DP-700 · Question #27
QUESTION 29 You have a Fabric workspace that contains a lakehouse and a notebook named Notebook1. Notebook1 reads data into a DataFrame from a table named Table1 and applies transformation logic…
The correct answer is C. OPTIMIZE. To consolidate underlying Parquet files in a Delta table within a Fabric lakehouse and improve query performance, the OPTIMIZE command should be used.
Question
Options
- AVACUUM
- BBROADCAST
- COPTIMIZE
- DCACHE
How the community answered
(35 responses)- B3% (1)
- C91% (32)
- D6% (2)
Why each option
To consolidate underlying Parquet files in a Delta table within a Fabric lakehouse and improve query performance, the OPTIMIZE command should be used.
VACUUM is used to remove old, unreferenced data files from a Delta table, not to consolidate existing files.
BROADCAST is a Spark SQL hint for query optimization in join operations, not a command for file management or consolidation.
The OPTIMIZE command in Delta Lake is specifically designed to rewrite data files to consolidate many small files into fewer, larger files. This process significantly improves query performance by reducing the overhead of reading numerous small files, which is a common issue with frequent data writes or merges.
CACHE is used to store data in memory or on disk for faster retrieval, not to consolidate the physical data files themselves.
Concept tested: Delta Lake file optimization and compaction
Source: https://learn.microsoft.com/en-us/azure/databricks/delta/optimize-performance/file-management#optimize
Topics
Community Discussion
No community discussion yet for this question.