DATABRICKS-CERTIFIED-DATA-ENGINEER-ASSOCIATE · Question #24
A data engineer has realized that the data files associated with a Delta table are incredibly small. They want to compact the small files to form larger files to improve performance. Which of the…
The correct answer is B. OPTIMIZE. OPTIMIZE is a Delta Lake command that compacts many small Parquet files into fewer, larger files, improving read performance and reducing metadata overhead. REDUCE and COMPACTION are not valid Delta Lake commands. REPARTITION is a DataFrame operation used during writing, not a…
Question
Options
- AREDUCE
- BOPTIMIZE
- CCOMPACTION
- DREPARTITION
- EVACUUM
How the community answered
(36 responses)- A3% (1)
- B89% (32)
- D6% (2)
- E3% (1)
Explanation
OPTIMIZE is a Delta Lake command that compacts many small Parquet files into fewer, larger files, improving read performance and reducing metadata overhead. REDUCE and COMPACTION are not valid Delta Lake commands. REPARTITION is a DataFrame operation used during writing, not a SQL command for compacting existing table files. VACUUM removes old, unreferenced files based on a retention period but does not compact existing files.
Topics
Community Discussion
No community discussion yet for this question.