DP-600 · Question #118
You have a Fabric workspace that contains a lakehouse named Lakehouse1. Lakehouse1 contains a Delta Parquet table named FactSales. You use a Describe command to review the history of FactSales and…
The correct answer is D. Run the VACUUM command under Maintenance. To reduce the size and number of files in a Delta Parquet table with many versions and a retention policy in a Fabric Lakehouse, the VACUUM command should be run under Maintenance.
Question
You have a Fabric workspace that contains a lakehouse named Lakehouse1. Lakehouse1 contains a Delta Parquet table named FactSales. You use a Describe command to review the history of FactSales and notice that you have over 1000 versions of the table, and the retention policy is six months. You need to reduce the size of the FactSales table and the number of files in the table. What should you configure on the table?
Options
- AApply V-Order under Maintenance.
- BDelete the FactSales table from Lakehouse1.
- CRun the OPTIMIZE command under Maintenance.
- DRun the VACUUM command under Maintenance.
How the community answered
(43 responses)- A2% (1)
- B16% (7)
- C9% (4)
- D72% (31)
Why each option
To reduce the size and number of files in a Delta Parquet table with many versions and a retention policy in a Fabric Lakehouse, the VACUUM command should be run under Maintenance.
Applying V-Order with OPTIMIZE optimizes the *layout* of current data files for read performance, not specifically to reduce the overall size by purging old versions or reducing the file count by removing unreferenced files.
Deleting the table would remove all data and metadata, which is an extreme measure and not a solution for managing table size and file count while retaining the table's current data.
The OPTIMIZE command primarily consolidates many small data files into fewer, larger files to improve read performance. While it reduces the *number* of files, its main purpose is not to reduce the *overall size* by purging old versions based on retention policy, which VACUUM handles.
The VACUUM command in Delta Lake is used to remove data files that are no longer referenced by the current version of the table and are older than the specified retention threshold. This directly reduces the overall storage size of the table and can decrease the number of underlying files by purging historical, unreferenced data, aligning with the goal of managing many versions and a retention policy.
Concept tested: Delta Lake table maintenance (VACUUM)
Source: https://learn.microsoft.com/en-us/fabric/data-engineering/delta-lake-vacuum
Topics
Community Discussion
No community discussion yet for this question.