nerdexam
Microsoft

DP-700 · Question #27

QUESTION 29 You have a Fabric workspace that contains a lakehouse and a notebook named Notebook1. Notebook1 reads data into a DataFrame from a table named Table1 and applies transformation logic…

The correct answer is C. OPTIMIZE. To consolidate underlying Parquet files in a Delta table within a Fabric lakehouse and improve query performance, the OPTIMIZE command should be used.

Monitor and optimize a data analytics solution

Question

QUESTION 29 You have a Fabric workspace that contains a lakehouse and a notebook named Notebook1. Notebook1 reads data into a DataFrame from a table named Table1 and applies transformation logic. The data from the DataFrame is then written to a new Delta table named Table2 by using a merge operation. You need to consolidate the underlying Parquet files in Table1. Which command should you run?

Options

  • AVACUUM
  • BBROADCAST
  • COPTIMIZE
  • DCACHE

How the community answered

(35 responses)
  • B
    3% (1)
  • C
    91% (32)
  • D
    6% (2)

Why each option

To consolidate underlying Parquet files in a Delta table within a Fabric lakehouse and improve query performance, the OPTIMIZE command should be used.

AVACUUM

VACUUM is used to remove old, unreferenced data files from a Delta table, not to consolidate existing files.

BBROADCAST

BROADCAST is a Spark SQL hint for query optimization in join operations, not a command for file management or consolidation.

COPTIMIZECorrect

The OPTIMIZE command in Delta Lake is specifically designed to rewrite data files to consolidate many small files into fewer, larger files. This process significantly improves query performance by reducing the overhead of reading numerous small files, which is a common issue with frequent data writes or merges.

DCACHE

CACHE is used to store data in memory or on disk for faster retrieval, not to consolidate the physical data files themselves.

Concept tested: Delta Lake file optimization and compaction

Source: https://learn.microsoft.com/en-us/azure/databricks/delta/optimize-performance/file-management#optimize

Topics

#Delta Lake#File optimization#Lakehouse#Data compaction

Community Discussion

No community discussion yet for this question.

Full DP-700 Practice