nerdexam
Microsoft

DP-700 · Question #124

You need to add a new set of data to the bronze layer. This data is in an Azure Data Lake Storage Gen2 account and consists of CSV files. You need to ensure that this data can be ingested and…

The correct answer is D. Create a shortcut in the bronze layer lakehouse pointing to the Azure Data Lake Storage Gen2 account. The user needs to efficiently ingest CSV data from ADLS Gen2 into a Fabric Lakehouse bronze layer for processing.

Design and implement data ingestion and transformation

Question

You need to add a new set of data to the bronze layer. This data is in an Azure Data Lake Storage Gen2 account and consists of CSV files. You need to ensure that this data can be ingested and processed efficiently into the bronze layer. What should you do?

Exhibit

DP-700 question #124 exhibit

Options

  • ACreate an external table in the bronze layer lakehouse.
  • BUse a Dataflow Gen2 to ingest the CSV files and transform them into Delta Lake format within the bronze layer lakehouse.
  • CUpload the CSV files directly to the bronze layer lakehouse using the Lakehouse explorer.
  • DCreate a shortcut in the bronze layer lakehouse pointing to the Azure Data Lake Storage Gen2 account.

How the community answered

(42 responses)
  • A
    14% (6)
  • B
    5% (2)
  • C
    7% (3)
  • D
    74% (31)

Why each option

The user needs to efficiently ingest CSV data from ADLS Gen2 into a Fabric Lakehouse bronze layer for processing.

ACreate an external table in the bronze layer lakehouse.

Creating an external table would define the schema over the existing CSV files but doesn't explicitly link them into the Lakehouse structure for seamless integration and processing as efficiently as a shortcut does.

BUse a Dataflow Gen2 to ingest the CSV files and transform them into Delta Lake format within the bronze layer lakehouse.

Using Dataflow Gen2 would involve ingesting and transforming the data into Delta Lake format, which is suitable for subsequent layers (silver/gold), but for the bronze layer, the goal is often to land raw data efficiently without initial transformation.

CUpload the CSV files directly to the bronze layer lakehouse using the Lakehouse explorer.

Uploading the CSV files directly copies the data, leading to duplication and potentially increased storage costs, which is less efficient than directly linking to the existing data in ADLS Gen2 via a shortcut.

DCreate a shortcut in the bronze layer lakehouse pointing to the Azure Data Lake Storage Gen2 account.Correct

Creating a shortcut in the bronze layer Lakehouse that points to the Azure Data Lake Storage Gen2 account allows direct access to the CSV files without data duplication. This is efficient as it avoids ingestion time and storage costs for the initial bronze layer and enables immediate processing of the external data.

Concept tested: Efficient data ingestion to Fabric Lakehouse bronze layer using shortcuts

Source: https://learn.microsoft.com/fabric/data-engineering/lakehouse-shortcuts

Topics

#Data Ingestion#Azure Data Lake Storage Gen2#Lakehouse Shortcuts#Bronze Layer

Community Discussion

No community discussion yet for this question.

Full DP-700 Practice