nerdexam
Microsoft

DP-203 · Question #373

You have an Azure Data Lake Storage Gen2 account named account1 and an Azure event hub named Hub1. Data is written to account1 by using Event Hubs Capture. You plan to query account by using an…

The correct answer is A. Parquet. Parquet showed either similar or better results on every test [than Avro]. The query-performance differences on the larger datasets in Parquet’s favor are partly due to the compression results; when querying the wide dataset, Spark had to read 3.5x less data for Parquet than…

Submitted by anjalisingh· Mar 30, 2026Develop data processing

Question

You have an Azure Data Lake Storage Gen2 account named account1 and an Azure event hub named Hub1. Data is written to account1 by using Event Hubs Capture. You plan to query account by using an Apache Spark pool in Azure Synapse Analytics. You need to create a notebook and ingest the data from account1. The solution must meet the following requirements:

  • Retrieve multiple rows of records in their entirety.
  • Minimize query execution time.
  • Minimize data processing.

Which data format should you use?

Options

  • AParquet
  • BAvro
  • CORC
  • DJSON

How the community answered

(58 responses)
  • A
    78% (45)
  • B
    12% (7)
  • C
    7% (4)
  • D
    3% (2)

Explanation

Parquet showed either similar or better results on every test [than Avro]. The query-performance differences on the larger datasets in Parquet’s favor are partly due to the compression results; when querying the wide dataset, Spark had to read 3.5x less data for Parquet than Avro. Avro did not perform well when processing the entire dataset, as suspected. https://blog.cloudera.com/benchmarking-apache-parquet-the-allstate-experience/

Topics

#Parquet#Event Hubs Capture#data formats#Spark ingestion

Community Discussion

No community discussion yet for this question.

Sign up to join the discussion
Full DP-203 Practice