You plan to create a Microsoft Azure Data Factory pipeline that will connect to an Azure HDInsight cluster that uses Apache Spark. You need to recommend which file format must be used by the…

The correct answer is D. Parquet. Apache Parquet is a columnar storage format available to any project in the Hadoop ecosystem, regardless of the choice of data processing framework, data model or programming language. Apache Parquet supports compression. Incorrect Answers: A: Azure Data Factory does not…

Implement Big Data batch processing solutions

Question

You plan to create a Microsoft Azure Data Factory pipeline that will connect to an Azure HDInsight cluster that uses Apache Spark. You need to recommend which file format must be used by the pipeline. The solution must meet the following requirements: - Store data in the columnar format - Support compression Which file format should you recommend?

Options

AXML
BAVRO
Ctext
DParquet

How the community answered

(47 responses)

A
6% (3)
B
11% (5)
C
2% (1)
D
81% (38)

Explanation

Apache Parquet is a columnar storage format available to any project in the Hadoop ecosystem, regardless of the choice of data processing framework, data model or programming language. Apache Parquet supports compression. Incorrect Answers: A: Azure Data Factory does not support XML. C: The text format does not support compression. Note: Azure Data Factory supports the following file format types:

Topics

#Azure Data Factory#HDInsight Spark#Parquet#columnar format

Community Discussion

No community discussion yet for this question.

Full 70-475 Practice