PROFESSIONAL-DATA-ENGINEER · Question #228
You receive data files in CSV format monthly from a third party. You need to cleanse this data, but every third month the schema of the files changes. Your requirements for implementing these…
The correct answer is A. Use Cloud Dataprep to build and maintain the transformation recipes, and execute them on a scheduled basis. Cloud Dataprep is the right choice because it's a managed, serverless service purpose-built for visually preparing and transforming data - it provides a graphical interface for building "transformation recipes," supports scheduled execution, and is designed for non-developer…
Question
Options
- AUse Cloud Dataprep to build and maintain the transformation recipes, and execute them on a scheduled basis
- BLoad each month's CSV data into BigQuery, and write a SQL query to transform the data to a standard schema.
- CHelp the analysts write a Cloud Dataflow pipeline in Python to perform the transformation.
- DUse Apache Spark on Cloud Dataproc to infer the schema of the CSV file before creating a Dataframe.
How the community answered
(36 responses)- A81% (29)
- B11% (4)
- C3% (1)
- D6% (2)
Explanation
Cloud Dataprep is the right choice because it's a managed, serverless service purpose-built for visually preparing and transforming data - it provides a graphical interface for building "transformation recipes," supports scheduled execution, and is designed for non-developer users like analysts without requiring any coding.
Option B is wrong because writing SQL in BigQuery requires developer/SQL skills and provides no graphical design tool for transformations. Option C fails because writing a Dataflow pipeline in Python explicitly requires developer expertise, directly contradicting the "non-developer analysts" requirement. Option D is wrong because Cloud Dataproc/Spark is a general-purpose big data processing engine - it has no built-in graphical transformation designer and still requires engineering skill to use.
Memory tip: Think of Dataprep as "Excel for cloud data pipelines" - it's the only GCP tool in this list that combines a Graphical interface, Scheduling, and Self-service for analysts (no code). Whenever an exam question mentions analysts + visual + scheduled transformations together, that triple signal points directly to Dataprep.
Topics
Community Discussion
No community discussion yet for this question.