DEA-C01 · Question #253
A data engineer is using an Apache Iceberg framework to build a data lake that contains 100 ТВ of data. The data engineer wants to run AWS Glue Apache Spark jobs that use the Iceberg framework. What…
The correct answer is B. Specify the path to a specific version of Iceberg by using the -extra-jars job parameter. Set C. Set Iceberg as a value for the --datalake-formats job parameter. To run AWS Glue Apache Spark jobs with the Apache Iceberg framework, you must: Set --datalake-formats to iceberg so Glue knows to use the Iceberg format. Specify the Iceberg library by using the --extra-jars parameter to include the appropriate Iceberg JAR files for Glue to…
Question
A data engineer is using an Apache Iceberg framework to build a data lake that contains 100 ТВ of data. The data engineer wants to run AWS Glue Apache Spark jobs that use the Iceberg framework. What combination of steps will meet these requirements? (Choose two.)
Options
- ACreate a key named --conf for an AWS Glue job. Set Iceberg as a value for the --datalake-formats
- BSpecify the path to a specific version of Iceberg by using the -extra-jars job parameter. Set
- CSet Iceberg as a value for the --datalake-formats job parameter.
- DSet the --enable-auto-scaling parameter to true.
- EAdd the --job-bookmark-option: job-bookmark-enable parameter to an AWS Glue job.
How the community answered
(59 responses)- A17% (10)
- B71% (42)
- D3% (2)
- E8% (5)
Explanation
To run AWS Glue Apache Spark jobs with the Apache Iceberg framework, you must: Set --datalake-formats to iceberg so Glue knows to use the Iceberg format. Specify the Iceberg library by using the --extra-jars parameter to include the appropriate Iceberg JAR files for Glue to access the Iceberg table format.
Topics
Community Discussion
No community discussion yet for this question.