nerdexam
AmazonAmazon

DAS-C01 · Question #112

DAS-C01 Question #112: Real Exam Question with Answer & Explanation

Sign in or unlock DAS-C01 to reveal the answer and full explanation for question #112. The question stem and answer options stay visible for context.

Processing

Question

An operations team notices that a few AWS Glue jobs for a given ETL application are failing. The AWS Glue jobs read a large number of small JOSN files from an Amazon S3 bucket and write the data to a different S3 bucket in Apache Parquet format with no major transformations. Upon initial investigation, a data engineer notices the following error message in the History tab on the AWS Glue console: "Command Failed with Exit Code 1." Upon further investigation, the data engineer notices that the driver memory profile of the failed jobs crosses the safe threshold of 50% usage quickly and reaches 90?5% soon after. The average memory usage across all executors continues to be less than 4%. The data engineer also notices the following error while examining the related Amazon CloudWatch Logs. What should the data engineer do to solve the failure in the MOST cost-effective way?

Options

  • AChange the worker type from Standard to G.2X.
  • BModify the AWS Glue ETL code to use the `groupFiles': `inPartition' feature.
  • CIncrease the fetch size setting by using AWS Glue dynamics frame.
  • DModify maximum capacity to increase the total maximum data processing units (DPUs) used.

Unlock DAS-C01 to see the answer

You've previewed enough free DAS-C01 questions. Unlock DAS-C01 for full answers, explanations, the timed quiz mode, progress tracking, and the master PDF. Question stem and options stay visible so you can still see what's on the exam.

Topics

#AWS Glue#Spark Driver Memory#Small Files Problem#Performance Optimization
Full DAS-C01 PracticeBrowse All DAS-C01 Questions