A data analyst is using AWS Glue to organize, cleanse, validate, and format a 200 GB dataset. The data analyst triggered the job to run with the Standard worker type. After 3 hours, the AWS Glue job…

Question

Options

• AEnable job bookmarks in AWS Glue to estimate the number of data processing units (DPUs).
• BEnable job metrics in AWS Glue to estimate the number of data processing units (DPUs).
• CEnable job metrics in AWS Glue to estimate the number of data processing units (DPUs).
• DEnable job bookmarks in AWS Glue to estimate the number of data processing units (DPUs).

• A
  4% (1)
• B
  85% (22)
• C
  8% (2)
• D
  4% (1)

Explanation

Enabling job metrics in AWS Glue publishes execution metrics (such as CPU utilization, memory usage, and bytes read/written) to Amazon CloudWatch. By analyzing these metrics, the data analyst can determine whether the job is under-resourced (low CPU/memory utilization with long runtime) or at capacity, and calculate the optimal number of DPUs (Data Processing Units) needed. This is the correct approach to right-size the job without guessing or overprovisioning. Job bookmarks (Options A and D) are used to track which data has already been processed in incremental jobs - they help avoid reprocessing data, not tune performance for a job that is already running slowly on a full dataset.

No community discussion yet for this question.