nerdexam
Amazon

DEA-C01 · Question #187

A car sales company maintains data about cars that are listed for sale in an area. The company receives data about new car listings from vendors who upload the data daily as compressed files into…

The correct answer is D. Use AWS Glue to process incoming data. Use AWS Lambda and S3 Event Notifications to. AWS Glue is a fully managed ETL (Extract, Transform, Load) service that is cost-effective and scalable for processing incoming data. It can handle the compressed data files efficiently. S3 Event Notifications and AWS Lambda provide a low-cost, serverless orchestration solution…

Data Ingestion and Transformation

Question

A car sales company maintains data about cars that are listed for sale in an area. The company receives data about new car listings from vendors who upload the data daily as compressed files into Amazon S3. The compressed files are up to 5 KB in size. The company wants to see the most up-to- date listings as soon as the data is uploaded to Amazon S3. A data engineer must automate and orchestrate the data processing workflow of the listings to feed a dashboard. The data engineer must also provide the ability to perform one-time queries and analytical reporting. The query solution must be scalable. Which solution will meet these requirements MOST cost-effectively?

Options

  • AUse an Amazon EMR cluster to process incoming data. Use AWS Step Functions to orchestrate
  • BUse a provisioned Amazon EMR cluster to process incoming data. Use AWS Step Functions to
  • CUse AWS Glue to process incoming data. Use AWS Step Functions to orchestrate workflows.
  • DUse AWS Glue to process incoming data. Use AWS Lambda and S3 Event Notifications to

How the community answered

(24 responses)
  • A
    4% (1)
  • B
    8% (2)
  • C
    21% (5)
  • D
    67% (16)

Explanation

AWS Glue is a fully managed ETL (Extract, Transform, Load) service that is cost-effective and scalable for processing incoming data. It can handle the compressed data files efficiently. S3 Event Notifications and AWS Lambda provide a low-cost, serverless orchestration solution that automatically triggers workflows as soon as new files are uploaded to S3. This ensures real- time or near real-time processing of the data without the need to manage long-running services Amazon Athena is a serverless, scalable query service that allows users to run SQL queries on data directly in S3, which is ideal for one-time queries and analytical reporting without provisioning infrastructure. Amazon QuickSight provides a cost-effective, fully managed service for visualizing the data, making it suitable for the dashboard requirements. This solution is cost-effective because it minimizes the need for provisioned infrastructure and uses serverless and managed services like Lambda, Glue, Athena, and QuickSight, all of which automatically scale with demand.

Topics

#Data Ingestion#ETL#Serverless Architecture#Workflow Orchestration

Community Discussion

No community discussion yet for this question.

Full DEA-C01 Practice