DEA-C01 · Question #78
A company created an extract, transform, and load (ETL) data pipeline in AWS Glue. A data engineer must crawl a table that is in Microsoft SQL Server. The data engineer needs to extract, transform…
The correct answer is B. AWS Glue workflows. AWS Glue workflows provide native, built-in orchestration for Glue ETL pipelines at no additional cost beyond the Glue job execution itself. A workflow can chain crawlers, jobs, and triggers together-making it the ideal and most cost-effective choice when all components (crawl…
Question
A company created an extract, transform, and load (ETL) data pipeline in AWS Glue. A data engineer must crawl a table that is in Microsoft SQL Server. The data engineer needs to extract, transform, and load the output of the crawl to an Amazon S3 bucket. The data engineer also must orchestrate the data pipeline. Which AWS service or feature will meet these requirements MOST cost-effectively?
Options
- AAWS Step Functions
- BAWS Glue workflows
- CAWS Glue Studio
- DAmazon Managed Workflows for Apache Airflow (Amazon MWAA)
How the community answered
(30 responses)- A7% (2)
- B80% (24)
- C10% (3)
- D3% (1)
Explanation
AWS Glue workflows provide native, built-in orchestration for Glue ETL pipelines at no additional cost beyond the Glue job execution itself. A workflow can chain crawlers, jobs, and triggers together-making it the ideal and most cost-effective choice when all components (crawl, transform, load) are already within the Glue ecosystem. AWS Step Functions (A) is a general-purpose orchestrator that adds extra state-machine execution costs. AWS Glue Studio (C) is a visual authoring interface, not an orchestration service. Amazon MWAA (D) runs a fully managed Apache Airflow environment, which carries significant hourly infrastructure costs and is overkill for a single pipeline.
Topics
Community Discussion
No community discussion yet for this question.