MLS-C01 · Question #58
A Machine Learning Specialist is developing a daily ETL workflow containing multiple ETL jobs. The workflow consists of the following processes: - Start the workflow as soon as data is uploaded to…
The correct answer is A. Use AWS Lambda to trigger an AWS Step Functions workflow to wait for dataset uploads to. S3 events can trigger AWS Lambda function. Step Functions can be used to implement a workflow. In this case, wait for all the datasets to be loaded before triggering the glue job. https://docs.aws.amazon.com/step-functions/latest/dg/tutorial-cloudwatch-events-s3.html
Question
A Machine Learning Specialist is developing a daily ETL workflow containing multiple ETL jobs. The workflow consists of the following processes:
- Start the workflow as soon as data is uploaded to Amazon S3.
- When all the datasets are available in Amazon S3, start an ETL job to
join the uploaded datasets with multiple terabyte-sized datasets already stored in Amazon S3.
- Store the results of joining datasets in Amazon S3.
- If one of the jobs fails, send a notification to the Administrator.
Which configuration will meet these requirements?
Options
- AUse AWS Lambda to trigger an AWS Step Functions workflow to wait for dataset uploads to
- BDevelop the ETL workflow using AWS Lambda to start an Amazon SageMaker notebook
- CDevelop the ETL workflow using AWS Batch to trigger the start of ETL jobs when data is
- DUse AWS Lambda to chain other Lambda functions to read and join the datasets in Amazon S3
How the community answered
(25 responses)- A72% (18)
- B8% (2)
- C16% (4)
- D4% (1)
Explanation
S3 events can trigger AWS Lambda function. Step Functions can be used to implement a workflow. In this case, wait for all the datasets to be loaded before triggering the glue job. https://docs.aws.amazon.com/step-functions/latest/dg/tutorial-cloudwatch-events-s3.html
Topics
Community Discussion
No community discussion yet for this question.