DEA-C01 · Question #231
A company receives marketing campaign data from a vendor. The company ingests the data into an Amazon S3 bucket every 40 to 60 minutes. The data is in CSV format. File sizes are between 100 KB and…
The correct answer is A. Create an AWS Lambda function that connects to Amazon Redshift and runs a COPY command. Configuring your S3 bucket to emit "Object Created" events into EventBridge and using a rule to invoke a lightweight Lambda function lets you automatically run a Redshift COPY for each new CSV. This serverless, event-driven pattern requires no continuously running…
Question
A company receives marketing campaign data from a vendor. The company ingests the data into an Amazon S3 bucket every 40 to 60 minutes. The data is in CSV format. File sizes are between 100 KB and 300 KB. A data engineer needs to set-up an extract, transform, and load (ETL) pipeline to upload the content of each file to Amazon Redshift. Which solution will meet these requirements with the LEAST operational overhead?
Options
- ACreate an AWS Lambda function that connects to Amazon Redshift and runs a COPY command.
- BCreate an Amazon Data Firehose stream. Configure the stream to use an AWS Lambda function
- CUse Amazon Redshift Spectrum to query the S3 bucket. Configure an AWS Glue Crawler for the
- DCreates an AWS Database Migration Service (AWS DMS) task. Specify an appropriate data
How the community answered
(21 responses)- A76% (16)
- B10% (2)
- C10% (2)
- D5% (1)
Explanation
Configuring your S3 bucket to emit "Object Created" events into EventBridge and using a rule to invoke a lightweight Lambda function lets you automatically run a Redshift COPY for each new CSV. This serverless, event-driven pattern requires no continuously running infrastructure and has minimal operational overhead.
Topics
Community Discussion
No community discussion yet for this question.