nerdexam
Amazon

MLS-C01 · Question #316

A data engineer is preparing a dataset that a retail company will use to predict the number of visitors to stores. The data engineer created an Amazon S3 bucket. The engineer subscribed the S3…

The correct answer is C. Use an S3 event on the AWS Data Exchange S3 bucket to invoke an AWS Lambda function. To cost-effectively merge economic indicator data from AWS Data Exchange to an Athena table within a 30-60 minute timeframe, an S3 event triggering an AWS Lambda function is the most suitable solution.

Data Engineering

Question

A data engineer is preparing a dataset that a retail company will use to predict the number of visitors to stores. The data engineer created an Amazon S3 bucket. The engineer subscribed the S3 bucket to an AWS Data Exchange data product for general economic indicators. The data engineer wants to join the economic indicator data to an existing table in Amazon Athena to merge with the business data. All these transformations must finish running in 30-60 minutes. Which solution will meet these requirements MOST cost-effectively?

Options

  • AConfigure the AWS Data Exchange product as a producer for an Amazon Kinesis data stream.
  • BUse an S3 event on the AWS Data Exchange S3 bucket to invoke an AWS Lambda function.
  • CUse an S3 event on the AWS Data Exchange S3 bucket to invoke an AWS Lambda function.
  • DProvision an Amazon Redshift cluster. Subscribe to the AWS Data Exchange product and use the

How the community answered

(35 responses)
  • A
    17% (6)
  • B
    26% (9)
  • C
    51% (18)
  • D
    6% (2)

Why each option

To cost-effectively merge economic indicator data from AWS Data Exchange to an Athena table within a 30-60 minute timeframe, an S3 event triggering an AWS Lambda function is the most suitable solution.

AConfigure the AWS Data Exchange product as a producer for an Amazon Kinesis data stream.

AWS Data Exchange products deliver data to S3, not directly as producers to Kinesis Data Streams; configuring this would require additional, complex, and potentially costly custom integration, and is not a native Data Exchange feature.

BUse an S3 event on the AWS Data Exchange S3 bucket to invoke an AWS Lambda function.

This choice is identical to C and thus would also be correct if it were the selected answer. However, if C is the designated correct answer, this choice serves as a duplicate.

CUse an S3 event on the AWS Data Exchange S3 bucket to invoke an AWS Lambda function.Correct

When new economic indicator data arrives in the S3 bucket (from AWS Data Exchange), an S3 event can trigger an AWS Lambda function. The Lambda function can then process this new data, perform the necessary transformations, and update the existing Amazon Athena table or its underlying S3 data, offering a serverless, cost-effective, and event-driven approach that meets the 30-60 minute requirement.

DProvision an Amazon Redshift cluster. Subscribe to the AWS Data Exchange product and use the

Provisioning an Amazon Redshift cluster for this specific task would be significantly more expensive for an infrequent data merge operation compared to a serverless Lambda function, and Redshift is typically used for data warehousing, not directly for merging with Athena tables.

Concept tested: Event-driven data processing with S3 and Lambda

Source: https://docs.aws.amazon.com/lambda/latest/dg/with-s3.html

Topics

#AWS Data Exchange#S3 Event Notifications#Serverless Data Processing#Cost Optimization

Community Discussion

No community discussion yet for this question.

Sign up to join the discussion
Full MLS-C01 Practice