A mining company is using Amazon S3 as its data lake. The company wants to analyze the data collected by the sensors in its mines. A data pipeline is being built to capture data from the sensors, inge

Question

Options

• AUse Amazon Data Firehose to invoke an AWS Lambda function that converts the data to Parquet
• BUse Amazon Kinesis Data Streams to invoke an AWS Lambda function that converts the data to
• CUse AWS DataSync to invoke an AWS Lambda function that converts the data to Parquet format
• DUse Amazon Simple Queue Service (Amazon SQS) to stream data directly to an AWS Glue job

• A
  74% (14)
• B
  5% (1)
• C
  16% (3)
• D
  5% (1)

Explanation

Amazon Kinesis Data Firehose (now known as Amazon Data Firehose) supports near-real-time streaming, with built-in support to: Invoke AWS Lambda functions for transformation. Store data directly into Amazon S3 in desired formats like Apache Parquet. "You can use Data Firehose to transform the data before delivering it, by invoking a Lambda function. You can convert to formats such as JSON or Apache Parquet before storing it into S3." Why not the others? B: Kinesis Data Streams requires more operational overhead than Firehose. C: DataSync is for file movement--not stream processing. D: SQS isn't designed for streaming and transformation pipelines.

No community discussion yet for this question.