nerdexam
Amazon

DEA-C01 · Question #71

A data engineer must manage the ingestion of real-time streaming data into AWS. The data engineer wants to perform real-time analytics on the incoming streaming data by using time- based aggregations

The correct answer is D. Use Amazon Managed Service for Apache Flink (previously known as Amazon Kinesis Data. To perform real-time analytics on incoming streaming data using time-based aggregations over a 30-minute window with high fault tolerance and least operational overhead, Amazon Managed Service for Apache Flink is the ideal solution.

Data Ingestion and Transformation

Question

A data engineer must manage the ingestion of real-time streaming data into AWS. The data engineer wants to perform real-time analytics on the incoming streaming data by using time- based aggregations over a window of up to 30 minutes. The data engineer needs a solution that is highly fault tolerant. Which solution will meet these requirements with the LEAST operational overhead?

Options

  • AUse an AWS Lambda function that includes both the business and the analytics logic to perform
  • BUse Amazon Managed Service for Apache Flink (previously known as Amazon Kinesis Data
  • CUse an AWS Lambda function that includes both the business and the analytics logic to perform
  • DUse Amazon Managed Service for Apache Flink (previously known as Amazon Kinesis Data

How the community answered

(48 responses)
  • A
    10% (5)
  • B
    4% (2)
  • C
    2% (1)
  • D
    83% (40)

Why each option

To perform real-time analytics on incoming streaming data using time-based aggregations over a 30-minute window with high fault tolerance and least operational overhead, Amazon Managed Service for Apache Flink is the ideal solution.

AUse an AWS Lambda function that includes both the business and the analytics logic to perform

While AWS Lambda functions are serverless, implementing complex time-based windowed aggregations and ensuring high fault tolerance and state management across invocations for streaming data requires significant custom development and operational overhead, especially for windows up to 30 minutes.

BUse Amazon Managed Service for Apache Flink (previously known as Amazon Kinesis Data

This option is identical to option D, which is the correct solution; however, option D is designated as the primary correct answer.

CUse an AWS Lambda function that includes both the business and the analytics logic to perform

Using an AWS Lambda function with Amazon DynamoDB for storing aggregations introduces significant operational overhead for managing state, ensuring consistency, and handling fault tolerance across many Lambda invocations for real-time, time-based windowed aggregations.

DUse Amazon Managed Service for Apache Flink (previously known as Amazon Kinesis DataCorrect

Amazon Managed Service for Apache Flink is a fully managed, highly fault-tolerant service specifically designed for processing real-time streaming data, offering built-in capabilities for time-based windowed aggregations, which directly meets the requirements with minimal operational overhead.

Concept tested: Real-time streaming analytics with Apache Flink

Source: https://aws.amazon.com/managed-service-for-apache-flink/

Topics

#Real-time data processing#Stream analytics#Windowed aggregations#Amazon Managed Service for Apache Flink

Community Discussion

No community discussion yet for this question.

Full DEA-C01 Practice