MLS-C01 · Question #361
A cybersecurity company is collecting on-premises server logs, mobile app logs, and IoT sensor data. The company backs up the ingested data in an Amazon S3 bucket and sends the ingested data to…
The correct answer is D. Create one Amazon Kinesis data stream. Create one Amazon Data Firehose delivery stream to. To create a serverless, automatically scaling ingestion pipeline for logs and sensor data that delivers to both Amazon S3 and Amazon OpenSearch Service, the most cost-effective solution involves using an Amazon Kinesis Data Stream as the central ingestion buffer.
Question
A cybersecurity company is collecting on-premises server logs, mobile app logs, and IoT sensor data. The company backs up the ingested data in an Amazon S3 bucket and sends the ingested data to Amazon OpenSearch Service for further analysis. Currently, the company has a custom ingestion pipeline that is running on Amazon EC2 instances. The company needs to implement a new serverless ingestion pipeline that can automatically scale to handle sudden changes in the data flow. Which solution will meet these requirements MOST cost-effectively?
Options
- ACreate two Amazon Data Firehose delivery streams to send data to the S3 bucket and
- BCreate one Amazon Kinesis data stream. Create two Amazon Data Firehose delivery streams to
- CCreate one Amazon Data Firehose delivery stream to send data to OpenSearch Service.
- DCreate one Amazon Kinesis data stream. Create one Amazon Data Firehose delivery stream to
How the community answered
(44 responses)- A9% (4)
- B18% (8)
- C27% (12)
- D45% (20)
Why each option
To create a serverless, automatically scaling ingestion pipeline for logs and sensor data that delivers to both Amazon S3 and Amazon OpenSearch Service, the most cost-effective solution involves using an Amazon Kinesis Data Stream as the central ingestion buffer.
While creating two Kinesis Data Firehose streams is serverless and scalable, this approach lacks the explicit buffering and robust handling of severe 'sudden changes in data flow' that a dedicated Kinesis Data Stream provides, potentially leading to throttling or backpressure issues for producers.
This option describes a robust and scalable solution, similar to the intended solution for D, but if the truncated portion of D implies a configuration with fewer Firehose streams (e.g., direct OpenSearch ingestion from KDS), then B might be considered less cost-effective due to the explicit use of two Firehose streams for both destinations.
Creating only one Amazon Data Firehose delivery stream to OpenSearch Service fails to meet the requirement of backing up the ingested data to an Amazon S3 bucket.
Creating one Amazon Kinesis Data Stream centralizes the ingestion pipeline, providing a scalable and durable buffer to absorb sudden changes in data flow from diverse sources. One or more Amazon Kinesis Data Firehose delivery streams can then consume from this Kinesis Data Stream to cost-effectively deliver the data in a serverless manner to both Amazon S3 for backup and Amazon OpenSearch Service for analysis, meeting all scalability and serverless requirements.
Concept tested: Real-time streaming data ingestion and fan-out
Source: https://aws.amazon.com/kinesis/data-streams/features/
Topics
Community Discussion
No community discussion yet for this question.