DEA-C01 · Question #136
A company is creating near real-time dashboards to visualize time series data. The company ingests data into Amazon Managed Streaming for Apache Kafka (Amazon MSK). A customized data pipeline…
The correct answer is A. Create OpenSearch Dashboards by using the data from OpenSearch Service. To visualize near real-time time series data with the least latency, leveraging OpenSearch Dashboards directly from data already written to Amazon OpenSearch Service is the most efficient solution.
Question
A company is creating near real-time dashboards to visualize time series data. The company ingests data into Amazon Managed Streaming for Apache Kafka (Amazon MSK). A customized data pipeline consumes the data. The pipeline then writes data to Amazon Keyspaces (for Apache Cassandra), Amazon OpenSearch Service, and Apache Avro objects in Amazon S3. Which solution will make the data available for the data visualizations with the LEAST latency?
Options
- ACreate OpenSearch Dashboards by using the data from OpenSearch Service.
- BUse Amazon Athena with an Apache Hive metastore to query the Avro objects in Amazon S3.
- CUse Amazon Athena to query the data from the Avro objects in Amazon S3. Configure Amazon
- DUse AWS Glue to catalog the data. Use S3 Select to query the Avro objects in Amazon S3.
How the community answered
(49 responses)- A57% (28)
- B24% (12)
- C12% (6)
- D6% (3)
Why each option
To visualize near real-time time series data with the least latency, leveraging OpenSearch Dashboards directly from data already written to Amazon OpenSearch Service is the most efficient solution.
Amazon OpenSearch Service is specifically designed for real-time analytics and full-text search, making it highly optimized for ingesting, indexing, and querying time series data with low latency, and its integrated OpenSearch Dashboards provide immediate visualization capabilities.
Using Amazon Athena to query Avro objects in Amazon S3 involves data scanning over S3, which introduces higher latency compared to querying an indexed, purpose-built analytics service like OpenSearch Service for near real-time dashboards.
Querying data directly from Avro objects in Amazon S3 using Athena is suitable for ad-hoc queries but typically has higher latency for near real-time dashboarding requirements compared to Amazon OpenSearch Service.
While AWS Glue catalogs data for S3, and S3 Select can retrieve specific data from files, this combination is not optimized for serving near real-time dashboards efficiently across potentially large volumes of time series data compared to Amazon OpenSearch Service.
Concept tested: Real-time analytics and visualization with OpenSearch
Source: https://aws.amazon.com/opensearch-service/
Topics
Community Discussion
No community discussion yet for this question.