DP-700 · Question #64
You're tasked with building a real-time analytics pipeline for a high-volume, low-latency application. The data source is a Kafka topic producing millions of events per second. Which streaming…
The correct answer is A. Azure Stream Analytics. For a high-volume, low-latency real-time analytics pipeline processing millions of events per second from a Kafka topic, Azure Stream Analytics is the most suitable fully managed streaming engine.
Question
Options
- AAzure Stream Analytics
- BAzure Synapse Analytics
- CApache Spark Streaming
- DAzure Databricks
How the community answered
(69 responses)- A94% (65)
- B1% (1)
- C1% (1)
- D3% (2)
Why each option
For a high-volume, low-latency real-time analytics pipeline processing millions of events per second from a Kafka topic, Azure Stream Analytics is the most suitable fully managed streaming engine.
Azure Stream Analytics (ASA) is a fully managed, highly scalable, real-time event processing engine specifically designed for high-volume, low-latency stream analytics. It can ingest millions of events per second from sources like Kafka (via Event Hubs) and perform complex event processing, making it ideal for real-time analytics applications requiring immediate insights.
Azure Synapse Analytics is a unified analytics platform, but its primary components are generally optimized for large-scale batch or micro-batch processing, not for continuous, event-by-event, sub-second latency processing of millions of events per second typical of pure real-time stream analytics.
Apache Spark Streaming can handle real-time data, but it typically operates in micro-batches and requires managing a Spark cluster. While powerful, Azure Stream Analytics offers a more specialized, fully managed, and often simpler operational experience for pure real-time stream analytics at this scale and latency.
Azure Databricks is a platform built on Apache Spark, enabling Spark Streaming. However, for a dedicated high-volume, low-latency real-time analytics pipeline, a fully managed service like Azure Stream Analytics is often more operationally efficient and directly suited for the specific task without the broader complexities of a Databricks environment.
Concept tested: Real-time streaming engine selection for high-volume, low-latency
Source: https://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-introduction
Topics
Community Discussion
No community discussion yet for this question.