nerdexam
Microsoft

DP-700 · Question #64

You're tasked with building a real-time analytics pipeline for a high-volume, low-latency application. The data source is a Kafka topic producing millions of events per second. Which streaming…

The correct answer is A. Azure Stream Analytics. For a high-volume, low-latency real-time analytics pipeline processing millions of events per second from a Kafka topic, Azure Stream Analytics is the most suitable fully managed streaming engine.

Design and implement data ingestion and transformation

Question

You're tasked with building a real-time analytics pipeline for a high-volume, low-latency application. The data source is a Kafka topic producing millions of events per second. Which streaming engine would be the most suitable choice for this scenario ?

Options

  • AAzure Stream Analytics
  • BAzure Synapse Analytics
  • CApache Spark Streaming
  • DAzure Databricks

How the community answered

(69 responses)
  • A
    94% (65)
  • B
    1% (1)
  • C
    1% (1)
  • D
    3% (2)

Why each option

For a high-volume, low-latency real-time analytics pipeline processing millions of events per second from a Kafka topic, Azure Stream Analytics is the most suitable fully managed streaming engine.

AAzure Stream AnalyticsCorrect

Azure Stream Analytics (ASA) is a fully managed, highly scalable, real-time event processing engine specifically designed for high-volume, low-latency stream analytics. It can ingest millions of events per second from sources like Kafka (via Event Hubs) and perform complex event processing, making it ideal for real-time analytics applications requiring immediate insights.

BAzure Synapse Analytics

Azure Synapse Analytics is a unified analytics platform, but its primary components are generally optimized for large-scale batch or micro-batch processing, not for continuous, event-by-event, sub-second latency processing of millions of events per second typical of pure real-time stream analytics.

CApache Spark Streaming

Apache Spark Streaming can handle real-time data, but it typically operates in micro-batches and requires managing a Spark cluster. While powerful, Azure Stream Analytics offers a more specialized, fully managed, and often simpler operational experience for pure real-time stream analytics at this scale and latency.

DAzure Databricks

Azure Databricks is a platform built on Apache Spark, enabling Spark Streaming. However, for a dedicated high-volume, low-latency real-time analytics pipeline, a fully managed service like Azure Stream Analytics is often more operationally efficient and directly suited for the specific task without the broader complexities of a Databricks environment.

Concept tested: Real-time streaming engine selection for high-volume, low-latency

Source: https://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-introduction

Topics

#Real-time analytics#Streaming data#Azure Stream Analytics#Kafka integration

Community Discussion

No community discussion yet for this question.

Full DP-700 Practice