nerdexam
Google

PROFESSIONAL-DATA-ENGINEER · Question #200

You are designing a data processing pipeline. The pipeline must be able to scale automatically as load increases. Messages must be processed at least once and must be ordered within windows of 1…

The correct answer is D. Use Cloud Pub/Sub for message ingestion and Cloud Dataflow for streaming analysis. You've hit your limit · resets 5am (America/New_York)

Submitted by deeparc· Mar 30, 2026Designing data processing systems

Question

You are designing a data processing pipeline. The pipeline must be able to scale automatically as load increases. Messages must be processed at least once and must be ordered within windows of 1 hour. How should you design the solution?

Options

  • AUse Apache Kafka for message ingestion and use Cloud Dataproc for streaming analysis.
  • BUse Apache Kafka for message ingestion and use Cloud Dataflow for streaming analysis.
  • CUse Cloud Pub/Sub for message ingestion and Cloud Dataproc for streaming analysis.
  • DUse Cloud Pub/Sub for message ingestion and Cloud Dataflow for streaming analysis.

How the community answered

(31 responses)
  • A
    6% (2)
  • B
    16% (5)
  • C
    3% (1)
  • D
    74% (23)

Explanation

You've hit your limit · resets 5am (America/New_York)

Topics

#Cloud Pub/Sub#Cloud Dataflow#streaming analysis#message ordering

Community Discussion

No community discussion yet for this question.

Full PROFESSIONAL-DATA-ENGINEER Practice