PROFESSIONAL-MACHINE-LEARNING-ENGINEER · Question #124
You need to analyze user activity data from your company's mobile applications. Your team will use BigQuery for data analysis, transformation, and experimentation with ML algorithms. You need to ensur
The correct answer is A. Configure Pub/Sub to stream the data into BigQuery.. Pub/Sub supports a native BigQuery subscription type that writes messages directly into a BigQuery table in real time, with no intermediate pipeline required. This is the simplest, most direct path to real-time ingestion and the lowest-operational-overhead solution. Option D (Pub
Question
Options
- AConfigure Pub/Sub to stream the data into BigQuery.
- BRun an Apache Spark streaming job on Dataproc to ingest the data into BigQuery.
- CRun a Dataflow streaming job to ingest the data into BigQuery.
- DConfigure Pub/Sub and a Dataflow streaming job to ingest the data into BigQuery,
How the community answered
(17 responses)- A94% (16)
- D6% (1)
Explanation
Pub/Sub supports a native BigQuery subscription type that writes messages directly into a BigQuery table in real time, with no intermediate pipeline required. This is the simplest, most direct path to real-time ingestion and the lowest-operational-overhead solution. Option D (Pub/Sub + Dataflow) is a valid pattern but adds unnecessary complexity when Pub/Sub can write to BigQuery directly. Option C (Dataflow streaming alone) omits the message ingestion layer. Option B (Spark on Dataproc) is designed for batch or micro-batch processing and is heavier to manage than a fully managed streaming solution for this straightforward ingestion use case.
Topics
Community Discussion
No community discussion yet for this question.