PROFESSIONAL-CLOUD-DATABASE-ENGINEER · Question #56
Your company is using Cloud SQL for MySQL with an internal (private) IP address and wants to replicate some tables into BigQuery in near-real time for analytics and machine learning. You need to ensur
The correct answer is D. Use Datastream to capture changes, and use Dataflow to write those changes to BigQuery.. Datastream is Google's serverless Change Data Capture (CDC) service that can connect to Cloud SQL for MySQL via private connectivity and stream row-level changes in near-real time. Dataflow then reads from the Datastream output and writes the changes into BigQuery using the Datas
Question
Your company is using Cloud SQL for MySQL with an internal (private) IP address and wants to replicate some tables into BigQuery in near-real time for analytics and machine learning. You need to ensure that replication is fast and reliable and uses Google-managed services. What should you do?
Options
- ADevelop a custom data replication service to send data into BigQuery.
- BUse Cloud SQL federated queries.
- CUse Database Migration Service to replicate tables into BigQuery.
- DUse Datastream to capture changes, and use Dataflow to write those changes to BigQuery.
How the community answered
(26 responses)- A8% (2)
- B4% (1)
- C12% (3)
- D77% (20)
Explanation
Datastream is Google's serverless Change Data Capture (CDC) service that can connect to Cloud SQL for MySQL via private connectivity and stream row-level changes in near-real time. Dataflow then reads from the Datastream output and writes the changes into BigQuery using the Datastream to BigQuery template, providing a fully managed, reliable, and scalable pipeline. Option A (custom replication service) is not a Google-managed service and adds operational burden. Option B (federated queries) allows BigQuery to query Cloud SQL directly but is not a replication mechanism and is not near-real-time. Option C (Database Migration Service) is designed for one-time database migrations, not continuous ongoing replication to BigQuery.
Topics
Community Discussion
No community discussion yet for this question.