nerdexam
Google

PROFESSIONAL-CLOUD-DATABASE-ENGINEER · Question #56

Your company is using Cloud SQL for MySQL with an internal (private) IP address and wants to replicate some tables into BigQuery in near-real time for analytics and machine learning. You need to ensur

The correct answer is D. Use Datastream to capture changes, and use Dataflow to write those changes to BigQuery.. Datastream is Google's serverless Change Data Capture (CDC) service that can connect to Cloud SQL for MySQL via private connectivity and stream row-level changes in near-real time. Dataflow then reads from the Datastream output and writes the changes into BigQuery using the Datas

Designing and Implementing Data Replication and Integration Solutions

Question

Your company is using Cloud SQL for MySQL with an internal (private) IP address and wants to replicate some tables into BigQuery in near-real time for analytics and machine learning. You need to ensure that replication is fast and reliable and uses Google-managed services. What should you do?

Options

  • ADevelop a custom data replication service to send data into BigQuery.
  • BUse Cloud SQL federated queries.
  • CUse Database Migration Service to replicate tables into BigQuery.
  • DUse Datastream to capture changes, and use Dataflow to write those changes to BigQuery.

How the community answered

(26 responses)
  • A
    8% (2)
  • B
    4% (1)
  • C
    12% (3)
  • D
    77% (20)

Explanation

Datastream is Google's serverless Change Data Capture (CDC) service that can connect to Cloud SQL for MySQL via private connectivity and stream row-level changes in near-real time. Dataflow then reads from the Datastream output and writes the changes into BigQuery using the Datastream to BigQuery template, providing a fully managed, reliable, and scalable pipeline. Option A (custom replication service) is not a Google-managed service and adds operational burden. Option B (federated queries) allows BigQuery to query Cloud SQL directly but is not a replication mechanism and is not near-real-time. Option C (Database Migration Service) is designed for one-time database migrations, not continuous ongoing replication to BigQuery.

Topics

#Data Replication#Change Data Capture#Cloud SQL#BigQuery

Community Discussion

No community discussion yet for this question.

Full PROFESSIONAL-CLOUD-DATABASE-ENGINEER Practice