PROFESSIONAL-DATA-ENGINEER · Question #324
You have designed an Apache Beam processing pipeline that reads from a Pub/Sub topic. The topic has a message retention duration of one day, and writes to a Cloud Storage bucket. You need to select…
The correct answer is A. 1. Use a dual-region Cloud Storage bucket. Option A is correct because a dual-region Cloud Storage bucket provides geographic redundancy - if one region fails, data remains accessible from the other - and critically, the Pub/Sub topic's 1-day message retention acts as the recovery mechanism: when the outage resolves…
Question
Options
- A
- Use a dual-region Cloud Storage bucket.
- C
- Use a regional Cloud Storage bucket.
- D
- Use a dual-region Cloud Storage bucket with turbo replication enabled.
How the community answered
(68 responses)- A74% (50)
- C7% (5)
- D19% (13)
Explanation
Option A is correct because a dual-region Cloud Storage bucket provides geographic redundancy - if one region fails, data remains accessible from the other - and critically, the Pub/Sub topic's 1-day message retention acts as the recovery mechanism: when the outage resolves, the Beam pipeline can seek back and replay up to 24 hours of messages, easily satisfying a 15-minute RPO without needing turbo replication.
Option C (regional bucket) is wrong because a single-region bucket becomes entirely inaccessible during a regional outage - there's no failover, so writes are lost and unrecoverable from storage. Option D (dual-region + turbo replication) is wrong not because it wouldn't work, but because it's unnecessary: turbo replication guarantees 15-minute cross-region sync for newly written objects, but since Pub/Sub retention already covers replay well beyond 15 minutes, paying for turbo replication adds cost without solving a real gap.
Memory tip: Ask yourself "Can I replay from the source?" - when the answer is yes (Pub/Sub retention ≥ RPO), standard dual-region storage is sufficient. Reach for turbo replication only when your source data is ephemeral and you must rely on the storage layer itself to meet your RPO.
Topics
Community Discussion
No community discussion yet for this question.