Google
PROFESSIONAL-DATA-ENGINEER · Question #193
You are creating a new pipeline in Google Cloud to stream IoT data from Cloud Pub/Sub through Cloud Dataflow to BigQuery. While previewing the data, you notice that roughly 2% of the data appears to b
You've hit your limit · resets 5am (America/New_York)
Submitted by katya_ua· Mar 30, 2026
Question
You are creating a new pipeline in Google Cloud to stream IoT data from Cloud Pub/Sub through Cloud Dataflow to BigQuery. While previewing the data, you notice that roughly 2% of the data appears to be corrupt. You need to modify the Cloud Dataflow pipeline to filter out this corrupt data. What should you do?
Options
- AAdd a SideInput that returns a Boolean if the element is corrupt.
- BAdd a ParDo transform in Cloud Dataflow to discard corrupt elements.
- CAdd a Partition transform in Cloud Dataflow to separate valid data from corrupt data.
- DAdd a GroupByKey transform in Cloud Dataflow to group all of the valid data together and discard the rest.
Explanation
You've hit your limit · resets 5am (America/New_York)
Community Discussion
No community discussion yet for this question.