Your team is responsible for developing and maintaining ETLs in your company. One of your Dataflow jobs is failing because of some errors in the input data, and you need to improve reliability of the

Question

Options

• AAdd a filtering step to skip these types of errors in the future, extract erroneous rows from logs.
• BAdd a try... catch block to your DoFn that transforms the data, extract erroneous rows from logs.
• CAdd a try... catch block to your DoFn that transforms the data, write erroneous rows to PubSub directly from the DoFn.
• DAdd a try... catch block to your DoFn that transforms the data, use a sideOutput to create a PCollection that can be stored to PubSub later.

• A
  24% (8)
• B
  6% (2)
• C
  9% (3)
• D
  62% (21)

Explanation

Explanation/Reference: https://cloud.google.com/blog/products/gcp/handling-invalid-inputs-in-dataflow

No community discussion yet for this question.