PROFESSIONAL-DATA-ENGINEER · Question #285
You issue a new batch job to Dataflow. The job starts successfully, processes a few elements, and then suddenly fails and shuts down. You navigate to the Dataflow monitoring interface where you find…
The correct answer is B. Exceptions in worker code. Explanation/Reference: While your job is running, you might encounter errors or exceptions in your worker code. These errors generally mean that the DoFns in your pipeline code have generated unhandled exceptions, which result in failed tasks in your Dataflow job. Exceptions in…
Question
Options
- AJob validation
- BExceptions in worker code
- CGraph or pipeline construction
- DInsufficient permissions
How the community answered
(19 responses)- B89% (17)
- C5% (1)
- D5% (1)
Explanation
Explanation/Reference: While your job is running, you might encounter errors or exceptions in your worker code. These errors generally mean that the DoFns in your pipeline code have generated unhandled exceptions, which result in failed tasks in your Dataflow job. Exceptions in user code (for example, your DoFn instances) are reported in the Dataflow monitoring interface. https://cloud.google.com/dataflow/docs/guides/troubleshooting-your-pipeline#Causes
Topics
Community Discussion
No community discussion yet for this question.