You want to automate execution of a multi-step data pipeline running on Google Cloud. The pipeline includes Cloud Dataproc and Cloud Dataflow jobs that have multiple dependencies on each other. You want to use managed services where possible, and the pipeline will run every day. Which tool should you use?

Question

Accepted Answer

B. Cloud Composer

Answer

A. cron

Answer

C. Cloud Scheduler

Answer

D. Workflow Templates on Cloud Dataproc

You want to automate execution of a multi-step data pipeline running on Google Cloud. The pipeline includes Cloud Dataproc and Cloud Dataflow jobs that have multiple dependencies on each other. You wa

Question

Options

How the community answered

Explanation

Community Discussion