PROFESSIONAL-DATA-ENGINEER · Question #246
Your company currently runs a large on-premises cluster using Spark, Hive, and HDFS in a colocation facility. The cluster is designed to accommodate peak usage on the system; however, many jobs are…
The correct answer is B. Migrate the workloads to Dataproc plus Cloud Storage; modernize later. Explanation/Reference: 1. migrate job and infrastructure to dataproc on clound 2. any data, move from hdfs on-premise to google cloud storage ( one of them is Hive) If you want to modernize Hive to Bigquery , you are need to move it into GCS(preceding step) first and load it…
Question
Options
- AMigrate the workloads to Dataproc plus HDFS; modernize later.
- BMigrate the workloads to Dataproc plus Cloud Storage; modernize later.
- CMigrate the Spark workload to Dataproc plus HDFS, and modernize the Hive workload for BigQuery.
- DModernize the Spark workload for Dataflow and the Hive workload for BigQuery.
How the community answered
(29 responses)- A3% (1)
- B79% (23)
- C7% (2)
- D10% (3)
Explanation
Explanation/Reference: 1. migrate job and infrastructure to dataproc on clound 2. any data, move from hdfs on-premise to google cloud storage ( one of them is Hive) If you want to modernize Hive to Bigquery , you are need to move it into GCS(preceding step) first and load it into bigquery https://cloud.google.com/blog/products/data-analytics/apache-hive-to-bigquery https://cloud.google.com/architecture/hadoop/migrating-apache-spark-jobs-to-cloud-dataproc https://cloud.google.com/architecture/hadoop/hadoop-gcp-migration-data
Topics
Community Discussion
No community discussion yet for this question.