nerdexam
Google

PROFESSIONAL-DATA-ENGINEER · Question #246

Your company currently runs a large on-premises cluster using Spark, Hive, and HDFS in a colocation facility. The cluster is designed to accommodate peak usage on the system; however, many jobs are…

The correct answer is B. Migrate the workloads to Dataproc plus Cloud Storage; modernize later. Explanation/Reference: 1. migrate job and infrastructure to dataproc on clound 2. any data, move from hdfs on-premise to google cloud storage ( one of them is Hive) If you want to modernize Hive to Bigquery , you are need to move it into GCS(preceding step) first and load it…

Submitted by khalil_dz· Mar 30, 2026Designing data processing systems

Question

Your company currently runs a large on-premises cluster using Spark, Hive, and HDFS in a colocation facility. The cluster is designed to accommodate peak usage on the system; however, many jobs are batch in nature, and usage of the cluster fluctuates quite dramatically. Your company is eager to move to the cloud to reduce the overhead associated with on-premises infrastructure and maintenance and to benefit from the cost savings. They are also hoping to modernize their existing infrastructure to use more serverless offerings in order to take advantage of the cloud. Because of the timing of their contract renewal with the colocation facility, they have only 2 months for their initial migration. How would you recommend they approach their upcoming migration strategy so they can maximize their cost savings in the cloud while still executing the migration in time?

Options

  • AMigrate the workloads to Dataproc plus HDFS; modernize later.
  • BMigrate the workloads to Dataproc plus Cloud Storage; modernize later.
  • CMigrate the Spark workload to Dataproc plus HDFS, and modernize the Hive workload for BigQuery.
  • DModernize the Spark workload for Dataflow and the Hive workload for BigQuery.

How the community answered

(29 responses)
  • A
    3% (1)
  • B
    79% (23)
  • C
    7% (2)
  • D
    10% (3)

Explanation

Explanation/Reference: 1. migrate job and infrastructure to dataproc on clound 2. any data, move from hdfs on-premise to google cloud storage ( one of them is Hive) If you want to modernize Hive to Bigquery , you are need to move it into GCS(preceding step) first and load it into bigquery https://cloud.google.com/blog/products/data-analytics/apache-hive-to-bigquery https://cloud.google.com/architecture/hadoop/migrating-apache-spark-jobs-to-cloud-dataproc https://cloud.google.com/architecture/hadoop/hadoop-gcp-migration-data

Topics

#Dataproc#Cloud Storage#HDFS migration#workload modernization

Community Discussion

No community discussion yet for this question.

Full PROFESSIONAL-DATA-ENGINEER Practice