nerdexam
Microsoft

DP-100 · Question #35

Your team is building a data engineering and data science development environment. The environment must support the following requirements: - support Python and Scala - compose data storage…

The correct answer is B. Build the environment in Azure Databricks and use Azure Data Factory for orchestration. In Azure Databricks, we can create two different types of clusters. Standard, these are the default clusters and can be used with Python, R, Scala and SQL High-concurrency Azure Databricks is fully integrated with Azure Data Factory. Incorrect Answers: D: Azure Container…

Design and prepare a machine learning solution

Question

Your team is building a data engineering and data science development environment. The environment must support the following requirements: - support Python and Scala - compose data storage, movement, and processing services into automated data pipelines - the same tool should be used for the orchestration of both data engineering and data science - support workload isolation and interactive workloads - enable scaling across a cluster of machines You need to create the environment. What should you do?

Options

  • ABuild the environment in Apache Hive for HDInsight and use Azure Data Factory for
  • BBuild the environment in Azure Databricks and use Azure Data Factory for orchestration.
  • CBuild the environment in Apache Spark for HDInsight and use Azure Container Instances for
  • DBuild the environment in Azure Databricks and use Azure Container Instances for orchestration.

How the community answered

(57 responses)
  • A
    12% (7)
  • B
    79% (45)
  • C
    4% (2)
  • D
    5% (3)

Explanation

In Azure Databricks, we can create two different types of clusters. Standard, these are the default clusters and can be used with Python, R, Scala and SQL High-concurrency Azure Databricks is fully integrated with Azure Data Factory. Incorrect Answers: D: Azure Container Instances is good for development or testing. Not suitable for production https://docs.microsoft.com/en-us/azure/architecture/data-guide/technology-choices/data-science- and-machine-learning

Topics

#Azure Databricks#Azure Data Factory#Data Pipeline Orchestration#Data Science Environment Design

Community Discussion

No community discussion yet for this question.

Sign up to join the discussion
Full DP-100 Practice