CERTIFIED-DATA-ENGINEER-PROFESSIONAL · Question #37
A small company based in the United States has recently contracted a consulting firm in India to implement several new data engineering pipelines to power artificial intelligence applications. All…
The correct answer is C. Cross-region reads and writes can incur significant costs and latency; whenever possible. Databricks workspaces run compute (virtual machines) in a specific cloud region. When compute is in a different region than the data (US cloud storage), every read and write crosses regional network boundaries, incurring egress fees and added latency. The physical location of…
Question
A small company based in the United States has recently contracted a consulting firm in India to implement several new data engineering pipelines to power artificial intelligence applications. All the company's data is stored in regional cloud storage in the United States. The workspace administrator at the company is uncertain about where the Databricks workspace used by the contractors should be deployed. Assuming that all data governance considerations are accounted for, which statement accurately informs this decision?
Options
- ADatabricks runs HDFS on cloud volume storage; as such, cloud virtual machines must be
- BDatabricks workspaces do not rely on any regional infrastructure; as such, the decision should be
- CCross-region reads and writes can incur significant costs and latency; whenever possible,
- DDatabricks leverages user workstations as the driver during interactive development; as such,
- EDatabricks notebooks send all executable code from the user's browser to virtual machines over
How the community answered
(24 responses)- A4% (1)
- B4% (1)
- C83% (20)
- E8% (2)
Explanation
Databricks workspaces run compute (virtual machines) in a specific cloud region. When compute is in a different region than the data (US cloud storage), every read and write crosses regional network boundaries, incurring egress fees and added latency. The physical location of the consulting team (India) is irrelevant to workspace region-engineers access Databricks through a web browser or API, which is a lightweight connection. The heavy data movement happens between the compute cluster and the storage bucket, so those two should be co-located in the same region. Cross-region data transfer costs in cloud environments can be substantial and should be avoided whenever possible.
Topics
Community Discussion
No community discussion yet for this question.