CERTIFIED-DATA-ENGINEER-PROFESSIONAL · Question #61
A distributed team of data analysts share computing resources on an interactive cluster with autoscaling configured. In order to better manage costs and query throughput, the workspace administrator…
The correct answer is D. Cluster Event Log. The Cluster Event Log in Databricks will show the timeline for cluster resizing events, including details about when and why a cluster was resized (scaled up or down). This log would help the workspace administrator determine the causes of cluster scaling, whether due to many…
Question
A distributed team of data analysts share computing resources on an interactive cluster with autoscaling configured. In order to better manage costs and query throughput, the workspace administrator is hoping to evaluate whether cluster upscaling is caused by many concurrent users or resource-intensive queries. In which location can one review the timeline for cluster resizing events?
Options
- AWorkspace audit logs
- BDriver's log file
- CGanglia
- DCluster Event Log
- EExecutor's log file
How the community answered
(40 responses)- B5% (2)
- C3% (1)
- D93% (37)
Explanation
The Cluster Event Log in Databricks will show the timeline for cluster resizing events, including details about when and why a cluster was resized (scaled up or down). This log would help the workspace administrator determine the causes of cluster scaling, whether due to many concurrent users submitting jobs or a few users running resource-intensive queries.
Topics
Community Discussion
No community discussion yet for this question.