DP-203 · Question #42
You create an Azure Databricks cluster and specify an additional library to install. When you attempt to load the library to a notebook, the library is not found. You need to identify the cause of…
The correct answer is C. global init scripts logs. Cluster-scoped Init Scripts: Init scripts are shell scripts that run during the startup of each cluster node before the Spark driver or worker JVM starts. Databricks customers use init scripts for various purposes such as installing custom libraries, launching background…
Question
You create an Azure Databricks cluster and specify an additional library to install. When you attempt to load the library to a notebook, the library is not found. You need to identify the cause of the issue. What should you review?
Options
- Aworkspace logs
- Bnotebook logs
- Cglobal init scripts logs
- Dcluster event logs
How the community answered
(37 responses)- A5% (2)
- B3% (1)
- C84% (31)
- D8% (3)
Explanation
Cluster-scoped Init Scripts: Init scripts are shell scripts that run during the startup of each cluster node before the Spark driver or worker JVM starts. Databricks customers use init scripts for various purposes such as installing custom libraries, launching background processes, or applying enterprise security Logs for Cluster-scoped init scripts are now more consistent with Cluster Log Delivery and can be found in the same root folder as driver and executor logs for the cluster. https://databricks.com/blog/2018/08/30/introducing-cluster-scoped-init-scripts.html
Topics
Community Discussion
No community discussion yet for this question.