A data engineer has a Job with multiple tasks that runs nightly. Each of the tasks runs slowly because the clusters take a long time to start. Which of the following actions can the data engineer…

Question

Options

• AThey can use endpoints available in Databricks SQL
• BThey can use jobs clusters instead of all-purpose clusters
• CThey can configure the clusters to be single-node
• DThey can use clusters that are from a cluster pool
• EThey can configure the clusters to autoscale for larger data sizes

• A
  9% (3)
• B
  15% (5)
• C
  3% (1)
• D
  70% (23)
• E
  3% (1)

Explanation

Cluster pools (instance pools) maintain a set of idle, pre-warmed VM instances. When a cluster is created from a pool, it draws from these pre-allocated instances instead of provisioning new VMs from scratch, dramatically reducing startup time. All-purpose clusters (option B is backwards - jobs clusters are already the leaner option, but they still start from scratch without a pool). Single-node (option C) or autoscaling (option E) configurations affect size, not startup speed. SQL endpoints (option A) are not applicable to Job task clusters.

No community discussion yet for this question.