nerdexam
Databricks

DATABRICKS-CERTIFIED-ASSOCIATE-DEVELOPER-FOR-APACHE-SPARK · Question #94

Of the following, which is the coarsest level in the Spark execution hierarchy?

The correct answer is D. Job. The Spark execution hierarchy from coarsest to finest is: Job → Stage → Task. A Job is triggered by a single action (e.g., collect()) and represents the highest-level unit of work. Each Job is divided into one or more Stages, which are sets of tasks that can run without a…

Spark Core Concepts and Architecture

Question

Of the following, which is the coarsest level in the Spark execution hierarchy?

Options

  • ATask
  • BStage
  • CExecutor
  • DJob
  • ESlot

How the community answered

(60 responses)
  • A
    2% (1)
  • B
    3% (2)
  • C
    2% (1)
  • D
    93% (56)

Explanation

The Spark execution hierarchy from coarsest to finest is: Job → Stage → Task. A Job is triggered by a single action (e.g., collect()) and represents the highest-level unit of work. Each Job is divided into one or more Stages, which are sets of tasks that can run without a shuffle. Each Stage is further broken into Tasks, which are the smallest unit of work executed on individual data partitions. Executors and Slots are infrastructure/resource concepts, not levels of the execution hierarchy. The Job is therefore the coarsest (broadest) level.

Topics

#Spark architecture#Execution hierarchy#Job Stage Task

Community Discussion

No community discussion yet for this question.

Full DATABRICKS-CERTIFIED-ASSOCIATE-DEVELOPER-FOR-APACHE-SPARK Practice