DATABRICKS-CERTIFIED-ASSOCIATE-DEVELOPER-FOR-APACHE-SPARK · Question #123
Which of the following is the most granular level of the Spark execution hierarchy?
The correct answer is A. Task. A task is the most granular unit in the Spark execution hierarchy, representing a single unit of work applied to a single partition of data.
Question
Which of the following is the most granular level of the Spark execution hierarchy?
Options
- ATask
- BExecutor
- CNode
- DJob
- ESlot
How the community answered
(58 responses)- A91% (53)
- C2% (1)
- D5% (3)
- E2% (1)
Why each option
A task is the most granular unit in the Spark execution hierarchy, representing a single unit of work applied to a single partition of data.
The Spark execution hierarchy from broadest to most granular is: Application > Job > Stage > Task. A task operates on one partition of data and is the smallest schedulable unit. Every other option in this question represents a higher-level or infrastructure concept, not a finer-grained execution unit.
An executor is an infrastructure component that runs tasks - it sits above tasks in the hierarchy.
A node is the physical or virtual machine hosting executors - it is not part of the logical execution hierarchy.
A job is a higher-level grouping of stages, which themselves contain multiple tasks.
A slot represents execution capacity within an executor - it is a resource concept, not a distinct level in the execution hierarchy.
Concept tested: Spark execution hierarchy - job, stage, task
Source: https://spark.apache.org/docs/latest/cluster-overview.html
Topics
Community Discussion
No community discussion yet for this question.