nerdexam
Databricks

DATABRICKS-CERTIFIED-ASSOCIATE-DEVELOPER-FOR-APACHE-SPARK · Question #123

Which of the following is the most granular level of the Spark execution hierarchy?

The correct answer is A. Task. A task is the most granular unit in the Spark execution hierarchy, representing a single unit of work applied to a single partition of data.

Spark Architecture and Execution

Question

Which of the following is the most granular level of the Spark execution hierarchy?

Options

  • ATask
  • BExecutor
  • CNode
  • DJob
  • ESlot

How the community answered

(58 responses)
  • A
    91% (53)
  • C
    2% (1)
  • D
    5% (3)
  • E
    2% (1)

Why each option

A task is the most granular unit in the Spark execution hierarchy, representing a single unit of work applied to a single partition of data.

ATaskCorrect

The Spark execution hierarchy from broadest to most granular is: Application > Job > Stage > Task. A task operates on one partition of data and is the smallest schedulable unit. Every other option in this question represents a higher-level or infrastructure concept, not a finer-grained execution unit.

BExecutor

An executor is an infrastructure component that runs tasks - it sits above tasks in the hierarchy.

CNode

A node is the physical or virtual machine hosting executors - it is not part of the logical execution hierarchy.

DJob

A job is a higher-level grouping of stages, which themselves contain multiple tasks.

ESlot

A slot represents execution capacity within an executor - it is a resource concept, not a distinct level in the execution hierarchy.

Concept tested: Spark execution hierarchy - job, stage, task

Source: https://spark.apache.org/docs/latest/cluster-overview.html

Topics

#Spark Execution Model#Spark Architecture#Task (Spark)

Community Discussion

No community discussion yet for this question.

Full DATABRICKS-CERTIFIED-ASSOCIATE-DEVELOPER-FOR-APACHE-SPARK Practice