Which of the following describes the Spark driver?

Question

Options

• AThe Spark driver is responsible for performing all execution in all execution modes - it is the entire
• BThe Spare driver is fault tolerant - if it fails, it will recover the entire Spark application.
• CThe Spark driver is the coarsest level of the Spark execution hierarchy - it is synonymous with the
• DThe Spark driver is the program space in which the Spark application's main method runs
• EThe Spark driver is horizontally scaled to increase overall processing throughput of a Spark

• A
  3% (1)
• C
  7% (2)
• D
  90% (27)

Explanation

The Spark driver is the JVM process in which the Spark application's main() method executes. It is responsible for creating the SparkContext/SparkSession, defining transformations and actions, and coordinating work across the cluster - but the actual data processing is distributed to executor nodes. Choice A is wrong because executors perform the actual data processing, not the driver. Choice B is wrong because the driver is a single point of failure - if it dies, the entire application fails (unlike executors, which can be restarted). Choice C is wrong because the Spark application itself is the top-level unit, not the driver. Choice E is wrong because there is exactly one driver per Spark application - it is not horizontally scaled.

No community discussion yet for this question.