Which statement regarding stream-static joins and static Delta tables is correct?

Question

Options

• AEach microbatch of a stream-static join will use the most recent version of the static Delta table as
• BEach microbatch of a stream-static join will use the most recent version of the static Delta table as
• CThe checkpoint directory will be used to track state information for the unique keys present in the
• DStream-static joins cannot use static Delta tables because of consistency issues.
• EThe checkpoint directory will be used to track updates to the static Delta table.

• A
  95% (40)
• C
  2% (1)
• E
  2% (1)

Explanation

In Spark Structured Streaming stream-static joins, the static Delta table is NOT snapshotted once at query startup and reused. Instead, each microbatch reads the most recent version of the static Delta table at the time that microbatch executes. This means if the static table is updated between microbatches, subsequent microbatches will automatically see the updated data. No checkpoint state is stored for the static side - the checkpoint only tracks streaming source progress. This behavior makes stream-static joins naturally pick up static table changes without requiring a stream restart.

No community discussion yet for this question.