DATABRICKS-CERTIFIED-DATA-ENGINEER-ASSOCIATE · Question #14
Which of the following describes when to use the CREATE STREAMING LIVE TABLE (formerly CREATE INCREMENTAL LIVE TABLE) syntax over the CREATE LIVE TABLE syntax when creating Delta Live Tables (DLT)…
The correct answer is B. CREATE STREAMING LIVE TABLE should be used when data needs to be processed. The CREATE STREAMING LIVE TABLE syntax is used in Delta Live Tables to create tables that are designed to process data incrementally from streaming sources, ensuring efficient and exactly-once processing.
Question
Options
- ACREATE STREAMING LIVE TABLE should be used when the subsequent step in the DLT
- BCREATE STREAMING LIVE TABLE should be used when data needs to be processed
- CCREATE STREAMING LIVE TABLE is redundant for DLT and it does not need to be used.
- DCREATE STREAMING LIVE TABLE should be used when data needs to be processed through
- ECREATE STREAMING LIVE TABLE should be used when the previous step in the DLT pipeline is
How the community answered
(24 responses)- B88% (21)
- C4% (1)
- D4% (1)
- E4% (1)
Why each option
The `CREATE STREAMING LIVE TABLE` syntax is used in Delta Live Tables to create tables that are designed to process data incrementally from streaming sources, ensuring efficient and exactly-once processing.
The purpose of `CREATE STREAMING LIVE TABLE` is not solely dependent on the subsequent step; it defines the behavior of the current table as a streaming source or transformation.
The `CREATE STREAMING LIVE TABLE` syntax is optimized for ingesting data incrementally from streaming sources, such as Auto Loader or other streaming live tables, to ensure that only new data is processed in each pipeline update.
`CREATE STREAMING LIVE TABLE` is a distinct and purposeful syntax for streaming workloads, offering specific optimizations over `CREATE LIVE TABLE` for incremental processing.
`CREATE STREAMING LIVE TABLE` is specifically for streaming data processing, not for data that needs to be processed through batches only.
While a previous streaming table is a common use case, the primary reason to use `CREATE STREAMING LIVE TABLE` is the desire for incremental processing from any streaming source, not just another DLT streaming table.
Concept tested: Delta Live Tables streaming tables
Source: https://docs.databricks.com/en/delta-live-tables/sql-ref.html#create-streaming-live-table
Topics
Community Discussion
No community discussion yet for this question.