DATABRICKS-CERTIFIED-DATA-ENGINEER-ASSOCIATE · Question #6
A data engineer is maintaining a data pipeline. Upon data ingestion, the data engineer notices that the source data is starting to have a lower level of quality. The data engineer would like to…
The correct answer is D. Delta Live Tables. Delta Live Tables (DLT) is Databricks' declarative ETL framework that includes built-in data quality monitoring via 'expectations' - constraints you define on your datasets. DLT automatically tracks constraint violations, can quarantine or drop bad records, and provides metrics…
Question
Options
- AUnity Catalog
- BData Explorer
- CDelta Lake
- DDelta Live Tables
- EAuto Loader
How the community answered
(38 responses)- A8% (3)
- B3% (1)
- C3% (1)
- D84% (32)
- E3% (1)
Explanation
Delta Live Tables (DLT) is Databricks' declarative ETL framework that includes built-in data quality monitoring via 'expectations' - constraints you define on your datasets. DLT automatically tracks constraint violations, can quarantine or drop bad records, and provides metrics dashboards for quality monitoring over time. This makes it ideal for automating data quality monitoring pipelines. Unity Catalog handles governance/access control, Data Explorer is a UI tool, Delta Lake provides storage format features, and Auto Loader handles incremental file ingestion - none of these provide automated quality constraint enforcement like DLT.
Topics
Community Discussion
No community discussion yet for this question.