CERTIFIED-DATA-ENGINEER-PROFESSIONAL · Question #86
Which statement describes the default execution mode for Databricks Auto Loader?
The correct answer is A. New files are identified by listing the input directory; new files are incrementally and idempotently. Databricks Auto Loader simplifies and automates the process of loading data into Delta Lake. The default execution mode of the Auto Loader identifies new files by listing the input directory. It incrementally and idempotently loads these new files into the target Delta Lake…
Question
Which statement describes the default execution mode for Databricks Auto Loader?
Options
- ANew files are identified by listing the input directory; new files are incrementally and idempotently
- BCloud vendor-specific queue storage and notification services are configured to track newly
- CWebhook trigger Databricks job to run anytime new data arrives in a source directory; new data
- DNew files are identified by listing the input directory; the target table is materialized by directory
- ECloud vendor-specific queue storage and notification services are configured to track newly
How the community answered
(33 responses)- A91% (30)
- B3% (1)
- E6% (2)
Explanation
Databricks Auto Loader simplifies and automates the process of loading data into Delta Lake. The default execution mode of the Auto Loader identifies new files by listing the input directory. It incrementally and idempotently loads these new files into the target Delta Lake table. This approach ensures that files are not missed and are processed exactly once, avoiding data duplication. The other options describe different mechanisms or integrations that are not part of the default behavior of the Auto Loader.
Topics
Community Discussion
No community discussion yet for this question.