DATABRICKS-CERTIFIED-DATA-ENGINEER-ASSOCIATE · Question #41
Which of the following describes the type of workloads that are always compatible with Auto Loader?
The correct answer is A. Streaming workloads. Auto Loader is Databricks' incremental file ingestion mechanism designed specifically for streaming workloads. It uses Structured Streaming under the hood, processing new files as they arrive in cloud storage. While it can be used in batch mode with .trigger(availableNow=True)…
Question
Options
- AStreaming workloads
- BMachine learning workloads
- CServerless workloads
- DBatch workloads
- EDashboard workloads
How the community answered
(58 responses)- A91% (53)
- B2% (1)
- D5% (3)
- E2% (1)
Explanation
Auto Loader is Databricks' incremental file ingestion mechanism designed specifically for streaming workloads. It uses Structured Streaming under the hood, processing new files as they arrive in cloud storage. While it can be used in batch mode with .trigger(availableNow=True), its core design and guarantee of exactly-once processing are rooted in the Structured Streaming engine, making streaming workloads the always-compatible type. Machine learning, serverless, batch (in the traditional sense), and dashboard workloads are not inherently tied to Auto Loader's design.
Topics
Community Discussion
No community discussion yet for this question.