COF-C02 · Question #410
What consideration should be made when loading data into Snowflake?
The correct answer is D. The number of data files that are processed in parallel is determined by the virtual warehouse. The degree of parallelism during a COPY INTO load is determined by the virtual warehouse size - a larger warehouse has more compute nodes that can process files concurrently. Snowflake's best practice is to use files of 100–250 MB compressed (not small files as in A). Option B…
Question
What consideration should be made when loading data into Snowflake?
Options
- ACreate small data files and stage them in cloud storage frequently.
- BCreate large data files to maximize the processing overhead for each file.
- CThe number of load operations That run in parallel can exceed the number of data files to be
- DThe number of data files that are processed in parallel is determined by the virtual warehouse.
How the community answered
(59 responses)- A3% (2)
- B7% (4)
- C2% (1)
- D88% (52)
Explanation
The degree of parallelism during a COPY INTO load is determined by the virtual warehouse size - a larger warehouse has more compute nodes that can process files concurrently. Snowflake's best practice is to use files of 100–250 MB compressed (not small files as in A). Option B is misleading because large files are recommended for throughput, not to 'maximize overhead.' Option C is incorrect - parallel load operations cannot exceed the number of data files; each file is processed by at most one thread.
Topics
Community Discussion
No community discussion yet for this question.