Why does Snowflake recommend file sizes of 100-250 MB compressed when loading data?

The correct answer is D. Allows optimization of parallel operations. Snowflake distributes data loading across multiple parallel threads. Files in the 100-250 MB compressed range strike the optimal balance: they are large enough to minimize per-file overhead and small enough to allow many files to be processed simultaneously across warehouse…

Data Loading and Unloading

Question

Options

AOptimizes the virtual warehouse size and multi-cluster setting to economy mode
BAllows a user to import the files in a sequential order
CIncreases the latency staging and accuracy when loading the data
DAllows optimization of parallel operations

How the community answered

(53 responses)

A
2% (1)
B
4% (2)
D
94% (50)

Explanation

Snowflake distributes data loading across multiple parallel threads. Files in the 100-250 MB compressed range strike the optimal balance: they are large enough to minimize per-file overhead and small enough to allow many files to be processed simultaneously across warehouse nodes. Files that are too small create excessive overhead from managing thousands of tiny loads, while files that are too large limit parallelism. Proper file sizing directly maximizes throughput during bulk loading.

Topics

#Data Loading#Best Practices#Performance Optimization#Parallel Processing

Community Discussion

No community discussion yet for this question.

Full COF-C02 Practice