ARA-C01 · Question #105
A company has built a data pipeline using Snowpipe to ingest files from an Amazon S3 bucket. Snowpipe is configured to load data into staging database tables. Then a task runs to load the data from th
The correct answer is C. Use an ORDER BY <cluster_key (s) > command to load the reporting tables.. Effective pruning in Snowflake relies on the organization of data within micro-partitions. By using an ORDER BY clause with clustering keys when loading data into the reporting tables, Snowflake can better organize the data within micro-partitions. This organization allows Snowfl
Question
A company has built a data pipeline using Snowpipe to ingest files from an Amazon S3 bucket. Snowpipe is configured to load data into staging database tables. Then a task runs to load the data from the staging database tables into the reporting database tables. The company is satisfied with the availability of the data in the reporting database tables, but the reporting tables are not pruning effectively. Currently, a size 4X-Large virtual warehouse is being used to query all of the tables in the reporting database. What step can be taken to improve the pruning of the reporting tables?
Options
- AEliminate the use of Snowpipe and load the files into internal stages using PUT commands.
- BIncrease the size of the virtual warehouse to a size 5X-Large.
- CUse an ORDER BY <cluster_key (s) > command to load the reporting tables.
- DCreate larger files for Snowpipe to ingest and ensure the staging frequency does not exceed 1
How the community answered
(40 responses)- A13% (5)
- B5% (2)
- C80% (32)
- D3% (1)
Explanation
Effective pruning in Snowflake relies on the organization of data within micro-partitions. By using an ORDER BY clause with clustering keys when loading data into the reporting tables, Snowflake can better organize the data within micro-partitions. This organization allows Snowflake to skip over irrelevant micro-partitions during a query, thus improving query performance and reducing the amount of data scanned.
Topics
Community Discussion
No community discussion yet for this question.