SOL-C01 · Question #104
SOL-C01 Question #104: Real Exam Question with Answer & Explanation
The correct answer is D: Snowpipe with Streams and Tasks.. Option D provides the best balance of automation, transformation, and minimal operational overhead. Snowpipe enables continuous data loading as new files arrive in S3. Streams capture change data (new files loaded), and Tasks automate the transformation process based on those cha
Question
You are designing a data ingestion pipeline for a SaaS application that generates JSON log files daily. These files are uploaded to an AWS S3 bucket. You need to load this data into Snowflake, transform it, and store it in a structured table. Consider the following requirements: 1 . Automated ingestion of new log files as they arrive in S3. 2. Transformation of the JSON data into a relational format. 3. Minimal operational overhead. 4. Cost Optimization. Which combination of Snowflake features would best address these requirements?
Options
- ASnowpipe with Snowsight Tasks and Materialized Views.
- BSnowpipe with External Tables and User-Defined Functions (UDFs).
- CScheduled Tasks using Cron and Stored Procedures with Python IJDF.
- DSnowpipe with Streams and Tasks.
- ESnowpipe with COPY INTO and Views.
Explanation
Option D provides the best balance of automation, transformation, and minimal operational overhead. Snowpipe enables continuous data loading as new files arrive in S3. Streams capture change data (new files loaded), and Tasks automate the transformation process based on those changes. A is good, but not perfect. Materialized Views have limitations related to supported functions. Tasks using 'AFTER with streams ensures only new changes are processed. B: External tables are not ideal for frequent transformations. UDFs are fine, but using streams and tasks together offers better automation for transformation following loading. C: Scheduled tasks using cron are less reactive to new files than Snowpipe. This requires more operational oversight compared to event-driven Snowpipe. E: While COPY INTO can be used in a scheduled task, Snowpipe is more efficient for continuous loading, and views are not suitable for data
Topics
Community Discussion
No community discussion yet for this question.