ARA-C01 · Question #156
A retail company has over 3000 stores all using the same Point of Sale (POS) system. The company wants to deliver near real-time sales results to category managers. The stores operate in a variety…
The correct answer is B. A Snowpipe should be created and configured with AUTO_INGEST = true. A stream should be C. A stream should be created to accumulate the near real-time data and a task should be created. To provide near real-time sales results to category managers, the Architect can use the following Create an external stage that references the cloud storage location where the POS sends the sales transactions files. The external stage should use the file format and encryption…
Question
A retail company has over 3000 stores all using the same Point of Sale (POS) system. The company wants to deliver near real-time sales results to category managers. The stores operate in a variety of time zones and exhibit a dynamic range of transactions each minute, with some stores having higher sales volumes than others. Sales results are provided in a uniform fashion using data engineered fields that will be calculated in a complex data pipeline. Calculations include exceptions, aggregations, and scoring using external functions interfaced to scoring algorithms. The source data for aggregations has over 100M rows. Every minute, the POS sends all sales transactions files to a cloud storage location with a naming convention that includes store numbers and timestamps to identify the set of transactions contained in the files. The files are typically less than 10MB in size. How can the near real-time results be provided to the category managers? (Select TWO).
Options
- AAll files should be concatenated before ingestion into Snowflake to avoid micro-ingestion.
- BA Snowpipe should be created and configured with AUTO_INGEST = true. A stream should be
- CA stream should be created to accumulate the near real-time data and a task should be created
- DAn external scheduler should examine the contents of the cloud storage location and issue
- EThe copy into command with a task scheduled to run every second should be used to achieve the
How the community answered
(25 responses)- A8% (2)
- B68% (17)
- D20% (5)
- E4% (1)
Explanation
To provide near real-time sales results to category managers, the Architect can use the following Create an external stage that references the cloud storage location where the POS sends the sales transactions files. The external stage should use the file format and encryption settings that match the source files2 Create a Snowpipe that loads the files from the external stage into a target table in Snowflake. The Snowpipe should be configured with AUTO_INGEST = true, which means that it will automatically detect and ingest new files as they arrive in the external stage. The Snowpipe should also use a copy option to purge the files from the external stage after loading, to avoid duplicate ingestion3 Create a stream on the target table that captures the INSERTS made by the Snowpipe. The stream should include the metadata columns that provide information about the file name, path, size, and last modified time. The stream should also have a retention period that matches the real-time analytics needs4 Create a task that runs a query on the stream to process the near real-time data. The query should use the stream metadata to extract the store number and timestamps from the file name and path, and perform the calculations for exceptions, aggregations, and scoring using external functions. The query should also output the results to another table or view that can be accessed by the category managers. The task should be scheduled to run at a frequency that matches the real-time analytics needs, such as every minute or every 5 minutes.
Topics
Community Discussion
No community discussion yet for this question.