DAS-C01 · Question #78
An airline has been collecting metrics on flight activities for analytics. A recently completed proof of concept demonstrates how the company provides insights to data analysts to improve on-time…
The correct answer is C. Compress the objects to reduce the data transfer I/O. D. Use an S3 bucket in the same Region as Athena. F. Preprocess the .csv data to Apache Parquet to reduce I/O by fetching only the data blocks. To optimize Amazon Athena query performance and reduce costs as a data lake grows, the data analyst should compress S3 objects, convert data to Apache Parquet format, and ensure the S3 bucket is in the same AWS Region as Athena.
Question
An airline has been collecting metrics on flight activities for analytics. A recently completed proof of concept demonstrates how the company provides insights to data analysts to improve on-time departures. The proof of concept used objects in Amazon S3, which contained the metrics in .csv format, and used Amazon Athena for querying the data. As the amount of data increases, the data analyst wants to optimize the storage solution to improve query performance. Which options should the data analyst use to improve performance as the data lake grows? (Choose three.)
Options
- AAdd a randomized string to the beginning of the keys in S3 to get more throughput across
- BUse an S3 bucket in the same account as Athena.
- CCompress the objects to reduce the data transfer I/O.
- DUse an S3 bucket in the same Region as Athena.
- EPreprocess the .csv data to JSON to reduce I/O by fetching only the document keys needed by
- FPreprocess the .csv data to Apache Parquet to reduce I/O by fetching only the data blocks
How the community answered
(41 responses)- A5% (2)
- B15% (6)
- C73% (30)
- E7% (3)
Why each option
To optimize Amazon Athena query performance and reduce costs as a data lake grows, the data analyst should compress S3 objects, convert data to Apache Parquet format, and ensure the S3 bucket is in the same AWS Region as Athena.
Adding randomized strings to S3 keys improves write/read throughput for individual objects but does not directly optimize Athena query performance, which is primarily driven by the amount of data scanned.
Using an S3 bucket in the same account as Athena simplifies permissions but does not inherently improve query performance; cross-account access for Athena queries is supported.
Compressing objects significantly reduces the amount of data Athena needs to scan and transfer, leading to faster queries and lower costs.
Placing the S3 bucket in the same AWS Region as Athena minimizes network latency and avoids cross-region data transfer charges, which improves query speed and cost efficiency.
Converting .csv data to JSON format is generally not an optimization for analytical queries in Athena as JSON is a row-oriented format that often results in larger files and less efficient querying compared to columnar formats like Parquet.
Converting data to Apache Parquet, a columnar storage format, allows Athena to read only the necessary columns and data blocks, drastically reducing data scanned and improving query performance.
Concept tested: Optimizing Amazon Athena query performance
Source: https://docs.aws.amazon.com/athena/latest/ug/performance-tuning.html
Topics
Community Discussion
No community discussion yet for this question.