nerdexam
Amazon

DAS-C01 · Question #78

An airline has been collecting metrics on flight activities for analytics. A recently completed proof of concept demonstrates how the company provides insights to data analysts to improve on-time…

The correct answer is C. Compress the objects to reduce the data transfer I/O. D. Use an S3 bucket in the same Region as Athena. F. Preprocess the .csv data to Apache Parquet to reduce I/O by fetching only the data blocks. To optimize Amazon Athena query performance and reduce costs as a data lake grows, the data analyst should compress S3 objects, convert data to Apache Parquet format, and ensure the S3 bucket is in the same AWS Region as Athena.

Storage and Data Management

Question

An airline has been collecting metrics on flight activities for analytics. A recently completed proof of concept demonstrates how the company provides insights to data analysts to improve on-time departures. The proof of concept used objects in Amazon S3, which contained the metrics in .csv format, and used Amazon Athena for querying the data. As the amount of data increases, the data analyst wants to optimize the storage solution to improve query performance. Which options should the data analyst use to improve performance as the data lake grows? (Choose three.)

Options

  • AAdd a randomized string to the beginning of the keys in S3 to get more throughput across
  • BUse an S3 bucket in the same account as Athena.
  • CCompress the objects to reduce the data transfer I/O.
  • DUse an S3 bucket in the same Region as Athena.
  • EPreprocess the .csv data to JSON to reduce I/O by fetching only the document keys needed by
  • FPreprocess the .csv data to Apache Parquet to reduce I/O by fetching only the data blocks

How the community answered

(41 responses)
  • A
    5% (2)
  • B
    15% (6)
  • C
    73% (30)
  • E
    7% (3)

Why each option

To optimize Amazon Athena query performance and reduce costs as a data lake grows, the data analyst should compress S3 objects, convert data to Apache Parquet format, and ensure the S3 bucket is in the same AWS Region as Athena.

AAdd a randomized string to the beginning of the keys in S3 to get more throughput across

Adding randomized strings to S3 keys improves write/read throughput for individual objects but does not directly optimize Athena query performance, which is primarily driven by the amount of data scanned.

BUse an S3 bucket in the same account as Athena.

Using an S3 bucket in the same account as Athena simplifies permissions but does not inherently improve query performance; cross-account access for Athena queries is supported.

CCompress the objects to reduce the data transfer I/O.Correct

Compressing objects significantly reduces the amount of data Athena needs to scan and transfer, leading to faster queries and lower costs.

DUse an S3 bucket in the same Region as Athena.Correct

Placing the S3 bucket in the same AWS Region as Athena minimizes network latency and avoids cross-region data transfer charges, which improves query speed and cost efficiency.

EPreprocess the .csv data to JSON to reduce I/O by fetching only the document keys needed by

Converting .csv data to JSON format is generally not an optimization for analytical queries in Athena as JSON is a row-oriented format that often results in larger files and less efficient querying compared to columnar formats like Parquet.

FPreprocess the .csv data to Apache Parquet to reduce I/O by fetching only the data blocksCorrect

Converting data to Apache Parquet, a columnar storage format, allows Athena to read only the necessary columns and data blocks, drastically reducing data scanned and improving query performance.

Concept tested: Optimizing Amazon Athena query performance

Source: https://docs.aws.amazon.com/athena/latest/ug/performance-tuning.html

Topics

#Athena#S3#Data Lake Optimization#Query Performance

Community Discussion

No community discussion yet for this question.

Full DAS-C01 Practice