DAS-C01 · Question #153
A company has several Amazon EC2 instances sitting behind an Application Load Balancer (ALB). The company wants its IT Infrastructure team to analyze the IP addresses coming into the company's ALB…
The correct answer is D. Use Amazon Redshift Spectrum to query the S3 data. To analyze 1TB of daily Amazon ALB access logs in S3 with infrequent access, prioritizing scalability, cost-effectiveness, and minimal maintenance, Amazon Redshift Spectrum is an excellent solution.
Question
A company has several Amazon EC2 instances sitting behind an Application Load Balancer (ALB). The company wants its IT Infrastructure team to analyze the IP addresses coming into the company's ALB. The ALB is configured to store access logs in Amazon S3. The access logs create about 1 TB of data each day, and access to the data will be infrequent. The company needs a solution that is scalable, cost-effective and has minimal maintenance requirements. Which solution meets these requirements?
Options
- ACopy the data into Amazon Redshift and query the data
- BUse Amazon EMR and Apache Hive to query the S3 data
- CUse Amazon Athena to query the S3 data
- DUse Amazon Redshift Spectrum to query the S3 data
How the community answered
(61 responses)- A3% (2)
- B15% (9)
- C8% (5)
- D74% (45)
Why each option
To analyze 1TB of daily Amazon ALB access logs in S3 with infrequent access, prioritizing scalability, cost-effectiveness, and minimal maintenance, Amazon Redshift Spectrum is an excellent solution.
Copying 1TB of daily log data into Amazon Redshift for infrequent access is expensive and inefficient due to storage costs, the ETL process, and the compute required for data that is not frequently queried. This also incurs significant maintenance overhead.
Using Amazon EMR and Apache Hive to query S3 data requires managing an EMR cluster, which introduces operational overhead and does not align with the 'minimal maintenance' requirement for infrequent queries compared to serverless options.
Amazon Athena is a serverless query service that can query S3 data directly, offering scalability, cost-effectiveness (pay-per-query), and minimal maintenance. While a strong contender, Redshift Spectrum offers similar benefits and can be preferred if there's an existing Redshift environment or specific integration needs, leveraging Redshift's query optimizer.
Amazon Redshift Spectrum allows you to query data directly in Amazon S3 using familiar SQL, without loading it into Redshift itself. This approach is highly scalable, cost-effective as you pay only for the data scanned, and requires minimal maintenance as it leverages a Redshift cluster's compute while leaving data in S3, making it ideal for infrequent analysis of large, evolving log datasets.
Concept tested: Querying S3 data with Redshift Spectrum
Source: https://docs.aws.amazon.com/redshift/latest/dg/c-getting-started-spectrum.html
Topics
Community Discussion
No community discussion yet for this question.