MLS-C01 · Question #9
A Data Science team is designing a dataset repository where it will store a large amount of training data commonly used in its machine learning models. As Data Scientists may create an arbitrary…
The correct answer is A. Store datasets as files in Amazon S3. The Data Science team needs a highly scalable, cost-effective storage for large, arbitrarily growing training datasets that can also be explored using SQL.
Question
A Data Science team is designing a dataset repository where it will store a large amount of training data commonly used in its machine learning models. As Data Scientists may create an arbitrary number of new datasets every day, the solution has to scale automatically and be cost- effective. Also, it must be possible to explore the data using SQL. Which storage scheme is MOST adapted to this scenario?
Options
- AStore datasets as files in Amazon S3.
- BStore datasets as files in an Amazon EBS volume attached to an Amazon EC2 instance.
- CStore datasets as tables in a multi-node Amazon Redshift cluster.
- DStore datasets as global tables in Amazon DynamoDB.
How the community answered
(45 responses)- A73% (33)
- B7% (3)
- C18% (8)
- D2% (1)
Why each option
The Data Science team needs a highly scalable, cost-effective storage for large, arbitrarily growing training datasets that can also be explored using SQL.
Amazon S3 is an object storage service offering virtually unlimited scalability and high durability at a low cost, making it ideal for large, growing datasets. When combined with services like Amazon Athena, which allows querying S3 data using standard SQL, it perfectly meets the requirement for SQL exploration.
Amazon EBS volumes have fixed capacity and require manual scaling, making them not automatically scalable or cost-effective for arbitrarily growing data.
Amazon Redshift is a data warehouse service, not primarily a raw data repository, and while it uses SQL, it is not the most cost-effective or automatically scaling solution for storing raw files that may or may not be immediately ingested into a warehouse.
Amazon DynamoDB is a NoSQL database, not designed for storing large files or directly querying raw file content using SQL.
Concept tested: Scalable, cost-effective, SQL-queryable object storage
Source: https://aws.amazon.com/s3/features/
Topics
Community Discussion
No community discussion yet for this question.