DAS-C01 · Question #124
A company receives data from its vendor in JSON format with a timestamp in the file name. The vendor uploads the data to an Amazon S3 bucket, and the data is registered into the company's data lake…
The correct answer is C. Use the excludeStorageClasses property in the AWS Glue Data Catalog table to exclude files on. The excludeStorageClasses property in the AWS Glue Data Catalog table definition allows you to specify storage classes (such as GLACIER) that the crawler should skip. This is a native Glue feature that filters files by their S3 storage class without requiring any changes to the…
Question
A company receives data from its vendor in JSON format with a timestamp in the file name. The vendor uploads the data to an Amazon S3 bucket, and the data is registered into the company's data lake for analysis and reporting. The company has configured an S3 Lifecycle policy to archive all files to S3 Glacier after 5 days. The company wants to ensure that its AWS Glue crawler catalogs data only from S3 Standard storage and ignores the archived files. A data analytics specialist must implement a solution to achieve this goal without changing the current S3 bucket configuration. Which solution meets these requirements?
Options
- AUse the exclude patterns feature of AWS Glue to identify the S3 Glacier files for the crawler to
- BSchedule an automation job that uses AWS Lambda to move files from the original S3 bucket to a
- CUse the excludeStorageClasses property in the AWS Glue Data Catalog table to exclude files on
- DUse the include patterns feature of AWS Glue to identify the S3 Standard files for the crawler to
How the community answered
(57 responses)- A12% (7)
- B5% (3)
- C79% (45)
- D4% (2)
Explanation
The excludeStorageClasses property in the AWS Glue Data Catalog table definition allows you to specify storage classes (such as GLACIER) that the crawler should skip. This is a native Glue feature that filters files by their S3 storage class without requiring any changes to the S3 bucket configuration or Lifecycle policy. Option A (exclude patterns) filters by file name or path prefix, not storage class, so it cannot distinguish Glacier-archived files from Standard files with the same names. Option B (Lambda to move files) would require changing the S3 bucket configuration, violating the requirement. Option D (include patterns) also filters by name/path, not storage class.
Topics
Community Discussion
No community discussion yet for this question.