A data engineer needs to build an enterprise data catalog based on the company's Amazon S3 buckets and Amazon RDS databases. The data catalog must include storage format metadata for the data in the…

Question

Options

• AUse an AWS Glue crawler to scan the S3 buckets and RDS databases and build a data catalog.
• BUse an AWS Glue crawler to build a data catalog. Use AWS Glue crawler classifiers to recognize
• CUse Amazon Macie to build a data catalog and to identify sensitive data elements. Collect the
• DUse scripts to scan data elements and to assign data classifications based on the format of the

• A
  4% (2)
• B
  74% (40)
• C
  7% (4)
• D
  15% (8)

Explanation

AWS Glue crawlers can automatically scan data in Amazon S3 buckets and Amazon RDS databases to build a data catalog. Glue crawlers also have classifiers that can automatically detect the format of the data (such as CSV, JSON, Parquet, etc.) and store this information as metadata in the Data Catalog. This solution automates the process of cataloging and format recognition, meeting the requirement with the least effort. The "Use an AWS Glue crawler to scan the S3 buckets and RDS databases and build a data catalog. Use data stewards to inspect the data and update the data catalog with the data format." option requires manual inspection and updating of the data catalog by data stewards, which adds significant effort and is unnecessary since Glue crawlers can automatically detect the format. Amazon Macie is primarily used for identifying sensitive data (e.g., PII), not for building a comprehensive data catalog or identifying data formats. It doesn't meet the requirement of cataloging storage format metadata. Writing custom scripts to scan and classify data based on format is much more labor-intensive compared to using an automated Glue crawler, which handles this task with much less effort.

No community discussion yet for this question.