nerdexam
Amazon

DEA-C01 · Question #29

A company needs to set up a data catalog and metadata management for data sources that run in the AWS Cloud. The company will use the data catalog to maintain the metadata of all the objects that are

The correct answer is B. Use the AWS Glue Data Catalog as the central metadata repository. Use AWS Glue crawlers to. To set up a data catalog and metadata management for various AWS data sources with the least operational overhead, use the AWS Glue Data Catalog as the central repository and employ AWS Glue crawlers to automatically discover schemas, update metadata regularly, and detect source

Data Ingestion and Transformation

Question

A company needs to set up a data catalog and metadata management for data sources that run in the AWS Cloud. The company will use the data catalog to maintain the metadata of all the objects that are in a set of data stores. The data stores include structured sources such as Amazon RDS and Amazon Redshift. The data stores also include semistructured sources such as JSON files and .xml files that are stored in Amazon S3. The company needs a solution that will update the data catalog on a regular basis. The solution also must detect changes to the source metadata. Which solution will meet these requirements with the LEAST operational overhead?

Options

  • AUse Amazon Aurora as the data catalog. Create AWS Lambda functions that will connect to the
  • BUse the AWS Glue Data Catalog as the central metadata repository. Use AWS Glue crawlers to
  • CUse Amazon DynamoDB as the data catalog. Create AWS Lambda functions that will connect to
  • DUse the AWS Glue Data Catalog as the central metadata repository. Extract the schema for

How the community answered

(32 responses)
  • A
    3% (1)
  • B
    84% (27)
  • C
    9% (3)
  • D
    3% (1)

Why each option

To set up a data catalog and metadata management for various AWS data sources with the least operational overhead, use the AWS Glue Data Catalog as the central repository and employ AWS Glue crawlers to automatically discover schemas, update metadata regularly, and detect source metadata changes.

AUse Amazon Aurora as the data catalog. Create AWS Lambda functions that will connect to the

Using Amazon Aurora as a custom data catalog with AWS Lambda functions requires significant development effort to build and maintain the catalog and schema detection logic, leading to high operational overhead.

BUse the AWS Glue Data Catalog as the central metadata repository. Use AWS Glue crawlers toCorrect

The AWS Glue Data Catalog is a fully managed, central metadata repository that works seamlessly with AWS Glue crawlers to automatically discover schemas, update metadata regularly, and detect changes across structured and semi-structured data sources in AWS, providing the least operational overhead.

CUse Amazon DynamoDB as the data catalog. Create AWS Lambda functions that will connect to

Using Amazon DynamoDB as a custom data catalog with AWS Lambda functions requires significant development effort for schema definition, metadata extraction, and maintenance, resulting in high operational overhead.

DUse the AWS Glue Data Catalog as the central metadata repository. Extract the schema for

While the AWS Glue Data Catalog is correct, merely stating "Extract the schema for metadata" is less specific and implies potentially manual or custom methods, whereas AWS Glue crawlers (as mentioned in option B) are the managed, low-overhead solution for automatic schema discovery and updates.

Concept tested: AWS Glue Data Catalog and Crawlers

Source: https://docs.aws.amazon.com/glue/latest/dg/catalog-dg.html

Topics

#AWS Glue#Data Catalog#Metadata Management#Glue Crawlers

Community Discussion

No community discussion yet for this question.

Full DEA-C01 Practice