nerdexam
Amazon

MLS-C01 · Question #26

A financial services company is building a robust serverless data lake on Amazon S3. The data lake should be flexible and meet the following requirements: - Support querying old and new data on…

The correct answer is A. Use an AWS Glue crawler to crawl S3 data, an AWS Lambda function to trigger an AWS Glue. The AWS Glue Data Catalog is your persistent metadata store. It is a managed service that lets you store, annotate, and share metadata in the AWS Cloud in the same way you would in an Apache Hive metastore. The Data Catalog is a drop-in replacement for the Apache Hive Metastore…

Data Engineering

Question

A financial services company is building a robust serverless data lake on Amazon S3. The data lake should be flexible and meet the following requirements:

  • Support querying old and new data on Amazon S3 through Amazon Athena

and Amazon Redshift Spectrum.

  • Support event-driven ETL pipelines
  • Provide a quick and easy way to understand metadata

Which approach meets these requirements?

Options

  • AUse an AWS Glue crawler to crawl S3 data, an AWS Lambda function to trigger an AWS Glue
  • BUse an AWS Glue crawler to crawl S3 data, an AWS Lambda function to trigger an AWS Batch
  • CUse an AWS Glue crawler to crawl S3 data, an Amazon CloudWatch alarm to trigger an AWS
  • DUse an AWS Glue crawler to crawl S3 data, an Amazon CloudWatch alarm to trigger an AWS

How the community answered

(41 responses)
  • A
    83% (34)
  • B
    10% (4)
  • C
    5% (2)
  • D
    2% (1)

Explanation

The AWS Glue Data Catalog is your persistent metadata store. It is a managed service that lets you store, annotate, and share metadata in the AWS Cloud in the same way you would in an Apache Hive metastore. The Data Catalog is a drop-in replacement for the Apache Hive Metastore https://docs.aws.amazon.com/zh_tw/glue/latest/dg/components-overview.html

Topics

#Data Lake Architecture#Serverless ETL#AWS Glue#Metadata Management

Community Discussion

No community discussion yet for this question.

Full MLS-C01 Practice