nerdexam
Amazon

MLS-C01 · Question #87

A Machine Learning Specialist needs to move and transform data in preparation for training. Some of the data needs to be processed in near-real time, and other data can be moved hourly. There are…

The correct answer is B. Amazon Kinesis C. AWS Data Pipeline. Amazon Kinesis (B) is a real-time data streaming service that can continuously ingest and deliver data to EMR clusters, making it ideal for the near-real-time processing requirement. AWS Data Pipeline (C) is an orchestration service specifically designed to move and transform…

Data Engineering

Question

A Machine Learning Specialist needs to move and transform data in preparation for training. Some of the data needs to be processed in near-real time, and other data can be moved hourly. There are existing Amazon EMR MapReduce jobs to clean and feature engineering to perform on the data. Which of the following services can feed data to the MapReduce jobs? (Choose two.)

Options

  • AAWS DMS
  • BAmazon Kinesis
  • CAWS Data Pipeline
  • DAmazon Athena
  • EAmazon ES

How the community answered

(54 responses)
  • A
    11% (6)
  • B
    81% (44)
  • D
    2% (1)
  • E
    6% (3)

Explanation

Amazon Kinesis (B) is a real-time data streaming service that can continuously ingest and deliver data to EMR clusters, making it ideal for the near-real-time processing requirement. AWS Data Pipeline (C) is an orchestration service specifically designed to move and transform data between AWS services on a scheduled basis (e.g., hourly), and it natively supports triggering EMR MapReduce jobs. AWS DMS is for database migration, Amazon Athena is a query service for S3 data (it reads, not feeds), and Amazon ES (Elasticsearch) is a search/analytics service-none of these are designed to feed data into EMR pipelines.

Topics

#Data Ingestion#Real-time Data Processing#Batch Data Processing#Data Orchestration

Community Discussion

No community discussion yet for this question.

Full MLS-C01 Practice