nerdexam
Amazon

MLS-C01 · Question #363

A media company wants to deploy a machine learning (ML) model that uses Amazon SageMaker to recommend new articles to the company's readers. The company's readers are primarily located in a single…

The correct answer is B. Serverless inference with provisioned concurrency. For an ML model providing real-time article recommendations with predictable, spiky traffic and low latency requirements, SageMaker Serverless Inference with provisioned concurrency is the most cost-effective solution.

Machine Learning Implementation and Operations

Question

A media company wants to deploy a machine learning (ML) model that uses Amazon SageMaker to recommend new articles to the company's readers. The company's readers are primarily located in a single city. The company notices that the heaviest reader traffic predictably occurs early in the morning, after lunch, and again after work hours. There is very little traffic at other times of day. The media company needs to minimize the time required to deliver recommendations to its readers. The expected amount of data that the API call will return for inference is less than 4 MB. Which solution will meet these requirements in the MOST cost-effective way?

Options

  • AReal-time inference with auto scaling
  • BServerless inference with provisioned concurrency
  • CAsynchronous inference
  • DA batch transform task

How the community answered

(42 responses)
  • A
    7% (3)
  • B
    71% (30)
  • C
    17% (7)
  • D
    5% (2)

Why each option

For an ML model providing real-time article recommendations with predictable, spiky traffic and low latency requirements, SageMaker Serverless Inference with provisioned concurrency is the most cost-effective solution.

AReal-time inference with auto scaling

While SageMaker real-time inference with auto scaling provides low latency and scales with traffic, it does not scale down to zero instances during periods of very little traffic, resulting in higher costs compared to a serverless solution.

BServerless inference with provisioned concurrencyCorrect

Amazon SageMaker Serverless Inference is highly cost-effective for workloads with intermittent or spiky traffic, as it automatically scales resources and scales down to zero when idle. By adding provisioned concurrency, the solution ensures that requests during predictable peak traffic hours experience minimal latency by eliminating cold starts, directly addressing the need to minimize delivery time.

CAsynchronous inference

SageMaker Asynchronous Inference is designed for large payloads or long-running inferences where immediate responses are not critical, which contradicts the requirement to minimize the time required to deliver recommendations (low latency).

DA batch transform task

A SageMaker batch transform task is used for offline processing of large datasets and is unsuitable for providing real-time recommendations that require minimal delivery time.

Concept tested: SageMaker inference options for variable traffic

Source: https://aws.amazon.com/sagemaker/serverless-inference/

Topics

#SageMaker Inference#Serverless ML#Low Latency#Cost Optimization

Community Discussion

No community discussion yet for this question.

Full MLS-C01 Practice