Amazon
MLS-C01 · Question #85
A Machine Learning Specialist wants to determine the appropriate setting for an endpoint automatic scaling SageMakerVariantInvocationsPerInstance configuration. The Specialist has performed a load…
The correct answer is C. 600. SageMakerVariantInvocationsPerInstance = (MAX_RPS SAFETY_FACTOR) 60 https://docs.aws.amazon.com/sagemaker/latest/dg/endpoint-scaling-loadtest.html
Machine Learning Implementation and Operations
Question
A Machine Learning Specialist wants to determine the appropriate setting for an endpoint automatic scaling SageMakerVariantInvocationsPerInstance configuration. The Specialist has performed a load test on a single instance and determined that peak requests per second (RPS) without service degradation is about 20 RPS. As this is the first deployment, the Specialist intends to set the invocation safety factor to 0.5. Based on the stated parameters and given that the invocations per instance setting is measured on a per-minute basis, what should the Specialist set as the setting? SageMakerVariantInvocationsPerInstance
Options
- A10
- B30
- C600
- D2,400
How the community answered
(53 responses)- A6% (3)
- B11% (6)
- C81% (43)
- D2% (1)
Explanation
SageMakerVariantInvocationsPerInstance = (MAX_RPS * SAFETY_FACTOR) * 60 https://docs.aws.amazon.com/sagemaker/latest/dg/endpoint-scaling-loadtest.html
Topics
#SageMaker Endpoint Scaling#Automatic Scaling#Invocation Metrics#Safety Factor
Community Discussion
No community discussion yet for this question.