MLA-C01 · Question #213
An ML engineer is configuring auto scaling for an inference component of a model that runs behind an Amazon SageMaker AI endpoint. The ML engineer configures SageMaker AI auto scaling with a target…
The correct answer is D. Apply a step scaling policy that scales based on an Amazon CloudWatch alarm. Apply a second. Using a scheduled CloudWatch alarm with a step scaling policy allows the endpoint to proactively scale the minimum instance count from zero to one at the start of each business day. This ensures at least one instance is warm and ready to handle incoming requests immediately…
Question
An ML engineer is configuring auto scaling for an inference component of a model that runs behind an Amazon SageMaker AI endpoint. The ML engineer configures SageMaker AI auto scaling with a target tracking scaling policy set to 100 invocations per model per minute. The SageMaker AI endpoint scales appropriately during normal business hours. However, the ML engineer notices that at the start of each business day, there are zero instances available to handle requests, which causes delays in processing. The ML engineer must ensure that the SageMaker AI endpoint can handle incoming requests at the start of each business day. Which solution will meet this requirement?
Options
- AReduce the SageMaker AI auto scaling cooldown period to the minimum supported value. Add an
- BChange the target metric to CPU utilization.
- CModify the scaling policy target value to one.
- DApply a step scaling policy that scales based on an Amazon CloudWatch alarm. Apply a second
How the community answered
(43 responses)- A7% (3)
- B5% (2)
- C16% (7)
- D72% (31)
Explanation
Using a scheduled CloudWatch alarm with a step scaling policy allows the endpoint to proactively scale the minimum instance count from zero to one at the start of each business day. This ensures at least one instance is warm and ready to handle incoming requests immediately, while still allowing target tracking auto scaling to manage load during normal operation.
Topics
Community Discussion
No community discussion yet for this question.