You want to route a small portion of traffic to a new model version for preview users, evaluate it, and then gradually shift all traffic to the new model over a fixed timeframe with minimal operational overhead. Which SageMaker approach accomplishes this with the least operational work?
Choose an answer
Tap an option to check your answer.
Correct answer: Call UpdateEndpointWeightsAndCapacities to change DesiredWeightsAndCapacity for the endpoint, setting DesiredWeight to 0 for the new model. For preview users, specify TargetVariant in InvokeEndpoint calls. Gradually increase DesiredWeight to shift traffic until the new version serves all users..
Why this is the answer
The correct approach leverages SageMaker's built-in traffic shifting capabilities with UpdateEndpointWeightsAndCapacities. This allows you to update an existing endpoint to include a new model variant with an initial weight of 0, effectively making it inactive for general traffic. Preview users can then be directed to this specific variant using the TargetVariant parameter in their InvokeEndpoint calls. As confidence grows, you can gradually increase the DesiredWeight of the new variant, shifting traffic until it serves all users, all within a single SageMaker endpoint. The first incorrect option, using CreateEndpointConfig, creates a new endpoint configuration, which would require updating the endpoint itself or creating a new endpoint, adding operational overhead. The second and fourth options, using an Application Load Balancer or Route 53 with two separate endpoints, introduce external infrastructure management and increase operational complexity compared to SageMaker's native endpoint update features.
Pass your exam — without the endless answer hunt
Get every verified question and explanation for this exam in one place, and save hours of prep. 1,000+ certifications · 20+ languages · free to start.
Pass your exam faster → No card needed