A company hosts multiple real-time SageMaker models that require accelerated instances and have different scaling needs. Cold starts must be prevented for every model. Which design meets these constraints?
Choose an answer
Tap an option to check your answer.
Correct answer: Create a SageMaker endpoint, add an inference component for each model that points to that endpoint, configure auto scaling per inference component, and set the minimum number of copies to at least 1..
Why this is the answer
The correct option leverages SageMaker's inference component feature, which allows multiple models with different scaling needs to share a single endpoint while maintaining isolation and individual scaling. By creating an inference component for each model and configuring auto scaling with a minimum of one copy, cold starts are prevented, and each model can scale independently on accelerated instances. Serverless Inference with provisioned concurrency is suitable for preventing cold starts but doesn't inherently support different accelerated instance types per model within the same endpoint, nor does it offer the fine-grained control of inference components for diverse scaling. Asynchronous Inference is designed for large payloads and infrequent requests, not real-time scenarios. A multi-model endpoint is efficient for hosting many models on shared instances but typically assumes similar resource requirements and scaling behavior across models, making it less ideal for models with "different scaling needs" and specific accelerated instance requirements.
Pass your exam — without the endless answer hunt
Get every verified question and explanation for this exam in one place, and save hours of prep. 1,000+ certifications · 20+ languages · free to start.
Pass your exam faster → No card needed