A production ML pipeline on Amazon SageMaker processes inputs up to 1 GB and jobs that can run up to an hour, but the application requires near real-time responses. Which SageMaker inference option is most appropriate?
Choose an answer
Tap an option to check your answer.
Correct answer: Asynchronous inference.
Why this is the answer
Asynchronous inference is the most appropriate option because it is designed for workloads with large payload sizes (up to 1 GB) and long processing times (up to an hour) while still providing near real-time responses. It uses a queue to manage requests, allowing the client to submit a request and retrieve the result later. Real-time inference is suitable for small payloads and low latency requirements, but not for 1 GB inputs or 1-hour processing times. Serverless inference also has payload size and processing time limits that are too restrictive for this scenario. Batch transform is for offline processing of large datasets and does not provide near real-time responses.
Pass your exam — without the endless answer hunt
Get every verified question and explanation for this exam in one place, and save hours of prep. 1,000+ certifications · 20+ languages · free to start.
Pass your exam faster → No card needed