MediaWatch runs a real-time video classification model and wants to alert when model execution time rises. Which CloudWatch metric should be used to detect increased model container inference time only, and what is the recommended way to alarm on sustained increases for a particular variant of an endpoint?
Choose an answer
Tap an option to check your answer.
Correct answer: Use the AWS/SageMaker 'ModelLatency' metric with dimensions EndpointName and VariantName (this measures time in the model container). Create a CloudWatch alarm on the p90 (or desired percentile) statistic for ModelLatency over a 5-minute period with evaluation periods set to 3 to detect sustained increases..
Why this is the answer
The correct answer identifies 'ModelLatency' as the metric that specifically measures the time spent inside the model container, which is crucial for detecting increases in model inference time. Using 'EndpointName' and 'VariantName' dimensions ensures the alarm is specific to a particular model variant. Alarming on a p90 (or other percentile) statistic over a 5-minute period with multiple evaluation periods (e.g., 3) effectively detects sustained increases, preventing false alarms from transient spikes. 'OverheadLatency' measures the time spent outside the model container, such as network overhead, not the model's execution. 'InvocationDuration' measures the total time from request to response, including network and SageMaker overhead, not just model compute. Alarming on a global 'ModelLatency' without dimensions would not isolate the issue to a specific variant, and alarming on a 'Minimum' dropping would indicate decreased latency, not increased.
Pass your exam — without the endless answer hunt
Get every verified question and explanation for this exam in one place, and save hours of prep. 1,000+ certifications · 20+ languages · free to start.
Pass your exam faster → No card needed