A company’s XGBoost model in production shows a significant drop in F1 score after several months, compared with the baseline threshold recorded earlier by SageMaker Model Monitor. What is the most likely cause of the reduced F1 score?
Choose an answer
Tap an option to check your answer.
Correct answer: Concept drift in the underlying customer data used for predictions..
Why this is the answer
The most likely cause for a significant drop in F1 score over time is concept drift. Concept drift occurs when the relationship between the input features and the target variable changes over time, or when the distribution of the input features themselves changes. This means the model, which was trained on older data, is no longer accurate for the new data patterns, leading to degraded performance metrics like F1 score. The model's original architecture being too simple would have led to poor performance from the start, not a gradual decline. Missing-value data quality issues in the baseline dataset would also have impacted initial performance or model training, not caused a drop months later. Incorrect ground-truth labels for the baseline would mean the baseline F1 score itself was inaccurate, but it wouldn't explain a drop relative to that (potentially flawed) baseline unless the ground truth for current data was also consistently incorrect in a way that exaggerated the decline.
Pass your exam — without the endless answer hunt
Get every verified question and explanation for this exam in one place, and save hours of prep. 1,000+ certifications · 20+ languages · free to start.
Pass your exam faster → No card needed