A retail company gets very few purchases per customer and relies on many new users. When splitting data for training and testing a custom recommender, how should the data scientist create a test set that reflects real usage?
Choose an answer
Tap an option to check your answer.
Correct answer: For each user, take their most recent 10% of interactions and use those per-user recent interactions as the test set..
Why this is the answer
The correct approach is to use each user's most recent interactions as the test set. This method simulates how a recommender system would be used in practice: predicting future behavior based on past interactions. It ensures the model is evaluated on its ability to recommend new items a user would interact with, rather than items they have already interacted with. Shuffling all records and holding out the last 10% of overall interactions (option 1) could include historical data for users in the test set, which doesn't reflect real-world prediction. Selecting users with the fewest interactions (option 3) or randomly selecting users (option 4) for the test set would not accurately assess the model's ability to make future recommendations for existing users, which is crucial for a recommender system.
Pass your exam — without the endless answer hunt
Get every verified question and explanation for this exam in one place, and save hours of prep. 1,000+ certifications · 20+ languages · free to start.
Pass your exam faster → No card needed