Mucun Tian

Monte Carlo Estimates of Evaluation Metric Error and Bias

2018

Traditional offline evaluations of recommender systems apply metrics from machine learning and information retrieval in settings where their underlying assumptions no longer hold. This results in significant error and bias in measures of top-N recommendation …