Vaibhav Mahant

Sturgeon and the Cool Kids: Problems with Random Decoys for Top-N Recommender Evaluation

2017 · Scholar Works (Boise State University)

Top-N evaluation of recommender systems, typically carried out using metrics from information retrieval or machine learning, has several challenges. Two of these challenges are popularity bias, where the evaluation intrinsically favors algorithms that recommend popular …