Comparative evaluation of recommender system quality

  • Authors:
  • Paolo Cremonesi;Franca Garzotto;Sara Negro;Alessandro Papadopoulos;Roberto Turrin

  • Affiliations:
  • Politecnico di Milano, Milano, Italy;Politecnico di Milano, Milano, Italy;Politecnico di Milano, Milano, Italy;Politecnico di Milano, Milano, Italy;Moviri srl, Milano, Italy

  • Venue:
  • CHI '11 Extended Abstracts on Human Factors in Computing Systems
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

Several researchers suggest that the Recommendation Systems (RSs) that are the "best" according to statistical metrics might not be the most satisfactory for the user. We explored this issue through an empirical study that involved 210 users and considered 7 RSs using different recommender algorithms on the same dataset. We measured user's perceived quality of each RS, and compared these results against measures of statistical quality of the considered algorithms as they have been assessed by past studies in the field, highlighting some interesting results.