Towards a more realistic evaluation: testing the ability to predict future tastes of matrix factorization-based recommenders

  • Authors:
  • Pedro G. Campos;Fernando Díez;Manuel Sánchez-Montañés

  • Affiliations:
  • Universidad Autónoma de Madrid & Universidad del Bío-Bío, Madrid, Spain;Universidad Autónoma de Madrid, Madrid, Spain;Universidad Autónoma de Madrid, Madrid, Spain

  • Venue:
  • Proceedings of the fifth ACM conference on Recommender systems
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

The use of temporal dynamic terms in Matrix Factorization (MF) models of recommendation have been proposed as a means to obtain better accuracy in rating prediction task. However, the way such models have been tested may not be a realistic setting for recommendation. In this paper, we evaluated rating prediction and top-N recommendation tasks using a MF model with and without temporal dynamic terms under two evaluation settings. Our experiments show that the addition of dynamic parameters do not necessarily yield to better results on these tasks when a more strict time-aware separation of train/test data is performed, and moreover, results may vary notably when different evaluation schemes are used.