Predicting the performance of recommender systems: an information theoretic approach

Authors:
Alejandro Bellogín;Pablo Castells;Iván Cantador
Affiliations:
Universidad Autónoma de Madrid, Escuela Politécnica Superior, Departamento de Ingeniería Informática, Madrid, Spain;Universidad Autónoma de Madrid, Escuela Politécnica Superior, Departamento de Ingeniería Informática, Madrid, Spain;Universidad Autónoma de Madrid, Escuela Politécnica Superior, Departamento de Ingeniería Informática, Madrid, Spain
Venue:
ICTIR'11 Proceedings of the Third international conference on Advances in information retrieval theory
Year:
2011

Citing 15
Cited 3

An algorithmic framework for performing collaborative filtering

Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval
Predicting query performance

SIGIR '02 Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval
Latent semantic models for collaborative filtering

ACM Transactions on Information Systems (TOIS)
Topic prediction based on comparative retrieval rankings

Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval
A framework for selective query expansion

Proceedings of the thirteenth ACM international conference on Information and knowledge management
Toward the Next Generation of Recommender Systems: A Survey of the State-of-the-Art and Possible Extensions

IEEE Transactions on Knowledge and Data Engineering
Learning to estimate query difficulty: including applications to missing content detection and distributed information retrieval

Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval
Query performance prediction in web search environments

SIGIR '07 Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval
Unified relevance models for rating prediction in collaborative filtering

ACM Transactions on Information Systems (TOIS)
A survey of pre-retrieval query performance predictors

Proceedings of the 17th ACM conference on Information and knowledge management
Predicting Query Performance by Query-Drift Estimation

ICTIR '09 Proceedings of the 2nd International Conference on Theory of Information Retrieval: Advances in Information Retrieval Theory
Ranking List Dispersion as a Query Performance Predictor

ICTIR '09 Proceedings of the 2nd International Conference on Theory of Information Retrieval: Advances in Information Retrieval Theory
Learning to rank query reformulations

Proceedings of the 33rd international ACM SIGIR conference on Research and development in information retrieval
Text retrieval methods for item ranking in collaborative filtering

ECIR'11 Proceedings of the 33rd European conference on Advances in information retrieval
A performance prediction approach to enhance collaborative filtering performance

ECIR'2010 Proceedings of the 32nd European conference on Advances in Information Retrieval

Predicting performance in recommender systems

Proceedings of the fifth ACM conference on Recommender systems
Understanding Similarity Metrics in Neighbour-based Recommender Systems

Proceedings of the 2013 Conference on the Theory of Information Retrieval
Neighbor Selection and Weighting in User-Based Collaborative Filtering: A Performance Prediction Approach

ACM Transactions on the Web (TWEB)

Quantified Score

Hi-index	0.00

Visualization

Abstract

Performance prediction is an appealing problem in Recommender Systems, as it enables an array of strategies for deciding when to deliver or hold back recommendations based on their foreseen accuracy. The problem, however, has been barely addressed explicitly in the area. In this paper, we propose adaptations of query clarity techniques from ad-hoc Information Retrieval to define performance predictors in the context of Recommender Systems, which we refer to as user clarity. Our experiments show positive results with different user clarity models in terms of the correlation with single recommender's performance. Empiric results show significant dependency between this correlation and the recommendation method at hand, as well as competitive results in terms of average correlation.