Item-based collaborative filtering recommendation algorithms
Proceedings of the 10th international conference on World Wide Web
MovieLens unplugged: experiences with an occasionally connected recommender system
Proceedings of the 8th international conference on Intelligent user interfaces
Evaluating collaborative filtering recommender systems
ACM Transactions on Information Systems (TOIS)
Item-based top-N recommendation algorithms
ACM Transactions on Information Systems (TOIS)
The Long Tail: Why the Future of Business Is Selling Less of More
The Long Tail: Why the Future of Business Is Selling Less of More
Factorization meets the neighborhood: a multifaceted collaborative filtering model
Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining
An Evaluation Methodology for Collaborative Recommender Systems
AXMEDIS '08 Proceedings of the 2008 International Conference on Automated solutions for Cross Media Content and Multi-channel Distribution
Collaborative Filtering for Implicit Feedback Datasets
ICDM '08 Proceedings of the 2008 Eighth IEEE International Conference on Data Mining
Collaborative filtering with temporal dynamics
Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining
Collaborative user modeling with user-generated tags for social recommender systems
Expert Systems with Applications: An International Journal
Comparative evaluation of recommender system quality
CHI '11 Extended Abstracts on Human Factors in Computing Systems
Utilizing marginal net utility for recommendation in e-commerce
Proceedings of the 34th international ACM SIGIR conference on Research and development in Information Retrieval
An analysis of probabilistic methods for top-N recommendation in collaborative filtering
ECML PKDD'11 Proceedings of the 2011 European conference on Machine learning and knowledge discovery in databases - Volume Part I
Hybrid algorithms for recommending new items
Proceedings of the 2nd International Workshop on Information Heterogeneity and Fusion in Recommender Systems
Semantically enhanced collaborative filtering based on RSVD
ICCCI'11 Proceedings of the Third international conference on Computational collective intelligence: technologies and applications - Volume Part II
Hybrid recommendation based on low-dimensional augmentation of combined feature profiles
ICCCI'11 Proceedings of the Third international conference on Computational collective intelligence: technologies and applications - Volume Part II
Looking for "good" recommendations: a comparative evaluation of recommender systems
INTERACT'11 Proceedings of the 13th IFIP TC 13 international conference on Human-computer interaction - Volume Part III
Modeling item selection and relevance for accurate recommendations: a bayesian approach
Proceedings of the fifth ACM conference on Recommender systems
Random walk based entity ranking on graph for multidimensional recommendation
Proceedings of the fifth ACM conference on Recommender systems
Proceedings of the fifth ACM conference on Recommender systems
Item popularity and recommendation accuracy
Proceedings of the fifth ACM conference on Recommender systems
Multi-value probabilistic matrix factorization for IP-TV recommendations
Proceedings of the fifth ACM conference on Recommender systems
Precision-oriented evaluation of recommender systems: an algorithmic comparison
Proceedings of the fifth ACM conference on Recommender systems
A personalized recommendation system on scholarly publications
Proceedings of the 20th ACM international conference on Information and knowledge management
Improving k-nearest neighbors algorithms: practical application of dataset analysis
Proceedings of the 20th ACM international conference on Information and knowledge management
Proceedings of the fifth ACM international conference on Web search and data mining
Fast top-k retrieval for model based recommendation
Proceedings of the fifth ACM international conference on Web search and data mining
Determining user expertise for improving recommendation performance
Proceedings of the 6th International Conference on Ubiquitous Information Management and Communication
Long-tail recommendation based on reflective indexing
AI'11 Proceedings of the 24th international conference on Advances in Artificial Intelligence
Using past-prediction accuracy in recommender systems
Information Sciences: an International Journal
ACM Transactions on Interactive Intelligent Systems (TiiS)
User profiling vs. accuracy in recommender system user experience
Proceedings of the International Working Conference on Advanced Visual Interfaces
Feature based informative model for discriminating favorite items from unrated ones
APWeb'12 Proceedings of the 14th Asia-Pacific international conference on Web Technologies and Applications
Challenging the long tail recommendation
Proceedings of the VLDB Endowment
GetJar mobile application recommendations with very sparse datasets
Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining
Accelerated singular value thresholding for matrix completion
Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining
Explicit relevance models in intent-oriented information retrieval diversification
SIGIR '12 Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval
TFMAP: optimizing MAP for top-n context-aware recommendation
SIGIR '12 Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval
Adaptive diversification of recommendation results via latent factor portfolio
SIGIR '12 Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval
Pareto-efficient hybridization for multi-objective recommender systems
Proceedings of the sixth ACM conference on Recommender systems
User effort vs. accuracy in rating-based elicitation
Proceedings of the sixth ACM conference on Recommender systems
Real-time top-n recommendation in social streams
Proceedings of the sixth ACM conference on Recommender systems
On top-k recommendation using social networks
Proceedings of the sixth ACM conference on Recommender systems
Local implicit feedback mining for music recommendation
Proceedings of the sixth ACM conference on Recommender systems
CLiMF: learning to maximize reciprocal rank with collaborative less-is-more filtering
Proceedings of the sixth ACM conference on Recommender systems
Proceedings of the sixth ACM conference on Recommender systems
Swarming to rank for recommender systems
Proceedings of the sixth ACM conference on Recommender systems
Workshop on recommendation utility evaluation: beyond RMSE -- RUE 2012
Proceedings of the sixth ACM conference on Recommender systems
PathRank: Ranking nodes on a heterogeneous graph for flexible hybrid recommender systems
Expert Systems with Applications: An International Journal
Metaphor: a system for related search recommendations
Proceedings of the 21st ACM international conference on Information and knowledge management
Proceedings of the 21st ACM international conference on Information and knowledge management
PathRank: a novel node ranking measure on a heterogeneous graph for recommender systems
Proceedings of the 21st ACM international conference on Information and knowledge management
Climbing the app wall: enabling mobile app discovery through context-aware recommendations
Proceedings of the 21st ACM international conference on Information and knowledge management
Improving top-n recommendations with user consuming profiles
PRICAI'12 Proceedings of the 12th Pacific Rim international conference on Trends in Artificial Intelligence
A live comparison of methods for personalized article recommendation at forbes.com
ECML PKDD'12 Proceedings of the 2012 European conference on Machine Learning and Knowledge Discovery in Databases - Volume Part II
Advances in Engineering Software
App recommendation: a contest between satisfaction and temptation
Proceedings of the sixth ACM international conference on Web search and data mining
Co-factorization machines: modeling user interests and predicting individual decisions in Twitter
Proceedings of the sixth ACM international conference on Web search and data mining
Building user profiles to improve user experience in recommender systems
Proceedings of the sixth ACM international conference on Web search and data mining
Proceedings of the 2013 international conference on Intelligent user interfaces
Transfer learning in heterogeneous collaborative filtering domains
Artificial Intelligence
Learning Rating Patterns for Top-N Recommendations
ASONAM '12 Proceedings of the 2012 International Conference on Advances in Social Networks Analysis and Mining (ASONAM 2012)
Learning User Preference Patterns for Top-N Recommendations
WI-IAT '12 Proceedings of the The 2012 IEEE/WIC/ACM International Joint Conferences on Web Intelligence and Intelligent Agent Technology - Volume 01
Serendipitous Personalized Ranking for Top-N Recommendation
WI-IAT '12 Proceedings of the The 2012 IEEE/WIC/ACM International Joint Conferences on Web Intelligence and Intelligent Agent Technology - Volume 01
Nontrivial landmark recommendation using geotagged photos
ACM Transactions on Intelligent Systems and Technology (TIST) - Special Sections on Paraphrasing; Intelligent Systems for Socially Aware Computing; Social Computing, Behavioral-Cultural Modeling, and Prediction
Opportunity model for e-commerce recommendation: right product; right time
Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval
Sentiment analysis of user comments for one-class collaborative filtering over ted talks
Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval
FISM: factored item similarity models for top-N recommender systems
Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining
LCARS: a location-content-aware recommender system
Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining
Probabilistic group recommendation via information matching
Proceedings of the 22nd international conference on World Wide Web
Is it time for a career switch?
Proceedings of the 22nd international conference on World Wide Web
TopRec: domain-specific recommendation through community topic mining in social network
Proceedings of the 22nd international conference on World Wide Web
Multimedia retrieval that matters
ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP) - Special Sections on the 20th Anniversary of ACM International Conference on Multimedia, Best Papers of ACM Multimedia 2012
Temporal influence over the Last.fm social network
Proceedings of the 2013 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining
GAPfm: optimal top-n recommendations for graded relevance domains
Proceedings of the 22nd ACM international conference on Conference on information & knowledge management
Evaluation of recommendations: rating-prediction and ranking
Proceedings of the 7th ACM conference on Recommender systems
Proceedings of the 7th ACM conference on Recommender systems
To personalize or not: a risk management perspective
Proceedings of the 7th ACM conference on Recommender systems
Hybrid event recommendation using linked data and user diversity
Proceedings of the 7th ACM conference on Recommender systems
Top-N recommendations from implicit feedback leveraging linked open data
Proceedings of the 7th ACM conference on Recommender systems
Retargeted matrix factorization for collaborative filtering
Proceedings of the 7th ACM conference on Recommender systems
Which app will you use next?: collaborative filtering with interactional context
Proceedings of the 7th ACM conference on Recommender systems
Effectiveness of the data generated on different time in latent factor model
Proceedings of the 7th ACM conference on Recommender systems
Evaluating top-n recommendations "when the best are gone"
Proceedings of the 7th ACM conference on Recommender systems
xCLiMF: optimizing expected reciprocal rank for data with multiple levels of relevance
Proceedings of the 7th ACM conference on Recommender systems
Hybrid recommenders: incorporating metadata awareness into latent factor models
Proceedings of the 19th Brazilian symposium on Multimedia and the web
CLiMF: collaborative less-is-more filtering
IJCAI'13 Proceedings of the Twenty-Third international joint conference on Artificial Intelligence
ACM Transactions on Intelligent Systems and Technology (TIST) - Special Section on Intelligent Mobile Knowledge Discovery and Management Systems and Special Issue on Social Web Mining
Location sharing privacy preference: analysis and personalized recommendation
Proceedings of the 19th international conference on Intelligent User Interfaces
Probabilistic topic models for sequence data
Machine Learning
Cross domain recommendation based on multi-type media fusion
Neurocomputing
Proceedings of the 23rd international conference on World wide web
A new user similarity model to improve the accuracy of collaborative filtering
Knowledge-Based Systems
A framework for tag-aware recommender systems
Expert Systems with Applications: An International Journal
Time-aware recommender systems: a comprehensive survey and analysis of existing evaluation protocols
User Modeling and User-Adapted Interaction
Clustering-based diversity improvement in top-N recommendation
Journal of Intelligent Information Systems
Hi-index | 0.00 |
In many commercial systems, the 'best bet' recommendations are shown, but the predicted rating values are not. This is usually referred to as a top-N recommendation task, where the goal of the recommender system is to find a few specific items which are supposed to be most appealing to the user. Common methodologies based on error metrics (such as RMSE) are not a natural fit for evaluating the top-N recommendation task. Rather, top-N performance can be directly measured by alternative methodologies based on accuracy metrics (such as precision/recall). An extensive evaluation of several state-of-the art recommender algorithms suggests that algorithms optimized for minimizing RMSE do not necessarily perform as expected in terms of top-N recommendation task. Results show that improvements in RMSE often do not translate into accuracy improvements. In particular, a naive non-personalized algorithm can outperform some common recommendation approaches and almost match the accuracy of sophisticated algorithms. Another finding is that the very few top popular items can skew the top-N performance. The analysis points out that when evaluating a recommender algorithm on the top-N recommendation task, the test set should be chosen carefully in order to not bias accuracy metrics towards non-personalized solutions. Finally, we offer practitioners new variants of two collaborative filtering algorithms that, regardless of their RMSE, significantly outperform other recommender algorithms in pursuing the top-N recommendation task, with offering additional practical advantages. This comes at surprise given the simplicity of these two methods.