Learning and adaptivity in interactive recommender systems
Proceedings of the ninth international conference on Electronic commerce
Usage-based web recommendations: a reinforcement learning approach
Proceedings of the 2007 ACM conference on Recommender systems
Adapting the interaction state model in conversational recommender systems
Proceedings of the 10th international conference on Electronic commerce
The value of personalised recommender systems to e-business: a case study
Proceedings of the 2008 ACM conference on Recommender systems
Using Skipping for Sequence-Based Collaborative Filtering
WI-IAT '08 Proceedings of the 2008 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology - Volume 01
A low-order markov model integrating long-distance histories for collaborative recommender systems
Proceedings of the 14th international conference on Intelligent user interfaces
Improving recommender systems with adaptive conversational strategies
Proceedings of the 20th ACM conference on Hypertext and hypermedia
An Inductive Logic Programming Approach to Statistical Relational Learning
Proceedings of the 2005 conference on An Inductive Logic Programming Approach to Statistical Relational Learning
WI-IAT '09 Proceedings of the 2009 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology - Volume 03
A survey of collaborative filtering techniques
Advances in Artificial Intelligence
A Survey of Accuracy Evaluation Metrics of Recommendation Tasks
The Journal of Machine Learning Research
Factorizing personalized Markov chains for next-basket recommendation
Proceedings of the 19th international conference on World wide web
Prediction of social bookmarking based on a behavior transition model
Proceedings of the 2010 ACM Symposium on Applied Computing
Beyond the usual suspects: context-aware revisitation support
Proceedings of the 22nd ACM conference on Hypertext and hypermedia
Utilizing marginal net utility for recommendation in e-commerce
Proceedings of the 34th international ACM SIGIR conference on Research and development in Information Retrieval
Personalized pricing recommender system: multi-stage epsilon-greedy approach
Proceedings of the 2nd International Workshop on Information Heterogeneity and Fusion in Recommender Systems
Collaborative temporal order modeling
Proceedings of the fifth ACM conference on Recommender systems
A careful assessment of recommendation algorithms related to dimension reduction techniques
Knowledge-Based Systems
PERVASIVE'05 Proceedings of the Third international conference on Pervasive Computing
A recommendation algorithm combining clustering method and slope one scheme
ICIC'11 Proceedings of the 7th international conference on Intelligent Computing: bio-inspired computing and applications
Collaborative Filtering Recommender Systems
Foundations and Trends in Human-Computer Interaction
Personalized news recommendation: a review and an experimental investigation
Journal of Computer Science and Technology - Special issue on Community Analysis and Information Recommendation
The Skyline algorithm for POMDP value function pruning
Annals of Mathematics and Artificial Intelligence
Electronic Commerce Research and Applications
Optimal radio channel recommendations with explicit and implicit feedback
Proceedings of the sixth ACM conference on Recommender systems
Topic model for analyzing purchase data with price information
Data Mining and Knowledge Discovery
A survey of point-based POMDP solvers
Autonomous Agents and Multi-Agent Systems
A new approach for collaborative filtering based on mining frequent itemsets
ACIIDS'13 Proceedings of the 5th Asian conference on Intelligent Information and Database Systems - Volume Part II
Personalized News Recommendation Based on Collaborative Filtering
WI-IAT '12 Proceedings of the The 2012 IEEE/WIC/ACM International Joint Conferences on Web Intelligence and Intelligent Agent Technology - Volume 01
Opportunity model for e-commerce recommendation: right product; right time
Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval
Movie recommender system for profit maximization
Proceedings of the 7th ACM conference on Recommender systems
Personalized news recommendation with context trees
Proceedings of the 7th ACM conference on Recommender systems
ACM Transactions on Interactive Intelligent Systems (TiiS)
Exploiting two-faceted web of trust for enhanced-quality recommendations
Expert Systems with Applications: An International Journal
Machine Learning
| Hi-index | 0.00 |
Typical recommender systems adopt a static view of the recommendation process and treat it as a prediction problem. We argue that it is more appropriate to view the problem of generating recommendations as a sequential optimization problem and, consequently, that Markov decision processes (MDPs) provide a more appropriate model for recommender systems. MDPs introduce two benefits: they take into account the long-term effects of each recommendation and the expected value of each recommendation. To succeed in practice, an MDP-based recommender system must employ a strong initial model, must be solvable quickly, and should not consume too much memory. In this paper, we describe our particular MDP model, its initialization using a predictive model, the solution and update algorithm, and its actual performance on a commercial site. We also describe the particular predictive model we used which outperforms previous models. Our system is one of a small number of commercially deployed recommender systems. As far as we know, it is the first to report experimental analysis conducted on a real commercial site. These results validate the commercial value of recommender systems, and in particular, of our MDP-based approach.