Explaining collaborative filtering recommendations
CSCW '00 Proceedings of the 2000 ACM conference on Computer supported cooperative work
Empirical research in on-line trust: a review and critical assessment
International Journal of Human-Computer Studies - Special issue: Trust and technology
Evaluating collaborative filtering recommender systems
ACM Transactions on Information Systems (TOIS)
Using social psychology to motivate contributions to online communities
CSCW '04 Proceedings of the 2004 ACM conference on Computer supported cooperative work
Improving recommendation lists through topic diversification
WWW '05 Proceedings of the 14th international conference on World Wide Web
IEEE Transactions on Knowledge and Data Engineering
Trust building with explanation interfaces
Proceedings of the 11th international conference on Intelligent user interfaces
Being accurate is not enough: how accuracy metrics have hurt recommender systems
CHI '06 Extended Abstracts on Human Factors in Computing Systems
Evaluating product search and recommender systems for E-commerce environments
Electronic Commerce Research
A Survey of Explanations in Recommender Systems
ICDEW '07 Proceedings of the 2007 IEEE 23rd International Conference on Data Engineering Workshop
Interaction design guidelines on critiquing-based recommender systems
User Modeling and User-Adapted Interaction
Critiquing recommenders for public taste products
Proceedings of the third ACM conference on Recommender systems
Interfaces for eliciting new user preferences in recommender systems
UM'03 Proceedings of the 9th international conference on User modeling
Explaining the user experience of recommender systems
User Modeling and User-Adapted Interaction
Enhancing recommendation diversity with organization interfaces
Proceedings of the 16th international conference on Intelligent user interfaces
RecLab: a system for eCommerce recommender research with real data, context and feedback
Proceedings of the 2011 Workshop on Context-awareness in Retrieval and Recommendation
Comparative evaluation of recommender system quality
CHI '11 Extended Abstracts on Human Factors in Computing Systems
Users' (Dis)satisfaction with the personalTV application: Combining objective and subjective data
Computers in Entertainment (CIE) - Theoretical and Practical Computer Applications in Entertainment
Looking for "good" recommendations: a comparative evaluation of recommender systems
INTERACT'11 Proceedings of the 13th IFIP TC 13 international conference on Human-computer interaction - Volume Part III
Towards responsive open learning environments: the ROLE interoperability framework
EC-TEL'11 Proceedings of the 6th European conference on Technology enhanced learning: towards ubiquitous learning
Auralist: introducing serendipity into music recommendation
Proceedings of the fifth ACM international conference on Web search and data mining
Out of the bubble: serendipitous even recommendations at an urban music festival
Proceedings of the 2012 ACM international conference on Intelligent User Interfaces
An acceptance model of recommender systems based on a large-scale internet survey
UMAP'11 Proceedings of the 19th international conference on Advances in User Modeling
Effects of behavior monitoring and perceived system benefit in online recommender systems
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
To switch or not to switch: understanding social influence in online choices
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
User profiling vs. accuracy in recommender system user experience
Proceedings of the International Working Conference on Advanced Visual Interfaces
Evaluating recommender systems from the user's perspective: survey of the state of the art
User Modeling and User-Adapted Interaction
Explaining the user experience of recommender systems
User Modeling and User-Adapted Interaction
Users and noise: the magic barrier of recommender systems
UMAP'12 Proceedings of the 20th international conference on User Modeling, Adaptation, and Personalization
User effort vs. accuracy in rating-based elicitation
Proceedings of the sixth ACM conference on Recommender systems
The influence of knowledgeable explanations on users' perception of a recommender system
Proceedings of the sixth ACM conference on Recommender systems
Case study on the business value impact of personalized recommendations on a large online retailer
Proceedings of the sixth ACM conference on Recommender systems
A live comparison of methods for personalized article recommendation at forbes.com
ECML PKDD'12 Proceedings of the 2012 European conference on Machine Learning and Knowledge Discovery in Databases - Volume Part II
A hybrid decision approach to detect profile injection attacks in collaborative recommender systems
ISMIS'12 Proceedings of the 20th international conference on Foundations of Intelligent Systems
User-centric evaluation of a K-furthest neighbor collaborative filtering recommender algorithm
Proceedings of the 2013 conference on Computer supported cooperative work
Directing exploratory search: reinforcement learning from user interactions with keywords
Proceedings of the 2013 international conference on Intelligent user interfaces
Proceedings of the 2013 international conference on Intelligent user interfaces
Recommending energy tariffs and load shifting based on smart household usage profiling
Proceedings of the 2013 international conference on Intelligent user interfaces
Being confident about the quality of the predictions in recommender systems
ECIR'13 Proceedings of the 35th European conference on Advances in Information Retrieval
iHR: an online recruiting system for Xiamen Talent Service Center
Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining
Making Decisions about Privacy: Information Disclosure in Context-Aware Recommender Systems
ACM Transactions on Interactive Intelligent Systems (TiiS)
Automatically recommending multimedia content for use in group reminiscence therap
Proceedings of the 1st ACM international workshop on Multimedia indexing and information retrieval for healthcare
A month in the life of a production news recommender system
Proceedings of the 2013 workshop on Living labs for information retrieval evaluation
Designing the default privacy settings for facebook applications
Proceedings of the companion publication of the 17th ACM conference on Computer supported cooperative work & social computing
The neglected user in music information retrieval research
Journal of Intelligent Information Systems
Hi-index | 0.00 |
This research was motivated by our interest in understanding the criteria for measuring the success of a recommender system from users' point view. Even though existing work has suggested a wide range of criteria, the consistency and validity of the combined criteria have not been tested. In this paper, we describe a unifying evaluation framework, called ResQue (Recommender systems' Quality of user experience), which aimed at measuring the qualities of the recommended items, the system's usability, usefulness, interface and interaction qualities, users' satisfaction with the systems, and the influence of these qualities on users' behavioral intentions, including their intention to purchase the products recommended to them and return to the system. We also show the results of applying psychometric methods to validate the combined criteria using data collected from a large user survey. The outcomes of the validation are able to 1) support the consistency, validity and reliability of the selected criteria; and 2) explain the quality of user experience and the key determinants motivating users to adopt the recommender technology. The final model consists of thirty two questions and fifteen constructs, defining the essential qualities of an effective and satisfying recommender system, as well as providing practitioners and scholars with a cost-effective way to evaluate the success of a recommender system and identify important areas in which to invest development resources.