Communications of the ACM
Referral Web: combining social networks and collaborative filtering
Communications of the ACM
Privacy in e-commerce: examining user scenarios and privacy preferences
Proceedings of the 1st ACM conference on Electronic commerce
Explaining collaborative filtering recommendations
CSCW '00 Proceedings of the 2000 ACM conference on Computer supported cooperative work
E-privacy in 2nd generation E-commerce: privacy preferences versus actual behavior
Proceedings of the 3rd ACM conference on Electronic Commerce
Interaction Design
Hybrid Recommender Systems: Survey and Experiments
User Modeling and User-Adapted Interaction
On the recommending of citations for research papers
CSCW '02 Proceedings of the 2002 ACM conference on Computer supported cooperative work
Empirical Evaluation of User Models and User-Adapted Systems
User Modeling and User-Adapted Interaction
Interacting with recommender systems
CHI '99 Extended Abstracts on Human Factors in Computing Systems
Is seeing believing?: how recommender system interfaces affect users' opinions
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Feature-Oriented vs. Needs-Oriented Product Access for Non-Expert-Online Shoppers
I3E '01 Proceedings of the IFIP Conference on Towards The E-Society: E-Commerce, E-Business, E-Government
Applying the Technology Acceptance Model and Flow Theory to Online Consumer Behavior
Information Systems Research
HICSS '04 Proceedings of the Proceedings of the 37th Annual Hawaii International Conference on System Sciences (HICSS'04) - Track 7 - Volume 7
Evaluating collaborative filtering recommender systems
ACM Transactions on Information Systems (TOIS)
Well-integrated needs-oriented recommender components regarded as helpful
CHI '04 Extended Abstracts on Human Factors in Computing Systems
Enhancing digital libraries with TechLens+
Proceedings of the 4th ACM/IEEE-CS joint conference on Digital libraries
An empirical investigation of decision-making satisfaction in web-based decision support systems
Decision Support Systems
Creating an E-commerce environment where consumers are willing to share personal information
Designing personalized user experiences in eCommerce
Designing personalized user experiences in eCommerce
Impacts of user privacy preferences on personalized systems: a comparative study
Designing personalized user experiences in eCommerce
Why do people play on-line games? an extended TAM with social influences and flow experience
Information and Management
Incorporating contextual information in recommender systems using a multidimensional approach
ACM Transactions on Information Systems (TOIS)
Improving recommendation lists through topic diversification
WWW '05 Proceedings of the 14th international conference on World Wide Web
Personalization versus Privacy: An Empirical Examination of the Online Consumer's Dilemma
Information Technology and Management
IEEE Transactions on Knowledge and Data Engineering
Trust building with explanation interfaces
Proceedings of the 11th international conference on Intelligent user interfaces
Being accurate is not enough: how accuracy metrics have hurt recommender systems
CHI '06 Extended Abstracts on Human Factors in Computing Systems
Making recommendations better: an analytic model for human-recommender interaction
CHI '06 Extended Abstracts on Human Factors in Computing Systems
Functionality, usability, and user experience: three areas of concern
interactions - Waits & Measures
Web Personalization as a Persuasion Strategy: An Elaboration Likelihood Model Perspective
Information Systems Research
Trust-inspiring explanation interfaces for recommender systems
Knowledge-Based Systems
International Journal of Electronic Commerce
Evaluating product search and recommender systems for E-commerce environments
Electronic Commerce Research
Who predicts better?: results from an online study comparing humans and an online recommender system
Proceedings of the 2008 ACM conference on Recommender systems
Online-updating regularized kernel matrix factorization models for large-scale recommender systems
Proceedings of the 2008 ACM conference on Recommender systems
The effects of transparency on trust in and acceptance of a content-based art recommender
User Modeling and User-Adapted Interaction
Preference-based search with adaptive recommendations
AI Communications - Recommender Systems
Recommendation Agents for Electronic Commerce: Effects of Explanation Facilities on Trusting Beliefs
Journal of Management Information Systems
A comparative user study on rating vs. personality quiz based preference elicitation methods
Proceedings of the 14th international conference on Intelligent user interfaces
Collaborative Filtering for Implicit Feedback Datasets
ICDM '08 Proceedings of the 2008 Eighth IEEE International Conference on Data Mining
User experience (UX): towards an experiential perspective on product quality
Proceedings of the 20th International Conference of the Association Francophone d'Interaction Homme-Machine
Understanding, scoping and defining user experience: a survey approach
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
User-centered evaluation of adaptive and adaptable systems: A literature review
The Knowledge Engineering Review
Marketing Science
Interaction design guidelines on critiquing-based recommender systems
User Modeling and User-Adapted Interaction
How Users Perceive and Appraise Personalized Recommendations
UMAP '09 Proceedings of the 17th International Conference on User Modeling, Adaptation, and Personalization: formerly UM and AH
Preference-based search using example-critiquing with suggestions
Journal of Artificial Intelligence Research
Proceedings of the third ACM conference on Recommender systems
Factor in the neighbors: Scalable and accurate collaborative filtering
ACM Transactions on Knowledge Discovery from Data (TKDD)
Assessing the impact of internet agent on end users' performance
Decision Support Systems
Extending the TAM for a t-commerce
Information and Management
The effect of preference elicitation methods on the user experience of a recommender system
CHI '10 Extended Abstracts on Human Factors in Computing Systems
BPR: Bayesian personalized ranking from implicit feedback
UAI '09 Proceedings of the Twenty-Fifth Conference on Uncertainty in Artificial Intelligence
International Journal of Human-Computer Studies
Understanding choice overload in recommender systems
Proceedings of the fourth ACM conference on Recommender systems
Layered evaluation of interactive adaptive systems: framework and formative methods
User Modeling and User-Adapted Interaction
Enhancing recommendation diversity with organization interfaces
Proceedings of the 16th international conference on Intelligent user interfaces
The impact of rating scales on user's rating behavior
UMAP'11 Proceedings of the 19th international conference on User modeling, adaption, and personalization
Each to his own: how different users call for different interaction methods in recommender systems
Proceedings of the fifth ACM conference on Recommender systems
A user-centric evaluation framework for recommender systems
Proceedings of the fifth ACM conference on Recommender systems
A pragmatic procedure to support the user-centric evaluation of recommender systems
Proceedings of the fifth ACM conference on Recommender systems
RecSys'11 workshop on human decision making in recommender systems
Proceedings of the fifth ACM conference on Recommender systems
Empirical Analysis of the Impact of Recommender Systems on Sales
Journal of Management Information Systems
PET'04 Proceedings of the 4th international conference on Privacy Enhancing Technologies
An economic model of user rating in an online recommender system
UM'05 Proceedings of the 10th international conference on User Modeling
ITWP'03 Proceedings of the 2003 international conference on Intelligent Techniques for Web Personalization
A study on user perception of personality-based recommender systems
UMAP'10 Proceedings of the 18th international conference on User Modeling, Adaptation, and Personalization
Towards a customization of rating scales in adaptive systems
UMAP'10 Proceedings of the 18th international conference on User Modeling, Adaptation, and Personalization
Recommender systems: from algorithms to user experience
User Modeling and User-Adapted Interaction
Critiquing-based recommenders: survey and emerging trends
User Modeling and User-Adapted Interaction
Evaluating recommender systems from the user's perspective: survey of the state of the art
User Modeling and User-Adapted Interaction
Evaluating the effectiveness of explanations for recommender systems
User Modeling and User-Adapted Interaction
User Modeling and User-Adapted Interaction
Each to his own: how different users call for different interaction methods in recommender systems
Proceedings of the fifth ACM conference on Recommender systems
A user-centric evaluation framework for recommender systems
Proceedings of the fifth ACM conference on Recommender systems
A pragmatic procedure to support the user-centric evaluation of recommender systems
Proceedings of the fifth ACM conference on Recommender systems
Recommender systems: from algorithms to user experience
User Modeling and User-Adapted Interaction
Personalization and privacy: a survey of privacy risks and remedies in personalization-based systems
User Modeling and User-Adapted Interaction
Proceedings of the 13th ACM Conference on Electronic Commerce
Evaluating recommender systems from the user's perspective: survey of the state of the art
User Modeling and User-Adapted Interaction
User Modeling and User-Adapted Interaction
Robust ranking models via risk-sensitive optimization
SIGIR '12 Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval
Correlating perception-oriented aspects in user-centric recommender system evaluation
Proceedings of the 4th Information Interaction in Context Symposium
Conducting user experiments in recommender systems
Proceedings of the sixth ACM conference on Recommender systems
User effort vs. accuracy in rating-based elicitation
Proceedings of the sixth ACM conference on Recommender systems
Inspectability and control in social recommenders
Proceedings of the sixth ACM conference on Recommender systems
User-centric evaluation of a K-furthest neighbor collaborative filtering recommender algorithm
Proceedings of the 2013 conference on Computer supported cooperative work
Proceedings of the 2013 international conference on Intelligent user interfaces
Helping users with information disclosure decisions: potential for adaptation
Proceedings of the 2013 international conference on Intelligent user interfaces
Being confident about the quality of the predictions in recommender systems
ECIR'13 Proceedings of the 35th European conference on Advances in Information Retrieval
Making Decisions about Privacy: Information Disclosure in Context-Aware Recommender Systems
ACM Transactions on Interactive Intelligent Systems (TiiS)
Rating support interfaces to improve user experience and recommender accuracy
Proceedings of the 7th ACM conference on Recommender systems
Design and evaluation of a client-side recommender system
Proceedings of the 7th ACM conference on Recommender systems
Proceedings of the International Workshop on Reproducibility and Replication in Recommender Systems Evaluation
ContextPlayer: learning contextual music preferences for situational recommendations
SIGGRAPH Asia 2013 Symposium on Mobile Graphics and Interactive Applications
Location sharing privacy preference: analysis and personalized recommendation
Proceedings of the 19th international conference on Intelligent User Interfaces
Towards a user experience design framework for adaptive spoken dialogue in automotive contexts
Proceedings of the 19th international conference on Intelligent User Interfaces
Time-aware recommender systems: a comprehensive survey and analysis of existing evaluation protocols
User Modeling and User-Adapted Interaction
| Hi-index | 0.00 |
Research on recommender systems typically focuses on the accuracy of prediction algorithms. Because accuracy only partially constitutes the user experience of a recommender system, this paper proposes a framework that takes a user-centric approach to recommender system evaluation. The framework links objective system aspects to objective user behavior through a series of perceptual and evaluative constructs (called subjective system aspects and experience, respectively). Furthermore, it incorporates the influence of personal and situational characteristics on the user experience. This paper reviews how current literature maps to the framework and identifies several gaps in existing work. Consequently, the framework is validated with four field trials and two controlled experiments and analyzed using Structural Equation Modeling. The results of these studies show that subjective system aspects and experience variables are invaluable in explaining why and how the user experience of recommender systems comes about. In all studies we observe that perceptions of recommendation quality and/or variety are important mediators in predicting the effects of objective system aspects on the three components of user experience: process (e.g. perceived effort, difficulty), system (e.g. perceived system effectiveness) and outcome (e.g. choice satisfaction). Furthermore, we find that these subjective aspects have strong and sometimes interesting behavioral correlates (e.g. reduced browsing indicates higher system effectiveness). They also show several tradeoffs between system aspects and personal and situational characteristics (e.g. the amount of preference feedback users provide is a tradeoff between perceived system usefulness and privacy concerns). These results, as well as the validated framework itself, provide a platform for future research on the user-centric evaluation of recommender systems.