Evaluation measures for interactive information retrieval
Information Processing and Management: an International Journal - Special issue on evaluation issues in information retrieval
Evaluating the utility and usability of an adaptive hypermedia system
Proceedings of the 2nd international conference on Intelligent user interfaces
Usability problem identification using both low- and high-fidelity prototypes
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
User interface evaluation in an iterative design process: a comparison of three techniques
Conference Companion on Human Factors in Computing Systems
Ethnography of novices' first use of Web search engines: affective control in cognitive processing
Internet Reference Services Quarterly
Integrated multimedia publishing: combining TV and newspaper content on personal channels
WWW '99 Proceedings of the eighth international conference on World Wide Web
A user-centered design approach to personalization
Communications of the ACM
Personal DJ, an architecture for personalised content delivery
Proceedings of the 10th international conference on World Wide Web
Methods to support human-centred design
International Journal of Human-Computer Studies
Using protocol analysis to evaluate the usability of a commercial web site
Information and Management
Mis-usability: on the uses and misuses of usability testing
Proceedings of the 20th annual international conference on Computer documentation
The Evaluation of a Personalised Health Information System for Patients with Cancer
User Modeling and User-Adapted Interaction
Empirical Evaluation of User Models and User-Adapted Systems
User Modeling and User-Adapted Interaction
Preliminary guidelines for empirical research in software engineering
IEEE Transactions on Software Engineering
Location-Aware Shopping Assistance: Evaluation of a Decision-Theoretic Approach
Mobile HCI '02 Proceedings of the 4th International Symposium on Mobile Human-Computer Interaction
Adaptive interfaces and agents
The human-computer interaction handbook
User needs for location-aware mobile services
Personal and Ubiquitous Computing
Eliciting reactive and reflective feedback for a social communication tool: a multi-session approach
DIS '04 Proceedings of the 5th conference on Designing interactive systems: processes, practices, methods, and techniques
Personalizing the user experience on ibm.com
IBM Systems Journal
User Modeling and User-Adapted Interaction
Methods and techniques for the evaluation of user-adaptive systems
The Knowledge Engineering Review
Heuristic evaluation: Comparing ways of finding and reporting usability problems
Interacting with Computers
Usability engineering for the adaptive web
The adaptive web
PCI'05 Proceedings of the 10th Panhellenic conference on Advances in Informatics
The value of qoe-based adaptation approach in educational hypermedia: empirical evaluation
AH'06 Proceedings of the 4th international conference on Adaptive Hypermedia and Adaptive Web-Based Systems
UMAP '09 Proceedings of the 17th International Conference on User Modeling, Adaptation, and Personalization: formerly UM and AH
From expert-driven to user-oriented communication of infection control guidelines
International Journal of Human-Computer Studies
Adaptive educational hypermedia systems in technology enhanced learning: a literature review
Proceedings of the 2010 ACM conference on Information technology education
Layered evaluation of interactive adaptive systems: framework and formative methods
User Modeling and User-Adapted Interaction
Content-free collaborative learning modeling using data mining
User Modeling and User-Adapted Interaction
Six years of systematic literature reviews in software engineering: An updated tertiary study
Information and Software Technology
A pragmatic procedure to support the user-centric evaluation of recommender systems
Proceedings of the fifth ACM conference on Recommender systems
Evaluating adaptive work-integrated learning systems: from the lab to the field
EC-TEL'11 Proceedings of the 6th European conference on Technology enhanced learning: towards ubiquitous learning
WI-IAT '11 Proceedings of the 2011 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology - Volume 03
The evaluation of adaptive and personalised information retrieval systems: a review
International Journal of Knowledge and Web Intelligence
An online framework for supporting the evaluation of personalised information retrieval systems
iUBICOM'11 Proceedings of the 6th international conference on Ubiquitous and Collaborative Computing
Explaining the user experience of recommender systems
User Modeling and User-Adapted Interaction
Evaluating an implementation of an adaptive game-based learning architecture
UMAP'12 Proceedings of the 20th international conference on User Modeling, Adaptation, and Personalization
Automatic on-device filtering of social networking feeds
Proceedings of the 7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design
A novel mobile device user interface with integrated social networking services
International Journal of Human-Computer Studies
| Hi-index | 0.00 |
This literature review focuses on user-centered evaluation (UCE) studies of adaptive and adaptable systems. Usability, perceived usefulness and appropriateness of adaptation are the three most commonly assessed variables. Questionnaires appeared to be the most popular method, followed by interviews and data log analysis. The quality of most questionnaires was questionable, and the reporting of interviews and think-aloud protocols was found to be shallow. Furthermore, data logs need triangulation in order to be useful. The reports encountered lack empirical value. The article models the iterative design process for adaptive and adaptable systems, linked to the goals of UCE: supporting decisions, detecting problems and verifying quality. This model summarizes the variables to be assessed at each stage of the process and the relevant methods to assess them.