Designing for usability: key principles and what designers think
Communications of the ACM
Formal models and techniques in human-computer interaction
Human factors for informatics usability
Evaluating the thinking-aloud technique for use by computer scientists
Advances in human-computer interaction (vol. 3)
Prototyping an intelligent agent through Wizard of Oz
INTERCHI '93 Proceedings of the INTERCHI '93 conference on Human factors in computing systems
How might people interact with agents
Communications of the ACM
Adaptively supported adaptability
International Journal of Human-Computer Studies
Usability inspection methods
The cognitive walkthrough method: a practitioner's guide
Usability inspection methods
A user interface integrating adaptability and adaptivity
Adaptive user support
Human-computer interaction (2nd ed.)
Human-computer interaction (2nd ed.)
AHAM: a Dexter-based reference model for adaptive hypermedia
Proceedings of the tenth ACM Conference on Hypertext and hypermedia : returning to our diverse roots: returning to our diverse roots
A hybrid user model for news story classification
UM '99 Proceedings of the seventh international conference on User modeling
UM '99 Proceedings of the seventh international conference on User modeling
Learning users' interests by unobtrusively observing their normal behavior
Proceedings of the 5th international conference on Intelligent user interfaces
Privacy in e-commerce: examining user scenarios and privacy preferences
Proceedings of the 1st ACM conference on Electronic commerce
Configuration agents, control and privacy
CUU '00 Proceedings on the 2000 conference on Universal Usability
Proceedings of the 6th international conference on Intelligent user interfaces
Contextual Design: Defining Customer-Centered Systems
Contextual Design: Defining Customer-Centered Systems
Designing the User Interface: Strategies for Effective Human-Computer Interaction
Designing the User Interface: Strategies for Effective Human-Computer Interaction
The Inmates Are Running the Asylum
The Inmates Are Running the Asylum
Human-Computer Interaction
Methods and metrics for cold-start recommendations
SIGIR '02 Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval
Methods to support human-centred design
International Journal of Human-Computer Studies
The Psychology of Human-Computer Interaction
The Psychology of Human-Computer Interaction
Logic-Based Representation and Reasoning for User Modeling Shell Systems
User Modeling and User-Adapted Interaction
User Modeling and User-Adapted Interaction
Empirical Evaluation of User Models and User-Adapted Systems
User Modeling and User-Adapted Interaction
A Bayesian Diagnostic Algorithm for Student Modeling and its Evaluation
User Modeling and User-Adapted Interaction
Layered Evaluation of Adaptive Applications and Services
AH '00 Proceedings of the International Conference on Adaptive Hypermedia and Adaptive Web-Based Systems
Pros and Cons of Controllability: An Empirical Study
AH '02 Proceedings of the Second International Conference on Adaptive Hypermedia and Adaptive Web-Based Systems
The Munich Reference Model for Adaptive Hypermedia Applications
AH '02 Proceedings of the Second International Conference on Adaptive Hypermedia and Adaptive Web-Based Systems
On Evaluating Adaptive Systems for Education
AH '02 Proceedings of the Second International Conference on Adaptive Hypermedia and Adaptive Web-Based Systems
Towards a Better Understanding of Context and Context-Awareness
HUC '99 Proceedings of the 1st international symposium on Handheld and Ubiquitous Computing
Student Modeling from Conversational Test Data: A Bayesian Approach Without Priors
ITS '98 Proceedings of the 4th International Conference on Intelligent Tutoring Systems
Stereotypes, Student Models and Scrutability
ITS '00 Proceedings of the 5th International Conference on Intelligent Tutoring Systems
Human or Computer? AutoTutor in a Bystander Turing Test
ITS '02 Proceedings of the 6th International Conference on Intelligent Tutoring Systems
When and Why Does Mastery Learning Work: Instructional Experiments with ACT-R "SimStudents"
ITS '02 Proceedings of the 6th International Conference on Intelligent Tutoring Systems
Evaluation of Adaptive Systems
UM '01 Proceedings of the 8th International Conference on User Modeling 2001
The evaluation of adaptive systems
Adaptive evolutionary information systems
Adaptive interfaces and agents
The human-computer interaction handbook
Composing letters with a simulated listening typewriter
CHI '82 Proceedings of the 1982 Conference on Human Factors in Computing Systems
Group Modeling: Selecting a Sequence of Television Items to Suit a Group of Viewers
User Modeling and User-Adapted Interaction
Evaluating collaborative filtering recommender systems
ACM Transactions on Information Systems (TOIS)
Improving recommendation lists through topic diversification
WWW '05 Proceedings of the 14th international conference on World Wide Web
Tailoring Automatically Generated Hypertext
User Modeling and User-Adapted Interaction
Consistent Modelling of Users, Devices and Sensors in a Ubiquitous Computing Environment
User Modeling and User-Adapted Interaction
Personalization and Context Management
User Modeling and User-Adapted Interaction
User Modeling and User-Adapted Interaction
User Modeling and User-Adapted Interaction
Methods and techniques for the evaluation of user-adaptive systems
The Knowledge Engineering Review
Being accurate is not enough: how accuracy metrics have hurt recommender systems
CHI '06 Extended Abstracts on Human Factors in Computing Systems
User Modeling and User-Adapted Interaction
User Modeling and User-Adapted Interaction
User Modeling and User-Adapted Interaction
Modeling individual and collaborative problem-solving in medical problem-based learning
User Modeling and User-Adapted Interaction
Data Mining: Practical Machine Learning Tools and Techniques, Second Edition (Morgan Kaufmann Series in Data Management Systems)
PEACH - Intelligent Interfaces for Museum Visits (Cognitive Technologies)
PEACH - Intelligent Interfaces for Museum Visits (Cognitive Technologies)
User Modeling and User-Adapted Interaction
Personalizing influence diagrams: applying online learning strategies to dialogue management
User Modeling and User-Adapted Interaction
A hybrid approach for improving predictive accuracy of collaborative filtering algorithms
User Modeling and User-Adapted Interaction
Introduction to the special issue on statistical and probabilistic methods for user modeling
User Modeling and User-Adapted Interaction
Efficient and non-parametric reasoning over user preferences
User Modeling and User-Adapted Interaction
User Modeling and User-Adapted Interaction
Adaptive testing for hierarchical student models
User Modeling and User-Adapted Interaction
Discovering stages in web navigation for problem-oriented navigation support
User Modeling and User-Adapted Interaction
Adaptive, intelligent presentation of information for the museum visitor in PEACH
User Modeling and User-Adapted Interaction
User Modeling and User-Adapted Interaction
Modeling the progression of Alzheimer's disease for cognitive assistance in smart homes
User Modeling and User-Adapted Interaction
Adaptive feedback generation to support teachers in web-based distance education
User Modeling and User-Adapted Interaction
Effective explanations of recommendations: user-centered design
Proceedings of the 2007 ACM conference on Recommender systems
Predicting time-sharing in mobile interaction
User Modeling and User-Adapted Interaction
Inferences, suppositions and explanatory extensions in argument interpretation
User Modeling and User-Adapted Interaction
User Modeling and User-Adapted Interaction
Automatic detection of learner's affect from conversational cues
User Modeling and User-Adapted Interaction
Diagnosing and acting on student affect: the tutor's perspective
User Modeling and User-Adapted Interaction
The relative impact of student affect on performance models in a spoken dialogue tutoring system
User Modeling and User-Adapted Interaction
Mediation of user models for enhanced personalization in recommender systems
User Modeling and User-Adapted Interaction
A multifactor approach to student model evaluation
User Modeling and User-Adapted Interaction
Analyzing Museum Visitors' Behavior Patterns
UM '07 Proceedings of the 11th international conference on User Modeling
AH '08 Proceedings of the 5th international conference on Adaptive Hypermedia and Adaptive Web-Based Systems
The Effectiveness of Personalized Movie Explanations: An Experiment Using Commercial Meta-data
AH '08 Proceedings of the 5th international conference on Adaptive Hypermedia and Adaptive Web-Based Systems
Towards Inferring Sequential-Global Dimension of Learning Styles from Mouse Movement Patterns
AH '08 Proceedings of the 5th international conference on Adaptive Hypermedia and Adaptive Web-Based Systems
International Journal of Artificial Intelligence in Education
Student Models that Invite the Learner In: The SMILI:() Open Learner Modelling Framework
International Journal of Artificial Intelligence in Education
What Do You Want to Know? Investigating the Information Requirements of Patient Supporters
CBMS '08 Proceedings of the 2008 21st IEEE International Symposium on Computer-Based Medical Systems
Assessment on the Adaptivity of Adaptive Systems
ICMECG '08 Proceedings of the 2008 International Conference on Management of e-Commerce and e-Government
LISTEN: a user-adaptive audio-augmented museum guide
User Modeling and User-Adapted Interaction
The effects of transparency on trust in and acceptance of a content-based art recommender
User Modeling and User-Adapted Interaction
A stroll with Carletto: adaptation in drama-based tours with virtual characters
User Modeling and User-Adapted Interaction
Tag-based user modeling for social multi-device adaptive guides
User Modeling and User-Adapted Interaction
Search personalization through query and page topical analysis
User Modeling and User-Adapted Interaction
Preface to the special issue on data mining for personalization
User Modeling and User-Adapted Interaction
A Comprehensive Model of Usability
Engineering Interactive Systems
Scrutinising usability evaluation: does thinking aloud affect behaviour and mental workload?
Behaviour & Information Technology
User-centered evaluation of adaptive and adaptable systems: A literature review
The Knowledge Engineering Review
AH 12 years later: a comprehensive survey of adaptive hypermedia methods and techniques
The New Review of Hypermedia and Multimedia - Adaptive Hypermedia
Evaluating Learning Style Personalization in Adaptive Systems: Quantitative Methods and Approaches
IEEE Transactions on Learning Technologies
Empirically building and evaluating a probabilistic model of user affect
User Modeling and User-Adapted Interaction
Managing uncertainty in group recommending processes
User Modeling and User-Adapted Interaction
Sensors Model Student Self Concept in the Classroom
UMAP '09 Proceedings of the 17th International Conference on User Modeling, Adaptation, and Personalization: formerly UM and AH
Assessing the Impact of Measurement Uncertainty on User Models in Spatial Domains
UMAP '09 Proceedings of the 17th International Conference on User Modeling, Adaptation, and Personalization: formerly UM and AH
UMAP '09 Proceedings of the 17th International Conference on User Modeling, Adaptation, and Personalization: formerly UM and AH
Evaluating the Impact of Adaptation to Learning Styles in a Web-Based Educational System
ICWL '009 Proceedings of the 8th International Conference on Advances in Web Based Learning
IJCAI'85 Proceedings of the 9th international joint conference on Artificial intelligence - Volume 1
A study of cross-validation and bootstrap for accuracy estimation and model selection
IJCAI'95 Proceedings of the 14th international joint conference on Artificial intelligence - Volume 2
CTRL: A research framework for providing adaptive collaborative learning support
User Modeling and User-Adapted Interaction
Guiding Learners in Learning Management Systems through Recommendations
EC-TEL '09 Proceedings of the 4th European Conference on Technology Enhanced Learning: Learning in the Synergy of Multiple Disciplines
Evaluating the inference mechanism of adaptive learning systems
UM'03 Proceedings of the 9th international conference on User modeling
The continuous empirical evaluation approach: evaluating adaptive web-based courses
UM'03 Proceedings of the 9th international conference on User modeling
Data mining for web personalization
The adaptive web
Privacy-enhanced web personalization
The adaptive web
Usability engineering for the adaptive web
The adaptive web
Developing instrument for handset usability evaluation: a survey study
HCI'07 Proceedings of the 12th international conference on Human-computer interaction: interaction design and usability
Modelling a receiver's position to persuasive arguments
PERSUASIVE'07 Proceedings of the 2nd international conference on Persuasive technology
Usability Testing Essentials: Ready, Set...Test!
Usability Testing Essentials: Ready, Set...Test!
Persuasion artifices to promote wellbeing
PERSUASIVE'06 Proceedings of the First international conference on Persuasive technology for human well-being
Designing and redesigning an affective interface for an adaptive museum guide
ACII'05 Proceedings of the First international conference on Affective Computing and Intelligent Interaction
User modeling meets usability goals
UM'05 Proceedings of the 10th international conference on User Modeling
A comparison of HMMs and dynamic bayesian networks for recognizing office activities
UM'05 Proceedings of the 10th international conference on User Modeling
A decomposition model for the layered evaluation of interactive adaptive systems
UM'05 Proceedings of the 10th international conference on User Modeling
Parallel presentations for heterogenous user groups – an initial user study
INTETAIN'05 Proceedings of the First international conference on Intelligent Technologies for Interactive Entertainment
Smart indicators on learning interactions
EC-TEL'07 Proceedings of the Second European conference on Technology Enhanced Learning: creating new learning experiences on a global scale
Evaluating adaptive work-integrated learning systems: from the lab to the field
EC-TEL'11 Proceedings of the 6th European conference on Technology enhanced learning: towards ubiquitous learning
The evaluation of adaptive and personalised information retrieval systems: a review
International Journal of Knowledge and Web Intelligence
The quest for validated personality trait stories
Proceedings of the 2012 ACM international conference on Intelligent User Interfaces
User models for motivational systems: the affective and the rational routes to persuasion
UMAP'11 Proceedings of the 19th international conference on Advances in User Modeling
Personalization in cultural heritage: the road travelled and the one ahead
User Modeling and User-Adapted Interaction
Evaluating recommender systems from the user's perspective: survey of the state of the art
User Modeling and User-Adapted Interaction
Explaining the user experience of recommender systems
User Modeling and User-Adapted Interaction
Evaluating the effectiveness of explanations for recommender systems
User Modeling and User-Adapted Interaction
ACM Transactions on Interactive Intelligent Systems (TiiS) - Special issue on highlights of the decade in interactive intelligent systems
Implementing high-resolution adaptivity in game-based learning
Edutainment'12/GameDays'12 Proceedings of the 7th international conference on Edutainment, and Proceedings of the 3rd international conference on E-Learning and Games for Training, Education, Health and Sports
Personal and Ubiquitous Computing
| Hi-index | 0.00 |
The evaluation of interactive adaptive systems has long been acknowledged to be a complicated and demanding endeavour. Some promising approaches in the recent past have attempted tackling the problem of evaluating adaptivity by "decomposing" and evaluating it in a "piece-wise" manner. Separating the evaluation of different aspects can help to identify problems in the adaptation process. This paper presents a framework that can be used to guide the "layered" evaluation of adaptive systems, and a set of formative methods that have been tailored or specially developed for the evaluation of adaptivity. The proposed framework unifies previous approaches in the literature and has already been used, in various guises, in recent research work. The presented methods are related to the layers in the framework and the stages in the development lifecycle of interactive systems. The paper also discusses practical issues surrounding the employment of the above, and provides a brief overview of complementary and alternative approaches in the literature.