C4.5: programs for machine learning
C4.5: programs for machine learning
Explaining collaborative filtering recommendations
CSCW '00 Proceedings of the 2000 ACM conference on Computer supported cooperative work
Making sense of sensing systems: five questions for designers and researchers
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
The role of trust in automation reliance
International Journal of Human-Computer Studies - Special issue: Trust and technology
Designing the whyline: a debugging interface for asking questions about program behavior
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Nomograms for visualization of naive Bayesian classifier
PKDD '04 Proceedings of the 8th European Conference on Principles and Practice of Knowledge Discovery in Databases
A Case-Based Explanation System for Black-Box Systems
Artificial Intelligence Review
User Modeling and User-Adapted Interaction
Answering why and why not questions in user interfaces
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Responsiveness in instant messaging: predictive models supporting inter-personal communication
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
How it works: a field study of non-technical users interacting with an intelligent system
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Context-Aware Computing Applications
WMCSA '94 Proceedings of the 1994 First Workshop on Mobile Computing Systems and Applications
Intelligibility and accountability: human considerations in context-aware systems
Human-Computer Interaction
Support for context-aware intelligibility and control
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
PersonisAD: distributed, active, scrutable model framework for context-aware services
PERVASIVE'07 Proceedings of the 5th international conference on Pervasive computing
Assessing demand for intelligibility in context-aware applications
Proceedings of the 11th international conference on Ubiquitous computing
I Bet You Look Good on the Wall: Making the Invisible Computer Visible
AmI '09 Proceedings of the European Conference on Ambient Intelligence
The infrastructure problem in HCI
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Toolkit to support intelligibility in context-aware applications
Proceedings of the 12th ACM international conference on Ubiquitous computing
Improving trust in context-aware applications with intelligibility
Proceedings of the 12th ACM international conference adjunct papers on Ubiquitous computing - Adjunct
Improving intelligibility and control in Ubicomp
Proceedings of the 12th ACM international conference adjunct papers on Ubiquitous computing - Adjunct
The state of the art in end-user software engineering
ACM Computing Surveys (CSUR)
Proceedings of the 22nd Conference of the Computer-Human Interaction Special Interest Group of Australia on Computer-Human Interaction
GridOrbit: an infrastructure awareness system for increasing contribution in volunteer computing
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Using decision-theoretic experience sampling to build personalized mobile phone interruption models
Pervasive'11 Proceedings of the 9th international conference on Pervasive computing
Where are my intelligent assistant's mistakes? a systematic testing approach
IS-EUD'11 Proceedings of the Third international conference on End-user development
Investigating intelligibility for uncertain context-aware applications
Proceedings of the 13th international conference on Ubiquitous computing
A framework for user controlled remembering and forgetting in long term user models
Proceedings of the 13th international conference on Ubiquitous computing
Why-oriented end-user debugging of naive Bayes text classification
ACM Transactions on Interactive Intelligent Systems (TiiS)
Design of an intelligible mobile context-aware application
Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services
An architecture and a prototype for querying and visualising recorded context information
CONTEXT'11 Proceedings of the 7th international and interdisciplinary conference on Modeling and using context
Are explanations always important?: a study of deployed, low-cost intelligent interactive systems
Proceedings of the 2012 ACM international conference on Intelligent User Interfaces
Intelligent pairing assistant for air operation centers
Proceedings of the 2012 ACM international conference on Intelligent User Interfaces
An explanation-centric approach for personalizing intelligent agents
Proceedings of the 2012 ACM international conference on Intelligent User Interfaces
Tell me more?: the effects of mental model soundness on personalizing an intelligent agent
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
End-user interactions with intelligent and autonomous systems
CHI '12 Extended Abstracts on Human Factors in Computing Systems
An adaptive rule-based approach for managing situation-awareness
Expert Systems with Applications: An International Journal
ACM Transactions on Interactive Intelligent Systems (TiiS) - Special issue on highlights of the decade in interactive intelligent systems
Learning from a learning thermostat: lessons for intelligent systems for the home
Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing
An integrated logical context sensor for mobile web applications
Proceedings of the South African Institute for Computer Scientists and Information Technologists Conference
The impact of explanation dialogues on human-computer trust
HCI'13 Proceedings of the 15th international conference on Human-Computer Interaction: users and contexts of use - Volume Part III
Foundations for infrastructure and interfaces to support user control in long-term user modelling
Proceedings of the 25th Australian Computer-Human Interaction Conference: Augmentation, Application, Innovation, Collaboration
| Hi-index | 0.01 |
Context-aware intelligent systems employ implicit inputs, and make decisions based on complex rules and machine learning models that are rarely clear to users. Such lack of system intelligibility can lead to loss of user trust, satisfaction and acceptance of these systems. However, automatically providing explanations about a system's decision process can help mitigate this problem. In this paper we present results from a controlled study with over 200 participants in which the effectiveness of different types of explanations was examined. Participants were shown examples of a system's operation along with various automatically generated explanations, and then tested on their understanding of the system. We show, for example, that explanations describing why the system behaved a certain way resulted in better understanding and stronger feelings of trust. Explanations describing why the system did not behave a certain way, resulted in lower understanding yet adequate performance. We discuss implications for the use of our findings in real-world context-aware applications.