Communications of the ACM
WordNet: a lexical database for English
Communications of the ACM
Representation of electronic mail filtering profiles: a user study
Proceedings of the 5th international conference on Intelligent user interfaces
Explaining collaborative filtering recommendations
CSCW '00 Proceedings of the 2000 ACM conference on Computer supported cooperative work
Challenges of the Email Domain for Text Classification
ICML '00 Proceedings of the Seventeenth International Conference on Machine Learning
The Journal of Machine Learning Research
Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining
User interfaces with semi-formal representations: a study of designing argumentation structures
Proceedings of the 10th international conference on Intelligent user interfaces
Improving proactive information systems
Proceedings of the 10th international conference on Intelligent user interfaces
Experiments in dynamic critiquing
Proceedings of the 10th international conference on Intelligent user interfaces
Task learning by instruction in tailor
Proceedings of the 10th international conference on Intelligent user interfaces
Named entity recognition using an HMM-based chunk tagger
ACL '02 Proceedings of the 40th Annual Meeting on Association for Computational Linguistics
Providing Expert Advice by Analogy for On-Line Help
IAT '05 Proceedings of the IEEE/WIC/ACM International Conference on Intelligent Agent Technology
Garbage in, Garbage out? An Empirical Look at Oracle Mistakes by End-User Programmers
VLHCC '05 Proceedings of the 2005 IEEE Symposium on Visual Languages and Human-Centric Computing
A hybrid learning system for recognizing user tasks from desktop activities and email messages
Proceedings of the 11th international conference on Intelligent user interfaces
Trust building with explanation interfaces
Proceedings of the 11th international conference on Intelligent user interfaces
Augmentation-based learning: combining observations and user edits for programming-by-demonstration
Proceedings of the 11th international conference on Intelligent user interfaces
Answering why and why not questions in user interfaces
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Supporting end-user debugging: what do users want to know?
Proceedings of the working conference on Advanced visual interfaces
Data Mining: Practical Machine Learning Tools and Techniques, Second Edition (Morgan Kaufmann Series in Data Management Systems)
Integrating rich user feedback into intelligent user interfaces
Proceedings of the 13th international conference on Intelligent user interfaces
Toward establishing trust in adaptive agents
Proceedings of the 13th international conference on Intelligent user interfaces
User-controllable learning of security and privacy policies
Proceedings of the 1st ACM workshop on Workshop on AISec
Fixing the program my computer learned: barriers for end users, challenges for the machine
Proceedings of the 14th international conference on Intelligent user interfaces
Who's viewed you?: the impact of feedback in a mobile location-sharing application
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Interacting meaningfully with machine learning systems: Three experiments
International Journal of Human-Computer Studies
Exposing parameters of a trained dynamic model for interactive music creation
AAAI'08 Proceedings of the 23rd national conference on Artificial intelligence - Volume 2
Multimedia Tools and Applications
Towards maximizing the accuracy of human-labeled sensor data
Proceedings of the 15th international conference on Intelligent user interfaces
On the impact of real-time feedback on users' behaviour in mobile location-sharing applications
Proceedings of the Sixth Symposium on Usable Privacy and Security
Using traits of web macro scripts to predict reuse
Journal of Visual Languages and Computing
Modeling users of intelligent systems
CHI '11 Extended Abstracts on Human Factors in Computing Systems
Using decision-theoretic experience sampling to build personalized mobile phone interruption models
Pervasive'11 Proceedings of the 9th international conference on Pervasive computing
Why-oriented end-user debugging of naive Bayes text classification
ACM Transactions on Interactive Intelligent Systems (TiiS)
Tell me more?: the effects of mental model soundness on personalizing an intelligent agent
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
End-user interactions with intelligent and autonomous systems
CHI '12 Extended Abstracts on Human Factors in Computing Systems
Continuous user feedback learning for data capture from business documents
HAIS'12 Proceedings of the 7th international conference on Hybrid Artificial Intelligent Systems - Volume Part II
End-User Software Engineering and Why it Matters
Journal of Organizational and End User Computing
Hi-index | 0.00 |
There has been little research into how end users might be able to communicate advice to machine learning systems. If this resource--the users themselves--could somehow work hand-in-hand with machine learning systems, the accuracy of learning systems could be improved and the users' understanding and trust of the system could improve as well. We conducted a think-aloud study to see how willing users were to provide feedback and to understand what kinds of feedback users could give. Users were shown explanations of machine learning predictions and asked to provide feedback to improve the predictions. We found that users had no difficulty providing generous amounts of feedback. The kinds of feedback ranged from suggestions for reweighting of features to proposals for new features, feature combinations, relational features, and wholesale changes to the learning algorithm. The results show that user feedback has the potential to significantly improve machine learning systems, but that learning algorithms need to be extended in several ways to be able to assimilate this feedback.