Mr.Web: an automated interactive webmaster
CHI '03 Extended Abstracts on Human Factors in Computing Systems
Sheepdog: learning procedures for technical support
Proceedings of the 9th international conference on Intelligent user interfaces
Stencils-based tutorials: design and evaluation
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Linking messages and form requests
Proceedings of the 11th international conference on Intelligent user interfaces
EMNLP '02 Proceedings of the ACL-02 conference on Empirical methods in natural language processing - Volume 10
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Translating keyword commands into executable code
UIST '06 Proceedings of the 19th annual ACM symposium on User interface software and technology
Koala: capture, share, automate, personalize business processes on the web
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Crowdsourcing user studies with Mechanical Turk
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
CoScripter: automating & sharing how-to knowledge in the enterprise
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
PLOW: a collaborative task learning agent
AAAI'07 Proceedings of the 22nd national conference on Artificial intelligence - Volume 2
Lowering the barriers to website testing with CoTester
Proceedings of the 15th international conference on Intelligent user interfaces
Training a multilingual sportscaster: using perceptual context to learn language
Journal of Artificial Intelligence Research
ShowMeHow: translating user interface instructions between applications
Proceedings of the 24th annual ACM symposium on User interface software and technology
Towards automatic functional test execution
Proceedings of the 2012 ACM international conference on Intelligent User Interfaces
"Then click ok!": extracting references to interface elements in online documentation
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Proceedings of the 34th International Conference on Software Engineering
Tutorial-based interfaces for cloud-enabled applications
Proceedings of the 25th annual ACM symposium on User interface software and technology
Corpus-based interpretation of instructions in virtual environments
ACL '12 Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics: Short Papers - Volume 2
LiveAction: Automating Web Task Model Generation
ACM Transactions on Interactive Intelligent Systems (TiiS)
Hi-index | 0.00 |
Written instructions are a common way of teaching people how to accomplish tasks on the web. However, studies have shown that written instructions are difficult to follow, even for experienced users. A system that understands human-written instructions could guide users through the process of following the directions, improving completion rates and enhancing the user experience. While general natural language understanding is extremely difficult, we believe that in the limited domain of howto instructions it should be possible to understand enough to provide guided help in a mixed-initiative environment. Based on a qualitative analysis of instructions gathered for 43 web-based tasks, we have formalized the problem of understanding and interpreting how-to instructions. We compare three different approaches to interpreting instructions: a keyword-based interpreter, a grammar-based interpreter, and an interpreter based on machine learning and information extraction. Our empirical results demonstrate the feasibility of automated how-to instruction understanding.