A softbot-based interface to the Internet
Communications of the ACM
Accessibility designer: visualizing usability for the blind
Assets '04 Proceedings of the 6th international ACM SIGACCESS conference on Computers and accessibility
Automation and customization of rendered web pages
Proceedings of the 18th annual ACM symposium on User interface software and technology
Koala: capture, share, automate, personalize business processes on the web
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Csurf: a context-driven non-visual web-browser
Proceedings of the 16th international conference on World Wide Web
Smartweb: multimodal web services on the road
Proceedings of the 15th international conference on Multimedia
CoScripter: automating & sharing how-to knowledge in the enterprise
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Highlight: a system for creating and deploying mobile web applications
Proceedings of the 21st annual ACM symposium on User interface software and technology
Trailblazer: enabling blind users to blaze trails through the web
Proceedings of the 14th international conference on Intelligent user interfaces
PLOW: a collaborative task learning agent
AAAI'07 Proceedings of the 22nd national conference on Artificial intelligence - Volume 2
Here's what i did: sharing and reusing web activity with ActionShot
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Find this for me: mobile information retrieval on the open web
Proceedings of the 16th international conference on Intelligent user interfaces
An intuitive accessible web automation user interface
Proceedings of the International Cross-Disciplinary Conference on Web Accessibility
Tutorial-based interfaces for cloud-enabled applications
Proceedings of the 25th annual ACM symposium on User interface software and technology
Crowd-based recognition of web interaction patterns
Adjunct proceedings of the 25th annual ACM symposium on User interface software and technology
PixelTone: a multimodal interface for image editing
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
LiveAction: Automating Web Task Model Generation
ACM Transactions on Interactive Intelligent Systems (TiiS)
Form-Based Web Service Composition for Domain Experts
ACM Transactions on the Web (TWEB)
| Hi-index | 0.00 |
This paper presents CoCo, a system that automates web tasks on a user's behalf through an interactive conversational interface. Given a short command such as "get road conditions for highway 88," CoCo synthesizes a plan to accomplish the task, executes it on the web, extracts an informative response, and returns the result to the user as a snippet of text. A novel aspect of our approach is that we leverage a repository of previously recorded web scripts and the user's personal web browsing history to determine how to complete each requested task. This paper describes the design and implementation of our system, along with the results of a brief user study that evaluates how likely users are to understand what CoCo does for them.