Watch what I do: programming by demonstration
Watch what I do: programming by demonstration
Using predictive prefetching to improve World Wide Web latency
ACM SIGCOMM Computer Communication Review
Proceedings of the ACM SIGCHI Conference on Human factors in computing systems
DEXA '00 Proceedings of the 11th International Workshop on Database and Expert Systems Applications
Automation and customization of rendered web pages
Proceedings of the 18th annual ACM symposium on User interface software and technology
Model-directed Web transactions under constrained modalities
ACM Transactions on the Web (TWEB)
Smart bookmarks: automatic retroactive macro recording on the web
Proceedings of the 20th annual ACM symposium on User interface software and technology
CoScripter: automating & sharing how-to knowledge in the enterprise
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Trailblazer: enabling blind users to blaze trails through the web
Proceedings of the 14th international conference on Intelligent user interfaces
Automated construction of web accessibility models from transaction click-streams
Proceedings of the 18th international conference on World wide web
Automating Navigation Sequences in AJAX Websites
ICWE '9 Proceedings of the 9th International Conference on Web Engineering
Incorporating concept hierarchies into usage mining based recommendations
WebKDD'06 Proceedings of the 8th Knowledge discovery on the web international conference on Advances in web mining and web usage analysis
Guidelines for an accessible web automation interface
The proceedings of the 13th international ACM SIGACCESS conference on Computers and accessibility
Short Survey: A taxonomy of web prediction algorithms
Expert Systems with Applications: An International Journal
An intuitive accessible web automation user interface
Proceedings of the International Cross-Disciplinary Conference on Web Accessibility
An interface agent for non-visual, accessible web automation
Adjunct proceedings of the 25th annual ACM symposium on User interface software and technology
Accessible web automation interface: a user study
Proceedings of the 14th international ACM SIGACCESS conference on Computers and accessibility
| Hi-index | 0.00 |
The Web is far less usable and accessible for people with vision impairments than it is for sighted people. Web automation, a process of automating browsing actions on behalf of the user, has the potential to bridge the divide between the ways sighted and people with vision impairment access the Web; specifically, it can enable the latter to breeze through web browsing tasks that beforehand were slow, hard, or even impossible to accomplish. Typical web automation requires that the user record a macro, a sequence of browsing steps, so that these steps can be automated in the future by replaying the macro. However, for people with vision impairment, automation with macros is not usable. In this paper, we propose a novel model-based approach that facilitates web automation without having to either record or replay macros. Using the past browsing history and the current web page as the browsing context, the proposed model can predict the most probable browsing actions that the user can do. The model construction is "unsupervised". More importantly, the model is continuously and incrementally updated as history evolves, thereby, ensuring the predictions are not "outdated". We also describe a novel interface that lets the user focus on the objects associated with the most probable predicted browsing steps (e.g., clicking links and filling out forms), and facilitates automatic execution of the selected steps. A study with 19 blind participants showed that the proposed approach dramatically reduced the interaction time needed to accomplish typical browsing tasks, and the user interface was perceived to be much more usable than the standard screen-reading interfaces.