Digital image processing (2nd ed.)
Digital image processing (2nd ed.)
Programmable user models for predictive evaluation of interface designs
CHI '89 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Triggers: guiding automation with pixels to achieve data access
Watch what I do
Demonstrational interfaces: a step beyond direct manipulation
Watch what I do
Agents that reduce work and information overload
Communications of the ACM
Communications of the ACM
Adding a collaborative agent to graphical user interfaces
Proceedings of the 9th annual ACM symposium on User interface software and technology
Direct manipulation for comprehensible, predictable and controllable user interfaces
Proceedings of the 2nd international conference on Intelligent user interfaces
Direct manipulation vs. interface agents
interactions
Integrating user interface agents with conventional applications
IUI '98 Proceedings of the 3rd international conference on Intelligent user interfaces
Scripting graphical applications by demonstration
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
IBOTS: agent control through the user interface
IUI '99 Proceedings of the 4th international conference on Intelligent user interfaces
Programming by example: visual generalization in programming by example
Communications of the ACM
The user interface as an agent environment
AGENTS '00 Proceedings of the fourth international conference on Autonomous agents
Interface agents as surrogate users
intelligence
Supporting cognitive models as users
ACM Transactions on Computer-Human Interaction (TOCHI) - Special issue on human-computer interaction in the new millennium, Part 2
A visual environment for specifying global reduction operations
International Journal of High Performance Computing and Networking
An environment for user interface softbots
Proceedings of the Working Conference on Advanced Visual Interfaces
Sikuli: using GUI screenshots for search and automation
Proceedings of the 22nd annual ACM symposium on User interface software and technology
Automatically identifying targets users interact with during real world tasks
Proceedings of the 15th international conference on Intelligent user interfaces
Prefab: implementing advanced behaviors using pixel-based reverse engineering of interface structure
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
GUI testing using computer vision
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Content and hierarchy in pixel-based methods for reverse engineering interface structure
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Using graphical representation of user interfaces as visual references
Proceedings of the 24th annual ACM symposium adjunct on User interface software and technology
Associating the visual representation of user interfaces with their internal structures and metadata
Proceedings of the 24th annual ACM symposium on User interface software and technology
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
| Hi-index | 0.02 |
The VisMap system provides for visual manipulation of arbitraryoff-the-shelf applications, through an applications graphical userinterface. VisMaps API-independent control has advantages for tasksthat can benefit from direct access to the functions of the userinterface. We describe the design goals and architecture of thesystem, and we discuss two applications, a user-controlled visualscripting program and an autonomous solitaire-playing program,which together demonstrate some of the capabilities and limitationsof the approach.