Incremental attribute evaluation: a flexible algorithm for lazy update
ACM Transactions on Programming Languages and Systems (TOPLAS)
Making computers easier for older adults to use: area cursors and sticky icons
Proceedings of the ACM SIGCHI Conference on Human factors in computing systems
Systematic output modification in a 2D user interface toolkit
Proceedings of the 10th annual ACM symposium on User interface software and technology
Supporting dynamic downloadable appearances in an extensible user interface toolkit
Proceedings of the 10th annual ACM symposium on User interface software and technology
IBOTS: agent control through the user interface
IUI '99 Proceedings of the 4th international conference on Intelligent user interfaces
Implementing interface attachments based on surface representations
Proceedings of the SIGCHI conference on Human Factors in Computing Systems
A visual medium for programmatic control of interactive applications
Proceedings of the SIGCHI conference on Human Factors in Computing Systems
Programming by example: visual generalization in programming by example
Communications of the ACM
Past, present, and future of user interface software tools
ACM Transactions on Computer-Human Interaction (TOCHI) - Special issue on human-computer interaction in the new millennium, Part 1
Providing visually rich resizable images for user interface components
UIST '00 Proceedings of the 13th annual ACM symposium on User interface software and technology
Side views: persistent, on-demand previews for open-ended tasks
Proceedings of the 15th annual ACM symposium on User interface software and technology
Artificial Intelligence: A Modern Approach
Artificial Intelligence: A Modern Approach
WinCuts: manipulating arbitrary window regions for more effective use of screen space
CHI '04 Extended Abstracts on Human Factors in Computing Systems
ScreenCrayons: annotating anything
Proceedings of the 17th annual ACM symposium on User interface software and technology
The bubble cursor: enhancing target acquisition by dynamic resizing of the cursor's activation area
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Extensible input handling in the subArctic toolkit
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
mudibo: multiple dialog boxes for multiple monitors
CHI '05 Extended Abstracts on Human Factors in Computing Systems
Phosphor: explaining transitions in the user interface using afterglow effects
UIST '06 Proceedings of the 19th annual ACM symposium on User interface software and technology
User interface façades: towards fully adaptable user interfaces
UIST '06 Proceedings of the 19th annual ACM symposium on User interface software and technology
Proceedings of the 20th annual ACM symposium on User interface software and technology
Programming by a sample: rapidly creating web applications with d.mix
Proceedings of the 20th annual ACM symposium on User interface software and technology
The angle mouse: target-agnostic dynamic gain adjustment based on angular deviation
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Sikuli: using GUI screenshots for search and automation
Proceedings of the 22nd annual ACM symposium on User interface software and technology
Automatically identifying targets users interact with during real world tasks
Proceedings of the 15th international conference on Intelligent user interfaces
Automatically generating personalized user interfaces with Supple
Artificial Intelligence
Chronicle: capture, exploration, and playback of document workflow histories
UIST '10 Proceedings of the 23nd annual ACM symposium on User interface software and technology
Enhanced area cursors: reducing fine pointing demands for people with motor impairments
UIST '10 Proceedings of the 23nd annual ACM symposium on User interface software and technology
UIMarks: quick graphical interaction with specific targets
UIST '10 Proceedings of the 23nd annual ACM symposium on User interface software and technology
Ability-Based Design: Concept, Principles and Examples
ACM Transactions on Accessible Computing (TACCESS)
Gesture avatar: a technique for operating mobile user interfaces using gestures
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Content and hierarchy in pixel-based methods for reverse engineering interface structure
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
How to evaluate technologies for health behavior change in HCI research
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
CHI '11 Extended Abstracts on Human Factors in Computing Systems
From the lab to the world: lessons from extending a pointing technique for real-world use
CHI '11 Extended Abstracts on Human Factors in Computing Systems
Using graphical representation of user interfaces as visual references
Proceedings of the 24th annual ACM symposium adjunct on User interface software and technology
Real-time crowd control of existing interfaces
Proceedings of the 24th annual ACM symposium on User interface software and technology
ShowMeHow: translating user interface instructions between applications
Proceedings of the 24th annual ACM symposium on User interface software and technology
Pause-and-play: automatically linking screencast video tutorials with applications
Proceedings of the 24th annual ACM symposium on User interface software and technology
Creating contextual help for GUIs using screenshots
Proceedings of the 24th annual ACM symposium on User interface software and technology
d.tour: style-based exploration of design example galleries
Proceedings of the 24th annual ACM symposium on User interface software and technology
Cracking the cocoa nut: user interface programming at runtime
Proceedings of the 24th annual ACM symposium on User interface software and technology
Associating the visual representation of user interfaces with their internal structures and metadata
Proceedings of the 24th annual ACM symposium on User interface software and technology
Menu controller: making existing software more accessible for people with motor impairments
Proceedings of the 4th International Conference on PErvasive Technologies Related to Assistive Environments
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Active progress bar: aiding the switch to temporary activities
BCS-HCI '12 Proceedings of the 26th Annual BCS Interaction Specialist Group Conference on People and Computers
Waken: reverse engineering usage information and interface structure from software videos
Proceedings of the 25th annual ACM symposium on User interface software and technology
MixT: automatic generation of step-by-step mixed media tutorials
Proceedings of the 25th annual ACM symposium on User interface software and technology
Tutorial-based interfaces for cloud-enabled applications
Proceedings of the 25th annual ACM symposium on User interface software and technology
User interface toolkit mechanisms for securing interface elements
Proceedings of the 25th annual ACM symposium on User interface software and technology
Patina: dynamic heatmaps for visualizing application usage
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Pixel-based reverse engineering of graphical interfaces
Proceedings of the adjunct publication of the 26th annual ACM symposium on User interface software and technology
MenuInspector: Outil pour l'analyse des menus et cas d'étude
Proceedings of the 25ième conférence francophone on l'Interaction Homme-Machine
WidgetLens: a system for adaptive content magnification of widgets
BCS-HCI '13 Proceedings of the 27th International BCS Human Computer Interaction Conference
Hi-index | 0.01 |
Current chasms between applications implemented with different user interface toolkits make it difficult to implement and explore potentially important interaction techniques in new and existing applications, limiting the progress and impact of human-computer interaction research. We examine an approach based in the single most common characteristic of all graphical user interface toolkits, that they ultimately paint pixels to a display. We present Prefab, a system for implementing advanced behaviors through the reverse engineering of the pixels in graphical interfaces. Informed by how user interface toolkits paint interfaces, Prefab features a separation of the modeling of widget layout from the recognition of widget appearance. We validate Prefab in implementations of three applications: target-aware pointing techniques, Phosphor transitions, and Side Views parameter spectrums. Working only from pixels, we demonstrate a single implementation of these enhancements in complex existing applications created in different user interface toolkits running on different windowing systems.