Defining constraints graphically
CHI '86 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Creating dynamic interaction techniques by demonstration
CHI '87 Proceedings of the SIGCHI/GI Conference on Human Factors in Computing Systems and Graphics Interface
Inductive Inference: Theory and Methods
ACM Computing Surveys (CSUR)
Metamouse: specifying graphical procedures by example
SIGGRAPH '89 Proceedings of the 16th annual conference on Computer graphics and interactive techniques
Creating user interfaces using programming by example, visual programming, and constraints
ACM Transactions on Programming Languages and Systems (TOPLAS)
Visual programming: perspectives and approaches
IBM Systems Journal
Usability testing of a graphical programming system: things we missed in a programming walkthrough
CHI '91 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
EAGER: programming repetitive tasks by example
CHI '91 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Declarative programming of graphical interfaces by visual examples
UIST '92 Proceedings of the 5th annual ACM symposium on User interface software and technology
Creating charts by demonstration
CHI '94 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
ACM Transactions on Computer-Human Interaction (TOCHI)
Direct manipulation for comprehensible, predictable and controllable user interfaces
Proceedings of the 2nd international conference on Intelligent user interfaces
Graphical representation of programs in a demonstrational visual shell—an empirical evaluation
ACM Transactions on Computer-Human Interaction (TOCHI)
Scripting graphical applications by demonstration
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Getting more out of programming-by-demonstration
Proceedings of the SIGCHI conference on Human Factors in Computing Systems
Visual programming: perspectives and approaches
IBM Systems Journal
Programming by example: intelligence in demonstrational interfaces
Communications of the ACM
Problem-centered design for expressiveness and facility in a graphical programming system
Human-Computer Interaction
Human performance model and evaluation of PBUI
HCI'07 Proceedings of the 12th international conference on Human-computer interaction: interaction design and usability
Using ensembles of decision trees to automate repetitive tasks in web applications
Proceedings of the 2nd ACM SIGCHI symposium on Engineering interactive computing systems
| Hi-index | 0.02 |
End users who need to program within highly interactive direct-manipulation interfaces should be able to communicate their intentions through concrete demonstration rather than in terms of symbolic abstraction. This paper describes a system that learns procedures in interactive graphics taught to it “by example” by minimally trained users. It shows how techniques of machine learning and reactive interfaces can support one another—the former providing generalization heuristics to identify constraints implicit in user actions, the latter offering immediate feedback to help the user clarify hidden constraints and correct errors before they are planted into the procedure. The teacher's attention is focused on the learning system's perceptual and inferential shortcomings through a metaphorical apprentice called Metamouse, which generalizes action sequences on the fly and eagerly carries out any actions it can predict. The success of the induction process is assessed quantitatively by counting erroneous predictions made during example tasks.