A grid-based approach to automating display layout
Proceedings on Graphics interface '88
An evaluation of animated demonstrations of learning computer-based tasks
CHI '91 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
A history-based macro by example system
UIST '92 Proceedings of the 5th annual ACM symposium on User interface software and technology
Watch what I do: programming by demonstration
Watch what I do: programming by demonstration
Mondrian: a teachable graphical editor
Watch what I do
Apple guide: a case study in user-aided design of online help
CHI '95 Conference Companion on Human Factors in Computing Systems
CHI '95 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Pursuit: graphically representing programs in a demonstrational visual shell
CHI '94 Conference Companion on Human Factors in Computing Systems
Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Image quilting for texture synthesis and transfer
Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Designing effective step-by-step assembly instructions
ACM SIGGRAPH 2003 Papers
Adaptive grid-based document layout
ACM SIGGRAPH 2003 Papers
Sheepdog: learning procedures for technical support
Proceedings of the 9th international conference on Intelligent user interfaces
Proceedings of the working conference on Advanced visual interfaces
Stencils-based tutorials: design and evaluation
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Automation and customization of rendered web pages
Proceedings of the 18th annual ACM symposium on User interface software and technology
DocWizards: a system for authoring follow-me documentation wizards
Proceedings of the 18th annual ACM symposium on User interface software and technology
Geometric Context from a Single Image
ICCV '05 Proceedings of the Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 - Volume 01
Two-scale tone management for photographic look
ACM SIGGRAPH 2006 Papers
Photoshop Retouching Cookbook for Digital Photographers (Cookbooks (O'Reilly))
Photoshop Retouching Cookbook for Digital Photographers (Cookbooks (O'Reilly))
Adobe Photoshop Lightroom Book for Digital Photographers,The (Voices That Matter)
Adobe Photoshop Lightroom Book for Digital Photographers,The (Voices That Matter)
Koala: capture, share, automate, personalize business processes on the web
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Ingimp: introducing instrumentation to an end-user open source application
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
An application-independent system for visualizing user operation history
Proceedings of the 21st annual ACM symposium on User interface software and technology
Bayesian tangent shape model: Estimating shape and pose parameters via bayesian inference
CVPR'03 Proceedings of the 2003 IEEE computer society conference on Computer vision and pattern recognition
What would other programmers do: suggesting solutions to error messages
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
ToolClips: an investigation of contextual video assistance for functionality understanding
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
D-Macs: building multi-device user interfaces by demonstrating, sharing and replaying design actions
UIST '10 Proceedings of the 23nd annual ACM symposium on User interface software and technology
Chronicle: capture, exploration, and playback of document workflow histories
UIST '10 Proceedings of the 23nd annual ACM symposium on User interface software and technology
Design principles for visual communication
Communications of the ACM
MeshFlow: interactive visualization of mesh construction sequences
ACM SIGGRAPH 2011 papers
Nonlinear revision control for images
ACM SIGGRAPH 2011 papers
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Analytic provenance: process+interaction+insight
CHI '11 Extended Abstracts on Human Factors in Computing Systems
ACM Transactions on Graphics (TOG)
ShowMeHow: translating user interface instructions between applications
Proceedings of the 24th annual ACM symposium on User interface software and technology
Pause-and-play: automatically linking screencast video tutorials with applications
Proceedings of the 24th annual ACM symposium on User interface software and technology
Creating contextual help for GUIs using screenshots
Proceedings of the 24th annual ACM symposium on User interface software and technology
TwitApp: in-product micro-blogging for design sharing
Proceedings of the 24th annual ACM symposium on User interface software and technology
Sketch-sketch revolution: an engaging tutorial system for guided sketching and application learning
Proceedings of the 24th annual ACM symposium on User interface software and technology
Exposing photo manipulation with inconsistent reflections
ACM Transactions on Graphics (TOG)
The impact of tutorials on games of varying complexity
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Delta: a tool for representing and comparing workflows
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
MixT: automatic generation of step-by-step mixed media tutorials
CHI '12 Extended Abstracts on Human Factors in Computing Systems
Proceedings of the 30th ACM international conference on Design of communication
Waken: reverse engineering usage information and interface structure from software videos
Proceedings of the 25th annual ACM symposium on User interface software and technology
MixT: automatic generation of step-by-step mixed media tutorials
Proceedings of the 25th annual ACM symposium on User interface software and technology
GamiCAD: a gamified tutorial system for first time autocad users
Proceedings of the 25th annual ACM symposium on User interface software and technology
Tutorial-based interfaces for cloud-enabled applications
Proceedings of the 25th annual ACM symposium on User interface software and technology
Community enhanced tutorials: improving tutorials with multiple demonstrations
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
A trace-based framework for analyzing and synthesizing educational progressions
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Toolscape: enhancing the learning experience of how-to videos
CHI '13 Extended Abstracts on Human Factors in Computing Systems
Proceedings of the 12th International Conference on Interaction Design and Children
The drawing assistant: automated drawing guidance and feedback from photographs
Proceedings of the 26th annual ACM symposium on User interface software and technology
DemoCut: generating concise instructional videos for physical demonstrations
Proceedings of the 26th annual ACM symposium on User interface software and technology
Authoring multi-stage code examples with editable code histories
Proceedings of the 26th annual ACM symposium on User interface software and technology
Inverse image editing: recovering a semantic editing history from a before-and-after image pair
ACM Transactions on Graphics (TOG)
TutorialPlan: automated tutorial generation from CAD drawings
IJCAI'13 Proceedings of the Twenty-Third international joint conference on Artificial Intelligence
Hi-index | 0.02 |
We present a demonstration-based system for automatically generating succinct step-by-step visual tutorials of photo manipulations. An author first demonstrates the manipulation using an instrumented version of GIMP that records all changes in interface and application state. From the example recording, our system automatically generates tutorials that illustrate the manipulation using images, text, and annotations. It leverages automated image labeling (recognition of facial features and outdoor scene structures in our implementation) to generate more precise text descriptions of many of the steps in the tutorials. A user study comparing our automatically generated tutorials to hand-designed tutorials and screen-capture video recordings finds that users are 20--44% faster and make 60--95% fewer errors using our tutorials. While our system focuses on tutorial generation, we also present some initial work on generating content-dependent macros that use image recognition to automatically transfer selection operations from the example image used in the demonstration to new target images. While our macros are limited to transferring selection operations we demonstrate automatic transfer of several common retouching techniques including eye recoloring, whitening teeth and sunset enhancement.