Gesture play: motivating online gesture learning with fun, positive reinforcement and physical metaphors

Authors:
Andrew Bragdon;Arman Uguray;Daniel Wigdor;Stylianos Anagnostopoulos;Robert Zeleznik;Rutledge Feman
Affiliations:
Brown University, Providence, RI;Brown University, Providence, RI;Microsoft Research, Redmond, WA;Brown University, Providence, RI;Brown University, Providence, RI;Brown University, Providence, RI
Venue:
ACM International Conference on Interactive Tabletops and Surfaces
Year:
2010

Citing 21
Cited 7

Making computer tasks at work more playful: Implications for systems analysts and designers

SIGCPR '88 Proceedings of the ACM SIGCPR conference on Management of information systems personnel
Charade: remote control of objects using free-hand gestures

Communications of the ACM - Special issue on computer augmented environments: back to the real world
Novel interaction techniques for overlapping windows

Proceedings of the 14th annual ACM symposium on User interface software and technology
A fast, interactive 3D paper-flier metaphor for digital bulletin boards

Proceedings of the 16th annual ACM symposium on User interface software and technology
Labeling images with a computer game

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Interactive public ambient displays: transitioning from implicit to explicit, public to personal, interaction with multiple users

Proceedings of the 17th annual ACM symposium on User interface software and technology
Hover widgets: using the tracking state to extend the capabilities of pen-operated devices

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Keepin' it real: pushing the desktop metaphor with physics, piles and the pen

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
InkSeine: In Situ search for active note taking

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Direct-touch vs. mouse input for tabletop displays

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Strategies for accelerating on-line learning of hotkeys

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Magic Paper: Sketch-Understanding Research

Computer
Reality-based interaction: a framework for post-WIMP interfaces

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Combining and measuring the benefits of bimanual pen and direct-touch interaction on horizontal interfaces

AVI '08 Proceedings of the working conference on Advanced visual interfaces
OctoPocus: a dynamic guide for learning gesture-based command sets

Proceedings of the 21st annual ACM symposium on User interface software and technology
Bringing physics to the surface

Proceedings of the 21st annual ACM symposium on User interface software and technology
User-defined gestures for surface computing

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
GestureBar: improving the approachability of gesture-based interfaces

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Using strokes as command shortcuts: cognitive benefits and toolkit support

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
ShadowGuides: visualizations for in-situ learning of multi-touch and whole-hand gestures

Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces
Lifelike pedagogical agents and affective computing: an exploratory synthesis

Artificial intelligence today

Hand occlusion on a multi-touch tabletop

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Self-revealing gestures: teaching new touch interactions in windows 8

CHI '12 Extended Abstracts on Human Factors in Computing Systems
Design and evaluation of finger-count interaction: Combining multitouch gestures and menus

International Journal of Human-Computer Studies
FlowBlocks: a multi-touch ui for crowd interaction

Proceedings of the 25th annual ACM symposium on User interface software and technology
On the relation of ordinary gestures to TV screens: general lessons for the design of collaborative interactive techniques

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Learning and performance with gesture guides

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Arpège: learning multitouch chord gestures vocabularies

Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces

Quantified Score

Hi-index	0.00

Visualization

Abstract

Learning a set of gestures requires a non-trivial investment of time from novice users. We propose a novel approach based on positive reinforcement for motivating the online learning of multi-touch gestures: introducing simple, game-like elements to make gesture learning fun and enjoyable. We develop 3 metaphors, button widgets, animated spring widgets, and physical props, as primitives for simple, physically-based puzzles which afford the disclosure of static and dynamic hand gestures. Using these metaphors, we implemented a gesture set representing 14 of 16 gesture types in an established hand gesture taxonomy. We present the results of a quantitative and qualitative evaluation which indicate this approach motivates gesture rehearsal more so than video demonstrations, while memory recall was equivalent overall but improved in the short-term, for controlled tasks.