ShadowGuides: visualizations for in-situ learning of multi-touch and whole-hand gestures

  • Authors:
  • Dustin Freeman;Hrvoje Benko;Meredith Ringel Morris;Daniel Wigdor

  • Affiliations:
  • University of Toronto, Toronto, ON;Microsoft Research, Redmond, WA;Microsoft Research, Redmond, WA;Microsoft Surface, Redmond, WA

  • Venue:
  • Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

We present ShadowGuides, a system for in-situ learning of multi-touch and whole-hand gestures on interactive surfaces. ShadowGuides provides on-demand assistance to the user by combining visualizations of the user's current hand posture as interpreted by the system (feedback) and available postures and completion paths necessary to finish the gesture (feedforward). Our experiment compared participants learning gestures with ShadowGuides to those learning with video-based instruction. We found that participants learning with ShadowGuides remembered more gestures and expressed significantly higher preference for the help system.