Interacting with large displays from a distance with vision-tracked multi-finger gestural input

  • Authors:
  • Shahzad Malik;Abhishek Ranjan;Ravin Balakrishnan

  • Affiliations:
  • University of Toronto;University of Toronto;University of Toronto

  • Venue:
  • Proceedings of the 18th annual ACM symposium on User interface software and technology
  • Year:
  • 2005

Quantified Score

Hi-index 0.01

Visualization

Abstract

We explore the idea of using vision-based hand tracking over a constrained tabletop surface area to perform multi-finger and whole-hand gestural interactions with large displays from a distance. We develop bimanual techniques to support a variety of asymmetric and symmetric interactions, including fast targeting and navigation to all parts of a large display from the comfort of a desk and chair, as well as techniques that exploit the ability of the vision-based hand tracking system to provide multi-finger identification and full 2D hand segmentation. We also posit a design that allows for handling multiple concurrent users.