Robust computer vision-based detection of pinching for one and two-handed gesture input

  • Authors:
  • Andrew D. Wilson

  • Affiliations:
  • Microsoft Research, Redmond, WA

  • Venue:
  • UIST '06 Proceedings of the 19th annual ACM symposium on User interface software and technology
  • Year:
  • 2006

Quantified Score

Hi-index 0.02

Visualization

Abstract

We present a computer vision technique to detect when the user brings their thumb and forefinger together (a pinch gesture) for close-range and relatively controlled viewing circumstances. The technique avoids complex and fragile hand tracking algorithms by detecting the hole formed when the thumb and forefinger are touching; this hole is found by simple analysis of the connected components of the background segmented against the hand. Our Thumb and Fore-Finger Interface (TAFFI) demonstrates the technique for cursor control as well as map navigation using one and two-handed interactions.