Toward the use of gesture in traditional user interfaces

  • Authors:
  • R. Kjeldsen;J. Kender

  • Affiliations:
  • -;-

  • Venue:
  • FG '96 Proceedings of the 2nd International Conference on Automatic Face and Gesture Recognition (FG '96)
  • Year:
  • 1996

Quantified Score

Hi-index 0.00

Visualization

Abstract

This work describes the design of a functioning user interface based on visual recognition of hand gestures, and details its performance. In the interface, gesture replaces the mouse for many actions including selecting, moving and resizing windows. A camera below the screen observes the user. The hand is segmented from the background using color. Features of the hand's motion are extracted from the sequence of segmented images, and when needed the hand's pose is classified using a neural net. This information is parsed by a task specific grammar. The system runs in real time on standard PC hardware. It has demonstrated its abilities with various users in several different office environments. Having experimented with a functioning gestural interface, the authors discuss the practicality and best applications of this technology.