Real-Time Visual Recognition of Facial Gestures for Human-Computer Interaction

  • Authors:
  • Alexander Zelinsky;Jochen Heinzmann

  • Affiliations:
  • -;-

  • Venue:
  • FG '96 Proceedings of the 2nd International Conference on Automatic Face and Gesture Recognition (FG '96)
  • Year:
  • 1996

Quantified Score

Hi-index 0.00

Visualization

Abstract

People naturally express themselves through facial gestures and expressions. Our goal is to build a facial gesture human-computer interface for use in robot applications. We have implemented an interface that tracks a person's facial features in real time (30Hz). Our system does not require special illumination nor facial makeup. By using multiple Kalman filters we accurately predict and robustly track facial features. This is despite disturbances and rapid movements of the head (including both translational and rotational motion). Since we reliably track the face in real-time we are also able to recognize motion gestures of the face. Our system can recognize a large set of gestures (13) ranging from "yes", "no" and "may be" to detecting winks, blinks and sleeping.