Real-time capable method for facial expression recognition in color and stereo vision

  • Authors:
  • Robert Niese;Ayoub Al-Hamadi;Axel Panning;Bernd Michaelis

  • Affiliations:
  • Institute for Electronics, Signal Processing and Communications, Otto-von-Guericke-University Magdeburg, Germany;Institute for Electronics, Signal Processing and Communications, Otto-von-Guericke-University Magdeburg, Germany;Institute for Electronics, Signal Processing and Communications, Otto-von-Guericke-University Magdeburg, Germany;Institute for Electronics, Signal Processing and Communications, Otto-von-Guericke-University Magdeburg, Germany

  • Venue:
  • ICCSA'07 Proceedings of the 2007 international conference on Computational science and its applications - Volume Part I
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper we present a user independent real-time capable automatic method for recognition of facial expressions related to basic emotions from stereo image sequences. The method automatically detects faces in unconstraint pose based on depth and color information. In order to overcome difficulties caused by increasing change in pose, lighting transitions, or complicated background, we introduce a face normalization algorithm based on an Iterative Closest Point algorithm. In normalized face images we defined a set of physiologically motivated face regions related to a subset of facial muscles which are apt to automatically detect the six well-known basis emotions. Visual facial expression analysis takes place by an optical flow based feature extraction and a nearest neighbor classification, which uses a distance measure, i.e. the current flow vector pattern is matched against empirically determined ground truth data.