Pose-Invariant Facial Expression Recognition Using Variable-Intensity Templates

  • Authors:
  • Shiro Kumano;Kazuhiro Otsuka;Junji Yamato;Eisaku Maeda;Yoichi Sato

  • Affiliations:
  • Institute of Industrial Science, The University of Tokyo, Tokyo, Japan 153-8505;NTT Communication Science Laboratories, NTT, Kanagawa, Japan 243-0198;NTT Communication Science Laboratories, NTT, Kanagawa, Japan 243-0198;NTT Communication Science Laboratories, NTT, Kanagawa, Japan 243-0198;Institute of Industrial Science, The University of Tokyo, Tokyo, Japan 153-8505

  • Venue:
  • International Journal of Computer Vision
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we propose a method for pose-invariant facial expression recognition from monocular video sequences. The advantage of our method is that, unlike existing methods, our method uses a simple model, called the variable-intensity template, for describing different facial expressions. This makes it possible to prepare a model for each person with very little time and effort. Variable-intensity templates describe how the intensities of multiple points, defined in the vicinity of facial parts, vary with different facial expressions. By using this model in the framework of a particle filter, our method is capable of estimating facial poses and expressions simultaneously. Experiments demonstrate the effectiveness of our method. A recognition rate of over 90% is achieved for all facial orientations, horizontal, vertical, and in-plane, in the range of 卤40 degrees, 卤20 degrees, and 卤40 degrees from the frontal view, respectively.