Pose-invariant facial expression recognition using variable-intensity templates

Authors:
Shiro Kumano;Kazuhiro Otsuka;Junji Yamato;Eisaku Maeda;Yoichi Sato
Affiliations:
Institute of Industrial Science, The University of Tokyo, Tokyo, Japan;NTT Communication Science Laboratories, NTT, Atsugi-shi, Kanagawa, Japan;NTT Communication Science Laboratories, NTT, Atsugi-shi, Kanagawa, Japan;NTT Communication Science Laboratories, NTT, Atsugi-shi, Kanagawa, Japan;Institute of Industrial Science, The University of Tokyo, Tokyo, Japan
Venue:
ACCV'07 Proceedings of the 8th Asian conference on Computer vision - Volume Part I
Year:
2007

Citing 12
Cited 6

Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection

IEEE Transactions on Pattern Analysis and Machine Intelligence
Artificial Intelligence

Artificial Intelligence
Model-Based Face Tracking for View-Independent Facial Expression Recognition

FGR '02 Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition
Facial expression recognition from video sequences: temporal and static modeling

Computer Vision and Image Understanding - Special issue on Face recognition
Simultaneous Facial Action Tracking and Expression Recognition Using a Particle Filter

ICCV '05 Proceedings of the Tenth IEEE International Conference on Computer Vision - Volume 2
AAM Derived Face Representations for Robust Facial Action Recognition

FGR '06 Proceedings of the 7th International Conference on Automatic Face and Gesture Recognition
Robust Real-Time Face Pose and Facial Expression Recovery

CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1
Generic vs. person specific active appearance models

Image and Vision Computing
Manifold based analysis of facial expression

Image and Vision Computing
Generalization of a vision-based computational model of mind-reading

ACII'05 Proceedings of the First international conference on Affective Computing and Intelligent Interaction
Real-time modeling of face deformation for 3d head pose estimation

AMFG'05 Proceedings of the Second international conference on Analysis and Modelling of Faces and Gestures
Robust online appearance models for visual tracking

IEEE Transactions on Pattern Analysis and Machine Intelligence

Automatic inference of cross-modal nonverbal interactions in multiparty conversations: "who responds to whom, when, and how?" from gaze, head gestures, and utterances

Proceedings of the 9th international conference on Multimodal interfaces
Fast and Robust Face Tracking for Analyzing Multiparty Face-to-Face Meetings

MLMI '08 Proceedings of the 5th international workshop on Machine Learning for Multimodal Interaction
Pose-Invariant Facial Expression Recognition Using Variable-Intensity Templates

International Journal of Computer Vision
Geometric and Optical Flow Based Method for Facial Expression Recognition in Color Image Sequences

ICCVG 2008 Proceedings of the International Conference on Computer Vision and Graphics: Revised Papers
Local binary patterns for multi-view facial expression recognition

Computer Vision and Image Understanding
A temporal latent topic model for facial expression recognition

ACCV'10 Proceedings of the 10th Asian conference on Computer vision - Volume Part IV

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we propose a method for pose-invariant facial expression recognition from monocular video sequences. The advantage of our method is that, unlike existing methods, our method uses a very simple model, called the variable-intensity template, for describing different facial expressions, making it possible to prepare a model for each person with very little time and effort. Variable-intensity templates describe how the intensity of multiple points defined in the vicinity of facial parts varies for different facial expressions. By using this model in the framework of a particle filter, our method is capable of estimating facial poses and expressions simultaneously. Experiments demonstrate the effectiveness of our method. A recognition rate of over 90% was achieved for horizontal facial orientations on a range of ±40 degrees from the frontal view.