Fully automatic 3D facial expression recognition using a region-based approach

Authors:
Pierre Lemaire;Boulbaba Ben Amor;Mohsen Ardabilian;Liming Chen;Mohamed Daoudi
Affiliations:
Ecole Centrale de Lyon, LIRIS, Lyon, France;Telecom Lille 1, LIFL, Lille, France;Ecole Centrale de Lyon, LIRIS, Lyon, France;Ecole Centrale de Lyon, LIRIS, Lyon, France;Telecom Lille 1, LIFL, Lille, France
Venue:
J-HGBU '11 Proceedings of the 2011 joint ACM workshop on Human gesture and behavior understanding
Year:
2011

Citing 15
Cited 2

Automatic recognition and analysis of human faces and facial expressions: a survey

Pattern Recognition
Automatic Analysis of Facial Expressions: The State of the Art

IEEE Transactions on Pattern Analysis and Machine Intelligence
Properties of Embedding Methods for Similarity Searching in Metric Spaces

IEEE Transactions on Pattern Analysis and Machine Intelligence
A 3D Facial Expression Database For Facial Behavior Research

FGR '06 Proceedings of the 7th International Conference on Automatic Face and Gesture Recognition
3D Facial Expression Recognition Based on Primitive Surface Feature Distribution

CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2
Multimodal human-computer interaction: A survey

Computer Vision and Image Understanding
Automatic inference of cross-modal nonverbal interactions in multiparty conversations: "who responds to whom, when, and how?" from gaze, head gestures, and utterances

Proceedings of the 9th international conference on Multimodal interfaces
Bosphorus Database for 3D Face Analysis

Biometrics and Identity Management
Automatic facial expression recognition on a single 3D face by exploring shape deformation

MM '09 Proceedings of the 17th ACM international conference on Multimedia
A coarse-to-fine curvature analysis-based rotation invariant 3D face landmarking

BTAS'09 Proceedings of the 3rd IEEE international conference on Biometrics: Theory, applications and systems
Anthropometric 3D Face Recognition

International Journal of Computer Vision
A Set of Selected SIFT Features for 3D Facial Expression Recognition

ICPR '10 Proceedings of the 2010 20th International Conference on Pattern Recognition
Shape analysis of local facial patches for 3D facial expression recognition

Pattern Recognition
Bilinear Models for 3-D Face and Facial Expression Recognition

IEEE Transactions on Information Forensics and Security
Facial expression recognition using 3D facial feature distances

ICIAR'07 Proceedings of the 4th international conference on Image Analysis and Recognition

Joint ACM workshop on human gesture and behavior understanding: (J-HGBU'11)

MM '11 Proceedings of the 19th ACM international conference on Multimedia
Static and dynamic 3D facial expression recognition: A comprehensive survey

Image and Vision Computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we address the problem of automatic 3D facial expression recognition. Automatic 3D Facial Expression Recognition techniques are generally limited in that they require manual, precise landmark points. Here, we propose a framework capable of handling the potential imprecision of automatic landmarking techniques, thanks to a region approach. After an automatic feature point localization step, we cluster the face into several regions, chosen for their importance into the facial expression process, according to the Facial Action Coding System (FACS) and anatomic considerations. Then, we match those regions to reference models representing the six prototypical expressions using Iterative Closest Points (ICP). ICP tends to compensate the imprecisions in the face clustering relative to landmarks localization. Resulting matching scores are concatenated into a descriptor for the probe model. Finally, we use a standard classification tool; in our experiments, we used Support Vector Machines (SVM), and were able to provide comparable results to existing 3D FER methods over the same protocol, while being fully automatic.