Technical Section: Expression modeling for expression-invariant face recognition

Authors:
Frank B. ter Haar;Remco C. Veltkamp
Affiliations:
Electro-Optics, TNO Defence Security and Safety, The Hague, The Netherlands;Information and Computing Sciences, Utrecht University, The Netherlands
Venue:
Computers and Graphics
Year:
2010

Citing 10
Cited 0

A Method for Registration of 3-D Shapes

IEEE Transactions on Pattern Analysis and Machine Intelligence - Special issue on interpretation of 3-D scenes—part II
Active Appearance Models

IEEE Transactions on Pattern Analysis and Machine Intelligence
Preliminary Face Recognition Grand Challenge Results

FGR '06 Proceedings of the 7th International Conference on Automatic Face and Gesture Recognition
A 3D Facial Expression Database For Facial Behavior Research

FGR '06 Proceedings of the 7th International Conference on Automatic Face and Gesture Recognition
Combined 2D/3D Face Recognition Using Log-Gabor Templates

AVSS '06 Proceedings of the IEEE International Conference on Video and Signal Based Surveillance
Three-Dimensional Face Recognition in the Presence of Facial Expressions: An Annotated Deformable Model Approach

IEEE Transactions on Pattern Analysis and Machine Intelligence
Deformation Modeling for Robust 3D Face Matching

IEEE Transactions on Pattern Analysis and Machine Intelligence
An Intrinsic Framework for Analysis of Facial Surfaces

International Journal of Computer Vision
Bilinear Models for 3-D Face and Facial Expression Recognition

IEEE Transactions on Information Forensics and Security
A Region Ensemble for 3-D Face Recognition

IEEE Transactions on Information Forensics and Security

Quantified Score

Hi-index	0.00

Visualization

Abstract

Morphable face models have proven to be an effective tool for 3D face modeling and face recognition, but the extension to 3D face scans with expressions is still a challenge. The two main difficulties are (1) how to build a new morphable face model that deals with expressions, and (2) how to fit this morphable face model automatically to new 3D face scans with unknown expressions. This work presents a multi-resolution approach to semi-automatically build seven morphable expression models, and one morphable identity model from scratch. We propose an algorithm that automatically selects the proper pose, identity, and expression such that the final model instance accurately fits the 3D face scan. To prove high fitting accuracy and its use for face recognition, we perform experiments on the publicly available UND, GAVAB, BU-3DFE, FRGC v.2 datasets. Our results show high recognition rates of respectively 99%, 98%, 100%, and 97% after the automatic removal of the expressions.