Component-based face recognition with 3D morphable models

Authors:
Jennifer Huang;Bernd Heisele;Volker Blanz
Affiliations:
Center for Biological and Computational Learning, M.I.T., Cambridge, MA;Center for Biological and Computational Learning, M.I.T., Cambridge, MA and Honda Research Institute US, Boston, MA;Computer Graphics Group, Max-Planck-Institut, Saarbrücken, Germany
Venue:
AVBPA'03 Proceedings of the 4th international conference on Audio- and video-based biometric person authentication
Year:
2003

Citing 4
Cited 30

A morphable model for the synthesis of 3D faces

Proceedings of the 26th annual conference on Computer graphics and interactive techniques
Example-Based Object Detection in Images by Components

IEEE Transactions on Pattern Analysis and Machine Intelligence
Face Recognition: Features Versus Templates

IEEE Transactions on Pattern Analysis and Machine Intelligence
An embedded HMM-based approach for face detection and recognition

ICASSP '99 Proceedings of the Acoustics, Speech, and Signal Processing, 1999. on 1999 IEEE International Conference - Volume 06

Multi-Modal 2D and 3D Biometrics for Face Recognition

AMFG '03 Proceedings of the IEEE International Workshop on Analysis and Modeling of Faces and Gestures
Face recognition: A literature survey

ACM Computing Surveys (CSUR)
Refocusing Multimedia Research on Short Clips

IEEE MultiMedia
Facial emotion recognition by adaptive processing of tree structures

Proceedings of the 2006 ACM symposium on Applied computing
Face recognition from a single image per person: A survey

Pattern Recognition
An Efficient Multimodal 2D-3D Hybrid Approach to Automatic Face Recognition

IEEE Transactions on Pattern Analysis and Machine Intelligence
Keypoint Detection and Local Feature Matching for Textured 3D Face Recognition

International Journal of Computer Vision
Face recognition using classification-based linear projections

EURASIP Journal on Advances in Signal Processing
Classification of face images using local iterated function systems

Machine Vision and Applications
A local experts organization model with application to face emotion recognition

Expert Systems with Applications: An International Journal
Faceprint: Fusion of Local Features for 3D Face Recognition

ICB '09 Proceedings of the Third International Conference on Advances in Biometrics
Three-dimensional facial surface modeling applied to recognition

Engineering Applications of Artificial Intelligence
Self-adapting feature layers

ECCV'10 Proceedings of the 11th European conference on Computer vision: Part I
Using component features for face recognition

FGR' 04 Proceedings of the Sixth IEEE international conference on Automatic face and gesture recognition
3D face recognition based on local shape patterns and sparse representation classifier

MMM'11 Proceedings of the 17th international conference on Advances in multimedia modeling - Volume Part I
Robust 3D face recognition based on resolution invariant features

Pattern Recognition Letters
Face recognition by generalized two-dimensional FLD method and multi-class support vector machines

Applied Soft Computing
Brief description of image based 3D face recognition methods

3D Research
Shape matching based on fully automatic face detection on triangular meshes

CGI'06 Proceedings of the 24th international conference on Advances in Computer Graphics
Face recognition using 2d and 3d multimodal local features

ISVC'06 Proceedings of the Second international conference on Advances in Visual Computing - Volume Part I
2D and 3d multimodal hybrid face recognition

ECCV'06 Proceedings of the 9th European conference on Computer Vision - Volume Part III
A survey of 3d face recognition methods

AVBPA'05 Proceedings of the 5th international conference on Audio- and Video-Based Biometric Person Authentication
An automatic face recognition system in the near infrared spectrum

MLDM'05 Proceedings of the 4th international conference on Machine Learning and Data Mining in Pattern Recognition
An improved hybrid approach to face recognition by fusing local and global discriminant features

International Journal of Biometrics
A 3D face recognition algorithm using histogram-based features

EG 3DOR'08 Proceedings of the 1st Eurographics conference on 3D Object Retrieval
Estimation of 3D faces and illumination from single photographs using a bilinear illumination model

EGSR'05 Proceedings of the Sixteenth Eurographics conference on Rendering Techniques
Keypoint identification and feature-based 3D face recognition

ICB'07 Proceedings of the 2007 international conference on Advances in Biometrics
Spatio-temporal multifeature for facial analysis

ECCV'12 Proceedings of the 12th international conference on Computer Vision - Volume 2
Efficient face recognition using wavelet-based generalized neural network

Signal Processing
Robust frontal view search using extended manifold learning

Journal of Visual Communication and Image Representation

Quantified Score

Hi-index	0.01

Visualization

Abstract

We present a novel approach to pose and illumination invariant face recognition that combines two recent advances in the computer vision field: component-based recognition and 3D morphable models. First, a 3D morphable model is used to generate 3D face models from three input images from each person in the training database. The 3D models are rendered under varying pose and illumination conditions to build a large set of synthetic images. These images are then used to train a component-based face recognition system. The resulting system achieved 90% accuracy on a database of 1200 real images of six people and significantly outperformed a comparable global face recognition system. The results show the potential of the combination of morphable models and component-based recognition towards pose and illumination invariant face recognition based on only three training images of each subject.