2D and 3d multimodal hybrid face recognition

Authors:
Ajmal Mian;Mohammed Bennamoun;Robyn Owens
Affiliations:
School of Computer Science and Software Engineering, The University of Western Australia, Crawley, WA, Australia;School of Computer Science and Software Engineering, The University of Western Australia, Crawley, WA, Australia;School of Computer Science and Software Engineering, The University of Western Australia, Crawley, WA, Australia
Venue:
ECCV'06 Proceedings of the 9th European conference on Computer Vision - Volume Part III
Year:
2006

Citing 11
Cited 6

A Method for Registration of 3-D Shapes

IEEE Transactions on Pattern Analysis and Machine Intelligence - Special issue on interpretation of 3-D scenes—part II
Curve and surface smoothing without shrinkage

ICCV '95 Proceedings of the Fifth International Conference on Computer Vision
Face recognition: A literature survey

ACM Computing Surveys (CSUR)
Robust Real-Time Face Detection

International Journal of Computer Vision
A Survey Of Approaches To Three-Dimensional Face Recognition

ICPR '04 Proceedings of the Pattern Recognition, 17th International Conference on (ICPR'04) Volume 1 - Volume 01
A Fast Multi-Modal Approach to Facial Feature Detection

WACV-MOTION '05 Proceedings of the Seventh IEEE Workshops on Application of Computer Vision (WACV/MOTION'05) - Volume 1 - Volume 01
Overview of the Face Recognition Grand Challenge

CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 1 - Volume 01
Matching 2.5D Face Scans to 3D Models

IEEE Transactions on Pattern Analysis and Machine Intelligence
Eigenfaces for recognition

Journal of Cognitive Neuroscience
Component-based face recognition with 3D morphable models

AVBPA'03 Proceedings of the 4th international conference on Audio- and video-based biometric person authentication
An introduction to biometric recognition

IEEE Transactions on Circuits and Systems for Video Technology

An Efficient Multimodal 2D-3D Hybrid Approach to Automatic Face Recognition

IEEE Transactions on Pattern Analysis and Machine Intelligence
Keypoint Detection and Local Feature Matching for Textured 3D Face Recognition

International Journal of Computer Vision
Face recognition using classification-based linear projections

EURASIP Journal on Advances in Signal Processing
Score Level Fusion of Ear and Face Local 3D Features for Fast and Expression-Invariant Human Recognition

ICIAR '09 Proceedings of the 6th International Conference on Image Analysis and Recognition
Speech-Video Synchronization Using Lips Movements and Speech Envelope Correlation

ICIAR '09 Proceedings of the 6th International Conference on Image Analysis and Recognition
Keypoint identification and feature-based 3D face recognition

ICB'07 Proceedings of the 2007 international conference on Advances in Biometrics

Quantified Score

Hi-index	0.00

Visualization

Abstract

We present a 2D and 3D multimodal hybrid face recognition algorithm and demonstrate its performance on the FRGC v1.0 data. We use hybrid (feature-based and holistic) matching for the 3D faces and a holistic matching approach on the 2D faces. Feature-based matching is performed by offline segmenting each 3D face in the gallery into three regions, namely the eyes-forehead, the nose and the cheeks. The cheeks are discarded to avoid facial expressions and hair. During recognition, each feature in the gallery is automatically matched, using a modified ICP algorithm, with a complete probe face. The holistic 3D and 2D face matching is performed using PCA. Individual matching scores are fused after normalization and the results are compared to the BEE baseline performances in order to provide some answers to the first three conjectures of the FRGC. Our multimodal hybrid algorithm substantially outperformed others by achieving 100% verification rate at 0.0006 FAR.