Automatic facial feature extraction and 3D face modeling using two orthogonal views with application to 3D face recognition

Authors:
A-Nasser Ansari;Mohamed Abdel-Mottaleb
Affiliations:
University of Miami, Department of Electrical and Computer Engineering, 1251 Memorial Drive, Coral Gables, FL 33124, USA;University of Miami, Department of Electrical and Computer Engineering, 1251 Memorial Drive, Coral Gables, FL 33124, USA
Venue:
Pattern Recognition
Year:
2005

Citing 20
Cited 10

Human face profile recognition by computer

Pattern Recognition
Realistic modeling for facial animation

SIGGRAPH '95 Proceedings of the 22nd annual conference on Computer graphics and interactive techniques
Computer facial animation

Computer facial animation
Making faces

Proceedings of the 25th annual conference on Computer graphics and interactive techniques
Synthesizing realistic facial expressions from photographs

Proceedings of the 25th annual conference on Computer graphics and interactive techniques
A morphable model for the synthesis of 3D faces

Proceedings of the 26th annual conference on Computer graphics and interactive techniques
Face Detection in Color Images

IEEE Transactions on Pattern Analysis and Machine Intelligence
Curvature-Based Face Surface Recognition Using Spherical Correlation - Principal Directions for Curved Object Recognition

FG '98 Proceedings of the 3rd. International Conference on Face & Gesture Recognition
3D Face Modeling from Stereo and Differential Constraints

FG '98 Proceedings of the 3rd. International Conference on Face & Gesture Recognition
3D Human Face Recognition Using Point Signature

FG '00 Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000
Face Recognition From Profiles Using Morphological Operations

RATFG-RTS '99 Proceedings of the International Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems
Face Recognition Using Range Images

VSMM '97 Proceedings of the 1997 International Conference on Virtual Systems and MultiMedia
Automated Modelling of Real Human Faces for 3D Animation

ICPR '98 Proceedings of the 14th International Conference on Pattern Recognition-Volume 1 - Volume 1
Face Modeling and Recognition in 3-D

AMFG '03 Proceedings of the IEEE International Workshop on Analysis and Modeling of Faces and Gestures
Face recognition: A literature survey

ACM Computing Surveys (CSUR)
3D face recognition based on high-resolution 3D face modeling from frontal and profile views

WBMA '03 Proceedings of the 2003 ACM SIGMM workshop on Biometrics methods and applications
A Survey Of Approaches To Three-Dimensional Face Recognition

ICPR '04 Proceedings of the Pattern Recognition, 17th International Conference on (ICPR'04) Volume 1 - Volume 01
Three-Dimensional Model Based Face Recognition

ICPR '04 Proceedings of the Pattern Recognition, 17th International Conference on (ICPR'04) Volume 1 - Volume 01
Parametric face modeling and affect synthesis

ICME '03 Proceedings of the 2003 International Conference on Multimedia and Expo - Volume 2
3-D face structure extraction and recognition from images using 3-D morphing and distance mapping

IEEE Transactions on Image Processing

Face recognition in non-uniform illumination conditions using lighting normalization and SVM

CEA'07 Proceedings of the 2007 annual Conference on International Conference on Computer Engineering and Applications
Recovering the 3D shape and poses of face images based on the similarity transform

Pattern Recognition Letters
Image-Based Augmented Reality Model for Image-Guided Surgical Simulation

Medical Imaging and Informatics
Face recognition based on 3D ridge images obtained from range data

Pattern Recognition
A multimodal approach for 3D face modeling and recognition using 3D deformable facial mask

Machine Vision and Applications
The 3DID face alignment system for verifying identity

Image and Vision Computing
Samera: a scalable and memory-efficient feature extraction algorithm for short 3D video segments

Proceedings of the 2nd International Conference on Immersive Telecommunications
Technical Section: Realistic wrinkle generation for 3D face modeling based on automatically extracted curves and improved shape control functions

Computers and Graphics
Computer-aided 3D human modeling for portrait-based product development using point- and curve-based deformation

Computer-Aided Design
Geometry-based 3D face morphology analysis: soft-tissue landmark formalization

Multimedia Tools and Applications

Quantified Score

Hi-index	0.01

Visualization

Abstract

We present a fully automated algorithm for facial feature extraction and 3D face modeling from a pair of orthogonal frontal and profile view images of a person's face taken by calibrated cameras. The algorithm starts by automatically extracting corresponding 2D landmark facial features from both view images, then compute their 3D coordinates. Further, we estimate the coordinates of the features that are hidden in the profile view based on the visible features extracted in the two orthogonal face images. The 3D coordinates of the selected feature points obtained from the images are used first to align, then to locally deform the corresponding facial vertices of the generic 3D model. Preliminary experiments to assess the applicability of the resulted models for face recognition show encouraging results.