Multi-biometrics using facial appearance, shape and temperature

Authors:
Kyong I. Chang;Kevin W. Bowyer;Patrick J. Flynn;Xin Chen
Affiliations:
Computer Science & Engineering Department, University of Notre Dame, Notre Dame, IN;Computer Science & Engineering Department, University of Notre Dame, Notre Dame, IN;Computer Science & Engineering Department, University of Notre Dame, Notre Dame, IN;Computer Science & Engineering Department, University of Notre Dame, Notre Dame, IN
Venue:
FGR' 04 Proceedings of the Sixth IEEE international conference on Automatic face and gesture recognition
Year:
2004

Citing 13
Cited 8

On Combining Classifiers

IEEE Transactions on Pattern Analysis and Machine Intelligence
The FERET Evaluation Methodology for Face-Recognition Algorithms

IEEE Transactions on Pattern Analysis and Machine Intelligence
Mathematical Techniques in Multisensor Data Fusion

Mathematical Techniques in Multisensor Data Fusion
BioID: A Multimodal Biometric Identification System

Computer
Information Fusion in Biometrics

AVBPA '01 Proceedings of the Third International Conference on Audio- and Video-Based Biometric Person Authentication
Thermal Imaging for Anxiety Detection

CVBVS '00 Proceedings of the IEEE Workshop on Computer Vision Beyond the Visible Spectrum: Methods and Applications (CVBVS 2000)
Combination of Face Classifiers for Person Identification

ICPR '96 Proceedings of the International Conference on Pattern Recognition (ICPR '96) Volume III-Volume 7276 - Volume 7276
On Probabilistic Combination of Face and Gait Cues for Identification

FGR '02 Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition
PCA-Based Face Recognition in Infrared Imagery: Baseline and Comparative Studies

AMFG '03 Proceedings of the IEEE International Workshop on Analysis and Modeling of Faces and Gestures
Combining classifiers for face recognition

ICME '03 Proceedings of the 2003 International Conference on Multimedia and Expo - Volume 3 (ICME '03) - Volume 03
Eigenfaces for recognition

Journal of Cognitive Neuroscience
Face recognition from 2D and 3D images using 3D Gabor filters

Image and Vision Computing
Assessment of time dependency in face recognition: an initial study

AVBPA'03 Proceedings of the 4th international conference on Audio- and video-based biometric person authentication

An Evaluation of Multimodal 2D+3D Face Biometrics

IEEE Transactions on Pattern Analysis and Machine Intelligence
Finger surface as a biometric identifier

Computer Vision and Image Understanding
Outdoor recognition at a distance by fusing gait and face

Image and Vision Computing
Real-time Stereo Face Recognition by Fusing Appearance and Depth Fisherfaces

Journal of VLSI Signal Processing Systems
Fusion of appearance image and passive stereo depth map for face recognition based on the bilateral 2DLDA

Journal on Image and Video Processing
Finger surface as a biometric identifier

Computer Vision and Image Understanding
Fusing Gabor and LBP feature sets for kernel-based face recognition

AMFG'07 Proceedings of the 3rd international conference on Analysis and modeling of faces and gestures
Fusion of appearance and depth information for face recognition

AVBPA'05 Proceedings of the 5th international conference on Audio- and Video-Based Biometric Person Authentication

Quantified Score

Hi-index	0.00

Visualization

Abstract

We present results of the first study to examine individual and multi-modal face recognition using 2D, 3D and infrared images of the same set of subjects. Each sensor captures different aspects of human facial features; appearance in intensity representing surface reflectance from a light source, shape data representing depth values from the camera, and the pattern of heat emitted, respectively. We employ a database containing a gallery set of 127 images and an accumulated time-lapse probe set of 297 images. Using a PCA-based approach tuned separately for 2D, 3D and IR, we find rank-one recognition rates of 90.6% for 2D, 91.9% for 3D and 71.0% for IR. Combining each pair of modalities, we find a multi-modal rank-one recognition rate of 98.7% for 2D-3D, 96.6% for 2D-IR and 98.0% for 3D-IR. When all three modalities are combined, we obtain 100% recognition. The results shown in this study appear to support the conclusion that the path to higher accuracy and robustness in biometrics involves use of multiple biometrics rather than the best possible sensor and algorithm for a single biometric.