Multimodal Face Recognition: Combination of Geometry with Physiological Information

Authors:
I. A. Kakadiaris;G. Passalis;T. Theoharis;G. Toderici;I. Konstantinidis;N. Murtuza
Affiliations:
University of Houston;University of Houston;University of Houston;University of Houston;University of Houston;University of Houston
Venue:
CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 2 - Volume 02
Year:
2005

Citing 0
Cited 5

Intraclass Retrieval of Nonrigid 3D Objects: Application to Face Recognition

IEEE Transactions on Pattern Analysis and Machine Intelligence
Three-Dimensional Face Recognition in the Presence of Facial Expressions: An Annotated Deformable Model Approach

IEEE Transactions on Pattern Analysis and Machine Intelligence
Classifying pretended and evoked facial expressions of positive and negative affective states using infrared measurement of skin temperature

ACM Transactions on Applied Perception (TAP)
Determining discriminative anatomical point pairings using adaboost for 3D face recognition

ICIP'09 Proceedings of the 16th IEEE international conference on Image processing
Collecting heart rate using a high precision, non-contact, single-point infrared temperature sensor

ICSR'12 Proceedings of the 4th international conference on Social Robotics

Quantified Score

Hi-index	0.00

Visualization

Abstract

It is becoming increasingly important to be able to credential and identify authorized personnel at key points of entry. Such identity management systems commonly employ biometric identifiers. In this paper, we present a novel multimodal facial recognition approach that employs data from both visible spectrum and thermal infrared sensors. Data from multiple cameras is used to construct a three-dimensional mesh representing the face and a facial thermal texture map. An annotated face model with explicit two-dimensional parameterization (UV) is then fitted to this data to construct: 1) a three-channel UV deformation image encoding geometry, and 2) a one-channel UV vasculature image encoding facial vasculature. Recognition is accomplished by comparing: 1) the parametric deformation images, 2) the parametric vasculature images, and 3) the visible spectrum texture maps. The novelty of our work lies in the use of deformation images and physiological information as means for comparison. We have performed extensive tests on the Face Recognition Grand Challenge v1.0 dataset and on our own multimodal database with very encouraging results.