Fusion of appearance and depth information for face recognition

Authors:
Jian-Gang Wang;Kar-Ann Toh;Ronda Venkateswarlu
Affiliations:
Institute for Infocomm Research, Singapore;Institute for Infocomm Research, Singapore;Institute for Infocomm Research, Singapore
Venue:
AVBPA'05 Proceedings of the 5th international conference on Audio- and Video-Based Biometric Person Authentication
Year:
2005

Citing 8
Cited 2

On Combining Classifiers

IEEE Transactions on Pattern Analysis and Machine Intelligence
Face verification from 3D and grey level clues

Pattern Recognition Letters
Person Identification Using Multiple Cues

IEEE Transactions on Pattern Analysis and Machine Intelligence
Use of depth and colour eigenfaces for face recognition

Pattern Recognition Letters
Face recognition with visible and thermal infrared imagery

Computer Vision and Image Understanding - Special issue on Face recognition
Kernel Methods for Pattern Analysis

Kernel Methods for Pattern Analysis
Benchmarking a Reduced Multivariate Polynomial Pattern Classifier

IEEE Transactions on Pattern Analysis and Machine Intelligence
Multi-biometrics using facial appearance, shape and temperature

FGR' 04 Proceedings of the Sixth IEEE international conference on Automatic face and gesture recognition

Real-time Stereo Face Recognition by Fusing Appearance and Depth Fisherfaces

Journal of VLSI Signal Processing Systems
Fusion of appearance image and passive stereo depth map for face recognition based on the bilateral 2DLDA

Journal on Image and Video Processing

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, an investigation is carried out regarding combination of 3D and 2D information for face recognition. A two-stage method, PCA and a Reduced Multivariate Polynomial Model (RMPM), is developed to fuse the appearance and depth information of face images in feature level where simplicity (number of polynomial coefficients increases linearly with model-order and input-dimension, i.e. no dimension explosion as in the case of full multivariate polynomials)and ease of use (can be easily formulated into recursive learning fashion) are major concerns. To cater for fast on-line registration capability when a new user arrives, the learning is formulated into recursive form. The improvement of the face recognition rate using this combination is quantified. The recognition rate by the combination is better than either appearance alone or depth alone. The performance of the algorithm is verified on both XM2VTS database and a real-time stereo vision system, showing that it is able to detect, track and recognize a person walking towards a stereo camera within reasonable time.