From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose
IEEE Transactions on Pattern Analysis and Machine Intelligence
Lambertian Reflectance and Linear Subspaces
IEEE Transactions on Pattern Analysis and Machine Intelligence
Comparison and Combination of Ear and Face Images in Appearance-Based Biometrics
IEEE Transactions on Pattern Analysis and Machine Intelligence
Unified 3D face and ear recognition using wavelets on geometry images
Pattern Recognition
Multimodal biometrics using geometry preserving projections
Pattern Recognition
Structural hidden Markov models for biometrics: Fusion of face and fingerprint
Pattern Recognition
Journal of Cognitive Neuroscience
Likelihood Ratio-Based Biometric Score Fusion
IEEE Transactions on Pattern Analysis and Machine Intelligence
Robust Face Recognition via Sparse Representation
IEEE Transactions on Pattern Analysis and Machine Intelligence
Integrating monomodal biometric matchers through logistic regression rank aggregation approach
AIPR '08 Proceedings of the 2008 37th IEEE Applied Imagery Pattern Recognition Workshop
Multimodal Biometric Recognition Based on Complex KFDA
IAS '09 Proceedings of the 2009 Fifth International Conference on Information Assurance and Security - Volume 02
Multimodal biometric system using rank-level fusion approach
IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics - Special issue on cybernetics and cognitive informatics
A new method of feature fusion and its application in image recognition
Pattern Recognition
Feature level fusion of fingerprint and finger vein biometrics
ICSI'11 Proceedings of the Second international conference on Advances in swarm intelligence - Volume Part II
Face and ear: a bimodal identification system
ICIAR'06 Proceedings of the Third international conference on Image Analysis and Recognition - Volume Part II
Is face recognition really a Compressive Sensing problem?
CVPR '11 Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition
Robust sparse coding for face recognition
CVPR '11 Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition
Face recognition using the nearest feature line method
IEEE Transactions on Neural Networks
Hi-index | 0.01 |
If fusion rules cannot adapt to the changes of environment and individual users, multimodal systems may perform worse than unimodal systems when one or more modalities encounter data degeneration. This paper develops a robust face and ear based multimodal biometric system using Sparse Representation (SR), which integrates the face and ear at feature level, and can effectively adjust the fusion rule based on reliability difference between the modalities. We first propose a novel index called Sparse Coding Error Ratio (SCER) to measure the reliability difference between face and ear query samples. Then, SCER is utilized to develop an adaptive feature weighting scheme for dynamically reducing the negative effect of the less reliable modality. In multimodal classification phase, SR-based classification techniques are employed, i.e., Sparse Representation based Classification (SRC) and Robust Sparse Coding (RSC). Finally, we derive a category of SR-based multimodal recognition methods, including Multimodal SRC with feature Weighting (MSRCW) and Multimodal RSC with feature Weighting (MRSCW). Experimental results demonstrate that: (a) MSRCW and MRSCW perform significantly better than the unimodal recognition using either face or ear alone, as well as the known multimodal methods; (b) The effectiveness of adaptive feature weighting is verified. MSRCW and MRSCW are very robust to the image degeneration occurring to one of the modalities. Even when face (ear) query sample suffers from 100% random pixel corruption, they can still get the performance close to the ear (face) unimodal recognition; (c) By integrating the advantages of adaptive feature weighting and sparsity-constrained regression, MRSCW seems excellent in tackling the face and ear based multimodal recognition problem.