Benchmarking still-to-video face recognition via partial and local linear discriminant analysis on COX-S2V dataset

Authors:
Zhiwu Huang;Shiguang Shan;Haihong Zhang;Shihong Lao;Alifu Kuerban;Xilin Chen
Affiliations:
Key Lab of Intelligent Information Processing, Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China,University of Chinese Academy of Sciences, Beijing, China;Key Lab of Intelligent Information Processing, Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China;OMRON Social Solutions Co. Ltd, Kyoto, Japan;OMRON Social Solutions Co. Ltd, Kyoto, Japan;College of Information Science and Engineering, Xinjiang University, China;Key Lab of Intelligent Information Processing, Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China
Venue:
ACCV'12 Proceedings of the 11th Asian conference on Computer Vision - Volume Part II
Year:
2012

Citing 13
Cited 0

Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection

IEEE Transactions on Pattern Analysis and Machine Intelligence
Hallucinating Faces

FG '00 Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000
Probabilistic recognition of human faces from video

Computer Vision and Image Understanding - Special issue on Face recognition
Face Recognition with Image Sets Using Manifold Density Divergence

CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 1 - Volume 01
Dimensionality Reduction of Multimodal Labeled Data by Local Fisher Discriminant Analysis

The Journal of Machine Learning Research
Discriminative Learning and Recognition of Image Set Classes Using Canonical Correlations

IEEE Transactions on Pattern Analysis and Machine Intelligence
Video-based face recognition using adaptive hidden markov models

CVPR'03 Proceedings of the 2003 IEEE computer society conference on Computer vision and pattern recognition
Inter-modality face recognition

ECCV'06 Proceedings of the 9th European conference on Computer Vision - Volume Part IV
Locality repulsion projections for image-to-set face recognition

ICME '11 Proceedings of the 2011 IEEE International Conference on Multimedia and Expo
Eigenface-domain super-resolution for face recognition

IEEE Transactions on Image Processing
Generalized Face Super-Resolution

IEEE Transactions on Image Processing
Super-Resolution Method for Face Recognition Using Nonlinear Mappings on Coherent Features

IEEE Transactions on Neural Networks
Covariance discriminative learning: A natural and efficient approach to image set classification

CVPR '12 Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we explore the real-world Still-to-Video (S2V) face recognition scenario, where only very few (single, in many cases) still images per person are enrolled into the gallery while it is usually possible to capture one or multiple video clips as probe. Typical application of S2V is mug-shot based watch list screening. Generally, in this scenario, the still image(s) were collected under controlled environment, thus of high quality and resolution, in frontal view, with normal lighting and neutral expression. On the contrary, the testing video frames are of low resolution and low quality, possibly with blur, and captured under poor lighting, in non-frontal view. We reveal that the S2V face recognition has been heavily overlooked in the past. Therefore, we provide a benchmarking in terms of both a large scale dataset and a new solution to the problem. Specifically, we collect (and release) a new dataset named COX-S2V, which contains 1,000 subjects, with each subject a high quality photo and four video clips captured simulating video surveillance scenario. Together with the database, a clear evaluation protocol is designed for benchmarking. In addition, in addressing this problem, we further propose a novel method named Partial and Local Linear Discriminant Analysis (PaLo-LDA). We then evaluated the method on COX-S2V and compared with several classic methods including LDA, LPP, ScSR. Evaluation results not only show the grand challenges of the COX-S2V, but also validate the effectiveness of the proposed PaLo-LDA method over the competitive methods.