Pose, illumination and expression invariant pairwise face-similarity measure via Doppelgänger list comparison

Authors:
Florian Schroff;Tali Treibitz;David Kriegman;Serge Belongie
Affiliations:
Department of Computer Science and Engineering, University of California, San Diego, USA;Department of Computer Science and Engineering, University of California, San Diego, USA;Department of Computer Science and Engineering, University of California, San Diego, USA;Department of Computer Science and Engineering, University of California, San Diego, USA
Venue:
ICCV '11 Proceedings of the 2011 International Conference on Computer Vision
Year:
2011

Citing 0
Cited 5

Connecting missing links: object discovery from sparse observations using 5 million product images

ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part VI
A study on the effective approach to illumination-invariant face recognition based on a single image

CCBR'12 Proceedings of the 7th Chinese conference on Biometric Recognition
Face recognition after plastic surgery: a comprehensive study

ACCV'12 Proceedings of the 11th Asian conference on Computer Vision - Volume Part II
Enhancing expression recognition in the wild with unlabeled reference data

ACCV'12 Proceedings of the 11th Asian conference on Computer Vision - Volume Part II
Sparsity sharing embedding for face verification

ACCV'12 Proceedings of the 11th Asian conference on Computer Vision - Volume Part II

Quantified Score

Hi-index	0.00

Visualization

Abstract

Face recognition approaches have traditionally focused on direct comparisons between aligned images, e.g. using pixel values or local image features. Such comparisons become prohibitively difficult when comparing faces across extreme differences in pose, illumination and expression. The goal of this work is to develop a face-similarity measure that is largely invariant to these differences. We propose a novel data driven method based on the insight that comparing images of faces is most meaningful when they are in comparable imaging conditions. To this end we describe an image of a face by an ordered list of identities from a Library. The order of the list is determined by the similarity of the Library images to the probe image. The lists act as a signature for each face image: similarity between face images is determined via the similarity of the signatures. Here the CMU Multi-PIE database, which includes images of 337 individuals in more than 2000 pose, lighting and illumination combinations, serves as the Library. We show improved performance over state of the art face-similarity measures based on local features, such as FPLBP, especially across large pose variations on FacePix and multi-PIE. On LFW we show improved performance in comparison with measures like SIFT (on fiducials), LBP, FPLBP and Gabor (C1).