Face Recognition with Image Sets Using Hierarchically Extracted Exemplars from Appearance Manifolds

  • Authors:
  • Wei Fan;Dit-Yan Yeung

  • Affiliations:
  • Hong Kong University of Science and Technology;Hong Kong University of Science and Technology

  • Venue:
  • FGR '06 Proceedings of the 7th International Conference on Automatic Face and Gesture Recognition
  • Year:
  • 2006

Quantified Score

Hi-index 0.01

Visualization

Abstract

An unsupervised nonparametric approach is proposed to automatically extract representative face samples (exemplars) from a video sequence or an image set for multipleshot face recognition. Motivated by a nonlinear dimensionality reduction algorithm called Isomap, we use local neighborhood information to approximate the geodesic distances between face images. A hierarchical agglomerative clustering (HAC) algorithm is then applied to group similar faces together based on the estimated geodesic distances which approximate their locations on the appearance manifold. We define the exemplars as cluster centers for template matching at the subsequent testing stage. The final recognition is the outcome of a majority voting scheme which combines the decisions from all the individual frames in the test set. Experimental results on a 40-subject video database demonstrate the effectiveness and flexibility of our proposed method.