Manifold of Facial Expression

  • Authors:
  • Ya Chang;Changbo Hu;Matthew Turk

  • Affiliations:
  • -;-;-

  • Venue:
  • AMFG '03 Proceedings of the IEEE International Workshop on Analysis and Modeling of Faces and Gestures
  • Year:
  • 2003

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we propose the concept of Manifold ofFacial Expression based on the observation that imagesof a subject's facial expressions define a smooth manifoldin the high dimensional image space. Such a manifoldrepresentation can provide a unified framework for facialexpression analysis. We first apply Active WaveletNetworks (AWN) on the image sequences for facialfeature localization. To learn the structure of the manifoldin the feature space derived by AWN, we investigated twotypes of embeddings from a high dimensional space to alow dimensional space: locally linear embedding (LLE)and Lipschitz embedding. Our experiments show that LLEis suitable for visualizing expression manifolds. Afterapplying Lipschitz embedding, the expression manifoldcan be approximately considered as a super-sphericalsurface in the embedding space. For manifolds derivedfrom different subjects, we propose a nonlinear alignmentalgorithm that keeps the semantic similarity of facialexpression from different subjects on one generalizedmanifold. We also show that nonlinear alignmentoutperforms linear alignment in expression classification.