Recognizing Expressions by Direct Estimation of the Parameters of a Pixel Morphable Model

  • Authors:
  • Vinay P. Kumar;Tomaso Poggio

  • Affiliations:
  • -;-

  • Venue:
  • BMCV '02 Proceedings of the Second International Workshop on Biologically Motivated Computer Vision
  • Year:
  • 2002

Quantified Score

Hi-index 0.01

Visualization

Abstract

This paper describes a method for estimating the parameters of a linear morphable model (LMM) that models mouth images. The method uses a supervised learning approach based on support vector machines (SVM) to estimate the LMM parameters directly from pixel-based representations of images of the object class (in this case mouths). This method can be used to bypass or speed up current computationally intensive methods that implement analysis by synthesis, for matching objects to morphable models. We show that the principal component axes of the flow space of the LMM correspond to easily discernible expressions such as openness, smile and pout. Therefore our method can be used to estimate the degrees of these expressions in a supervised learning framework without the need for manual annotation of a training set. We apply this to drive a cartoon character from the video of a persons face.