Bilinear kernel reduced rank regression for facial expression synthesis

  • Authors:
  • Dong Huang;Fernando De la Torre

  • Affiliations:
  • Robotics Institute, Carnegie Mellon University, Pittsburgh, Pennsylvania;Robotics Institute, Carnegie Mellon University, Pittsburgh, Pennsylvania

  • Venue:
  • ECCV'10 Proceedings of the 11th European conference on Computer vision: Part II
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

In the last few years, Facial Expression Synthesis (FES) has been a flourishing area of research driven by applications in character animation, computer games, and human computer interaction. This paper proposes a photorealistic FES method based on Bilinear Kernel Reduced Rank Regression (BKRRR). BKRRR learns a high-dimensional mapping between the appearance of a neutral face and a variety of expressions (e.g. smile, surprise, squint). There are two main contributions in this paper: (1) Propose BKRRR for FES. Several algorithms for learning the parameters of BKRRR are evaluated. (2) Propose a new method to preserve subtle person-specific facial characteristics (e.g. wrinkles, pimples). Experimental results on the CMUMulti-PIE database and pictures taken with a regular camera show the effectiveness of our approach.