Regression based automatic face annotation for deformable model building

  • Authors:
  • Akshay Asthana;Simon Lucey;Roland Goecke

  • Affiliations:
  • Research School of Engineering, College of Engineering and Computer Science, Australian National University, Canberra, Australia;Information Communication Technology (ICT) Centre, Commonwealth Scientific and Industrial Research Organisation (CSIRO), Sydney, Australia;Vision and Sensing Group, Faculty of Information Sciences and Engineering, University of Canberra, Australia and Research School of Computer Science, College of Engineering and Computer Science, A ...

  • Venue:
  • Pattern Recognition
  • Year:
  • 2011

Quantified Score

Hi-index 0.01

Visualization

Abstract

A major drawback of statistical models of non-rigid, deformable objects, such as the active appearance model (AAM), is the required pseudo-dense annotation of landmark points for every training image. We propose a regression-based approach for automatic annotation of face images at arbitrary pose and expression, and for deformable model building using only the annotated frontal images. We pose the problem of learning the pattern of manual annotation as a data-driven regression problem and explore several regression strategies to effectively predict the spatial arrangement of the landmark points for unseen face images, with arbitrary expression, at arbitrary poses. We show that the proposed fully sparse non-linear regression approach outperforms other regression strategies by effectively modelling the changes in the shape of the face under varying pose and is capable of capturing the subtleties of different facial expressions at the same time, thus, ensuring the high quality of the generated synthetic images. We show the generalisability of the proposed approach by automatically annotating the face images from four different databases and verifying the results by comparing them with a ground truth obtained from manual annotations.