A Statistical Method for 2-D Facial Landmarking

  • Authors:
  • Hamdi Dibeklioglu;Albert Ali Salah;Theo Gevers

  • Affiliations:
  • Intelligent Systems Laboratorium Amsterdam, Informatics Institute, University of Amsterdam, XH Amsterdam, The Netherlands;Department of Computer Engineering, Boğaziçi University, Bebek, Turkey;Intelligent Systems Laboratorium Amsterdam, Informatics Institute, University of Amsterdam, XH Amsterdam, The Netherlands

  • Venue:
  • IEEE Transactions on Image Processing
  • Year:
  • 2012

Quantified Score

Hi-index 0.01

Visualization

Abstract

Many facial-analysis approaches rely on robust and accurate automatic facial landmarking to correctly function. In this paper, we describe a statistical method for automatic facial-landmark localization. Our landmarking relies on a parsimonious mixture model of Gabor wavelet features, computed in coarse-to-fine fashion and complemented with a shape prior. We assess the accuracy and the robustness of the proposed approach in extensive cross-database conditions conducted on four face data sets (Face Recognition Grand Challenge, Cohn–Kanade, Bosphorus, and BioID). Our method has 99.33% accuracy on the Bosphorus database and 97.62% accuracy on the BioID database on the average, which improves the state of the art. We show that the method is not significantly affected by low-resolution images, small rotations, facial expressions, and natural occlusions such as beard and mustache. We further test the goodness of the landmarks in a facial expression recognition application and report landmarking-induced improvement over baseline on two separate databases for video-based expression recognition (Cohn–Kanade and BU-4DFE).