The fast and the flexible: extended pseudo two-dimensional warping for face recognition

  • Authors:
  • Leonid Pishchulin;Tobias Gass;Philippe Dreuw;Hermann Ney

  • Affiliations:
  • Computer Vision and Multimodal Computing, MPI Informatics, Saarbruecken and Human Language Technology and Pattern Recognition Group, RWTH Aachen University;Computer Vision Laboratory ETH Zurich and Human Language Technology and Pattern Recognition Group, RWTH Aachen University;Human Language Technology and Pattern Recognition Group, RWTH Aachen University;Human Language Technology and Pattern Recognition Group, RWTH Aachen University

  • Venue:
  • IbPRIA'11 Proceedings of the 5th Iberian conference on Pattern recognition and image analysis
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this work, we propose a novel extension of pseudo 2D image warping (P2DW) which allows for joint alignment and recognition of non-rectified face images. P2DW allows for optimal displacement inference in a simplified setting, but cannot cope with stronger deformations since it is restricted to column-to-column mapping. We propose to implement additional flexibility in P2DW by allowing deviations from column centers while preserving vertical structural dependencies between neighboring pixel coordinates. In order to speed up the recognition we employ hard spacial constraints on candidate alignment positions. Experiments on two well-known face datasets show that our algorithm significantly improves the recognition quality under difficult variability such as 3D rotation (poses), expressions and illuminations, and can reliably classify even automatically detected faces. We also show an improvement over state-of-the-art results while keeping computational complexity low.