Morphable displacement field based image matching for face recognition across pose

  • Authors:
  • Shaoxin Li;Xin Liu;Xiujuan Chai;Haihong Zhang;Shihong Lao;Shiguang Shan

  • Affiliations:
  • Institute of Computing Technology, CAS, Key Lab of Intelligent Information Processing of Chinese Academy of Sciences (CAS), Beijing, China, Graduate University of Chinese Academy of Sciences, Beij ...;Institute of Computing Technology, CAS, Key Lab of Intelligent Information Processing of Chinese Academy of Sciences (CAS), Beijing, China, Graduate University of Chinese Academy of Sciences, Beij ...;Institute of Computing Technology, CAS, Key Lab of Intelligent Information Processing of Chinese Academy of Sciences (CAS), Beijing, China;Omron Social Solutions Co., LTD., Kyoto, Japan;Omron Social Solutions Co., LTD., Kyoto, Japan;Institute of Computing Technology, CAS, Key Lab of Intelligent Information Processing of Chinese Academy of Sciences (CAS), Beijing, China

  • Venue:
  • ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part I
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

Fully automatic Face Recognition Across Pose (FRAP) is one of the most desirable techniques, however, also one of the most challenging tasks in face recognition field. Matching a pair of face images in different poses can be converted into matching their pixels corresponding to the same semantic facial point. Following this idea, given two images G and P in different poses, we propose a novel method, named Morphable Displacement Field (MDF), to match G with P's virtual view under G's pose. By formulating MDF as a convex combination of a number of template displacement fields generated from a 3D face database, our model satisfies both global conformity and local consistency. We further present an approximate but effective solution of the proposed MDF model, named implicit Morphable Displacement Field (iMDF), which synthesizes virtual view implicitly via an MDF by minimizing matching residual. This formulation not only avoids intractable optimization of the high-dimensional displacement field but also facilitates a constrained quadratic optimization. The proposed method can work well even when only 2 facial landmarks are labeled, which makes it especially suitable for fully automatic FRAP system. Extensive evaluations on FERET, PIE and Multi-PIE databases show considerable improvement over state-of-the-art FRAP algorithms in both semi-automatic and fully automatic evaluation protocols.