Reconstructing a whole face image from a partially damaged or occluded image by multiple matching

  • Authors:
  • Bon-Woo Hwang;Seong-Whan Lee

  • Affiliations:
  • The Robotics Institute, Carnegie Mellon University, Pittsburgh, PA;Center for Artificial Vision Research, Korea University, Seoul, Korea

  • Venue:
  • ICB'07 Proceedings of the 2007 international conference on Advances in Biometrics
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

The problem we address in this paper is, given a facial image that is partially occluded or damaged by noise, to reconstruct a whole face. A key process for the reconstruction is to obtain the correspondences between the input image and the reference face. We present a method that matches an input image with multiple example images that are generated from a morphable face model. From the matched feature points, shape and texture of the full face are inferred by the non-iterative data completion algorithm. Compared with single matching with the particular "reference face", this multiple matching method increases the robustness of the matching. The experimental results of applying the algorithm to face images that are contaminated by Gaussian noise and those which are partially occluded show that the reconstructed faces are plausible and similar to the original ones.