Face Hallucination: Theory and Practice

  • Authors:
  • Ce Liu;Heung-Yeung Shum;William T. Freeman

  • Affiliations:
  • Computer Science and Artificial Intelligence Lab, Massachusetts Institute of Technology, Massachusetts, USA;Microsoft Research Asia, Beijing, China;Computer Science and Artificial Intelligence Lab, Massachusetts Institute of Technology, Massachusetts, USA

  • Venue:
  • International Journal of Computer Vision
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we study face hallucination, or synthesizing a high-resolution face image from an input low-resolution image, with the help of a large collection of other high-resolution face images. Our theoretical contribution is a two-step statistical modeling approach that integrates both a global parametric model and a local nonparametric model. At the first step, we derive a global linear model to learn the relationship between the high-resolution face images and their smoothed and down-sampled lower resolution ones. At the second step, we model the residue between an original high-resolution image and the reconstructed high-resolution image after applying the learned linear model by a patch-based non-parametric Markov network to capture the high-frequency content. By integrating both global and local models, we can generate photorealistic face images. A practical contribution is a robust warping algorithm to align the low-resolution face images to obtain good hallucination results. The effectiveness of our approach is demonstrated by extensive experiments generating high-quality hallucinated face images from low-resolution input with no manual alignment.