Models for patch-based image restoration

  • Authors:
  • Mithun Das Gupta;Shyamsundar Rajaram;Nemanja Petrovic;Thomas S. Huang

  • Affiliations:
  • Beckman Institute, Department of Electrical and Computer Engineering, University of Illinois at Urbana-Champaign, IL;Beckman Institute, Department of Electrical and Computer Engineering, University of Illinois at Urbana-Champaign, IL;Google Inc., NY;Beckman Institute, Department of Electrical and Computer Engineering, University of Illinois at Urbana-Champaign, IL

  • Venue:
  • Journal on Image and Video Processing - Special issue on patches in vision
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

We present a supervised learning approach for object-category specific restoration, recognition, and segmentation of images which are blurred using an unknown kernel. The novelty of this work is a multilayer graphical model which unifies the low-level vision task of restoration and the high-level vision task of recognition in a cooperative framework. The graphical model is an interconnected two-layer Markov random field. The restoration layer accounts for the compatibility between sharp and blurred images and models the association between adjacent patches in the sharp image. The recognition layer encodes the entity class and its location in the underlying scene. The potentials are represented using nonparametric kernel densities and are learnt from training data. Inference is performed using nonparametric belief propagation. Experiments demonstrate the effectiveness of our model for the restoration and recognition of blurred license plates as well as face images.