Image super-resolution by textural context constrained visual vocabulary

  • Authors:
  • Yan Liang;Pong C. Yuen;Jian-Huang Lai

  • Affiliations:
  • School of Mathematics and Computational Science, Sun Yat-sen University, Guangzhou, China and Department of Computer Science, Hong Kong Baptist University, 224 Waterloo Road, Kowloon, Hong Kong, C ...;Department of Computer Science, Hong Kong Baptist University, 224 Waterloo Road, Kowloon, Hong Kong, China;School of Information Science and Technology, Sun Yat-sen University, Guangzhou, China

  • Venue:
  • Image Communication
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

Example-based super-resolution (SR) approach hallucinates the missing high-resolution (HR) details by learning the example image patches. This approach implicitly assumes that the similarity of the low-resolution (LR) patches can infer the similarity of the corresponding HR patches. However, this similarity preserving assumption may not be held in practice. Thus the example-based super-resolved image inevitably contains artifacts not close to the ground truth. In this paper, we propose a novel single-image SR method by integrating an enforced similarity preserving process by using visual vocabulary into example-based SR approach. By jointly learning the HR and LR visual vocabularies, we can obtain a geometric co-occurrence prior to make the geometric similarity preserved within each visual word. We further propose a two-step framework for SR. The first step estimates the optimum visual word using textural context cue while the second step enforces the visual word subspace constraint and reconstruction constraint for estimating the final result. Experiments demonstrate the effectiveness of our method for recovering the missing HR details, especially texture.