TILT: transform invariant low-rank textures

  • Authors:

  • Zhengdong Zhang;Xiao Liang;Arvind Ganesh;Yi Ma

  • Affiliations:

  • Microsoft Research Asia, Beijing;Microsoft Research Asia, Beijing;Coordinated Science Lab, University of Illinois at Urbana-Champaign;Microsoft Research Asia, Beijing and Coordinated Science Lab, University of Illinois at Urbana-Champaign

  • Venue:
  • ACCV'10 Proceedings of the 10th Asian conference on Computer vision - Volume Part III
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we show how to efficiently and effectively extract a rich class of low-rank textures in a 3D scene from 2D images despite significant distortion and warping. The low-rank textures capture geometrically meaningful structures in an image, which encompass conventional local features such as edges and corners as well as all kinds of regular, symmetric patterns ubiquitous in urban environments and manmade objects. Our approach to finding these low-rank textures leverages the recent breakthroughs in convex optimization that enable robust recovery of a high-dimensional low-rank matrix despite gross sparse errors. In the case of planar regions with significant projective deformation, our method can accurately recover both the intrinsic low-rank texture and the precise domain transformation. Extensive experimental results demonstrate that this new technique works effectively for many nearregular patterns or objects that are approximately low-rank, such as human faces and text.