Mesh-Guided Optimized Retexturing for Image and Video

  • Authors:
  • Yanwen Guo;Hanqiu Sun;Qunsheng Peng;Zhongding Jiang

  • Affiliations:
  • -;-;-;-

  • Venue:
  • IEEE Transactions on Visualization and Computer Graphics
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper presents an approach of replacing textures of specified regions in the input image/video with new ones. The replacement results have the similar distortion and shading effects conforming to the underlying geometry and lighting conditions. For replacing textures in single image, the approach consists of two steps. First, a stretchbased mesh parametrization incorporating the recovered normal information is deduced to imitate perspective distortion of the interest region. Second, a Poisson-based refinement process is exploited to account for texture distortion at fine scale. Our approach is independent of the replaced textures. Once processing the input image is completed, any new texture can be applied efficiently. For dealing with video sequence, one key-frame based texture replacement approach is devised. The approach is generalized from image retexturing. It repeatedly propagates the replacement results of key frames to the rest ones. We develop a local motion optimization scheme to deal with the inaccuracies of optical flow when tracking moving objects. One graphcut segmentation algorithm is incorporated into the approach for handling visibility shifting. Texture drifting is alleviated with one globally optimization to smooth trajectories of the tracked points over temporal domain. Experimental results show that our approach can generate visually pleasing results for both image and video.