Improving spatiotemporal inpainting with layer appearance models

  • Authors:
  • Thommen Korah;Christopher Rasmussen

  • Affiliations:
  • Dept. Computer and Information Sciences, University of Delaware, Newark, DE;Dept. Computer and Information Sciences, University of Delaware, Newark, DE

  • Venue:
  • ISVC'06 Proceedings of the Second international conference on Advances in Visual Computing - Volume Part II
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

The problem of removing blemishes in mosaics of building facades caused by foreground objects such as trees may be framed in terms of inpainting. Affected regions are first automatically segmented and then inpainted away using a combination of cues from unoccluded, temporally adjacent views of the same building patch, as well as surrounding unoccluded patches in the same frame. Discriminating the building layer from those containing foreground features is most directly accomplished through parallax due to camera motion over the sequence. However, the intricacy of tree silhouettes often complicates accurate motion-based segmentation, especially along their narrower branches. In this work we describe methods for automatically training appearance-based classifiers from a coarse motion-based segmentation to recognize foreground patches in static imagery and thereby improve the quality of the final mosaic. A local technique for photometric adjustment of inpainted patches which compensates for exposure variations between frames is also discussed.