Video Completion by Motion Field Transfer

  • Authors:
  • Takaaki Shiratori;Yasuyuki Matsushita;Xiaoou Tang;Sing Bing Kang

  • Affiliations:
  • University of Tokyo, Japan;Microsoft Research Asia, Beijing , P.R.China;Microsoft Research Asia, Beijing , P.R.China;Microsoft Research, WA, U.S.A.

  • Venue:
  • CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

Existing methods for video completion typically rely on periodic color transitions, layer extraction, or temporally local motion. However, periodicity may be imperceptible or absent, layer extraction is difficult, and temporally local motion cannot handle large holes. This paper presents a new approach for video completion using motion field transfer to avoid such problems. Unlike prior methods, we fill in missing video parts by sampling spatio-temporal patches of local motion instead of directly sampling color. Once the local motion field has been computed within the missing parts of the video, color can then be propagated to produce a seamless hole-free video. We have validated our method on many videos spanning a variety of scenes. We can also use the same approach to perform frame interpolation using motion fields from different videos.