Temporally consistent gradient domain video editing

  • Authors:
  • Gabriele Facciolo;Rida Sadek;Aurélie Bugeau;Vicent Caselles

  • Affiliations:
  • DTIC, Universitat Pompeu Fabra, Barcelona, Spain;DTIC, Universitat Pompeu Fabra, Barcelona, Spain;LaBRI, Université Bordeaux 1, Talence, France;DTIC, Universitat Pompeu Fabra, Barcelona, Spain

  • Venue:
  • EMMCVPR'11 Proceedings of the 8th international conference on Energy minimization methods in computer vision and pattern recognition
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

In the context of video editing, enforcing spatio-temporal consistency is an important issue. With that purpose, the current variational models for gradient domain video editing include space and time regularization terms. The spatial terms are based on the usual space derivatives, the temporal ones are based on the convective derivative, and both are balanced by a parameter ß. However, the usual discretizations of the convective derivative limit the value of ß to a certain range, thus limiting these models from achieving their full potential. In this paper, we propose a new numerical scheme to compute the convective derivative, the deblurring convective derivative, which allows us to lift this constraint. Moreover, the proposed scheme introduces less errors than other discretization schemes without adding computational complexity. We use this scheme in the implementation of two gradient domain models for temporally consistent video editing, based on Poisson and total variation type formulations, respectively. We apply these models to three video editing tasks: inpainting correction, object insertion and object removal.