Optical flow guided TV-L1 video interpolation and restoration

  • Authors:

  • Manuel Werlberger;Thomas Pock;Markus Unger;Horst Bischof

  • Affiliations:

  • Institute for Computer Graphics and Vision, Graz University of Technology, Austria;Institute for Computer Graphics and Vision, Graz University of Technology, Austria;Institute for Computer Graphics and Vision, Graz University of Technology, Austria;Institute for Computer Graphics and Vision, Graz University of Technology, Austria

  • Venue:
  • EMMCVPR'11 Proceedings of the 8th international conference on Energy minimization methods in computer vision and pattern recognition
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

The ability to generate intermediate frames between two given images in a video sequence is an essential task for video restoration and video post-processing. In addition, restoration requires robust denoising algorithms, must handle corrupted frames and recover from impaired frames accordingly. In this paper we present a unified framework for all these tasks. In our approach we use a variant of the TV-L1 denoising algorithm that operates on image sequences in a space-time volume. The temporal derivative is modified to take the pixels' movement into account. In order to steer the temporal gradient in the desired direction we utilize optical flow to estimate the velocity vectors between consecutive frames. We demonstrate our approach on impaired movie sequences as well as on benchmark datasets where the ground-truth is known.