Patch-based spatio-temporal super-resolution for video with non-rigid motion

Authors:
Jordi Salvador;Axel Kochale;Siegfried Schweidler
Affiliations:
Image Processing Lab, Technicolor R&I, Karl-Wiechert-Allee 74, 30625 Hannover, Germany;Image Processing Lab, Technicolor R&I, Karl-Wiechert-Allee 74, 30625 Hannover, Germany;Image Processing Lab, Technicolor R&I, Karl-Wiechert-Allee 74, 30625 Hannover, Germany
Venue:
Image Communication
Year:
2013

Citing 12
Cited 1

Programs for Digital Signal Processing

Programs for Digital Signal Processing
Example-Based Super-Resolution

IEEE Computer Graphics and Applications
Fundamental Limits of Reconstruction-Based Superresolution Algorithms under Local Translation

IEEE Transactions on Pattern Analysis and Machine Intelligence
Space-Time Super-Resolution

IEEE Transactions on Pattern Analysis and Machine Intelligence
Matching by Linear Programming and Successive Convexification

IEEE Transactions on Pattern Analysis and Machine Intelligence
Image upsampling via imposed edge statistics

ACM SIGGRAPH 2007 papers
Super-resolution without explicit subpixel motion estimation

IEEE Transactions on Image Processing
Photo zoom: high resolution from unordered image collections

Proceedings of Graphics Interface 2010
Image and video upscaling from local self-examples

ACM Transactions on Graphics (TOG)
A Database and Evaluation Methodology for Optical Flow

International Journal of Computer Vision
Space-time super-resolution from a single video

CVPR '11 Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition
Image quality assessment: from error visibility to structural similarity

IEEE Transactions on Image Processing

Enhancing dynamic videos for surveillance and robotic applications: The robust bilateral and temporal filter

Image Communication

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents a novel approach for spatio-temporal video super-resolution. Whereas the task of synthesizing high-frequency information on the spatial domain can be accomplished without introducing arbitrary priors on the image model (beyond the assumption of local cross-scale self-similarity), the high degree of temporal aliasing in standard-frame-rate video requires applying motion compensation in order to correctly interpolate the video sequence along the temporal axis. As the experimental results show, the proposed technique is capable of augmenting both the frame-rate of a video sequence (by any real up-converting factor) and its effective spatial resolution (by any rational magnification factor). The presented method is suitable for parallelized computing environments, such as GPUs, and provides an output quality comparable to state-of-the-art methods in both temporal interpolation and spatial super-resolution.