Spatial-temporal motion compensation based video super resolution

Authors:
Yaozu An;Yao Lu;Ziye Yan
Affiliations:
Beijing Laboratory of Intelligent Information Technology, School of Computer Science and Technology,Beijing Institute of Technology, Beijing, China;Beijing Laboratory of Intelligent Information Technology, School of Computer Science and Technology,Beijing Institute of Technology, Beijing, China;Beijing Laboratory of Intelligent Information Technology, School of Computer Science and Technology,Beijing Institute of Technology, Beijing, China
Venue:
ACCV'10 Proceedings of the 10th Asian conference on Computer vision - Volume Part II
Year:
2010

Citing 8
Cited 0

A Non-Local Algorithm for Image Denoising

CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 2 - Volume 02
Noisy video super-resolution

MM '08 Proceedings of the 16th ACM international conference on Multimedia
Region-based weighted-norm approach to video super-resolution with adaptive regularization

ICASSP '09 Proceedings of the 2009 IEEE International Conference on Acoustics, Speech and Signal Processing
Video Super Resolution Using Duality Based TV-L1 Optical Flow

Proceedings of the 31st DAGM Symposium on Pattern Recognition
A duality based approach for realtime TV-L1 optical flow

Proceedings of the 29th DAGM conference on Pattern recognition
Nonlocal back-projection for adaptive image enlargement

ICIP'09 Proceedings of the 16th IEEE international conference on Image processing
New motion compensation model VIA frequency classification for fast video super-resolution

ICIP'09 Proceedings of the 16th IEEE international conference on Image processing
Extraction of high-resolution frames from video sequences

IEEE Transactions on Image Processing

Quantified Score

Hi-index	0.00

Visualization

Abstract

Due to the arbitrary motion patterns in practical video, annoying artifacts cased by the registration error often appears in the super resolution outcome. This paper proposes a spatial-temporal motion compensation based super resolution fusion method (STMC) for video after explicit motion estimation between a few neighboring frames. We first register the neighboring low resolution frames to proper positions in the high resolution frame, and then use the registered low resolution information as non-local redundancy to compensate the surrounding positions which have no or a few registered low resolution pixels. Experimental results indicate the proposed method can effectively reduce the artifacts cased by the motion estimation error with obvious performance improvement in both PSNR and visual effect.