Temporal super resolution from a single quasi-periodic image sequence based on phase registration

Authors:
Yasushi Makihara;Atsushi Mori;Yasushi Yagi
Affiliations:
Osaka University, Ibaraki, Osaka, Japan;Osaka University, Ibaraki, Osaka, Japan;Osaka University, Ibaraki, Osaka, Japan
Venue:
ACCV'10 Proceedings of the 10th Asian conference on Computer vision - Volume Part I
Year:
2010

Citing 13
Cited 0

Improving resolution by image registration

CVGIP: Graphical Models and Image Processing
Estimation of Planar Curves, Surfaces, and Nonplanar Space Curves Defined by Implicit Equations with Applications to Edge and Range Image Segmentation

IEEE Transactions on Pattern Analysis and Machine Intelligence
Video Processing and Communications

Video Processing and Communications
Example-Based Super-Resolution

IEEE Computer Graphics and Applications
Limits on Super-Resolution and How to Break Them

IEEE Transactions on Pattern Analysis and Machine Intelligence
Spatio-Temporal Alignment of Sequences

IEEE Transactions on Pattern Analysis and Machine Intelligence
Motion Deblurring and Super-resolution from an Image Sequence

ECCV '96 Proceedings of the 4th European Conference on Computer Vision-Volume II - Volume II
Space-Time Super-Resolution

IEEE Transactions on Pattern Analysis and Machine Intelligence
Ellipse Fitting with Hyperaccuracy

IEICE - Transactions on Information and Systems
Image morphing for space-time interpolation

ACM SIGGRAPH 2007 sketches
An iterative image registration technique with an application to stereo vision

IJCAI'81 Proceedings of the 7th international joint conference on Artificial intelligence - Volume 2
Video synthesis with high spatio-temporal resolution using spectral fusion

MRCS'06 Proceedings of the 2006 international conference on Multimedia Content Representation, Classification and Security
Superresolution video reconstruction with arbitrary sampling lattices and nonzero aperture time

IEEE Transactions on Image Processing

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper describes a method for temporal super resolution from a single quasi-periodic image sequence. A so-called reconstruction-based method is applied to construct a one period image sequence with high frame-rate based on phase registration data in sub-frame order among multiple periods of the image sequence. First, the periodic image sequence to be reconstructed is expressed as a manifold in the parametric eigenspace of the phase. Given an input image sequence, phase registration and manifold reconstruction are alternately executed iteratively within an energy minimization framework that considers data fitness and the smoothness of both the manifold and the phase evolution. The energy minimization problem is solved through three-step coarse-to-fine procedures to avoid local minima. The experiments using both simulated and real data confirm the realization of temporal super resolution from a single image sequence.