Online video registration of dynamic scenes using frame prediction

Authors:
Alex Rav-Acha;Yael Pritch;Shmuel Peleg
Affiliations:
School of Computer Science and Engineering, The Hebrew University of Jerusalem, Jerusalem, Israel;School of Computer Science and Engineering, The Hebrew University of Jerusalem, Jerusalem, Israel;School of Computer Science and Engineering, The Hebrew University of Jerusalem, Jerusalem, Israel
Venue:
WDV'05/WDV'06/ICCV'05/ECCV'06 Proceedings of the 2005/2006 international conference on Dynamical vision
Year:
2006

Citing 12
Cited 0

Robust regression methods for computer vision: a review

International Journal of Computer Vision
Dynamic Textures

International Journal of Computer Vision
Texture Mixing and Texture Movie Synthesis Using Statistical Learning

IEEE Transactions on Visualization and Computer Graphics
Direct Recovery of Planar-Parallax from Multiple Frames

IEEE Transactions on Pattern Analysis and Machine Intelligence
Hierarchical Model-Based Motion Estimation

ECCV '92 Proceedings of the Second European Conference on Computer Vision
Summed-area tables for texture mapping

SIGGRAPH '84 Proceedings of the 11th annual conference on Computer graphics and interactive techniques
Texture Synthesis by Non-Parametric Sampling

ICCV '99 Proceedings of the International Conference on Computer Vision-Volume 2 - Volume 2
Graphcut textures: image and video synthesis using graph cuts

ACM SIGGRAPH 2003 Papers
Robust Multi-Sensor Image Alignment

ICCV '98 Proceedings of the Sixth International Conference on Computer Vision
A Unified Approach for Motion Analysis and View Synthesis

3DPVT '04 Proceedings of the 3D Data Processing, Visualization, and Transmission, 2nd International Symposium
Extracting layers and analyzing their specular properties using epipolar-plane-image analysis

Computer Vision and Image Understanding
Optical Flow Estimation and Segmentation of Multiple Moving Dynamic Textures

CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 2 - Volume 02

Quantified Score

Hi-index	0.00

Visualization

Abstract

An online approach is proposed for Video registration of dynamic scenes, such as scenes with dynamic textures, moving objects, motion parallax, etc. This approach has three steps: (i) Assume that a few frames are already registered. (ii) Using the registered frames, the next frame is predicted. (iii) A new video frame is registered to the predicted frame. Frame prediction overcomes the bias introduced by dynamics in the scene, even when dynamic objects cover the majority of the image. It can also overcome many systematic changes in intensity, and the "brightness constancy" is replaced with "dynamic constancy". This predictive online approach can also be used with motion parallax, where non uniform image motion is caused by camera translation in a 3D scene with large depth variations. In this case a method to compute the camera ego motion is described.