Mosaicing with Parallax using Time Warping

Authors:
Alex Rav-Acha;Yael Shor;Shmuel Peleg
Affiliations:
The Hebrew University of Jerusalem;The Hebrew University of Jerusalem;The Hebrew University of Jerusalem
Venue:
CVPRW '04 Proceedings of the 2004 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'04) Volume 11 - Volume 11
Year:
2004

Citing 0
Cited 6

Photographing long scenes with multi-viewpoint panoramas

ACM SIGGRAPH 2006 Papers
Rapid and Brief Communication: Image mosaicking for polyhedral scene and in particular singly visible surfaces

Pattern Recognition
Minimal Aspect Distortion (MAD) Mosaicing of Long Scenes

International Journal of Computer Vision
Mosaicing and restoration from blurred image sequence taken with moving camera

ICAPR'05 Proceedings of the Third international conference on Pattern Recognition and Image Analysis - Volume Part II
Automatic multiperspective images

EGSR'06 Proceedings of the 17th Eurographics conference on Rendering Techniques
Scene reconstruction from high spatio-angular resolution light fields

ACM Transactions on Graphics (TOG) - SIGGRAPH 2013 Conference Proceedings

Quantified Score

Hi-index	0.00

Visualization

Abstract

2D image alignment methods are applied successfully for mosaicing aerial images, but fail when the camera moves in a 3D scene.Such methods can not handle 3D parallax, resulting in distorted mosaicing.General egomotion methods are slow, and do not have the robustness of 2D alignment methods. We propose to use the x-y-t space-time volume as a tool for depth invariant mosaicing.When the camera moves on a straight line in the x direction, a y-t slice of the space-time volume is a panoramic mosaic, while a x-t slice is an EPI plane.Time warping, which is a resampling of the t axix, is used to form straight feature lines in the EPI planes.This process will simultaneously give best panoramic mosaic in the y-t slices. This approach is as robust as 2D alignment methods, while giving depth invariant motion ("ego motion").Extensions for two dimensional camera motion on a plane are also described, with applications for 2D mosaicing, and for image based rendering such as "light field".