Video synchronization and its application to object transfer

Authors:
Xiaochun Cao;Lin Wu;Jiangjian Xiao;Hassan Foroosh;Jigui Zhu;Xiaohong Li
Affiliations:
School of Computer Science and Technology, Tianjin University, Tianjin, China;School of Computer Science and Technology, Tianjin University, Tianjin, China;Sarnoff Corporation, Princeton, NJ 08540, USA;Computational Imaging Lab, University of Central Florida, Orlando, FL 32816, USA;State Key Laboratory of Precision Measuring Technology and Instruments, Tianjin University, Tianjin, China;School of Computer Science and Technology, Tianjin University, Tianjin, China
Venue:
Image and Vision Computing
Year:
2010

Citing 20
Cited 2

Automatic partitioning of full-motion video

Multimedia Systems
Iterative point matching for registration of free-form curves and surfaces

International Journal of Computer Vision
A Flexible New Technique for Camera Calibration

IEEE Transactions on Pattern Analysis and Machine Intelligence
Multiple view geometry in computer visiond

Multiple view geometry in computer visiond
Video matting of complex scenes

Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Bayesian Model Estimation and Selection for Epipolar Geometry and Generic Manifold Fitting

International Journal of Computer Vision
Sequence-to-Sequence Self Calibration

ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part II
Evolutionary Based Autocalibration from the Fundamental Matrix

Proceedings of the Applications of Evolutionary Computing on EvoWorkshops 2002: EvoCOP, EvoIASP, EvoSTIM/EvoPLAN
Synthesis and Recognition of Biological Motion Patterns Based on Linear Superposition of Prototypical Motion Sequences

MVIEW '99 Proceedings of the IEEE Workshop on Multi-View Modeling & Analysis of Visual Scenes
Shadow matting and compositing

ACM SIGGRAPH 2003 Papers
View-invariant Alignment and Matching of Video Sequences

ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
An Efficient Solution to the Five-Point Relative Pose Problem

IEEE Transactions on Pattern Analysis and Machine Intelligence
Distinctive Image Features from Scale-Invariant Keypoints

International Journal of Computer Vision
Video matching

ACM SIGGRAPH 2004 Papers
Temporal Synchronization of Video Sequences in Theory and in Practice

WACV-MOTION '05 Proceedings of the IEEE Workshop on Motion and Video Computing (WACV/MOTION'05) - Volume 2 - Volume 02
Periodic Motion Detection and Segmentation via Approximate Sequence Alignment

ICCV '05 Proceedings of the Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 - Volume 01
3D Object Transfer Between Non-Overlapping Videos

VR '06 Proceedings of the IEEE conference on Virtual Reality
Projective rectification from the fundamental matrix

Image and Vision Computing
The viewing graph

CVPR'03 Proceedings of the 2003 IEEE computer society conference on Computer vision and pattern recognition
A unified approach to shot change detection and camera motion characterization

IEEE Transactions on Circuits and Systems for Video Technology

Temporal synchronization of non-overlapping videos using known object motion

Pattern Recognition Letters
Video synchronization based on events alignment

Pattern Recognition Letters

Quantified Score

Hi-index	0.00

Visualization

Abstract

In video post-production applications, camera motion analysis and alignment are important in order to ensure the geometric correctness and temporal consistency. In this paper, we trade some generality in estimating and aligning camera motion for reduced computational complexity and increased image-based nature. The main contribution is to use fundamental ratios to synchronize video sequences of distinct scenes captured by cameras undergoing similar motions. We also present a simple method to align 3D camera trajectories when the fundamental ratios are not able to match the noisy trajectories. Experimental results show that our method can accurately synchronize sequences even when the scenes are totally different and have dense depths. An application on 3D object transfer is also demonstrated.