3DTV view generation using uncalibrated pure rotating and zooming cameras

Authors:
Songkran Jarusirisawad;Hideo Saito
Affiliations:
Department of Information and Computer Science, Keio University, 3-14-1 Hiyoshi, Kohoku-ku, Yokohama 223-8522, Japan;Department of Information and Computer Science, Keio University, 3-14-1 Hiyoshi, Kohoku-ku, Yokohama 223-8522, Japan
Venue:
Image Communication
Year:
2009

Citing 20
Cited 3

Marching cubes: A high resolution 3D surface construction algorithm

SIGGRAPH '87 Proceedings of the 14th annual conference on Computer graphics and interactive techniques
Feature-based image metamorphosis

SIGGRAPH '92 Proceedings of the 19th annual conference on Computer graphics and interactive techniques
View interpolation for image synthesis

SIGGRAPH '93 Proceedings of the 20th annual conference on Computer graphics and interactive techniques
Image-based visual hulls

Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography

Communications of the ACM
Virtual View Generation for 3D Digital Video

IEEE MultiMedia
A Multiple-Baseline Stereo

IEEE Transactions on Pattern Analysis and Machine Intelligence
The Visual Hull Concept for Silhouette-Based Image Understanding

IEEE Transactions on Pattern Analysis and Machine Intelligence
Physically-Valid View Synthesis by Image Interplation

VSR '95 Proceedings of the IEEE Workshop on Representation of Visual Scenes
Virtualized reality: concepts and early results

VSR '95 Proceedings of the IEEE Workshop on Representation of Visual Scenes
Marker Tracking and HMD Calibration for a Video-Based Augmented Reality Conferencing System

IWAR '99 Proceedings of the 2nd IEEE and ACM International Workshop on Augmented Reality
Multiple View Geometry in Computer Vision

Multiple View Geometry in Computer Vision
Free-viewpoint video of human actors

ACM SIGGRAPH 2003 Papers
Visual Modeling with a Hand-Held Camera

International Journal of Computer Vision
Distinctive Image Features from Scale-Invariant Keypoints

International Journal of Computer Vision
A self-reconfigurable camera array

SIGGRAPH '04 ACM SIGGRAPH 2004 Sketches
Evaluation of Features Detectors and Descriptors based on 3D Objects

International Journal of Computer Vision
Appearance-based virtual view generation from multicamera videos captured in the 3-D room

IEEE Transactions on Multimedia
Automatic reconstruction of stationary 3-D objects from multiple uncalibrated camera views

IEEE Transactions on Circuits and Systems for Video Technology
A combined studio production system for 3-D capturing of live action and immersive actor feedback

IEEE Transactions on Circuits and Systems for Video Technology

Real-time video-based rendering from uncalibrated cameras using plane-sweep algorithm

Journal of Visual Communication and Image Representation
Collaborative color calibration for multi-camera systems

Image Communication
Safe polyhedral visual hulls

MMM'10 Proceedings of the 16th international conference on Advances in Multimedia Modeling

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper proposes a novel method for synthesizing free viewpoint video captured by uncalibrated pure rotating and zooming cameras. Neither intrinsic nor extrinsic parameters of our cameras are known. Projective grid space (PGS), which is the 3D space defined by the epipolar geometry of two basis cameras, is employed for weak camera calibration. Trifocal tensors are used to relate non-basis cameras to PGS. Given trifocal tensors in the initial frame, our method automatically computes trifocal tensors in the other frames. Scale invariant feature transform (SIFT) is used for finding corresponding points in a natural scene between the initial frame and the other frames. Finally, free viewpoint video is synthesized based on the reconstructed visual hull. In the experimental results, free viewpoint video captured by uncalibrated hand-held cameras is successfully synthesized using the proposed method.