Appearance-based virtual view generation of temporally-varying events from multi-camera images in the 3D room

Authors:
Hideo Saito;Shigeyuki Baba;Makoto Kimura;Sundar Vedula;Takeo Kanade
Affiliations:
Robotics Institute, Carnegie Mellon University, Pittsburgh, PA;Robotics Institute, Carnegie Mellon University, Pittsburgh, PA;Robotics Institute, Carnegie Mellon University, Pittsburgh, PA;Robotics Institute, Carnegie Mellon University, Pittsburgh, PA;Robotics Institute, Carnegie Mellon University, Pittsburgh, PA
Venue:
3DIM'99 Proceedings of the 2nd international conference on 3-D digital imaging and modeling
Year:
1999

Citing 16
Cited 5

Feature-based image metamorphosis

SIGGRAPH '92 Proceedings of the 19th annual conference on Computer graphics and interactive techniques
Shape and motion from image streams under orthography: a factorization method

International Journal of Computer Vision
View interpolation for image synthesis

SIGGRAPH '93 Proceedings of the 20th annual conference on Computer graphics and interactive techniques
Modeling and rendering architecture from photographs: a hybrid geometry- and image-based approach

SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
View morphing

SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
Light field rendering

SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
The lumigraph

SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
A volumetric method for building complex models from range images

SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
Virtualized Reality: Constructing Virtual Worlds from Real Scenes

IEEE MultiMedia
A Multiple-Baseline Stereo

IEEE Transactions on Pattern Analysis and Machine Intelligence
Reliable Surface Reconstructiuon from Multiple Range Images

ECCV '96 Proceedings of the 4th European Conference on Computer Vision-Volume I - Volume I
3-D model-based tracking of humans in action: a multi-view approach

CVPR '96 Proceedings of the 1996 Conference on Computer Vision and Pattern Recognition (CVPR '96)
Rendering real-world objects using view interpolation

ICCV '95 Proceedings of the Fifth International Conference on Computer Vision
Multiple perspective interactive video

ICMCS '95 Proceedings of the International Conference on Multimedia Computing and Systems
Self-Calibration and Metric Reconstruction in spite of Varying and Unknown Internal Camera Parameters

ICCV '98 Proceedings of the Sixth International Conference on Computer Vision
Constructing Virtual Worlds Using Dense Stereo

ICCV '98 Proceedings of the Sixth International Conference on Computer Vision

Incorporating dynamic real objects into immersive virtual environments

I3D '03 Proceedings of the 2003 symposium on Interactive 3D graphics
Immersive Observation of Virtualized Soccer Match at Real Stadium Model

ISMAR '03 Proceedings of the 2nd IEEE/ACM International Symposium on Mixed and Augmented Reality
Virtual view synthesis of people from multiple view video sequences

Graphical Models - Special issue: Vision and computer graphics
Centralized and Distributed Multi-view Correspondence

International Journal of Computer Vision
The Vision System of the ACROBOTER Project

ICIRA '09 Proceedings of the 2nd International Conference on Intelligent Robotics and Applications

Quantified Score

Hi-index	0.01

Visualization

Abstract

In this paper, we present an "appearance-based" virtual view generation methodfor temporally-varying events taken by multiple cameras of the "3D Room", developed by our group. With this method, we can generate images from any virtual view point between two selected real views. The virtual appearance view generation method is based on simple interpolation between two selected views. The correspondence between the views are automatically generated from the multiple images by use of the volumetric model shape reconstruction framework. Since the correspondences are obtained by the recovered volumetric model, even occluded regions in the views can be correctly interpolated in the virtual view images. The virtual view image sequences are presented for demonstrating the performance of the virtual view image generation in the 3D Room.