Methods for Volumetric Reconstruction of Visual Scenes

Authors:
Gregory G. Slabaugh;W. Bruce Culbertson;Thomas Malzbender;Mark R. Stevens;Ronald W. Schafer
Affiliations:
Intelligent Vision and Reasoning Department, Siemens Corporate Research, Princeton, NJ 08540, USA. greg.slabaugh@scr.siemens.com;Visual Computing Department, Hewlett-Packard Laboratories, Palo Alto, CA 94304, USA. bruce_culbertson@hp.com;Visual Computing Department, Hewlett-Packard Laboratories, Palo Alto, CA 94304, USA. tom_malzbender@hp.com;Charles River Analytics Inc., Cambridge, MA 02138, USA. mstevens@cra.com;Center for Signal and Image Processing, Georgia Institute of Technology, Atlanta, GA 30318, USA. rws@ece.gatech.edu
Venue:
International Journal of Computer Vision
Year:
2004

Citing 30
Cited 18

Environment mapping and other applications of world projections

IEEE Computer Graphics and Applications
Rapid octree construction from image sequences

CVGIP: Image Understanding
Object-centered surface reconstruction: combining multi-image stereo and shading

International Journal of Computer Vision
Plenoptic modeling: an image-based rendering system

SIGGRAPH '95 Proceedings of the 22nd annual conference on Computer graphics and interactive techniques
Modeling and rendering architecture from photographs: a hybrid geometry- and image-based approach

SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
Light field rendering

SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
The lumigraph

SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
Hierarchical rendering of trees from precomputed multi-layer z-buffers

Proceedings of the eurographics workshop on Rendering techniques '96
Layered depth images

Proceedings of the 25th annual conference on Computer graphics and interactive techniques
Photorealistic Scene Reconstruction by Voxel Coloring

International Journal of Computer Vision
Surfels: surface elements as rendering primitives

Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Image-based visual hulls

Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Improved Computational Methods for Ray Tracing

ACM Transactions on Graphics (TOG)
Texture and reflection in computer generated images

Communications of the ACM
A Theory of Shape by Space Carving

International Journal of Computer Vision - Special issue on Genomic Signal Processing
The Visual Hull Concept for Silhouette-Based Image Understanding

IEEE Transactions on Pattern Analysis and Machine Intelligence
3D Model Acquisition from Extended Image Sequences

ECCV '96 Proceedings of the 4th European Conference on Computer Vision-Volume II - Volume II
A Probabilistic Theory of Occupancy and Emptiness

ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part III
Volumetric Warping for Voxel Coloring on an Infinite Domain

SMILE '00 Revised Papers from Second European Workshop on 3D Structure from Multiple Images of Large-Scale Environments
Interactive Construction of 3D Models from Panoramic Mosaics

CVPR '98 Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
A Histogram-Based Color Consistency Test for Voxel Coloring

ICPR '02 Proceedings of the 16 th International Conference on Pattern Recognition (ICPR'02) Volume 4 - Volume 4
Reasoning about object appearance in the context of a scene (computer vision)

Reasoning about object appearance in the context of a scene (computer vision)
Novel volumetric scene reconstruction methods for new view synthesis

Novel volumetric scene reconstruction methods for new view synthesis
Stereo Matching with Transparency and Matting

ICCV '98 Proceedings of the Sixth International Conference on Computer Vision
Constructing Virtual Worlds Using Dense Stereo

ICCV '98 Proceedings of the Sixth International Conference on Computer Vision
Multi-hypothesis, volumetric reconstruction of 3-D objects from multiple calibrated camera views

ICASSP '99 Proceedings of the Acoustics, Speech, and Signal Processing, 1999. on 1999 IEEE International Conference - Volume 06
Hand-held acquisition of 3D models with a video camera

3DIM'99 Proceedings of the 2nd international conference on 3-D digital imaging and modeling
Variational principles, surface evolution, PDEs, level set methods, and the stereo problem

IEEE Transactions on Image Processing
Automatic reconstruction of stationary 3-D objects from multiple uncalibrated camera views

IEEE Transactions on Circuits and Systems for Video Technology
A survey of methods for volumetric scene reconstruction from photographs

VG'01 Proceedings of the 2001 Eurographics conference on Volume Graphics

MultiView: spatially faithful group video conferencing

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Real-Time 3D Human Capture System for Mixed-Reality Art and Entertainment

IEEE Transactions on Visualization and Computer Graphics
Appearance-Cloning: Photo-Consistent Scene Recovery from Multi-View Images

International Journal of Computer Vision
3D Reconstruction by Shadow Carving: Theory and Practical Evaluation

International Journal of Computer Vision
Efficient multi-viewpoint acquisition of 3D objects undergoing repetitive motions

Proceedings of the 2007 symposium on Interactive 3D graphics and games
Shape from silhouettes based on a centripetal pentahedron model

Graphical Models
Modulating the shape and size of backprojection surfaces to improve accuracy in volumetric stereo

EURASIP Journal on Applied Signal Processing - 3DTV: Capture, Transmission, and Display of 3D Video
Real-Time Space Carving Using Graphics Hardware

IEICE - Transactions on Information and Systems
Space Carving Acceleration Using Uncertainty Measurements

IbPRIA '09 Proceedings of the 4th Iberian Conference on Pattern Recognition and Image Analysis
Multi-view Occlusion Reasoning for Probabilistic Silhouette-Based Dynamic Scene Reconstruction

International Journal of Computer Vision
3D scans of as-built street scenes for virtual environments

Proceedings of the 2011 Symposium on Simulation for Architecture and Urban Design
View synthesis of scenes with multiple independently translating objects from uncalibrated views

ACCV'06 Proceedings of the 7th Asian conference on Computer Vision - Volume Part I
Interactive 3-d modeling system using a hand-held video camera

SCIA'05 Proceedings of the 14th Scandinavian conference on Image Analysis
Surface reconstruction from images using a variational formulation

MMM'10 Proceedings of the 16th international conference on Advances in Multimedia Modeling
Embedded Voxel Colouring with Adaptive Threshold Selection Using Globally Minimal Surfaces

International Journal of Computer Vision
Reconstruction of volumetric surface textures for real-time rendering

EGSR'06 Proceedings of the 17th Eurographics conference on Rendering Techniques
Rapid synchronous acquisition of geometry and appearance of cultural heritage artefacts

VAST'05 Proceedings of the 6th International conference on Virtual Reality, Archaeology and Intelligent Cultural Heritage
3D modeling of multiple-object scenes from sets of images

Pattern Recognition

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we present methods for 3D volumetric reconstruction of visual scenes photographed by multiple calibrated cameras placed at arbitrary viewpoints. Our goal is to generate a 3D model that can be rendered to synthesize new photo-realistic views of the scene. We improve upon existing voxel coloring/space carving approaches by introducing new ways to compute visibility and photo-consistency, as well as model infinitely large scenes. In particular, we describe a visibility approach that uses all possible color information from the photographs during reconstruction, photo-consistency measures that are more robust and/or require less manual intervention, and a volumetric warping method for application of these reconstruction methods to large-scale scenes.