Real-time view synthesis from a sparse set of views

Authors:
George Chen;Yang Liu;Nelson Max
Affiliations:
SoarSpace Inc., 1103 Cowboys Pkwy, Irving, TX 75063, USA;Lawrence Livermore National Laboratory, 7000 East Avenue, Livermore, CA 94550, USA;Department of Computer Science, University of California Davis, One Shields Avenue, Davis, CA 95616, USA
Venue:
Image Communication
Year:
2007

Citing 19
Cited 0

Light field rendering

SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
The lumigraph

SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
Photorealistic Scene Reconstruction by Voxel Coloring

International Journal of Computer Vision
Dynamically reparameterized light fields

Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Plenoptic sampling

Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Image-based visual hulls

Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Multiple view geometry in computer visiond

Multiple view geometry in computer visiond
Unstructured lumigraph rendering

Proceedings of the 28th annual conference on Computer graphics and interactive techniques
A real-time distributed light field camera

EGRW '02 Proceedings of the 13th Eurographics workshop on Rendering
Generalized Multiple Baseline Stereo and Direct Virtual View Synthesis Using Range-Space Search, Match, and Render

International Journal of Computer Vision
Virtualized Reality: Constructing Virtual Worlds from Real Scenes

IEEE MultiMedia
Augmented Reality Camera Tracking with Homographies

IEEE Computer Graphics and Applications
Pose Estimation for Planar Structures

IEEE Computer Graphics and Applications
A Multiple-Baseline Stereo

IEEE Transactions on Pattern Analysis and Machine Intelligence
When Is the Shape of a Scene Unique Given Its Light-Field: A Fundamental Theorem of 3D Vision?

IEEE Transactions on Pattern Analysis and Machine Intelligence
Efficient Free Form Light Field Rendering

VMV '01 Proceedings of the Vision Modeling and Visualization Conference 2001
Plenoptic Modeling and Rendering from Image Sequences Taken by Hand-Held Camera

Mustererkennung 1999, 21. DAGM-Symposium
The Light Field Oracle

PG '02 Proceedings of the 10th Pacific Conference on Computer Graphics and Applications
High-quality video view interpolation using a layered representation

ACM SIGGRAPH 2004 Papers

Quantified Score

Hi-index	0.00

Visualization

Abstract

It is known that the pure light field approach for view synthesis relies on a large number of image samples to produce anti-aliased renderings. Otherwise, the insufficiency of image sampling needs to be compensated for by geometry sampling. Currently, geometry estimation is done either offline or using dedicated hardware. Our solution to this dilemma is based on three key ideas: a formal analysis of the equivalency between light field rendering and plane-based warping, multi focus imaging in a multi camera system by plane sweeping, and the fusion of the multi focus image using multi view stereo. The essence of our method is to perform necessary depth estimation up to the level required by the minimal joint image-geometry sampling rate using off-the-shelf graphics hardware. As a result, real-time anti-aliased light field rendering is achieved even if the image samples are insufficient.