Light-Field Rendering Using Colored Point Clouds---A Dual-Space Approach

Authors:
Christian Hofsetz;George Chen;Nelson Max;Kim C. Ng;Yang Liu;Li Hong;Peter McGuinness
Affiliations:
Visualization and Graphics Group, Department of Computer Science, University of California at Davis, Davis, CA 95616 USA and Universidade do Vale do Rio dos Sinos Ciencias Exatas e Tecnologicas, R ...;Human-Computer Interface Laboratory, Advanced System Technology, STMicroelectronics, San Diego, CA 92121 USA;Visualization and Graphics Group, Department of Computer Science, University of California at Davis, Davis, CA 95616 USA;Human-Computer Interface Laboratory, Advanced System Technology, STMicroelectronics, San Diego, CA 92121 USA;Visualization and Graphics Group, Department of Computer Science, University of California at Davis, Davis, CA 95616 USA;-;Human-Computer Interface Laboratory, Advanced System Technology, STMicroelectronics, San Diego, CA 92121 USA
Venue:
Presence: Teleoperators and Virtual Environments
Year:
2004

Citing 18
Cited 1

Plenoptic modeling: an image-based rendering system

SIGGRAPH '95 Proceedings of the 22nd annual conference on Computer graphics and interactive techniques
Modeling and rendering architecture from photographs: a hybrid geometry- and image-based approach

SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
Light field rendering

SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
The lumigraph

SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
Image synthesis from a sparse set of views

VIS '97 Proceedings of the 8th conference on Visualization '97
An image-based approach to three-dimensional computer graphics

An image-based approach to three-dimensional computer graphics
Hierarchical rendering of trees from precomputed multi-layer z-buffers

Proceedings of the eurographics workshop on Rendering techniques '96
Layered depth images

Proceedings of the 25th annual conference on Computer graphics and interactive techniques
LDI tree: a hierarchical representation for image-based rendering

Proceedings of the 26th annual conference on Computer graphics and interactive techniques
Plenoptic sampling

Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Surfels: surface elements as rendering primitives

Proceedings of the 27th annual conference on Computer graphics and interactive techniques
QSplat: a multiresolution point rendering system for large meshes

Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Surface splatting

Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Unstructured lumigraph rendering

Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Light field duality: concept and applications

VRST '02 Proceedings of the ACM symposium on Virtual reality software and technology
Generalized Multiple Baseline Stereo and Direct Virtual View Synthesis Using Range-Space Search, Match, and Render

International Journal of Computer Vision
Plenoptic Modeling and Rendering from Image Sequences Taken by Hand-Held Camera

Mustererkennung 1999, 21. DAGM-Symposium
Photorealistic Scene Reconstruction by Voxel Coloring

CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)

Ambient point clouds for view interpolation

ACM SIGGRAPH 2010 papers

Quantified Score

Hi-index	0.00

Visualization

Abstract

Most existing light-field rendering methods rely on images that record the color of the rays. In this paper, we present a new approach that instead uses colored point clouds, which are the source of the rays. Furthermore, we study the light field from a dual-space viewpoint, where 3D scene points appear as geometry hyperlines, and rays appear as hyperpoints located on the hyperlines. Rendering the light field reduces to finding and blending the closest hyperlines to the hyperpoints corresponding to the virtual rays. Occlusion is dealt with by clustering nearby hyperlines according to their slope. Hole filling is dealt with by increasing the range of contribution of the hyperlines by a given threshold. We also propose the concept of local ray space, and show that it improves the rendering quality and removes the restriction on virtual camera position that is associated with the global ray space scheme. Finally, we show how to deal with uncertain geometric information in our framework.