Camera field rendering for static and dynamic scenes

Authors:
Minglun Gong;Yee-Hong Yang
Affiliations:
Computer Graphics Research Group, Department of Computing Science, University of Alberta, Edmonton, Alta, Canada, T6G 2E8;Computer Graphics Research Group, Department of Computing Science, University of Alberta, Edmonton, Alta, Canada, T6G 2E8
Venue:
Graphical Models
Year:
2005

Citing 30
Cited 2

Feature-based image metamorphosis

SIGGRAPH '92 Proceedings of the 19th annual conference on Computer graphics and interactive techniques
QuickTime VR: an image-based approach to virtual environment navigation

SIGGRAPH '95 Proceedings of the 22nd annual conference on Computer graphics and interactive techniques
Plenoptic modeling: an image-based rendering system

SIGGRAPH '95 Proceedings of the 22nd annual conference on Computer graphics and interactive techniques
Modeling and rendering architecture from photographs: a hybrid geometry- and image-based approach

SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
View morphing

SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
Light field rendering

SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
The lumigraph

SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
Virtualized reality: constructing time-varying virtual worlds from real world events

VIS '97 Proceedings of the 8th conference on Visualization '97
Rendering with concentric mosaics

Proceedings of the 26th annual conference on Computer graphics and interactive techniques
Surface light fields for 3D photography

Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Dynamically reparameterized light fields

Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Relief texture mapping

Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Image-based visual hulls

Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Layer-based morphing

Graphical Models
Feature-based light field morphing

Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Spatio-temporal view interpolation

EGRW '02 Proceedings of the 13th Eurographics workshop on Rendering
A real-time distributed light field camera

EGRW '02 Proceedings of the 13th Eurographics workshop on Rendering
A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms

International Journal of Computer Vision
Genetic-Based Stereo Algorithm and Disparity Map Evaluation

International Journal of Computer Vision
Real-Time Video-Based Modeling and Rendering of 3D Scenes

IEEE Computer Graphics and Applications
A Multiple-Baseline Stereo

IEEE Transactions on Pattern Analysis and Machine Intelligence
Efficient Free Form Light Field Rendering

VMV '01 Proceedings of the Vision Modeling and Visualization Conference 2001
Plenoptic Modeling and Rendering from Image Sequences Taken by Hand-Held Camera

Mustererkennung 1999, 21. DAGM-Symposium
Hardware accelerated displacement mapping for image based rendering

GRIN'01 No description on Graphics interface 2001
The Rayset and its applications

GRIN'01 No description on Graphics interface 2001
Photorealistic Scene Reconstruction by Voxel Coloring

CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)
3D Video Recorder

PG '02 Proceedings of the 10th Pacific Conference on Computer Graphics and Applications
Fast Stereo Matching Using Reliability-Based Dynamic Programming and Consistency Constraints

ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
3D Image Display with Motion Parallax by Camera Matrix Stereo

ICMCS '96 Proceedings of the 1996 International Conference on Multimedia Computing and Systems
Efficient displacement mapping by image warping

EGWR'99 Proceedings of the 10th Eurographics conference on Rendering

Real-time backward disparity-based rendering for dynamic scenes using programmable graphics hardware

GI '07 Proceedings of Graphics Interface 2007
Temporal synchronization of non-overlapping videos using known object motion

Pattern Recognition Letters

Quantified Score

Hi-index	0.00

Visualization

Abstract

Most of the previously proposed image-based rendering approaches rely on a large number of samples, accurate depth information, or 3D geometric proxies. It is, therefore, a challenge to apply them to render novel views for dynamic scenes as the required information is difficult to obtain in real-time. The proposed approach requires only sparely sampled data. Two new interpolation techniques are presented in this paper, the combination of which can produce reasonable rendering results for sparsely sampled real scenes. The first one, which is a color-matching based interpolation, searches for a possible physical point along the testing ray using color information in nearby reference images. The second technique, which is a disparity-matching based interpolation, tries to find the closest intersection between the testing ray and the disparity surfaces defined by nearby reference images. Both approaches are designed as backward rendering techniques and can be combined to produce robust results. Our experiments suggest that the proposed approach is capable of handling complex dynamic real scenes offline.