An introduction to image-based rendering

Authors:
Heung Yeung Shum;Yin Li;Sing Bing Kang
Affiliations:
Microsoft Research Asia, Beijing, P.R. China;Hong Kong University of Science and Technology;Microsoft Research Asia, Beijing, P.R. China
Venue:
Integrated image and graphics technologies
Year:
2004

Citing 47
Cited 3

Improving resolution by image registration

CVGIP: Graphical Models and Image Processing
View interpolation for image synthesis

SIGGRAPH '93 Proceedings of the 20th annual conference on Computer graphics and interactive techniques
Three-dimensional computer vision: a geometric viewpoint

Three-dimensional computer vision: a geometric viewpoint
QuickTime VR: an image-based approach to virtual environment navigation

SIGGRAPH '95 Proceedings of the 22nd annual conference on Computer graphics and interactive techniques
Plenoptic modeling: an image-based rendering system

SIGGRAPH '95 Proceedings of the 22nd annual conference on Computer graphics and interactive techniques
Modeling and rendering architecture from photographs: a hybrid geometry- and image-based approach

SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
View morphing

SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
Light field rendering

SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
The lumigraph

SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
Post-rendering 3D warping

Proceedings of the 1997 symposium on Interactive 3D graphics
Time critical lumigraph rendering

Proceedings of the 1997 symposium on Interactive 3D graphics
PixelFlow: the realization

HWWS '97 Proceedings of the ACM SIGGRAPH/EUROGRAPHICS workshop on Graphics hardware
Rendering with coherent layers

Proceedings of the 24th annual conference on Computer graphics and interactive techniques
Creating full view panoramic image mosaics and environment maps

Proceedings of the 24th annual conference on Computer graphics and interactive techniques
Multiple-center-of-projection images

Proceedings of the 25th annual conference on Computer graphics and interactive techniques
Layered depth images

Proceedings of the 25th annual conference on Computer graphics and interactive techniques
LDI tree: a hierarchical representation for image-based rendering

Proceedings of the 26th annual conference on Computer graphics and interactive techniques
Rendering with concentric mosaics

Proceedings of the 26th annual conference on Computer graphics and interactive techniques
View-dependent geometry

Proceedings of the 26th annual conference on Computer graphics and interactive techniques
Surface light fields for 3D photography

Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Dynamically reparameterized light fields

Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Plenoptic sampling

Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Image-based visual hulls

Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Unstructured lumigraph rendering

Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Plenoptic stitching: a scalable method for reconstructing 3D interactive walk throughs

Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Video matting of complex scenes

Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Feature-based light field morphing

Proceedings of the 29th annual conference on Computer graphics and interactive techniques
The Convergence of Graphics and Vision

Computer
Image-based Rendering with Controllable Illumination

Proceedings of the Eurographics Workshop on Rendering Techniques '97
Plenoptic Modeling and Rendering from Image Sequences Taken by Hand-Held Camera

Mustererkennung 1999, 21. DAGM-Symposium
Multi-camera Scene Reconstruction via Graph Cuts

ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part III
Panoramic mosaics by manifold projection

CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)
Creating Image-Based VR Using a Self-Calibrating Fisheye Lens

CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)
Novel view synthesis in tensor space

CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)
Catadioptric Omnidirectional Camera

CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)
Stereo Vision for View Synthesis

CVPR '96 Proceedings of the 1996 Conference on Computer Vision and Pattern Recognition (CVPR '96)
3-D Scene Data Recovery using Omnidirectional Multibaseline Stereo

CVPR '96 Proceedings of the 1996 Conference on Computer Vision and Pattern Recognition (CVPR '96)
A Layered Approach to Stereo Reconstruction

CVPR '98 Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
Compositing digital images

SIGGRAPH '84 Proceedings of the 11th annual conference on Computer graphics and interactive techniques
Rendering of spherical light fields

PG '97 Proceedings of the 5th Pacific Conference on Computer Graphics and Applications
Scan Light Field Rendering

PG '02 Proceedings of the 10th Pacific Conference on Computer Graphics and Applications
An Image-Based Approach to Three-Dimensional Computer Graphics

An Image-Based Approach to Three-Dimensional Computer Graphics
Relief Textures

Relief Textures
Construction and Refinement of Panoramic Mosaics with Global and Local Alignment

ICCV '98 Proceedings of the Sixth International Conference on Computer Vision
An Iterative Bayesian Approach for Digital Matting

ICPR '06 Proceedings of the 18th International Conference on Pattern Recognition - Volume 02
Video Mosaics for Virtual Environments

IEEE Computer Graphics and Applications
Real-time rendering of real world environments

EGWR'99 Proceedings of the 10th Eurographics conference on Rendering

Phase space rendering

ISVC'07 Proceedings of the 3rd international conference on Advances in visual computing - Volume Part II
Copy detection of 3D videos

Proceedings of the 3rd Multimedia Systems Conference
Spider: A system for finding 3D video copies

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this chapter, we review the techniques for image-based rendering. Unlike traditional 3D computer graphics in which 3D geometry of the scene is known, image-based rendering (IBR) techniques render novel views directly from input images. IBR techniques can be classified into three categories according to how much geometric information is used: rendering without geometry, rendering with implicit geometry (i.e., correspondence), and rendering with explicit geometry (either with approximate or accurate geometry). We discuss the characteristics of these categories and their representative techniques.IBR techniques demonstrate a surprising diverse range in their extent of use of images and geometry in representing 3D scenes. We explore the issues in trading off the use of images and geometry by revisiting plenoptic sampling analysis and the notions of view dependency and geometric proxies. Finally, we highlight a practical IBR technique called pop-up light field. It models a sparse light field using a set of coherent layers, which incorporates both color and matting information, and renders in real time and free of aliasing.