Image-based rendering

Authors:
Sing Bing Kang;Yin Li;Xin Tong;Heung-Yeung Shum
Affiliations:
Microsoft Research;Microsoft Corporation;Microsoft Research Asia, China;Microsoft Research Asia, China
Venue:
Foundations and Trends® in Computer Graphics and Vision
Year:
2006

Citing 87
Cited 1

Creating raster Omnimax images from multiple perspective views using the elliptical weighted average filter

IEEE Computer Graphics and Applications
Survey of texture mapping

IEEE Computer Graphics and Applications
Improving resolution by image registration

CVGIP: Graphical Models and Image Processing
Panoramic representation for route recognition by a mobile robot

International Journal of Computer Vision - Special issue on machine vision research at Osaka University
View interpolation for image synthesis

SIGGRAPH '93 Proceedings of the 20th annual conference on Computer graphics and interactive techniques
Three-dimensional computer vision: a geometric viewpoint

Three-dimensional computer vision: a geometric viewpoint
QuickTime VR: an image-based approach to virtual environment navigation

SIGGRAPH '95 Proceedings of the 22nd annual conference on Computer graphics and interactive techniques
Plenoptic modeling: an image-based rendering system

SIGGRAPH '95 Proceedings of the 22nd annual conference on Computer graphics and interactive techniques
Modeling and rendering architecture from photographs: a hybrid geometry- and image-based approach

SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
View morphing

SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
Light field rendering

SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
The lumigraph

SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
Post-rendering 3D warping

Proceedings of the 1997 symposium on Interactive 3D graphics
Time critical lumigraph rendering

Proceedings of the 1997 symposium on Interactive 3D graphics
Multiperspective panoramas for cel animation

Proceedings of the 24th annual conference on Computer graphics and interactive techniques
Creating full view panoramic image mosaics and environment maps

Proceedings of the 24th annual conference on Computer graphics and interactive techniques
Linear Pushbroom Cameras

IEEE Transactions on Pattern Analysis and Machine Intelligence
Multiple-center-of-projection images

Proceedings of the 25th annual conference on Computer graphics and interactive techniques
Layered depth images

Proceedings of the 25th annual conference on Computer graphics and interactive techniques
Multiple viewpoint rendering

Proceedings of the 25th annual conference on Computer graphics and interactive techniques
3-D reconstruction of urban scenes from image sequences

Computer Vision and Image Understanding - Special issue on CAD-based computer vision
A real-time low-latency hardware light-field renderer

Proceedings of the 26th annual conference on Computer graphics and interactive techniques
LDI tree: a hierarchical representation for image-based rendering

Proceedings of the 26th annual conference on Computer graphics and interactive techniques
Rendering with concentric mosaics

Proceedings of the 26th annual conference on Computer graphics and interactive techniques
Surface light fields for 3D photography

Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Dynamically reparameterized light fields

Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Plenoptic sampling

Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Surfels: surface elements as rendering primitives

Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Relief texture mapping

Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Image-based visual hulls

Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Video textures

Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Mosaicing on Adaptive Manifolds

IEEE Transactions on Pattern Analysis and Machine Intelligence
Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography

Communications of the ACM
Multiple view geometry in computer vision

Multiple view geometry in computer vision
Unstructured lumigraph rendering

Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Plenoptic stitching: a scalable method for reconstructing 3D interactive walk throughs

Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Realistic image synthesis using photon mapping

Realistic image synthesis using photon mapping
Image-based 3D photography using opacity hulls

Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Feature-based light field morphing

Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Hardware-accelerated point-based rendering of complex scenes

EGRW '02 Proceedings of the 13th Eurographics workshop on Rendering
Rendering by Manifold Hopping

International Journal of Computer Vision
The Convergence of Graphics and Vision

Computer
On the Motion and Appearance of Specularities in Image Sequences

ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part I
Diffuse-Specular Separation and Depth Recovery from Image Sequences

ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part III
Rendering with Non-uniform Approximate Concentric Mosaics

SMILE '00 Revised Papers from Second European Workshop on 3D Structure from Multiple Images of Large-Scale Environments
Image-based Rendering with Controllable Illumination

Proceedings of the Eurographics Workshop on Rendering Techniques '97
View-base Rendering: Visualizing Real Objects from Scanned Range and Color Data

Proceedings of the Eurographics Workshop on Rendering Techniques '97
Plenoptic Modeling and Rendering from Image Sequences Taken by Hand-Held Camera

Mustererkennung 1999, 21. DAGM-Symposium
Panoramic mosaics by manifold projection

CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)
Creating Image-Based VR Using a Self-Calibrating Fisheye Lens

CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)
Novel view synthesis in tensor space

CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)
Catadioptric Omnidirectional Camera

CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)
Stereo Vision for View Synthesis

CVPR '96 Proceedings of the 1996 Conference on Computer Vision and Pattern Recognition (CVPR '96)
A Space-Sweep Approach to True Multi-Image Matching

CVPR '96 Proceedings of the 1996 Conference on Computer Vision and Pattern Recognition (CVPR '96)
A Layered Approach to Stereo Reconstruction

CVPR '98 Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
Mosaics of Scenes with Moving Objects

CVPR '98 Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
Merging and transformation of raster images for cartoon animation

SIGGRAPH '81 Proceedings of the 8th annual conference on Computer graphics and interactive techniques
Compositing digital images

SIGGRAPH '84 Proceedings of the 11th annual conference on Computer graphics and interactive techniques
Rendering of spherical light fields

PG '97 Proceedings of the 5th Pacific Conference on Computer Graphics and Applications
Real-Time Consensus-Based Scene Reconstruction Using Commodity Graphics Hardware

PG '02 Proceedings of the 10th Pacific Conference on Computer Graphics and Applications
Advanced Global Illumination

Advanced Global Illumination
Billboard clouds for extreme model simplification

ACM SIGGRAPH 2003 Papers
An Image-Based Approach to Three-Dimensional Computer Graphics

An Image-Based Approach to Three-Dimensional Computer Graphics
Construction and Refinement of Panoramic Mosaics with Global and Local Alignment

ICCV '98 Proceedings of the Sixth International Conference on Computer Vision
Plenoptic Image Editing

ICCV '98 Proceedings of the Sixth International Conference on Computer Vision
Image-based rendering using image-based priors

ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
Extracting View-Dependent Depth Maps from a Collection of Images

International Journal of Computer Vision - Special Issue on Research at Microsoft Corporation
Physically Based Rendering: From Theory to Implementation

Physically Based Rendering: From Theory to Implementation
Pop-up light field: An interactive image-based modeling and rendering system

ACM Transactions on Graphics (TOG)
Interactive deformation of light fields

Proceedings of the 2005 symposium on Interactive 3D graphics and games
Real-time relief mapping on arbitrary polygonal surfaces

Proceedings of the 2005 symposium on Interactive 3D graphics and games
Dynamosaics: Video Mosaics with Non-Chronological Time

CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 1 - Volume 01
Fourier slice photography

ACM SIGGRAPH 2005 Papers
Panoramic video textures

ACM SIGGRAPH 2005 Papers
Vignette and Exposure Calibration and Compensation

ICCV '05 Proceedings of the Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 - Volume 01
Real-time high-quality View-Dependent Texture Mapping using per-pixel visibility

GRAPHITE '05 Proceedings of the 3rd international conference on Computer graphics and interactive techniques in Australasia and South East Asia
Image-Based Rendering

Image-Based Rendering
Image-Based Interactive Exploration of Real-World Environments

IEEE Computer Graphics and Applications
Video Mosaics for Virtual Environments

IEEE Computer Graphics and Applications
Point-based rendering techniques

Computers and Graphics
A survey of point-based techniques in computer graphics

Computers and Graphics
Stereo matching with reflections and translucency

CVPR'03 Proceedings of the 2003 IEEE computer society conference on Computer vision and pattern recognition
Mosaicing new views: the Crossed-Slits projection

IEEE Transactions on Pattern Analysis and Machine Intelligence
Simultaneous homographic and comparametric alignment of multiple exposure-adjusted pictures of the same scene

IEEE Transactions on Image Processing
Image-based rendering by joint view triangulation

IEEE Transactions on Circuits and Systems for Video Technology
Light field techniques for reflections and refractions

EGWR'99 Proceedings of the 10th Eurographics conference on Rendering
High-quality surface splatting on today's GPUs

SPBG'05 Proceedings of the Second Eurographics / IEEE VGTC conference on Point-Based Graphics

Joint Multi-Layer Segmentation and Reconstruction for Free-Viewpoint Video Applications

International Journal of Computer Vision

Quantified Score

Hi-index	0.00

Visualization

Abstract

Image-based rendering (IBR) is unique in that it requires computer graphics, computer vision, and image processing to join forces to solve a common goal, namely photorealistic rendering through the use of images. IBR as an area of research has been around for about ten years, and substantial progress has been achieved in effiectively capturing, representing, and rendering scenes. In this article, we survey the techniques used in IBR. Our survey shows that representations and rendering techniques can differ radically, depending on design decisions related to ease of capture, use of geometry, accuracy of geometry (if used), number and distribution of source images, degrees of freedom for virtual navigation, and expected scene complexity.