View interpolation for image synthesis
SIGGRAPH '93 Proceedings of the 20th annual conference on Computer graphics and interactive techniques
QuickTime VR: an image-based approach to virtual environment navigation
SIGGRAPH '95 Proceedings of the 22nd annual conference on Computer graphics and interactive techniques
Plenoptic modeling: an image-based rendering system
SIGGRAPH '95 Proceedings of the 22nd annual conference on Computer graphics and interactive techniques
SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
Database management for interactive display of large architectural models
GI '96 Proceedings of the conference on Graphics interface '96
Creating full view panoramic image mosaics and environment maps
Proceedings of the 24th annual conference on Computer graphics and interactive techniques
LDI tree: a hierarchical representation for image-based rendering
Proceedings of the 26th annual conference on Computer graphics and interactive techniques
Rendering with concentric mosaics
Proceedings of the 26th annual conference on Computer graphics and interactive techniques
Surface light fields for 3D photography
Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Proceedings of the 1999 conference on Graphics interface '99
Unstructured lumigraph rendering
Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Plenoptic stitching: a scalable method for reconstructing 3D interactive walk throughs
Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Spatially-encoded far-field representations for interactive walkthroughs
MULTIMEDIA '01 Proceedings of the ninth ACM international conference on Multimedia
Polymorph: Morphing Among Multiple Images
IEEE Computer Graphics and Applications
The Wavelet Stream: Interactive Multi Resolution Light Field Rendering
Proceedings of the 12th Eurographics Workshop on Rendering Techniques
Catadioptric Omnidirectional Camera
CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)
3-D Scene Data Recovery using Omnidirectional Multibaseline Stereo
CVPR '96 Proceedings of the 1996 Conference on Computer Vision and Pattern Recognition (CVPR '96)
Movie-maps: An application of the optical videodisc to computer graphics
SIGGRAPH '80 Proceedings of the 7th annual conference on Computer graphics and interactive techniques
On Enhancing the Speed of Splatting with Indexing
VIS '95 Proceedings of the 6th conference on Visualization '95
The Delta Tree: An Object-Centered Approach to Image-Based Rendering
The Delta Tree: An Object-Centered Approach to Image-Based Rendering
VHS to VRML: 3D Graphical Models from Video Sequences
ICMCS '99 Proceedings of the IEEE International Conference on Multimedia Computing and Systems - Volume 2
Interactive image-based rendering using feature globalization
I3D '03 Proceedings of the 2003 symposium on Interactive 3D graphics
Simplifying complex environments using incremental textured depth meshes
ACM SIGGRAPH 2003 Papers
Sea of Images: A Dense Sampling Approach for Rendering Large Indoor Environments
IEEE Computer Graphics and Applications
A general framework for multidimensional adaptation
Proceedings of the 12th annual ACM international conference on Multimedia
Supporting adaptive remote access to multiresolutional or hierarchical data for large user groups
Proceedings of the 12th annual ACM international conference on Multimedia
Locating key views for image indexing of spaces
MIR '08 Proceedings of the 1st ACM international conference on Multimedia information retrieval
Key views for visualizing large spaces
Journal of Visual Communication and Image Representation
View planning for cityscape archiving and visualization
ACCV'07 Proceedings of the 8th Asian conference on Computer vision - Volume Part I
Digesting omni-video along routes for navigation
Proceedings of the international conference on Multimedia
An efficient arbitrary view generation method using panoramic-based image morphing
ICIC'06 Proceedings of the 2006 international conference on Intelligent Computing - Volume Part I
Computer Graphics Forum
GA based adaptive sampling for image-based walkthrough
EGVE'06 Proceedings of the 12th Eurographics conference on Virtual Environments
| Hi-index | 0.00 |
A long-standing research problem in computer graphics is to reproduce the visual experience of walking through a large photorealistic environment interactively. On one hand, traditional geometry-based rendering systems fall short of simulating the visual realism of a complex environment. On the other hand, image-based rendering systems have to date been unable to capture and store a sampled representation of a large environment with complex lighting and visibility effects.In this paper, we present a "Sea of Images," a practical approach to dense sampling, storage, and reconstruction of the plenoptic function in large, complex indoor environments. We use a motorized cart to capture omnidirectional images every few inches on a eye-height plane throughout an environment. The captured images are compressed and stored in a multiresolution hierarchy suitable for real-time prefetching during an interactive walkthrough. Later, novel images are reconstructed for a simulated observer by resampling nearby captured images.Our system acquires 15,254 images over 1,050 square feet at an average image spacing of 1.5 inches. The average capture and processing time is 7 hours. We demonstrate realistic walkthroughs of real-world environments reproducing specular reflections and occlusion effects while rendering 15-25 frames per second.