Proceedings of the 25th annual conference on Computer graphics and interactive techniques
Inverse global illumination: recovering reflectance models of real scenes from photographs
Proceedings of the 26th annual conference on Computer graphics and interactive techniques
A Flexible New Technique for Camera Calibration
IEEE Transactions on Pattern Analysis and Machine Intelligence
A signal-processing framework for inverse rendering
Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Acquiring a Radiance Distribution to Superimpose Virtual Objects onto a Real Scene
IEEE Transactions on Visualization and Computer Graphics
Interactive Rendering with Real-World Illumination
Proceedings of the Eurographics Workshop on Rendering Techniques 2000
Shader Lamps: Animating Real Objects With Image-Based Illumination
Proceedings of the 12th Eurographics Workshop on Rendering Techniques
Relighting with 4D incident light fields
ACM SIGGRAPH 2003 Papers
Capturing and rendering with incident light fields
EGRW '03 Proceedings of the 14th Eurographics workshop on Rendering
A Projector-Camera System with Real-Time Photometric Adaptation for Dynamic Environments
CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 1 - Volume 01
ACM SIGGRAPH 2005 Papers
Fast separation of direct and global components of a scene using high frequency illumination
ACM SIGGRAPH 2006 Papers
Toward the Light Field Display: Autostereoscopic Rendering via a Cluster of Projectors
IEEE Transactions on Visualization and Computer Graphics
Symmetric photography: exploiting data-sparseness in reflectance fields
EGSR'06 Proceedings of the 17th Eurographics conference on Rendering Techniques
BiDi screen: a thin, depth-sensing LCD for 3D interaction using light fields
ACM SIGGRAPH Asia 2009 papers
Hemispherical confocal imaging using turtleback reflector
ACCV'10 Proceedings of the 10th Asian conference on Computer vision - Volume Part I
Rendering synthetic objects into legacy photographs
Proceedings of the 2011 SIGGRAPH Asia Conference
8D: interacting with a relightable glasses-free 3D display
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Render synthetic fog into interior and exterior photographs
Proceedings of the 12th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and Its Applications in Industry
| Hi-index | 0.00 |
We present a novel image-based method for compositing real and synthetic objects in the same scene with a high degree of visual realism. Ours is the first technique to allow global illumination and near-field lighting effects between both real and synthetic objects at interactive rates, without needing a geometric and material model of the real scene. We achieve this by using a light field interface between real and synthetic components---thus, indirect illumination can be simulated using only two 4D light fields, one captured from and one projected onto the real scene. Multiple bounces of interreflections are obtained simply by iterating this approach. The interactivity of our technique enables its use with time-varying scenes, including dynamic objects. This is in sharp contrast to the alternative approach of using 6D or 8D light transport functions of real objects, which are very expensive in terms of acquisition and storage and hence not suitable for real-time applications. In our method, 4D radiance fields are simultaneously captured and projected by using a lens array, video camera, and digital projector. The method supports full global illumination with restricted object placement, and accommodates moderately specular materials. We implement a complete system and show several example scene compositions that demonstrate global illumination effects between dynamic real and synthetic objects. Our implementation requires a single point light source and dark background.