Feature-based image metamorphosis
SIGGRAPH '92 Proceedings of the 19th annual conference on Computer graphics and interactive techniques
View interpolation for image synthesis
SIGGRAPH '93 Proceedings of the 20th annual conference on Computer graphics and interactive techniques
Rapid octree construction from image sequences
CVGIP: Image Understanding
Plenoptic modeling: an image-based rendering system
SIGGRAPH '95 Proceedings of the 22nd annual conference on Computer graphics and interactive techniques
Modeling and rendering architecture from photographs: a hybrid geometry- and image-based approach
SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
Virtualized reality: constructing time-varying virtual worlds from real world events
VIS '97 Proceedings of the 8th conference on Visualization '97
Acquiring the reflectance field of a human face
Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Proceedings of the 27th annual conference on Computer graphics and interactive techniques
A Flexible New Technique for Camera Calibration
IEEE Transactions on Pattern Analysis and Machine Intelligence
Unstructured lumigraph rendering
Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Image-based 3D photography using opacity hulls
Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Frequency space environment map rendering
Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Spatio-temporal view interpolation
EGRW '02 Proceedings of the 13th Eurographics workshop on Rendering
A real-time distributed light field camera
EGRW '02 Proceedings of the 13th Eurographics workshop on Rendering
Acquisition and rendering of transparent and refractive objects
EGRW '02 Proceedings of the 13th Eurographics workshop on Rendering
Interactive Design of Complex Time-Dependent Lighting
IEEE Computer Graphics and Applications
Reality Modeling and Visualization from Multiple Video Sequences
IEEE Computer Graphics and Applications
Real-Time Rendering of Densely Populated Urban Environments
Proceedings of the Eurographics Workshop on Rendering Techniques 2000
Interactive Rendering of Trees with Shading and Shadows
Proceedings of the 12th Eurographics Workshop on Rendering Techniques
SIGGRAPH '84 Proceedings of the 11th annual conference on Computer graphics and interactive techniques
PG '02 Proceedings of the 10th Pacific Conference on Computer Graphics and Applications
ACM SIGGRAPH 2003 Papers
Free-viewpoint video of human actors
ACM SIGGRAPH 2003 Papers
Spacetime faces: high resolution capture for modeling and animation
ACM SIGGRAPH 2004 Papers
High-quality video view interpolation using a layered representation
ACM SIGGRAPH 2004 Papers
Image-based spatio-temporal modeling and view interpolation of dynamic events
ACM Transactions on Graphics (TOG)
Performance relighting and reflectance transformation with time-multiplexed illumination
ACM SIGGRAPH 2005 Papers
High performance imaging using large camera arrays
ACM SIGGRAPH 2005 Papers
Video-Based Rendering
A self-reconfigurable camera array
EGSR'04 Proceedings of the Fifteenth Eurographics conference on Rendering Techniques
Smooth reconstruction and compact representation of reflectance functions for image-based relighting
EGSR'04 Proceedings of the Fifteenth Eurographics conference on Rendering Techniques
Animatable facial reflectance fields
EGSR'04 Proceedings of the Fifteenth Eurographics conference on Rendering Techniques
Efficient multi-viewpoint acquisition of 3D objects undergoing repetitive motions
Proceedings of the 2007 symposium on Interactive 3D graphics and games
Adaptive sampling of reflectance fields
ACM Transactions on Graphics (TOG)
Seeing People in Different Light-Joint Shape, Motion, and Reflectance Capture
IEEE Transactions on Visualization and Computer Graphics
Rendering for an interactive 360° light field display
ACM SIGGRAPH 2007 papers
Post-production facial performance relighting using reflectance transfer
ACM SIGGRAPH 2007 papers
Performance capture from sparse multi-view video
ACM SIGGRAPH 2008 papers
Principles of appearance acquisition and representation
ACM SIGGRAPH 2008 classes
Dynamic shape capture using multi-view photometric stereo
ACM SIGGRAPH Asia 2009 papers
Principles of Appearance Acquisition and Representation
Foundations and Trends® in Computer Graphics and Vision
3D object relighting based on multi-view stereo and image based lighting techniques
ICME'09 Proceedings of the 2009 IEEE international conference on Multimedia and Expo
Spatio-temporal reflectance sharing for relightable 3D video
MIRAGE'07 Proceedings of the 3rd international conference on Computer vision/computer graphics collaboration techniques
Video-based characters: creating new human performances from a multi-view video database
ACM SIGGRAPH 2011 papers
International Journal of Computer Vision
Optimized image sampling for view and light interpolation
VAST'09 Proceedings of the 10th International conference on Virtual Reality, Archaeology and Cultural Heritage
Performance Capture of High-Speed Motion Using Staggered Multi-View Recording
Computer Graphics Forum
Elevation angle from reflectance monotonicity: photometric stereo for general isotropic reflectances
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part III
Interactive viewpoint video textures
Proceedings of the 9th European Conference on Visual Media Production
| Hi-index | 0.00 |
We present an image-based approach for capturing the appearance of a walking or running person so they can be rendered realistically under variable viewpoint and illumination. In our approach, a person walks on a treadmill at a regular rate as a turntable slowly rotates the person's direction. As this happens, the person is filmed with a vertical array of high-speed cameras under a time-multiplexed lighting basis, acquiring a seven-dimensional dataset of the person under variable time, illumination, and viewing direction in approximately forty seconds. We process this data into a flowed reflectance field using an optical flow algorithm to correspond pixels in neighboring camera views and time samples to each other, and we use image compression to reduce the size of this data. We then use image-based relighting and a hardware-accelerated combination of view morphing and light field rendering to render the subject under user-specified viewpoint and lighting conditions. To composite the person into a scene, we use an alpha channel derived from back lighting and a retroreflective treadmill surface and a visual hull process to render the shadows the person would cast onto the ground. We demonstrate realistic composites of several subjects into real and virtual environments using our technique.