View interpolation for image synthesis
SIGGRAPH '93 Proceedings of the 20th annual conference on Computer graphics and interactive techniques
Modeling and rendering architecture from photographs: a hybrid geometry- and image-based approach
SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
Efficient View-Dependent Image-Based Rendering with Projective Texture-Mapping
Efficient View-Dependent Image-Based Rendering with Projective Texture-Mapping
Model-Based Multiple View Reconstruction of People
ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
Surface Capture for Performance-Based Animation
IEEE Computer Graphics and Applications
Image quality assessment: from error visibility to structural similarity
IEEE Transactions on Image Processing
Global Non-rigid Alignment of Surface Sequences
International Journal of Computer Vision
| Hi-index | 0.00 |
Video-based free-viewpoint rendering from multiple view video capture has achieved video-realistic performance replay. Existing free-viewpoint rendering approaches require storage, streaming and re-sampling of multiple videos, which requires high bandwidth and computational resources limiting applications to local replay on high-performance computers. This paper introduces a layered texture representation for efficient storage and view-dependent rendering from multiple view video capture whilst maintaining the video-realism. Layered textures re-sample the captured video according to the surface visibility. Prioritisation of layers according to surface visibility allows the N-best views for all surface elements to be pre-computed significantly reducing both storage and rendering cost. Typically 3 texture map layers are required for free-viewpoint rendering with an equivalent visual quality to the multiple view video giving a significant reduction in storage cost. Quantitative evaluation demonstrates that the layered representation achieves a 90% reduction in storage cost and 50% reduction in rendering cost without loss of visual quality compared to storing only the foreground of the original multiple view video. This reduces the storage and transmission cost for free-viewpoint video rendering from eight cameras to be similar to the requirements for a single video. Streaming the layered representation enables, for the first time, demonstration of free-viewpoint video rendering on mobile devices and web platforms.