Joint rendering and segmentation of free-viewpoint images

Authors:
Masato Ishii;Keita Takahashi;Takeshi Naemura
Affiliations:
Graduate School of Information Science and Technology, The University of Tokyo;IRT Research Initiative, The University of Tokyo;Graduate School of Information Science and Technology, The University of Tokyo and IRT Research Initiative, The University of Tokyo
Venue:
ICIP'09 Proceedings of the 16th IEEE international conference on Image processing
Year:
2009

Citing 7
Cited 0

Light field rendering

SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
The lumigraph

SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
High-quality video view interpolation using a layered representation

ACM SIGGRAPH 2004 Papers
Bi-Layer Segmentation of Binocular Stereo Video

CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 2 - Volume 02
High performance imaging using large camera arrays

ACM SIGGRAPH 2005 Papers
Natural video matting using camera arrays

ACM SIGGRAPH 2006 Papers
A self-reconfigurable camera array

EGSR'04 Proceedings of the Fifteenth Eurographics conference on Rendering Techniques

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents a method that jointly performs synthesis of freeviewpoint images and object segmentation from that viewpoint. This method works efficiently and online by sharing a certain calculation process among rendering and segmentation steps. Since the segmentation is performed for arbitrary viewpoints directly, the extracted object can be superimposed onto another 3-D scene with geometric consistency. Experimental results using a 25-camera array show the effectiveness of our method.