An Immersive Free-Viewpoint Video System Using Multiple Outer/Inner Cameras

Authors:
Hansung Kim;Itaru Kitahara;Ryuuki Sakamoto;Kiyoshi Kogure
Affiliations:
ATR, Japan;ATR, Japan/ Univ. of Tsukuba, Japan;ATR, Japan;ATR, Japan
Venue:
3DPVT '06 Proceedings of the Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06)
Year:
2006

Citing 0
Cited 3

Toward cinematizing our daily lives

Multimedia Tools and Applications
Real-time remote rendering of 3D video for mobile devices

MM '09 Proceedings of the 17th ACM international conference on Multimedia
A high-quality low-delay remote rendering system for 3D video

Proceedings of the international conference on Multimedia

Quantified Score

Hi-index	0.00

Visualization

Abstract

We propose a new free-view video system that generates immersive 3D video from arbitrary point of view, using outer cameras and an inner omni-directional camera. The system reconstructs 3D modes from the captured video streams and generates realistic free-view video of those objects from a virtual camera. In this paper, we propose a real-time omni-directional camera calibration method, and describe a shape-from-silhouette technique for 3D modeling and a micro-facet billboarding technique for rendering. Owing to the movability and high resolution of the inner omni-directional camera, the proposed system reconstructs more elaborate 3D models and generates natural and vivid video with an immersive sensation.