Frame rate stabilization by variable resolution shape reconstruction for on-line free-viewpoint video generation

Authors:
Rui Nabeshima;Megumu Ueda;Daisaku Arita;Rin-ichiro Taniguchi
Affiliations:
Department of Intelligent Systems, Kyushu University, Fukuoka, Japan;Department of Intelligent Systems, Kyushu University, Fukuoka, Japan;Department of Intelligent Systems, Kyushu University, Fukuoka, Japan;Department of Intelligent Systems, Kyushu University, Fukuoka, Japan
Venue:
ACCV'06 Proceedings of the 7th Asian conference on Computer Vision - Volume Part II
Year:
2006

Citing 6
Cited 0

Image-based visual hulls

Proceedings of the 27th annual conference on Computer graphics and interactive techniques
RPV-II: A Stream-Based Real-Time Parallel Vision System and Its Application to Real-Time Volume Reconstruction

ICVS '01 Proceedings of the Second International Workshop on Computer Vision Systems
Virtualized reality: concepts and early results

VSR '95 Proceedings of the IEEE Workshop on Representation of Visual Scenes
Free-viewpoint video of human actors

ACM SIGGRAPH 2003 Papers
Heterogeneous Deformation Model for 3D Shape and Motion Recovery from Multi-Viewpoint Images

3DPVT '04 Proceedings of the 3D Data Processing, Visualization, and Transmission, 2nd International Symposium
Real-Time free-viewpoint video generation using multiple cameras and a PC-Cluster

PCM'04 Proceedings of the 5th Pacific Rim conference on Advances in Multimedia Information Processing - Volume Part I

Quantified Score

Hi-index	0.00

Visualization

Abstract

Recently, the number of researches aiming at showing real world objects from arbitrary viewpoint have been steadily growing. The processing method is divided into three stages: 3D shape reconstruction by the visual cone intersection method, conversion of 3D shape representation from a voxel form into a triangular patch form, and coloring triangular patches. If the surface area of the object becomes larger, the frame rate decreases since the processing time of the conversion and coloring depends on the number of triangular patches. Stability of the frame rate is essential for on-line distribution of a free-viewpoint video. To solve this problem, we propose a new method which accommodates the space resolution during the 3D shape reconstruction step, thus stabilizing the number of triangular patches and the frame rate. This is achieved by raising the space resolution step by step and stopping the process on a time criteria. The reconstruction is done by using an octree-based visual cone intersection method. Experimental results show that this method makes the frame rate more stable.