A real-time 3d modeling system using multiple stereo cameras for free-viewpoint video generation

  • Authors:
  • Hansung Kim;Itaru Kitahara;Kiyoshi Kogure;Kwanghoon Sohn

  • Affiliations:
  • Knowledge Science Lab, ATR, Kyoto, Japan;Knowledge Science Lab, ATR, Kyoto, Japan;Knowledge Science Lab, ATR, Kyoto, Japan;Dept. of Electrical and Electronics Eng., Yonsei University, Seoul, Korea

  • Venue:
  • ICIAR'06 Proceedings of the Third international conference on Image Analysis and Recognition - Volume Part II
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

We propose a real-time 3D modeling system using multiple stereo cameras which is a method for displaying a target object from an arbitrary view. Each capturing PC segments the objects and estimates disparity fields, then they transmit the data to a 3D modeling server. A modeling server generates 3D models of the objects and renders a video at the designated point of view. A main contribution in this system is a shape-recovery algorithm to derive a 3D scene description from 2D images. We propose an efficient volume carving algorithm using silhouette and disparity at a time that is more robust than conventional algorithms. The algorithm partitions space into an octree and processes it hierarchically so that execution time and space are dramatically reduced. The generated free-view video provides realistic images of dynamically changing scenes in real-time.