VirtualizeMe: interactive model reconstruction from stereo video streams

  • Authors:
  • Daniel Knoblauch;Falko Kuester

  • Affiliations:
  • University of California, San Diego;University of California, San Diego

  • Venue:
  • Proceedings of the 2008 ACM symposium on Virtual reality software and technology
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

Tele-Immersion depends on face-to-face, viewpoint corrected, stereoscopic, virtual environments, allowing users to naturally interact with each other and the digital environment surrounding them, via realistic avatars. This paper presents an extraction, modeling and communication methodology for the creation of the needed avatars, based on a scalable focused disparity map (FDM) approach. The FDM enables variable distance reconstruction of dynamic target objects despite restrictions in disparity range. Combined with a pixel-based disparity cost interpolation, a sub-pixel disparity refinement is achieved, providing a high depth-resolution and smooth reconstruction of the target objects. This technique approaches real-time characteristics, extracting avatar models and communicating them to remote render nodes at 15 frames per second.