MixIn3D: 3D Mixed Reality with ToF-Camera

  • Authors:
  • Reinhard Koch;Ingo Schiller;Bogumil Bartczak;Falko Kellner;Kevin Köser

  • Affiliations:
  • Institute of Computer Science, Christian-Albrechts-University (CAU), Kiel, Germany 24098;Institute of Computer Science, Christian-Albrechts-University (CAU), Kiel, Germany 24098;Institute of Computer Science, Christian-Albrechts-University (CAU), Kiel, Germany 24098;Institute of Computer Science, Christian-Albrechts-University (CAU), Kiel, Germany 24098;Institute of Computer Science, Christian-Albrechts-University (CAU), Kiel, Germany 24098

  • Venue:
  • Dyn3D '09 Proceedings of the DAGM 2009 Workshop on Dynamic 3D Imaging
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

This work discusses an approach to seamlessly integrate real and virtual scene content by on-the-fly 3D scene modeling and dynamic scene interaction. The key element is a ToF-depth camera, accompanied by color cameras, mounted on a pan-tilt head. The system allows to scan the environment for easy 3D reconstruction, and will track and model dynamically moving objects like human actors in 3D. This allows to compute mutual occlusions between real and virtual objects and correct light and shadow generation with mutual light interaction. No dedicated studio is required, as virtually any room can be turned into a virtual studio with this approach. Since the complete process operates in 3D and produces consistent color and depth sequences, this system can be used for full 3D TV production.