Framework for hierarchical calibration of multi-camera systems for teleimmersion
Proceedings of the 2nd International Conference on Immersive Telecommunications
MM '09 Proceedings of the 17th ACM international conference on Multimedia
MobileTI: a portable tele-immersive system
MM '09 Proceedings of the 17th ACM international conference on Multimedia
A high-quality low-delay remote rendering system for 3D video
Proceedings of the international conference on Multimedia
QoS and resource management in distributed interactive multimedia environments
Multimedia Tools and Applications
Next generation session management for 3D teleimmersive interactive environments
Multimedia Tools and Applications
Tele-immersive gaming for everybody
MM '11 Proceedings of the 19th ACM international conference on Multimedia
A real-time remote rendering system for interactive mobile graphics
ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP) - Special section of best papers of ACM multimedia 2011, and special section on 3D mobile multimedia
| Hi-index | 0.00 |
In this paper, we present a framework for immersive 3D video conferencing and geographically distributed collaboration. Our multi-camera system performs a full-body 3D reconstruction of users in real time and renders their image in a virtual space allowing remote interaction between users and the virtual environment. The paper features an overview of the technology and algorithms used for calibration, capturing, and reconstruction. We introduce stereo mapping using adaptive triangulation which allows for fast (under 25 ms) and robust real-time 3D reconstruction. The chosen representation of the data provides high compression ratios for transfer to a remote site. The algorithm produces partial 3D meshes, instead of dense point clouds, which are combined on the renderer to create a unified model of the user. We have successfully demonstrated the use of our system in various applications such as remote dancing and immersive Tai Chi learning.