A multi-stream adaptation framework for bandwidth management in 3D tele-immersion

  • Authors:

  • Zhenyu Yang;Bin Yu;Klara Nahrstedt;Ruzena Bajscy

  • Affiliations:

  • University of Illinois at Urbana-Champaign, Goodwin, Urbana, IL;University of Illinois at Urbana-Champaign, Goodwin, Urbana, IL;University of Illinois at Urbana-Champaign, Goodwin, Urbana, IL;University of California at Berkeley, Berkeley, CA

  • Venue:
  • Proceedings of the 2006 international workshop on Network and operating systems support for digital audio and video
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

Tele-immersive environments will improve the state of collaboration among distributed participants. However, along with the promise a new set of challenges have emerged including the real-time acquisition, streaming and rendering of 3D scenes to convey a realistic sense of immersive spaces. Unlike 2D video conferencing, a 3D tele-immersive environment employs multiple 3D cameras to cover a much wider field of view, thus generating a very large volume of data that need to be carefully coordinated, organized, and synchronized for Internet transmission, rendering and display. This is a challenging task and a dynamic bandwidth management must be in place. To achieve this goal, we propose a multi-stream adaptation framework for bandwidth management in 3D tele-immersion. The adaptation framework relies on the hierarchy of mechanisms and services that exploits the semantic link of multiple 3D video streams in the tele-immersive environment. We implement a prototype of the framework that integrates semantic stream selection, content adaptation, and 3D data compression services with user preference. The experimental results have demonstrated that the framework shows a good quality of the resulting composite 3D rendered video in case of sufficient bandwidth, while it adapts individual 3D video streams in a coordinated and user-friendly fashion, and yields graceful quality degradation in case of low bandwidth availability.