A flexible client-driven 3DTV systemfor real-time aquisition, transmission, and display of dynamic scenes

  • Authors:
  • Xun Cao;Yebin Liu;Qionghai Dai

  • Affiliations:
  • Broadband Networks & Digital Media Lab, Tsinghua University, Beijing, China and Tsinghua National Laboratory for Information Science and Technology (TNList), Beijing, China;Broadband Networks & Digital Media Lab, Tsinghua University, Beijing, China and Tsinghua National Laboratory for Information Science and Technology (TNList), Beijing, China;Broadband Networks & Digital Media Lab, Tsinghua University, Beijing, China and Tsinghua National Laboratory for Information Science and Technology (TNList), Beijing, China

  • Venue:
  • EURASIP Journal on Applied Signal Processing - 3DTV: Capture, Transmission, and Display of 3D Video
  • Year:
  • 2008

Quantified Score

Hi-index 0.01

Visualization

Abstract

3D experience and free-viewpoint navigation are expected to be two essential features of next generation television. In this paper, we present a flexible 3DTV system in which multiview video streams are captured, compressed, transmitted, and finally converted to high-quality 3D video in real time. Our system consists of an 8 × 8 camera array, 16 producer PCs, a streaming server, multiple clients, and several autostereoscopic displays. The whole system is implemented over IP network to provide multiple users with interactive 2D/3D switching, viewpoint control, and synthesis for dynamic scenes. In our approach,multiple video streams are first captured by a synchronized camera array. Then, we adopt a lengthened-B-field and region of interest- (ROI-) based coding scheme to guarantee a seamless view switching for each user as well as saving per-user transmission bandwidth. Finally, a convenient rendering algorithm is used to synthesize a visually pleasing result by introducing a new metric called Clarity Degree (CD). Experiments on both synthetic and real-world data have verified the feasibility, flexibility, and good performance of our system.