A low-latency 3D teleconferencing system with image based approach

  • Authors:
  • Bingbin Dai;Xubo Yang

  • Affiliations:
  • Shanghai Jiao Tong University;Shanghai Jiao Tong University

  • Venue:
  • Proceedings of the 12th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and Its Applications in Industry
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we present a fully dynamic 3D one-to-one teleconferencing system that allows remote collaborators to see each other from different viewpoints. The local 3D scene including the participants is reconstructed with multiple calibrated color plus depth sensors and rendered under the tracked remote users viewpoint in real time. The rendering color and depth buffers are encoded as H.264 stream and transferred to the remote site. An image-based approach is applied to synthesize the desired viewing results in the remote site and reduce the interaction delay. Our system is featured with low latency, high frame rate and constant network flow.