Real-Time Streaming of Point-Based 3D Video

  • Authors:
  • Edouard Lamboray;Stephan Würmlin;Markus Gross

  • Affiliations:
  • Swiss Federal Institute of Technology (ETH), Zurich, Switzerland;Swiss Federal Institute of Technology (ETH), Zurich, Switzerland;Swiss Federal Institute of Technology (ETH), Zurich, Switzerland

  • Venue:
  • VR '04 Proceedings of the IEEE Virtual Reality 2004
  • Year:
  • 2004

Quantified Score

Hi-index 0.00

Visualization

Abstract

Free-viewpoint video is a promising technology fornext-generation virtual and augmented reality applications.Our goal is to enhance collaborative VR applicationswith 3D video-conferencing features. In this paper,we propose a 3D video streaming technique which can bedeployed in telepresence environments. The streamingcharacteristics of real-time 3D video sequences are investigatedunder various system and networking conditions.We introduce several encoding techniques and analyzetheir behavior with respect to resolution, bandwidth andinter-frame jitter. Our 3D video pipeline uses point samplesas basic primitives and is fully integrated with a communicationframework handling acknowledgmentinformation for reliable network transmissions and applicationcontrol data. The 3D video reconstruction processdynamically adapts to processing and networking bottlenecks.Our results show that a reliable transmission of ourpixel-based differential prediction encoding leads to thebest performance in terms of bandwidth, but is also quitesensitive to packet losses. A redundantly encoded streamachieves better results in presence of burst losses andseamlessly adapts to varying network throughput.