TSync: a new synchronization framework for multi-site 3D tele-immersion

Authors:
Zixia Huang;Wanmin Wu;Klara Nahrstedt;Ahsan Arefin;Raoul Rivas
Affiliations:
University of Illinois at Urbana-Champaign, Urbana, IL, USA;University of Illinois at Urbana-Champaign, Urbana, IL, USA;University of Illinois at Urbana-Champaign, Urbana, IL, USA;University of Illinois at Urbana-Champaign, Urbana, IL, USA;University of Illinois at Urbana-Champaign, Urbana, IL, USA
Venue:
Proceedings of the 20th international workshop on Network and operating systems support for digital audio and video
Year:
2010

Citing 7
Cited 5

Time Warping of Audio Signals

CGI '99 Proceedings of the International Conference on Computer Graphics
An adaptive delay and synchronization control scheme for Wi-Fi based audio/video conferencing

Wireless Networks
A multi-stream adaptation framework for bandwidth management in 3D tele-immersion

Proceedings of the 2006 international workshop on Network and operating systems support for digital audio and video
Implementing a Distributed Tele-immersive System

ISM '08 Proceedings of the 2008 Tenth IEEE International Symposium on Multimedia
Enabling multi-party 3D tele-immersive environments with ViewCast

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
Human perception of jitter and media synchronization

IEEE Journal on Selected Areas in Communications
Evaluation and characterization of available bandwidth probing techniques

IEEE Journal on Selected Areas in Communications

QoS and resource management in distributed interactive multimedia environments

Multimedia Tools and Applications
SyncCast: synchronized dissemination in multi-site interactive 3D tele-immersion

MMSys '11 Proceedings of the second annual ACM conference on Multimedia systems
Synchronized dissemination framework for supporting high-quality tele-immersive shared activity

MM '11 Proceedings of the 19th ACM international conference on Multimedia
Multi-stream 3D video distribution over peer-to-peer networks

Image Communication
Evolution of temporal multimedia synchronization principles: A historical viewpoint

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP) - Special Sections on the 20th Anniversary of ACM International Conference on Multimedia, Best Papers of ACM Multimedia 2012

Quantified Score

Hi-index	0.00

Visualization

Abstract

Synchronization is a challenge in the multi-site 3D tele-immersion (3DTI) because it is complicated by the coexistence of highly correlated heterogenous streams from multiple sources, and the need for multi-stream resynchronization when user views change. To address the problems, we present TSync: a new multi-tier synchronization framework for 3DTI which can effectively reduce the multi-stream sync skews. Our contributions are focusing on (1) the use of timed synchronization points for multi-stream synchronization; (2) Internet bandwidth estimation based on machine learning; (3) the cooperative frame rate allocation for correlated multi-streams and (4) the resynchronization protocol used when user views change. Experimental results show that TSync can successfully achieve the synchronization of multi-source heterogeneous streams in 3DTI under Internet dynamics.