Inter-stream synchronization between haptic media and voice in collaborative virtual environments

Authors:
Yutaka Ishibashi;Takeshi Kanbara;Shuji Tasaka
Affiliations:
Nagoya Institute of Technology, Nagoya, Japan;Nagoya Institute of Technology, Nagoya, Japan;Nagoya Institute of Technology, Nagoya, Japan
Venue:
Proceedings of the 12th annual ACM international conference on Multimedia
Year:
2004

Citing 6
Cited 8

A case for end system multicast (keynote address)

Proceedings of the 2000 ACM SIGMETRICS international conference on Measurement and modeling of computer systems
Phantom-Based Haptic Interaction with Virtual Objects

IEEE Computer Graphics and Applications
A synchronization mechanism for continuous media in multimedia communications

INFOCOM '95 Proceedings of the Fourteenth Annual Joint Conference of the IEEE Computer and Communication Societies (Vol. 3)-Volume - Volume 3
Group synchronization control for haptic media in networked virtual environments

HAPTICS'04 Proceedings of the 12th international conference on Haptic interfaces for virtual environment and teleoperator systems
A media synchronization survey: reference model, specification, and case studies

IEEE Journal on Selected Areas in Communications
Human perception of jitter and media synchronization

IEEE Journal on Selected Areas in Communications

Packetization interval of haptic media in networked virtual environments

NetGames '05 Proceedings of 4th ACM SIGCOMM workshop on Network and system support for games
An agent based synchronization scheme for multimedia applications

Journal of Systems and Software - Special issue: Quality software
Group synchronization control over haptic media in a networked real-time game with collaborative work

NetGames '06 Proceedings of 5th ACM SIGCOMM workshop on Network and system support for games
Multimedia group and inter-stream synchronization techniques: A comparative study

Information Systems
A comparison between transmission methods of sense of force in a remote haptic instruction system

ICME'09 Proceedings of the 2009 IEEE international conference on Multimedia and Expo
A user perspective of olfaction-enhanced mulsemedia

Proceedings of the International Conference on Management of Emergent Digital EcoSystems
Human perception of haptic-to-video and haptic-to-audio skew in multimedia applications

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
Frame Rate Exclusive Sync Management of Live Video Streams in Collaborative Mobile Production Environment

Proceedings of Workshop on Mobile Video Delivery

Quantified Score

Hi-index	0.01

Visualization

Abstract

This paper addresses an inter-stream synchronization issue between haptic media and voice in networked virtual environments. The paper proposes a media synchronization algorithm for the two types of media stream by enhancing the virtual-time rendering (VTR) algorithm, which the authors previously proposed. The new algorithm employs two types of error range in order to keep high quality of intra-stream synchronization at the expense of slight deterioration in the inter-stream synchronization quality. One is the imperceptible range of inter-stream synchronization error, and the other is the allowable range of the error. If the error is beyond the allowable range, the algorithm tries to reduce the error gradually until the error becomes within the imperceptible range. Otherwise, it accepts the error. By carrying out an experiment in which two users do collaborative work with haptic media and voice in a virtual space, we demonstrate the effectiveness of the algorithm quantitatively.