Spatialized audio multiparty teleconferencing with commodity miniature microphone array

Authors:
Viet Anh Nguyen;Shengkui Zhao;Tien Dung Vu;Douglas L. Jones;Minh N. Do
Affiliations:
Advanced Digital Sciences Center, Illinois at Singapore, Singapore, Singapore;Advanced Digital Sciences Center, Illinois at Singapore, Singapore, Singapore;Advanced Digital Sciences Center, Illinois at Singapore, Singapore, Singapore;University of Illinois at Urbana-Champaign, IL, Urbana-Champaign, Illinois, USA;University of Illinois at Urbana-Champaign, Urbana-Champaign, Illinois, USA
Venue:
Proceedings of the 21st ACM international conference on Multimedia
Year:
2013

Citing 4
Cited 0

Distributed meetings: a meeting capture and broadcasting system

Proceedings of the tenth ACM international conference on Multimedia
Voice Source Localization for Automatic Camera Pointing System in Videoconferencing

ICASSP '97 Proceedings of the 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '97) -Volume 1 - Volume 1
CuteChat: a lightweight tele-immersive video chat system

MM '11 Proceedings of the 19th ACM international conference on Multimedia
Maximum Likelihood Sound Source Localization and Beamforming for Directional Microphone Arrays in Distributed Meetings

IEEE Transactions on Multimedia

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents a Spatialized Audio Multiparty Teleconferencing (SAMT) system with a radically new communication experience for group teleconferencing. The system includes our recently developed 3D audio technologies: 3D sound source localization (SSL) and 3D audio capture and reproduction using a low-cost and compact design microphone array. In essence, the SAMT system offers 3D audio capture capability and spatial audio perception with multiple participants at a site, which still falls short in teleconferencing solutions. In addition to being able to identify and automatically track the active speaker, the system allows more compelling visual presentation for effective communication. Requiring only a low-cost microphone array and a consumer depth camera, the proposed system runs reliably and comfortably in real time on a commodity laptop or desktop PC. With such a minimal deployment requirement, we present a variety of user experiences created by SAMT.