On building immersive audio applications using robust adaptive beamforming and joint audio-video source localization

Authors:
J. A. Beracoechea;S. Torres-Guijarro;L. García;F. J. Casajús-Quirós
Affiliations:
Departamento de Señales, Sistemas y Radiocomunicaciones, Universidad Politécnica de Madrid, Madrid, Spain;Departamento de Señales, Sistemas y Radiocomunicaciones, Universidad Politécnica de Madrid, Madrid, Spain;Departamento de Señales, Sistemas y Radiocomunicaciones, Universidad Politécnica de Madrid, Madrid, Spain;Departamento de Señales, Sistemas y Radiocomunicaciones, Universidad Politécnica de Madrid, Madrid, Spain
Venue:
EURASIP Journal on Applied Signal Processing
Year:
2006

Citing 7
Cited 3

Adaptive filter theory (2nd ed.)

Adaptive filter theory (2nd ed.)
On the implementation of a partitioned block frequency domain adaptive filter (PBFDAF) for long acoustic echo cancellation

Signal Processing - Special issue on acoustic echo control
Three-dimensional computer vision: a geometric viewpoint

Three-dimensional computer vision: a geometric viewpoint
Voice Source Localization for Automatic Camera Pointing System in Videoconferencing

ICASSP '97 Proceedings of the 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '97) -Volume 1 - Volume 1
A generative framework for real time object detection and classification

Computer Vision and Image Understanding - Special issue on eye detection and tracking
Detection and separation of speech event using audio and video information fusion and its application to robust speech interface

EURASIP Journal on Applied Signal Processing
A robust adaptive beamformer for microphone arrays with a blockingmatrix using constrained adaptive filters

IEEE Transactions on Signal Processing

A 3d-audio reconfigurable processor

Proceedings of the 18th annual ACM/SIGDA international symposium on Field programmable gate arrays
A reconfigurable audio beamforming multi-core processor

ARC'11 Proceedings of the 7th international conference on Reconfigurable computing: architectures, tools and applications
Custom architecture for multicore audio beamforming systems

ACM Transactions on Embedded Computing Systems (TECS) - Special issue on application-specific processors

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper deals with some of the different problems, strategies, and solutions of building true immersive audio systems oriented to future communication applications. The aim is to build a system where the acoustic field of a chamber is recorded using a microphone array and then is reconstructed or rendered again, in a different chamber using loudspeaker array-based techniques. Our proposal explores the possibility of using recent robust adaptive beamforming techniques for effectively estimating the original sources of the emitting room. A joint audio-video localization method needed in the estimation process as well as in the rendering engine is also presented. The estimated source signal and the source localization information drive a wave field synthesis engine that renders the acoustic field again at the receiving chamber. The system performance is tested using MUSHRA-based subjective tests.