A sparsity-based approach to 3D binaural sound synthesis using time-frequency array processing

Authors:
Maximo Cobos;Jose J. Lopez;Sascha Spors
Affiliations:
Institute of Telecommunications and Multimedia Applications, Universidad Politécnica de Valencia, Valencia, Spain;Institute of Telecommunications and Multimedia Applications, Universidad Politécnica de Valencia, Valencia, Spain;Deutsche Telekom Laboratories, Technische Universität Berlin, Berlin, Germany
Venue:
EURASIP Journal on Advances in Signal Processing - Special issue on digital audio effects
Year:
2010

Citing 6
Cited 2

Time-frequency analysis: theory and applications

Time-frequency analysis: theory and applications
Blind separation of disjoint orthogonal signals: demixing N sources from 2 mixtures

ICASSP '00 Proceedings of the Acoustics, Speech, and Signal Processing, 2000. on IEEE International Conference - Volume 05
Binaural rendering in MPEG surround

EURASIP Journal on Advances in Signal Processing
A Uniform Framework for Ad-Hoc Indexes to Answer Reachability Queries on Large Graphs

DASFAA '09 Proceedings of the 14th International Conference on Database Systems for Advanced Applications
Spatial Audio Processing: MPEG Surround and Other Applications

Spatial Audio Processing: MPEG Surround and Other Applications
Blind separation of speech mixtures via time-frequency masking

IEEE Transactions on Signal Processing

3D Virtual worlds and the metaverse: Current status and future possibilities

ACM Computing Surveys (CSUR)
Capturing and reproducing spatial audio based on a circular microphone array

Journal of Electrical and Computer Engineering

Quantified Score

Hi-index	0.00

Visualization

Abstract

Localization of sounds in physical space plays a very important role in multiple audio-related disciplines, such as music, telecommunications, and audiovisual productions. Binaural recording is the most commonly used method to provide an immersive sound experience by means of headphone reproduction. However, it requires a very specific recording setup using high-fidelity microphones mounted in a dummy head. In this paper, we present a novel processing framework for binaural sound recording and reproduction that avoids the use of dummy heads, which is specially suitable for immersive teleconferencing applications. The method is based on a time-frequency analysis of the spatial properties of the sound picked up by a simple tetrahedral microphone array, assuming source sparseness. The experiments carried out using simulations and a real-time prototype confirm the validity of the proposed approach.