A multichannel sinusoidal model applied to spot microphone signals for immersive audio

Authors:
Christos Tzagkarakis;Athanasios Mouchtaris;Panagiotis Tsakalides
Affiliations:
Computer Science Department, University of Crete, Heraklion, Crete, Greece and Institute of Computer Science, Foundation for Research and Technology-Hellas, Heraklion, Crete, Greece;Computer Science Department, University of Crete, Heraklion, Crete, Greece and Institute of Computer Science, Foundation for Research and Technology-Hellas, Heraklion, Crete, Greece;Computer Science Department, University of Crete, Heraklion, Crete, Greece and Institute of Computer Science, Foundation for Research and Technology-Hellas, Heraklion, Crete, Greece
Venue:
IEEE Transactions on Audio, Speech, and Language Processing
Year:
2009

Citing 8
Cited 0

High-resolution voice transformation

High-resolution voice transformation
Residual modeling in music analysis-synthesis

ICASSP '96 Proceedings of the Acoustics, Speech, and Signal Processing, 1996. on Conference Proceedings., 1996 IEEE International Conference - Volume 02
Exploiting time and frequency masking in consistent sinusoidal analysis-synthesis

ICASSP '00 Proceedings of the Acoustics, Speech, and Signal Processing, 2000. on IEEE International Conference - Volume 02
Virtual microphones for multichannel audio resynthesis

EURASIP Journal on Applied Signal Processing
Parametric coding of stereo audio

EURASIP Journal on Applied Signal Processing
Multiresolution source/filter model for low bitrate coding of spot microphone signals

EURASIP Journal on Audio, Speech, and Music Processing - Atypical Speech
High-Resolution Spherical Quantization of Sinusoidal Parameters

IEEE Transactions on Audio, Speech, and Language Processing
Enhancing the Tracking of Partials for the Sinusoidal Modeling of Polyphonic Sounds

IEEE Transactions on Audio, Speech, and Language Processing

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, a multichannel version of the sinusoids plus noise model (also known as deterministic plus stochastic decomposition) is proposed and applied to spot microphone signals of a music recording. These are the recordings captured by the various microphones placed in a venue, before the mixing process produces the final multichannel audio mix. Coding these microphone signals makes them available to the decoder, allowing for interactive audio reproduction which is a necessary component in immersive audio applications. The proposed model uses a single reference audio signal in order to derive a noise signal per spot microphone. This noise signal can significantly enhance the sinusoidal representation of the corresponding spot signal. The reference can be one of the spot signals or a downmix, depending on the application. Thus, for a collection of multiple spot signals, only the reference is fully encoded (e.g., as an MP3 monophonic signal). For the remaining spot signals, their sinusoidal parameters and corresponding noise spectral envelopes are retained and coded, resulting in bitrates for this side information in the order of 15 kb/s for perceptual performance above the 4.0 grade on the mean opinion score (MOS) scale.