Multimodal speech separation

Authors:
Bertrand Rivet;Jonathon Chambers
Affiliations:
GIPSA-lab, CNRS UMR-5216, Grenoble INP, Grenoble, France;Electronic and Electrical Engineering, Loughborough University, UK
Venue:
NOLISP'09 Proceedings of the 2009 international conference on Advances in Nonlinear Speech Processing
Year:
2009

Citing 7
Cited 0

Space or time adaptive signal processing by neural network models

AIP Conference Proceedings 151 on Neural Networks for Computing
Blind separation of sources, Part 1: an adaptive algorithm based on neuromimetic architecture

Signal Processing
Independent component analysis, a new concept?

Signal Processing - Special issue on higher order statistics
Visual voice activity detection as a help for speech source separation from convolutive mixtures

Speech Communication
Separation of audio-visual speech sources: a new approach exploiting the audio-visual coherence of speech stimuli

EURASIP Journal on Applied Signal Processing
Log-Rayleigh Distribution: A Simple and Efficient Statistical Representation of Log-Spectral Coefficients

IEEE Transactions on Audio, Speech, and Language Processing
Mixing Audiovisual Speech Processing and Blind Source Separation for the Extraction of Speech Signals From Convolutive Mixtures

IEEE Transactions on Audio, Speech, and Language Processing

Quantified Score

Hi-index	0.00

Visualization

Abstract

The work of Bernstein and Benoît has confirmed that it is advantageous to use multiple senses, for example to employ both audio and visual modalities, in speech perception. As a consequence, looking at the speaker's face can be useful to better hear a speech signal in a noisy environment and to extract it from competing sources, as originally identified by Cherry, who posed the so-called “Cocktail Party” problem. To exploit the intrinsic coherence between audition and vision within a machine, the method of blind source separation (BSS) is particularly attractive.