Blind separation of speech mixtures via time-frequency masking

Authors:
O. Yilmaz;S. Rickard
Affiliations:
Dept. of Math., Maryland Univ., College Park, MD, USA;-
Venue:
IEEE Transactions on Signal Processing
Year:
2004

Citing 0
Cited 127

An Adaptive Method for Subband Decomposition ICA

Neural Computation
The Cocktail Party Problem

Neural Computation
Underdetermined blind sparse source separation for arbitrarily arranged multiple sensors

Signal Processing
Audio source separation with a signal-adaptive local cosine transform

Signal Processing
Oracle estimators for the benchmarking of source separation algorithms

Signal Processing
Underdetermined blind audio source separation using modal decomposition

EURASIP Journal on Audio, Speech, and Music Processing
Speaker separation and tracking system

EURASIP Journal on Applied Signal Processing
Speech source separation in convolutive environments using space-time-frequency analysis

EURASIP Journal on Applied Signal Processing
Blind separation of nonstationary sources based on spatial time-frequency distributions

EURASIP Journal on Applied Signal Processing
Map-based underdetermined blind source separation of convolutive mixtures by hierarchical clustering and l1-norm minimization

EURASIP Journal on Applied Signal Processing
Underdetermined blind source separation in echoic environments using DESPRIT

EURASIP Journal on Applied Signal Processing
Using pitch, amplitude modulation, and spatial cues for separation of harmonic instruments from stereo music recordings

EURASIP Journal on Applied Signal Processing
3D-audio matting, postediting, and rerendering from field recordings

EURASIP Journal on Applied Signal Processing
Blind sparse source separation using cluster particle swarm optimization technique

AIAP'07 Proceedings of the 25th conference on Proceedings of the 25th IASTED International Multi-Conference: artificial intelligence and applications
A robust blind sparse source separation algorithm using genetic algorithm to identify mixing matrix

SPPR'07 Proceedings of the Fourth conference on IASTED International Conference: Signal Processing, Pattern Recognition, and Applications
Comparison of the wavelet and short time Fourier transforms for spectral analysis of speech signals

WAMUS'05 Proceedings of the 5th WSEAS International Conference on Wavelet Analysis and Multirate Systems
Blind partial separation of underdetermined convolutive mixtures of complex sources based on differential normalized kurtosis

Neurocomputing
An adaptive stereo basis method for convolutive blind audio source separation

Neurocomputing
Blind separation with unknown number of sources based on auto-trimmed neural network

Neurocomputing
Stereo audio source separation based on time--frequency masking and multilevel thresholding

Digital Signal Processing
Performance evaluation of blind source separation schemes in anechoic and echoic environments

ISPRA'08 Proceedings of the 7th WSEAS International Conference on Signal Processing, Robotics and Automation
A Speech Enhancement Method in Subband

ISNN '07 Proceedings of the 4th international symposium on Neural Networks: Advances in Neural Networks, Part III
Blind source separation with dynamic source number using adaptive neural algorithm

Expert Systems with Applications: An International Journal
K-hyperline clustering learning for sparse component analysis

Signal Processing
Underdetermined Blind Source Separation Using Linear Separation System

Multimodal Signals: Cognitive and Algorithmic Issues
Modeling the Short Time Fourier Transform Ratio and Application to Underdetermined Audio Source Separation

ICA '09 Proceedings of the 8th International Conference on Independent Component Analysis and Signal Separation
Iterative-Shift Cluster-Based Time-Frequency BSS for Fractional-Time-Delay Mixtures

ICA '09 Proceedings of the 8th International Conference on Independent Component Analysis and Signal Separation
Blind Non-stationnary Sources Separation by Sparsity in a Linear Instantaneous Mixture

ICA '09 Proceedings of the 8th International Conference on Independent Component Analysis and Signal Separation
Constructing Time-Frequency Dictionaries for Source Separation via Time-Frequency Masking and Source Localisation

ICA '09 Proceedings of the 8th International Conference on Independent Component Analysis and Signal Separation
Time Frequency Masking Strategy for Blind Source Separation of Acoustic Signals Based on Optimally-Modified LOG-Spectral Amplitude Estimator

ICA '09 Proceedings of the 8th International Conference on Independent Component Analysis and Signal Separation
An ICA-Based Method for Blind Source Separation in Sparse Domains

ICA '09 Proceedings of the 8th International Conference on Independent Component Analysis and Signal Separation
Limitations of the Spectrum Masking Technique for Blind Source Separation

ICA '09 Proceedings of the 8th International Conference on Independent Component Analysis and Signal Separation
Stereo Source Separation and Source Counting with MAP Estimation with Dirichlet Prior Considering Spatial Aliasing Problem

ICA '09 Proceedings of the 8th International Conference on Independent Component Analysis and Signal Separation
Blind Spectral-GMM Estimation for Underdetermined Instantaneous Audio Source Separation

ICA '09 Proceedings of the 8th International Conference on Independent Component Analysis and Signal Separation
Underdetermined Instantaneous Audio Source Separation via Local Gaussian Modeling

ICA '09 Proceedings of the 8th International Conference on Independent Component Analysis and Signal Separation
An algorithm for mixing matrix estimation in instantaneous blind source separation

Signal Processing
A novel fuzzy clustering algorithm using observation weighting and context information for reverberant blind speech separation

Signal Processing
Advanced narrow speech channeling algorithm for robot speech recognition

Proceedings of the 2009 International Conference on Hybrid Information Technology
A speaker diarization method based on the probabilistic fusion of audio-visual location information

Proceedings of the 2009 international conference on Multimodal interfaces
Indeterminacy free frequency-domain blind separation of reverberant audio sources

IEEE Transactions on Audio, Speech, and Language Processing
Determining mixing parameters from multispeaker data using speech-specific information

IEEE Transactions on Audio, Speech, and Language Processing
Underdetermined blind source separation based on subspace representation

IEEE Transactions on Signal Processing
Underdetermined blind source separation based on relaxed sparsity condition of sources

IEEE Transactions on Signal Processing
Comparing measures of sparsity

IEEE Transactions on Information Theory
The concept of narrow sound channel using binary time frequency masking for speech recognition of intelligent service robots

ICACT'09 Proceedings of the 11th international conference on Advanced Communication Technology - Volume 2
A robust blind sparse source separation algorithm using genetic algorithm to identify mixing matrix

SPPRA '07 Proceedings of the Fourth IASTED International Conference on Signal Processing, Pattern Recognition, and Applications
Mixing matrix identification for underdetermined blind signal separation: using hough transform and fuzzy K-means clustering

SMC'09 Proceedings of the 2009 IEEE international conference on Systems, Man and Cybernetics
Robot auditory system using head-mounted square microphone array

IROS'09 Proceedings of the 2009 IEEE/RSJ international conference on Intelligent robots and systems
Model-based expectation-maximization source separation and localization

IEEE Transactions on Audio, Speech, and Language Processing
A separating method using orthogonal properties between audio sources in frequency domain

ASMCSS'09 Proceedings of the 3rd International Conference on Applied Mathematics, Simulation, Modelling, Circuits, Systems and Signals
Underdetermined blind separation of non-sparse sources using spatial time-frequency distributions

Digital Signal Processing
A new approach to underdetermined blind source separation using sparse representation

RSKT'07 Proceedings of the 2nd international conference on Rough sets and knowledge technology
Blind audio source separation using sparsity based criterion for convolutive mixture case

ICA'07 Proceedings of the 7th international conference on Independent component analysis and signal separation
Estimator for number of sources using minimum description length criterion for blind sparse source mixtures

ICA'07 Proceedings of the 7th international conference on Independent component analysis and signal separation
Complex nonconvex lp norm minimization for underdetermined source separation

ICA'07 Proceedings of the 7th international conference on Independent component analysis and signal separation
Modeling perceptual similarity of audio signals for blind source separation evaluation

ICA'07 Proceedings of the 7th international conference on Independent component analysis and signal separation
A batch algorithm for blind source separation of acoustic signals using ICA and time-frequency masking

ICA'07 Proceedings of the 7th international conference on Independent component analysis and signal separation
First stereo audio source separation evaluation campaign: data, algorithms and results

ICA'07 Proceedings of the 7th international conference on Independent component analysis and signal separation
Learning of translation-invariant independent components: multivariate anechoic mixtures

ICA'07 Proceedings of the 7th international conference on Independent component analysis and signal separation
An optical access network system without a power supply using blind speech separation and a loopback technique

GLOBECOM'09 Proceedings of the 28th IEEE conference on Global telecommunications
Underdetermined convolutive blind source separation via time-frequency masking

IEEE Transactions on Audio, Speech, and Language Processing
A robust method to count and locate audio sources in a multichannel underdetermined mixture

IEEE Transactions on Signal Processing
Learning sparse representation using iterative subspace identification

IEEE Transactions on Signal Processing
Monaural speech/music source separation using discrete energy separation algorithm

Signal Processing
A new blind method for separating M+1 sources from M mixtures

Computers & Mathematics with Applications
Speech activity detection for multi-party conversation analyses based on likelihood ratio test on spatial magnitude

IEEE Transactions on Audio, Speech, and Language Processing
A watermarking-based method for informed source separation of audio signals with a single sensor

IEEE Transactions on Audio, Speech, and Language Processing
Beyond the narrowband approximation: wideband convex methods for under-determined reverberant audio source separation

IEEE Transactions on Audio, Speech, and Language Processing - Special issue on processing reverberant speech: methodologies and applications
Under-determined reverberant audio source separation using a full-rank spatial covariance model

IEEE Transactions on Audio, Speech, and Language Processing - Special issue on processing reverberant speech: methodologies and applications
Glimpsing IVA: a framework for overcomplete/complete/undercomplete convolutive source separation

IEEE Transactions on Audio, Speech, and Language Processing - Special issue on processing reverberant speech: methodologies and applications
Evaluating source separation algorithms with reverberant speech

IEEE Transactions on Audio, Speech, and Language Processing - Special issue on processing reverberant speech: methodologies and applications
Two-microphone multi-speaker localization based on a Laplacian Mixture Model

Digital Signal Processing
A two microphone-based approach for source localization of multiple speech sources

IEEE Transactions on Audio, Speech, and Language Processing
Multiple fundamental frequency estimation by modeling spectral peaks and non-peak regions

IEEE Transactions on Audio, Speech, and Language Processing
A deflation procedure for subspace decomposition

IEEE Transactions on Signal Processing
Optimal filter designs for separating and enhancing periodic signals

IEEE Transactions on Signal Processing
A sparsity-based approach to 3D binaural sound synthesis using time-frequency array processing

EURASIP Journal on Advances in Signal Processing - Special issue on digital audio effects
Under-determined reverberant audio source separation using local observed covariance and auditory-motivated time-frequency representation

LVA/ICA'10 Proceedings of the 9th international conference on Latent variable analysis and signal separation
Spatial efficiency of blind source separation based on decorrelation - subjective and objective assessment

Speech Communication
Independent component analysis and time-frequency masking for speech recognition in multitalker conditions

EURASIP Journal on Audio, Speech, and Music Processing
Correlation-based amplitude estimation of coincident partials in monaural musical signals

EURASIP Journal on Audio, Speech, and Music Processing
Underdetermined blind separation of non-disjoint signals in time-frequency domain based on matrix diagonalization

Signal Processing
Underdetermined DOA estimation via independent component analysis and time-frequency masking

Journal of Electrical and Computer Engineering
Combining localization cues and source model constraints for binaural source separation

Speech Communication
Source localization for multiple speech sources using low complexity non-parametric source separation and clustering

Signal Processing
DOA Estimation for Multiple Sparse Sources with Arbitrarily Arranged Multiple Sensors

Journal of Signal Processing Systems
Correlated Postfiltering and Mutual Information in Pseudoanechoic Model Based Blind Source Separation

Journal of Signal Processing Systems
Anechoic Blind Source Separation Using Wigner Marginals

The Journal of Machine Learning Research
Robot with two ears listens to more than two simultaneous utterances by exploiting harmonic structures

IEA/AIE'11 Proceedings of the 24th international conference on Industrial engineering and other applications of applied intelligent systems conference on Modern approaches in applied intelligence - Volume Part I
Interactive music with active audio CDs

CMMR'10 Proceedings of the 7th international conference on Exploring music contents
Pattern induction and matching in music signals

CMMR'10 Proceedings of the 7th international conference on Exploring music contents
Neural networks for speech separation for binaural hearing aids

GAVTASC'11 Proceedings of the 11th WSEAS international conference on Signal processing, computational geometry and artificial vision, and Proceedings of the 11th WSEAS international conference on Systems theory and scientific computation
Underdetermined Sparse Blind Source Separation of Nonnegative and Partially Overlapped Data

SIAM Journal on Scientific Computing
K-EVD clustering and its applications to sparse component analysis

ICA'06 Proceedings of the 6th international conference on Independent Component Analysis and Blind Signal Separation
BLUES from music: BLind underdetermined extraction of sources from music

ICA'06 Proceedings of the 6th international conference on Independent Component Analysis and Blind Signal Separation
A robust method to count and locate audio sources in a stereophonic linear instantaneous mixture

ICA'06 Proceedings of the 6th international conference on Independent Component Analysis and Blind Signal Separation
Under-Determined source separation: comparison of two approaches based on sparse decompositions

ICA'06 Proceedings of the 6th international conference on Independent Component Analysis and Blind Signal Separation
Separation of mixed audio signals by source localization and binary masking with hilbert spectrum

ICA'06 Proceedings of the 6th international conference on Independent Component Analysis and Blind Signal Separation
Separating underdetermined convolutive speech mixtures

ICA'06 Proceedings of the 6th international conference on Independent Component Analysis and Blind Signal Separation
On calculating the inverse of separation matrix in frequency-domain blind source separation

ICA'06 Proceedings of the 6th international conference on Independent Component Analysis and Blind Signal Separation
The cocktail party robot: sound source separation and localisation with an active binaural head

HRI '12 Proceedings of the seventh annual ACM/IEEE international conference on Human-Robot Interaction
A tractable framework for estimating and combining spectral source models for audio source separation

Signal Processing
The signal separation evaluation campaign (2007-2010): Achievements and remaining challenges

Signal Processing
Informed source separation through spectrogram coding and data embedding

Signal Processing
Multi-source TDOA estimation in reverberant audio using angular spectra and clustering

Signal Processing
K-hyperplanes clustering and its application to sparse component analysis

ICONIP'06 Proceedings of the 13 international conference on Neural Information Processing - Volume Part I
Underdetermined blind separation of speech signals with delays in different time-frequency domains

Nonlinear Speech Modeling and Applications
A quantitative evaluation of a bio-inspired sound segregation technique for two- and three-source mixtures

Nonlinear Speech Modeling and Applications
Speech source separation using a generalized mean shift algorithm

Signal Processing
Low-Latency instrument separation in polyphonic audio using timbre models

LVA/ICA'12 Proceedings of the 10th international conference on Latent Variable Analysis and Signal Separation
A latently constrained mixture model for audio source separation and localization

LVA/ICA'12 Proceedings of the 10th international conference on Latent Variable Analysis and Signal Separation
Enhancing the energy efficiency of wireless-communicated binaural hearing aids for speech separation driven by soft-computing algorithms

Applied Soft Computing
Acoustic Rendering and Auditory–Visual Cross-Modal Perception and Interaction

Computer Graphics Forum
Time-frequency analysis of signals using support adaptive Hermite-Gaussian expansions

Digital Signal Processing
Cluster-based dynamic variance adaptation for interconnecting speech enhancement pre-processor and speech recognizer

Computer Speech and Language
Mixing matrix estimation using discriminative clustering for blind source separation

Digital Signal Processing
Online blind speech separation using multiple acoustic speaker tracking and time-frequency masking

Computer Speech and Language
Speech recognition in living rooms: Integrated speech enhancement and recognition system based on spatial, spectral and temporal modeling of sounds

Computer Speech and Language
Sparse coding with adaptive dictionary learning for underdetermined blind speech separation

Speech Communication
Real and imaginary modulation spectral subtraction for speech enhancement

Speech Communication
Approximated Cramér-Rao bound for estimating the mixing matrix in the two-sensor noisy Sparse Component Analysis (SCA)

Digital Signal Processing
Modulation domain blind speech separation in noisy environments

Speech Communication
Fast communication: Extension of DUET to single-channel mixing model and separability analysis

Signal Processing
Noise variance estimation based on dual-channel phase difference for speech enhancement

Digital Signal Processing
Location Feature Integration for Clustering-Based Speech Separation in Distributed Microphone Arrays

IEEE/ACM Transactions on Audio, Speech and Language Processing (TASLP)
Bayesian Nonparametrics for Microphone Array Processing

IEEE/ACM Transactions on Audio, Speech and Language Processing (TASLP)
The analysis of the simplification from the ideal ratio to binary mask in signal-to-noise ratio sense

Speech Communication

Quantified Score

Hi-index	35.77

Visualization

Abstract

Binary time-frequency masks are powerful tools for the separation of sources from a single mixture. Perfect demixing via binary time-frequency masks is possible provided the time-frequency representations of the sources do not overlap: a condition we call W-disjoint orthogonality. We introduce here the concept of approximate W-disjoint orthogonality and present experimental results demonstrating the level of approximate W-disjoint orthogonality of speech in mixtures of various orders. The results demonstrate that there exist ideal binary time-frequency masks that can separate several speech signals from one mixture. While determining these masks blindly from just one mixture is an open problem, we show that we can approximate the ideal masks in the case where two anechoic mixtures are provided. Motivated by the maximum likelihood mixing parameter estimators, we define a power weighted two-dimensional (2-D) histogram constructed from the ratio of the time-frequency representations of the mixtures that is shown to have one peak for each source with peak location corresponding to the relative attenuation and delay mixing parameters. The histogram is used to create time-frequency masks that partition one of the mixtures into the original sources. Experimental results on speech mixtures verify the technique. Example demixing results can be found online at http://alum.mit.edu/www/rickard/bss.html.