Evaluating source separation algorithms with reverberant speech

  • Authors:
  • Michael I. Mandel;Scott Bressler;Barbara Shinn-Cunningham;Daniel P. W. Ellis

  • Affiliations:
  • Département d'informatique et de Recherche Opérationnelle, Université de Montréal, Montreal, QC, Canada;Department of Cognitive and Neural Systems, Boston University, Boston, MA;Department of Cognitive and Neural Systems, Boston University, Boston, MA;Department of Electrical Engineering, Columbia University, New York, NY

  • Venue:
  • IEEE Transactions on Audio, Speech, and Language Processing - Special issue on processing reverberant speech: methodologies and applications
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper examines the performance of several source separation systems on a speech separation task for which human intelligibility has previously been measured. For anechoic mixtures, automatic speech recognition (ASR) performance on the separated signals is quite similar to human performance. In reverberation, however, while signal separation has some benefit for ASR, the results are still far below those of human listeners facing the same task. Performing this same experiment with a number of oracle masks created with a priori knowledge of the separated sources motivates a new objective measure of separation performance, the Direct-path, Early echo, and Reverberation, of the Target and Masker (DERTM), which is closely related to the ASR results. This measure indicates that while the nonoracle algorithms successfully reject the direct-path signal from the masking source, they reject less of its reverberation, explaining the disappointing ASR performance.