Role of modulation magnitude and phase spectrum towards speech intelligibility

Authors:
Kuldip Paliwal;Belinda Schwerin;Kamil Wójcicki
Affiliations:
Signal Processing Laboratory, School of Engineering, Griffith University, Nathan Campus, Brisbane QLD 4111, Australia;Signal Processing Laboratory, School of Engineering, Griffith University, Nathan Campus, Brisbane QLD 4111, Australia;Signal Processing Laboratory, School of Engineering, Griffith University, Nathan Campus, Brisbane QLD 4111, Australia
Venue:
Speech Communication
Year:
2011

Citing 10
Cited 3

Effects of phase on the perception of intervocalic stop consonants

Speech Communication
Robust speech recognition using the modulation spectrogram

Speech Communication - Special issue on robust speech recognition
Spoken Language Processing: A Guide to Theory, Algorithm, and System Development

Spoken Language Processing: A Guide to Theory, Algorithm, and System Development
The Modulation Spectrogram: In Pursuit of an Invariant Representation of Speech

ICASSP '97 Proceedings of the 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '97)-Volume 3 - Volume 3
Subjective comparison and evaluation of speech enhancement algorithms

Speech Communication
Discrete-time speech signal processing: principles and practice

Discrete-time speech signal processing: principles and practice
Automatic recognition of speech emotion using long-term spectro-temporal features

DSP'09 Proceedings of the 16th international conference on Digital Signal Processing
Single-channel speech enhancement using spectral subtraction in the short-time modulation domain

Speech Communication
Modulation spectral features for robust far-field speaker identification

IEEE Transactions on Audio, Speech, and Language Processing
A non-intrusive quality and intelligibility measure of reverberant and dereverberated speech

IEEE Transactions on Audio, Speech, and Language Processing - Special issue on processing reverberant speech: methodologies and applications

Modulation-domain Kalman filtering for single-channel speech enhancement

Speech Communication
Speech enhancement using a minimum mean-square error short-time spectral modulation magnitude estimator

Speech Communication
Using STFT real and imaginary parts of modulation signals for MMSE-based speech enhancement

Speech Communication

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper our aim is to investigate the properties of the modulation domain and more specifically, to evaluate the relative contributions of the modulation magnitude and phase spectra towards speech intelligibility. For this purpose, we extend the traditional (acoustic domain) analysis-modification-synthesis framework to include modulation domain processing. We use this framework to construct stimuli that retain only selected spectral components, for the purpose of objective and subjective intelligibility tests. We conduct three experiments. In the first, we investigate the relative contributions to intelligibility of the modulation magnitude, modulation phase, and acoustic phase spectra. In the second experiment, the effect of modulation frame duration on intelligibility for processing of the modulation magnitude spectrum is investigated. In the third experiment, the effect of modulation frame duration on intelligibility for processing of the modulation phase spectrum is investigated. Results of these experiments show that both the modulation magnitude and phase spectra are important for speech intelligibility, and that significant improvement is gained by the inclusion of acoustic phase information. They also show that smaller modulation frame durations improve intelligibility when processing the modulation magnitude spectrum, while longer frame durations improve intelligibility when processing the modulation phase spectrum.