Joint acoustic and modulation frequency

Authors:
Les Atlas;Shihab A. Shamma
Affiliations:
Department of Electrical Engineering, Seattle, WA;Department of Electrical and Computer Engineering and Center for Auditory and Acoustic Research, Institute for Systems Research, University of Maryland, College Park, MD
Venue:
EURASIP Journal on Applied Signal Processing
Year:
2003

Citing 5
Cited 16

Statistical spectral analysis: a nonprobabilistic theory

Statistical spectral analysis: a nonprobabilistic theory
The Modulation Spectrogram: In Pursuit of an Invariant Representation of Speech

ICASSP '97 Proceedings of the 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '97)-Volume 3 - Volume 3
Perceptually inspired signal processing strategies for robust speech recognition in reverberant environments

Perceptually inspired signal processing strategies for robust speech recognition in reverberant environments
Scalable and progressive audio codec

ICASSP '01 Proceedings of the Acoustics, Speech, and Signal Processing, 2001. on IEEE International Conference - Volume 05
Estimation of modulation based on FM-to-AM transduction: two-sinusoid case

IEEE Transactions on Signal Processing

Towards low-power on-chip auditory processing

EURASIP Journal on Applied Signal Processing
Source separation with one ear: proposition for an anthropomorphic approach

EURASIP Journal on Applied Signal Processing
A physiologically inspired method for audio classification

EURASIP Journal on Applied Signal Processing
Monophonic sound source separation with an unsupervised network of spiking neurones

Neurocomputing
Temporal contrast normalization and edge-preserved smoothing of temporal modulation structures of speech for robust speech recognition

Speech Communication
An overview of text-independent speaker recognition: From features to supervectors

Speech Communication
Automatic music genre classification based on modulation spectral analysis of spectral and cepstral features

IEEE Transactions on Multimedia
Single-channel speech enhancement using spectral subtraction in the short-time modulation domain

Speech Communication
Temporal modulation normalization for robust speech feature extraction and recognition

Multimedia Tools and Applications
Discrimination of speech from nonspeeech in broadcast news based on modulation frequency features

Speech Communication
Automatic speech emotion recognition using modulation spectral features

Speech Communication
Modulation-domain Kalman filtering for single-channel speech enhancement

Speech Communication
Speech enhancement using a minimum mean-square error short-time spectral modulation magnitude estimator

Speech Communication
Artist filtering for non-western music classification

Proceedings of the 6th Audio Mostly Conference: A Conference on Interaction with Sound
Perceptive, non-linear speech processing and spiking neural networks

Nonlinear Speech Modeling and Applications
Modulation domain blind speech separation in noisy environments

Speech Communication

Quantified Score

Hi-index	0.00

Visualization

Abstract

There is a considerable evidence that our perception of sound uses important features which are related to underlying signal modulations. This topic has been studied extensively via perceptual experiments, yet there are few, if any, well-developed signal processing methods which capitalize on or model these effects. We begin by summarizing evidence of the importance of modulation representations from psychophysical, physiological, and other sources. The concept of a two-dimensional joint acoustic and modulation frequency representation is proposed. A simple single sinusoidal amplitude modulator of a sinusoidal carrier is then used to illustrate properties of an unconstrained and ideal joint representation. Added constraints are required to remove or reduce undesired interference terms and to provide invertibility. It is then noted that the constraints would be also applied to more general and complex cases of broader modulation and carriers. Applications in single-channel speaker separation and in audio coding are used to illustrate the applicability of this joint representation. Other applications in signal analysis and filtering are suggested.