Role of head pose estimation in speech acquisition from distant microphones

Authors:
Shankar T. Shivappa;Bhaskar D. Rao;Mohan M. Trivedi
Affiliations:
University of California, San Diego, Department of Electrical and Computer Engineering, 9500 Gilman Drive, La Jolla, 92093, USA;University of California, San Diego, Department of Electrical and Computer Engineering, 9500 Gilman Drive, La Jolla, 92093, USA;University of California, San Diego, Department of Electrical and Computer Engineering, 9500 Gilman Drive, La Jolla, 92093, USA
Venue:
ICASSP '09 Proceedings of the 2009 IEEE International Conference on Acoustics, Speech and Signal Processing
Year:
2009

Citing 0
Cited 2

An environment aware ML estimation of acoustic radiation pattern with distributed microphone pairs

Signal Processing
Directional acoustic source orientation estimation using only two microphones

Digital Signal Processing

Quantified Score

Hi-index	0.00

Visualization

Abstract

Reverberant environments pose a challenge to speech acquisition from distant microphones. Approaches using microphone arrays have met with limited success. Recent research using audio-visual sensors for tasks such as speaker localization has shown improvement over traditional audio-only approaches. Using computer vision techniques we can estimate the orientation of the speaker's head in addition to the location of the speaker. In this paper we study the utility of using the head pose information for effective beamforming and clean speech acquisition from distant microphones. The improvements in speech recognition accuracy relative to that of a close talking microphone are presented and the results provide sufficient motivation for incorporating head pose information in beamforming techniques.