Audiovisual Arrays for Untethered Spoken Interfaces

Authors:
Kevin Wilson;Vibhav Rangarajan;Neal Checka;Trevor Darrell
Affiliations:
Massachusetts Institute of Technology;Massachusetts Institute of Technology;Massachusetts Institute of Technology;Massachusetts Institute of Technology
Venue:
ICMI '02 Proceedings of the 4th IEEE International Conference on Multimodal Interfaces
Year:
2002

Citing 6
Cited 0

Integrated Person Tracking Using Stereo, Color, and Pattern Detection

International Journal of Computer Vision - Special issue on a special section on visual surveillance
Fast Lighting Independent Background Subtraction

International Journal of Computer Vision - Special issue on a special section on visual surveillance
The Huge Microphone Array

IEEE Concurrency
Probabalistic Models and Informative Subspaces for Audiovisual Correspondence

ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part III
LISTEN: A System for Locating and Tracking Individual Speakers

FG '96 Proceedings of the 2nd International Conference on Automatic Face and Gesture Recognition (FG '96)
Multi-Camera Multi-Person Tracking for EasyLiving

VS '00 Proceedings of the Third IEEE International Workshop on Visual Surveillance (VS'2000)

Quantified Score

Hi-index	0.00

Visualization

Abstract

When faced with a distant speaker at a known location in a noisy environment, a microphonearray can provide a significantly improved audio signal for speech recognition. Estimating thelocation of a speaker in a reverberant environment from audio information alone can be quitedifficult, so we use an array of video cameras to aid localization. Stereo processing techniques are used on pairs of cameras, and foreground 3-D points are grouped to estimate the trajectory of people as they move in an environment. These trajectories are used to guide a microphone array beamformer. Initial results using this system for speech recognition demonstrate increased recognition rates compared to non-array processing techniques.