Loudness measurement of human utterance to a robot in noisy environment

Authors:
Satoshi Kagami;Yoko Sasaki;Simon Thompson;Tomoaki Fujihara;Tadashi Enomoto;Hiroshi Mizoguchi
Affiliations:
National Institute of Advanced Industrial Science and Technology, Tokyo, Japan;Tokyo University of Science, Chiba, Japan;National Institute of Advanced Industrial Science and Technology, Tokyo, Japan;Tokyo University of Science, Chiba, Japan;Kansai Electric Power Company, Inc., Hyogo, Japan;Tokyo University of Science, Chiba, Japan
Venue:
Proceedings of the 3rd ACM/IEEE international conference on Human robot interaction
Year:
2008

Citing 3
Cited 2

Integrated natural spoken dialogue system of Jijo-2 mobile robot for office services

AAAI '99/IAAI '99 Proceedings of the sixteenth national conference on Artificial intelligence and the eleventh Innovative applications of artificial intelligence conference innovative applications of artificial intelligence
Designing Sociable Robots

Designing Sociable Robots
Robust localization and tracking of simultaneous moving sound sources using beamforming and particle filtering

Robotics and Autonomous Systems

Evaluating the utility of auditory perspective-taking in robot speech presentations

CMMR/ICAD'09 Proceedings of the 6th international conference on Auditory Display
The false dichotomy between accessibility and usability

Proceedings of the 10th International Cross-Disciplinary Conference on Web Accessibility

Quantified Score

Hi-index	0.00

Visualization

Abstract

In order to understand utterance based human-robot interation, and to develop such a system, this paper initially analyzes how loud humans speak in a noisy environment. Experiments were conducted to measure how loud humans speak with 1) different noise levels, 2) different number of sound sources, 3) different sound sources, and 4) different distances to a robot. Synchronized sound sources add noise to the auditory scene, and resultant utterances are recorded and compared to a previously recorded noiseless utterance. From experiments, we understand that humans generate basically the same level of sound pressure level at his/her location irrespective of distance and background noise. More precisely, there is a band according to a distance, and also according to sound sources that is including language pronounce. According to this understanding, we developed an online spoken command recognition system for a mobile robot. System consists of two key componenets: 1) Low side-lobe microphone array that works as omini-directional telescopic microphone, and 2) DSBF combined with FBS method for sound source localization and segmentation. Caller location and segmented sound stream are calculated, and then the segmented sound stream is sent to voice recognition system. The system works with at most five sound sources at the same time with about at most 18[dB] sound pressure differences. Experimental results with the modile robot are also shown.