A Study on Demonstrative Words Extraction in Instructor Utterance on Communication Support for Hearing Impaired Persons

Authors:
Ayaka Ito;Ken Saito;Yoshinori Takeuchi;Noboru Ohnishi;Shigeyoshi Iizuka;Shinya Nakajima
Affiliations:
Graduate School of Information Science, Nagoya University, Nagoya, Japan 464-8603;Graduate School of Information Science, Nagoya University, Nagoya, Japan 464-8603;Information and Communications Headquarters, Nagoya University, Nagoya, Japan 464-8603 and Bio-Mimetic Control Research Center, RIKEN, Nagoya, Japan 463-0003;Graduate School of Information Science, Nagoya University, Nagoya, Japan 464-8603;NTT Cyber Solutions Laboratories,;School of Science and Engineering, Kokushikan University,
Venue:
ICCHP '08 Proceedings of the 11th international conference on Computers Helping People with Special Needs
Year:
2008

Citing 4
Cited 1

Passive capture and structuring of lectures

MULTIMEDIA '99 Proceedings of the seventh ACM international conference on Multimedia (Part 1)
Shooting the Lecture Scene Using Computer-controlled Cameras Based on Situation Understanding and Evaluation of Video Images

ICPR '04 Proceedings of the Pattern Recognition, 17th International Conference on (ICPR'04) Volume 1 - Volume 01
Camera control for remote transcription system

CGIM '08 Proceedings of the Tenth IASTED International Conference on Computer Graphics and Imaging
Communication supporting system in a classroom environment for the hearing impaired

ICCHP'06 Proceedings of the 10th international conference on Computers Helping People with Special Needs

A system for matching mathematical formulas spoken during a lecture with those displayed on the screen for use in remote transcription

ICCHP'12 Proceedings of the 13th international conference on Computers Helping People with Special Needs - Volume Part I

Quantified Score

Hi-index	0.00

Visualization

Abstract

Remote transcription system is one of the communication support systems for hearing impaired students in a lecture. Because the remote transcription system requires several seconds from the utterance of the instructor to displaying the summarized text, hearing impaired students cannot associate the demonstrative word. In this paper, we analyze how demonstrative words appear in the utterance of instructor. About 75% of demonstrative words follow the pause and are uttered within 500ms after the pause. We propose a method for extracting demonstrative words based on acoustic features and conducted experiments. Experimental results show that the recall rate is more than 80% but the relevance rate is less than 20% in the cross validation test.