Speech understanding in open tasks

Authors:
Wayne Ward;Sunil Issar;Xuedong Huang;Hsiao-Wuen Hon;Mei-Yuh Hwang;Sheryl Young;Mike Matessa;Fu-Hua Liu;Richard Stern
Affiliations:
Carnegie Mellon University, Pittsburgh, PA;Carnegie Mellon University, Pittsburgh, PA;Carnegie Mellon University, Pittsburgh, PA;Carnegie Mellon University, Pittsburgh, PA;Carnegie Mellon University, Pittsburgh, PA;Carnegie Mellon University, Pittsburgh, PA;Carnegie Mellon University, Pittsburgh, PA;Carnegie Mellon University, Pittsburgh, PA;Carnegie Mellon University, Pittsburgh, PA
Venue:
HLT '91 Proceedings of the workshop on Speech and Natural Language
Year:
1992

Citing 3
Cited 4

Evaluation of the CMU ATIS system

HLT '91 Proceedings of the workshop on Speech and Natural Language
The CMU air travel information service: understanding spontaneous speech

HLT '90 Proceedings of the workshop on Speech and Natural Language
Multiple approaches to robust speech recognition

HLT '91 Proceedings of the workshop on Speech and Natural Language

The Application of Semantic Classification Trees to Natural Language Understanding

IEEE Transactions on Pattern Analysis and Machine Intelligence
DARPA February 1992 ATIS benchmark test results

HLT '91 Proceedings of the workshop on Speech and Natural Language
Multiple approaches to robust speech recognition

HLT '91 Proceedings of the workshop on Speech and Natural Language
Learning speech semantics with keyword classification trees

ICASSP'93 Proceedings of the 1993 IEEE international conference on Acoustics, speech, and signal processing: speech processing - Volume II

Quantified Score

Hi-index	0.00

Visualization

Abstract

The Air Traffic Information Service task is currently used by DARPA as a common evaluation task for Spoken Language Systems. This task is an example of open type tasks. Subjects are given a task and allowed to interact spontaneously with the system by voice. There is no fixed lexicon or grammar, and subjects are likely to exceed those used by any given system. In order to evaluate system performance on such tasks, a common corpus of training data has been gathered and annotated. An independent test corpus was also created in a similar fashion. This paper explains the techniques used in our system and the performance results on the standard set of tests used to evaluate systems.