Benchmark tests for the DARPA Spoken Language Program

Authors:
David S. Pallett;Johathan G. Fiscus;William M. Fisher;John S. Garofolo
Affiliations:
National Institute of Standards and Technology, Gaithersburg, MD;National Institute of Standards and Technology, Gaithersburg, MD;National Institute of Standards and Technology, Gaithersburg, MD;National Institute of Standards and Technology, Gaithersburg, MD
Venue:
HLT '93 Proceedings of the workshop on Human Language Technology
Year:
1993

Citing 15
Cited 11

Performance assessment of automatic speech recognizers

Journal of Research of the National Institute of Standards and Technology
DARPA February 1992 ATIS benchmark test results

HLT '91 Proceedings of the workshop on Speech and Natural Language
DARPA February 1992 pilot corpus CSR "dry run" benchmark test results

HLT '91 Proceedings of the workshop on Speech and Natural Language
Multi-site data collection and evaluation in spoken language understanding

HLT '93 Proceedings of the workshop on Human Language Technology
A portable approach to last resort parsing and interpretation

HLT '93 Proceedings of the workshop on Human Language Technology
Gemini: a natural language system for spoken-language understanding

HLT '93 Proceedings of the workshop on Human Language Technology
Efficient cepstral normalization for robust speech recognition

HLT '93 Proceedings of the workshop on Human Language Technology
Comparative experiments on large vocabulary speech recognition

HLT '93 Proceedings of the workshop on Human Language Technology
Progressive-search algorithms for large-vocabulary speech recognition

HLT '93 Proceedings of the workshop on Human Language Technology
The BBN/HARC spoken language understanding system

ICASSP'93 Proceedings of the 1993 IEEE international conference on Acoustics, speech, and signal processing: speech processing - Volume II
An improved search algorithm using incremental knowledge for continuous speech recognition

ICASSP'93 Proceedings of the 1993 IEEE international conference on Acoustics, speech, and signal processing: speech processing - Volume II
Predicting unseen triphones with senones

ICASSP'93 Proceedings of the 1993 IEEE international conference on Acoustics, speech, and signal processing: speech processing - Volume II
Large-vocabulary dictation using SRI's DECIPHERTM speech recognition system: progressive search techniques

ICASSP'93 Proceedings of the 1993 IEEE international conference on Acoustics, speech, and signal processing: speech processing - Volume II
Large vocabulary continuous speech recognition of wall street journal data

ICASSP'93 Proceedings of the 1993 IEEE international conference on Acoustics, speech, and signal processing: speech processing - Volume II
The Lincoln large-vocabulary stack-decoder HMM CSR

ICASSP'93 Proceedings of the 1993 IEEE international conference on Acoustics, speech, and signal processing: speech processing - Volume II

Automatic language and information processing: rethinking evaluation

Natural Language Engineering
Interleaving syntax and semantics in an efficient bottom-up parser

ACL '94 Proceedings of the 32nd annual meeting on Association for Computational Linguistics
Multi-site data collection and evaluation in spoken language understanding

HLT '93 Proceedings of the workshop on Human Language Technology
The Semantic Linker: a new fragment combining method

HLT '93 Proceedings of the workshop on Human Language Technology
Comparative experiments on large vocabulary speech recognition

HLT '93 Proceedings of the workshop on Human Language Technology
Expanding the scope of the ATIS task: the ATIS-3 corpus

HLT '94 Proceedings of the workshop on Human Language Technology
Language modeling with sentence-level mixtures

HLT '94 Proceedings of the workshop on Human Language Technology
Session summary

HLT '94 Proceedings of the workshop on Human Language Technology
Pegasus: a spoken language interface for on-line air travel planning

HLT '94 Proceedings of the workshop on Human Language Technology
High-accuracy large-vocabulary speech recognition using mixture tying and consistency modeling

HLT '94 Proceedings of the workshop on Human Language Technology
The LIMSI continuous speech dictation system

HLT '94 Proceedings of the workshop on Human Language Technology

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper documents benchmark tests implemented within the DARPA Spoken Language Program during the period November, 1992 - January, 1993. Tests were conducted using the Wall Street Journal-based Continuous Speech Recognition (WSJ-CSR) corpus and the Air Travel Information System (ATIS) corpus collected by the Multi-site ATIS Data COllection Working (MADCOW) Group. The WSJ-CSR tests consist of tests of large vocabulary (lexicons of 5,000 to more than 20,000 words) continuous speech recognition systems. The ATIS tests consist of tests of (1) ATIS-domain spontaneous speech (lexicons typically less than 2,000 words), (2) natural language understanding, and (3) spoken language understanding. These tests were reported on and discussed in detail at the Spoken Language Systems Technology Workshop held at the Massachusetts Institute of Technology, January 20-22, 1993.