Evaluation of spoken language systems: the ATIS domain
HLT '90 Proceedings of the workshop on Speech and Natural Language
The ATIS spoken language systems pilot corpus
HLT '90 Proceedings of the workshop on Speech and Natural Language
Beyond class A: a proposal for automatic evaluation of discourse
HLT '90 Proceedings of the workshop on Speech and Natural Language
Designing the human machine interface in the ATIS domain
HLT '90 Proceedings of the workshop on Speech and Natural Language
Management and evaluation of interactive dialog in the air travel domain
HLT '90 Proceedings of the workshop on Speech and Natural Language
Data collection and analysis in the air travel planning domain
HLT '89 Proceedings of the workshop on Speech and Natural Language
The collection and preliminary analysis of a spontaneous speech database
HLT '89 Proceedings of the workshop on Speech and Natural Language
Experiments in evaluating interactive spoken language systems
HLT '91 Proceedings of the workshop on Speech and Natural Language
Spontaneous speech collection for the ATIS domain with an aural user feedback paradigm
HLT '91 Proceedings of the workshop on Speech and Natural Language
Experiences collecting genuine spoken enquiries using WOZ techniques
HLT '91 Proceedings of the workshop on Speech and Natural Language
The MIT ATIS system: February 1992 progress report
HLT '91 Proceedings of the workshop on Speech and Natural Language
Collection and analyses of WSJ-CSR data at MIT
HLT '91 Proceedings of the workshop on Speech and Natural Language
Test and evaluation of a spoken dialogue system
ICASSP'93 Proceedings of the 1993 IEEE international conference on Acoustics, speech, and signal processing: speech processing - Volume II
| Hi-index | 0.00 |
As part of our development of a spoken language system in the ATIS domain, we have begun a small-scale effort in collecting spontaneous speech data. Our procedure differs from the one used at Texas Instruments (TI) in many respects, the most important being the reliance on an existing system, rather than a wizard, to participate in data collection. Over the past few months, we have collected over 3,600 spontaneously generated sentences from 100 subjects. This paper documents our data collection process, and makes some comparative analyses of our data with those collected at TI. The advantages as well as disadvantages of this method of data collection will be discussed.