The CMU air travel information service: understanding spontaneous speech
HLT '90 Proceedings of the workshop on Speech and Natural Language
Management and evaluation of interactive dialog in the air travel domain
HLT '90 Proceedings of the workshop on Speech and Natural Language
Training and evaluation of a spoken language understanding system
HLT '90 Proceedings of the workshop on Speech and Natural Language
HLT '89 Proceedings of the workshop on Speech and Natural Language
Preliminary evaluation of the VOYAGER spoken language system
HLT '89 Proceedings of the workshop on Speech and Natural Language
The use of commercial natural language interface in the ATIS task
HLT '91 Proceedings of the workshop on Speech and Natural Language
A proposal for incremental dialogue evaluation
HLT '91 Proceedings of the workshop on Speech and Natural Language
HLT '91 Proceedings of the workshop on Speech and Natural Language
Empirical studies in discourse
Computational Linguistics
Towards developing general models of usability with PARADISE
Natural Language Engineering
A practical methodology for the evaluation of spoken language systems
ANLC '92 Proceedings of the third conference on Applied natural language processing
PARADISE: a framework for evaluating spoken dialogue agents
ACL '98 Proceedings of the 35th Annual Meeting of the Association for Computational Linguistics and Eighth Conference of the European Chapter of the Association for Computational Linguistics
Designing a task-based evaluation methodology for a spoken machine translation system
ACL '99 Proceedings of the 37th annual meeting of the Association for Computational Linguistics on Computational Linguistics
Subject-based evaluation measures for interactive spoken language systems
HLT '91 Proceedings of the workshop on Speech and Natural Language
ISDS '97 Interactive Spoken Dialog Systems on Bringing Speech and NLP Together in Real Applications
Chorus: a crowd-powered conversational assistant
Proceedings of the 26th annual ACM symposium on User interface software and technology
| Hi-index | 0.00 |
The DARPA Spoken Language community has just completed the first trial evaluation of spontaneous query/response pairs in the Air Travel (ATIS) domain.1 Our goal has been to find a methodology for evaluating correct responses to user queries. To this end, we agreed, for the first trial evaluation, to constrain the problem in several ways:Database Application: Constrain the application to a database query application, to ease the burden of a) constructing the back-end, and b) determining correct responses;