Workshop on the evaluation of natural language processing systems
Computational Linguistics
Evaluating text categorization
HLT '91 Proceedings of the workshop on Speech and Natural Language
Evaluation of spoken language systems: the ATIS domain
HLT '90 Proceedings of the workshop on Speech and Natural Language
A practical methodology for the evaluation of spoken language systems
ANLC '92 Proceedings of the third conference on Applied natural language processing
Information extraction and semantic constraints
COLING '90 Proceedings of the 13th conference on Computational linguistics - Volume 3
Overview of the fourth message understanding evaluation and conference
MUC4 '92 Proceedings of the 4th conference on Message understanding
Preference semantics for message understanding
HLT '89 Proceedings of the workshop on Speech and Natural Language
Survey of the Message Understanding Conferences
HLT '93 Proceedings of the workshop on Human Language Technology
Integrating natural language processing and knowledge based processing
AAAI'90 Proceedings of the eighth National conference on Artificial intelligence - Volume 2
| Hi-index | 0.00 |
A plan is presented for evaluating natural language processing (NLP) systems that have focused on the issues of text understanding as exemplified in short texts from military messages. The plan includes definition of bodies of text to use as development and test data, namely the narrative lines from one type of naval message, and definition of a simulated database update task that requires NLP systems to fill a template with information found in the texts. Documentation related to the naval messages and examples of filled templates have been prepared to assist NLP system developers. It is anticipated that developers of a number of different NLP systems will participate in the evaluation and will meet afterwards to present and interpret the results and to critique the test design.