Natural language understanding (2nd ed.)
Natural language understanding (2nd ed.)
Testing finite state machines: fault detection
Selected papers of the 23rd annual ACM symposium on Theory of computing
Overview of evaluation in speech and natural language processing
Survey of the state of the art in human language technology
Evaluating Natural Language Processing Systems: An Analysis and Review
Evaluating Natural Language Processing Systems: An Analysis and Review
Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition
PARADISE: a framework for evaluating spoken dialogue agents
ACL '98 Proceedings of the 35th Annual Meeting of the Association for Computational Linguistics and Eighth Conference of the European Chapter of the Association for Computational Linguistics
The use of instrumentation in grammar engineering
COLING '00 Proceedings of the 18th conference on Computational linguistics - Volume 1
| Hi-index | 0.00 |
If Natural Language Processing (NLP) systems are viewed as intelligent systems then we should be able to make use of verification and validation (V&V) approaches and methods that have been developed in the intelligent systems community. This paper addresses language engineering infrastructure issues by considering whether standard V&V methods are fundamentally different than the evaluation practices commonly used for NLP systems, and proposes practical approaches for applying V&V in the context of language processing systems. We argue that evaluation, as it is performed in the NL community, can be improved by supplementing it with methods from the V&V community.