Towards better NLP system evaluation

Authors:
Karen Sparck Jones
Affiliations:
University of Cambridge, Cambridge
Venue:
HLT '94 Proceedings of the workshop on Human Language Technology
Year:
1994

Citing 0
Cited 6

Summary evaluation and text categorization

Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval
A definition and short history of Language Engineering

Natural Language Engineering
Session summary

HLT '94 Proceedings of the workshop on Human Language Technology
Extracting conceptual relationships from specialized documents

Data & Knowledge Engineering - Special issue: ER 2002
Measuring user acceptability of machine translations to diagnose system errors: an experience report

COLING-MTIA '02 Proceedings of the 2002 COLING workshop on Machine translation in Asia - Volume 16
That's nice... what can you do with it?

Computational Linguistics

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper considers key elements of evaluation methodology, indicating the many points involved and advocating an unpacking approach in specifying an evaluation remit and design. Recognising the importance of both environment variables and system parameters leads to a grid organisation for tests. The paper illustrates the application of these notions through two examples.