Comparing human and machine performance for natural language information extraction: results for English microelectronics from the MUC-5 evaluation

Authors:
Craig A. Will
Affiliations:
Institute for Defense Analyses, Alexandria, VA
Venue:
MUC5 '93 Proceedings of the 5th conference on Message understanding
Year:
1993

Citing 2
Cited 4

MUC-5 evaluation metrics

MUC5 '93 Proceedings of the 5th conference on Message understanding
Overview of the fourth message understanding evaluation and conference

MUC4 '92 Proceedings of the 4th conference on Message understanding

Comparing human and machine performance for natural language information extraction: results from the Tipster text evaluation

TIPSTER '93 Proceedings of a workshop on held at Fredericksburg, Virginia: September 19-23, 1993
Pattern matching and discourse processing in information extraction from Japanese text

Journal of Artificial Intelligence Research
Wrap-Up: a trainable discourse module for information extraction

Journal of Artificial Intelligence Research
Cerno: Light-weight tool support for semantic annotation of textual documents

Data & Knowledge Engineering

Quantified Score

Hi-index	0.00

Visualization

Abstract

In evaluating the state of technology for extracting information from natural language text by machine, it is valuable to compare the performance of machine extraction systems with that achieved by humans performing the same task. The purpose of this paper is to present some results from a comparative study of human and machine performance for one of the information extraction tasks used in the MUC-5/Tipster evaluation that can help assess the maturity and applicability of the technology.