Comparing human and machine performance for natural language information extraction: results from the Tipster text evaluation

Authors:
Craig A. Will
Affiliations:
Institute for Defense Analyses, Alexandria, VA
Venue:
TIPSTER '93 Proceedings of a workshop on held at Fredericksburg, Virginia: September 19-23, 1993
Year:
1993

Citing 3
Cited 0

Comparing human and machine performance for natural language information extraction: results for English microelectronics from the MUC-5 evaluation

MUC5 '93 Proceedings of the 5th conference on Message understanding
MUC-5 evaluation metrics

MUC5 '93 Proceedings of the 5th conference on Message understanding
Overview of the fourth message understanding evaluation and conference

MUC4 '92 Proceedings of the 4th conference on Message understanding

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents results from a study comparing human performance on the text of natural language information extraction with that of machine extraction systems that were developed as part of the ARPA Tipster program. Information extraction is shown to be a difficult task for both humans and machines. Evidence for one set of text material, English Microelectronics, indicated that a human analyst produces about half the errors as does machine systems.