MUC-5 evaluation metrics

  • Authors:
  • Nancy Chinchor;Beth Sundheim

  • Affiliations:
  • Science Applications International Corporation, San Diego, CA;Naval Command, Control, and Ocean Surveillance Center, San Diego, CA

  • Venue:
  • MUC5 '93 Proceedings of the 5th conference on Message understanding
  • Year:
  • 1993

Quantified Score

Hi-index 0.00

Visualization

Abstract

The metrics used for the Fifth Message Understanding Conference (MUC-5) evaluation are a major update to those used for MUC-4 in 1992. The official MUC-5 metrics express error rates while the official MUC-4 metrics express performance in terms of recall and precision (used for MUC-5 only as "unofficial" metrics). This paper discusses the current metrics and the reasons for their adoption.