Tipster/MUC-5 information extraction system evaluation

Authors:
Beth M. Sundheim
Affiliations:
Naval Command, Control, and Ocean Surveillance Center, San Diego, CA
Venue:
TIPSTER '93 Proceedings of a workshop on held at Fredericksburg, Virginia: September 19-23, 1993
Year:
1993

Citing 6
Cited 0

Comparing MUCK-II and MUC-3: assessing the difficulty of different tasks

MUC3 '91 Proceedings of the 3rd conference on Message understanding
Domain and language evaluation results

MUC5 '93 Proceedings of the 5th conference on Message understanding
MUC-5 evaluation metrics

MUC5 '93 Proceedings of the 5th conference on Message understanding
The statistical significance of the MUC-5 results

MUC5 '93 Proceedings of the 5th conference on Message understanding
The statistical significance of the MUC-4 results

MUC4 '92 Proceedings of the 4th conference on Message understanding
Survey of the Message Understanding Conferences

HLT '93 Proceedings of the workshop on Human Language Technology

Quantified Score

Hi-index	0.00

Visualization

Abstract

Three information extraction system evaluations using Tipster data were conducted in the context of Phase 1 of the Tipster Text program. Interim evaluations were conducted in September, 1992, and February, 1993; the final evaluation was conducted in July, 1993. The final evaluation included not only the Tipster-supported information extraction contractors but thirteen other participants as well. This evaluation was the topic of the Fifth Message Understanding Conference (MUC-5) in August. 1993. With particular respect to the research and development tasks of the Tipster contractors, the goal of these evaluations has been to assess success in terms of the development of systems to work in both English and Japanese (BBN, GE/CMU, and NMSU/Brandeis) and/or in both the joint ventures and microelectronics domains (BBN, GE/CMU, NMSU/Brandeis, and UMass/Hughes).