Benchmarking ARS: anaphora resolution system

  • Authors:
  • Benjamin Chu Min Xian;Fadzly Zahari;Dickson Lukose

  • Affiliations:
  • MIMOS Berhad, Technology Park, Malaysia, Kuala Lumpur, Malaysia;MIMOS Berhad, Technology Park, Malaysia, Kuala Lumpur, Malaysia;MIMOS Berhad, Technology Park, Malaysia, Kuala Lumpur, Malaysia

  • Venue:
  • i-KNOW '11 Proceedings of the 11th International Conference on Knowledge Management and Knowledge Technologies
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

Benchmarking is an established way for evaluating automatic systems which tackle the same task. This paper presents the results of benchmarking the Anaphora Resolution Systems (ARS) developed at MIMOS against several similar systems, and the lessons learnt from it. The dataset used for this benchmarking effort consists of texts with Pronominal Anaphora, Definite Noun Phrase Anaphora, Pleonastic Anaphora and Reader/Writer Anaphora. The authors used the Recall, Precision and F-measure (F1 score) to measure the results of this evaluation.