Relation detection between named entities: report of a shared task

  • Authors:
  • Cláudia Freitas;Diana Santos;Cristina Mota;Hugo Gonçalo Oliveira;Paula Carvalho

  • Affiliations:
  • SINTEF ICT;SINTEF ICT;SINTEF ICT;CISUC, DEI - FCTUC;Univ. Lisbon, FCUL, XLDB

  • Venue:
  • DEW '09 Proceedings of the Workshop on Semantic Evaluations: Recent Achievements and Future Directions
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper we describe the first evaluation contest (track) for Portuguese whose goal was to detect and classify relations between named entities in running text, called ReRelEM. Given a collection annotated with named entities belonging to ten different semantic categories, we marked all relationships between them within each document. We used the following fourfold relationship classification: identity, included-in, located-in, and other (which was later on explicitly detailed into twenty different relations). We provide a quantitative description of this evaluation resource, as well as describe the evaluation architecture and summarize the results of the participating systems in the track.