Error analysis of the TempEval temporal relation identification task

  • Authors:
  • Chong Min Lee;Graham Katz

  • Affiliations:
  • Georgetown University, Washington, DC;Georgetown University, Washington, DC

  • Venue:
  • DEW '09 Proceedings of the Workshop on Semantic Evaluations: Recent Achievements and Future Directions
  • Year:
  • 2009

Quantified Score

Hi-index 0.01

Visualization

Abstract

The task to classify a temporal relation between temporal entities has proven to be difficult with unsatisfactory results of previous research. In TempEval07 that was a first attempt to standardize the task, six teams competed with each other for three simple relationidentification tasks and their results were comparably poor. In this paper we provide an analysis of the TempEval07 competition results, identifying aspects of the tasks which presented the systems with particular challenges and those that were accomplished with relative ease.