Temporal evaluation

Authors:
Naushad UzZaman;James F. Allen
Affiliations:
University of Rochester, Rochester, NY;University of Rochester, Rochester, NY
Venue:
HLT '11 Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies: short papers - Volume 2
Year:
2011

Citing 6
Cited 2

Time revisited

Computational Intelligence
Maintaining knowledge about temporal intervals

Communications of the ACM
Performance of Temporal Reasoning Systems

Performance of Temporal Reasoning Systems
A model-theoretic coreference scoring scheme

MUC6 '95 Proceedings of the 6th conference on Message understanding
SemEval-2007 task 15: TempEval temporal relation identification

SemEval '07 Proceedings of the 4th International Workshop on Semantic Evaluations
SemEval-2010 task 13: evaluating events, time expressions, and temporal relations (TempEval-2)

DEW '09 Proceedings of the Workshop on Semantic Evaluations: Recent Achievements and Future Directions

Automatic system for identifying and categorizing temporal relations in natural language

International Journal of Intelligent Systems
Methodological Review: Annotating temporal information in clinical narratives

Journal of Biomedical Informatics

Quantified Score

Hi-index	0.01

Visualization

Abstract

In this paper we propose a new method for evaluating systems that extract temporal information from text. It uses temporal closure to reward relations that are equivalent but distinct. Our metric measures the overall performance of systems with a single score, making comparison between different systems straightforward. Our approach is easy to implement, intuitive, accurate, scalable and computationally inexpensive.