SemEval-2007 task 15: TempEval temporal relation identification

Authors:
Marc Verhagen;Robert Gaizauskas;Frank Schilder;Mark Hepple;Graham Katz;James Pustejovsky
Affiliations:
Brandeis University;University of Sheffield;Thomson Legal & Regulatory;University of Sheffield;Stanford University;Brandeis University
Venue:
SemEval '07 Proceedings of the 4th International Workshop on Semantic Evaluations
Year:
2007

Citing 2
Cited 54

Maintaining knowledge about temporal intervals

Communications of the ACM
Machine learning of temporal relations

ACL-44 Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the Association for Computational Linguistics

Using a Bigram Event Model to Predict Causal Potential

CICLing '09 Proceedings of the 10th International Conference on Computational Linguistics and Intelligent Text Processing
Learning semantic links from a corpus of parallel temporal and causal relations

HLT-Short '08 Proceedings of the 46th Annual Meeting of the Association for Computational Linguistics on Human Language Technologies: Short Papers
Experiments with reasoning for temporal relations between events

COLING '08 Proceedings of the 22nd International Conference on Computational Linguistics - Volume 1
Jointly combining implicit constraints improves temporal ordering

EMNLP '08 Proceedings of the Conference on Empirical Methods in Natural Language Processing
CU-TMP: temporal relation classification using syntactic and semantic features

SemEval '07 Proceedings of the 4th International Workshop on Semantic Evaluations
NAIST.Japan: temporal relation identification using dependency parsed tree

SemEval '07 Proceedings of the 4th International Workshop on Semantic Evaluations
USFD: preliminary exploration of features and classifiers for the TempEval-2007 tasks

SemEval '07 Proceedings of the 4th International Workshop on Semantic Evaluations
XRCE-T: XIP temporal module for TempEval campaign

SemEval '07 Proceedings of the 4th International Workshop on Semantic Evaluations
SemEval-2010 task 13: evaluating events, time expressions, and temporal relations (TempEval-2)

DEW '09 Proceedings of the Workshop on Semantic Evaluations: Recent Achievements and Future Directions
Error analysis of the TempEval temporal relation identification task

DEW '09 Proceedings of the Workshop on Semantic Evaluations: Recent Achievements and Future Directions
Building a semantically annotated corpus of clinical texts

Journal of Biomedical Informatics
Jointly identifying temporal relations with Markov Logic

ACL '09 Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 1 - Volume 1
From Semantic Roles to Temporal Information Representation

MICAI '09 Proceedings of the 8th Mexican International Conference on Artificial Intelligence
Extraction and exploration of spatio-temporal information in documents

Proceedings of the 6th Workshop on Geographic Information Retrieval
Annotating, extracting and reasoning about time and events

Proceedings of the 2005 international conference on Annotating, extracting and reasoning about time and events
Towards a denotational semantics for TimeML

Proceedings of the 2005 international conference on Annotating, extracting and reasoning about time and events
XTM: a robust temporal text processor

CICLing'08 Proceedings of the 9th international conference on Computational linguistics and intelligent text processing
Temporal relation identification with endpoints

HLT-SRWS '10 Proceedings of the NAACL HLT 2010 Student Research Workshop
Temporal information processing of a new language: fast porting with minimal resources

ACL '10 Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics
SemEval-2010 task 13: TempEval-2

SemEval '10 Proceedings of the 5th International Workshop on Semantic Evaluation
TRIPS and TRIOS system for TempEval-2: Extracting temporal information from text

SemEval '10 Proceedings of the 5th International Workshop on Semantic Evaluation
TIPSem (English and Spanish): Evaluating CRFs and semantic roles in TempEval-2

SemEval '10 Proceedings of the 5th International Workshop on Semantic Evaluation
KUL: Recognition and normalization of temporal expressions

SemEval '10 Proceedings of the 5th International Workshop on Semantic Evaluation
JU_CSE_TEMP: A first step towards evaluating events, time expressions and temporal relations

SemEval '10 Proceedings of the 5th International Workshop on Semantic Evaluation
Comparison of different algebras for inducing the temporal structure of texts

COLING '10 Proceedings of the 23rd International Conference on Computational Linguistics
Event-time relation identification using machine learning and rules

TSD'10 Proceedings of the 13th international conference on Text, speech and dialogue
Exploring the effectiveness of lexical ontologies for modeling temporal relations with Markov logic

SIGDIAL '10 Proceedings of the 11th Annual Meeting of the Special Interest Group on Discourse and Dialogue
Temporal analysis of sentiment events: a visual realization and tracking

CICLing'11 Proceedings of the 12th international conference on Computational linguistics and intelligent text processing - Volume Part I
Modeling reciprocity in social interactions with probabilistic latent space models

Natural Language Engineering
Using query patterns to learn the duration of events

IWCS '11 Proceedings of the Ninth International Conference on Computational Semantics
Temporal evaluation

HLT '11 Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies: short papers - Volume 2
Evaluating temporal graphs built from texts via transitive reduction

Journal of Artificial Intelligence Research
Coupled temporal scoping of relational facts

Proceedings of the fifth ACM international conference on Web search and data mining
Extraction of temporal facts and events from Wikipedia

Proceedings of the 2nd Temporal Web Analytics Workshop
Identification of top relevant temporal expressions in documents

Proceedings of the 2nd Temporal Web Analytics Workshop
Temporal expression identification based on semantic roles

NLDB'09 Proceedings of the 14th international conference on Applications of Natural Language to Information Systems
Automatic system for identifying and categorizing temporal relations in natural language

International Journal of Intelligent Systems
Combining flat and structured approaches for temporal slot filling or: how much to compress?

CICLing'12 Proceedings of the 13th international conference on Computational Linguistics and Intelligent Text Processing - Volume Part II
Extracting temporal information from portuguese texts

PROPOR'12 Proceedings of the 10th international conference on Computational Processing of the Portuguese Language
When did that happen?: linking events and relations to timestamps

EACL '12 Proceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics
Aspectual type and temporal relation classification

EACL '12 Proceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics
Extracting narrative timelines as temporal dependency structures

ACL '12 Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics: Long Papers - Volume 1
Labeling documents with timestamps: learning from their time expressions

ACL '12 Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics: Long Papers - Volume 1
Temporally anchored relation extraction

ACL '12 Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics: Long Papers - Volume 1
Finding salient dates for building thematic timelines

ACL '12 Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics: Long Papers - Volume 1
Joint inference for event timeline construction

EMNLP-CoNLL '12 Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning
Identifying constant and unique relations by using time-series text

EMNLP-CoNLL '12 Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning
Towards unsupervised learning of temporal relations between events

Journal of Artificial Intelligence Research
Structured summarization for news events

Proceedings of the 22nd international conference on World Wide Web companion
Temporal Relation Identification and Classification in Clinical Notes

Proceedings of the International Conference on Bioinformatics, Computational Biology and Biomedical Informatics
Editorial: Chronology of your health events: Approaches to extracting temporal relations from medical narratives

Journal of Biomedical Informatics
Methodological Review: Annotating temporal information in clinical narratives

Journal of Biomedical Informatics
Classifying temporal relations in clinical data: A hybrid, knowledge-rich approach

Journal of Biomedical Informatics
Towards generating a patient's timeline: Extracting temporal relationships from clinical notes

Journal of Biomedical Informatics

Quantified Score

Hi-index	0.00

Visualization

Abstract

The TempEval task proposes a simple way to evaluate automatic extraction of temporal relations. It avoids the pitfalls of evaluating a graph of inter-related labels by defining three sub tasks that allow pairwise evaluation of temporal relations. The task not only allows straightforward evaluation, it also avoids the complexities of full temporal parsing.