Semeval-2012 task 8: cross-lingual textual entailment for content synchronization

  • Authors:
  • Matteo Negri;Alessandro Marchetti;Yashar Mehdad;Luisa Bentivogli;Danilo Giampiccolo

  • Affiliations:
  • FBK-irst Trento, Italy;CELCT Trento, Italy;FBK-irst Trento, Italy;FBK-irst Trento, Italy;CELCT Trento, Italy

  • Venue:
  • SemEval '12 Proceedings of the First Joint Conference on Lexical and Computational Semantics - Volume 1: Proceedings of the main conference and the shared task, and Volume 2: Proceedings of the Sixth International Workshop on Semantic Evaluation
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper presents the first round of the task on Cross-lingual Textual Entailment for Content Synchronization, organized within SemEval-2012. The task was designed to promote research on semantic inference over texts written in different languages, targeting at the same time a real application scenario. Participants were presented with datasets for different language pairs, where multi-directional entailment relations ("forward", "backward", "bidirectional", "no_entailment") had to be identified. We report on the training and test data used for evaluation, the process of their creation, the participating systems (10 teams, 92 runs), the approaches adopted and the results achieved.