Contradiction-focused qualitative evaluation of textual entailment

  • Authors:
  • Bernardo Magnini;Elena Cabrio

  • Affiliations:
  • FBK-Irst, Trento, Italy;University of Trento, Trento, Italy

  • Venue:
  • NeSp-NLP '10 Proceedings of the Workshop on Negation and Speculation in Natural Language Processing
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper we investigate the relation between positive and negative pairs in Textual Entailment (TE), in order to highlight the role of contradiction in TE datasets. We base our analysis on the decomposition of Text-Hypothesis pairs into monothematic pairs, i.e. pairs where only one linguistic phenomenon at a time is responsible for entailment judgment and we argue that such a deeper inspection of the linguistic phenomena behind textual entailment is necessary in order to highlight the role of contradiction. We support our analysis with a number of empirical experiments, which use current available TE systems.