Using bleu-like algorithms for the automatic recognition of entailment

  • Authors:
  • Diana Pérez;Enrique Alfonseca

  • Affiliations:
  • Department of Computer Science, Universidad Autónoma de Madrid, Madrid, Spain;Department of Computer Science, Universidad Autónoma de Madrid, Madrid, Spain

  • Venue:
  • MLCW'05 Proceedings of the First international conference on Machine Learning Challenges: evaluating Predictive Uncertainty Visual Object Classification, and Recognizing Textual Entailment
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

The Bleu algorithm has been used in many different fields. Another possible application is the automatic recognition of textual entailment. Bleu works at the lexical level, by comparing a candidate text with several reference texts in order to calculate how close the candidate text is to the references. In this case, the candidate is the text part of the entailment and the hypothesis is the unique reference. The algorithm achieves an accuracy of around 50%. Moreover, in this paper we explore the application of Bleu-like algorithms, finding that they can reach an accuracy of around 56%, which proves its possible use as a baseline for the task of recognizing entailment.