372: Comparing the benefit of different dependency parsers for textual entailment using syntactic constraints only

  • Authors:
  • Alexander Volokh;Günter Neumann

  • Affiliations:
  • DFKI, Saarbrücken, Germany;DFKI, Saarbrücken, Germany

  • Venue:
  • SemEval '10 Proceedings of the 5th International Workshop on Semantic Evaluation
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

We compare several state of the art dependency parsers with our own parser based on a linear classification technique. Our primary goal is therefore to use syntactic information only, in order to keep the comparison of the parsers as fair as possible. We demonstrate, that despite the inferior result using the standard evaluation metrics for parsers like UAS or LAS on standard test data, our system achieves comparable results when used in an application, such as the SemEval-2 #12 evaluation exercise PETE. Our submission achieved the 4th position out of 19 participating systems. However, since it only uses a linear classifier it works 17--20 times faster than other state of the parsers, as for instance MaltParser or Stanford Parser.