A test of the leaf-ancestor metric for parse accuracy

  • Authors:
  • Geoffrey Sampson;Anna Babarczy

  • Affiliations:
  • School of Cognitive and Computing Sciences, University of Sussex, Falmer, Brighton BN1 9QH, UK e-mail: geoffs@cogs.susx.ac.uk;School of Cognitive and Computing Sciences, University of Sussex, Falmer, Brighton BN1 9QH, UK e-mail: annab@cogs.susx.ac.uk

  • Venue:
  • Natural Language Engineering
  • Year:
  • 2003

Quantified Score

Hi-index 0.00

Visualization

Abstract

The GEIG metric for quantifying the accuracy of parsing became influential through the Parseval programme, but many researchers have seen it as unsatisfactory. The Leaf-Ancestor (LA) metric, first developed in the 1980s, arguably comes closer to formalizing our intuitive concept of relative parse accuracy. We support this claim via an experiment that contrasts the performance of alternative metrics on the same body of automatically-parsed examples. The LA metric has the further virtue of providing straightforward indications of the location of parsing errors.