Automatic prediction of parser accuracy

  • Authors:
  • Sujith Ravi;Kevin Knight;Radu Soricut

  • Affiliations:
  • University of Southern California, Marina del Rey, California;University of Southern California, Marina del Rey, California;Language Weaver, Inc., Marina del Rey, California

  • Venue:
  • EMNLP '08 Proceedings of the Conference on Empirical Methods in Natural Language Processing
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

Statistical parsers have become increasingly accurate, to the point where they are useful in many natural language applications. However, estimating parsing accuracy on a wide variety of domains and genres is still a challenge in the absence of gold-standard parse trees. In this paper, we propose a technique that automatically takes into account certain characteristics of the domains of interest, and accurately predicts parser performance on data from these new domains. As a result, we have a cheap (no annotation involved) and effective recipe for measuring the performance of a statistical parser on any given domain.