Probabilistic prediction and Picky chart parsing

  • Authors:
  • David M. Magerman;Carl Weir

  • Affiliations:
  • Stanford University;Paramax Systems

  • Venue:
  • HLT '91 Proceedings of the workshop on Speech and Natural Language
  • Year:
  • 1992

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper describes Picky, a probabilistic agenda-based chart parsing algorithm which uses a technique called probabilistic prediction to predict which grammar rules are likely to lead to an acceptable parse of the input. In tests on randomly selected test data, Picky generates fewer edges on average than other CKY-like algorithms, while achieving 89% first parse accuracy and also enabling the parser to process sentences with false starts and other minor disfluencies. Further, sentences which are parsed completely by the probabilistic prediction technique have a 97% first parse accuracy.