Lexicalized stochastic modeling of constraint-based grammars using log-linear measures and EM training

  • Authors:
  • Stefan Riezler;Jonas Kuhn;Detlef Prescher;Mark Johnson

  • Affiliations:
  • Universität Stuttgart;Universität Stuttgart;Universität Stuttgart;Brown University

  • Venue:
  • ACL '00 Proceedings of the 38th Annual Meeting on Association for Computational Linguistics
  • Year:
  • 2000

Quantified Score

Hi-index 0.00

Visualization

Abstract

We present a new approach to stochastic modeling of constraint-based grammars that is based on loglinear models and uses EM for estimation from unannotated data. The techniques are applied to an LFG grammar for German. Evaluation on an exact match task yields 86% precision for an ambiguity rate of 5.4, and 90% precision on a subcat frame match for an ambiguity rate of 25. Experimental comparison to training from a parsebank shows a 10% gain from EM training. Also, a new class-based grammar lexicalization is presented, showing a 10% gain over unlexicalized models.