Inside-outside reestimation from partially bracketed corpora

  • Authors:
  • Fernando Pereira;Yves Schabes

  • Affiliations:
  • 2D-447, AT& T Bell Laboratories, Murray Hill, NJ;University of Pennsylvania, Philadelphia, PA

  • Venue:
  • ACL '92 Proceedings of the 30th annual meeting on Association for Computational Linguistics
  • Year:
  • 1992

Quantified Score

Hi-index 0.00

Visualization

Abstract

The inside-outside algorithm for inferring the parameters of a stochastic context-free grammar is extended to take advantage of constituent information (constituent bracketing) in a partially parsed corpus. Experiments on formal and natural language parsed corpora show that the new algorithm can achieve faster convergence and better modeling of hierarchical structure than the original one. In particular, over 90% test set bracketing accuracy was achieved for grammars inferred by our algorithm from a training set of handparsed part-of-speech strings for sentences in the Air Travel Information System spoken language corpus. Finally, the new algorithm has better time complexity than the original one when sufficient bracketing is provided.