Dynamic nonlocal language modeling via hierarchical topic-based adaptation

  • Authors:
  • Radu Florian;David Yarowsky

  • Affiliations:
  • Johns Hopkins University, Baltimore, Maryland;Johns Hopkins University, Baltimore, Maryland

  • Venue:
  • ACL '99 Proceedings of the 37th annual meeting of the Association for Computational Linguistics on Computational Linguistics
  • Year:
  • 1999

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper presents a novel method of generating and applying hierarchical, dynamic topic-based language models. It proposes and evaluates new cluster generation, hierarchical smoothing and adaptive topic-probability estimation techniques. These combined models help capture long-distance lexical dependencies. Experiments on the Broadcast News corpus show significant improvement in perplexity (10.5% overall and 33.5% on target vocabulary).