Trigger-based language models: a maximum entropy approach

  • Authors:
  • Raymond Lau;Ronald Rosenfeld;Salim Roukos

  • Affiliations:
  • Massachusetts Institute of Technology, Cambridge, MA;School of Computer Science, Carnegie Mellon University, Pittsburgh, PA;IBM T. J. Watson Research Center, Yorktown Heights, NY

  • Venue:
  • ICASSP'93 Proceedings of the 1993 IEEE international conference on Acoustics, speech, and signal processing: speech processing - Volume II
  • Year:
  • 1993

Quantified Score

Hi-index 0.00

Visualization

Abstract

We describe our ongoing efforts at adaptive statistical language modeling. To extract information from the document history, we use trigger pairs as the basic information bearing elements. To combine statistical evidence from multiple triggers, we use the principle of Maximum Entropy (ME). To combine the trigger-based model with the static model, we absorb the latter into the ME formalism. Given consistent statistical evidence, a unique ME solution is guaranteed to exist, and an iterative algorithm exists which is guaranteed to converge to it. Among the advantages of this approach are its simplicity, its generality, and its incremental nature. Among its disadvantages are its computational requirements. We report our current results and discuss possible improvements.