Class-based n-gram models of natural language

  • Authors:
  • Peter F. Brown;Peter V. deSouza;Robert L. Mercer;Vincent J. Della Pietra;Jenifer C. Lai

  • Affiliations:
  • IBM T. J. Watson Research Center;IBM T. J. Watson Research Center;IBM T. J. Watson Research Center;IBM T. J. Watson Research Center;IBM T. J. Watson Research Center

  • Venue:
  • Computational Linguistics
  • Year:
  • 1992

Quantified Score

Hi-index 0.01

Visualization

Abstract

We address the problem of predicting a word from previous words in a sample of text. In particular, we discuss n-gram models based on classes of words. We also discuss several statistical algorithms for assigning words to classes based on the frequency of their co-occurrence with other words. We find that we are able to extract classes that have the flavor of either syntactically based groupings or semantically based groupings, depending on the nature of the underlying statistics.