A novel word clustering algorithm based on latent semantic analysis

  • Authors:
  • J. R. Bellegarda;J. W. Butzberger;Yen-Lu Chow;N. B. Coccaro;D. Naik

  • Affiliations:
  • Interactive Media Group, Apple Comput. Inc., Cupertino, CA, USA;Interactive Media Group, Apple Comput. Inc., Cupertino, CA, USA;Interactive Media Group, Apple Comput. Inc., Cupertino, CA, USA;Interactive Media Group, Apple Comput. Inc., Cupertino, CA, USA;Interactive Media Group, Apple Comput. Inc., Cupertino, CA, USA

  • Venue:
  • ICASSP '96 Proceedings of the Acoustics, Speech, and Signal Processing, 1996. on Conference Proceedings., 1996 IEEE International Conference - Volume 01
  • Year:
  • 1996

Quantified Score

Hi-index 0.00

Visualization

Abstract

A new approach is proposed for the clustering of words in a given vocabulary. The method is based on a paradigm first formulated in the context of information retrieval, called latent semantic analysis. This paradigm leads to a parsimonious vector representation of each word in a suitable vector space, where familiar clustering techniques can be applied. The distance measure selected in this space arises naturally from the problem formulation. Preliminary experiments indicate that, the clusters produced are intuitively satisfactory. Because these clusters are semantic in nature, this approach may prove useful as a complement to conventional class-based statistical language modeling techniques.