On the use of topic models for word completion

  • Authors:
  • Elisabeth Wolf;Shankar Vembu;Tristan Miller

  • Affiliations:
  • German Research Center for Artificial Intelligence, Kaiserslautern, Germany;German Research Center for Artificial Intelligence, Kaiserslautern, Germany;The Socialist Party of Great Britain, London, United Kingdom

  • Venue:
  • FinTAL'06 Proceedings of the 5th international conference on Advances in Natural Language Processing
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

We investigate the use of topic models, such as probabilistic latent semantic analysis (PLSA) and latent Dirichlet allocation (LDA), for word completion tasks. The advantage of using these models for such an application is twofold. On the one hand, they allow us to exploit semantic or contextual information when predicting candidate words for completion. On the other hand, these probabilistic models have been found to outperform classical latent semantic analysis (LSA) for modeling text documents. We describe a word completion algorithm that takes into account the semantic context of the word being typed. We also present evaluation metrics to compare different models being used in our study. Our experiments validate our hypothesis of using probabilistic models for semantic analysis of text documents and their application in word completion tasks.