Dimension-reduced estimation of word co-occurrence probability

  • Authors:
  • Kilyoun Kim;Key-Sun Choi

  • Affiliations:
  • Korea Advanced Institute of Science & Technology, Yusong-Gu Taejon, Republic of Korea;Korea Advanced Institute of Science & Technology, Yusong-Gu Taejon, Republic of Korea

  • Venue:
  • ACL '00 Proceedings of the 38th Annual Meeting on Association for Computational Linguistics
  • Year:
  • 2000

Quantified Score

Hi-index 0.00

Visualization

Abstract

We investigate a novel approach to solve the problem of sparse data through dimension reduction. Linear algebraic technique called LSA/SVD is used to find co-relationships of sparse words. Three variant estimation methods are suggested and they are evaluated for estimating unseen noun-verb co-occurrence probability. The model shows possibility to be alternative probability smoothing method.