Extracting the significant terms from a sentence-term matrix by removal of the noise in term usage

  • Authors:

  • Changbeom Lee;Hoseop Choe;Hyukro Park;Cheolyoung Ock

  • Affiliations:

  • School of Computer Engineering & Information Technology, University of Ulsan, Ulsan, South Korea;School of Computer Engineering & Information Technology, University of Ulsan, Ulsan, South Korea;Department of Computer Science, Chonnam National University, Kwangju, South Korea;School of Computer Engineering & Information Technology, University of Ulsan, Ulsan, South Korea

  • Venue:
  • AIRS'05 Proceedings of the Second Asia conference on Asia Information Retrieval Technology
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we propose an approach to extracting the significant terms in a document by the quantification methods which are both singular value decomposition (SVD) and principal component analysis (PCA). The SVD can remove the noise of variability in term usage of an original sentence-term matrix by using the singular values acquired after computing the SVD. This adjusted sentence-term matrix, which have removed its noisy usage of terms, can be used to perform the PCA, since the dimensionality of the revised matrix is the same as that of the original. Since the PCA can be used to extract the significant terms on the basis of the eigenvalue-eigenvector pairs for the sentence-term matrix, the extracted terms by the revised matrix instead of the original can be regarded as more effective or appropriate. Experimental results on Korean newspaper articles in automatic summarization show that the proposed method is superior to that over the only PCA.