Text classification: combining grouping, LSA and kNN vs support vector machine

  • Authors:
  • Naohiro Ishii;Takeshi Murai;Takahiro Yamada;Yongguang Bao;Susumu Suzuki

  • Affiliations:
  • Aichi Institute of Technology, Toyota, Japan;Aichi Institute of Technology, Toyota, Japan;Aichi Institute of Technology, Toyota, Japan;Aichi Institute of Technology, Toyota, Japan;Aichi Institute of Technology, Toyota, Japan

  • Venue:
  • KES'06 Proceedings of the 10th international conference on Knowledge-Based Intelligent Information and Engineering Systems - Volume Part II
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

Text classification is a key technique for handling and organizing text data. The support vector machine(SVM) is shown to be better for the classification among well-known methods. In this paper, the grouping method of the similar words, is proposed for the classification of documents, which is applied to Reuters news and it is shown that the grouping of words has equivalent ability to the Latent Semantic Analysis(LSA) in the classification accuracy. Further, a new combining method is proposed for the classification, which consists of Grouping, LSA followed by the k-Nearest Neighbor classification ( k-NN ). The combining method proposed here, shows the higher accuracy in the classification than the conventional methods of the kNN, and the LSA followed by the kNN. Then, the combining method shows almost same accuracies as SVM.