Fast Text Classification: A Training-Corpus Pruning Based Approach

  • Authors:
  • Shuigeng Zhou;Tok Wang Ling;Jihong Guan;Jiangtao Hu;Aoying Zhou

  • Affiliations:
  • -;-;-;-;-

  • Venue:
  • DASFAA '03 Proceedings of the Eighth International Conference on Database Systems for Advanced Applications
  • Year:
  • 2003

Quantified Score

Hi-index 0.00

Visualization

Abstract

With the rapid growth of on-line information available,text classification is becoming more and more important.kNN is a widely used text classification method of high performance. However, this method is inefficient because itrequires a large amount of computation or evaluating thesimilarity between a test document and each training document. In this paper, we propose a fast kNN text classification approach based on pruning the training corpus. Byusing this approach, the size of training corpus can be condensed sharply so that time-consuming on kNN searchingcan be cut off significantly, and consequently classificationefficiency can be improved substantially while classification performance is preserved comparable to that of withoutpruning. Effective algorithm for text corpus pruning is designed. Experiments over the Reuters corpus are carriedout, which validate the practicability of the proposed approach. Our approach is especially suitable or on-line textclassification applications.