A rough set-based case-based reasoner for text categorization

  • Authors:

  • Y. Li;S. C. K. Shiu;S. K. Pal;J. N. K. Liu

  • Affiliations:

  • Department of Computing, The Hong Kong Polytechnic University, Hung Hom, Kowloon, Hong Kong, China;Department of Computing, The Hong Kong Polytechnic University, Hung Hom, Kowloon, Hong Kong, China;Machine Intelligence Unit, Indian Statistical Institute, Kolkata 700 035, India;Department of Computing, The Hong Kong Polytechnic University, Hung Hom, Kowloon, Hong Kong, China

  • Venue:
  • International Journal of Approximate Reasoning
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper presents a novel rough set-based case-based reasoner for use in text categorization (TC). The reasoner has four main components: feature term extractor, document representor, case selector, and case retriever. It operates by first reducing the number of feature terms in the documents using the rough set technique. Then, the number of documents is reduced using a new document selection approach based on the case-based reasoning (CBR) concepts of coverage and reachability. As a result, both the number of feature terms and documents are reduced with only minimal loss of information. Finally, this smaller set of documents with fewer feature terms is used in TC. The proposed rough set-based case-based reasoner was tested on the Reuters21578 text datasets. The experimental results demonstrate its effectiveness and efficiency as it significantly reduced feature terms and documents, important for improving the efficiency of TC, while preserving and even improving classification accuracy.