Rough set feature selection methods for case-based categorization of text documents

  • Authors:
  • Kalyan Moy Gupta;Philip G. Moore;David W. Aha;Sankar K. Pal

  • Affiliations:
  • ITT Industries, Alexandria, VA;ITT Industries, Alexandria, VA;ITT Industries, Alexandria, VA;Indian Statistical Institute, Kolkata, India

  • Venue:
  • PReMI'05 Proceedings of the First international conference on Pattern Recognition and Machine Intelligence
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

Textual case bases can contain thousands of features in the form of tokens or words, which can inhibit classification performance. Recent developments in rough set theory and its applications to feature selection offer promising approaches for selecting and reducing the number of features. We adapt two rough set feature selection methods for use on n-ary class text categorization problems. We also introduce a new method for selecting features that computes the union of features selected from randomly-partitioned training subsets. Our comparative evaluation of our method with a conventional method on the Reuters-21578 data set shows that it can dramatically decrease training time without compromising classification accuracy. Also, we found that randomized training set partitions dramatically reduce training time.