Depth First Rule Generation for Text Categorization

  • Authors:
  • Jiyuan An;Yi-Ping Phoebe Chen

  • Affiliations:
  • School of Information Technology, Faculty of Science and Technology, Deakin University, Melbourne, VIC 3125, Australia;School of Information Technology, Faculty of Science and Technology, Deakin University, Melbourne, VIC 3125, Australia and Australian Research Council Centre in Bioinformatics, E-mail: {jiyuan, ph ...

  • Venue:
  • Proceedings of the 2006 conference on Advances in Intelligent IT: Active Media Technology 2006
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

Classification methods are usually used to categorize text documents, such as, Rocchio method, Naïve bayes based method, and SVM based text classification method. These methods learn labeled text documents and then construct classifiers. The generated classifiers can predict which category is located for a new coming text document. The keywords in the document are often used to form rules to categorize text documents, for example “kw = computer” can be a rule for the IT documents category. However, the number of keywords is very large. To select keywords from the large number of keywords is a challenging work. Recently, a rule generation method based on enumeration of all possible keywords combinations has been proposed [2]. In this method, there remains a crucial problem: how to prune irrelevant combinations at the early stages of the rule generation procedure. In this paper, we propose a method than can effectively prune irrelative keywords at an early stage.