A subspace decision cluster classifier for text classification

  • Authors:
  • Yan Li;Edward Hung;Korris Chung

  • Affiliations:
  • Liuxian Road, West Campus, Shenzhen Polytechnic, Shenzhen 518055, China;PQ Building, MailBox 56, The Hong Kong Polytechnic University, Hung Hom, KLN, Hong Kong;PQ Building, MailBox 56, The Hong Kong Polytechnic University, Hung Hom, KLN, Hong Kong

  • Venue:
  • Expert Systems with Applications: An International Journal
  • Year:
  • 2011

Quantified Score

Hi-index 12.05

Visualization

Abstract

In this paper, a new classification method (SDCC) for high dimensional text data with multiple classes is proposed. In this method, a subspace decision cluster classification (SDCC) model consists of a set of disjoint subspace decision clusters, each labeled with a dominant class to determine the class of new objects falling in the cluster. A cluster tree is first generated from a training data set by recursively calling a subspace clustering algorithm Entropy Weighting k-Means algorithm. Then, the SDCC model is extracted from the subspace decision cluster tree. Various tests including Anderson-Darling test are used to determine the stopping condition of the tree growing. A series of experiments on real text data sets have been conducted. Their results show that the new classification method (SDCC) outperforms the existing methods like decision tree and SVM. SDCC is particularly suitable for large, high dimensional sparse text data with many classes.