Develop multi-hierarchy classification model: rough set based feature decomposition method

  • Authors:
  • Qingdong Wang;Huaping Dai;Youxian Sun

  • Affiliations:
  • National Key Laboratory of Industry Control Technology, Zhejiang University, Hangzhou, P.R. China;National Key Laboratory of Industry Control Technology, Zhejiang University, Hangzhou, P.R. China;National Key Laboratory of Industry Control Technology, Zhejiang University, Hangzhou, P.R. China

  • Venue:
  • ICAPR'05 Proceedings of the Third international conference on Advances in Pattern Recognition - Volume Part I
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

Model development on high dimension database is very difficult. This paper presents a new rough set based machine learning method, named feature decomposition method, to discover concept hierarchies and develop a multi-hierarchy model of database. For the databases which we are familiar with, the feature group can be selected by experience of expert. When dealing with the databases without any background knowledge, a new criterion based on rough set is presented to select the features to form a feature group. According to some measures of rough set theory, the objects defined on the proposed feature group are labeled by a new intermediate concept. The concept hierarchies of the database have specific meaning, which increased the transparency of data mining process and enhance the comprehensibility of the model. Each feature group and the corresponding intermediate concept compose the structure of the database. Finally rule induction can be processed on the intermediate concepts. The algorithm presented is verified by datasets from UCI. The results show that the multi-hierarchy model established by feature decomposition method can get high classification accuracy and have better comprehensibility.