Extracting Decision Rules from Sigmoid Kernel

  • Authors:
  • Quanzhong Liu;Yang Zhang;Zhengguo Hu

  • Affiliations:
  • College of Information Engineering, Northwest A&F University, P.R. China 712100;College of Information Engineering, Northwest A&F University, P.R. China 712100;College of Information Engineering, Northwest A&F University, P.R. China 712100

  • Venue:
  • ADMA '08 Proceedings of the 4th international conference on Advanced Data Mining and Applications
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

Sigmoid kernel is widely applied in neural networks for classification tasks. SVM classifier, which is applied with sigmoid kernel, has excellent classification accuracy. However, as sigmoid kernel has complicated structure, it is generally difficult for human expert to interpret and understand how the sigmoid kernel makes its classification decision. As decision rule classifier is understandable to human expert, in this paper, we present our InterSIG algorithm, which mines decision rules from the classification hyper-plane which is constructed by SVM with sigmoid kernel. InterSIG expands sigmoid kernel into its Maclaurin series, and then mines classification rules which make great contribution to classification from the classification hyper-plane. Experiment results show that InterSIG classifier is more understandable to human experts without jeopardizing the accuracy than the original SVM with sigmoid kernel. Furthermore, compared with 3 association classifiers, CMAR, CBA, CPAR and C4.5, a decision tree classifier, InterSIG classifier is very encouraging over the 9 datasets.