Rule extraction from linear support vector machines

Authors:
Glenn Fung;Sathyakama Sandilya;R. Bharat Rao
Affiliations:
Siemens Medical Solutions, Inc., Malvern, PA;Siemens Medical Solutions, Inc., Malvern, PA;Siemens Medical Solutions, Inc., Malvern, PA
Venue:
Proceedings of the eleventh ACM SIGKDD international conference on Knowledge discovery in data mining
Year:
2005

Citing 9
Cited 21

Extracting Refined Rules from Knowledge-Based Neural Networks

Machine Learning
The nature of statistical learning theory

The nature of statistical learning theory
Least Squares Support Vector Machine Classifiers

Neural Processing Letters
Proximal support vector machine classifiers

Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining
Learning from Data: Concepts, Theory, and Methods

Learning from Data: Concepts, Theory, and Methods
Neural Networks and Structured Knowledge: Rule Extraction andApplications

Applied Intelligence
Feature Selection via Concave Minimization and Support Vector Machines

ICML '98 Proceedings of the Fifteenth International Conference on Machine Learning
The disputed federalist papers: SVM feature selection via concave minimization

Proceedings of the 2003 conference on Diversity in computing
Rule Based Expert Systems: The Mycin Experiments of the Stanford Heuristic Programming Project (The Addison-Wesley series in artificial intelligence)

Rule Based Expert Systems: The Mycin Experiments of the Stanford Heuristic Programming Project (The Addison-Wesley series in artificial intelligence)

Rule Extraction from Support Vector Machines: A Sequential Covering Approach

IEEE Transactions on Knowledge and Data Engineering
A multiple kernel support vector machine scheme for feature selection and rule extraction from gene expression data of cancer tissue

Artificial Intelligence in Medicine
Extracting Decision Rules from Sigmoid Kernel

ADMA '08 Proceedings of the 4th international conference on Advanced Data Mining and Applications
Refining rules incorporated into knowledge-based support vector learners via successive linear programming

AAAI'07 Proceedings of the 22nd national conference on Artificial intelligence - Volume 1
Data Mining Using Rules Extracted from SVM: An Application to Churn Prediction in Bank Credit Cards

RSFDGrC '09 Proceedings of the 12th International Conference on Rough Sets, Fuzzy Sets, Data Mining and Granular Computing
On the Importance of Comprehensible Classification Models for Protein Function Prediction

IEEE/ACM Transactions on Computational Biology and Bioinformatics (TCBB)
Binarized Support Vector Machines

INFORMS Journal on Computing
A multiple kernel support vector machine scheme for simultaneous feature selection and rule-based classification

PAKDD'07 Proceedings of the 11th Pacific-Asia conference on Advances in knowledge discovery and data mining
Support vector regression based hybrid rule extraction methods for forecasting

Expert Systems with Applications: An International Journal
Rule extraction from support vector machines: A review

Neurocomputing
Rule extraction from support vector machine using modified active learning based approach: an application to CRM

KES'10 Proceedings of the 14th international conference on Knowledge-based and intelligent information and engineering systems: Part I
Extraction of interpretable rules from piecewise-linear approximation of a nonlinear classifier using clustering-based decomposition

AIKED'11 Proceedings of the 10th WSEAS international conference on Artificial intelligence, knowledge engineering and data bases
Rule extraction for support vector machine using input space expansion

ACIIDS'11 Proceedings of the Third international conference on Intelligent information and database systems - Volume Part II
Enabling fast prediction for ensemble models on data streams

Proceedings of the 17th ACM SIGKDD international conference on Knowledge discovery and data mining
Polytope classifier: a symbolic knowledge extraction from piecewise-linear support vector machine

KES'11 Proceedings of the 15th international conference on Knowledge-based and intelligent information and engineering systems - Volume Part I
Skill acquisition via transfer learning and advice taking

ECML'06 Proceedings of the 17th European conference on Machine Learning
ITER: an algorithm for predictive regression rule extraction

DaWaK'06 Proceedings of the 8th international conference on Data Warehousing and Knowledge Discovery
Modeling medical decision making by support vector machines, explaining by rules of evolutionary algorithms with feature selection

Expert Systems with Applications: An International Journal
Decision Rule Extraction for Regularized Multiple Criteria Linear Programming Model

International Journal of Data Warehousing and Mining
Rule extraction from support vector machines based on consistent region covering reduction

Knowledge-Based Systems
Comprehensible classification models: a position paper

ACM SIGKDD Explorations Newsletter

Quantified Score

Hi-index	0.01

Visualization

Abstract

We describe an algorithm for converting linear support vector machines and any other arbitrary hyperplane-based linear classifiers into a set of non-overlapping rules that, unlike the original classifier, can be easily interpreted by humans. Each iteration of the rule extraction algorithm is formulated as a constrained optimization problem that is computationally inexpensive to solve. We discuss various properties of the algorithm and provide proof of convergence for two different optimization criteria We demonstrate the performance and the speed of the algorithm on linear classifiers learned from real-world datasets, including a medical dataset on detection of lung cancer from medical images. The ability to convert SVM's and other "black-box" classifiers into a set of human-understandable rules, is critical not only for physician acceptance, but also to reducing the regulatory barrier for medical-decision support systems based on such classifiers.