A unified approach to the extraction of rules from artificial neural networks and support vector machines

Authors:
João Guerreiro;Duarte Trigueiros
Affiliations:
Department of Information Science and Technology, ISCTE, IUL, Portugal;Faculty of Economics, University of Algarve, Portugal
Venue:
ADMA'10 Proceedings of the 6th international conference on Advanced data mining and applications - Volume Part II
Year:
2010

Citing 10
Cited 1

Symbolic and Neural Learning Algorithms: An Experimental Comparison

Machine Learning
Fast training of support vector machines using sequential minimal optimization

Advances in kernel methods
An integrated framework for risk profiling of breast cancer patients following surgery

Artificial Intelligence in Medicine
2008 Special Issue: Time-to-event analysis with artificial neural networks: An integrated analytical and rule-based study for breast cancer

Neural Networks
Comparing Analytical Decision Support Models Through Boolean Rule Extraction: A Case Study of Ovarian Tumour Malignancy

ISNN '07 Proceedings of the 4th international symposium on Neural Networks: Part II--Advances in Neural Networks
An empirical comparison of pattern recognition, neural nets, and machine learning classification methods

IJCAI'89 Proceedings of the 11th international joint conference on Artificial intelligence - Volume 1
An empirical comparison of ID3 and back-propagation

IJCAI'89 Proceedings of the 11th international joint conference on Artificial intelligence - Volume 1
A prototype integrated decision support system for breast cancer oncology

IWANN'07 Proceedings of the 9th international work conference on Artificial neural networks
Extracting rules from trained neural networks

IEEE Transactions on Neural Networks
Orthogonal search-based rule extraction (OSRE) for trained neural networks: a practical and efficient approach

IEEE Transactions on Neural Networks

Unified forms for Kalman and finite impulse response filtering and smoothing

Automatica (Journal of IFAC)

Quantified Score

Hi-index	0.00

Visualization

Abstract

Support Vector Machines (SVM) are believed to be as powerful as Artificial Neural Networks (ANN) in modeling complex problems while avoiding some of the drawbacks of the latter such as local minimæ or reliance on architecture. However, a question that remains to be answered is whether SVM users may expect improvements in the interpretability of their models, namely by using rule extraction methods already available to ANN users. This study successfully applies the Orthogonal Search-based Rule Extraction algorithm (OSRE) to Support Vector Machines. The study evidences the portability of rules extracted using OSRE, showing that, in the case of SVM, extracted rules are as accurate and consistent as those from equivalent ANN models. Importantly, the study also shows that the OSRE method benefits from SVM specific characteristics, being able to extract less rules from SVM than from equivalent ANN models.