Learning internal representations by error propagation
Parallel distributed processing: explorations in the microstructure of cognition, vol. 1
Neural network learning and expert systems
Neural network learning and expert systems
NIPS-3 Proceedings of the 1990 conference on Advances in neural information processing systems 3
C4.5: programs for machine learning
C4.5: programs for machine learning
Extracting Refined Rules from Knowledge-Based Neural Networks
Machine Learning
Machine Learning
Extracting comprehensible models from trained neural networks
Extracting comprehensible models from trained neural networks
IEEE Transactions on Neural Networks
ANN-DT: an algorithm for extraction of decision trees from artificial neural networks
IEEE Transactions on Neural Networks
| Hi-index | 0.00 |
Extracting meaningful knowledge from Artificial Neural Networks (ANNs) is a current issue since, for several applications, the ability to explain the decisions taken by ANNs is even more important than their classification performance. Although some techniques have been suggested to solve this problem, a large number of these techniques can only be applied to some specific ANNs models. This paper proposes and investigates the use of symbolic learning algorithms, such as C.45, C4.5rules [13], and CN2 [4], to extract meaningful symbolic representations from trained ANNs. The main difference of this approach with other techniques previously proposed is that it can be applied to any supervised ANN model. The approach proposed is in some way similar to the one used by the Trepan algorithm [5], which extracts a symbolic representation, expressed as a decision tree, from a trained ANN. Experimental results are presented and discussed in order to compare the knowledge extracted from several ANNs using the proposed approach and the Trepan approach. Results are compared regarding two aspects: fidelity and comprehensibility. The results obtained show that our approach, using C4.5, C4.5rules and CN2 as symbolic learning algorithms, produces in general better comprehensible symbolic representation than Trepan for the trained ANNs considered in the experiments.