Generating production rules from decision trees

Authors:
J. R. Quinlan
Affiliations:
School of Computing Sciences, New South Wales Institute of Technology, Sydney, Australia and Artificial Intelligence Laboratory, Massachusetts Institute of Technology, Cambridge, MA
Venue:
IJCAI'87 Proceedings of the 10th international joint conference on Artificial intelligence - Volume 1
Year:
1987

Citing 5
Cited 28

An analytical comparison of some rule-learning programs

Artificial Intelligence
Artificial intelligence (2nd ed.)

Artificial intelligence (2nd ed.)
Inductive knowledge acquisition: a case study

Proceedings of the Second Australian Conference on Applications of expert systems
Simplifying decision trees

International Journal of Man-Machine Studies - Special Issue: Knowledge Acquisition for Knowledge-based Systems. Part 5
Induction of Decision Trees

Machine Learning

Experience with a learning personal assistant

Communications of the ACM
Connectionist Expert System with Adaptive Learning Capability

IEEE Transactions on Knowledge and Data Engineering
Learning Rules from Distributed Data

Revised Papers from Large-Scale Parallel Data Mining, Workshop on Large-Scale Parallel KDD Systems, SIGKDD
Mining the data from a hyperheuristic approach using associative classification

Expert Systems with Applications: An International Journal
A Genetic Algorithm for Text Classification Rule Induction

ECML PKDD '08 Proceedings of the European conference on Machine Learning and Knowledge Discovery in Databases - Part II
Wise mining method through ant colony optimization

SMC'09 Proceedings of the 2009 IEEE international conference on Systems, Man and Cybernetics
An efficient algorithm for automatic knowledge acquisition

Pattern Recognition
Motion retrieval based on temporal-spatial features by decision tree

ICDHM'07 Proceedings of the 1st international conference on Digital human modeling
What should be minimized in a decision tree?

AAAI'90 Proceedings of the eighth National conference on Artificial intelligence - Volume 2
Learning meta knowledge for database checking

AAAI'91 Proceedings of the ninth National conference on Artificial intelligence - Volume 1
A personal learning apprentice

AAAI'92 Proceedings of the tenth national conference on Artificial intelligence
COGIN: symbolic induction with genetic algorithms

AAAI'92 Proceedings of the tenth national conference on Artificial intelligence
Inductive policy

AAAI'92 Proceedings of the tenth national conference on Artificial intelligence
Iterative weakening: optimal and near-optimal policies for the selection of search bias

AAAI'93 Proceedings of the eleventh national conference on Artificial intelligence
Generating C4.5 production rules in parallel

AAAI'97/IAAI'97 Proceedings of the fourteenth national conference on artificial intelligence and ninth conference on Innovative applications of artificial intelligence
ROLEX-SP: Rules of lexical syntactic patterns for free text categorization

Knowledge-Based Systems
Scaling up: distributed machine learning with cooperation

AAAI'96 Proceedings of the thirteenth national conference on Artificial intelligence - Volume 1
Decisions: algebra and implementation

MLDM'11 Proceedings of the 7th international conference on Machine learning and data mining in pattern recognition
Standards, data models, ontologies, rules: prerequisites for comprehensive clinical practice guidelines

RuleML'11 Proceedings of the 5th international conference on Rule-based modeling and computing on the semantic web
Time complexity of decision trees

Transactions on Rough Sets III
A TENGRAM method based part-of-speech tagging of multi-category words in Hindi language

Expert Systems with Applications: An International Journal
Using Bayesian networks in the construction of a bi-level multi-classifier. A case study using intensive care unit patients data

Artificial Intelligence in Medicine
Automating the knowledge acquisition process in the construction of medical expert systems

Artificial Intelligence in Medicine
Unimprovable Upper Bounds on Time Complexity of Decision Trees

Fundamenta Informaticae
GAMoN: Discovering M-of-N{¬,∨} hypotheses for text classification by a lattice-based Genetic Algorithm

Artificial Intelligence
A novel classification model for cotton yarn quality based on trained neural network using genetic algorithm

Knowledge-Based Systems
Disparate attributes algorithm for semantic assembly design rule management

Advanced Engineering Informatics
A novel ant colony optimization based single path hierarchical classification algorithm for predicting gene ontology

Applied Soft Computing

Quantified Score

Hi-index	0.02

Visualization

Abstract

Many inductive knowledge acquisition algorithms generate classifiers in the form of decision trees. This paper describes a technique for transforming such trees to small sets of production rules, a common formalism for expressing knowledge in expert systems. The method makes use of the training set of cases from which the decision tree was generated, first to generalize and assess the reliability of individual rules extracted from the tree, and subsequently to refine the collection of rules as a whole. The final set of production rules is usually both simpler than the decision tree from which it was obtained, and more accurate when classifying unseen cases. Transformation to production rules also provides a way of combining different decision trees for the same classification domain.