Simplifying decision trees: A survey

Authors:
Leonard A. Breslow;David W. Aha
Affiliations:
Navy Center for Applied Research in Artificial Intelligence, Naval Research Laboratory, Washington, DC 20375, USA. E-mail: {breslow,aha}@aic.nrl.navy.mil;Navy Center for Applied Research in Artificial Intelligence, Naval Research Laboratory, Washington, DC 20375, USA. E-mail: {breslow,aha}@aic.nrl.navy.mil
Venue:
The Knowledge Engineering Review
Year:
1997

Citing 53
Cited 42

Tree classifier design with a permutation statistic

Pattern Recognition
Learning decision rules in noisy domains

Proceedings of Expert Systems '86, The 6Th Annual Technical Conference on Research and development in expert systems III
Simplifying decision trees

International Journal of Man-Machine Studies - Special Issue: Knowledge Acquisition for Knowledge-based Systems. Part 5
Computational limitations on learning from examples

Journal of the ACM (JACM)
Extensions to the CART algorithm

International Journal of Man-Machine Studies
Inferring decision trees using the minimum description length principle

Information and Computation
Boolean Feature Discovery in Empirical Learning

Machine Learning
Decision tree reduction

Journal of the ACM (JACM)
An incremental method for finding multivariate splits for decision trees

Proceedings of the seventh international conference (1990) on Machine learning
An ounce of knowledge is worth a ton of data: quantitative studies of the trade-off between expertise and data based on statistically well-founded empirical induction

Proceedings of the sixth international workshop on Machine learning
Improved training via incremental learning

Proceedings of the sixth international workshop on Machine learning
Improved Estimates for the Accuracy of Small Disjuncts

Machine Learning
An Iterative Growing and Pruning Algorithm for Classification Tree Design

IEEE Transactions on Pattern Analysis and Machine Intelligence
A Statistical-Heuristic Feature Selection Criterion for Decision Tree Induction

IEEE Transactions on Pattern Analysis and Machine Intelligence
A Further Comparison of Splitting Rules for Decision-Tree Induction

Machine Learning
C4.5: programs for machine learning

C4.5: programs for machine learning
The application of confidence interval error analysis to the design of decision tree classifiers

Pattern Recognition Letters
Overfitting Avoidance as Bias

Machine Learning
Coding Decision Trees

Machine Learning
Very Simple Classification Rules Perform Well on Most Commonly Used Datasets

Machine Learning
Bottom-up induction of oblivious read-once decision graphs

ECML-94 Proceedings of the European conference on machine learning on Machine Learning
Trading Accuracy for Simplicity in Decision Trees

Machine Learning
Bottom-up induction of oblivious read-once decision graphs: strengths and limitations

AAAI '94 Proceedings of the twelfth national conference on Artificial intelligence (vol. 1)
Decision tree pruning: biased or optimal?

AAAI '94 Proceedings of the twelfth national conference on Artificial intelligence (vol. 1)
Multivariate Decision Trees

Machine Learning
Elements of machine learning

Elements of machine learning
Recursive Automatic Bias Selection for Classifier Construction

Machine Learning - Special issue on bias evaluation and selection
On the boosting ability of top-down decision tree learning algorithms

STOC '96 Proceedings of the twenty-eighth annual ACM symposium on Theory of computing
IGTree: Using Trees for Compression and Classification in Lazy LearningAlgorithms

Artificial Intelligence Review - Special issue on lazy learning
Transforming rules and trees

Advances in knowledge discovery and data mining
An Empirical Comparison of Pruning Methods for Decision Tree Induction

Machine Learning
An Empirical Comparison of Selection Measures for Decision-Tree Induction

Machine Learning
Induction of Decision Trees

Machine Learning
Knowledge Acquisition Via Incremental Conceptual Clustering

Machine Learning
A Balanced Hierarchical Data Structure for Multidimensional Data with Highly Efficient Dynamic Characteristics

IEEE Transactions on Knowledge and Data Engineering
The Replication Problem: A Constructive Induction Approach

EWSL '91 Proceedings of the European Working Session on Machine Learning
On Changing Continuous Attributes into Ordered Discrete Attributes

EWSL '91 Proceedings of the European Working Session on Machine Learning
On Estimating Probabilities in Tree Pruning

EWSL '91 Proceedings of the European Working Session on Machine Learning
Decision Tree Pruning as a Search in the State Space

ECML '93 Proceedings of the European Conference on Machine Learning
Pruning Multivariate Decision Trees by Hyperplane Merging

ECML '95 Proceedings of the 8th European Conference on Machine Learning
Simplifying Decision Trees by Pruning and Grafting: New Results (Extended Abstract)

ECML '95 Proceedings of the 8th European Conference on Machine Learning
Deconstructing the Digit Recognition Problem

ML '92 Proceedings of the Ninth International Workshop on Machine Learning
A Practical Approach to Feature Selection

ML '92 Proceedings of the Ninth International Workshop on Machine Learning
INRECA: A Seamlessly Integrated System Based on Inductive Inference and Case-Based Reasoning

ICCBR '95 Proceedings of the First International Conference on Case-Based Reasoning Research and Development
Linear Machine Decision Trees

Linear Machine Decision Trees
A Kolmogorov-Smirnoff Metric for Decision Tree Induction

A Kolmogorov-Smirnoff Metric for Decision Tree Induction
Perceptrons: An Introduction to Computational Geometry

Perceptrons: An Introduction to Computational Geometry
Improved use of continuous attributes in C4.5

Journal of Artificial Intelligence Research
Oversearching and layered search in empirical learning

IJCAI'95 Proceedings of the 14th international joint conference on Artificial intelligence - Volume 2
Lookahead and pathology in decision tree induction

IJCAI'95 Proceedings of the 14th international joint conference on Artificial intelligence - Volume 2
Intermediate decision trees

IJCAI'95 Proceedings of the 14th international joint conference on Artificial intelligence - Volume 2
Constructing nominal X-of-N attributes

IJCAI'95 Proceedings of the 14th international joint conference on Artificial intelligence - Volume 2
Oblivious decision trees graphs and top down pruning

IJCAI'95 Proceedings of the 14th international joint conference on Artificial intelligence - Volume 2

A Comparison of Prediction Accuracy, Complexity, and Training Time of Thirty-Three Old and New Classification Algorithms

Machine Learning
Understanding the crucial differences between classification and discovery of association rules: a position paper

ACM SIGKDD Explorations Newsletter
Conversational Case-Based Reasoning

Applied Intelligence
A Generalised Approach to Similarity-Based Retrieval in Recommender Systems

Artificial Intelligence Review
Mining Comprehensible Rules from Data with an Ant Colony Algorithm

SBIA '02 Proceedings of the 16th Brazilian Symposium on Artificial Intelligence: Advances in Artificial Intelligence
Contribution of Dataset Reduction Techniques to Tree-Simplification and Knowledge Discovery

PKDD '00 Proceedings of the 4th European Conference on Principles of Data Mining and Knowledge Discovery
Sampling Strategies for Targeting Rare Groups from a Bank Customer Database

PKDD '00 Proceedings of the 4th European Conference on Principles of Data Mining and Knowledge Discovery
Discovering Fuzzy Classification Rules with Genetic Programming and Co-evolution

PKDD '01 Proceedings of the 5th European Conference on Principles of Data Mining and Knowledge Discovery
Sequential Diagnosis in the Independence Bayesian Framework

Soft-Ware 2002 Proceedings of the First International Conference on Computing in an Imperfect World
Boosted Tree Ensembles for Solving Multiclass Problems

MCS '02 Proceedings of the Third International Workshop on Multiple Classifier Systems
An Empirical Comparison of Pruning Methods for Ensemble Classifiers

IDA '01 Proceedings of the 4th International Conference on Advances in Intelligent Data Analysis
Industry: the use of modern heuristic algorithms for mining insurance data

Handbook of data mining and knowledge discovery
A heuristic for learning decision trees and pruning them into classification rules

AI Communications
A heuristic for learning decision trees and pruning them into classification rules

AI Communications
Evolutionary stratified training set selection for extracting classification rules with trade off precision-interpretability

Data & Knowledge Engineering
Design and evaluation of visualization support to facilitate decision trees classification

International Journal of Human-Computer Studies
Toward Exploratory Test-Instance-Centered Diagnosis in High-Dimensional Classification

IEEE Transactions on Knowledge and Data Engineering
Hybrid systems of local basis functions

Intelligent Data Analysis
Reducing decision tree fragmentation through attribute value grouping: A comparative study

Intelligent Data Analysis
Machine learning: a review of classification and combining techniques

Artificial Intelligence Review
Region-based image retrieval with high-level semantics using decision tree learning

Pattern Recognition
Fuzzy Rules Generation Method for Pattern Recognition Problems

WILF '07 Proceedings of the 7th international workshop on Fuzzy Logic and Applications: Applications of Fuzzy Sets Theory
A bottom-up approach to discover transition rules of cellular automata using ant intelligence

International Journal of Geographical Information Science
An Optimal Constrained Pruning Strategy for Decision Trees

INFORMS Journal on Computing
Increasing dialogue efficiency in case-based reasoning without loss of solution quality

IJCAI'03 Proceedings of the 18th international joint conference on Artificial intelligence
minimizing dialog length in interactive case-based reasoning

IJCAI'01 Proceedings of the 17th international joint conference on Artificial intelligence - Volume 2
A preference-based approach for interactive weight learning: learning weights within a logic-based query language

Distributed and Parallel Databases
Wise mining method through ant colony optimization

SMC'09 Proceedings of the 2009 IEEE international conference on Systems, Man and Cybernetics
CSNL: A cost-sensitive non-linear decision tree algorithm

ACM Transactions on Knowledge Discovery from Data (TKDD)
Automatic revision of the control knowledge used by trial and error methods: Application to cartographic generalisation

Applied Soft Computing
The inverse classification problem

Journal of Computer Science and Technology
Fuzzy knowledge generation method for data-mining problems

ACS'06 Proceedings of the 6th WSEAS international conference on Applied computer science
Learning search heuristics for finding objects in structured environments

Robotics and Autonomous Systems
Towards the automatic design of decision tree induction algorithms

Proceedings of the 13th annual conference companion on Genetic and evolutionary computation
Mining staff assignment rules from event-based data

BPM'05 Proceedings of the Third international conference on Business Process Management
A hyper-heuristic evolutionary algorithm for automatically designing decision-tree algorithms

Proceedings of the 14th annual conference on Genetic and evolutionary computation
Selection of evolutionary approach based hybrid data mining algorithms for decision support systems and business intelligence

Proceedings of the International Conference on Advances in Computing, Communications and Informatics
An approximation decision entropy based decision tree algorithm and its application in intrusion detection

RSKT'12 Proceedings of the 7th international conference on Rough Sets and Knowledge Technology
On achieving semi-supervised pattern recognition by utilizing tree-based SOMs

Pattern Recognition
Decision tree selection in an industrial machine fault diagnostics

MEDI'12 Proceedings of the 2nd international conference on Model and Data Engineering
FPTASs for trimming weighted trees

Theoretical Computer Science
Automatic design of decision-tree algorithms with evolutionary algorithms

Evolutionary Computation

Quantified Score

Hi-index	0.00

Visualization

Abstract

Induced decision trees are an extensively-researched solution to classification tasks. For many practical tasks, the trees produced by tree-generation algorithms are not comprehensible to users due to their size and complexity. Although many tree induction algorithms have been shown to produce simpler, more comprehensible trees (or data structures derived from trees) with good classification accuracy, tree simplification has usually been of secondary concern relative to accuracy, and no attempt has been made to survey the literature from the perspective of simplification. We present a framework that organizes the approaches to tree simplification and summarize and critique the approaches within this framework. The purpose of this survey is to provide researchers and practitioners with a concise overview of tree-simplification approaches and insight into their relative capabilities. In our final discussion, we briefly describe some empirical findings and discuss the application of tree induction algorithms to case retrieval in case-based reasoning systems.