Classification and regression: money *can* grow on trees
KDD '99 Tutorial notes of the fifth ACM SIGKDD international conference on Knowledge discovery and data mining
Meta Analysis of Classification Algorithms for Pattern Recognition
IEEE Transactions on Pattern Analysis and Machine Intelligence
Enlarging the Margins in Perceptron Decision Trees
Machine Learning
Machine Learning
Hybrid inductive machine learning: an overview of CLIP algorithms
New learning paradigms in soft computing
Automatic Construction of Decision Trees from Data: A Multi-Disciplinary Survey
Data Mining and Knowledge Discovery
Goal-Directed Classification Using Linear Machine Decision Trees
IEEE Transactions on Pattern Analysis and Machine Intelligence
Learning of plan execution policies for indoor navigation
AI Communications - Special issue on KI-2001
Two timescale analysis of the Alopex algorithm for optimization
Neural Computation
Induction of Multivariate Decision Trees by Using Dipolar Criteria
PKDD '00 Proceedings of the 4th European Conference on Principles of Data Mining and Knowledge Discovery
Convex Hulls in Concept Induction
PAKDD '99 Proceedings of the Third Pacific-Asia Conference on Methodologies for Knowledge Discovery and Data Mining
Feature Transformation and Multivariate Decision Tree Induction
DS '98 Proceedings of the First International Conference on Discovery Science
DS '99 Proceedings of the Second International Conference on Discovery Science
DS '01 Proceedings of the 4th International Conference on Discovery Science
Functional Trees for Regression
IDA '01 Proceedings of the 4th International Conference on Advances in Intelligent Data Analysis
Theoretical Computer Science
Data reduction: feature aggregation
Handbook of data mining and knowledge discovery
HOT: Heuristics for Oblique Trees
ICTAI '99 Proceedings of the 11th IEEE International Conference on Tools with Artificial Intelligence
Generating neural networks through the induction of threshold logic unit trees
INBS '95 Proceedings of the First International Symposium on Intelligence in Neural and Biological Systems (INBS'95)
A maximal figure-of-merit learning approach to text categorization
Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval
A comparative assessment of classification methods
Decision Support Systems
Simplifying decision trees: A survey
The Knowledge Engineering Review
Machine Learning
Online adaptive decision trees
Neural Computation
Interpretable Hierarchical Clustering by Constructing an Unsupervised Decision Tree
IEEE Transactions on Knowledge and Data Engineering
A scalable decision tree system and its application in pattern recognition and intrusion detection
Decision Support Systems
ACM Transactions on Information Systems (TOIS)
A simple regression based heuristic for learning model trees
Intelligent Data Analysis
A simple and fast multi-class piecewise linear pattern classifier
Pattern Recognition
Enhancing software quality estimation using ensemble-classifier based noise filtering
Intelligent Data Analysis
Classifier Ensembles with a Random Linear Oracle
IEEE Transactions on Knowledge and Data Engineering
Decision trees using model ensemble-based nodes
Pattern Recognition
Setting attribute weights for k-NN based binary classification via quadratic programming
Intelligent Data Analysis
Intelligent Data Analysis
Tree structured classifiers, interconnected data, and predictive accuracy
Intelligent Data Analysis
Data & Knowledge Engineering
Constructing a decision tree from data with hierarchical class labels
Expert Systems with Applications: An International Journal
Genetic Programming and Evolvable Machines
Classification with Unknown Classes
SSDBM 2009 Proceedings of the 21st International Conference on Scientific and Statistical Database Management
A system for induction of oblique decision trees
Journal of Artificial Intelligence Research
Computers in Biology and Medicine
WSEAS Transactions on Computers
A scalable decision tree system and its application in pattern recognition and intrusion detection
Decision Support Systems
Identifying and eliminating mislabeled training instances
AAAI'96 Proceedings of the thirteenth national conference on Artificial intelligence - Volume 1
Multivariate decision tree function approximation for reinforcement learning
ICONIP'10 Proceedings of the 17th international conference on Neural information processing: theory and algorithms - Volume Part I
The inverse classification problem
Journal of Computer Science and Technology
A subspace decision cluster classifier for text classification
Expert Systems with Applications: An International Journal
ACM Transactions on Reconfigurable Technology and Systems (TRETS)
Model trees for classification of hybrid data types
IDEAL'05 Proceedings of the 6th international conference on Intelligent Data Engineering and Automated Learning
Model selection in omnivariate decision trees
ECML'05 Proceedings of the 16th European conference on Machine Learning
Multivariate decision trees using different splitting attribute subsets for large datasets
AI'10 Proceedings of the 23rd Canadian conference on Advances in Artificial Intelligence
Time complexity of decision trees
Transactions on Rough Sets III
An experimental study on ensembles of functional trees
MCS'10 Proceedings of the 9th international conference on Multiple Classifier Systems
Multi-Test decision trees for gene expression data analysis
SIIS'11 Proceedings of the 2011 international conference on Security and Intelligent Information Systems
Evolutionary design of decision trees for medical application
Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery
Model selection in omnivariate decision trees using Structural Risk Minimization
Information Sciences: an International Journal
Differential evolution and perceptron decision trees for classification tasks
IDEAL'12 Proceedings of the 13th international conference on Intelligent Data Engineering and Automated Learning
Review: Supervised classification and mathematical optimization
Computers and Operations Research
Quite a mess in my cookie jar!: leveraging machine learning to protect web authentication
Proceedings of the 23rd international conference on World wide web
Hi-index | 0.01 |
Unlike a univariate decision tree, a multivariate decision tree is not restricted to splits of the instance space that are orthogonal to the features' axes. This article addresses several issues for constructing multivariate decision trees: representing a multivariate test, including symbolic and numeric features, learning the coefficients of a multivariate test, selecting the features to include in a test, and pruning of multivariate decision trees. We present several new methods for forming multivariate decision trees and compare them with several well-known methods. We compare the different methods across a variety of learning tasks, in order to assess each method's ability to find concise, accurate decision trees. The results demonstrate that some multivariate methods are in general more effective than others (in the context of our experimental assumptions). In addition, the experiments confirm that allowing multivariate tests generally improves the accuracy of the resulting decision tree over a univariate tree.