On the combination of locally optimal pairwise classifiers

Authors:
G. Szepannek;B. Bischl;C. Weihs
Affiliations:
Department of Statistics, Dortmund University of Technology, D-44221 Dortmund, Germany;Department of Statistics, Dortmund University of Technology, D-44221 Dortmund, Germany;Department of Statistics, Dortmund University of Technology, D-44221 Dortmund, Germany
Venue:
Engineering Applications of Artificial Intelligence
Year:
2009

Citing 10
Cited 0

Bagging predictors

Machine Learning
A decision-theoretic generalization of on-line learning and an application to boosting

Journal of Computer and System Sciences - Special issue: 26th annual ACM symposium on the theory of computing & STOC'94, May 23–25, 1994, and second annual Europe an conference on computational learning theory (EuroCOLT'95), March 13–15, 1995
Approximate statistical tests for comparing supervised classification learning algorithms

Neural Computation
Random Forests

Machine Learning
Improved Pairwise Coupling Classification with Correcting Classifiers

ECML '98 Proceedings of the 10th European Conference on Machine Learning
Reducing multiclass to binary: a unifying approach for margin classifiers

The Journal of Machine Learning Research
Probability Estimates for Multi-class Classification by Pairwise Coupling

The Journal of Machine Learning Research
Solving multiclass learning problems via error-correcting output codes

Journal of Artificial Intelligence Research
Local modelling in classification on different feature subspaces

ICDM'06 Proceedings of the 6th Industrial Conference on Data Mining conference on Advances in Data Mining: applications in Medicine, Web Mining, Marketing, Image and Signal Mining
Exploiting randomness for feature selection in multinomial logit: a CRM cross-sell application

ICDM'06 Proceedings of the 6th Industrial Conference on Data Mining conference on Advances in Data Mining: applications in Medicine, Web Mining, Marketing, Image and Signal Mining

Quantified Score

Hi-index	0.00

Visualization

Abstract

Classification methods generally rely on some idea about the data structure. If the specific assumptions are not met, a classifier may fail. In this paper, the possibility of combining classifiers in multi-class problems is investigated. Multi-class classification problems are split into two class problems. For each of the latter problems an optimal classifier is determined. The results of applying the optimal classifiers on the two class problems can be combined using a pairwise coupling algorithm. In this paper, exemplary situations are investigated where the respective assumptions of Naive Bayes or the classical Linear Discriminant Analysis (LDA) fail. It is investigated at which degree of violations of the assumptions it may be advantageous to use single methods or a classifier combination by pairwise coupling.