Exploiting AUC for optimal linear combinations of dichotomizers

Authors:
Claudio Marrocco;Mario Molinara;Francesco Tortorella
Affiliations:
Dipartimento di Automazione, Elettromagnetismo, Ingegneria dell'Informazione e Matematica Industriale, Universití degli Studi di Cassino, 03043 Cassino (FR), Italy;Dipartimento di Automazione, Elettromagnetismo, Ingegneria dell'Informazione e Matematica Industriale, Universití degli Studi di Cassino, 03043 Cassino (FR), Italy;Dipartimento di Automazione, Elettromagnetismo, Ingegneria dell'Informazione e Matematica Industriale, Universití degli Studi di Cassino, 03043 Cassino (FR), Italy
Venue:
Pattern Recognition Letters - Special issue: ROC analysis in pattern recognition
Year:
2006

Citing 9
Cited 7

Making large-scale support vector machine learning practical

Advances in kernel methods
Robust Classification for Imprecise Environments

Machine Learning
A Simple Generalisation of the Area Under the ROC Curve for Multiple Class Classification Problems

Machine Learning
The Case against Accuracy Estimation for Comparing Induction Algorithms

ICML '98 Proceedings of the Fifteenth International Conference on Machine Learning
An efficient boosting algorithm for combining preferences

The Journal of Machine Learning Research
Model selection via the AUC

ICML '04 Proceedings of the twenty-first international conference on Machine learning
Using AUC and Accuracy in Evaluating Learning Algorithms

IEEE Transactions on Knowledge and Data Engineering
A ROC-based reject rule for dichotomizers

Pattern Recognition Letters
The use of the area under the ROC curve in the evaluation of machine learning algorithms

Pattern Recognition

Maximizing the area under the ROC curve by pairwise feature combination

Pattern Recognition
Combination of Experts by Classifiers in Similarity Score Spaces

SSPR & SPR '08 Proceedings of the 2008 Joint IAPR International Workshop on Structural, Syntactic, and Statistical Pattern Recognition
Score Fusion by Maximizing the Area under the ROC Curve

IbPRIA '09 Proceedings of the 4th Iberian Conference on Pattern Recognition and Image Analysis
AUC maximization linear classifier based on active learning and its application

Neurocomputing
Index driven combination of multiple biometric experts for AUC maximisation

MCS'07 Proceedings of the 7th international conference on Multiple classifier systems
An overview of AI research in Italy

Artificial intelligence
Partial AUC maximization in a linear combination of dichotomizers

Pattern Recognition

Quantified Score

Hi-index	0.00

Visualization

Abstract

The combination of classifiers is an established technique to improve the classification performance. The possible combination rules proposed up to now generally try to decrease the classification error rate, which is a performance measure not suitable in many real situations and particularly when dealing with two-class problems. In this case, a good alternative is given by the area under the receiver operating characteristic curve (AUC), whose effectiveness in measuring the classification quality has been proved in many recent papers. In this paper, we propose a method to achieve the optimal linear combination of two dichotomizers based on the maximization of the AUC of the resulting classification system. The effectiveness of the approach has been confirmed by the tests performed on standard datasets.