Improving ANNs performance on unbalanced data with an AUC-Based learning algorithm

Authors:
Cristiano L. Castro;Antônio P. Braga
Affiliations:
Department of Computer Science, Federal University of Lavras, Lavras, MG, Brazil;Department of Computer Science, Federal University of Lavras, Lavras, MG, Brazil
Venue:
ICANN'12 Proceedings of the 22nd international conference on Artificial Neural Networks and Machine Learning - Volume Part II
Year:
2012

Citing 11
Cited 0

Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations

Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations
A study of the behavior of several methods for balancing machine learning training data

ACM SIGKDD Explorations Newsletter - Special issue on learning from imbalanced datasets
KBA: Kernel Boundary Alignment Considering Imbalanced Data Distribution

IEEE Transactions on Knowledge and Data Engineering
A support vector method for multivariate performance measures

ICML '05 Proceedings of the 22nd international conference on Machine learning
An introduction to ROC analysis

Pattern Recognition Letters - Special issue: ROC analysis in pattern recognition
Learning from Imbalanced Data

IEEE Transactions on Knowledge and Data Engineering
An investigation of neural network classifiers with unequal misclassification costs and group sizes

Decision Support Systems
The use of the area under the ROC curve in the evaluation of machine learning algorithms

Pattern Recognition
Margin-based Ranking and an Equivalence between AdaBoost and RankBoost

The Journal of Machine Learning Research
Supervised neural network modeling: an empirical investigation into learning from imbalanced data with labeling errors

IEEE Transactions on Neural Networks
RAMOBoost: ranked minority oversampling in boosting

IEEE Transactions on Neural Networks

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper investigates the use of the Area Under the ROC Curve (AUC) as an alternative criteria for model selection in classification problems with unbalanced datasets. A novel algorithm, named here as AUCMLP, which incorporates AUC optimization into the Multi-layer Perceptron (MLPs) learning process is presented. The basic principle of AUCMLP is the solution of an optimization problem that aims at ranking quality as well as the separability of class distributions with respect to the threshold decision. Preliminary results achieved on real data, point out that our approach is promising, and can lead to better decision surfaces, specially under more severe unbalance conditions.