Comparing Boosting and Bagging Techniques With Noisy and Imbalanced Data

Authors:
T. M. Khoshgoftaar;J. Van Hulse;A. Napolitano
Affiliations:
Florida Atlantic Univ., Boca Raton, FL, USA;-;-
Venue:
IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans
Year:
2011

Citing 0
Cited 7

A direct boosting algorithm for the k-nearest neighbor classifier via local warping of the distance metric

Pattern Recognition Letters
ACOSampling: An ant colony optimization-based undersampling method for classifying imbalanced DNA microarray data

Neurocomputing
Analysing the classification of imbalanced data-sets with multiple classes: Binarization techniques and ad-hoc approaches

Knowledge-Based Systems
The fuzzy Laplacianclassifier

Neurocomputing
Enhancing text clustering model based on truncated singular value decomposition, fuzzy art and cross validation

Proceedings of the 2013 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining
Tackling the problem of classification with noisy data using Multiple Classifier Systems: Analysis of the performance and robustness

Information Sciences: an International Journal
Training and assessing classification rules with imbalanced data

Data Mining and Knowledge Discovery

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper compares the performance of several boosting and bagging techniques in the context of learning from imbalanced and noisy binary-class data. Noise and class imbalance are two well-established data characteristics encountered in a wide range of data mining and machine learning initiatives. The learning algorithms studied in this paper, which include SMOTEBoost, RUSBoost, Exactly Balanced Bagging, and Roughly Balanced Bagging, combine boosting or bagging with data sampling to make them more effective when data are imbalanced. These techniques are evaluated in a comprehensive suite of experiments, for which nearly four million classification models were trained. All classifiers are assessed using seven different performance metrics, providing a complete perspective on the performance of these techniques, and results are tested for statistical significance via analysis-of-variance modeling. The experiments show that the bagging techniques generally outperform boosting, and hence in noisy data environments, bagging is the preferred method for handling class imbalance.