On the suitability of combining feature selection and resampling to manage data complexity

Authors:
Raúl Martín-Félez;Ramón A. Mollineda
Affiliations:
DLSI and Institute of New Imaging Technologies, Universitat Jaume I, Castellón, Spain;DLSI and Institute of New Imaging Technologies, Universitat Jaume I, Castellón, Spain
Venue:
CAEPIA'09 Proceedings of the Current topics in artificial intelligence, and 13th conference on Spanish association for artificial intelligence
Year:
2009

Citing 5
Cited 1

Feature selection for text categorization on imbalanced data

ACM SIGKDD Explorations Newsletter - Special issue on learning from imbalanced datasets
Data Complexity in Pattern Recognition (Advanced Information and Knowledge Processing)

Data Complexity in Pattern Recognition (Advanced Information and Knowledge Processing)
Melodic Track Identification in MIDI Files Considering the Imbalanced Context

IbPRIA '09 Proceedings of the 4th Iberian Conference on Pattern Recognition and Image Analysis
SMOTE: synthetic minority over-sampling technique

Journal of Artificial Intelligence Research
Combined effects of class imbalance and class overlap on instance-based classification

IDEAL'06 Proceedings of the 7th international conference on Intelligent Data Engineering and Automated Learning

Analysis of preprocessing vs. cost-sensitive learning for imbalanced classification. Open problems on intrinsic data characteristics

Expert Systems with Applications: An International Journal

Quantified Score

Hi-index	0.00

Visualization

Abstract

The effectiveness of a learning task depends on data complexity (class overlap, class imbalance, irrelevant features, etc.). When more than one complexity factor appears, two or more preprocessing techniques should be applied. Nevertheless, no much effort has been devoted to investigate the importance of the order in which they can be used. This paper focuses on the joint use of feature reduction and balancing techniques, and studies which could be the application order that leads to the best classification results. This analysis was made on a specific problem whose aim was to identify the melodic track given a MIDI file. Several experiments were performed from different imbalanced 38- dimensional training sets with many more accompaniment tracks than melodic tracks, and where features were aggregated without any correlation study. Results showed that the most effective combination was the ordered use of resampling and feature reduction techniques.