Feature selection for high-dimensional multi-category data using PLS-based local recursive feature elimination

Authors:
Wenjie You;Zijiang Yang;Guoli Ji
Affiliations:
Department of Automation, Xiamen University, 361005 Xiamen, China and School of Information Technology, York University, Toronto M3J 1P3, Canada;School of Information Technology, York University, Toronto M3J 1P3, Canada;Department of Automation, Xiamen University, 361005 Xiamen, China
Venue:
Expert Systems with Applications: An International Journal
Year:
2014

Citing 21
Cited 0

Estimating attributes: analysis and extensions of RELIEF

ECML-94 Proceedings of the European conference on machine learning on Machine Learning
Wrappers for feature subset selection

Artificial Intelligence - Special issue on relevance
Statistical Pattern Recognition: A Review

IEEE Transactions on Pattern Analysis and Machine Intelligence
Random Forests

Machine Learning
Gene Selection for Cancer Classification using Support Vector Machines

Machine Learning
Reducing multiclass to binary: a unifying approach for margin classifiers

The Journal of Machine Learning Research
An introduction to variable and feature selection

The Journal of Machine Learning Research
Significance of Gene Ranking for Classification of Microarray Samples

IEEE/ACM Transactions on Computational Biology and Bioinformatics (TCBB)
Iterative RELIEF for Feature Weighting: Algorithms, Theories, and Applications

IEEE Transactions on Pattern Analysis and Machine Intelligence
MSVM-RFE

Bioinformatics
Microarray-based classification and clinical predictors

Bioinformatics
Multiclass classification and gene selection with a stochastic algorithm

Computational Statistics & Data Analysis
Support vector-based feature selection using Fisher's linear discriminant and Support Vector Machine

Expert Systems with Applications: An International Journal
Local-Learning-Based Feature Selection for High-Dimensional Data Analysis

IEEE Transactions on Pattern Analysis and Machine Intelligence
Variable selection using random forests

Pattern Recognition Letters
The feature selection problem: traditional methods and a new algorithm

AAAI'92 Proceedings of the tenth national conference on Artificial intelligence
Empirical study of feature selection methods based on individual feature evaluation for classification problems

Expert Systems with Applications: An International Journal
Using partial least squares and support vector machines for bankruptcy prediction

Expert Systems with Applications: An International Journal
An overview of ensemble methods for binary classifiers in multi-class problems: Experimental study on one-vs-one and one-vs-all schemes

Pattern Recognition
A General Wrapper Approach to Selection of Class-Dependent Features

IEEE Transactions on Neural Networks
PLS-Based Gene Selection and Identification of Tumor-Specific Genes

IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews

Quantified Score

Hi-index	12.05

Visualization

Abstract

This paper focuses on high-dimensional and ultrahigh dimensional multi-category problems and presents a feature selection framework based on local recursive feature elimination (Local-RFE). Using this analytical framework, we propose a new feature selection algorithm, PLS-based local-RFE (LRFE-PLS). In order to compare the effectiveness of the proposed methodology, we also present PLS-based Global-RFE which takes all categories into consideration simultaneously. The advantage of the proposed algorithms lies in the fact that PLS-based feature ranking can quickly delete irrelevant features and RFE can concurrently remove some redundant features. As a result, the selected feature subset is more compact. In this paper the proposed algorithms are compared to some state-of-the-art methods using multiple datasets. Experimental results show that the proposed algorithms are competitive and work effectively for high-dimensional multi-category data. Statistical tests of significance show that LRFE-PLS algorithm has better performance. The proposed algorithms can be effectively applied not only to microarray data analysis but also to image recognition and financial data analysis.