Multiclass classification and gene selection with a stochastic algorithm

Authors:
Kim-Anh Lê Cao;Agnès Bonnet;Sébastien Gadat
Affiliations:
Institut de Mathématiques de Toulouse, Université de Toulouse et CNRS (UMR 5219), F-31062 Toulouse, France and Station d'Amélioration Génétique des Animaux UR631, INRA, F- ...;Laboratoire de Génétique Cellulaire UMR 444, INRA, F-31326 Castanet-Tolosan, France;Institut de Mathématiques de Toulouse, Université de Toulouse et CNRS (UMR 5219), F-31062 Toulouse, France
Venue:
Computational Statistics & Data Analysis
Year:
2009

Citing 12
Cited 2

The nature of statistical learning theory

The nature of statistical learning theory
Bagging predictors

Machine Learning
Random Iterative Models

Random Iterative Models
Random Forests

Machine Learning
A Tutorial on Support Vector Machines for Pattern Recognition

Data Mining and Knowledge Discovery
Leave-One-Out Support Vector Machines

IJCAI '99 Proceedings of the Sixteenth International Joint Conference on Artificial Intelligence
Gene Selection for Multi-Class Prediction of Microarray Data

CSB '03 Proceedings of the IEEE Computer Society Conference on Bioinformatics
Does cost-sensitive learning beat sampling for classifying rare classes?

UBDM '05 Proceedings of the 1st international workshop on Utility-based data mining
A comparative study of feature selection and multiclass classification methods for tissue classification based on gene expression

Bioinformatics
A Stochastic Algorithm for Feature Selection in Pattern Recognition

The Journal of Machine Learning Research
Simultaneous cancer classification and gene selection with Bayesian nearest neighbor method: An integrated approach

Computational Statistics & Data Analysis
Using Boosting to prune Double-Bagging ensembles

Computational Statistics & Data Analysis

Feature selection for high-dimensional multi-category data using PLS-based local recursive feature elimination

Expert Systems with Applications: An International Journal
PLS-based recursive feature elimination for high-dimensional small sample

Knowledge-Based Systems

Quantified Score

Hi-index	0.03

Visualization

Abstract

Microarray technology allows for the monitoring of thousands of gene expressions in various biological conditions, but most of these genes are irrelevant for classifying these conditions. Feature selection is consequently needed to help reduce the dimension of the variable space. Starting from the application of the stochastic meta-algorithm ''Optimal Feature Weighting'' (OFW) for selecting features in various classification problems, focus is made on the multiclass problem that wrapper methods rarely handle. From a computational point of view, one of the main difficulties comes from the unbalanced classes situation that is commonly encountered in microarray data. From a theoretical point of view, very few methods have been developed so far to minimize the classification error made on the minority classes. The OFW approach is developed to handle multiclass problems using CART and one-vs-one SVM classifiers. Comparisons are made with other multiclass selection algorithms such as Random Forests and the filter method F-test on five public microarray data sets with various complexities. Statistical relevancy of the gene selections is assessed by computing the performances and the stability of these different approaches and the results obtained show that the two proposed approaches are competitive and relevant to selecting genes classifying the minority classes. Application to a pig folliculogenesis study follows and a detailed interpretation of the genes that were selected shows that the OFW approach answers the biological question.