Variable selection using svm based criteria

Authors:
Alain Rakotomamonjy
Affiliations:
Perception, Systèmes et Information, FRE CNRS 2645, INSA de Rouen, 76801 Saint Etienne du Rouvray France
Venue:
The Journal of Machine Learning Research
Year:
2003

Citing 9
Cited 95

A training algorithm for optimal margin classifiers

COLT '92 Proceedings of the fifth annual workshop on Computational learning theory
Wrappers for feature subset selection

Artificial Intelligence - Special issue on relevance
An introduction to support Vector Machines: and other kernel-based learning methods

An introduction to support Vector Machines: and other kernel-based learning methods
On the Optimality of the Backward Greedy Algorithm for the Subset Selection Problem

SIAM Journal on Matrix Analysis and Applications
Soft Margins for AdaBoost

Machine Learning
Choosing Multiple Parameters for Support Vector Machines

Machine Learning
Gene Selection for Cancer Classification using Support Vector Machines

Machine Learning
Gradient-Based Optimization of Hyperparameters

Neural Computation
Bounds on Error Expectation for Support Vector Machines

Neural Computation

An introduction to variable and feature selection

The Journal of Machine Learning Research
Using recursive classification to discover predictive features

Proceedings of the 2005 ACM symposium on Applied computing
Semisupervised Learning for Molecular Profiling

IEEE/ACM Transactions on Computational Biology and Bioinformatics (TCBB)
Variable selection in kernel Fisher discriminant analysis by means of recursive feature elimination

Computational Statistics & Data Analysis
Non-parametric classifier-independent feature selection

Pattern Recognition
A penalized criterion for variable selection in classification

Journal of Multivariate Analysis
Analysis of SVM regression bounds for variable ranking

Neurocomputing
Feature selection for the SVM: An application to hypertension diagnosis

Expert Systems with Applications: An International Journal
Direct convex relaxations of sparse SVM

Proceedings of the 24th international conference on Machine learning
A hybrid genetic algorithm for feature selection wrapper based on mutual information

Pattern Recognition Letters
Feature selection via sensitivity analysis of SVM probabilistic outputs

Machine Learning
Multiclass SVM-RFE for product form feature selection

Expert Systems with Applications: An International Journal
A machine-learning approach for analyzing document layout structures with two reading orders

Pattern Recognition
An Information Criterion for Variable Selection in Support Vector Machines

The Journal of Machine Learning Research
Kernel discriminant analysis based feature selection

Neurocomputing
Visual Methods for Examining SVM Classifiers

Visual Data Mining
Support Vector Based T-Score for Gene Ranking

PRIB '08 Proceedings of the Third IAPR International Conference on Pattern Recognition in Bioinformatics
A data mining-based subset selection for enhanced discrimination using iterative elimination of redundancy

Expert Systems with Applications: An International Journal
Informative transcription factor selection using support vector machine-based generalized approximate cross validation criteria

Computational Statistics & Data Analysis
Evaluating switching neural networks through artificial and real gene expression data

Artificial Intelligence in Medicine
A wrapper method for feature selection using Support Vector Machines

Information Sciences: an International Journal
Non-monotonic feature selection

ICML '09 Proceedings of the 26th Annual International Conference on Machine Learning
A memetic algorithm for gene selection and molecular classification of cancer

Proceedings of the 11th Annual conference on Genetic and evolutionary computation
Feature Selection in Survival Least Squares Support Vector Machines with Maximal Variation Constraints

IWANN '09 Proceedings of the 10th International Work-Conference on Artificial Neural Networks: Part I: Bio-Inspired Systems: Computational and Ambient Intelligence
Efficient linearization of tree kernel functions

CoNLL '09 Proceedings of the Thirteenth Conference on Computational Natural Language Learning
Design of input vector for day-ahead price forecasting of electricity markets

Expert Systems with Applications: An International Journal
Feature Weighting Using Margin and Radius Based Error Bound Optimization in SVMs

ECML PKDD '09 Proceedings of the European Conference on Machine Learning and Knowledge Discovery in Databases: Part I
Gene extraction for cancer diagnosis by support vector machines-An improvement

Artificial Intelligence in Medicine
Feature subset selection for improved native accent identification

Speech Communication
Reverse engineering of tree kernel feature spaces

EMNLP '09 Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing: Volume 1 - Volume 1
Selective enhancement learning in competitive learning

IJCNN'09 Proceedings of the 2009 international joint conference on Neural Networks
Local Causal and Markov Blanket Induction for Causal Discovery and Feature Selection for Classification Part I: Algorithms and Empirical Evaluation

The Journal of Machine Learning Research
Noise-based feature perturbation as a selection method for microarray data

ISBRA'07 Proceedings of the 3rd international conference on Bioinformatics research and applications
One-versus-one and one-versus-all multiclass SVM-RFE for gene selection in cancer classification

EvoBIO'07 Proceedings of the 5th European conference on Evolutionary computation, machine learning and data mining in bioinformatics
A genetic embedded approach for gene selection and classification of microarray data

EvoBIO'07 Proceedings of the 5th European conference on Evolutionary computation, machine learning and data mining in bioinformatics
Input selection for radial basis function networks by constrained optimization

ICANN'07 Proceedings of the 17th international conference on Artificial neural networks
SVM-RFE with relevancy and redundancy criteria for gene selection

PRIB'07 Proceedings of the 2nd IAPR international conference on Pattern recognition in bioinformatics
A study of crossover operators for gene selection of microarray data

EA'07 Proceedings of the Evolution artificielle, 8th international conference on Artificial evolution
First and second order sensitivity analysis of MLP

Neurocomputing
Feature selection for SVM via optimization of kernel polarization with Gaussian ARD kernels

Expert Systems with Applications: An International Journal
A greedy algorithm for gene selection based on SVM and correlation

International Journal of Bioinformatics Research and Applications
Feature selection for support vector regression using probabilistic prediction

Proceedings of the 16th ACM SIGKDD international conference on Knowledge discovery and data mining
Expectation Propagation for microarray data classification

Pattern Recognition Letters
An unsupervised self-organizing learning with support vector ranking for imbalanced datasets

Expert Systems with Applications: An International Journal
Variable selection using random forests

Pattern Recognition Letters
A new wrapper feature selection approach using neural network

Neurocomputing
Simultaneous feature selection and classification using kernel-penalized support vector machines

Information Sciences: an International Journal
Discriminative codeword selection for image representation

Proceedings of the international conference on Multimedia
Mining concept similarities for heterogeneous ontologies

ICDM'10 Proceedings of the 10th industrial conference on Advances in data mining: applications and theoretical aspects
Using a priori knowledge to classify in vivo images of the lung

ICIC'10 Proceedings of the Advanced intelligent computing theories and applications, and 6th international conference on Intelligent computing
Part-based feature synthesis for human detection

ECCV'10 Proceedings of the 11th European conference on Computer vision: Part IV
Accurate identification of MCI patients via enriched white-matter connectivity network

MLMI'10 Proceedings of the First international conference on Machine learning in medical imaging
Recursive Mahalanobis Separability Measure for Gene Subset Selection

IEEE/ACM Transactions on Computational Biology and Bioinformatics (TCBB)
DTI based diagnostic prediction of a disease via pattern classification

MICCAI'10 Proceedings of the 13th international conference on Medical image computing and computer-assisted intervention: Part I
Support vector machines for inhabitant identification in smart houses

UIC'10 Proceedings of the 7th international conference on Ubiquitous intelligence and computing
SVM-RFE based feature selection for tandem mass spectrum quality assessment

International Journal of Data Mining and Bioinformatics
SVM based feature selection: why are we using the dual?

IBERAMIA'10 Proceedings of the 12th Ibero-American conference on Advances in artificial intelligence
Distributed representation of tone frequency in highly decodable spatio-temporal activity in the auditory cortex

Neural Networks
Selective information enhancement learning for creating interpretable representations in competitive learning

Neural Networks
A classification-based Kansei engineering system for modeling consumers' affective responses and analyzing product form features

Expert Systems with Applications: An International Journal
Separating the wheat from the chaff: on feature selection and feature importance in regression random forests and symbolic regression

Proceedings of the 13th annual conference companion on Genetic and evolutionary computation
Improved support vector machines with distance metric learning

ACIVS'11 Proceedings of the 13th international conference on Advanced concepts for intelligent vision systems
Feature selection using support vector machines and bootstrap methods for ventricular fibrillation detection

Expert Systems with Applications: An International Journal
Forex trend classification using machine learning techniques

ACS'11 Proceedings of the 11th WSEAS international conference on Applied computer science
A new hybrid ant colony optimization algorithm for feature selection

Expert Systems with Applications: An International Journal
Feature selection using Bayesian and multiclass Support Vector Machines approaches: Application to bank risk prediction

Expert Systems with Applications: An International Journal
Segmentation evaluation using a support vector machine

ICAPR'05 Proceedings of the Third international conference on Advances in Pattern Recognition - Volume Part I
Feature selection based on kernel discriminant analysis

ICANN'06 Proceedings of the 16th international conference on Artificial Neural Networks - Volume Part II
Classification of structural images via high-dimensional image warping, robust feature extraction, and SVM

MICCAI'05 Proceedings of the 8th international conference on Medical Image Computing and Computer-Assisted Intervention - Volume Part I
Gene extraction for cancer diagnosis by support vector machines

ICANN'05 Proceedings of the 15th international conference on Artificial Neural Networks: biological Inspirations - Volume Part I
SVM classifier incorporating feature selection using GA for spam detection

EUC'05 Proceedings of the 2005 international conference on Embedded and Ubiquitous Computing
Improved feature selection algorithm based on SVM and correlation

ISNN'06 Proceedings of the Third international conference on Advances in Neural Networks - Volume Part I
Gene selection through sensitivity analysis of support vector machines

CompLife'05 Proceedings of the First international conference on Computational Life Sciences
Learning the reasons why groups of consumers prefer some food products

ICDM'06 Proceedings of the 6th Industrial Conference on Data Mining conference on Advances in Data Mining: applications in Medicine, Web Mining, Marketing, Image and Signal Mining
Feature selection using SVM probabilistic outputs

ICONIP'06 Proceedings of the 13 international conference on Neural Information Processing - Volume Part I
Embedded feature selection for support vector machines: state-of-the-art and future challenges

CIARP'11 Proceedings of the 16th Iberoamerican Congress conference on Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications
Feature selection for dimensionality reduction

SLSFS'05 Proceedings of the 2005 international conference on Subspace, Latent Structure and Feature Selection
A new local search based hybrid genetic algorithm for feature selection

Neurocomputing
Double enhancement learning for explicit internal representations: unifying self-enhancement and information enhancement to incorporate information on input variables

Applied Intelligence
Bispectral analysis and genetic algorithm for congestive heart failure recognition based on heart rate variability

Computers in Biology and Medicine
A general lp-norm support vector machine via mixed 0-1 programming

MLDM'12 Proceedings of the 8th international conference on Machine Learning and Data Mining in Pattern Recognition
Structural feature selection for connectivity network-based MCI diagnosis

MBIA'12 Proceedings of the Second international conference on Multimodal Brain Image Analysis
Facial image medical analysis system using quantitative chromatic feature

Expert Systems with Applications: An International Journal
Partial Least Square Discriminant Analysis for bankruptcy prediction

Decision Support Systems
A local information-based feature-selection algorithm for data regression

Pattern Recognition
An iterative SVM approach to feature selection and classification in high-dimensional datasets

Pattern Recognition
Comparison of text feature selection policies and using an adaptive framework

Expert Systems with Applications: An International Journal
Texture classification using kernel-based techniques

IWANN'13 Proceedings of the 12th international conference on Artificial Neural Networks: advances in computational intelligence - Volume Part I
DCA based algorithms for feature selection in semi-supervised support vector machines

MLDM'13 Proceedings of the 9th international conference on Machine Learning and Data Mining in Pattern Recognition
Robust unsupervised feature selection

IJCAI'13 Proceedings of the Twenty-Third international joint conference on Artificial Intelligence
Silent speech decoder using adaptive collection

Proceedings of the companion publication of the 19th international conference on Intelligent User Interfaces
Fault detection and diagnosis of non-linear non-Gaussian dynamic processes using kernel dynamic independent component analysis

Information Sciences: an International Journal
White box radial basis function classifiers with component selection for clinical prediction models

Artificial Intelligence in Medicine
Locality and similarity preserving embedding for feature selection

Neurocomputing
To feature space and back: Identifying top-weighted features in polynomial Support Vector Machine models

Intelligent Data Analysis

Quantified Score

Hi-index	0.02

Visualization

Abstract

We propose new methods to evaluate variable subset relevance with a view to variable selection. Relevance criteria are derived from Support Vector Machines and are based on weight vector ||w||2 or generalization error bounds sensitivity with respect to a variable. Experiments on linear and non-linear toy problems and real-world datasets have been carried out to assess the effectiveness of these criteria. Results show that the criterion based on weight vector derivative achieves good results and performs consistently well over the datasets we used.