Feature subset selection for support vector machines through discriminative function pruning analysis

Authors:
K. Z. Mao
Affiliations:
Sch. of Electr. & Electron. Eng., Nanyang Technol. Univ., Singapore, Singapore
Venue:
IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Year:
2004

Citing 0
Cited 27

Multi-class feature selection for texture classification

Pattern Recognition Letters
FS_SFS: A novel feature selection method for support vector machines

Pattern Recognition
Credit scoring with a data mining approach based on support vector machines

Expert Systems with Applications: An International Journal
Extracting gene regulation information for cancer classification

Pattern Recognition
A multiple kernel support vector machine scheme for feature selection and rule extraction from gene expression data of cancer tissue

Artificial Intelligence in Medicine
Constructing the gene regulation-level representation of microarray data for cancer classification

Journal of Biomedical Informatics
Time series prediction using evolving radial basis function networks with new encoding scheme

Neurocomputing
Multiclass SVM-RFE for product form feature selection

Expert Systems with Applications: An International Journal
Feature selection to diagnose a business crisis by using a real GA-based support vector machine: An empirical study

Expert Systems with Applications: An International Journal
A GA-Based Feature Subset Selection and Parameter Optimization of Support Vector Machine for Content --- Based Image Retrieval

ADMA '07 Proceedings of the 3rd international conference on Advanced Data Mining and Applications
Selecting of the optimal feature subset and kernel parameters in digital modulation classification by using hybrid genetic algorithm-support vector machines: HGASVM

Expert Systems with Applications: An International Journal
A data mining-based subset selection for enhanced discrimination using iterative elimination of redundancy

Expert Systems with Applications: An International Journal
Discrimination of myocardial infarction stages by subjective feature extraction

Computer Methods and Programs in Biomedicine
A neural network-based biomarker association information extraction approach for cancer classification

Journal of Biomedical Informatics
Feature subset selection in large dimensionality domains

Pattern Recognition
Two-stage mixed discrete-continuous identification of radial basis function (RBF) neural models for nonlinear systems

IEEE Transactions on Circuits and Systems Part I: Regular Papers
Integrating support vector machine and genetic algorithm to implement dynamic wafer quality prediction system

Expert Systems with Applications: An International Journal
A multiple kernel support vector machine scheme for simultaneous feature selection and rule-based classification

PAKDD'07 Proceedings of the 11th Pacific-Asia conference on Advances in knowledge discovery and data mining
Content-based image retrieval by combining genetic algorithm and support vector machine

ICANN'07 Proceedings of the 17th international conference on Artificial neural networks
Feature selection for SVM via optimization of kernel polarization with Gaussian ARD kernels

Expert Systems with Applications: An International Journal
Feature selection and parameter optimization for support vector machines: A new approach based on genetic algorithm with feature chromosomes

Expert Systems with Applications: An International Journal
Combining functional networks and sensitivity analysis as wrapper method for feature selection

Expert Systems with Applications: An International Journal
A method for feature selection on microarray data using support vector machine

DaWaK'06 Proceedings of the 8th international conference on Data Warehousing and Knowledge Discovery
Computational time reduction for credit scoring: An integrated approach based on support vector machine and stratified sampling method

Expert Systems with Applications: An International Journal
A minority class feature selection method

CIARP'11 Proceedings of the 16th Iberoamerican Congress conference on Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications
Parameterized attribute reduction with Gaussian kernel based fuzzy rough sets

Information Sciences: an International Journal
A novel divide-and-merge classification for high dimensional datasets

Computational Biology and Chemistry

Quantified Score

Hi-index	0.01

Visualization

Abstract

In many pattern classification applications, data are represented by high dimensional feature vectors, which induce high computational cost and reduce classification speed in the context of support vector machines (SVMs). To reduce the dimensionality of pattern representation, we develop a discriminative function pruning analysis (DFPA) feature subset selection method in the present study. The basic idea of the DFPA method is to learn the SVM discriminative function from training data using all input variables available first, and then to select feature subset through pruning analysis. In the present study, the pruning is implement using a forward selection procedure combined with a linear least square estimation algorithm, taking advantage of linear-in-the-parameter structure of the SVM discriminative function. The strength of the DFPA method is that it combines good characters of both filter and wrapper methods. Firstly, it retains the simplicity of the filter method avoiding training of a large number of SVM classifier. Secondly, it inherits the good performance of the wrapper method by taking the SVM classification algorithm into account.