An excellent feature selection model using gradient-based and point injection techniques

Authors:
D. Huang;Tommy W. S. Chow
Affiliations:
Department of Electrical Engineering, City University of Hong Kong;Department of Electrical Engineering, City University of Hong Kong
Venue:
ICONIP'06 Proceedings of the 13th international conference on Neural Information Processing - Volume Part II
Year:
2006

Citing 11
Cited 0

Floating search methods in feature selection

Pattern Recognition Letters
Data mining: concepts and techniques

Data mining: concepts and techniques
Neural Networks for Pattern Recognition

Neural Networks for Pattern Recognition
Feature Selection for Knowledge Discovery and Data Mining

Feature Selection for Knowledge Discovery and Data Mining
Gene Selection for Cancer Classification using Support Vector Machines

Machine Learning
Nonparametric selection of input variables for connectionist learning

Nonparametric selection of input variables for connectionist learning
Grafting: fast, incremental feature selection by gradient descent in function space

The Journal of Machine Learning Research
Penalized Cox regression analysis in the high-dimensional and low-sample size settings, with applications to microarray gene expression data

Bioinformatics
k-nearest neighbors directed noise injection in multilayer perceptron training

IEEE Transactions on Neural Networks
Efficient training of RBF neural networks for pattern recognition

IEEE Transactions on Neural Networks
Estimating optimal feature subsets using efficient estimation of high-dimensional mutual information

IEEE Transactions on Neural Networks

Quantified Score

Hi-index	0.01

Visualization

Abstract

This paper focuses on enhancing the effectiveness of filter feature selection models from two aspects. One is to modify feature searching engines based on optimization theory, and the other is to improve the regularization capability using point injection techniques. The second topic is undoubtedly important in the situations where overfitting is likely to be met, for example, the ones with only small sample sets available. Synthetic and real data are used to demonstrate the contribution of our proposed strategies.