Orthogonal forward selection and backward elimination algorithms for feature subset selection

Authors:
K. Z. Mao
Affiliations:
Sch. of Electr. & Electron. Eng., Nanyang Technol. Univ., Singapore
Venue:
IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Year:
2004

Citing 0
Cited 14

Selecting salient features for classification based on neural network committees

Pattern Recognition Letters
Predictor output sensitivity and feature similarity-based feature selection

Fuzzy Sets and Systems
Increasing classification efficiency with multiple mirror classifiers

Expert Systems with Applications: An International Journal
Feature selection using localized generalization error for supervised classification problems using RBFNN

Pattern Recognition
Evolving Committees of Support Vector Machines

MLDM '07 Proceedings of the 5th international conference on Machine Learning and Data Mining in Pattern Recognition
A feature selection technique for generation of classification committees and its application to categorization of laryngeal images

Pattern Recognition
Multi-class support vector machine for classification of the ultrasonic images of supraspinatus

Expert Systems with Applications: An International Journal
Performance evaluation of multiple classification of the ultrasonic supraspinatus images by using ML, RBFNN and SVM classifiers

Expert Systems with Applications: An International Journal
Feature selection for identifying critical variables of principal components based on k-nearest neighbor rule

VISUAL'07 Proceedings of the 9th international conference on Advances in visual information systems
SVM-FuzCoC: A novel SVM-based feature selection method using a fuzzy complementary criterion

Pattern Recognition
The mass appraisal of the real estate by computational intelligence

Applied Soft Computing
Orthogonal relief algorithm for feature selection

ICIC'06 Proceedings of the 2006 international conference on Intelligent Computing - Volume Part I
Evolutionary generation of neural network classifiers-An empirical comparison

Neurocomputing
Feature subset selection using improved binary gravitational search algorithm

Journal of Intelligent & Fuzzy Systems: Applications in Engineering and Technology

Quantified Score

Hi-index	0.00

Visualization

Abstract

Sequential forward selection (SFS) and sequential backward elimination (SBE) are two commonly used search methods in feature subset selection. In the present study, we derive an orthogonal forward selection (OFS) and an orthogonal backward elimination (OBE) algorithms for feature subset selection by incorporating Gram-Schmidt and Givens orthogonal transforms into forward selection and backward elimination procedures, respectively. The basic idea of the orthogonal feature subset selection algorithms is to find an orthogonal space in which to express features and to perform feature subset selection. After selection, the physically meaningless features in the orthogonal space are linked back to the same number of input variables in the original measurement space. The strength of employing orthogonal transforms is that features are decorrelated in the orthogonal space, hence individual features can be evaluated and selected independently. The effectiveness of our algorithms to deal with real world problems is finally demonstrated.