Feature selection in MLPs and SVMs based on maximum output information

Authors:
V. Sindhwani;S. Rakshit;D. Deodhare;D. Erdogmus;J. C. Principe;P. Niyogi
Affiliations:
Dept. of Comput. Sci., Univ. of Chicago, IL, USA;-;-;-;-;-
Venue:
IEEE Transactions on Neural Networks
Year:
2004

Citing 0
Cited 24

Multi-class feature selection for texture classification

Pattern Recognition Letters
A hybrid genetic algorithm for feature selection wrapper based on mutual information

Pattern Recognition Letters
The application of mutual information-based feature selection and fuzzy LS-SVM-based classifier in motion classification

Computer Methods and Programs in Biomedicine
A Facial Expression Recognition Approach Based on Novel Support Vector Machine Tree

ISNN '07 Proceedings of the 4th international symposium on Neural Networks: Advances in Neural Networks, Part III
An information-theoretic approach to feature extraction in competitive learning

Neurocomputing
Feature Selection in Marketing Applications

ADMA '09 Proceedings of the 5th International Conference on Advanced Data Mining and Applications
Normalized mutual information feature selection

IEEE Transactions on Neural Networks
Information theoretic combination of classifiers with application to AdaBoost

MCS'07 Proceedings of the 7th international conference on Multiple classifier systems
The effect of linguistic hedges on feature selection: Part 2

Expert Systems with Applications: An International Journal
Information theoretic combination of pattern classifiers

Pattern Recognition
Two information-theoretic tools to assess the performance of multi-class classifiers

Pattern Recognition Letters
A new wrapper feature selection approach using neural network

Neurocomputing
Structural enhanced information and its application to improved visualization of self-organizing maps

Applied Intelligence
Selective information enhancement learning for creating interpretable representations in competitive learning

Neural Networks
Feature subset selection wrapper based on mutual information and rough sets

Expert Systems with Applications: An International Journal
A new hybrid ant colony optimization algorithm for feature selection

Expert Systems with Applications: An International Journal
Probability model of covering algorithm (PMCA)

ICIC'06 Proceedings of the 2006 international conference on Intelligent Computing - Volume Part I
A method for feature selection on microarray data using support vector machine

DaWaK'06 Proceedings of the 8th international conference on Data Warehousing and Knowledge Discovery
Feature selection for hyperspectral data classification using double parallel feedforward neural networks

FSKD'05 Proceedings of the Second international conference on Fuzzy Systems and Knowledge Discovery - Volume Part II
Relative information maximization and its application to the extraction of explicit class structure in SOM

Neurocomputing
Exploiting randomness for feature selection in multinomial logit: a CRM cross-sell application

ICDM'06 Proceedings of the 6th Industrial Conference on Data Mining conference on Advances in Data Mining: applications in Medicine, Web Mining, Marketing, Image and Signal Mining
Support vector machine tree based on feature selection

ICONIP'06 Proceedings of the 13 international conference on Neural Information Processing - Volume Part I
Double enhancement learning for explicit internal representations: unifying self-enhancement and information enhancement to incorporate information on input variables

Applied Intelligence
A classification system based on a new wrapper feature selection algorithm for the diagnosis of primary and secondary polycythemia

Computers in Biology and Medicine

Quantified Score

Hi-index	0.01

Visualization

Abstract

This paper presents feature selection algorithms for multilayer perceptrons (MLPs) and multiclass support vector machines (SVMs), using mutual information between class labels and classifier outputs, as an objective function. This objective function involves inexpensive computation of information measures only on discrete variables; provides immunity to prior class probabilities; and brackets the probability of error of the classifier. The maximum output information (MOI) algorithms employ this function for feature subset selection by greedy elimination and directed search. The output of the MOI algorithms is a feature subset of user-defined size and an associated trained classifier (MLP/SVM). These algorithms compare favorably with a number of other methods in terms of performance on various artificial and real-world data sets.