A Branch and Bound Algorithm for Feature Subset Selection

Authors:
P. M. Narendra;K. Fukunaga
Affiliations:
Honeywell Systems and Research Center;-
Venue:
IEEE Transactions on Computers
Year:
1977

Citing 4
Cited 96

Backtrack Programming

Journal of the ACM (JACM)
A Branch and Bound Algorithm for Computing k-Nearest Neighbors

IEEE Transactions on Computers
A Comparison of Seven Techniques for Choosing Subsets of Pattern Recognition Properties

IEEE Transactions on Computers
A Branch and Bound Clustering Algorithm

IEEE Transactions on Computers

Using EAs for Error Prediction in Near Infrared Spectroscopy

Proceedings of the Applications of Evolutionary Computing on EvoWorkshops 2002: EvoCOP, EvoIASP, EvoSTIM/EvoPLAN
Parallel GA-Based Wrapper Feature Selection for Spectroscopic Data Mining

IPDPS '02 Proceedings of the 16th International Parallel and Distributed Processing Symposium
Design Choices and Theoretical Issues for Relative Feature Importance, a Metric for Nonparametric Discriminatory Power

Proceedings of the Joint IAPR International Workshops on Advances in Pattern Recognition
Branch & Bound Algorithm with Partial Prediction for Use with Recursive and Non-recursive Criterion Forms

ICAPR '01 Proceedings of the Second International Conference on Advances in Pattern Recognition
Advances in Statistical Feature Selection

ICAPR '01 Proceedings of the Second International Conference on Advances in Pattern Recognition
Consistency Based Feature Selection

PADKK '00 Proceedings of the 4th Pacific-Asia Conference on Knowledge Discovery and Data Mining, Current Issues and New Applications
Multi-Modal Nonlinear Feature Reduction for the Recognition of Handwritten Numerals

CRV '04 Proceedings of the 1st Canadian Conference on Computer and Robot Vision
A feature selection technique for classificatory analysis

Pattern Recognition Letters
Cluster-based pattern discrimination: A novel technique for feature selection

Pattern Recognition Letters
Analysis of new variable selection methods for discriminant analysis

Computational Statistics & Data Analysis
FS_SFS: A novel feature selection method for support vector machines

Pattern Recognition
A hybrid approach for feature subset selection using neural networks and ant colony optimization

Expert Systems with Applications: An International Journal
Convergent design of piecewise linear neural networks

Neurocomputing
Biological shape characterization for automatic image recognition and diagnosis of protozoan parasites of the genus Eimeria

Pattern Recognition
Adaptive branch and bound algorithm for selecting optimal features

Pattern Recognition Letters
GRAFT, a complete system for data fusion

Computational Statistics & Data Analysis
Recent Developments in Pattern Recognition

IEEE Transactions on Computers
Linear feature extraction by integrating pairwise and global discriminatory information via sequential forward floating selection and kernel QR factorization with column pivoting

Pattern Recognition
Improved binary PSO for feature selection using gene expression data

Computational Biology and Chemistry
A multilevel tabu search algorithm for the feature selection problem in biomedical data

Computers & Mathematics with Applications
A parameterless feature ranking algorithm based on MI

Neurocomputing
Feature selection algorithms in classification problems: an experimental evaluation

Optimization Methods & Software - Systems Analysis, Optimization and Data Mining in Biomedicine
Subspace based feature selection for pattern recognition

Information Sciences: an International Journal
Particle swarm optimization for pap-smear diagnosis

Expert Systems with Applications: An International Journal
Neuro-IG: A Hybrid System for Selection and Elimination of Predictor Variables and non Relevant Individuals

Informatica
Speeding Up Feature Subset Selection Through Mutual Information Relevance Filtering

PKDD 2007 Proceedings of the 11th European conference on Principles and Practice of Knowledge Discovery in Databases
Data pre-processing: a new algorithm for feature selection and data discretization

CSTST '08 Proceedings of the 5th international conference on Soft computing as transdisciplinary science and technology
Dimensionality reduction for knowledge discovery in medical claims database: Application to antidepressant medication utilization study

Computer Methods and Programs in Biomedicine
Pap smear diagnosis using a hybrid intelligent scheme focusing on genetic algorithm based feature selection and nearest neighbor classification

Computers in Biology and Medicine
Different metaheuristic strategies to solve the feature selection problem

Pattern Recognition Letters
Feature selection using tabu search with long-term memories and probabilistic neural networks

Pattern Recognition Letters
Ant colony and particle swarm optimization for financial classification problems

Expert Systems with Applications: An International Journal
Symbolic function network

Neural Networks
Sensitivity and specificity based multiobjective approach for feature selection: Application to cancer diagnosis

Information Processing Letters
Genetic programming for improved data mining: application to the biochemistry of protein interactions

GECCO '96 Proceedings of the 1st annual conference on Genetic and evolutionary computation
A new feature selection method based on association rules for diagnosis of erythemato-squamous diseases

Expert Systems with Applications: An International Journal
A dependency-based search strategy for feature selection

Expert Systems with Applications: An International Journal
OPUS: an efficient admissible algorithm for unordered search

Journal of Artificial Intelligence Research
Factor analysisin data mining

Computers & Mathematics with Applications
Input selection in learning systems: a brief review of some important issues and recent developments

FUZZ-IEEE'09 Proceedings of the 18th international conference on Fuzzy Systems
Selecting discrete and continuous features based on neighborhood decision error minimization

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Impact of error estimation on feature selection

Pattern Recognition
Honey Bees Mating Optimization algorithm for financial classification problems

Applied Soft Computing
An improved branch & bound algorithm in feature selection

RSFDGrC'03 Proceedings of the 9th international conference on Rough sets, fuzzy sets, data mining, and granular computing
Increasing classification robustness with adaptive features

ICVS'08 Proceedings of the 6th international conference on Computer vision systems
Topology representing network map: a new tool for visualization of high-dimensional data

Transactions on computational science I
A new feature selection algorithm for multispectral and polarimetric vehicle images

ICIP'09 Proceedings of the 16th IEEE international conference on Image processing
Towards a memetic feature selection paradigm

IEEE Computational Intelligence Magazine
SVM-FuzCoC: A novel SVM-based feature selection method using a fuzzy complementary criterion

Pattern Recognition
Assessment of the influence of adaptive components in trainable surface inspection systems

Machine Vision and Applications - Integrated Imaging and Vision Techniques for Industrial Inspection
Soft fuzzy rough sets for robust feature evaluation and selection

Information Sciences: an International Journal
Optimizing reservoir features in oil exploration management based on fusion of soft computing

Applied Soft Computing
Pseudo-optimal parameter selection of non-stationary generalized extreme value models for environmental variables

Environmental Modelling & Software
A new wrapper feature selection approach using neural network

Neurocomputing
Review:

The Knowledge Engineering Review
Improving dynamic facial expression recognition with feature subset selection

Pattern Recognition Letters
Time space tradeoffs in GA based feature selection for workload characterization

IEA/AIE'10 Proceedings of the 23rd international conference on Industrial engineering and other applications of applied intelligent systems - Volume Part II
Scaling up feature selection by means of democratization

IEA/AIE'10 Proceedings of the 23rd international conference on Industrial engineering and other applications of applied intelligent systems - Volume Part II
A hybrid feature selection method for DNA microarray data

Computers in Biology and Medicine
Genetic algorithms for feature selection of image analysis-based quality monitoring model: An application to an iron mine

Engineering Applications of Artificial Intelligence
Gene selection and classification using Taguchi chaotic binary particle swarm optimization

Expert Systems with Applications: An International Journal
mr2PSO: A maximum relevance minimum redundancy feature selection method based on swarm intelligence for support vector machine classification

Information Sciences: an International Journal
Feature selection for translation initiation site recognition

IEA/AIE'11 Proceedings of the 24th international conference on Industrial engineering and other applications of applied intelligent systems conference on Modern approaches in applied intelligence - Volume Part II
Self-tuned Evolution-COnstructed features for general object recognition

Pattern Recognition
Minimizing neighborhood evidential decision error for feature evaluation and selection based on evidence theory

Expert Systems with Applications: An International Journal
Survey and taxonomy of feature selection algorithms in intrusion detection system

Inscrypt'06 Proceedings of the Second SKLOIS conference on Information Security and Cryptology
Multi-population genetic algorithm for feature selection

ICNC'06 Proceedings of the Second international conference on Advances in Natural Computation - Volume Part II
A distance-based branch and bound feature selection algorithm

UAI'03 Proceedings of the Nineteenth conference on Uncertainty in Artificial Intelligence
Test-retest reliability and feature selection in physiological time series classification

Computer Methods and Programs in Biomedicine
Optimal sensor placement for predictive cardiac motion modeling

MICCAI'06 Proceedings of the 9th international conference on Medical Image Computing and Computer-Assisted Intervention - Volume Part II
Predicting stock market trends using hybrid ant-colony-based data mining algorithms: an empirical validation on the Bombay Stock Exchange

International Journal of Business Intelligence and Data Mining
Speeding up the wrapper feature subset selection in regression by mutual information relevance and redundancy analysis

ICANN'06 Proceedings of the 16th international conference on Artificial Neural Networks - Volume Part I
Feature selection with adjustable criteria

RSFDGrC'05 Proceedings of the 10th international conference on Rough Sets, Fuzzy Sets, Data Mining, and Granular Computing - Volume Part I
Feature selection method using preferences aggregation

MLDM'05 Proceedings of the 4th international conference on Machine Learning and Data Mining in Pattern Recognition
The application of adaptive partitioned random search in feature selection problem

ADMA'05 Proceedings of the First international conference on Advanced Data Mining and Applications
A survey on feature extraction for pattern recognition

Artificial Intelligence Review
Feature selection in an electric billing database considering attribute inter-dependencies

ICDM'06 Proceedings of the 6th Industrial Conference on Data Mining conference on Advances in Data Mining: applications in Medicine, Web Mining, Marketing, Image and Signal Mining
Identifying a small set of marker genes using minimum expected cost of misclassification

Artificial Intelligence in Medicine
Feature selection based on run covering

PSIVT'06 Proceedings of the First Pacific Rim conference on Advances in Image and Video Technology
Dimensional reduction based on artificial bee colony for classification problems

ICIC'11 Proceedings of the 7th international conference on Intelligent Computing: bio-inspired computing and applications
A rule-based method for identifying the factor structure in customer satisfaction

Information Sciences: an International Journal
Optimal sensors placement for failures detection and isolation

VECoS'09 Proceedings of the Third international conference on Verification and Evaluation of Computer and Communication Systems
Feature subset selection by genetic algorithms and estimation of distribution algorithms

Artificial Intelligence in Medicine
Feature selection for high-dimensional machinery fault diagnosis data using multiple models and Radial Basis Function networks

Neurocomputing
A novel feature selection method based on normalized mutual information

Applied Intelligence
Selective ensemble modeling parameters of mill load based on shell vibration signal

ISNN'12 Proceedings of the 9th international conference on Advances in Neural Networks - Volume Part I
An Empirical Investigation of Filter Attribute Selection Techniques for High-Speed Network Traffic Flow Classification

Wireless Personal Communications: An International Journal
An evolutionary approach for high dimensional attribute selection

International Journal of Intelligent Information and Database Systems
Automatic detection of erythemato-squamous diseases using PSO-SVM based on association rules

Engineering Applications of Artificial Intelligence
Discrete Artificial Bee Colony Optimization Algorithm for Financial Classification Problems

International Journal of Applied Metaheuristic Computing
Feature selection using misclassification counts

AusDM '11 Proceedings of the Ninth Australasian Data Mining Conference - Volume 121
Understanding latency variations of black box services

Proceedings of the 22nd international conference on World Wide Web
A feature construction method for general object recognition

Pattern Recognition
Feature selection filter for classification of power system operating states

Computers & Mathematics with Applications
Quality estimation for machine translation: some lessons learned

Machine Translation
A survey on feature selection methods

Computers and Electrical Engineering

Quantified Score

Hi-index	15.00

Visualization

Abstract

A feature subset selection algorithm based on branch and bound techniques is developed to select the best subset of m features from an n-feature set. Existing procedures for feature subset selection, such as sequential selection and dynamic programming, do not guarantee optimality of the selected feature subset. Exhaustive search, on the other hand, is generally computationally unfeasible. The present algorithm is very efficient and it selects the best subset without exhaustive search. Computational aspects of the algorithm are discussed. Results of several experiments demonstrate the very substantial computational savings realized. For example, the best 12-feature set from a 24-feature set was selected with the computational effort of evaluating only 6000 subsets. Exhaustive search would require the evaluation of 2 704 156 subsets.