A fast linear-in-the-parameters classifier construction algorithm using orthogonal forward selection to minimize leave-one-out misclassification rate

Authors:
X. Hong;S. Chen;C. J. Harris
Affiliations:
School of Systems Engineering, University of Reading, Reading, RG6 6AY, UK;School of Electronics and Computer Science, University of Southampton, Southampton SO17 1BJ, UK;School of Electronics and Computer Science, University of Southampton, Southampton SO17 1BJ, UK
Venue:
International Journal of Systems Science
Year:
2008

Citing 11
Cited 7

Bayesian interpolation

Neural Computation
The nature of statistical learning theory

The nature of statistical learning theory
Soft Margins for AdaBoost

Machine Learning
Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond

Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond
Kernel Matching Pursuit

Machine Learning
Sparse bayesian learning and the relevance vector machine

The Journal of Machine Learning Research
Sparse modeling using orthogonal forward regression with PRESS statistic and regularization

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
RBF neural network center selection based on Fisher ratio class separability measure

IEEE Transactions on Neural Networks
Nonlinear model structure design and construction using orthogonal least squares and D-optimality design

IEEE Transactions on Neural Networks
Kernel Classifier Construction Using Orthogonal Forward Selection and Boosting With Fisher Ratio Class Separability Measure

IEEE Transactions on Neural Networks
A Kernel-Based Two-Class Classifier for Imbalanced Data Sets

IEEE Transactions on Neural Networks

Orthogonal-least-squares regression: A unified approach for data modelling

Neurocomputing
Construction of tunable radial basis function networks using orthogonal forward selection

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Particle swarm optimization aided orthogonal forward regression for unified data modeling

IEEE Transactions on Evolutionary Computation
A combined SMOTE and PSO based RBF classifier for two-class imbalanced problems

Neurocomputing
A novel locally regularized automatic construction method for RBF neural models

Neurocomputing
A novel automatic two-stage locally regularized classifier construction method using the extreme learning machine

Neurocomputing
Particle swarm optimisation assisted classification using elastic net prefiltering

Neurocomputing

Quantified Score

Hi-index	0.00

Visualization

Abstract

We propose a simple and computationally efficient construction algorithm for two class linear-in-the-parameters classifiers. In order to optimize model generalization, a forward orthogonal selection (OFS) procedure is used for minimizing the leave-one-out (LOO) misclassification rate directly. An analytic formula and a set of forward recursive updating formula of the LOO misclassification rate are developed and applied in the proposed algorithm. Numerical examples are used to demonstrate that the proposed algorithm is an excellent alternative approach to construct sparse two class classifiers in terms of performance and computational efficiency.