Introduction to statistical pattern recognition (2nd ed.)
Introduction to statistical pattern recognition (2nd ed.)
Adaptive algorithms and stochastic approximations
Adaptive algorithms and stochastic approximations
Fast RLS-Like Algorithm for Generalized Eigendecomposition and its Applications
Journal of VLSI Signal Processing Systems
Algorithms and networks for accelerated convergence of adaptive LDA
Pattern Recognition
On self-organizing algorithms and networks for class-separability features
IEEE Transactions on Neural Networks
Artificial neural networks for feature extraction and multivariate data projection
IEEE Transactions on Neural Networks
Incremental local linear fuzzy classifier in fisher space
EURASIP Journal on Advances in Signal Processing
Adaptive algorithms and networks for optimal feature extraction from Gaussian data
Pattern Recognition Letters
| Hi-index | 0.10 |
A new adaptive algorithm for linear discriminant analysis (LDA) based on the quasi-Newton optimization technique is presented. The proposed algorithm uses the secant method for adaptive computation of the inverse Hessian matrix and the Newton-Raphson method for optimal estimation of the step size at each iteration. Current adaptive method, based on the Newton-Raphson optimization technique, uses a direct calculation of the inverse Hessian matrix, which can be both laborious to calculate and invert for systems with large number of dimensions. The new algorithm has the advantage of automatic optimal selection of the step size using the current data samples and also adaptive computation of the inverse Hessian matrix that overcomes its sensitivity to data condition. Based on the new adaptive algorithm, we present a self-organizing neural network for adaptive computation of the square root of the inverse covariance matrix and use it in cascaded form with a principal component analysis (PCA) network for LDA. Experimental results demonstrated fast convergence and lower computational cost of the new algorithm compared to the adaptive gradient descent and Newton-Raphson LDA algorithms, respectively and justified its advantages for on-line pattern recognition applications with stationary and non-stationary multidimensional input data.