Online training for single hidden-layer Online training for single hidden-layer

Authors:
Hieu Trung Huynh;Yonggwan Won
Affiliations:
Department of Computer Engineering, Chonnam National University, Gwangju, Korea;Department of Computer Engineering, Chonnam National University, Gwangju, Korea
Venue:
CIRA'09 Proceedings of the 8th IEEE international conference on Computational intelligence in robotics and automation
Year:
2009

Citing 10
Cited 1

A resource-allocating network for function interpolation

Neural Computation
A function estimation approach to sequential learning with neural networks

Neural Computation
A sequential learning scheme for function approximation using minimal radial basis function neural networks

Neural Computation
Effiicient BackProp

Neural Networks: Tricks of the Trade, this book is an outgrowth of a 1996 NIPS workshop
Rapid and brief communication: Evolutionary extreme learning machine

Pattern Recognition
An efficient sequential learning algorithm for growing and pruning RBF (GAP-RBF) networks

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
The sample complexity of pattern classification with neural networks: the size of the weights is more important than the size of the network

IEEE Transactions on Information Theory
Performance evaluation of a sequential minimal radial basis function (RBF) neural network learning algorithm

IEEE Transactions on Neural Networks
A generalized growing and pruning RBF (GGAP-RBF) neural network for function approximation

IEEE Transactions on Neural Networks
A Fast and Accurate Online Sequential Learning Algorithm for Feedforward Networks

IEEE Transactions on Neural Networks

A novel ELM based adaptive Kalman filter tracking algorithm

Neurocomputing

Quantified Score

Hi-index	0.00

Visualization

Abstract

Extreme learning machine (ELM) is one of the effective training algorithms for single hidden layer feedforward neural networks (SLFNs), but it often requires a large number of hidden units which makes the trained networks respond slowly to input patterns. Regularized least-squares extreme learning machine (RLS-ELM) is one of the improvements which can overcome this problem. It determines the input weights including hidden layer biases based on the regularized least squares scheme and the output weights based on the pseudo-inverse operation of hidden layer output matrix. In this paper, we develop the RLS-ELM for online sequential learning to due with large training datasets. It can learn the arriving data with one-by-one and chunk-by-chunk, blocks with different sizes. Experimental results show that the proposed approach can obtain good performance with compact network which results in high speed for both training and testing.