An Improved On-Line Sequential Learning Algorithm for Extreme Learning Machine

  • Authors:
  • Bin Li;Jingming Wang;Yibin Li;Yong Song

  • Affiliations:
  • College of Mathematical and Physical Sciences, Shandong Institute, of Light Industry, Jinan, 250353, China;College of Mathematical and Physical Sciences, Shandong Institute, of Light Industry, Jinan, 250353, China;Center for Robotics, Shandong University, Jinan 250061, China;Center for Robotics, Shandong University, Jinan 250061, China

  • Venue:
  • ISNN '07 Proceedings of the 4th international symposium on Neural Networks: Advances in Neural Networks
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper presents an efficient online sequential learning algorithm for extreme learning machine, which can learn data one by one. In this algorithm, the parameters of hidden nodes (the input weights and biases of additive nodes or the centers and impact factors of RBF nodes) are randomly selected and the output weights are analytically determined based on the sequentially arriving data. In the online sequence, the algorithm updates the output-layer weights with a Givens QR decomposition based on the orthogonalized least square algorithm. Simulations on benchmark problems demonstrate that the algorithm produces much better generalization performance than another online sequential extreme learning machine algorithm, or sometimes it has good performance than primitive extreme learning machine algorithm.