Batch intrinsic plasticity for extreme learning machines

  • Authors:
  • Klaus Neumann;Jochen J. Steil

  • Affiliations:
  • Research Institute for Cognition and Robotics-Lab., Bielefeld University, Bielefeld;Research Institute for Cognition and Robotics-Lab., Bielefeld University, Bielefeld

  • Venue:
  • ICANN'11 Proceedings of the 21th international conference on Artificial neural networks - Volume Part I
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

Extreme learning machines are single-hidden layer feed-forward neural networks, where the training is restricted to the output weights in order to achieve fast learning with good performance. The success of learning strongly depends on the random parameter initialization. To overcome the problem of unsuited initialization ranges, a novel and efficient pretraining method to adapt extreme learning machines task-specific is presented. The pretraining aims at desired output distributions of the hidden neurons. It leads to better performance and less dependence on the size of the hidden layer.