Hybrid learning of regularization neural networks

  • Authors:
  • Petra Vidnerová;Roman Neruda

  • Affiliations:
  • Institute of Computer Science, Academy of Sciences of the Czech Republic, Prague 8, Czech Republic;Institute of Computer Science, Academy of Sciences of the Czech Republic, Prague 8, Czech Republic

  • Venue:
  • ICAISC'10 Proceedings of the 10th international conference on Artifical intelligence and soft computing: Part II
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

Regularization theory presents a sound framework to solving supervised learning problems. However, the regularization networks have a large size corresponding to the size of training data. In this work we study a relationship between network complexity, i.e. number of hidden units, and approximation and generalization ability. We propose an incremental hybrid learning algorithm that produces smaller networks with performance similar to original regularization networks.