Data driven multiple neural network models generator based on a tree-like scheduler

  • Authors:
  • Kurosh Madani;Abdennasser Chebira;Mariusz Rybnilc

  • Affiliations:
  • Intelligence in Instrumentation and Systems Laboratory, Senart Institute of Technology, University PARIS XII, Lieusaint, France;Intelligence in Instrumentation and Systems Laboratory, Senart Institute of Technology, University PARIS XII, Lieusaint, France;Intelligence in Instrumentation and Systems Laboratory, Senart Institute of Technology, University PARIS XII, Lieusaint, France

  • Venue:
  • IWANN'03 Proceedings of the Artificial and natural neural networks 7th international conference on Computational methods in neural modeling - Volume 1
  • Year:
  • 2003

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper we describe a new penalty-based model selection criterion for nonlinear models which is based on the influence of the noise in the fitting. According to Occam's razor we should seek simpler models over complex ones and optimize the trade-off between model complexity and the accuracy of a model's description to the training data. An empirical derivation is developed and computer simulations for multilayer perceptron with weight decay regularization are made in order to show the efficiency and robustness of the method in comparison with other well-known criteria for nonlinear systems.