Optimal Hidden Structure for Feedforward Neural Networks

  • Authors:
  • P. Bachiller;Rosa M. Pérez Utrero;Pablo Martínez Cobo;Pedro Luis Aguilar Mateos;P. Díaz

  • Affiliations:
  • -;-;-;-;-

  • Venue:
  • Proceedings of the 6th International Conference on Computational Intelligence, Theory and Applications: Fuzzy Days
  • Year:
  • 1999

Quantified Score

Hi-index 0.00

Visualization

Abstract

The selection of an adequate hidden structure of a feedforward neural network is a very important issue of its design. When the hidden structure of the network is too large and complex for the model being developed, the network may tend to memorize input and output sets rather than learning relationships between them. In addition, training time will significantly increase when the network is unnecessarily large. We propose two methods to optimize the size of feedforward neural networks using orthogonal transformations. These two approaches avoid the retraining process of the reduced-size network, which is necessary in any pruning technique.