Neural network topology optimization

  • Authors:
  • Mohammed Attik;Laurent Bougrain;Frédéric Alexandre

  • Affiliations:
  • LORIA/INRIA-Lorraine, Vandœuvre-lès-Nancy Cedex, France and BRGM, Orléans Cedex 2, France;LORIA/INRIA-Lorraine, Vandœuvre-lès-Nancy Cedex, France;LORIA/INRIA-Lorraine, Vandœuvre-lès-Nancy Cedex, France

  • Venue:
  • ICANN'05 Proceedings of the 15th international conference on Artificial neural networks: formal models and their applications - Volume Part II
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

The determination of the optimal architecture of a supervised neural network is an important and a difficult task. The classical neural network topology optimization methods select weight(s) or unit(s) from the architecture in order to give a high performance of a learning algorithm. However, all existing topology optimization methods do not guarantee to obtain the optimal solution. In this work, we propose a hybrid approach which combines variable selection method and classical optimization method in order to improve optimization topology solution. The proposed approach suggests to identify the relevant subset of variables which gives a good classification performance in the first step and then to apply a classical topology optimization method to eliminate unnecessary hidden units or weights. A comparison of our approach to classical techniques for architecture optimization is given.