Mutual information neuro-evolutionary system (MINES)

  • Authors:
  • Robert E. Smith;Behzad Behzadan

  • Affiliations:
  • University College London, Department of Computer Science, London, UK;University College London, Department of Computer Science, London, UK

  • Venue:
  • CEC'09 Proceedings of the Eleventh conference on Congress on Evolutionary Computation
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

This article presents a new approach for automatically determining the optimal quantity and connectivity of the hidden-layer of a three-layer Feed-Forward Neural Network (FFNN) based on a theoretical and practical approach. The system (MINES) is a combination of Neural Network (NN), Back-Propagation (BP), Genetic Algorithm (GA), Mutual Information (MI), and clustering. BP is used to reduce the training-error while MI aides BP to follow an effective path. A GA changes the incoming synaptic connections of the hidden-nodes based on MI fitness. Assigning MI as the fitness of individuals brings a competition between hidden-nodes to acquire a higher amount of information from the error-space. Weight clustering is applied to reduce those hidden-nodes having similar weights. Experimental results are presented, and future directions discussed.