Generalized compressed network search

  • Authors:
  • Rupesh Kumar Srivastava;Jürgen Schmidhuber;Faustino Gomez

  • Affiliations:
  • IDSIA, USI-SUPSI, Manno-Lugano, Switzerland;IDSIA, USI-SUPSI, Manno-Lugano, Switzerland;IDSIA, USI-SUPSI, Manno-Lugano, Switzerland

  • Venue:
  • PPSN'12 Proceedings of the 12th international conference on Parallel Problem Solving from Nature - Volume Part I
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper presents initial results of Generalized Compressed Network Search (GCNS), a method for automatically identifying the important frequencies for neural networks encoded as Fourier-type coefficients (i.e. "compressed" networks [7]). GCNS is a general search procedure in this coefficient space --- both the number of frequencies and their value are automatically determined by employing the use of variable-length chromosomes, inspired by messy genetic algorithms. The method achieves better compression than our previous approach, and promises improved generalization for evolved controllers. Results for a high-dimensional Octopus arm control problem show that a high fitness 3680-weight network can be encoded using less than 10 coefficients using the frequencies identified by GCNS.