Grammar-Guided Neural Architecture Evolution

  • Authors:
  • Jorge Couchet;Daniel Manrique;Luis Porras

  • Affiliations:
  • Departamento de Inteligencia Artificial, Facultad de Informática, Universidad Politécnica de Madrid, 28660 Boadilla del Monte, Madrid, Spain;Departamento de Inteligencia Artificial, Facultad de Informática, Universidad Politécnica de Madrid, 28660 Boadilla del Monte, Madrid, Spain;Departamento de Inteligencia Artificial, Facultad de Informática, Universidad Politécnica de Madrid, 28660 Boadilla del Monte, Madrid, Spain

  • Venue:
  • IWINAC '07 Proceedings of the 2nd international work-conference on The Interplay Between Natural and Artificial Computation, Part I: Bio-inspired Modeling of Cognitive Tasks
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

This article proposes a context-free grammar to be used in grammar-guided genetic programming systems to automatically design feed-forward neural architectures. This grammar has three important features. The sentences that belong to the grammar are binary strings that directly encode all the valid neural architectures only. This rules out the appearance of illegal points in the search space. Second, the grammar has the property of being ambiguous and semantically redundant. Therefore, there are alternative ways of reaching the optimum. Third, the grammar starts by generating small networks. This way it can efficiently adapt to the complexity of the problem to be solved. From the results, it is clear that these three properties are beneficial to the convergence process of the grammar-guided genetic programming system.