Neural Network Training Using Genetic Algorithm with a Novel Binary Encoding

  • Authors:
  • Yong Liang;Kwong-Sak Leung;Zong-Ben Xu

  • Affiliations:
  • Department of Computer Science and, Ministry of Education National Key Laboratory on Embedded Systems, College of Engineering, Shantou University, Shantou, Guangdong, China;Department of Computer Science and Engineering, The Chinese University of Hong Kong, HK,;School of Science, Xi'an Jiaotong University, Xi'an, Shaanxi, China

  • Venue:
  • ISNN '07 Proceedings of the 4th international symposium on Neural Networks: Part II--Advances in Neural Networks
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

Genetic algorithms (GAs) are widely used in the parameter training of Neural Network (NN). In this paper, we investigate GAs based on our proposed novel genetic representation to train the parameters of NN. A splicing/decomposable (S/D) binary encoding is designed based on some theoretical guidance and existing recommendations. Our theoretical and empirical investigations reveal that the S/D binary representation is more proper than other existing binary encodings for GAs' searching. Moreover, a new genotypic distance on the S/D binary space is equivalent to the Euclidean distance on the real-valued space during GAs convergence. Therefore, GAs can reliably and predictably solve problems of bounded complexity and the methods depended on the Euclidean distance for solving different kinds of optimization problems can be directly used on the S/D binary space. This investigation demonstrates that GAs based our proposed binary representation can efficiently and effectively train the parameters of NN.