Evolving neural networks: a comparison between differential evolution and particle swarm optimization

Authors:
Beatriz A. Garro;Humberto Sossa;Roberto A. Vázquez
Affiliations:
-;-;Intelligent Systems Group, Facultad de Ingeniería - Universidad La Salle, México, D.F.
Venue:
ICSI'11 Proceedings of the Second international conference on Advances in swarm intelligence - Volume Part I
Year:
2011

Citing 8
Cited 3

Evolving Multilayer Perceptrons

Neural Processing Letters
Swarm intelligence

Swarm intelligence
Differential Evolution Training Algorithm for Feed-Forward Neural Networks

Neural Processing Letters
A comparative study of differential evolution variants for global optimization

Proceedings of the 8th annual conference on Genetic and evolutionary computation
An Improved Particle Swarm Optimization for Evolving Feedforward Artificial Neural Networks

Neural Processing Letters
Automatic Design of ANNs by Means of GP for Data Mining Tasks: Iris Flower Classification Problem

ICANNGA '07 Proceedings of the 8th international conference on Adaptive and Natural Computing Algorithms, Part I
PSO-based single multiplicative neuron model for time series prediction

Expert Systems with Applications: An International Journal
Letters: An improved PSO-based ANN with simulated annealing technique

Neurocomputing

A new model of modular neural networks with fuzzy granularity for pattern recognition and its optimization with hierarchical genetic algorithms

MICAI'11 Proceedings of the 10th international conference on Artificial Intelligence: advances in Soft Computing - Volume Part II
A hybrid evolving and gradient strategy for approximating policy evaluation on online critic-actor learning

ISNN'12 Proceedings of the 9th international conference on Advances in Neural Networks - Volume Part I
Automatic design of artificial neural networks and associative memories for pattern classification and pattern restoration

MCPR'12 Proceedings of the 4th Mexican conference on Pattern Recognition

Quantified Score

Hi-index	0.00

Visualization

Abstract

Due to their efficiency and adaptability, bio-inspired algorithms have shown their usefulness in a wide range of different non-linear optimization problems. In this paper, we compare two ways of training an artificial neural network (ANN): Particle Swarm Optimization (PSO) and Differential Evolution (DE) algorithms. The main contribution of this paper is to show which of these two algorithms provides the best accuracy during the learning phase of an ANN. First of all, we explain how the ANN training phase could be seen as an optimization problem. Then, we explain how PSO and DE could be applied to find the best synaptic weights of the ANN. Finally, we perform a comparison between PSO and DE approaches when used to train an ANN applied to different non-linear problems.