Comparing particle swarm optimization approaches for training multi-layer perceptron neural networks for forecasting

Authors:
Saulo M. Santos;Mêuser J. S. Valença;Carmelo J. A. Bastos-Filho
Affiliations:
Polytechnic School of Pernambuco, University of Pernambuco, Recife, Pernambuco, Brazil;Polytechnic School of Pernambuco, University of Pernambuco, Recife, Pernambuco, Brazil;Polytechnic School of Pernambuco, University of Pernambuco, Recife, Pernambuco, Brazil
Venue:
IDEAL'12 Proceedings of the 13th international conference on Intelligent Data Engineering and Automated Learning
Year:
2012

Citing 3
Cited 0

Neural Networks vs. PARMA Modelling: Case Studies of River Flow Prediction

SBRN '00 Proceedings of the VI Brazilian Symposium on Neural Networks (SBRN'00)
Multi-ring Particle Swarm Optimization

SBRN '08 Proceedings of the 2008 10th Brazilian Symposium on Neural Networks
Adaptive particle swarm optimization

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Quantified Score

Hi-index	0.00

Visualization

Abstract

Multilayer Perceptron Artificial Neural Networks (MLP-NN) have been widely used to tackle forecasting problems. The most used algorithm for training MLP-NN is called Backpropagation (BP). Since the BP presents a high chance to be trapped in local minima during the training process for forecasting, we propose in this paper to assess some recently proposed variations of the Particle Swarm Optimization algorithm (PSO) applied for this purpose. We tested the standard PSO, the APSO, the ClanPSO and the ClanAPSO in five benchmark data sets. Although the standard version of the PSO presented worse results when compared to the BP algorithm, we observed that the ClanAPSO outperformed the BP algorithm in most of cases.