An Improved Approach Combining Random PSO with BP for Feedforward Neural Networks

Authors:
Yu Cui;Shi-Guang Ju;Fei Han;Tong-Yue Gu
Affiliations:
School of Computer Science and Telecommunication Engineering, Jiangsu University, Zhenjiang, China;School of Computer Science and Telecommunication Engineering, Jiangsu University, Zhenjiang, China;School of Computer Science and Telecommunication Engineering, Jiangsu University, Zhenjiang, China;School of Computer Science and Telecommunication Engineering, Jiangsu University, Zhenjiang, China
Venue:
AICI '09 Proceedings of the International Conference on Artificial Intelligence and Computational Intelligence
Year:
2009

Citing 4
Cited 1

Multilayer feedforward networks are universal approximators

Neural Networks
Parameter Selection in Particle Swarm Optimization

EP '98 Proceedings of the 7th International Conference on Evolutionary Programming VII
Modified constrained learning algorithms incorporating additional functional constraints into neural networks

Information Sciences: an International Journal
The particle swarm - explosion, stability, and convergence in amultidimensional complex space

IEEE Transactions on Evolutionary Computation

An optimised product-unit neural network with a novel PSO-BP hybrid training algorithm: Applications to load-deformation analysis of axially loaded piles

Engineering Applications of Artificial Intelligence

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, an improved approach which combines random particle swarm optimization with BP is proposed to obtain better generalization performance and faster convergence rate. It is well known that the backpropagation (BP) algorithm has good local search ability but it is easily trapped to local minima. On the contrary, the particle swarm optimization algorithm (PSO), with good global search ability, converges rapidly during the initial stages of a global research. Since the PSO suffers from the disadvantage of losing diversity, it converges more slow around the global minima. Hence, the global search is combined with local search reasonably in the improved approach which is called as RPSO-BP. Moreover, in order to improve the diversity of the swarm in the PSO, a random PSO (RPSO) is proposed in the paper. Compared with the traditional learning algorithms, the improved learning algorithm has much better convergence accuracy and rate. Finally, the experimental results are given to verify the efficiency and effectiveness of the proposed algorithm.