An intelligent augmentation of particle swarm optimization with multiple adaptive methods

  • Authors:
  • Mengqi Hu;Teresa Wu;Jeffery D. Weir

  • Affiliations:
  • School of Computing, Informatics, Decision Systems Engineering, Arizona State University, Tempe, Arizona 85287-5906, USA;School of Computing, Informatics, Decision Systems Engineering, Arizona State University, Tempe, Arizona 85287-5906, USA;Department of Operational Sciences, Graduate School of Engineering & Management, Air Force Institute of Technology, Wright-Patterson AFB, OH 45433-7765, USA

  • Venue:
  • Information Sciences: an International Journal
  • Year:
  • 2012

Quantified Score

Hi-index 0.07

Visualization

Abstract

Over the last two decades, the newly developed optimization technique - Particle Swarm Optimization (PSO) has attracted great attention. Two common criticisms exist. First, most existing PSOs are designed for a specific search space thus an algorithm performing well on a diverse set of problems is lacking. Secondly, PSO suffers premature convergence. To address the first issue, we propose to augment PSO via the fusion of multiple search methods. An intelligent selection mechanism is developed based on an effectiveness index to trigger appropriate search methods. In this research, two search techniques are studied: a non-uniform mutation-based method and an adaptive sub-gradient method. We further improve the proposed PSO using adaptive Cauchy mutation to prevent premature convergence. As a result, an augmented PSO with multiple adaptive methods (PSO-MAM) is proposed. The performance of PSO-MAM is tested on 43 functions (uni-modal, multi-modal, non-separable, shifted, rotated, noisy and mis-scaled functions). The results are compared in terms of solution quality and convergence speed with 10 published PSO methods. The experimental results demonstrate PSO-MAM outperforms the comparison algorithms on 36 out of 43 functions. We conclude, while promising, there is still room for improving PSO-MAM on complex multi-modal functions (e.g., rotated multi-modal functions).