Niche particle swarm optimization for neural network ensembles

  • Authors:
  • Camiel Castillo;Geoff Nitschke;Andries Engelbrecht

  • Affiliations:
  • Department of Computer Science, University of Pretoria, South Africa;Department of Computer Science, University of Pretoria, South Africa;Department of Computer Science, University of Pretoria, South Africa

  • Venue:
  • ECAL'09 Proceedings of the 10th European conference on Advances in artificial life: Darwin meets von Neumann - Volume Part II
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

This research investigates a swarm intelligence based multi-objective optimization algorithm for optimizing the behavior of a group of Artificial Neural Networks (ANNs), where each ANN specializes to solving a specific part of a task, such that the group as a whole achieves an effective solution. Niche Particle Swarm Optimization (NichePSO) is a speciation technique that has proven effective at locating multiple solutions in complex multivariate tasks. This research evaluates the efficacy of the NichePSO method for training a group of ANNs that form a neural network ensemble (NNE) for the purpose of solving a set of multivariate tasks. NichePSO is compared with a gradient descent method for training a set of individual ANNs to solve different parts of a multivariate task, and then combining the outputs of each ANN into a single solution. To date, there has been little research that has compared the effectiveness of applying NichePSO versus more traditional supervised learning methods for the training of neural network ensembles.