Neural network ensembles: immune-inspired approaches to the diversity of components

  • Authors:
  • Rodrigo Pasti;Leandro Nunes Castro;Guilherme Palermo Coelho;Fernando José Zuben

  • Affiliations:
  • Laboratory of Bioinformatics and Bio-Inspired Computing (LBiC), Department of Computer Engineering and Industrial Automation (DCA), School of Electrical and Computer Engineering (FEEC), University ...;Mackenzie University, São Paulo, Brazil 01302-907;Laboratory of Bioinformatics and Bio-Inspired Computing (LBiC), Department of Computer Engineering and Industrial Automation (DCA), School of Electrical and Computer Engineering (FEEC), University ...;Laboratory of Bioinformatics and Bio-Inspired Computing (LBiC), Department of Computer Engineering and Industrial Automation (DCA), School of Electrical and Computer Engineering (FEEC), University ...

  • Venue:
  • Natural Computing: an international journal
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

This work applies two immune-inspired algorithms, namely opt-aiNet and omni-aiNet, to train multi-layer perceptrons (MLPs) to be used in the construction of ensembles of classifiers. The main goal is to investigate the influence of the diversity of the set of solutions generated by each of these algorithms, and if these solutions lead to improvements in performance when combined in ensembles. omni-aiNet is a multi-objective optimization algorithm and, thus, explicitly maximizes the components' diversity at the same time it minimizes their output errors. The opt-aiNet algorithm, by contrast, was originally designed to solve single-objective optimization problems, focusing on the minimization of the output error of the classifiers. However, an implicit diversity maintenance mechanism stimulates the generation of MLPs with different weights, which may result in diverse classifiers. The performances of opt-aiNet and omni-aiNet are compared with each other and with that of a second-order gradient-based algorithm, named MSCG. The results obtained show how the different diversity maintenance mechanisms presented by each algorithm influence the gain in performance obtained with the use of ensembles.