Combining Bayesian classifiers and estimation of distribution algorithms for optimization in continuous domains

  • Authors:

  • Teresa Miquélez;Endika Bengoetxea;Alexander Mendiburu;Pedro Larrañaga

  • Affiliations:

  • Intelligent Systems Group, Computer Engineering Faculty, University of the Basque Country, San Sebastian, Spain;Intelligent Systems Group, Computer Engineering Faculty, University of the Basque Country, San Sebastian, Spain;Intelligent Systems Group, Computer Engineering Faculty, University of the Basque Country, San Sebastian, Spain;Intelligent Systems Group, Computer Engineering Faculty, University of the Basque Country, San Sebastian, Spain

  • Venue:
  • Connection Science - Evolutionary Learning and Optimisation
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper introduces a evolutionary computation method that applies Bayesian classifiers to optimization problems. This approach is based on Estimation of Distribution Algorithms (EDAs) in which Bayesian or Gaussian networks are applied to the evolution of a population of individuals (i.e. potential solutions to the optimization problem) in order to improve the quality of the individuals of the next generation. Our new approach, called Evolutionary Bayesian Classifier-based Optimization Algorithm (EBCOA), employs Bayesian classifiers instead of Bayesian or Gaussian networks in order to evolve individuals to a fitter population. In brief, EBCOAs are characterized by applying Bayesian classification techniques-usually applied to supervised classification problems-to optimization in continuous domains. We propose and review in this paper different Bayesian classifiers for implementing our EBCOA method, focusing particularly on EBCOAs applying naïve Bayes, semi-na¨ive Bayes, and tree augmented na¨ive Bayes classifiers. This work presents a deep study on the behavior of these algorithms with classical optimiztion problems in continuous domains. The different parameters used for tuning the performance of the algorithms are discussed, and a comprehensive overview of their influence is provided. We also present experimental results to compare this new method with other state of the art approaches of the evolutionary computation field for continuous domains such as Evolutionary Strategies (ES) and Estimation of Distribution Algorithms (EDAs).