Log-linear convergence of the scale-invariant (µ/µw, λ)-ES and optimal µ for intermediate recombination for large population sizes

  • Authors:
  • Mohamed Jebalia;Anne Auger

  • Affiliations:
  • INRIA Saclay-Ile-de-France, LRI, Paris-Sud University, Orsay Cedex, France;INRIA Saclay-Ile-de-France, LRI, Paris-Sud University, Orsay Cedex, France

  • Venue:
  • PPSN'10 Proceedings of the 11th international conference on Parallel problem solving from nature: Part I
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

Evolution Strategies (ESs) are population-based methods well suited for parallelization. In this paper, we study the convergence of the (µ/µw, λ)-ES, an ES with weighted recombination, and derive its optimal convergence rate and optimal µ especially for large population sizes. First, we theoretically prove the log-linear convergence of the algorithm using a scale-invariant adaptation rule for the step-size and minimizing spherical objective functions and identify its convergence rate as the expectation of an underlying random variable. Then, using Monte-Carlo computations of the convergence rate in the case of equal weights, we derive optimal values for µ that we compare with previously proposed rules. Our numerical computations show also a dependency of the optimal convergence rate in ln(λ) in agreement with previous theoretical results.