Investigating the impact of adaptation sampling in natural evolution strategies on black-box optimization testbeds

  • Authors:
  • Tom Schaul

  • Affiliations:
  • New York University, New York, NY, USA

  • Venue:
  • Proceedings of the 14th annual conference companion on Genetic and evolutionary computation
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

Natural Evolution Strategies (NES) are a recent member of the class of real-valued optimization algorithms that are based on adapting search distributions. Exponential NES (xNES) are the most common instantiation of NES, and particularly appropriate for the BBOB 2012 benchmarks, given that many are non-separable, and their relatively small problem dimensions. The technique of adaptation sampling, which adapts learning rates online further improves the algorithm's performance. This report provides an extensive empirical comparison to study the impact of adaptation sampling in xNES, both on the noise-free and noisy BBOB testbeds.