A rigorous runtime analysis for quasi-random restarts and decreasing stepsize

  • Authors:
  • Marc Schoenauer;Fabien Teytaud;Olivier Teytaud

  • Affiliations:
  • TAO (Inria), LRI, UMR 8623, CNRS - Univ. Paris-Sud, Orsay, France;TAO (Inria), LRI, UMR 8623, CNRS - Univ. Paris-Sud, Orsay, France;TAO (Inria), LRI, UMR 8623, CNRS - Univ. Paris-Sud, Orsay, France

  • Venue:
  • EA'11 Proceedings of the 10th international conference on Artificial Evolution
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

Multi-Modal Optimization (MMO) is ubiquitous in engineering, machine learning and artificial intelligence applications. Many algorithms have been proposed for multimodal optimization, and many of them are based on restart strategies. However, only few works address the issue of initialization in restarts. Furthermore, very few comparisons have been done, between different MMO algorithms, and against simple baseline methods. This paper proposes an analysis of restart strategies, and provides a restart strategy for any local search algorithm for which theoretical guarantees are derived. This restart strategy is to decrease some 'step-size', rather than to increase the population size, and it uses quasi-random initialization, that leads to a rigorous proof of improvement with respect to random restarts or restarts with constant initial step-size. Furthermore, when this strategy encapsulates a (1+1)-ES with 1/5th adaptation rule, the resulting algorithm outperforms state of the art MMO algorithms while being computationally faster.