Comparison-based optimizers need comparison-based surrogates

  • Authors:
  • Ilya Loshchilov;Marc Schoenauer;Michèle Sebag

  • Affiliations:
  • INRIA Saclay - Île-de-France and Laboratoire de Recherche en Informatique, UMR CNRS, Université Paris-Sud, Orsay Cedex, France;INRIA Saclay - Île-de-France and Laboratoire de Recherche en Informatique, UMR CNRS, Université Paris-Sud, Orsay Cedex, France;INRIA Saclay - Île-de-France and Laboratoire de Recherche en Informatique, UMR CNRS, Université Paris-Sud, Orsay Cedex, France

  • Venue:
  • PPSN'10 Proceedings of the 11th international conference on Parallel problem solving from nature: Part I
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

Taking inspiration from approximate ranking, this paper investigates the use of rank-based Support Vector Machine as surrogate model within CMA-ES, enforcing the invariance of the approach with respect to monotonous transformations of the fitness function. Whereas the choice of the SVM kernel is known to be a critical issue, the proposed approach uses the Covariance Matrix adapted by CMA-ES within a Gaussian kernel, ensuring the adaptation of the kernel to the currently explored region of the fitness landscape at almost no computational overhead. The empirical validation of the approach on standard benchmarks, comparatively to CMA-ES and recent surrogate-based CMA-ES, demonstrates the efficiency and scalability of the proposed approach.