High-dimensional model-based optimization based on noisy evaluations of computer games

  • Authors:

  • Mike Preuss;Tobias Wagner;David Ginsbourger

  • Affiliations:

  • Chair of Algorithm Engineering (LS 11), Technische Universität Dortmund, Dortmund, Germany;Institute of Machining Technology (ISF), Technische Universität Dortmund, Dortmund, Germany;Institute of Mathematical Statistics and Actuarial Science, University of Bern, Bern, Switzerland

  • Venue:
  • LION'12 Proceedings of the 6th international conference on Learning and Intelligent Optimization
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

Most publications on surrogate models have focused either on the prediction quality or on the optimization performance. It is still unclear whether the prediction quality is indeed related to the suitability for optimization. Moreover, most of these studies only employ low-dimensional test cases. There are no results for popular surrogate models, such as kriging, for high-dimensional (n10) noisy problems. In this paper, we analyze both aspects by comparing different surrogate models on the noisy 22-dimensional car setup optimization problem, based on both, prediction quality and optimization performance. In order not to favor specific properties of the model, we run two conceptually different modern optimization methods on the surrogate models, CMA-ES and BOBYQA. It appears that kriging and random forests are very good modeling techniques with respect to both, prediction quality and suitability for optimization algorithms.