AOAB: automated optimization algorithm benchmarking

  • Authors:
  • Thomas Weise;Li Niu;Ke Tang

  • Affiliations:
  • University of Science and Technology of China (USTC), Hefei, China;University of Science and Technology of China (USTC), Hefei, China;University of Science and Technology of China (USTC), Hefei, China

  • Venue:
  • Proceedings of the 12th annual conference companion on Genetic and evolutionary computation
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper we present AOAB, the Automated Optimization Algorithm Benchmarking system. AOAB can be used to automatically conduct experiments with numerical optimization algorithms by applying them to different benchmarks with different parameter settings. Based on the results, AOAB can automatically perform comparisons between different algorithms and settings. It can aid the researcher to identify trends for good parameter settings and to find which algorithms are suitable for which type of problem. We introduce the system structure of AOAB (the server and the graphical client interface), define the way in which optimizers and benchmark functions can be implemented for the use in AOAB, and conduct an illustrative example experiment with our system: a comparison between Random Search and two Hill Climbers.