Reducing the space-time complexity of the CMA-ES

  • Authors:
  • James N. Knight;Monte Lunacek

  • Affiliations:
  • Colorado State University, Ft Collins, CO;Colorado State University, Ft Collins, CO

  • Venue:
  • Proceedings of the 9th annual conference on Genetic and evolutionary computation
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

A limited memory version of the covariance matrix adaptation evolution strategy (CMA-ES) is presented. This algorithm, L-CMA-ES, improves the space and time complexity of the CMA-ES algorithm. The L-CMA-ES uses the $m$ eigenvectors and eigenvalues spanning the m-dimensional dominant subspace of the n-dimensional covariance matrix, C, describing the mutation distribution. The algorithm avoids explicit computation and storage of $C$ resulting in space and time savings. The L-CMA-ES algorithm has a space complexity of \mathcal{O}(nm) and a time complexity of \mathcal{O}(nm^2). The algorithm is evaluated on a number of standard test functions. The results show that while the number of objective function evaluations needed to find a solution is often increased by using m the increase in computational efficiency leads to a lower overall run time.