Learning evaluation functions to improve optimization by local search

  • Authors:
  • Justin Boyan;Andrew W. Moore

  • Affiliations:
  • NASA Ames Research Center, Computational Sciences Division, Moffett Field, CA;Carnegie Mellon University, Computer Science Department, Pittsburgh, PA

  • Venue:
  • The Journal of Machine Learning Research
  • Year:
  • 2001

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper describes algorithms that learn to improve search performance on large-scale optimization tasks. The main algorithm, STAGE, works by learning an evaluation function that predicts the outcome of a local search algorithm, such as hillclimbing or Walksat, from features of states visited during search. The learned evaluation function is then used to bias future search trajectories toward better optima on the same problem. Another algorithm, X-STAGE, transfers previously learned evaluation functions to new, similar optimization problems. Empirical results are provided on seven large-scale optimization domains: bin-packing, channel routing, Bayesian network structure-finding, radiotherapy treatment planning, cartogram design, Boolean satisfiability, and Boggle board setup.