Optimizing through Co-evolutionary Avalanches

• Authors: Stefan Boettcher;Allon G. Percus;Michelangelo Grigni
• Venue: PPSN VI Proceedings of the 6th International Conference on Parallel Problem Solving from Nature
• Year: 2000

We explore a new general-purpose heuristic for finding high-quality solutions to hard optimization problems. The method, called extremal optimization, is inspired by "self-organized criticality," a concept introduced to describe emergent complexity in many physical systems. In contrast to Genetic Algorithms which operate on an entire "genepool" of possible solutions, extremal optimization successively replaces extremely undesirable elements of a sub-optimal solution with new, random ones. Large fluctuations, called "avalanches," ensue that efficiently explore many local optima. Drawing upon models used to simulate far-from-equilibrium dynamics, extremal optimization complements approximation methods inspired by equilibrium statistical physics, such as simulated annealing. With only one adjustable parameter, its performance has proved competitive with more elaborate methods, especially near phase transitions. Those phase transitions are found in the parameter space of most optimization problems, and have recently been conjectured to be the origin of some of the hardest instances in computational complexity. We will demonstrate how extremal optimization can be implemented for a variety of combinatorial optimization problems. We believe that extremal optimization will be a useful tool in the investigation of phase transitions in combinatorial optimization problems, hence valuable in elucidating the origin of computational complexity.