Critical factors in the performance of hyperNEAT

  • Authors:
  • Thomas G. van den Berg;Shimon Whiteson

  • Affiliations:
  • University of Amsterdam, Amsterdam, Netherlands;University of Amsterdam, Amsterdam, Netherlands

  • Venue:
  • Proceedings of the 15th annual conference on Genetic and evolutionary computation
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

HyperNEAT is a popular indirect encoding method for evolutionary computation that has performed well on a number of benchmark tasks. This paper presents a series of experiments designed to examine the critical factors for its success. First, we determine the fewest hidden nodes a genotypic network needs to solve several of these tasks. Our results show that all of these tasks are easy: they can be solved with at most one hidden node and require generating only trivial regular patterns. Then, we examine how HyperNEAT performs when the tasks are made harder. Our results show that HyperNEAT's performance decays quickly: it fails to solve all variants of these tasks that require more complex solutions. Next, we examine the hypothesis that fracture in the problem space, known to be challenging for regular NEAT, is even more so for HyperNEAT. Our results suggest that quite complex networks are needed to cope with fracture and HyperNEAT can have difficulty discovering them. Finally, we connect these results to previous experiments showing that HyperNEAT's performance decreases on irregular tasks. Our results suggest irregularity is an extreme form of fracture and that HyperNEAT's limitations are thus more severe than those experiments suggested.