Learnable embeddings of program spaces

  • Authors:

  • Krzysztof Krawiec

  • Affiliations:

  • Institute of Computing Science, Poznan University of Technology, Poznań, Poland

  • Venue:
  • EuroGP'11 Proceedings of the 14th European conference on Genetic programming
  • Year:
  • 2011

Quantified Score

Hi-index 0.01

Visualization

Abstract

We consider a class of adaptive, globally-operating, semantic-based embeddings of programs into discrete multidimensional spaces termed prespaces. In the proposed formulation, the original space of programs and its prespace are bound with a learnable mapping, where the process of learning is aimed at improving the overall locality of the new representation with respect to program semantics. To learn the mapping, which is formally a permutation of program locations in the prespace, we propose two algorithms: simple greedy heuristics and an evolutionary algorithm. To guide the learning process, we use a new definition of semantic locality. In an experimental illustration concerning four symbolic regression domains, we demonstrate that an evolutionary algorithm is able to improve the embedding designed by means of greedy search, and that the learned prespaces usually offer better search performance than the original program space.