An evolutionary algorithm for global induction of regression trees with multivariate linear models

  • Authors:
  • Marcin Czajkowski;Marek Kretowski

  • Affiliations:
  • Faculty of Computer Science, Bialystok University of Technology, Białystok, Poland;Faculty of Computer Science, Bialystok University of Technology, Białystok, Poland

  • Venue:
  • ISMIS'11 Proceedings of the 19th international conference on Foundations of intelligent systems
  • Year:
  • 2011

Quantified Score

Hi-index 0.01

Visualization

Abstract

In the paper we present a new evolutionary algorithm for induction of regression trees. In contrast to the typical top-down approaches it globally searches for the best tree structure, tests at internal nodes and models at the leaves. The general structure of proposed solution follows a framework of evolutionary algorithms with an unstructured population and a generational selection. Specialized genetic operators efficiently evolve regression trees with multivariate linear models. Bayesian information criterion as a fitness function mitigate the over-fitting problem. The preliminary experimental validation is promising as the resulting trees are less complex with at least comparable performance to the classical top-down counterpart.