LEGAL-tree: a lexicographic multi-objective genetic algorithm for decision tree induction

  • Authors:
  • Márcio P. Basgalupp;Rodrigo C. Barros;André C. P. L. F. de Carvalho;Alex A. Freitas;Duncan D. Ruiz

  • Affiliations:
  • University of São Paulo, São Carlos -- SP, Brazil;Pontifical Catholic University of RS, Porto Alegre -- RS, Brazil;University of São Paulo, São Carlos -- SP, Brazil;University of Kent, Canterbury, Kent, United Kingdom;Pontifical Catholic University of RS, Porto Alegre -- RS, Brazil

  • Venue:
  • Proceedings of the 2009 ACM symposium on Applied Computing
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

Decision trees are widely disseminated as an effective solution for classification tasks. Decision tree induction algorithms have some limitations though, due to the typical strategy they implement: recursive top-down partitioning through a greedy split evaluation. This strategy is limiting in the sense that there is quality loss while the partitioning process occurs, creating statistically insignificant rules. In order to prevent the greedy strategy and to avoid converging to local optima, we present a novel Genetic Algorithm for decision tree induction based on a lexicographic multi-objective approach, and we compare it with the most well-known algorithm for decision tree induction, J48, over distinct public datasets. The results show the feasibility of using this technique as a means to avoid the previously described problems, reporting not only a comparable accuracy but also, importantly, a significantly simpler classification model in the employed datasets.