Evolutionary Induction of Decision Trees for Misclassification Cost Minimization

  • Authors:
  • Marek Kretowski;Marek Grześ

  • Affiliations:
  • Faculty of Computer Science, Białystok Technical University, Wiejska 45a, 15-351 Białystok, Poland;Faculty of Computer Science, Białystok Technical University, Wiejska 45a, 15-351 Białystok, Poland

  • Venue:
  • ICANNGA '07 Proceedings of the 8th international conference on Adaptive and Natural Computing Algorithms, Part I
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

In the paper, a new method of decision tree learning for cost-sensitive classification is presented. In contrast to the traditional greedy top-down inducer in the proposed approach optimal trees are searched in a global manner by using an evolutionary algorithm (EA). Specialized genetic operators are applied to modify both the tree structure and tests in non-terminal nodes. A suitably defined fitness function enables the algorithm to minimize the misclassification cost instead of the number of classification errors. The performance of the EA-based method is compared to three well-recognized algorithms on real-life problems with known and randomly generated cost-matrices. Obtained results show that the proposed approach is competitive both in terms of misclassification cost and compactness of the classifier at least for some datasets.