A New Criterion in Selection and Discretization of Attributes for the Generation of Decision Trees

  • Authors:
  • Byung Hwan Jun;Chang Soo Kim;Hong-Yeop Song;Jaihie Kim

  • Affiliations:
  • Kongju National Univ., Chungnam, Korea;Yonsei Univ., Seoul, Korea;Yonsei Univ., Seoul, Korea;Yonsei Univ., Seoul, Korea

  • Venue:
  • IEEE Transactions on Pattern Analysis and Machine Intelligence
  • Year:
  • 1997

Quantified Score

Hi-index 0.14

Visualization

Abstract

It is important to use a better criterion in selection and discretization of attributes for the generation of decision trees to construct a better classifier in the area of pattern recognition in order to intelligently access huge amount of data efficiently. Two well-known criteria are gain and gain ratio, both based on the entropy of partitions. We propose in this paper a new criterion based also on entropy, and use both theoretical analysis and computer simulation to demonstrate that it works better than gain or gain ratio in a wide variety of situations. We use the usual entropy calculation where the base of the logarithm is not two but the number of successors to the node. Our theoretical analysis leads some specific situations in which the new criterion works always better than gain or gain ratio, and the simulation result may implicitly cover all the other situations not covered by the analysis.