Comparison of information theoretical measures for reduct finding

  • Authors:
  • Szymon Jaroszewicz;Marcin Korzeń

  • Affiliations:
  • Faculty of Computer Science and Information Systems, Technical University of Szczecin, Szczecin, Poland;Faculty of Computer Science and Information Systems, Technical University of Szczecin, Szczecin, Poland

  • Venue:
  • ICAISC'06 Proceedings of the 8th international conference on Artificial Intelligence and Soft Computing
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

The paper discusses the properties of an attribute selection criterion for building rough set reducts based on discernibility matrix and compares it with Shannon entropy and Gini index used for building decision trees. It has been shown theoretically and experimentally that entropy and Gini index tend to work better if the reduct is later used for prediction of previously unseen cases, and the criterion based on the discernibility matrix tends to work better for learning functional relationships where generalization is not an issue.