The graph-theoretical properties of partitions and information entropy

  • Authors:

  • Cungen Cao;Yuefei Sui;Youming Xia

  • Affiliations:

  • Key Laboratory of Intelligent Information Processing, Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China;Key Laboratory of Intelligent Information Processing, Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China;Department of Computer Science, Yunnan Normal University, Kunming, Yunnan, China

  • Venue:
  • RSFDGrC'05 Proceedings of the 10th international conference on Rough Sets, Fuzzy Sets, Data Mining, and Granular Computing - Volume Part I
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

The information entropy, as a measurement of the average amount of information contained in an information system, is used in the classification of objects and the analysis of information systems. The information entropy of a partition is non-increasing when the partition is refined, and is related to rough sets by Wong and Ziarko. The partitions and information entropy have some graph-theoretical properties. Given a non-empty universe U, all the partitions G on U are taken as nodes, and a relation V between partitions are defined and taken as edges. The graph obtained is denoted by (G,V), which represents the connections between partitions on U. According to the values of the information entropy of partitions, a directed graph $(G,\overrightarrow{V})$ is defined on (G,V). It will be proved that there is a set of partitions with the minimal entropy; and a set of partitions with the maximal entropy; and the entropy is non-decreasing on any directed pathes in $(G,\overrightarrow{V})$ from a partition with the minimal entropy to one of the partitions with the maximal entropy. Hence, in $(G,\overrightarrow{V})$ the information entropy of partitions is represented in a clearly structured way.