Improving generalization of fuzzy IF-THEN rules by maximizing fuzzy entropy

  • Authors:
  • Xi-Zhao Wang;Chun-Ru Dong

  • Affiliations:
  • Department of Mathematics and Computer Science, Hebei University, Baoding City, Hebei Province, China;Department of Mathematics and Computer Science, Hebei University, Baoding City, Hebei Province, China

  • Venue:
  • IEEE Transactions on Fuzzy Systems
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

When fuzzy IF-THEN rules initially extracted from data have not a satisfying performance, we consider that the rules require refinement. Distinct frommost existing rule-refinement approaches that are based on the further reduction of training error, this paper proposes a new rule-refinement scheme that is based on the maximization of fuzzy entropy on the training set. The new scheme, which is realized by solving a quadratic programming problem, is expected to have the advantages of improving the generalization capability of initial fuzzy IF-THEN rules and simultaneously overcoming the overfitting of refinement. Experimental results on a number of selected databases demonstrate the expected improvement of generalization capability and the prevention of overfitting by a comparison of both training and testing accuracy before and after the refinement.