An ensemble method using hybrid real-coded genetic algorithm with pruning (HRGA/PR)

  • Authors:
  • Hong Zhang;Masumi Ishikawa

  • Affiliations:
  • Kyushu Institute of Technology, Wakamatsu, Kitakyushu, Japan;Kyushu Institute of Technology, Wakamatsu, Kitakyushu, Japan

  • Venue:
  • PDCS '07 Proceedings of the 19th IASTED International Conference on Parallel and Distributed Computing and Systems
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

We have proposed an ensemble method using hybrid real-coded genetic algorithm with pruning (HRGA/P) for superior generalization ability in classification. In order to further improve its performance, this paper proposes to use a novel hybrid real-coded genetic algorithm with pruning (HRGA/Pr) instead of HRGA/P for estimating classifiers. A crucial idea here is to replace the evaluation of the entire classifier by the original Rumelhart's regularizer to that of each unit as an additive criterion term for reducing the complexity. It is intended for improving the generalization ability of the classifier with efficiently exploring the simple structure of the classifier by execution of the additional criterion. Accordingly, the resulting classifiers are expected to be structurally simple and have superior generalization ability in classification. Applications of the proposed method to an iris classification problem well demonstrate its effectiveness. Our experimental results indicate that it has superior generalization ability for test data (classification rate: 98.3%) than the conventional algorithms such as backpropagation (classification rate: 94.1%) and structural learning with forgetting (classification rate: 95.0%).