Determining optimal decision model for support vector machine by genetic algorithm

  • Authors:
  • Syng-Yup Ohn;Ha-Nam Nguyen;Dong Seong Kim;Jong Sou Park

  • Affiliations:
  • Department of Computer Engineering, Hankuk Aviation University, Seoul, Korea;Department of Computer Engineering, Hankuk Aviation University, Seoul, Korea;Department of Computer Engineering, Hankuk Aviation University, Seoul, Korea;Department of Computer Engineering, Hankuk Aviation University, Seoul, Korea

  • Venue:
  • CIS'04 Proceedings of the First international conference on Computational and Information Science
  • Year:
  • 2004

Quantified Score

Hi-index 0.00

Visualization

Abstract

The problem of determining optimal decision model is a difficult combinatorial task in the fields of pattern classification and machine learning. In this paper, we propose a new method to find the optimal decision model for SVM, which consists of the minimal set of highly discriminative features and the set of parameters for the kernel. To cope with this problem, we adopted genetic algorithm (GA) which provides efficient optimization tool simulating the natural evolution procedures in iterative fashion to select the optimal set of features and set of kernel parameters. In the method, the decision models generated by GA are evaluated by SVM, and GA selects the only good models and gives the selected models the chance to survive and improve by crossover and mutation operation. Combining GA and SVM, we can obtain the optimal decision model which reduces the execution time as well as improves the classification rate of SVM. We also demonstrated the feasibility of our proposed method by several experiments on the sets of clinical data such as KDD Cup 1999 intrusion detection pattern samples and stomach cancer proteome pattern samples.