A genetic feature weighting scheme for pattern recognition

  • Authors:
  • Heesung Lee;Euntai Kim;Mignon Park

  • Affiliations:
  • School of Electrical and Electronic Engineering, Yonsei University, Korea;(Correspd. Tel.: +82 2 2123 2863/ Fax: +82 2 313 2879/ E-mail: etkim@yonsei.ac.kr) C613, School of Electrical and Electronic Engineering, Yonsei University, 134 Shinchon-dong, Seodaemun-gu, Seoul, ...;School of Electrical and Electronic Engineering, Yonsei University, Korea

  • Venue:
  • Integrated Computer-Aided Engineering
  • Year:
  • 2007

Quantified Score

Hi-index 0.03

Visualization

Abstract

This paper proposes a new pattern recognition scheme, combining a new adaptive feature weighting and modified k-Nearest Neighbor (k-NN) rule. The proposed feature weighting method named adaptive-3FW. It uses three non-uniform weight levels (zero weight, middle weight and full weight) to weight each feature. The middle weight value is determined using genetic algorithms (GAs). The proposed adaptive-3FW overcomes overfitting issues and achieves high recognition performance. Novel GA operators tailored for this formulation are introduced to implement the proposed scheme. Further, a modified k-NN is proposed which uses a class-dependent feature weighting strategy. Whilst the conventional pattern recognition systems use the same set of feature weights for all classes, the proposed algorithm uses different sets of feature weights for different classes. Experiments were performed with the UCI repository for machine learning databases and the unconstrained handwritten numeral database of Concordia University in Canada to show the performance of the proposed method.