Simulated annealing based pattern classification

  • Authors:
  • Sanghamitra Bandyopadhyay;Sankar K. Pal;C. A. Murthy

  • Affiliations:
  • Machine Intelligence Unit, Indian Statistical Institute, 203 Barrackpore Trunk Road, Calcutta 700 035, India;Machine Intelligence Unit, Indian Statistical Institute, 203 Barrackpore Trunk Road, Calcutta 700 035, India;Department of Statistics, 326, Thomas Building, Pennsylvania State University, University Park PA -16802-111, USA

  • Venue:
  • Information Sciences: an International Journal
  • Year:
  • 1998

Quantified Score

Hi-index 0.07

Visualization

Abstract

A method is described for finding decision boundaries, approximated by piecewise linear segments, for classifying patterns in @?^N, N = 2, using Simulated Annealing (SA). It involves generation and placement of a set of hyperplanes (represented by strings) in the feature space that yields minimum misclassification. Theoretical analysis shows that as the size of the training data set approaches infinity, the boundary provided by the SA based classifier will approach the Bayes boundary. The effectiveness of the classification methodology, along with the generalization ability of the decision boundary, is demonstrated for both artificial data and real life data sets having non-linear/overlapping class boundaries. Results are compared extensively with those of the Bayes classifier, k-NN rule and multilayer perceptron, and Genetic Algorithms, another popular evolutionary technique. Empirical verification of the theoretical claim is also provided.