An Iterative Method for Deciding SVM and Single Layer Neural Network Structures

  • Authors:
  • Tarek M. Hamdani;Adel M. Alimi;Mohamed A. Khabou

  • Affiliations:
  • Research Group on Intelligent Machines (REGIM), University of Sfax, National Engineering School of Sfax (ENIS), Sfax, Tunisia 3038;Research Group on Intelligent Machines (REGIM), University of Sfax, National Engineering School of Sfax (ENIS), Sfax, Tunisia 3038;Department of Electrical and Computer Engineering, University of West Florida, Pensacola, USA 32514

  • Venue:
  • Neural Processing Letters
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

We present two new classifiers for two-class classification problems using a new Beta-SVM kernel transformation and an iterative algorithm to concurrently select the support vectors for a support vector machine (SVM) and the hidden units for a single hidden layer neural network to achieve a better generalization performance. To construct the classifiers, the contributing data points are chosen on the basis of a thresholding scheme of the outputs of a single perceptron trained using all training data samples. The chosen support vectors are used to construct a new SVM classifier that we call Beta-SVN. The number of chosen support vectors is used to determine the structure of the hidden layer in a single hidden layer neural network that we call Beta-NN. The Beta-SVN and Beta-NN structures produced by our method outperformed other commonly used classifiers when tested on a 2-dimensional non-linearly separable data set.