Radial Basis Function network learning using localized generalization error bound

  • Authors:

  • Daniel S. Yeung;Patrick P. K. Chan;Wing W. Y. Ng

  • Affiliations:

  • School of Computer Science and Engineering, South China University of Technology, Guangzhou 510006, China;School of Computer Science and Engineering, South China University of Technology, Guangzhou 510006, China and Department of Computing, The Hong Kong Polytechnic University, Hung Hom, Kowloon, Hong ...;School of Computer Science and Engineering, South China University of Technology, Guangzhou 510006, China

  • Venue:
  • Information Sciences: an International Journal
  • Year:
  • 2009

Quantified Score

Hi-index 0.07

Visualization

Abstract

Training a classifier with good generalization capability is a major issue for pattern classification problems. A novel training objective function for Radial Basis Function (RBF) network using a localized generalization error model (L-GEM) is proposed in this paper. The localized generalization error model provides a generalization error bound for unseen samples located within a neighborhood that contains all training samples. The assumption of the same width for all dimensions of a hidden neuron in L-GEM is relaxed in this work. The parameters of RBF network are selected via minimization of the proposed objective function to minimize its localized generalization error bound. The characteristics of the proposed objective function are compared with those for regularization methods. For weight selection, RBF networks trained by minimizing the proposed objective function consistently outperform RBF networks trained by minimizing the training error, Tikhonov Regularization, Weight Decay or Locality Regularization. The proposed objective function is also applied to select center, width and weight in RBF network simultaneously. RBF networks trained by minimizing the proposed objective function yield better testing accuracies when compared to those that minimizes training error only.