The automatic model selection and variable kernel width for RBF neural networks

  • Authors:
  • Peng Zhou;Dehua Li;Hong Wu;Feng Cheng

  • Affiliations:
  • Institute for Pattern Recognition & artificial Intelligence, Huazhong University of Science and Technology Wuhan 430074, China;Institute for Pattern Recognition & artificial Intelligence, Huazhong University of Science and Technology Wuhan 430074, China;Institute for Pattern Recognition & artificial Intelligence, Huazhong University of Science and Technology Wuhan 430074, China;Institute for Pattern Recognition & artificial Intelligence, Huazhong University of Science and Technology Wuhan 430074, China

  • Venue:
  • Neurocomputing
  • Year:
  • 2011

Quantified Score

Hi-index 0.01

Visualization

Abstract

The Orthogonal Least Squares (OLS) algorithm has been extensively used in basis selection for RBF networks, but it is unable to perform model selection automatically because the tolerance @r must be specified manually. This introduces noise and it is difficult to implement in the parametric complexity of real-time system. Therefore, a generic criterion that detects the optimum number of its basis functions is proposed. In this paper, not only the Bayesian Information Criterion (BIC) method, used for fitness calculation, is incorporated into the basis function selection process of the OLS algorithm for assigning its appropriate number, but also a new method is developed to optimize the widths of the Gaussian functions in order to improve the generalization performance. The augmented algorithm is employed to the Radial Basis Function Neural Networks (RBFNN) for known and unknown noise nonlinear dynamic systems and its performance is compared with the standard OLS; experimental results show that both the efficacy of BIC for fitness calculation and the importance of proper choice of basis function widths are significant.