A generalized-constraint neural network model: Associating partially known relationships for nonlinear regressions

  • Authors:
  • Bao-Gang Hu;Han-Bing Qu;Yong Wang;Shuang-Hong Yang

  • Affiliations:
  • NLPR/LIAMA, Institute of Automation, Chinese Academy of Sciences, P.O. Box 2728, Beijing 100080, China and Beijing Graduate School, Chinese Academy of Sciences, Beijing 100049, China;Beijing Pattern Recognition Tech. Research Center, Beijing Academy of Science and Technology, China;Beijing Graduate School, Chinese Academy of Sciences, Beijing 100049, China;College of Computing, Georgia Institute of Technology, Atlanta, GA 30332, USA

  • Venue:
  • Information Sciences: an International Journal
  • Year:
  • 2009

Quantified Score

Hi-index 0.07

Visualization

Abstract

In an attempt to enhance the neural network technique so that it can evolve from a ''black box'' tool into a semi-analytical one, we propose a novel modeling approach of imposing ''generalized constraints'' on a standard neural network. We redefine approximation problems by use of a new formalization with the aim of embedding prior knowledge explicitly into the model to the maximum extent. A generalized-constraint neural network (GCNN) model has therefore been developed, which basically consists of two submodels. One is constructed by the standard neural network technique to approximate the unknown part of the target function. The other is formed from partially known relationships to impose generalized constraints on the whole model. Three issues arising after combination of the two submodels are discussed: (a) the better approximation provided by the GCNN model compared with a standard neural network, (b) the identifiability of parameters in the partially known relationships, and (c) the discrepancy in the approximation due to removable singularities in the target function. Numerical studies of three benchmark problems show important findings that have not previously been reported in the literature. Significant benefits were observed from using the GCNN model in comparison with a standard neural network.