IEEE Transactions on Neural Networks
A growing and pruning method for radial basis function networks
IEEE Transactions on Neural Networks
Efficient and reliable training of neural networks
HSI'09 Proceedings of the 2nd conference on Human System Interactions
IJCNN'09 Proceedings of the 2009 international joint conference on Neural Networks
Improved computation for Levenberg-Marquardt training
IEEE Transactions on Neural Networks
Neural network learning without backpropagation
IEEE Transactions on Neural Networks
| Hi-index | 0.00 |
In this paper, a supervised neural network training technique based on constrained optimization is developed for preserving prior knowledge of an input-output mapping during repeated incremental training sessions. The prior knowledge, referred to as long-term memory (LTM), is expressed in the form of equality constraints obtained by means of an algebraic training technique. Incremental training, which may be used to learn new short-term memories (STMs) online, is then formulated as an error minimization problem subject to equality constraints. The solution of this problem is simplified by implementing an adjoined error gradient that circumvents direct substitution and exploits classical backpropagation. A target application is neural network function approximation in adaptive critic designs. For illustrative purposes, constrained training is implemented to update an adaptive critic flight controller, while preserving prior knowledge of an established performance baseline that consists of classical gain-scheduled controllers. It is shown both analytically and numerically that the LTM is accurately preserved while the controller is repeatedly trained over time to assimilate new STMs.