A Stochastic Neural Model for Fast Identification of Spatiotemporal Sequences
Neural Processing Letters
Learning the Dynamic Neural Networks with the Improvement of Generalization Capabilities
ICANN '02 Proceedings of the International Conference on Artificial Neural Networks
Improving generalization capabilities of dynamic neural networks
Neural Computation
ISNN'06 Proceedings of the Third international conference on Advances in Neural Networks - Volume Part I
| Hi-index | 0.00 |
The paper is concerned with a general learning (with arbitrary criterion and state-dependent constraints) of continuous trajectories by means of recurrent neural networks with time-varying weights. The learning process is transformed into an optimal control framework, where the weights to be found are treated as controls. A learning algorithm based on a variational formulation of Pontryagin's maximum principle is proposed. This algorithm is shown to converge, under reasonable conditions, to an optimal solution. The neural networks with time-dependent weights make it possible to efficiently find an admissible solution (i.e., initial weights satisfying state constraints) which then serves as an initial guess to carry out a proper minimization of a given criterion. The proposed methodology may be directly applicable to both classification of temporal sequences and to optimal tracking of nonlinear dynamic systems. Numerical examples are also given which demonstrate the efficiency of the approach presented