Training Recurrent Neurocontrollers for Real-Time Applications

Authors:
D. V. Prokhorov
Affiliations:
Toyota Motor Eng. & Manufacturing North America, Ann Arbor
Venue:
IEEE Transactions on Neural Networks
Year:
2007

Citing 0
Cited 3

Robust neural network motion tracking control of piezoelectric actuation systems for micro/nanomanipulation

IEEE Transactions on Neural Networks
Processing short-term and long-term information with a combination of polynomial approximation techniques and time-delay neural networks

IEEE Transactions on Neural Networks
Adaptive critic design with ESN critic for bioprocess optimization

ICANN'10 Proceedings of the 20th international conference on Artificial neural networks: Part II

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we introduce a new approach to train recurrent neurocontrollers for real-time applications. We begin with training a recurrent neurocontroller for robustness on high-fidelity models of physical systems. For training, we use a recently developed derivative-free Kalman filter method which we enhance for controller training. After training, we fix weights of our recurrent neurocontroller and deploy it in an embedded environment. Then, we carry out additional training of the neurocontroller by adapting in real time its internal state (short-term memory), rather than its weights (long-term memory). Such real-time training is done with a new combination of simultaneous perturbation stochastic approximation (SPSA) and adaptive critic. Our critic is also a recurrent neural network (RNN), and it is trained by stochastic meta-descent (SMD) for increased efficiency. Our approach is applied to two important practical problems, electronic throttle control and hybrid electric vehicle control, with apparent performance improvement.