Issues on Stability of ADP Feedback Controllers for Dynamical Systems

Authors:
S. N. Balakrishnan;Jie Ding;F. L. Lewis
Affiliations:
Dept. of Mech. & Aerosp. Eng., Missouri Univ. of Sci. & Technol., Rolla, MO;-;-
Venue:
IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Year:
2008

Citing 0
Cited 13

Reinforcement learning and adaptive dynamic programming for feedback control

IEEE Circuits and Systems Magazine
Adaptive dynamic programming: an introduction

IEEE Computational Intelligence Magazine
Control of unknown nonlinear systems with efficient transient performance using concurrent exploitation and exploration

IEEE Transactions on Neural Networks
PH optimal control in the clarifying process of sugar cane juice based on DHP

ICIC'10 Proceedings of the 6th international conference on Advanced intelligent computing theories and applications: intelligent computing
A three-network architecture for on-line learning and optimization based on adaptive dynamic programming

Neurocomputing
Finite-horizon neuro-optimal tracking control for a class of discrete-time nonlinear systems using adaptive dynamic programming approach

Neurocomputing
2012 Special Issue: Metamodeling and the Critic-based approach to multi-level optimization

Neural Networks
2012 Special Issue: A boundedness result for the direct heuristic dynamic programming

Neural Networks
Optimal control of unknown nonaffine nonlinear discrete-time systems based on adaptive dynamic programming

Automatica (Journal of IFAC)
Integral Q-learning and explorized policy iteration for adaptive optimal control of continuous-time linear systems

Automatica (Journal of IFAC)
Nearly optimal control for nonlinear systems with dead-zone control input based on the iterative ADP approach

ICONIP'12 Proceedings of the 19th international conference on Neural Information Processing - Volume Part I
Neuro-optimal control for a class of unknown nonlinear dynamic systems using SN-DHP technique

Neurocomputing
Neural-network-based optimal tracking control scheme for a class of unknown discrete-time nonlinear systems using iterative ADP algorithm

Neurocomputing

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper traces the development of neural-network (NN)-based feedback controllers that are derived from the principle of adaptive/approximate dynamic programming (ADP) and discusses their closed-loop stability. Different versions of NN structures in the literature, which embed mathematical mappings related to solutions of the ADP-formulated problems called ldquoadaptive criticsrdquo or ldquoaction-criticrdquo networks, are discussed. Distinction between the two classes of ADP applications is pointed out. Furthermore, papers in ldquomodel-freerdquo development and model-based neurocontrollers are reviewed in terms of their contributions to stability issues. Recent literature suggests that work in ADP-based feedback controllers with assured stability is growing in diverse forms.