Adaptive Dynamic Programming for Finite-Horizon Optimal Control of Discrete-Time Nonlinear Systems With -Error Bound

Authors:
Fei-Yue Wang;Ning Jin;Derong Liu;Qinglai Wei
Affiliations:
Key Lab. of Complex Syst. & Intell. Sci., Chinese Acad. of Sci., Beijing, China;-;-;-
Venue:
IEEE Transactions on Neural Networks
Year:
2011

Citing 0
Cited 16

Finite horizon optimal tracking control for a class of discrete-time nonlinear systems

ISNN'11 Proceedings of the 8th international conference on Advances in neural networks - Volume Part II
A three-network architecture for on-line learning and optimization based on adaptive dynamic programming

Neurocomputing
Finite-horizon neuro-optimal tracking control for a class of discrete-time nonlinear systems using adaptive dynamic programming approach

Neurocomputing
Adaptive dynamic programming-based optimal control of unknown nonaffine nonlinear discrete-time systems with proof of convergence

Neurocomputing
2012 Special Issue: An iterative ε-optimal control scheme for a class of discrete-time nonlinear systems with unfixed initial state

Neural Networks
Modeling and monitoring of multimodes process

ISNN'12 Proceedings of the 9th international conference on Advances in Neural Networks - Volume Part I
Temperature control in water-gas shift reaction with adaptive dynamic programming

ISNN'12 Proceedings of the 9th international conference on Advances in Neural Networks - Volume Part II
Self-learning control schemes for two-person zero-sum differential games of continuous-time nonlinear systems with saturating controllers

ISNN'12 Proceedings of the 9th international conference on Advances in Neural Networks - Volume Part II
An iterative adaptive dynamic programming algorithm for optimal control of unknown discrete-time nonlinear systems with constrained inputs

Information Sciences: an International Journal
Neural-network-based zero-sum game for discrete-time nonlinear systems via iterative adaptive dynamic programming algorithm

Neurocomputing
Optimal tracking control for a class of nonlinear time-delay systems with actuator saturation

BICS'13 Proceedings of the 6th international conference on Advances in Brain Inspired Cognitive Systems
Optimal tracking control scheme for discrete-time nonlinear systems with approximation errors

ISNN'13 Proceedings of the 10th international conference on Advances in Neural Networks - Volume Part II
Neuro-optimal control for a class of unknown nonlinear dynamic systems using SN-DHP technique

Neurocomputing
Neural-network-based optimal tracking control scheme for a class of unknown discrete-time nonlinear systems using iterative ADP algorithm

Neurocomputing
Fixed-final-time optimal control of nonlinear systems with terminal constraints

Neural Networks
Fixed-final-time optimal tracking control of input-affine nonlinear systems

Neurocomputing

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we study the finite-horizon optimal control problem for discrete-time nonlinear systems using the adaptive dynamic programming (ADP) approach. The idea is to use an iterative ADP algorithm to obtain the optimal control law which makes the performance index function close to the greatest lower bound of all performance indices within an -error bound. The optimal number of control steps can also be obtained by the proposed ADP algorithms. A convergence analysis of the proposed ADP algorithms in terms of performance index function and control policy is made. In order to facilitate the implementation of the iterative ADP algorithms, neural networks are used for approximating the performance index function, computing the optimal control policy, and modeling the nonlinear system. Finally, two simulation examples are employed to illustrate the applicability of the proposed method.