An iterative adaptive dynamic programming algorithm for optimal control of unknown discrete-time nonlinear systems with constrained inputs

Authors:
Derong Liu;Ding Wang;Xiong Yang
Affiliations:
State Key Laboratory of Management and Control for Complex Systems, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, PR China;State Key Laboratory of Management and Control for Complex Systems, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, PR China;State Key Laboratory of Management and Control for Complex Systems, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, PR China
Venue:
Information Sciences: an International Journal
Year:
2013

Citing 24
Cited 2

Neuro-Dynamic Programming

Neuro-Dynamic Programming
Handbook of Learning and Approximate Dynamic Programming (IEEE Press Series on Computational Intelligence)

Handbook of Learning and Approximate Dynamic Programming (IEEE Press Series on Computational Intelligence)
Neural Network Control of Nonlinear Discrete-Time Systems (Public Administration and Public Policy)

Neural Network Control of Nonlinear Discrete-Time Systems (Public Administration and Public Policy)
A fuzzy Actor-Critic reinforcement learning network

Information Sciences: an International Journal
2009 Special Issue: Neural network approach to continuous-time direct adaptive optimal control for partially unknown nonlinear systems

Neural Networks
2009 Special Issue: Optimal control of unknown affine nonlinear discrete-time systems using offline-trained neural networks with proof of convergence

Neural Networks
Neural-network-based near-optimal control for a class of discrete-time affine nonlinear systems with control constraints

IEEE Transactions on Neural Networks
Reinforcement learning and adaptive dynamic programming for feedback control

IEEE Circuits and Systems Magazine
A new approach for neural control of nonlinear discrete dynamic systems

Information Sciences: an International Journal
A modified gradient-based neuro-fuzzy learning algorithm and its convergence

Information Sciences: an International Journal
Online actor-critic algorithm to solve the continuous-time infinite horizon optimal control problem

Automatica (Journal of IFAC)
Brief paper: Model-free H∞ control design for unknown linear discrete-time systems via Q-learning with LMI

Automatica (Journal of IFAC)
Type-2 fuzzy neural networks with fuzzy clustering and differential evolution optimization

Information Sciences: an International Journal
Self-organizing state aggregation for architecture design of Q-learning

Information Sciences: an International Journal
Optimal control for a class of unknown nonlinear systems via the iterative GDHP algorithm

ISNN'11 Proceedings of the 8th international conference on Advances in neural networks - Volume Part II
Example-based learning particle swarm optimization for continuous optimization

Information Sciences: an International Journal
Discrete-Time Nonlinear HJB Solution Using Approximate Dynamic Programming: Convergence Proof

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approach

Automatica (Journal of IFAC)
Adaptive critic designs

IEEE Transactions on Neural Networks
Online learning control by association and reinforcement

IEEE Transactions on Neural Networks
Comparison of heuristic dynamic programming and dual heuristic programming adaptive critics for neurocontrol of a turbogenerator

IEEE Transactions on Neural Networks
Control of nonlinear dynamical systems using neural networks: controllability and stabilization

IEEE Transactions on Neural Networks
Adaptive Dynamic Programming for Finite-Horizon Optimal Control of Discrete-Time Nonlinear Systems With -Error Bound

IEEE Transactions on Neural Networks
Application of IFT and SPSA to Servo System Control

IEEE Transactions on Neural Networks - Part 2

Gravitational search algorithm-based design of fuzzy control systems with a reduced parametric sensitivity

Information Sciences: an International Journal
A smoothed NR neural network for solving nonlinear convex programs with second-order cone constraints

Information Sciences: an International Journal

Quantified Score

Hi-index	0.07

Visualization

Abstract

In this paper, the adaptive dynamic programming (ADP) approach is employed for designing an optimal controller of unknown discrete-time nonlinear systems with control constraints. A neural network is constructed for identifying the unknown dynamical system with stability proof. Then, the iterative ADP algorithm is developed to solve the optimal control problem with convergence analysis. Two other neural networks are introduced for approximating the cost function and its derivatives and the control law, under the framework of globalized dual heuristic programming technique. Furthermore, two simulation examples are included to verify the theoretical results.