A Novel Infinite-Time Optimal Tracking Control Scheme for a Class of Discrete-Time Nonlinear Systems via the Greedy HDP Iteration Algorithm

Authors:
Huaguang Zhang;Qinglai Wei;Yanhong Luo
Affiliations:
Lab. of Integrated Autom. of Process Ind., Northeastern Univ., Shenyang;-;-
Venue:
IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Year:
2008

Citing 0
Cited 20

Neural-network-based near-optimal control for a class of discrete-time affine nonlinear systems with control constraints

IEEE Transactions on Neural Networks
Adaptive dynamic programming: an introduction

IEEE Computational Intelligence Magazine
Asymptotic tracking control scheme for mechanical systems with external disturbances and friction

Neurocomputing
Optimal control laws for time-delay systems with saturating actuators based on heuristic dynamic programming

Neurocomputing
Brief paper: An iterative adaptive dynamic programming method for solving a class of nonlinear zero-sum differential games

Automatica (Journal of IFAC)
Optimal control for boiler combustion system based on iterative heuristic dynamic programming

ISNN'11 Proceedings of the 8th international conference on Advances in neural networks - Volume Part I
Finite horizon optimal tracking control for a class of discrete-time nonlinear systems

ISNN'11 Proceedings of the 8th international conference on Advances in neural networks - Volume Part II
Finite-horizon neuro-optimal tracking control for a class of discrete-time nonlinear systems using adaptive dynamic programming approach

Neurocomputing
LMI-based criterion for the robust stability of 2D discrete state-delayed systems using generalized overflow nonlinearities

Journal of Control Science and Engineering
Adaptive dynamic programming-based optimal control of unknown nonaffine nonlinear discrete-time systems with proof of convergence

Neurocomputing
2012 Special Issue: An iterative ε-optimal control scheme for a class of discrete-time nonlinear systems with unfixed initial state

Neural Networks
Temperature control in water-gas shift reaction with adaptive dynamic programming

ISNN'12 Proceedings of the 9th international conference on Advances in Neural Networks - Volume Part II
Self-learning control schemes for two-person zero-sum differential games of continuous-time nonlinear systems with saturating controllers

ISNN'12 Proceedings of the 9th international conference on Advances in Neural Networks - Volume Part II
Neural-network-based zero-sum game for discrete-time nonlinear systems via iterative adaptive dynamic programming algorithm

Neurocomputing
Multi-objective optimal control for a class of unknown nonlinear systems based on finite-approximation-error ADP algorithm

Neurocomputing
Optimal tracking control for a class of nonlinear time-delay systems with actuator saturation

BICS'13 Proceedings of the 6th international conference on Advances in Brain Inspired Cognitive Systems
Optimal tracking control scheme for discrete-time nonlinear systems with approximation errors

ISNN'13 Proceedings of the 10th international conference on Advances in Neural Networks - Volume Part II
Neural network H∞ tracking control of nonlinear systems using GHJI method

ISNN'13 Proceedings of the 10th international conference on Advances in Neural Networks - Volume Part II
Neural-network-based optimal tracking control scheme for a class of unknown discrete-time nonlinear systems using iterative ADP algorithm

Neurocomputing
Fixed-final-time optimal tracking control of input-affine nonlinear systems

Neurocomputing

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we aim to solve the infinite-time optimal tracking control problem for a class of discrete-time nonlinear systems using the greedy heuristic dynamic programming (HDP) iteration algorithm. A new type of performance index is defined because the existing performance indexes are very difficult in solving this kind of tracking problem, if not impossible. Via system transformation, the optimal tracking problem is transformed into an optimal regulation problem, and then, the greedy HDP iteration algorithm is introduced to deal with the regulation problem with rigorous convergence analysis. Three neural networks are used to approximate the performance index, compute the optimal control policy, and model the nonlinear system for facilitating the implementation of the greedy HDP iteration algorithm. An example is given to demonstrate the validity of the proposed optimal tracking control scheme.