Dual Heuristic dynamic Programming for nonlinear discrete-time uncertain systems with state delay

Authors:
Bin Wang;Dongbin Zhao;Cesare Alippi;Derong Liu
Affiliations:
-;-;-;-
Venue:
Neurocomputing
Year:
2014

Citing 12
Cited 0

Frequency-domain design of PID controllers for stable and unstable systems with time delay

Automatica (Journal of IFAC)
Time-Delay Systems: Analysis, Optimization and Applications

Time-Delay Systems: Analysis, Optimization and Applications
2009 Special Issue: Neural network approach to continuous-time direct adaptive optimal control for partially unknown nonlinear systems

Neural Networks
Optimal control laws for time-delay systems with saturating actuators based on heuristic dynamic programming

Neurocomputing
Self-teaching adaptive dynamic programming for Gomoku

Neurocomputing
State and Disturbance Estimator for Time-Delay Systems With Application to Fault Estimation and Signal Compensation

IEEE Transactions on Signal Processing
Adaptive dynamic programming

IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews
Discrete-Time Nonlinear HJB Solution Using Approximate Dynamic Programming: Convergence Proof

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Fuzzy H∞ Filter Design for a Class of Nonlinear Discrete-Time Systems With Multiple Time Delays

IEEE Transactions on Fuzzy Systems
Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approach

Automatica (Journal of IFAC)
Optimal Tracking Control for a Class of Nonlinear Discrete-Time Systems With Time Delays Based on Heuristic Dynamic Programming

IEEE Transactions on Neural Networks - Part 1
DHP Method for Ramp Metering of Freeway Traffic

IEEE Transactions on Intelligent Transportation Systems

Quantified Score

Hi-index	0.01

Visualization

Abstract

The paper proposes a novel iterative control scheme based on neural networks for optimally controlling a large class of nonlinear discrete-time systems affected by an unknown time variant delay and system uncertainties. An iterative Dual Heuristic dynamic Programming (DHP) algorithm has been envisaged to design the controller which is proven to converge to the optimal one. The key elements required by the DHP, namely the performance index function, the optimal control policy and the nonlinear delay-affected discrete-time system are modeled with feedforward neural networks. Examples demonstrate the validity of the proposed optimal control approach and its effectiveness in dealing with nonlinear time delay situations.