Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approach

Authors:
Murad Abu-Khalaf;Frank L. Lewis
Affiliations:
Automation and Robotics Research Institute, The University of Texas at Arlington, TX 76118, USA;Automation and Robotics Research Institute, The University of Texas at Arlington, TX 76118, USA
Venue:
Automatica (Journal of IFAC)
Year:
2005

Citing 10
Cited 40

Universal approximation of an unknown mapping and its derivatives using multilayer feedforward networks

Neural Networks
Galerkin approximations of the generalized Hamilton-Jacobi-Bellman equation

Automatica (Journal of IFAC)
Approximate solutions to the time-invariant Hamilton-Jacobi-Bellman equation

Journal of Optimization Theory and Applications
Solving Hamilton-Jacobi-Bellman equations by a modified method of characteristics

Nonlinear Analysis: Theory, Methods & Applications - Lakshmikantham's Legacy: A tribute on his 75th birthday
Control Systems Theory with Engineering Applications

Control Systems Theory with Engineering Applications
Neural Network Control of Robot Manipulators and Nonlinear Systems

Neural Network Control of Robot Manipulators and Nonlinear Systems
Brief Intelligent optimal control of robotic manipulators using neural networks

Automatica (Journal of IFAC)
Editorial: Introduction to the special issue on neural network feedback control

Automatica (Journal of IFAC)
Neural approximations for infinite-horizon optimal control of nonlinear stochastic systems

IEEE Transactions on Neural Networks
A perceptron network for functional identification and control of nonlinear systems

IEEE Transactions on Neural Networks

Brief paper: A neural network solution for fixed-final time optimal control of nonlinear systems

Automatica (Journal of IFAC)
Brief paper: Explicit construction of H∞ control law for a class of nonminimum phase nonlinear systems

Automatica (Journal of IFAC)
Brief paper: A multivariate adaptive regression B-spline algorithm (BMARS) for solving a class of nonlinear optimal feedback control problems

Automatica (Journal of IFAC)
Neural network solution for finite-horizon H∞ state feedback control of nonlinear systems

International Journal of Systems Science
Brief paper: Adaptive optimal control for continuous-time linear systems based on policy iteration

Automatica (Journal of IFAC)
Model-free multiobjective approximate dynamic programming for discrete-time nonlinear systems with general performance index functions

Neurocomputing
2009 Special Issue: Neural network approach to continuous-time direct adaptive optimal control for partially unknown nonlinear systems

Neural Networks
Neural-network-based near-optimal control for a class of discrete-time affine nonlinear systems with control constraints

IEEE Transactions on Neural Networks
Reinforcement learning and adaptive dynamic programming for feedback control

IEEE Circuits and Systems Magazine
Constrained controller design for a class of nonlinear discrete-time uncertain systems

ACC'09 Proceedings of the 2009 conference on American Control Conference
Online actor critic algorithm to solve the continuous-time infinite horizon optimal control problem

IJCNN'09 Proceedings of the 2009 international joint conference on Neural Networks
Adaptive dynamic programming for discrete-time systems with infinite horizon and Ɛ -error bound in the performance cost

IJCNN'09 Proceedings of the 2009 international joint conference on Neural Networks
Generalized policy iteration for continuous-time systems

IJCNN'09 Proceedings of the 2009 international joint conference on Neural Networks
Non-fragile control of uncertain Markovian jumping linear systems subject to actuator saturation

CCDC'09 Proceedings of the 21st annual international conference on Chinese control and decision conference
Direct heuristic dynamic programming for nonlinear tracking control with filtered tracking error

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Adaptive dynamic programming: an introduction

IEEE Computational Intelligence Magazine
Online actor-critic algorithm to solve the continuous-time infinite horizon optimal control problem

Automatica (Journal of IFAC)
Optimal control laws for time-delay systems with saturating actuators based on heuristic dynamic programming

Neurocomputing
Optimal control for a class of unknown nonlinear systems via the iterative GDHP algorithm

ISNN'11 Proceedings of the 8th international conference on Advances in neural networks - Volume Part II
Multi-player non-zero-sum games: Online adaptive learning solution of coupled Hamilton-Jacobi equations

Automatica (Journal of IFAC)
A radial basis collocation method for Hamilton-Jacobi-Bellman equations

Automatica (Journal of IFAC)
Finite-horizon neuro-optimal tracking control for a class of discrete-time nonlinear systems using adaptive dynamic programming approach

Neurocomputing
Adaptive dynamic programming-based optimal control of unknown nonaffine nonlinear discrete-time systems with proof of convergence

Neurocomputing
Controller design for Markov jumping systems subject to actuator saturation

Automatica (Journal of IFAC)
2012 Special Issue: A boundedness result for the direct heuristic dynamic programming

Neural Networks
Adaptive optimal control without weight transport

Neural Computation
Optimal control of unknown nonaffine nonlinear discrete-time systems based on adaptive dynamic programming

Automatica (Journal of IFAC)
Multi-agent differential graphical games: Online adaptive learning solution for synchronization with optimality

Automatica (Journal of IFAC)
Self-learning control schemes for two-person zero-sum differential games of continuous-time nonlinear systems with saturating controllers

ISNN'12 Proceedings of the 9th international conference on Advances in Neural Networks - Volume Part II
An iterative adaptive dynamic programming algorithm for optimal control of unknown discrete-time nonlinear systems with constrained inputs

Information Sciences: an International Journal
A novel actor-critic-identifier architecture for approximate optimal control of uncertain nonlinear systems

Automatica (Journal of IFAC)
Case studies on the application of the stable manifold approach for nonlinear optimal control design

Automatica (Journal of IFAC)
Nearly optimal control for nonlinear systems with dead-zone control input based on the iterative ADP approach

ICONIP'12 Proceedings of the 19th international conference on Neural Information Processing - Volume Part I
Neural-network-based zero-sum game for discrete-time nonlinear systems via iterative adaptive dynamic programming algorithm

Neurocomputing
Optimal tracking control scheme for discrete-time nonlinear systems with approximation errors

ISNN'13 Proceedings of the 10th international conference on Advances in Neural Networks - Volume Part II
Neuro-optimal control for a class of unknown nonlinear dynamic systems using SN-DHP technique

Neurocomputing
Neural-network-based optimal tracking control scheme for a class of unknown discrete-time nonlinear systems using iterative ADP algorithm

Neurocomputing
Robust adaptive neural network control for a class of uncertain nonlinear systems with actuator amplitude and rate saturations

Neurocomputing
Integral reinforcement learning and experience replay for adaptive optimal control of partially-unknown constrained-input continuous-time systems

Automatica (Journal of IFAC)
Dual Heuristic dynamic Programming for nonlinear discrete-time uncertain systems with state delay

Neurocomputing

Quantified Score

Hi-index	22.17

Visualization

Abstract

The Hamilton-Jacobi-Bellman (HJB) equation corresponding to constrained control is formulated using a suitable nonquadratic functional. It is shown that the constrained optimal control law has the largest region of asymptotic stability (RAS). The value function of this HJB equation is solved for by solving for a sequence of cost functions satisfying a sequence of Lyapunov equations (LE). A neural network is used to approximate the cost function associated with each LE using the method of least-squares on a well-defined region of attraction of an initial stabilizing controller. As the order of the neural network is increased, the least-squares solution of the HJB equation converges uniformly to the exact solution of the inherently nonlinear HJB equation associated with the saturating control inputs. The result is a nearly optimal constrained state feedback controller that has been tuned a priori off-line.