Neural Processing Letters
New internal optimal neurocontrol for a series FACTS device in a power transmission line
Neural Networks - 2003 Special issue: Advances in neural networks research IJCNN'03
2005 Special Issue: A model of evolution and learning
Neural Networks - 2005 Special issue: IJCNN 2005
Learning DFA representations of HTTP for protecting web applications
Computer Networks: The International Journal of Computer and Telecommunications Networking
Brief paper: Adaptive critic methods for stochastic systems with input-dependent noise
Automatica (Journal of IFAC)
Dual heuristic programming based nonlinear optimal control for a synchronous generator
Engineering Applications of Artificial Intelligence
Approximate Dynamic Programming for Ship Course Control
ISNN '07 Proceedings of the 4th international symposium on Neural Networks: Advances in Neural Networks
The Application of Adaptive Critic Design in the Nosiheptide Fermentation
ISNN '07 Proceedings of the 4th international symposium on Neural Networks: Advances in Neural Networks
On-Line Learning Control for Discrete Nonlinear Systems Via an Improved ADDHP Method
ISNN '07 Proceedings of the 4th international symposium on Neural Networks: Advances in Neural Networks
ADHDP for the pH Value Control in the Clarifying Process of Sugar Cane Juice
ISNN '08 Proceedings of the 5th international symposium on Neural Networks: Advances in Neural Networks
Automatica (Journal of IFAC)
Binary action search for learning continuous-action control policies
ICML '09 Proceedings of the 26th Annual International Conference on Machine Learning
Performance Evaluation of Direct Heuristic Dynamic Programming using Control-Theoretic Measures
Journal of Intelligent and Robotic Systems
Temperature Control in Cement Rotary Kiln with Neural Network-Based Heuristic Dynamic Programming
ISNN 2009 Proceedings of the 6th International Symposium on Neural Networks: Advances in Neural Networks - Part II
IEEE Transactions on Neural Networks
Optimal neurocontroller synthesis for impulse-driven systems
Neural Networks
Reinforcement learning and adaptive dynamic programming for feedback control
IEEE Circuits and Systems Magazine
Asymptotically stable adaptive critic design for uncertain nonlinear systems
ACC'09 Proceedings of the 2009 conference on American Control Conference
Neuro-dynamic programming with recurrent critic for automatic train regulation of metro line
IJCNN'09 Proceedings of the 2009 international joint conference on Neural Networks
Online actor critic algorithm to solve the continuous-time infinite horizon optimal control problem
IJCNN'09 Proceedings of the 2009 international joint conference on Neural Networks
IJCNN'09 Proceedings of the 2009 international joint conference on Neural Networks
IJCNN'09 Proceedings of the 2009 international joint conference on Neural Networks
A retrospective on adaptive dynamic programming for control
IJCNN'09 Proceedings of the 2009 international joint conference on Neural Networks
Adaptive dynamic programming-based optimal control of unknown affine nonlinear discrete-time systems
IJCNN'09 Proceedings of the 2009 international joint conference on Neural Networks
An improved method of DHP for optimal control in the clarifying process of sugar cane juice
IJCNN'09 Proceedings of the 2009 international joint conference on Neural Networks
Coordinated multiple ramps metering based on neuro-fuzzy adaptive dynamic programming
IJCNN'09 Proceedings of the 2009 international joint conference on Neural Networks
Generalized policy iteration for continuous-time systems
IJCNN'09 Proceedings of the 2009 international joint conference on Neural Networks
Adaptive neural controller design for synchronous generator based on heuristic dynamic programming
CCDC'09 Proceedings of the 21st annual international conference on Chinese control and decision conference
Adaptive dynamic programming: an introduction
IEEE Computational Intelligence Magazine
Adaptive critic based redundancy resolution scheme for robot manipulators
SMC'09 Proceedings of the 2009 IEEE international conference on Systems, Man and Cybernetics
Control and Intelligent Systems
Energy dispatch controllers for a photovoltaic system
Engineering Applications of Artificial Intelligence
Motion control of a nonlinear spring by reinforcement learning
Control and Intelligent Systems
Online actor-critic algorithm to solve the continuous-time infinite horizon optimal control problem
Automatica (Journal of IFAC)
Multiple fuzzy neural networks modeling with sparse data
Neurocomputing
Online adaptive utilization control for real-time embedded multiprocessor systems
Journal of Systems Architecture: the EUROMICRO Journal
PH optimal control in the clarifying process of sugar cane juice based on DHP
ICIC'10 Proceedings of the 6th international conference on Advanced intelligent computing theories and applications: intelligent computing
Two coupled neural-networks-based solution of the Hamilton-Jacobi-Bellman equation
Applied Soft Computing
Brief paper: Optimality and convergence of adaptive optimal control by reinforcement synthesis
Automatica (Journal of IFAC)
Optimal control for a class of unknown nonlinear systems via the iterative GDHP algorithm
ISNN'11 Proceedings of the 8th international conference on Advances in neural networks - Volume Part II
Adaptive dual heuristic programming based on delta-bar-delta learning rule
ISNN'11 Proceedings of the 8th international conference on Advances in neural networks - Volume Part III
Optimization control of rectifier in HVDC system with ADHDP
ISNN'11 Proceedings of the 8th international conference on Advances in neural networks - Volume Part III
Application of dual heuristic programming in excitation system of synchronous generators
ISNN'11 Proceedings of the 8th international conference on Advances in neural networks - Volume Part III
Application of collective robotic search using neural network based dual heuristic programming (DHP)
ISNN'06 Proceedings of the Third international conference on Advnaces in Neural Networks - Volume Part II
Book reviews: Neural networks for modeling and control of dynamic systems: a practitioner's handbook
Automatica (Journal of IFAC)
Book review: Stochastic controls-Hamiltonian systems and HJB equations
Automatica (Journal of IFAC)
Optical Memory and Neural Networks
Automatica (Journal of IFAC)
Temperature control in water-gas shift reaction with adaptive dynamic programming
ISNN'12 Proceedings of the 9th international conference on Advances in Neural Networks - Volume Part II
Constrained adaptive optimal control using a reinforcement learning agent
Automatica (Journal of IFAC)
Automatica (Journal of IFAC)
Information Sciences: an International Journal
Automatica (Journal of IFAC)
ICONIP'12 Proceedings of the 19th international conference on Neural Information Processing - Volume Part I
Optimal tracking control scheme for discrete-time nonlinear systems with approximation errors
ISNN'13 Proceedings of the 10th international conference on Advances in Neural Networks - Volume Part II
Reinforcement learning algorithms with function approximation: Recent advances and applications
Information Sciences: an International Journal
On integral generalized policy iteration for continuous-time linear quadratic regulations
Automatica (Journal of IFAC)
Hi-index | 0.03 |
We discuss a variety of adaptive critic designs (ACDs) for neurocontrol. These are suitable for learning in noisy, nonlinear, and nonstationary environments. They have common roots as generalizations of dynamic programming for neural reinforcement learning approaches. Our discussion of these origins leads to an explanation of three design families: heuristic dynamic programming, dual heuristic programming, and globalized dual heuristic programming (GDHP). The main emphasis is on DHP and GDHP as advanced ACDs. We suggest two new modifications of the original GDHP design that are currently the only working implementations of GDHP. They promise to be useful for many engineering applications in the areas of optimization and optimal control. Based on one of these modifications, we present a unified approach to all ACDs. This leads to a generalized training procedure for ACDs