Dynamic programming: deterministic and stochastic models
Dynamic programming: deterministic and stochastic models
Adaptive control: stability, convergence, and robustness
Adaptive control: stability, convergence, and robustness
Neural networks for control
A menu of designs for reinforcement learning over time
Neural networks for control
Learning internal representations by error propagation
Parallel distributed processing: explorations in the microstructure of cognition, vol. 1
Optimal, predictive, and adaptive control
Optimal, predictive, and adaptive control
Modern control engineering (3rd ed.)
Modern control engineering (3rd ed.)
A course in fuzzy systems and control
A course in fuzzy systems and control
Fuzzy logic: intelligence, control, and information
Fuzzy logic: intelligence, control, and information
Feedback control systems (4th ed.)
Feedback control systems (4th ed.)
Iterative Dynamic Programming
Applied Optimal Control and Estimation
Applied Optimal Control and Estimation
Modern Control Systems
Control System Design
Computer Controlled Systems: Theory and Design
Computer Controlled Systems: Theory and Design
Adaptive critic designs and their applications
Adaptive critic designs and their applications
Handbook of Learning and Approximate Dynamic Programming (IEEE Press Series on Computational Intelligence)
Stochastic Optimal Control: The Discrete-Time Case
Stochastic Optimal Control: The Discrete-Time Case
Adaptive control of a hybrid electric vehicle
IEEE Transactions on Intelligent Transportation Systems
IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews
Higher Level Application of ADP: A Next Phase for the Control Field?
IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Editorial: Introduction to the special issue on neural network feedback control
Automatica (Journal of IFAC)
Adaptive-critic based optimal neuro control synthesis for distributed parameter systems
Automatica (Journal of IFAC)
IEEE Transactions on Neural Networks
IEEE Transactions on Neural Networks
Adaptive critic design with ESN critic for bioprocess optimization
ICANN'10 Proceedings of the 20th international conference on Artificial neural networks: Part II
| Hi-index | 0.01 |
Some three decades ago, certain computational intelligence methods of reinforcement learning were recognized as implementing an approximation of Bellman's Dynamic Programming method, which is known in the controls community as an important tool for designing optimal control policies for nonlinear plants and sequential decision making. Significant theoretical and practical developments have occurred within this arena, mostly in the past decade, with the methodology now usually referred to as Adaptive Dynamic Programming (ADP). The objective of this paper is to provide a retrospective of selected threads of such developments. In addition, a commentary is offered concerning present status of ADP, and threads for future research and development within the controls field are suggested.