Methods to design optimal control of Markov process with finite state set in the presence of constraints

Authors:
B. M. Miller;G. B. Miller;K. V. Semenikhin
Affiliations:
Kharkevich Institute for Information Transmission Problems, Russian Academy of Sciences, Moscow, Russia;Institute of Informatics Problems, Russian Academy of Sciences, Moscow, Russia;Moscow State Aviation Institute, Moscow, Russia
Venue:
Automation and Remote Control
Year:
2011

Citing 4
Cited 1

Continuity of Optimal Values and Solutions for Control of Markov Chains with Constraints

SIAM Journal on Control and Optimization
Stochastic Optimal Control: The Discrete-Time Case

Stochastic Optimal Control: The Discrete-Time Case
Bicriteria Optimization of a Queue with a Controlled Input Stream

Queueing Systems: Theory and Applications
Mathematical Models of Traffic Control in Internet: New Approaches Based of TCP/AQM Schemes

Automation and Remote Control

Control and observation for dynamical queueing networks. I

Automation and Remote Control

Quantified Score

Hi-index	0.00

Visualization

Abstract

The problem of optimal control of a nonuniform Markov process with a finite state set over a fixed interval in the presence of inequality-like constraints was considered. The design of control relies on the principle of dynamic programming in combination with the methods of convex programming and the duality theory. Two types of conditions under which it is possible to select a Markov optimal control were proposed.