Ergodic control of multidimensional diffusions 1: the existence results
SIAM Journal on Control and Optimization
Discrete-time controlled Markov processes with average cost criterion: a survey
SIAM Journal on Control and Optimization
Ergodic Control of Switching Diffusions
SIAM Journal on Control and Optimization
Zero-Sum Risk-Sensitive Stochastic Differential Games
Mathematics of Operations Research
| Hi-index | 0.00 |
In this paper we address an open problem which was stated in [A. Arapostathis et al., SIAM J. Control Optim., 31 (1993), pp. 282-344] in the context of discrete-time controlled Markov chains with a compact action space. It asked whether the associated invariant probability distributions are necessarily tight if all stationary Markov policies are stable, in other words if the corresponding chains are positive recurrent. We answer this question affirmatively for controlled nondegenerate diffusions modeled by Itô stochastic differential equations. We apply the results to the ergodic control problem in its average formulation to obtain fairly general characterizations of optimality without resorting to blanket Lyapunov stability assumptions.