Almost sure and moments stability of jump linear systems
Systems & Control Letters
On the solution of discrete-time Markovian jump linear quadratic control problems
Automatica (Journal of IFAC)
Neuro-Dynamic Programming
Composite anti-disturbance control for Markovian jump nonlinear systems via disturbance observer
Automatica (Journal of IFAC)
Hi-index | 22.15 |
In this paper, we present an iterative technique based on Monte Carlo simulations for deriving the optimal control of the infinite horizon linear regulator problem of discrete-time Markovian jump linear systems for the case in which the transition probability matrix of the Markov chain is not known. We trace a parallel with the theory of TD(@l) algorithms for Markovian decision processes to develop a TD(@l) like algorithm for the optimal control associated to the maximal solution of a set of coupled algebraic Riccati equations (CARE). It is assumed that either there is a sample of past observations of the Markov chain that can be used for the iterative algorithm, or it can be generated through a computer program. Our proofs rely on the spectral radius of the closed loop operators associated to the mean square stability of the system being less than 1.