1971 kyow symposium paper: Optimal stochastic control for discrete-time linear system with interrupted observations

  • Authors:
  • Shohei Fujita;Takeshi Fukao

  • Affiliations:
  • Department of Electrical Engineering, Tokyo Institute of Technology, O-okayama 2-12-1, Meguro-ku, Tokyo, Japan;-

  • Venue:
  • Automatica (Journal of IFAC)
  • Year:
  • 1972

Quantified Score

Hi-index 22.15

Visualization

Abstract

This paper is concerned with determining an optimal control policy in situations where at any time it is possible that information concerning the state vector of the system may or may not be contained in the observations-''interrupted stochastic control problem''. The interrupted observation mechanism is formulated in terms of two-state Markov chain with states 0 and 1. A Separation Theorem is established for discrete-time linear system with interrupted observations and an expected quadratic cost. The optimal policy is realized by cascading a nonlinear estimator, which computes the conditional mean of the state vector, with the optimal feedback gain matrix in which all uncertainties are removed. This does not require the use of dynamic programming and has much computational advantage. The nonlinear estimator consists of a weighted sum of Kalman type filters. The performance measure is evaluated and it is pointed out that the probability of interruption enters into the expected cost only as a function of the estimation error covariance matrix.