Control variation as a source of uncertainty: single input case

  • Authors:

  • André P. Calmon;Thomas Valleé;João B. R. Do Val

  • Affiliations:

  • Department of Telematics, School of Electrical and Computer Engineering, University of Campinas, Campinas, SP, Brazil;IEMN-IAE, LEMNA, Université de Nantes, Nantes, France;Department of Telematics, School of Electrical and Computer Engineering, University of Campinas, Campinas, SP, Brazil

  • Venue:
  • ACC'09 Proceedings of the 2009 conference on American Control Conference
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper presents a theoretical framework and the control strategy for single input discrete-time stochastic systems for which the control variations increase state uncertainty (CVIU systems). This type of system model can be useful in many practical situations, such as in monetary policy problems, medicine and biology, and, in general, in problems for which a complete dynamic model is too complex to be feasible. The optimal control strategy for a single-input CVIU system associated with a convex cost functional is devised using dynamic programming and tools from nonsmooth analysis. Furthermore, this strategy points to a region in the state space in which the optimal action is of no variation, as expected from the cautionary nature of controlling underdetermined systems. In addition, a specific result for the case when the cost functional is differentiable is obtained and discussed. These results are illustrated through a numerical example in economics.