A Fokker-Planck control framework for multidimensional stochastic processes

  • Authors:
  • M. Annunziato;A. Borzí

  • Affiliations:
  • Universití degli Studi di Salerno, Dipartimento di Matematica, Via Ponte Don Melillo, 84084 Fisciano, Italy;Institut für Mathematik, Universität Würzburg, Emil-Fischer-Strasse 30, 97074 Würzburg, Germany

  • Venue:
  • Journal of Computational and Applied Mathematics
  • Year:
  • 2013

Quantified Score

Hi-index 7.29

Visualization

Abstract

An efficient framework for the optimal control of probability density functions (PDFs) of multidimensional stochastic processes is presented. This framework is based on the Fokker-Planck equation that governs the time evolution of the PDF of stochastic processes and on tracking objectives of terminal configuration of the desired PDF. The corresponding optimization problems are formulated as a sequence of open-loop optimality systems in a receding-horizon control strategy. Many theoretical results concerning the forward and the optimal control problem are provided. In particular, it is shown that under appropriate assumptions the open-loop bilinear control function is unique. The resulting optimality system is discretized by the Chang-Cooper scheme that guarantees positivity of the forward solution. The effectiveness of the proposed computational framework is validated with a stochastic Lotka-Volterra model and a noised limit cycle model.