A fully probabilistic control framework for stochastic systems with input and state delay

Abstract

This paper proposes a unified probabilistic control framework for a class of stochastic systems with both control input and state time delays. Both of the stochastic nature and time delays in the system dynamics are considered simultaneously, thus providing a comprehensive and rigorous control methodology. The problem is formulated in a fully probabilistic framework, where the system dynamics and its controller are fully characterised by arbitrary probabilistic models. In this framework, the Kullback–Leibler Divergence between the actual joint probability density function of the system dynamics and controller and a predefined ideal joint probability density function is used to characterise the discrepancy between the two distributions and derive the randomised controller. Time delays in the control input and system state are taken into consideration in the optimisation process for the derivation of the optimal randomised controller. Besides, the analytic control solution of the time delay fully probabilistic control problem for a class of linear Gaussian stochastic systems is derived while the successive approximation approach is implemented to deal with the time-advanced components in the control law that result from the existence of time delays. The effectiveness of the proposed control framework is then illustrated on a numerical example and a real-world example.