Stochastic optimal control based on variable-period sampling model for Networked Control Systems with random delays

This paper presents a stochastic optimal controller using the variable-period sampling networked control systems (NCSs) model, where it has been assumed that the random network-induced delay only exists between sensor and controller and the time delay occuring at current sampling step is taken as the sampling period between current sampling step and next sampling step. It is assumed that the random delay is subjected to a uniform distribution in the interval between 0 and the maximal random delay. The proposed stochastic optimal controller is shown to produce a closed loop system which exhibits exponentially mean square stability. In the end, the simulations on an inverted pendulum process and DC motor are studied, which show that the proposed algorithm can produce desired control effect.