Stabilization of stochastic systems under Markovian switching

The problem of state feedback stabilization of discrete-time stochastic processes under Markovian switching is considered. The jump Markovian switching is modeled by a discrete-time Markov chain, and the noise or stochastic environmental disturbance is modeled by a sequence of identically independently normally distributed random variables. Necessary and sufficient conditions based on linear matrix inequalities (LMI’s) for stochastic stability is obtained. The proposed control law for this stochastic stabilization result depends on the mode of the system as well as the environmental disturbances. The robustness results of such stability concepts against all admissible uncertainties are also investigated. An example is given to demonstrate the obtained results.