Stability of networked control systems based on hidden Markov models

For the stability analysis of the networked control system (NCS) with random network-induced delays, which were considered to be governed by an underlying Markov chain with unknown probability distribution, the hidden Markov model (HMM) theory was proposed to model this kind of NCS as a jump linear system, wherein the output feedback controller was adopted. By using Baum-Welch algorithm, the parameters of the derived HMM were identified. Based on the derived closed loop model, the sufficient conditions on the existence of the stabilizing output feedback controller were established by solving a set of linear matrix inequalities (LMIs). A simulated experimental result was given to show the efficiency and feasibility of our proposed approach.