• DocumentCode
    1271693
  • Title

    Theories and Ultra Efficient Computation of Joint Spectral Radius for Estimating First Passage Time Distribution of Markov Set-Chain

  • Author

    Li, Keyong

  • Author_Institution
    Boston Univ., Brookline, MA, USA
  • Volume
    56
  • Issue
    12
  • fYear
    2011
  • Firstpage
    2951
  • Lastpage
    2956
  • Abstract
    This technical note is concerned with the tail distribution of the first passage time of Markov set chains (MSC). An original two-part idea-a more progressive relation and a sortedness test-is conceived to characterize such chains. The theoretical construction based on this idea further results in an algorithm that can compute the tightest exponent bound of the tail distribution for high-dimensional problem instances with surprising ease. To understand the computational implication of this algorithm, note that the problem is equivalent to computing the joint spectral radius (JSR) of a special independent column polytope (one that defines Markov set chains) of nonnegative matrices. In this context, the reported algorithm can compute the exact JSR value for cases of 100 × 100 matrices in less than a second in Matlab. Problems of this size is far beyond the scope of known JSR techniques. It is worth noting that the fields of MSC and JSR have not had significant overlap as one may expect, despite their conceptual akiness. Meanwhile, the present technical note is a contribution that belongs to both fields.
  • Keywords
    Markov processes; matrix algebra; JSR technique; Markov set-chain; Matlab; first passage time distribution; independent column polytope; joint spectral radius; nonnegative matrix; sortedness test; tail distribution; ultra efficient computation; Computational modeling; Eigenvalues and eigenfunctions; Linear matrix inequalities; Markov processes; Uncertainty; Joint spectral radius (JSR); Markov set chains (MSC);
  • fLanguage
    English
  • Journal_Title
    Automatic Control, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9286
  • Type

    jour

  • DOI
    10.1109/TAC.2011.2161791
  • Filename
    5953481