• DocumentCode
    1423506
  • Title

    Equilibrium distribution of finite-state Markov processes

  • Author

    Hawkes, Alan G. ; Sykes, Alan M.

  • Author_Institution
    Dept. of Manage. Sci. & Stat., Univ. Coll. of Swansea, UK
  • Volume
    39
  • Issue
    5
  • fYear
    1990
  • fDate
    12/1/1990 12:00:00 AM
  • Firstpage
    592
  • Lastpage
    595
  • Abstract
    Very simple methods are presented for computing equilibrium distributions of finite-state Markov processes in continuous time and in discrete time, namely Markov chains. These use the APL domino function which takes a least-squares approach which is efficient with systems of up to 50 states and probably more. This approach can also be used to solve for mean interval occupancies. It is not suggested that the least-squares solution be implemented in traditional languages like Fortran simply for the purpose of finding equilibrium distributions, for which the state reduction method is simpler. However, if APL is available the methods described provide accurate and extremely simple solutions for discrete or continuous-time models. More importantly, the APL domino function leads to a powerful and simple computation of mean interval occupancies and, hence, availabilities
  • Keywords
    Markov processes; statistical analysis; APL domino function; Markov chains; continuous time; discrete time; equilibrium distributions; finite-state Markov processes; least-squares approach; Computer languages; Distributed computing; Equations; Least squares approximation; Least squares methods; Markov processes; Probability distribution; Reliability; Steady-state;
  • fLanguage
    English
  • Journal_Title
    Reliability, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9529
  • Type

    jour

  • DOI
    10.1109/24.61316
  • Filename
    61316