• DocumentCode
    1348282
  • Title

    Transient solution of Markov models by combining adaptive and standard uniformization

  • Author

    Van Moorsel, Aad P A ; Sanders, William H.

  • Author_Institution
    AT&T Bell Labs., Murray Hill, NJ, USA
  • Volume
    46
  • Issue
    3
  • fYear
    1997
  • fDate
    9/1/1997 12:00:00 AM
  • Firstpage
    430
  • Lastpage
    440
  • Abstract
    Adaptive uniformization (AU) has been proposed to compute transient measures in continuous-time Markov chains and is especially attractive for solving large and stiff dependability models. The major advantage of AU is that it requires at most as many iterations as standard uniformization (SU), and often far fewer, thus resulting in substantial computation savings. However, this computation gain can be offset by the need to compute more complex jump-probabilities in AU, whose computation is more expensive than computing Poisson probabilities in SU. In particular, AU is computationally superior to SU if and only if the considered time instant is less than some threshold time value. To overcome this drawback, AU and SU are combined (AU/SU) so that AU is used early in the time interval, and SU is used over the rest of the time interval. AU/SU can be implemented so that: (1) the combination introduces only minor computation overhead, (2) the number of iterations required is almost as low as for AU, and (3) the cost of computing the jump probabilities is about as low as for SU. AU/SU yields a strict lower bound of the true result, within any desired pre-specified accuracy. The error bounds include the error introduced when the Fox/Glynn algorithm is used for computing Poisson probabilities; this algorithm is enhanced to optimize its error-bound characteristics. To demonstrate the benefits of AU/SU it is applied to a machine-repair model, using a version of combined AU/SU implemented in UltraSAN, a performance and dependability evaluation software package
  • Keywords
    Markov processes; Poisson distribution; error analysis; maintenance engineering; mathematics computing; reliability theory; software packages; transient analysis; Fox/Glynn algorithm; Poisson probabilities; UltraSAN; adaptive uniformization; continuous-time Markov chains; dependability evaluation software package; error bounds; jump-probabilities; machine-repair model; performance evaluation software package; standard uniformization; stiff dependability models; transient measures; Costs; Finite wordlength effects; Gold; Laboratories; Markov processes; Numerical stability; Time measurement;
  • fLanguage
    English
  • Journal_Title
    Reliability, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9529
  • Type

    jour

  • DOI
    10.1109/24.664016
  • Filename
    664016