• DocumentCode
    1347463
  • Title

    Perturbation analysis via coupling

  • Author

    Dai, Liyi

  • Author_Institution
    Dept. of Syst. Sci. & Math., Washington Univ., St. Louis, MO, USA
  • Volume
    45
  • Issue
    4
  • fYear
    2000
  • fDate
    4/1/2000 12:00:00 AM
  • Firstpage
    614
  • Lastpage
    628
  • Abstract
    Perturbation analysis is an efficient method for performance analysis of discrete event dynamic systems. It yields gradient information from only one sample path observation. Over the last two decades, various perturbation analysis techniques have been developed to handle a large class of problems. Coupling is a method of generating multiple random samples. It has wide range of applications in applied probability. The paper is concerned with perturbation analysis via coupling. This approach offers a great versatility of the form of gradient estimators, which is potentially useful for variance reduction and for efficient implementation. Several known perturbation analysis techniques can be reviewed as special ways of coupling. The coupling method is further applied to gradient estimation of Markov chains. The method is used not only in deriving a gradient estimator but also in its implementation. It is proved that the estimator is strongly consistent. Finally, different coupling schemes are compared using an illustrative example
  • Keywords
    Markov processes; discrete event systems; perturbation techniques; probability; Markov chains; applied probability; coupling; discrete event dynamic systems; gradient estimation; gradient information; performance analysis; perturbation analysis; random samples; variance reduction; Analytical models; Books; Design optimization; Discrete event simulation; Information analysis; Markov processes; Performance analysis; Stochastic systems; Structural engineering; Timing;
  • fLanguage
    English
  • Journal_Title
    Automatic Control, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9286
  • Type

    jour

  • DOI
    10.1109/9.847099
  • Filename
    847099