DocumentCode
1347463
Title
Perturbation analysis via coupling
Author
Dai, Liyi
Author_Institution
Dept. of Syst. Sci. & Math., Washington Univ., St. Louis, MO, USA
Volume
45
Issue
4
fYear
2000
fDate
4/1/2000 12:00:00 AM
Firstpage
614
Lastpage
628
Abstract
Perturbation analysis is an efficient method for performance analysis of discrete event dynamic systems. It yields gradient information from only one sample path observation. Over the last two decades, various perturbation analysis techniques have been developed to handle a large class of problems. Coupling is a method of generating multiple random samples. It has wide range of applications in applied probability. The paper is concerned with perturbation analysis via coupling. This approach offers a great versatility of the form of gradient estimators, which is potentially useful for variance reduction and for efficient implementation. Several known perturbation analysis techniques can be reviewed as special ways of coupling. The coupling method is further applied to gradient estimation of Markov chains. The method is used not only in deriving a gradient estimator but also in its implementation. It is proved that the estimator is strongly consistent. Finally, different coupling schemes are compared using an illustrative example
Keywords
Markov processes; discrete event systems; perturbation techniques; probability; Markov chains; applied probability; coupling; discrete event dynamic systems; gradient estimation; gradient information; performance analysis; perturbation analysis; random samples; variance reduction; Analytical models; Books; Design optimization; Discrete event simulation; Information analysis; Markov processes; Performance analysis; Stochastic systems; Structural engineering; Timing;
fLanguage
English
Journal_Title
Automatic Control, IEEE Transactions on
Publisher
ieee
ISSN
0018-9286
Type
jour
DOI
10.1109/9.847099
Filename
847099
Link To Document