DocumentCode :
1492028
Title :
Single sample path-based sensitivity analysis of Markov processes using uniformization
Author :
Liu, Zikuan ; Tu, Fengsheng
Author_Institution :
Dept. of Appl. Math., Hebei Univ. of Technol., Tianjin, China
Volume :
44
Issue :
4
fYear :
1999
fDate :
4/1/1999 12:00:00 AM
Firstpage :
872
Lastpage :
875
Abstract :
Using the notion of perturbation realization factor, Cao and Chen (1997) provide sensitivity formulas of discrete-time Markov chains and uniformizable Markov processes. In this paper, the estimators of the realization factors of a uniformizable Markov process are provided by its uniformized Markov chain. It is proved that estimators given by the uniformized Markov chain have smaller variances than those provided by the original Markov process, which are increasing functions of the uniformization parameter and thus have minimal solutions
Keywords :
Markov processes; matrix algebra; perturbation techniques; probability; sensitivity analysis; Markov chains; Markov processes; perturbation; probability matrix; sensitivity analysis; single sample path; uniformization; Analytical models; Markov processes; Mathematics; Particle measurements; Performance analysis; Sensitivity analysis; State estimation; State-space methods; Stochastic processes; Uncertainty;
fLanguage :
English
Journal_Title :
Automatic Control, IEEE Transactions on
Publisher :
ieee
ISSN :
0018-9286
Type :
jour
DOI :
10.1109/9.754837
Filename :
754837
Link To Document :
بازگشت