DocumentCode :
1661834
Title :
Stationary solutions of stochastic recursions describing discrete event systems
Author :
Anantharam, Venkat ; Konstantopoulos, Takis
Author_Institution :
Dept. of Electr. Eng. & Comput. Sci., California Univ., Berkeley, CA, USA
Volume :
2
fYear :
1994
Firstpage :
1481
Abstract :
We consider recursions of the form xn+1n [xn], where {φn, n⩾0} is a stationary ergodic sequence of maps from a Polish space (E, ε) into itself, and {xn, n⩾0} are random variables taking values in (E, ε). The question of when stationary solutions exist for such recursions, whether they are unique, and whether there is convergence to a stationary solution starting from arbitrary initial conditions is of considerable interest in discrete event system applications. Currently available techniques can only answer such questions under strong simplifying assumptions on the statistics of {φn}n, (such as Markov assumptions), or on the nature of these maps (such as monotonicity), In this paper we introduce a new technique for studying stochastic recursions without such simplifying assumptions. To do so, we weaken the solution concept: rather than constructing a pathwise solution we construct a probability measure on another sample space and families of random variables on this space whose law gives a stationary solution to the recursion. The problem of existence of a stationary solution is then translated into the problem of establishing tightness of a sequence of probability distributions, and uniqueness questions can be addressed using techniques familiar from the ergodic theory of positive Markov operators on spaces of continuous functions
Keywords :
discrete event systems; probability; stochastic systems; Polish space; continuous function spaces; convergence; discrete event systems; ergodic theory; positive Markov operators; probability distribution sequence tightness; stationary ergodic map sequence; stationary solution; stochastic recursions; uniqueness; Algebra; Discrete event systems; Extraterrestrial measurements; Probability distribution; Random variables; Space stations; Stability; Statistics; Stochastic processes; Stochastic systems;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Decision and Control, 1994., Proceedings of the 33rd IEEE Conference on
Conference_Location :
Lake Buena Vista, FL
Print_ISBN :
0-7803-1968-0
Type :
conf
DOI :
10.1109/CDC.1994.411237
Filename :
411237
Link To Document :
بازگشت