• DocumentCode
    1661834
  • Title

    Stationary solutions of stochastic recursions describing discrete event systems

  • Author

    Anantharam, Venkat ; Konstantopoulos, Takis

  • Author_Institution
    Dept. of Electr. Eng. & Comput. Sci., California Univ., Berkeley, CA, USA
  • Volume
    2
  • fYear
    1994
  • Firstpage
    1481
  • Abstract
    We consider recursions of the form xn+1n [xn], where {φn, n⩾0} is a stationary ergodic sequence of maps from a Polish space (E, ε) into itself, and {xn, n⩾0} are random variables taking values in (E, ε). The question of when stationary solutions exist for such recursions, whether they are unique, and whether there is convergence to a stationary solution starting from arbitrary initial conditions is of considerable interest in discrete event system applications. Currently available techniques can only answer such questions under strong simplifying assumptions on the statistics of {φn}n, (such as Markov assumptions), or on the nature of these maps (such as monotonicity), In this paper we introduce a new technique for studying stochastic recursions without such simplifying assumptions. To do so, we weaken the solution concept: rather than constructing a pathwise solution we construct a probability measure on another sample space and families of random variables on this space whose law gives a stationary solution to the recursion. The problem of existence of a stationary solution is then translated into the problem of establishing tightness of a sequence of probability distributions, and uniqueness questions can be addressed using techniques familiar from the ergodic theory of positive Markov operators on spaces of continuous functions
  • Keywords
    discrete event systems; probability; stochastic systems; Polish space; continuous function spaces; convergence; discrete event systems; ergodic theory; positive Markov operators; probability distribution sequence tightness; stationary ergodic map sequence; stationary solution; stochastic recursions; uniqueness; Algebra; Discrete event systems; Extraterrestrial measurements; Probability distribution; Random variables; Space stations; Stability; Statistics; Stochastic processes; Stochastic systems;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Decision and Control, 1994., Proceedings of the 33rd IEEE Conference on
  • Conference_Location
    Lake Buena Vista, FL
  • Print_ISBN
    0-7803-1968-0
  • Type

    conf

  • DOI
    10.1109/CDC.1994.411237
  • Filename
    411237