• DocumentCode
    1694613
  • Title

    Stability of piecewise-deterministic Markov processes

  • Author

    Dufour, F. ; Costa, O.L.V.

  • Author_Institution
    Lab. des Signaux et Syst., CNRS, Gif-sur-Yvette, France
  • Volume
    4
  • fYear
    1999
  • fDate
    6/21/1905 12:00:00 AM
  • Firstpage
    3174
  • Abstract
    We study a form of stability for a general family of non-diffusion Markov processes, known in the literature as piecewise-deterministic Markov process (PDMP). By stability here we mean the existence of an invariant probability measure for the PDMP. It is shown that the existence of such invariant probability measure is equivalent to the existence of a σ-finite invariant measure for a Markov kernel G linked to the resolvent operator U of the PDMP, satisfying a boundedness condition or, equivalently, a Radon-Nikodym derivative. Here we generalize existing results of the literature since we do not require any additional assumptions to establish this equivalence. Moreover, we give sufficient conditions to ensure the existence of such σ-finite measure satisfying the boundedness condition. They are mainly based on a modified Foster-Lyapunov criteria for the case in which the Markov chain generated by G is either recurrent or weak Feller. To emphasize the relevance of our results, three examples are studied in Dufour and Costa (1999) and in particular, we are able to generalize the results obtained by Costa (1990) and Davis (1993) on the capacity expansion model
  • Keywords
    Markov processes; probability; stability; Markov kernel; Radon-Nikodym derivative; boundedness condition; capacity expansion model; invariant probability measure; modified Foster-Lyapunov criteria; nondiffusion Markov processes; piecewise-deterministic Markov processes; resolvent operator; sufficient conditions; Councils; Equations; Kernel; Markov processes; Motion measurement; Stability analysis; State-space methods; Stochastic processes; Sufficient conditions; Time measurement;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Decision and Control, 1999. Proceedings of the 38th IEEE Conference on
  • Conference_Location
    Phoenix, AZ
  • ISSN
    0191-2216
  • Print_ISBN
    0-7803-5250-5
  • Type

    conf

  • DOI
    10.1109/CDC.1999.827755
  • Filename
    827755