DocumentCode
1694613
Title
Stability of piecewise-deterministic Markov processes
Author
Dufour, F. ; Costa, O.L.V.
Author_Institution
Lab. des Signaux et Syst., CNRS, Gif-sur-Yvette, France
Volume
4
fYear
1999
fDate
6/21/1905 12:00:00 AM
Firstpage
3174
Abstract
We study a form of stability for a general family of non-diffusion Markov processes, known in the literature as piecewise-deterministic Markov process (PDMP). By stability here we mean the existence of an invariant probability measure for the PDMP. It is shown that the existence of such invariant probability measure is equivalent to the existence of a σ-finite invariant measure for a Markov kernel G linked to the resolvent operator U of the PDMP, satisfying a boundedness condition or, equivalently, a Radon-Nikodym derivative. Here we generalize existing results of the literature since we do not require any additional assumptions to establish this equivalence. Moreover, we give sufficient conditions to ensure the existence of such σ-finite measure satisfying the boundedness condition. They are mainly based on a modified Foster-Lyapunov criteria for the case in which the Markov chain generated by G is either recurrent or weak Feller. To emphasize the relevance of our results, three examples are studied in Dufour and Costa (1999) and in particular, we are able to generalize the results obtained by Costa (1990) and Davis (1993) on the capacity expansion model
Keywords
Markov processes; probability; stability; Markov kernel; Radon-Nikodym derivative; boundedness condition; capacity expansion model; invariant probability measure; modified Foster-Lyapunov criteria; nondiffusion Markov processes; piecewise-deterministic Markov processes; resolvent operator; sufficient conditions; Councils; Equations; Kernel; Markov processes; Motion measurement; Stability analysis; State-space methods; Stochastic processes; Sufficient conditions; Time measurement;
fLanguage
English
Publisher
ieee
Conference_Titel
Decision and Control, 1999. Proceedings of the 38th IEEE Conference on
Conference_Location
Phoenix, AZ
ISSN
0191-2216
Print_ISBN
0-7803-5250-5
Type
conf
DOI
10.1109/CDC.1999.827755
Filename
827755
Link To Document