Title of article :
The vanishing discount approach to constrained continuous-time controlled Markov chains
Author/Authors :
Prieto-Rumeau، نويسنده , , Tomلs and Hernلndez-Lerma، نويسنده , , Onésimo، نويسنده ,
Issue Information :
ماهنامه با شماره پیاپی سال 2010
Pages :
6
From page :
504
To page :
509
Abstract :
We consider a denumerable state continuous-time controlled Markov chain (CMC) with possibly unbounded transition and reward rates. We deal with constrained optimality; that is, we want to maximize a discounted reward (an average reward) criterion subject to a constraint on a discounted cost (an average cost). We give conditions ensuring that the average constrained optimal reward and policies can be obtained as the limit, as the discount rate vanishes, of the corresponding discounted constrained optimal reward and policies. This extends to average constrained CMCs the standard results on the vanishing discount approach for the average unconstrained case. We also present an example showing that the vanishing discount results for constrained problems might not hold.
Keywords :
Continuous-time controlled Markov chains (CMCs) , Vanishing discount approach , Constrained control models
Journal title :
Systems and Control Letters
Serial Year :
2010
Journal title :
Systems and Control Letters
Record number :
1675524
Link To Document :
بازگشت