DocumentCode
933266
Title
Constrained Optimization for Average Cost Continuous-Time Markov Decision Processes
Author
Guo, Xianping
Author_Institution
Zhongshan Univ., Guangzhou
Volume
52
Issue
6
fYear
2007
fDate
6/1/2007 12:00:00 AM
Firstpage
1139
Lastpage
1143
Abstract
To the best of our knowledge, this note is a first study on a multiconstrained optimization problem for average cost continuous-time Markov decision processes in polish spaces. The optimality criterion is the long-run expected average cost, and the constraints are imposed on similar average costs. We give suitable conditions under which the existence of a constrained optimal stationary policy is shown by introducing occupation measures and using a martingale technique. Also, we illustrate our conditions with controlled Potlach processes.
Keywords
Markov processes; continuous time systems; optimal control; optimisation; Potlach processes; constrained optimal stationary policy; constrained optimization; continuous-time Markov decision processes; long-run expected average cost; multiconstrained optimization problem; optimality criterion; Communication system control; Constraint optimization; Constraint theory; Control system synthesis; Cost function; Optimal control; Process control; State-space methods; Stochastic processes; Systems engineering and theory; Average cost; constrained optimal stationary policy; general state space; martingale; occupation measure;
fLanguage
English
Journal_Title
Automatic Control, IEEE Transactions on
Publisher
ieee
ISSN
0018-9286
Type
jour
DOI
10.1109/TAC.2007.899040
Filename
4237305
Link To Document