• DocumentCode
    933266
  • Title

    Constrained Optimization for Average Cost Continuous-Time Markov Decision Processes

  • Author

    Guo, Xianping

  • Author_Institution
    Zhongshan Univ., Guangzhou
  • Volume
    52
  • Issue
    6
  • fYear
    2007
  • fDate
    6/1/2007 12:00:00 AM
  • Firstpage
    1139
  • Lastpage
    1143
  • Abstract
    To the best of our knowledge, this note is a first study on a multiconstrained optimization problem for average cost continuous-time Markov decision processes in polish spaces. The optimality criterion is the long-run expected average cost, and the constraints are imposed on similar average costs. We give suitable conditions under which the existence of a constrained optimal stationary policy is shown by introducing occupation measures and using a martingale technique. Also, we illustrate our conditions with controlled Potlach processes.
  • Keywords
    Markov processes; continuous time systems; optimal control; optimisation; Potlach processes; constrained optimal stationary policy; constrained optimization; continuous-time Markov decision processes; long-run expected average cost; multiconstrained optimization problem; optimality criterion; Communication system control; Constraint optimization; Constraint theory; Control system synthesis; Cost function; Optimal control; Process control; State-space methods; Stochastic processes; Systems engineering and theory; Average cost; constrained optimal stationary policy; general state space; martingale; occupation measure;
  • fLanguage
    English
  • Journal_Title
    Automatic Control, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9286
  • Type

    jour

  • DOI
    10.1109/TAC.2007.899040
  • Filename
    4237305