• DocumentCode
    3572789
  • Title

    Finite horizon semi-Markov decision processes with multiple constraints

  • Author

    Yonghui Huang

  • Author_Institution
    Sch. of Math. & Comput. Sci., Sun Yat-Sen Univ., Guangzhou, China
  • fYear
    2014
  • Firstpage
    1761
  • Lastpage
    1768
  • Abstract
    This paper focuses on solving a finite horizon semi-Markov decision process with multiple constraints. We convert the problem to a constrained absorbing discrete-time Markov decision process and then to an equivalent linear program over a class of occupancy measures. The existence, characterization and computation of constrained-optimal policies are established under suitable conditions. An example is given to demonstrate our results.
  • Keywords
    Markov processes; constraint theory; decision theory; linear programming; constrained absorbing discrete-time Markov decision process; finite horizon semiMarkov decision processes; linear program; multiple constraints; occupancy measures; Markov processes; Semi-Markov decision processes; constrained-optimal policy; expected finite horizon reward; linear programm; occupancy measure;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Intelligent Control and Automation (WCICA), 2014 11th World Congress on
  • Type

    conf

  • DOI
    10.1109/WCICA.2014.7052987
  • Filename
    7052987