• DocumentCode
    1434297
  • Title

    Markov decision processes and regular events

  • Author

    Courcoubetis, Costas ; Yannakakis, Mihalis

  • Author_Institution
    Dept. of Comput. Sci., Crete Univ., Heraklion, Greece
  • Volume
    43
  • Issue
    10
  • fYear
    1998
  • fDate
    10/1/1998 12:00:00 AM
  • Firstpage
    1399
  • Lastpage
    1418
  • Abstract
    Desirable properties of the infinite histories of a finite-state Markov decision process are specified in terms of a finite number of events represented as ω-regular sets. An infinite history of the process produces a reward which depends on the properties it satisfies. The authors investigate the existence of optimal policies and provide algorithms for the construction of such policies
  • Keywords
    Markov processes; computational complexity; decision theory; discrete event systems; finite automata; formal languages; ω-regular sets; finite-state Markov decision processes; optimal policies; regular events; Automata; Computer science; Control systems; Cost function; Discrete event systems; Dynamic programming; History; Polynomials; Time measurement;
  • fLanguage
    English
  • Journal_Title
    Automatic Control, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9286
  • Type

    jour

  • DOI
    10.1109/9.720497
  • Filename
    720497
    • Link To Document
    https://search.isc.ac/dl/search/defaultta.aspx?DTC=49&DC=1434297