• DocumentCode
    391236
  • Title

    On weak conditions and optimality inequality solutions in risk-sensitive controlled Markov processes with average criterion

  • Author

    Brau-Rojas, Agustin ; Fernández-Gaucherand, Emmanuel

  • Author_Institution
    Departamento de Matematicas, Sonora Univ., Mexico
  • Volume
    2
  • fYear
    2002
  • fDate
    10-13 Dec. 2002
  • Firstpage
    1375
  • Abstract
    A standard approach to the problem of finding optimal policies for controlled Markov processes with average cost is based on the existence of solutions to an average optimality equation, or an average optimality inequality (Cavazos-Cadena and Sennott (1992), Sennott (1999)). In the latter, conditions are imposed on the solutions to the inequalities such that if one such solution is found, then optimal policies are obtained for all values of the state. In Hernandez-Lerma and Lasserre, (1994), such conditions are relaxed, at the expense that perhaps optimal policies are characterized for only a proper subset of the state space. Motivated by the work in Hernandez-Lerma and Lasserre, optimality inequality results were presented in Hernandez-Hernandez and Marcus, (1999), for the risk-sensitive case, purposely trying to emulate in the risk-sensitive case what had been done previously for the risk-neutral case. However, as it is illustrated in the sequel, the results in Hernandez-Hernandez and Marcus exhibit an acute fragility not present in their risk- counterparts.
  • Keywords
    Markov processes; state-space methods; average optimality equation; controlled Markov chain; controlled Markov processes; discrete-time; risk-; Computer science; Cost function; Equations; Kernel; Markov processes; Measurement standards; Optimal control; Performance analysis; Process control; State-space methods;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Decision and Control, 2002, Proceedings of the 41st IEEE Conference on
  • ISSN
    0191-2216
  • Print_ISBN
    0-7803-7516-5
  • Type

    conf

  • DOI
    10.1109/CDC.2002.1184709
  • Filename
    1184709