DocumentCode
391236
Title
On weak conditions and optimality inequality solutions in risk-sensitive controlled Markov processes with average criterion
Author
Brau-Rojas, Agustin ; Fernández-Gaucherand, Emmanuel
Author_Institution
Departamento de Matematicas, Sonora Univ., Mexico
Volume
2
fYear
2002
fDate
10-13 Dec. 2002
Firstpage
1375
Abstract
A standard approach to the problem of finding optimal policies for controlled Markov processes with average cost is based on the existence of solutions to an average optimality equation, or an average optimality inequality (Cavazos-Cadena and Sennott (1992), Sennott (1999)). In the latter, conditions are imposed on the solutions to the inequalities such that if one such solution is found, then optimal policies are obtained for all values of the state. In Hernandez-Lerma and Lasserre, (1994), such conditions are relaxed, at the expense that perhaps optimal policies are characterized for only a proper subset of the state space. Motivated by the work in Hernandez-Lerma and Lasserre, optimality inequality results were presented in Hernandez-Hernandez and Marcus, (1999), for the risk-sensitive case, purposely trying to emulate in the risk-sensitive case what had been done previously for the risk-neutral case. However, as it is illustrated in the sequel, the results in Hernandez-Hernandez and Marcus exhibit an acute fragility not present in their risk- counterparts.
Keywords
Markov processes; state-space methods; average optimality equation; controlled Markov chain; controlled Markov processes; discrete-time; risk-; Computer science; Cost function; Equations; Kernel; Markov processes; Measurement standards; Optimal control; Performance analysis; Process control; State-space methods;
fLanguage
English
Publisher
ieee
Conference_Titel
Decision and Control, 2002, Proceedings of the 41st IEEE Conference on
ISSN
0191-2216
Print_ISBN
0-7803-7516-5
Type
conf
DOI
10.1109/CDC.2002.1184709
Filename
1184709
Link To Document