DocumentCode
631048
Title
Dynamic programming with non-convex risk-sensitive measures
Author
Kun Lin ; Marcus, Steven I.
Author_Institution
Dept. of Electr. & Comput. Eng., Inst. for Syst. Res., Univ. of Maryland, College Park, MD, USA
fYear
2013
fDate
17-19 June 2013
Firstpage
6778
Lastpage
6783
Abstract
Dynamic programming with risk-sensitive performance criteria has applications in many fields (e.g., operations research, finance, control systems). Historically, risk-sensitive performance criteria have been represented using expected utility functions. More recently, literature on dynamic performance (i.e., risk or reward) measures has inspired an alternative approach to risk-sensitive performance evaluation. The dynamic performance measure approach is a generalization of the classical work using expected value. One drawback of this approach is that it has only been developed with convex/coherent performance measures, which exclude a large class of important non-convex performance criteria (e.g., Cumulative Prospect Theory (CPT)). We remedy this drawback by proving the existence of dynamic programming equations for non-convex performance criteria.
Keywords
concave programming; dynamic programming; risk management; utility theory; CPT; coherent performance measures; convex performance measures; cumulative prospect theory; dynamic programming equations; expected utility functions; nonconvex risk-sensitive measures; risk-sensitive performance criteria; risk-sensitive performance evaluation; Aerospace electronics; Current measurement; Dynamic programming; Equations; Markov processes; Mathematical model; Random variables; Dynamic Programming; Markov Decision Processes (MDP); Non-Convex; Risk-Sensitive;
fLanguage
English
Publisher
ieee
Conference_Titel
American Control Conference (ACC), 2013
Conference_Location
Washington, DC
ISSN
0743-1619
Print_ISBN
978-1-4799-0177-7
Type
conf
DOI
10.1109/ACC.2013.6580904
Filename
6580904
Link To Document