• DocumentCode
    631048
  • Title

    Dynamic programming with non-convex risk-sensitive measures

  • Author

    Kun Lin ; Marcus, Steven I.

  • Author_Institution
    Dept. of Electr. & Comput. Eng., Inst. for Syst. Res., Univ. of Maryland, College Park, MD, USA
  • fYear
    2013
  • fDate
    17-19 June 2013
  • Firstpage
    6778
  • Lastpage
    6783
  • Abstract
    Dynamic programming with risk-sensitive performance criteria has applications in many fields (e.g., operations research, finance, control systems). Historically, risk-sensitive performance criteria have been represented using expected utility functions. More recently, literature on dynamic performance (i.e., risk or reward) measures has inspired an alternative approach to risk-sensitive performance evaluation. The dynamic performance measure approach is a generalization of the classical work using expected value. One drawback of this approach is that it has only been developed with convex/coherent performance measures, which exclude a large class of important non-convex performance criteria (e.g., Cumulative Prospect Theory (CPT)). We remedy this drawback by proving the existence of dynamic programming equations for non-convex performance criteria.
  • Keywords
    concave programming; dynamic programming; risk management; utility theory; CPT; coherent performance measures; convex performance measures; cumulative prospect theory; dynamic programming equations; expected utility functions; nonconvex risk-sensitive measures; risk-sensitive performance criteria; risk-sensitive performance evaluation; Aerospace electronics; Current measurement; Dynamic programming; Equations; Markov processes; Mathematical model; Random variables; Dynamic Programming; Markov Decision Processes (MDP); Non-Convex; Risk-Sensitive;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    American Control Conference (ACC), 2013
  • Conference_Location
    Washington, DC
  • ISSN
    0743-1619
  • Print_ISBN
    978-1-4799-0177-7
  • Type

    conf

  • DOI
    10.1109/ACC.2013.6580904
  • Filename
    6580904