Title :
Hamiltonian dynamical systems for convex problems of optimal control: implications for the value function
Author_Institution :
Dept. of Electr. & Comput. Eng., California Univ., Santa Barbara, CA, USA
Abstract :
For fully convex problems of optimal control, the Hamiltonian dynamical system provides a global description of evolution of the subdifferentials of the value function from those of the initial cost. We employ this description and the convex structure of the problem to investigate the differentiability properties of the value function. Motivation is provided by questions of regularity of optimal feedback, the key ingredients of which the the value function, and by the fact that the Hamiltonian may lead to a reasonable dynamical system, even if the underlying control problem involves various constraints and penalties.
Keywords :
feedback; functions; optimal control; Hamiltonian dynamical systems; convex problems; differentiability properties; global description; optimal control; optimal feedback; regularity; value function; Control engineering; Control engineering computing; Control system analysis; Control systems; Cost function; Electric shock; Equations; Fuzzy control; Optimal control; State feedback;
Conference_Titel :
Decision and Control, 2002, Proceedings of the 41st IEEE Conference on
Print_ISBN :
0-7803-7516-5
DOI :
10.1109/CDC.2002.1184591