Title :
Variational inequalities for the optimal stopping with continuous control of piecewise deterministic Markov processes
Author :
Costa, O.L.V. ; Raymundo, C.A.B. ; Dufour, F.
Author_Institution :
Dept. of Electron. Eng., Sao Paulo Univ., Brazil
Abstract :
We consider the problem of optimal stopping and continuous control on some local parameters of a piecewise-deterministic Markov processes (PDPs). Optimality equations are obtained in terms of the infinitesimal operator as well as on the first jump time operator of the PDP. It is shown that if the final cost function is absolutely continuous along trajectories then so is the value function of the optimal stopping problem with continuous control. These results unify and generalize previous ones in the current literature
Keywords :
Markov processes; continuous time systems; optimal control; variational techniques; continuous control; infinitesimal operator; optimal stopping; piecewise deterministic Markov processes; variational inequality; Cost function; Equations; Fluid flow measurement; Markov processes; Motion measurement; Operations research; Optimal control; Q measurement; State-space methods; Stochastic processes;
Conference_Titel :
American Control Conference, 1999. Proceedings of the 1999
Conference_Location :
San Diego, CA
Print_ISBN :
0-7803-4990-3
DOI :
10.1109/ACC.1999.786579