Title :
Indefinite stochastic linear quadratic controls in infinite time horizon
Author :
Rami, Mustapha Ait ; Zhou, Xun Yu
Author_Institution :
Dept. of Syst. Eng. & Eng. Manage., Chinese Univ. of Hong Kong, Shatin, Hong Kong
fDate :
6/21/1905 12:00:00 AM
Abstract :
This paper is concerned with an optimal stochastic linear-quadratic (LQ) control problem in an infinite time horizon, where the diffusion term in dynamics depends on both the state and control variables. In contrast to the deterministic case, we allow the control and state weighting matrices in the cost functional to be indefinite. This leads to an indefinite LQ problem which may still be well-posed due to the deep nature of uncertainty involved. The problem gives rise to a generalized algebraic Riccati equation (GARE), which is however fundamentally different from the classical algebraic Riccati equation as a result of the indefiniteness of the LQ problem. To analyze the GARE, we introduce linear matrix inequalities (LMIs) whose feasibility is shown to be equivalent to the solvability of the GARE. Moreover, we develop a computational approach to the GARE via a semidefinite programming associated with the LMIs
Keywords :
Riccati equations; linear quadratic control; matrix algebra; optimal control; stochastic systems; control variables; cost functional; diffusion term; generalized algebraic Riccati equation; indefinite LQ problem; indefinite stochastic linear quadratic controls; infinite time horizon; linear matrix inequalities; mean-square stability; optimal stochastic linear-quadratic control problem; semidefinite programming; solvability; state variables; uncertainty; Control systems; Cost function; Differential algebraic equations; Linear matrix inequalities; Optimal control; Riccati equations; Stochastic processes; Systems engineering and theory; Uncertainty; Weight control;
Conference_Titel :
Decision and Control, 1999. Proceedings of the 38th IEEE Conference on
Conference_Location :
Phoenix, AZ
Print_ISBN :
0-7803-5250-5
DOI :
10.1109/CDC.1999.830186