Title :
Optimal control for stochastic discrete-time systems with multiple input-delays
Author :
Wang, Hongxia ; Zhang, Huanshui ; Wang, Xuan
Author_Institution :
Shenzhen Grad. Sch., Shenzhen Univ., Xili, China
Abstract :
The main purpose of the paper is to settle the stochastic linear quadratic control problem for systems with multiple input-delays (SDLQ) which is very intractable and remains to be solved. We introduce a different version of stochastic discrete-time maximum principle (SDMP) where it is shown that the auxiliary variable depends on the optimal system state through a stochastic matrix and the expectation of the relationship matrix happens to be the solution to the standard generalized Riccati equation with the same dimension as the origin system. The relationship explores the key difference of stochastic LQ from the deterministic one. It enables us to obtain the kernel of the optimal cost function for stochastic control and further the analytical and explicit solution to the stochastic LQ control problem with multiple input-delays.
Keywords :
Riccati equations; delays; discrete time systems; linear quadratic control; matrix algebra; maximum principle; stochastic systems; SDLQ; SDMP; auxiliary variable; multiple input-delays; optimal control; optimal cost function; optimal system state; relationship matrix; standard generalized Riccati equation; stochastic LQ control problem; stochastic discrete time maximum principle; stochastic discrete time systems; stochastic linear quadratic control problem; stochastic matrix; Cost function; Delay; Educational institutions; Kernel; Optimal control; Riccati equations; Stochastic systems; Generalized Riccati equation; Maximum principle; Multiple input-delays; Optimal control; Stochastic system;
Conference_Titel :
Intelligent Control and Automation (WCICA), 2012 10th World Congress on
Conference_Location :
Beijing
Print_ISBN :
978-1-4673-1397-1
DOI :
10.1109/WCICA.2012.6358121