DocumentCode :
11173
Title :
Decentralized Stabilization for a Class of Continuous-Time Nonlinear Interconnected Systems Using Online Learning Optimal Control Approach
Author :
Derong Liu ; Ding Wang ; Hongliang Li
Author_Institution :
State Key Lab. of Manage. & Control for Complex Syst., Inst. of Autom., Beijing, China
Volume :
25
Issue :
2
fYear :
2014
fDate :
Feb. 2014
Firstpage :
418
Lastpage :
428
Abstract :
In this paper, using a neural-network-based online learning optimal control approach, a novel decentralized control strategy is developed to stabilize a class of continuous-time nonlinear interconnected large-scale systems. First, optimal controllers of the isolated subsystems are designed with cost functions reflecting the bounds of interconnections. Then, it is proven that the decentralized control strategy of the overall system can be established by adding appropriate feedback gains to the optimal control policies of the isolated subsystems. Next, an online policy iteration algorithm is presented to solve the Hamilton-Jacobi-Bellman equations related to the optimal control problem. Through constructing a set of critic neural networks, the cost functions can be obtained approximately, followed by the control policies. Furthermore, the dynamics of the estimation errors of the critic networks are verified to be uniformly and ultimately bounded. Finally, a simulation example is provided to illustrate the effectiveness of the present decentralized control scheme.
Keywords :
adaptive control; approximation theory; continuous time systems; control system synthesis; decentralised control; dynamic programming; feedback; interconnected systems; iterative methods; learning systems; neurocontrollers; nonlinear control systems; optimal control; partial differential equations; stability; Hamilton-Jacobi-Bellman equations; adaptive dynamic programming; continuous-time nonlinear interconnected systems; decentralized control strategy; decentralized stabilization; feedback gains; isolated subsystems; neural-network-based online learning optimal control approach; online policy iteration algorithm; optimal control policies; Cost function; Decentralized control; Equations; Heuristic algorithms; Interconnected systems; Large-scale systems; Optimal control; Adaptive dynamic programming; decentralized control; large-scale systems; neural networks; nonlinear interconnected systems; optimal control; policy iteration; reinforcement learning;
fLanguage :
English
Journal_Title :
Neural Networks and Learning Systems, IEEE Transactions on
Publisher :
ieee
ISSN :
2162-237X
Type :
jour
DOI :
10.1109/TNNLS.2013.2280013
Filename :
6600960
Link To Document :
بازگشت