• DocumentCode
    11173
  • Title

    Decentralized Stabilization for a Class of Continuous-Time Nonlinear Interconnected Systems Using Online Learning Optimal Control Approach

  • Author

    Derong Liu ; Ding Wang ; Hongliang Li

  • Author_Institution
    State Key Lab. of Manage. & Control for Complex Syst., Inst. of Autom., Beijing, China
  • Volume
    25
  • Issue
    2
  • fYear
    2014
  • fDate
    Feb. 2014
  • Firstpage
    418
  • Lastpage
    428
  • Abstract
    In this paper, using a neural-network-based online learning optimal control approach, a novel decentralized control strategy is developed to stabilize a class of continuous-time nonlinear interconnected large-scale systems. First, optimal controllers of the isolated subsystems are designed with cost functions reflecting the bounds of interconnections. Then, it is proven that the decentralized control strategy of the overall system can be established by adding appropriate feedback gains to the optimal control policies of the isolated subsystems. Next, an online policy iteration algorithm is presented to solve the Hamilton-Jacobi-Bellman equations related to the optimal control problem. Through constructing a set of critic neural networks, the cost functions can be obtained approximately, followed by the control policies. Furthermore, the dynamics of the estimation errors of the critic networks are verified to be uniformly and ultimately bounded. Finally, a simulation example is provided to illustrate the effectiveness of the present decentralized control scheme.
  • Keywords
    adaptive control; approximation theory; continuous time systems; control system synthesis; decentralised control; dynamic programming; feedback; interconnected systems; iterative methods; learning systems; neurocontrollers; nonlinear control systems; optimal control; partial differential equations; stability; Hamilton-Jacobi-Bellman equations; adaptive dynamic programming; continuous-time nonlinear interconnected systems; decentralized control strategy; decentralized stabilization; feedback gains; isolated subsystems; neural-network-based online learning optimal control approach; online policy iteration algorithm; optimal control policies; Cost function; Decentralized control; Equations; Heuristic algorithms; Interconnected systems; Large-scale systems; Optimal control; Adaptive dynamic programming; decentralized control; large-scale systems; neural networks; nonlinear interconnected systems; optimal control; policy iteration; reinforcement learning;
  • fLanguage
    English
  • Journal_Title
    Neural Networks and Learning Systems, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    2162-237X
  • Type

    jour

  • DOI
    10.1109/TNNLS.2013.2280013
  • Filename
    6600960