Title :
Adaptive Dynamic Programming for a Class of Complex-Valued Nonlinear Systems
Author :
Ruizhuo Song ; Wendong Xiao ; Huaguang Zhang ; Changyin Sun
Author_Institution :
Sch. of Autom. & Electr. Eng., Univ. of Sci. & Technol. Beijing, Beijing, China
Abstract :
In this brief, an optimal control scheme based on adaptive dynamic programming (ADP) is developed to solve infinite-horizon optimal control problems of continuous-time complex-valued nonlinear systems. A new performance index function is established on the basis of complex-valued state and control. Using system transformations, the complex-valued system is transformed into a real-valued one, which overcomes Cauchy-Riemann conditions effectively. With the transformed system and the performance index function, a new ADP method is developed to obtain the optimal control law by using neural networks. A compensation controller is developed to compensate the approximation errors of neural networks. Stability properties of the nonlinear system are analyzed and convergence properties of the weights for neural networks are presented. Finally, simulation results demonstrate the performance of the developed optimal control scheme for complex-valued nonlinear systems.
Keywords :
approximation theory; continuous time systems; control system synthesis; convergence of numerical methods; dynamic programming; error compensation; infinite horizon; large-scale systems; neurocontrollers; nonlinear control systems; optimal control; performance index; stability; ADP method; Cauchy-Riemann conditions; adaptive dynamic programming; approximation error compensation; compensation controller development; complex-valued control; complex-valued state; continuous-time complex-valued nonlinear systems; convergence properties; infinite-horizon optimal control problems; neural network weights; optimal control law; performance index function; real-valued system; stability properties; system transformations; Approximation error; Dynamic programming; Learning systems; Neural networks; Nonlinear systems; Optimal control; Performance analysis; Adaptive critic designs; adaptive dynamic programming (ADP); approximate complex-valued systems; dynamic programming; neural networks; neural networks.; optimal control;
Journal_Title :
Neural Networks and Learning Systems, IEEE Transactions on
DOI :
10.1109/TNNLS.2014.2306201