Title :
Concurrent learning-based approximate feedback-Nash equilibrium solution of N-player nonzero-sum differential games
Author :
Kamalapurkar, Rushikesh ; Klotz, Justin R. ; Dixon, Warren E.
Author_Institution :
Dept. of Mech. & Aerosp. Eng., Univ. of Florida, Gainesville, FL, USA
Abstract :
This paper presents a concurrent learning-based actor-critic-identifier architecture to obtain an approximate feedback-Nash equilibrium solution to an infinite horizon N-player nonzero-sum differential game. The solution is obtained online for a nonlinear control-affine system with uncertain linearly parameterized drift dynamics. It is shown that under a condition milder than persistence of excitation (PE), uniformly ultimately bounded convergence of the developed control policies to the feedback-Nash equilibrium policies can be established. Simulation results are presented to demonstrate the performance of the developed technique without an added excitation signal.
Keywords :
differential games; feedback; learning systems; nonlinear control systems; uncertain systems; PE; concurrent learning-based actor-critic-identifier architecture; concurrent learning-based approximate feedback-Nash equilibrium solution; infinite horizon N-player nonzero-sum differential game; nonlinear control-affine system; persistence of excitation; uncertain linearly parameterized drift dynamics; uniformly ultimately bounded convergence; Convergence; Function approximation; Games; Learning (artificial intelligence); Stability analysis; Trajectory; Nonlinear system; data driven control; dynamic programming; optimal adaptive control;
Journal_Title :
Automatica Sinica, IEEE/CAA Journal of
DOI :
10.1109/JAS.2014.7004681