• DocumentCode
    3157453
  • Title

    Reinforcement learning-based robust adaptive tracking control for multi-wheeled mobile robots synchronization with optimality

  • Author

    Nguyen Tan Luy ; Nguyen Thien Thanh ; Hoang Minh Tri

  • Author_Institution
    HCM City Univ. of Ind., Ho Chi Minh City, Vietnam
  • fYear
    2013
  • fDate
    16-19 April 2013
  • Firstpage
    74
  • Lastpage
    81
  • Abstract
    This paper proposes a new method based on reinforcement learning to design robust adaptive tracking control laws with optimality for multi-wheeled mobile robots synchronization in communication graph without requiring knowledge of drift tracking terms in node dynamics. Wheeled mobile robots are controlled by integrated kinematic and dynamic laws. Actor critic structures in the control scheme for every node is proposed such as only single NN is used to reduce computational cost and storage resources, but parameters of critic and actors are updated synchronously. Novel tuning laws for the NNs are designed not only to learn online adaptive solutions of cooperative Hamilton-Jacobi-Isaacs (HJI) equation on purpose of approximating optimal cooperative tracking performance index functions and robust direct adaptive tracking control inputs as well as worst case disturbances but also to guarantee closed-loop stability in real-time. The convergence and stability of the overall system are proven by Lyapunov techniques. The simulation results on multi-wheeled mobile robots systems verify the effectiveness of the proposed controller.
  • Keywords
    Lyapunov methods; adaptive control; closed loop systems; computational complexity; control engineering computing; control system synthesis; cooperative systems; graph theory; learning (artificial intelligence); mobile robots; multi-robot systems; robot dynamics; robot kinematics; robust control; stability; synchronisation; HJI equation; Lyapunov techniques; NN; actor critic structures; communication graph; computational cost reduction; convergence; cooperative HamiltonJacobi-Isaacs equation; cooperative wheeled mobile robots; integrated kinematic-dynamic laws; multiwheeled mobile robots synchronization; optimal cooperative tracking performance index functions; real-time closed-loop stability; reinforcement learning; robust adaptive tracking control law design; robust direct adaptive tracking control inputs; storage resource reduction; tuning laws; worst case disturbances; Equations; Heuristic algorithms; Mobile robots; Robustness; Synchronization; Vectors; Cooperative Hamilton-Jacobi-Isaacs equations; Robust direct adaptive control; Wheeled mobile robot system;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Robotic Intelligence In Informationally Structured Space (RiiSS), 2013 IEEE Workshop on
  • Conference_Location
    Singapore
  • Type

    conf

  • DOI
    10.1109/RiiSS.2013.6607932
  • Filename
    6607932