• DocumentCode
    3476612
  • Title

    Reinforcement learning for the soccer dribbling task

  • Author

    Carvalho, Adriano ; Oliveira, Renato

  • Author_Institution
    David Cheriton Sch. of Comput. Sci., Univ. of Waterloo, Waterloo, ON, Canada
  • fYear
    2011
  • fDate
    Aug. 31 2011-Sept. 3 2011
  • Firstpage
    95
  • Lastpage
    101
  • Abstract
    We propose a reinforcement learning solution to the soccer dribbling task, a scenario in which a soccer agent has to go from the beginning to the end of a region keeping possession of the ball, as an adversary attempts to gain possession. While the adversary uses a stationary policy, the dribbler learns the best action to take at each decision point. After defining meaningful variables to represent the state space, and high-level macro-actions to incorporate domain knowledge, we describe our application of the reinforcement learning algorithm Sarsa with CMAC for function approximation. Our experiments show that, after the training period, the dribbler is able to accomplish its task against a strong adversary around 58% of the time.
  • Keywords
    cerebellar model arithmetic computers; function approximation; learning (artificial intelligence); multi-robot systems; sport; CMAC; Sarsa; function approximation; reinforcement learning algorithm; soccer agent; soccer dribbling task; stationary policy; Approximation algorithms; Computational intelligence; Equations; Function approximation; Games; Learning; Training;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Computational Intelligence and Games (CIG), 2011 IEEE Conference on
  • Conference_Location
    Seoul
  • Print_ISBN
    978-1-4577-0010-1
  • Electronic_ISBN
    978-1-4577-0009-5
  • Type

    conf

  • DOI
    10.1109/CIG.2011.6031994
  • Filename
    6031994