• DocumentCode
    2976978
  • Title

    The Pong game implementation with the FRIQ-learning reinforcement learning algorithm

  • Author

    Tompa, Tamas ; Vincze, David ; Kovacs, Szilveszter

  • Author_Institution
    Dept. of Inf. Technol., Univ. of Miskolc, Miskolc, Hungary
  • fYear
    2015
  • fDate
    27-30 May 2015
  • Firstpage
    542
  • Lastpage
    547
  • Abstract
    This paper introduces a way to control the Pong game automatically with the usage of FRIQ-learning (Fuzzy Rule Interpolation-based Q-learning). The FRIQ-learning method can be a solution to such a problem which has a small state-space. The system starts with an empty knowledge base and the system constructs the final rule-base during the simulation, based on a reward used to solve the task. This way the method can find the required rules using the feedback provided by the environment. To correctly solve the problem the reward-function should be carefully defined for the corresponding problem (handling of the paddle in the Pong game in this case). After determining the required specifications (e.g. the actions and the effects of the actions) we used the FRIQ-learning framework to build a simulation application. FRIQ-learning can gather the required knowledge automatically in the form of a fuzzy rule-base, therefore it can be applied to such a system where the process of the exact operation is unknown. Our main goal is to show that the FRIQ-learning method is suitable to solve this problem by automatically constructing a sparse rule-base for Pong.
  • Keywords
    computer games; fuzzy set theory; interpolation; knowledge based systems; learning (artificial intelligence); FRIQ-learning; Pong game; fuzzy rule interpolation-based Q-learning; fuzzy rule-base; knowledge base; reinforcement learning algorithm; reward-function; simulation application; sparse rule-base; state-space; Games; Learning (artificial intelligence); MATLAB; Programmable logic arrays; FRIQ-learning; Pong; Q-learning; fuzzy rule-interpolation; reinforcement learning;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Carpathian Control Conference (ICCC), 2015 16th International
  • Conference_Location
    Szilvasvarad
  • Print_ISBN
    978-1-4799-7369-9
  • Type

    conf

  • DOI
    10.1109/CarpathianCC.2015.7145139
  • Filename
    7145139