• DocumentCode
    2584217
  • Title

    Improving reinforcement learning using temporal-difference network EUROCON2009

  • Author

    Karbasian, Habib ; Ahmadabadi, Majid N. ; Araabi, Babak N.

  • Author_Institution
    Control & Intell. Process. Center of Excellence, Univ. of Tehran, Tehran, Iran
  • fYear
    2009
  • fDate
    18-23 May 2009
  • Firstpage
    1716
  • Lastpage
    1722
  • Abstract
    Reinforcement learning has been one of popular learning methods for many problems in many different domains. The important point for this method is how fast and efficient it is to learn a new problem. In this paper, we present a new approach to increase the efficiency of the reinforcement learning method with the great help of a predictive model of the problem´s environment called temporal-difference network along with observation. This TD network is nourished with the knowledge extracted from another problem with the same task using TD network. First a reinforcement-learning agent tries to learn its environment for the task of wall following. After that we train temporal-difference network (TDN) with intervening observation in the brain of the agent in order to gain a predictive model of the environment. Later the most promising sequences of action-observation of the given environment will be extracted as knowledge to strengthen the reinforcement learning problem in a new environment. Finally this knowledge helps the reinforcement procedure to produce more efficient results.
  • Keywords
    Markov processes; decision theory; intelligent robots; knowledge acquisition; learning (artificial intelligence); learning systems; mobile robots; predictive control; POMDP; TD network; knowledge extraction; partially observable Markov decision process; predictive model; reinforcement learning agent method; robot wall-following; temporal-difference network; Intelligent agent; Intelligent control; Intelligent robots; Intelligent sensors; Learning systems; Mathematics; Physics computing; Predictive models; Process control; Robot sensing systems; Concept; MDP; POMDP; Reinforcement Learning; Temporal-Difference Network;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    EUROCON 2009, EUROCON '09. IEEE
  • Conference_Location
    St.-Petersburg
  • Print_ISBN
    978-1-4244-3860-0
  • Electronic_ISBN
    978-1-4244-3861-7
  • Type

    conf

  • DOI
    10.1109/EURCON.2009.5167875
  • Filename
    5167875