• DocumentCode
    1831395
  • Title

    Improving the accomplishment of a neural network based agent for draughts that operates in a distributed learning environment

  • Author

    Tomaz, Lidia B. P. ; Julia, R.M.S. ; Barcelos, Ayres R. A.

  • Author_Institution
    Comput. Sci. Dept., Fed. Univ. of Uberlandia, Uberlandia, Brazil
  • fYear
    2013
  • fDate
    14-16 Aug. 2013
  • Firstpage
    262
  • Lastpage
    269
  • Abstract
    This article presents an extension to the system D-VisionDraughts: a draughts player agent based on a MultiLayer Perceptron Neural Network which operates in a distributed environment, and in a manner which distinguishes it from the current world champion Chinook, it learns without human supervision. The network weights are updated by Temporal Differences Methods using self-play with cloning technique. The best move is chosen by the parallel Alpha-Beta search algorithm called Young Brothers Wait Concept. The representation of the game board states is based on the NET-FEATUREMAP techniques (functions describing features inherent to Draughts game). This paper investigates the improvement obtained by D-VisionDraughts through the insertion of new features that allow a more precise representation of the board states. Further, the authors show to what extent the addition of new processors compensates the increase in training time that would be an obvious consequence of the optimization of the board state representation.
  • Keywords
    computer games; distributed processing; learning (artificial intelligence); multilayer perceptrons; search problems; software agents; D-VisionDraughts; Draughts game; Draughts player agent; NET-FEATUREMAP techniques; Young Brothers Wait Concept; board state representation; cloning technique; distributed learning environment; game board; multilayer perceptron neural network; network weights; neural network based agent; parallel alpha-beta search algorithm; temporal differences methods; world champion Chinook; Artificial neural networks; Cloning; Games; Neurons; Program processors; Training; Distributed Search Algorithm YBWC; Neural Networks; Reinforcement Learning in Draughts; Representation of the State Spaces;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Information Reuse and Integration (IRI), 2013 IEEE 14th International Conference on
  • Conference_Location
    San Francisco, CA
  • Type

    conf

  • DOI
    10.1109/IRI.2013.6642481
  • Filename
    6642481