Title :
Information compression effect based on PCA for reinforcement learning agents´ communication
Author :
Notsu, A. ; Honda, Kazuhiro ; Ichihashi, Hayato ; Ido, A. ; Komori, Y.
Author_Institution :
Dept. of Comput. Sci. & Intell. Syst., Osaka Prefecture Univ., Sakai, Japan
Abstract :
In general, the amount of required memory and reduction of learning time with explosion of the number of states become problems in reinforcement learning. In this study, as a method of cutting information of the learning table, principal component analysis was used as an information compression method, which is well known. The principal component analysis was applied to the learning table directly. Also, the influence given by reducing the principal component vector extremely when restructuring state space and action space was reviewed. In a numerical experiment, it was confirmed that the proposed method cut the amount of information and without a big change to learning speed and agents´ minimal communication can had positive effect on the learning.
Keywords :
learning (artificial intelligence); multi-agent systems; principal component analysis; vectors; PCA; action space; agent communication; information compression effect; learning speed; learning table; learning time; principal component analysis; principal component vector; reinforcement learning agent; state space; Information Compression; Principal Component Analysis; Reinforcement Learning;
Conference_Titel :
Soft Computing and Intelligent Systems (SCIS) and 13th International Symposium on Advanced Intelligent Systems (ISIS), 2012 Joint 6th International Conference on
Conference_Location :
Kobe
Print_ISBN :
978-1-4673-2742-8
DOI :
10.1109/SCIS-ISIS.2012.6504999