DocumentCode
2007976
Title
Modulating reinforcement-learning parameters using agent emotions
Author
von Haugwitz, R. ; Kitamura, Yoshifumi ; Takashima, Katsuyuki
Author_Institution
Appl. Inf. Technol., Chalmers Univ. of Technol., Göteborg, Sweden
fYear
2012
fDate
20-24 Nov. 2012
Firstpage
1281
Lastpage
1285
Abstract
An actor-critic reinforcement-learning algorithm using a radial-basis-function network for approximation of the actor and the critic was run on a small-scale multi-agent system with an initially unpredictably hostile environment. The performance of two approaches was compared: having fixed learning parameters, and using modulated parameters that were allowed to deviate from their base values depending on the simulated emotional state of the agent. The latter approach was shown to give marginally better performance once the distracting hostile elements were removed from the environment. This seems to indicate that emotion-modulated learning may lead to somewhat closer approximation of the optimal policy in a difficult environment, by focusing learning on more useful input and avoiding pursuing suboptimal strategies.
Keywords
learning (artificial intelligence); multi-agent systems; radial basis function networks; actor-critic reinforcement learning algorithm; agent emotion; emotion-modulated learning; fixed learning parameter; modulated learning parameter; radial basis function network; reinforcement learning parameter; small scale multiagent system; suboptimal strategy;
fLanguage
English
Publisher
ieee
Conference_Titel
Soft Computing and Intelligent Systems (SCIS) and 13th International Symposium on Advanced Intelligent Systems (ISIS), 2012 Joint 6th International Conference on
Conference_Location
Kobe
Print_ISBN
978-1-4673-2742-8
Type
conf
DOI
10.1109/SCIS-ISIS.2012.6505340
Filename
6505340
Link To Document