DocumentCode :
495251
Title :
A Reinforcement Learning Algorithm Based on Minimum State Method and Average Reward
Author :
Qi-ming, Fu ; Quan, Liu ; Zhi-ming, Cui ; Yu-chen, Fu
Author_Institution :
Inst. of Comput. Sci. & Technol., Soochow Univ., Suzhou, China
Volume :
5
fYear :
2009
fDate :
March 31 2009-April 2 2009
Firstpage :
534
Lastpage :
538
Abstract :
Reinforcement learning is learning what to do - how to map situations to actions - so as to maximize a numerical reward signal. In allusion to the problem that Q-Learning, which uses discount reward as the evaluation criterion, cannot show the affect of the action to the next situation, the paper puts forward AR-Q-Learning based on the average reward and Q-Learning. In allusion to the Curse Of Dimensionality, which means that the computational requirements grow exponentially with the number of state variables, the paper puts forward Minimum State Method. AR-Q-Learning and Minimum State Method are used in the reinforcement learning of Blocks World, and the result of the experiment shows that the method has the characteristic of after effect and converge more faster than Q-Learning, and at the same time, solve the Curse Of Dimensionality in Blocks World in a certain extent.
Keywords :
learning (artificial intelligence); minimisation; average reward; computational requirement; minimum state method; numerical reward signal; reinforcement learning algorithm; Computer science; Learning;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Computer Science and Information Engineering, 2009 WRI World Congress on
Conference_Location :
Los Angeles, CA
Print_ISBN :
978-0-7695-3507-4
Type :
conf
DOI :
10.1109/CSIE.2009.433
Filename :
5170592
Link To Document :
بازگشت