Title :
A Reinforcement Learning Algorithm Based on Minimum State Method and Average Reward
Author :
Qi-ming, Fu ; Quan, Liu ; Zhi-ming, Cui ; Yu-chen, Fu
Author_Institution :
Inst. of Comput. Sci. & Technol., Soochow Univ., Suzhou, China
fDate :
March 31 2009-April 2 2009
Abstract :
Reinforcement learning is learning what to do - how to map situations to actions - so as to maximize a numerical reward signal. In allusion to the problem that Q-Learning, which uses discount reward as the evaluation criterion, cannot show the affect of the action to the next situation, the paper puts forward AR-Q-Learning based on the average reward and Q-Learning. In allusion to the Curse Of Dimensionality, which means that the computational requirements grow exponentially with the number of state variables, the paper puts forward Minimum State Method. AR-Q-Learning and Minimum State Method are used in the reinforcement learning of Blocks World, and the result of the experiment shows that the method has the characteristic of after effect and converge more faster than Q-Learning, and at the same time, solve the Curse Of Dimensionality in Blocks World in a certain extent.
Keywords :
learning (artificial intelligence); minimisation; average reward; computational requirement; minimum state method; numerical reward signal; reinforcement learning algorithm; Computer science; Learning;
Conference_Titel :
Computer Science and Information Engineering, 2009 WRI World Congress on
Conference_Location :
Los Angeles, CA
Print_ISBN :
978-0-7695-3507-4
DOI :
10.1109/CSIE.2009.433