Title :
Step size adaptation in evolution strategies using reinforcement learning
Author :
Müller, Sibylle D. ; Schraudolph, Nicol N. ; Koumoutsakos, Petros D.
Author_Institution :
Inst. of Computational Sci., Swiss Fed. Inst. of Technol., Zurich, Switzerland
Abstract :
We discuss the implementation of a learning algorithm for determining adaptation parameters in evolution strategies. As an initial test case, we consider the application of reinforcement learning for determining the relationship between success rates and the adaptation of step sizes in the (1+1)-evolution strategy. The results from the new adaptive scheme when applied to several test functions are compared with those obtained from the (1+1)-evolution strategy with a priori selected parameters. Our results indicate that assigning good reward measures seems to be crucial to the performance of the combined strategy
Keywords :
evolutionary computation; learning (artificial intelligence); adaptation parameters; adaptive scheme; evolution strategies; performance; reinforcement learning; reward measures; step size adaptation; test case; test functions; Automatic control; Delay; Learning; Mobile robots; Optimal control; Robot control; Robot sensing systems; Size control; Testing;
Conference_Titel :
Evolutionary Computation, 2002. CEC '02. Proceedings of the 2002 Congress on
Conference_Location :
Honolulu, HI
Print_ISBN :
0-7803-7282-4
DOI :
10.1109/CEC.2002.1006225