DocumentCode :
2097618
Title :
Theoretical framework for comparing several popular stochastic optimization approaches
Author :
Spall, James C. ; Hill, Stacy D. ; Stark, David R.
Author_Institution :
Appl. Phys. Lab., Johns Hopkins Univ., Laurel, MD, USA
Volume :
4
fYear :
2002
fDate :
2002
Firstpage :
3153
Abstract :
This paper establishes a framework for formal comparisons of several leading optimization algorithms, establishing guidance to practitioners for when to use or not to use a particular method. The focus in this paper are five general algorithm forms: random search, simultaneous perturbation stochastic approximation, simulated annealing, evolutionary strategies, and genetic algorithms. We summarize the available theoretical results on rates of convergence for the five algorithm forms and then use the theoretical results to draw some preliminary conclusions on the relative efficiency. Our aim is to sort out some of the competing claims of efficiency and to suggest a structure for comparison that is more general and transferable than the usual problem-specific numerical studies.
Keywords :
genetic algorithms; optimisation; simulated annealing; stochastic processes; evolutionary strategies; genetic algorithms; problem-specific numerical studies; random search; simulated annealing; simultaneous perturbation stochastic approximation; stochastic optimization; Approximation algorithms; Computational modeling; Convergence; Evolutionary computation; Genetic algorithms; Laboratories; Optimization methods; Physics; Simulated annealing; Stochastic processes;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
American Control Conference, 2002. Proceedings of the 2002
ISSN :
0743-1619
Print_ISBN :
0-7803-7298-0
Type :
conf
DOI :
10.1109/ACC.2002.1025274
Filename :
1025274
Link To Document :
بازگشت