DocumentCode
2819679
Title
A model reference adaptive search method for stochastic optimization with applications to Markov decision processes
Author
Hu, Jiaqiao ; Fu, Michael C. ; Marcus, Steven I.
Author_Institution
State Univ. of New York, Stony Brook
fYear
2007
fDate
12-14 Dec. 2007
Firstpage
975
Lastpage
980
Abstract
We propose a randomized search method called stochastic model reference adaptive search (SMRAS) for solving stochastic optimization problems. We present its global convergence properties in a general stochastic setting, and explore its applications for solving Markov decision processes.
Keywords
Markov processes; convergence; decision theory; optimisation; search problems; Markov decision processes; global convergence; randomized search method; stochastic model reference adaptive search; stochastic optimization; Adaptive control; Algorithm design and analysis; Convergence; Learning; Monte Carlo methods; Optimization methods; Programmable control; Random variables; Search methods; Stochastic processes;
fLanguage
English
Publisher
ieee
Conference_Titel
Decision and Control, 2007 46th IEEE Conference on
Conference_Location
New Orleans, LA
ISSN
0191-2216
Print_ISBN
978-1-4244-1497-0
Electronic_ISBN
0191-2216
Type
conf
DOI
10.1109/CDC.2007.4434328
Filename
4434328
Link To Document