Title :
Convergence of simultaneous perturbation stochastic approximation for nondifferentiable optimization
Author :
He, Ying ; Fu, Michael C. ; Marcus, Steven I.
Author_Institution :
Electr. & Comput. Eng. Dept., Colorado State Univ., Fort Collins, CO, USA
Abstract :
We consider simultaneous perturbation stochastic approximation for function minimization. The standard assumption for convergence is that the function be three times differentiable, although weaker assumptions have been used for special cases. However, all work that we are aware of at least requires differentiability. We relax the differentiability requirement and prove convergence using convex analysis.
Keywords :
approximation theory; convergence of numerical methods; interpolation; optimisation; convex analysis; function minimization; nondifferentiable optimization; simultaneous perturbation stochastic approximation; subgradient; Approximation algorithms; Convergence; Cost function; Decision making; Finite difference methods; Helium; Minimization methods; Research and development; Semiconductor device noise; Stochastic processes;
Journal_Title :
Automatic Control, IEEE Transactions on
DOI :
10.1109/TAC.2003.815008