Title :
Trust Region Secant/Finite Difference Method for Large Sparse Minimax Problems
Author :
Junxiang Li ; Jiazhen Huo ; Limei Dou
Author_Institution :
Sch. of Econ. & Manage., Tongji Univ., Shanghai, China
Abstract :
A secant/finite difference algorithm based on trust region strategy is presented. This algorithm is designed to solve the minimax optimization problem of a finite number of functions, whose Hessian matrices are normally sparse. By integrating a secant method and a finite difference method, and adopting a symmetrically consistent partition of the columns of the Hessian matrices, the algorithm can employ the gradient evaluations as efficiently as possible to build quadratic approximations to the functions. This technique will, at every iterative step, have m, the number of functions, less the number of gradient evaluations than that of the direct method. And in order to enlarge the region of convergence, the trust region strategy is also adopted. The algorithm is proved to have good global and local convergence properties with q-superlinear convergence and r-convergence rate. The robustness and efficiency of the algorithm is verified by numerical tests, and its performance is comparable to or better than that of other algorithms currently available.
Keywords :
Hessian matrices; finite difference methods; gradient methods; minimax techniques; sparse matrices; Hessian matrices; gradient evaluation; iterative step; large sparse minimax problem; local convergence properties; minimax optimization problem; q-superlinear convergence rate; quadratic approximation; r-convergence rate; secant method; trust region secant-finite difference method; Algorithm design and analysis; Convergence; Design optimization; Finite difference methods; Iterative algorithms; Iterative methods; Minimax techniques; Partitioning algorithms; Sparse matrices; Symmetric matrices; finite difference; nondifferentiable optimization; partition; secant; sparsity;
Conference_Titel :
Computational Science and Optimization (CSO), 2010 Third International Joint Conference on
Conference_Location :
Huangshan, Anhui
Print_ISBN :
978-1-4244-6812-6
Electronic_ISBN :
978-1-4244-6813-3
DOI :
10.1109/CSO.2010.180