DocumentCode :
3178063
Title :
The convergence rate of Newton-Raphson consensus optimization for quadratic cost functions
Author :
Zanella, Filippo ; Varagnolo, Damiano ; Cenedese, Angelo ; Pillonetto, G. ; Schenato, L.
Author_Institution :
Dept. of Inf. Eng., Univ. of Padova, Padova, Italy
fYear :
2012
fDate :
10-13 Dec. 2012
Firstpage :
5098
Lastpage :
5103
Abstract :
We consider the convergence rates of two convex optimization strategies in the context of multi agent systems, namely the Newton-Raphson consensus optimization and a distributed Gradient-Descent opportunely derived from the first. To allow analytical derivations, the convergence analyses are performed under the simplificative assumption of quadratic local cost functions. In this framework we derive sufficient conditions which guarantee the convergence of the algorithms. From these conditions we then obtain closed form expressions that can be used to tune the parameters for maximizing the rate of convergence. Despite these formulae have been derived under quadratic local cost functions assumptions, they can be used as rules-of-thumb for tuning the parameters of the algorithms in general situations.
Keywords :
Newton-Raphson method; convergence; convex programming; gradient methods; multi-agent systems; quadratic programming; Newton-Raphson consensus optimization; convergence rate; convex optimization strategies; distributed Gradient-Descent methods; multiagent systems; parameter tuning; quadratic cost functions; quadratic local cost functions; rules-of-thumb; sufficient conditions; Asymptotic stability; Convergence; Convex functions; Cost function; Stability analysis; Vectors; Newton-Raphson methods; consensus algorithms; convex optimization; distributed optimization; multi-agent systems; rate of convergence;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Decision and Control (CDC), 2012 IEEE 51st Annual Conference on
Conference_Location :
Maui, HI
ISSN :
0743-1546
Print_ISBN :
978-1-4673-2065-8
Electronic_ISBN :
0743-1546
Type :
conf
DOI :
10.1109/CDC.2012.6426750
Filename :
6426750
Link To Document :
بازگشت