Title :
Distributed subgradient methods and quantization effects
Author :
Angelia Nedic;Alex Olshevsky;Asuman Ozdaglar;John N. Tsitsiklis
Author_Institution :
Department of Industrial and Enterprise Systems Engineering, University of Illinois, Urbana-Champaign, 61801, USA
Abstract :
We consider a convex unconstrained optimization problem that arises in a network of agents whose goal is to cooperatively optimize the sum of the individual agent objective functions through local computations and communications. For this problem, we use averaging algorithms to develop distributed subgradient methods that can operate over a time-varying topology. Our focus is on the convergence rate of these methods and the degradation in performance when only quantized information is available. Based on our recent results on the convergence time of distributed averaging algorithms, we derive improved upper bounds on the convergence rate of the unquantized subgradient method. We then propose a distributed subgradient method under the additional constraint that agents can only store and communicate quantized information, and we provide bounds on its convergence rate that highlight the dependence on the number of quantization levels.
Keywords :
"Quantization","Convergence","Optimization methods","Network topology","Upper bound","Resource management","Control systems","Communication industry","Computer industry","Electrical equipment industry"
Conference_Titel :
Decision and Control, 2008. CDC 2008. 47th IEEE Conference on
Print_ISBN :
978-1-4244-3123-6
DOI :
10.1109/CDC.2008.4738860