Title :
Distributed Optimization in an Energy-Constrained Network: Analog Versus Digital Communication Schemes
Author :
Razavi, A. ; Wenbo Zhang ; Zhi-Quan Luo
Author_Institution :
Dept. of Electr. & Comput. Eng., Univ. of Minnesota, Minneapolis, MN, USA
Abstract :
We consider a distributed optimization problem whereby a network of n nodes, Sℓ, ℓ ∈ {1, ..., n}, wishes to minimize a common strongly convex function f(x), x=[x1,..., xn]T, under the constraint that node Sℓ controls variable xℓ only. The nodes locally update their respective variables and periodically exchange their values with their neighbors over a set of predefined communication channels. Previous studies of this problem have focused mainly on the convergence issue and the analysis of convergence rate. In this study, we consider noisy communication channels and study the impact of communication energy on convergence. In particular, we study the minimum amount of communication energy required for nodes to obtain an ε-minimizer of f(x) in the mean square sense. For linear analog communication schemes, we prove that the communication energy to obtain an ε-minimizer of f(x) must grow at least at the rate of Ω(1/ε), and this bound is tight when f is convex quadratic. Furthermore, we show that the same energy requirement can be reduced to O (log21/ε) if a suitable digital communication scheme is used.
Keywords :
computational complexity; convergence; convex programming; digital communication; mean square error methods; minimisation; quadratic programming; telecommunication channels; telecommunication networks; ε-minimizer; communication energy; convergence rate analysis; convex function; convex quadratic programming; digital communication schemes; distributed optimization problem; energy-constrained network; linear analog communication schemes; mean square method; noisy communication channels; predefined communication channels; Convergence; Convex functions; Digital communication; Indexes; Matrix decomposition; Noise; Optimization; Communication energy; distributed optimization; energy-constrained network;
Journal_Title :
Information Theory, IEEE Transactions on
DOI :
10.1109/TIT.2012.2208550