Title :
Multitask Diffusion Adaptation Over Networks
Author :
Jie Chen ; Richard, Cedric ; Sayed, Ali H.
Author_Institution :
Obs. de la Cote d´Azur Lab. Lagrange, Univ. de Nice Sophia-Antipolis, Nice, France
Abstract :
Adaptive networks are suitable for decentralized inference tasks. Recent works have intensively studied distributed optimization problems in the case where the nodes have to estimate a single optimum parameter vector collaboratively. However, there are many important applications that are multitask-oriented in the sense that there are multiple optimum parameter vectors to be inferred simultaneously, in a collaborative manner, over the area covered by the network. In this paper, we employ diffusion strategies to develop distributed algorithms that address multitask problems by minimizing an appropriate mean-square error criterion with l2-regularization. The stability and performance of the algorithm in the mean and mean-square error sense are analyzed. Simulations are conducted to verify the theoretical findings, and to illustrate how the distributed strategy can be used in several useful applications related to target localization and hyperspectral data unmixing.
Keywords :
adaptive systems; distributed algorithms; inference mechanisms; mean square error methods; optimisation; adaptive networks; decentralized inference task; diffusion strategy; distributed algorithm; distributed optimization problem; hyperspectral data unmixing; mean square error criteria; multitask diffusion adaptation; multitask problem; single optimum parameter vector estimation; target localization; Adaptive systems; Collaboration; Estimation; Indexes; Mean square error methods; Optimization; Vectors; Asymmetric regularization; collaborative processing; data unmixing; diffusion strategy; distributed optimization; multitask learning; target localization;
Journal_Title :
Signal Processing, IEEE Transactions on
DOI :
10.1109/TSP.2014.2333560