DocumentCode :
1446360
Title :
Decentralized Delay Optimal Control for Interference Networks With Limited Renewable Energy Storage
Author :
Huang, Huang ; Lau, Vincent K N
Author_Institution :
ECE Dept., Hong Kong Univ. of Sci. & Technol., Hong Kong, China
Volume :
60
Issue :
5
fYear :
2012
fDate :
5/1/2012 12:00:00 AM
Firstpage :
2552
Lastpage :
2561
Abstract :
In this paper, we consider delay minimization for interference networks with renewable energy source, where the transmission power of a node comes from both the conventional utility power (ac power) and the renewable energy source. We assume the transmission power of each node is a function of the local channel state, local data queue state and local energy queue state only. We consider two delay optimization formulations, namely the decentralized partially observable Markov decision process (DEC-POMDP) and noncooperative partially observable stochastic game (POSG). In DEC-POMDP formulation, we derive a decentralized online learning algorithm to determine the control actions and Lagrangian multipliers (LMs) simultaneously, based on the policy gradient approach. Under some mild technical conditions, the proposed decentralized policy gradient algorithm converges almost surely to a local optimal solution. In the noncooperative POSG formulation, the transmitter nodes are noncooperative. We extend the decentralized policy gradient solution and establish the technical proof for almost-sure convergence of the learning algorithms. In both cases, the solutions are very robust to model variations.
Keywords :
Markov processes; decentralised control; delays; fading channels; interference (signal); learning (artificial intelligence); optimal control; optimisation; queueing theory; radio transmitters; renewable energy sources; stochastic games; DEC-POMDP formulation; Lagrangian multiplier; decentralized delay optimal control; decentralized online learning algorithm; decentralized partially observable Markov decision process; decentralized policy gradient solution algorithm; delay minimization; delay optimization formulation; interference network; limited renewable energy storage; local channel state function; local data queue state function; local energy queue state function; local optimal solution; mild technical condition; noncooperative POSG formulation; noncooperative partially observable stochastic game; noncooperative transmitter node; transmission power; utility power; Delay; Games; Interference; Minimization; Optimization; Renewable energy resources; Transmitters; , delay optimal control; , interference networks; , partially observed stochastic game; POMDP; Renewable energy;
fLanguage :
English
Journal_Title :
Signal Processing, IEEE Transactions on
Publisher :
ieee
ISSN :
1053-587X
Type :
jour
DOI :
10.1109/TSP.2012.2187284
Filename :
6151187
Link To Document :
بازگشت