Title :
Optimal decentralized control policy for wireless communication systems with wireless energy transfer capability
Author :
Dinh Thai Hoang ; Niyato, Dusit ; Ping Wang ; Dong In Kim
Author_Institution :
Sch. of Comput. Eng., Nanyang Technol. Univ., Singapore, Singapore
Abstract :
In this paper, we consider a decentralized wireless communication system with wireless energy transfer capability. We aim to minimize the total number of packets waiting at wireless nodes for the whole system. We first formulated the optimization problem as a decentralized partially observable Markov decision process (DEC-POMDP). To solve an optimization problem with constraints, we applied the Lagrangian multiplier and the policy gradient method. In addition, to reduce the complexity of DEC-POMDP, we proposed a decentralized online learning algorithm with minimum communication among the wireless nodes. Under appropriate conditions, we showed that the proposed algorithm converges to a local optimal solution. The simulation results clearly showed the convergence as well as the efficiency of the proposed algorithm.
Keywords :
Markov processes; gradient methods; inductive power transmission; learning (artificial intelligence); power engineering computing; radiocommunication; telecommunication computing; DEC-POMDP; Lagrangian multiplier; decentralized online learning algorithm; decentralized partially observable Markov decision process; decentralized wireless communication system; local optimal solution; optimization problem; policy gradient method; wireless energy transfer capability; wireless nodes; Artificial neural networks; Base stations; Convergence; Data communication; Energy exchange; Vectors; Wireless communication; Markov decision processes; Wireless energy transfer; decentralized systems; simulation-based algorithm;
Conference_Titel :
Communications (ICC), 2014 IEEE International Conference on
Conference_Location :
Sydney, NSW
DOI :
10.1109/ICC.2014.6883754