Optimal decentralized control policy for wireless communication systems with wireless energy transfer capability

In this paper, we consider a decentralized wireless communication system with wireless energy transfer capability. We aim to minimize the total number of packets waiting at wireless nodes for the whole system. We first formulated the optimization problem as a decentralized partially observable Markov decision process (DEC-POMDP). To solve an optimization problem with constraints, we applied the Lagrangian multiplier and the policy gradient method. In addition, to reduce the complexity of DEC-POMDP, we proposed a decentralized online learning algorithm with minimum communication among the wireless nodes. Under appropriate conditions, we showed that the proposed algorithm converges to a local optimal solution. The simulation results clearly showed the convergence as well as the efficiency of the proposed algorithm.