Title :
Dynamic power management utilizing reinforcement learning with fuzzy reward for energy harvesting wireless sensor nodes
Author :
Liu, Cheng-Ting ; Hsu, Roy Chaoming
Author_Institution :
Dept. of Comput. Sci. & Inf. Eng., Nat. Chiayi Univ., Chiayi, Taiwan
Abstract :
This paper considers a scenario that wireless sensor node is powered by harvesting energy with the characteristics of ambiguity and uncertainty. Reinforcement learning with fuzzy reward (RLFR) is used in this study for the dynamic power management of such energy harvesting wireless sensor nodes. By interacting with the given environment, the RLFR adjusts the duty-cycle in data sensing task according to the variable incoming energy related signals. The outcomes of these interactions are evaluated by fuzzy reward that express how well the duty-cycle adjustments in satisfying given requirement of energy neutrality. Simulation results show that the RLFR not only satisfies the sensing requirement in maintaining energy neutrality, but it also achieves better energy utilization in terms of residual battery energy in comparing with another existing dynamic power management method.
Keywords :
energy harvesting; fuzzy set theory; learning (artificial intelligence); telecommunication computing; wireless sensor networks; data sensing task; duty-cycle adjustments; dynamic power management method; energy harvesting wireless sensor nodes; energy neutrality; energy utilization; reinforcement learning with fuzzy reward; residual battery energy; sensing requirement; variable incoming energy related signals; Batteries; Energy harvesting; Learning; Sensors; Wireless communication; Wireless sensor networks; Dynamic Power Management; Energy Harvest; Fuzzy Reward; Reinforcement Learning; Wireless Sensor Nodes;
Conference_Titel :
IECON 2011 - 37th Annual Conference on IEEE Industrial Electronics Society
Conference_Location :
Melbourne, VIC
Print_ISBN :
978-1-61284-969-0
DOI :
10.1109/IECON.2011.6119679