Title :
Balanced Energy-Efficient Routing in MANETs using Reinforcement Learning
Author :
Naruephiphat, W. ; Usaha, W.
Author_Institution :
Suranaree Univ. of Technol., Nakhon Ratchasima
Abstract :
This paper proposes an energy-efficient path selection algorithm which aims at balancing the contrasting objectives of maximizing network lifetime and minimizing energy consumption routing in mobile ad hoc networks (MANETs). The method is based on a reinforcement learning technique called the on- policy Monte Carlo (ONMC) method. Simulation results show that variants of the proposed method can outperform existing schemes such as variants of the conditional max-min battery capacity routing (CMMBR) and the best minimum combined- cost routing algorithm in terms of the long-term average reward which depicts the balance of the tradeoff in dynamic topology environments.
Keywords :
ad hoc networks; learning (artificial intelligence); minimax techniques; mobile communication; mobile computing; telecommunication network routing; telecommunication network topology; MANET; balanced energy-efficient routing; best minimum combined-cost routing; conditional max-min battery capacity routing; dynamic topology environment; energy consumption routing; energy-efficient path selection; mobile ad hoc networks; network lifetime miximization; on-policy Monte Carlo method; reinforcement learning; Batteries; Bismuth; Costs; Energy consumption; Energy efficiency; Learning; Mobile ad hoc networks; Monte Carlo methods; Radio transmitters; Routing protocols;
Conference_Titel :
Information Networking, 2008. ICOIN 2008. International Conference on
Conference_Location :
Busan
Print_ISBN :
978-89-960761-1-7
Electronic_ISBN :
1976-7684
DOI :
10.1109/ICOIN.2008.4472784