DocumentCode
2717529
Title
Opposition-Based Reinforcement Learning in the Management of Water Resources
Author
Mahootchi, M. ; Tizhoosh, H.R. ; Ponnambalam, K.
Author_Institution
Syst. Design Eng., Waterloo Univ., Ont.
fYear
2007
fDate
1-5 April 2007
Firstpage
217
Lastpage
224
Abstract
Opposition-based learning (OBL) is a new scheme in machine intelligence. In this paper, an OBL version Q-learning which exploits opposite quantities to accelerate the learning is used for management of single reservoir operations. In this method, an agent takes an action, receives reward, and updates its knowledge in terms of action-value functions. Furthermore, the transition function which is the balance equation in the optimization model determines the next state and updates the action-value function pertinent to opposite action. Two type of opposite actions will be defined. It will be demonstrated that using OBL can significantly improve the efficiency of the operating policy within limited iterations. It is also shown that this technique is more robust than Q-Learning
Keywords
environmental science computing; learning (artificial intelligence); optimisation; reservoirs; Q-learning; action-value functions; balance equation; machine intelligence; opposite action; opposition-based reinforcement learning; optimization model; reservoir operation management; transition function; water reservoirs; water resourcemanagement; Design engineering; Dynamic programming; Machine intelligence; Machine learning; Neural networks; Reservoirs; Resource management; Stochastic processes; Systems engineering and theory; Water resources; Q-learning; opposite action; reinforcement learning; water reservoirs;
fLanguage
English
Publisher
ieee
Conference_Titel
Approximate Dynamic Programming and Reinforcement Learning, 2007. ADPRL 2007. IEEE International Symposium on
Conference_Location
Honolulu, HI
Print_ISBN
1-4244-0706-0
Type
conf
DOI
10.1109/ADPRL.2007.368191
Filename
4220836
Link To Document