• DocumentCode
    2717529
  • Title

    Opposition-Based Reinforcement Learning in the Management of Water Resources

  • Author

    Mahootchi, M. ; Tizhoosh, H.R. ; Ponnambalam, K.

  • Author_Institution
    Syst. Design Eng., Waterloo Univ., Ont.
  • fYear
    2007
  • fDate
    1-5 April 2007
  • Firstpage
    217
  • Lastpage
    224
  • Abstract
    Opposition-based learning (OBL) is a new scheme in machine intelligence. In this paper, an OBL version Q-learning which exploits opposite quantities to accelerate the learning is used for management of single reservoir operations. In this method, an agent takes an action, receives reward, and updates its knowledge in terms of action-value functions. Furthermore, the transition function which is the balance equation in the optimization model determines the next state and updates the action-value function pertinent to opposite action. Two type of opposite actions will be defined. It will be demonstrated that using OBL can significantly improve the efficiency of the operating policy within limited iterations. It is also shown that this technique is more robust than Q-Learning
  • Keywords
    environmental science computing; learning (artificial intelligence); optimisation; reservoirs; Q-learning; action-value functions; balance equation; machine intelligence; opposite action; opposition-based reinforcement learning; optimization model; reservoir operation management; transition function; water reservoirs; water resourcemanagement; Design engineering; Dynamic programming; Machine intelligence; Machine learning; Neural networks; Reservoirs; Resource management; Stochastic processes; Systems engineering and theory; Water resources; Q-learning; opposite action; reinforcement learning; water reservoirs;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Approximate Dynamic Programming and Reinforcement Learning, 2007. ADPRL 2007. IEEE International Symposium on
  • Conference_Location
    Honolulu, HI
  • Print_ISBN
    1-4244-0706-0
  • Type

    conf

  • DOI
    10.1109/ADPRL.2007.368191
  • Filename
    4220836