Q_learning based on active backup and memory mechanism

Exploration is used in Q_learning because the agent would be caught in locally optimal policies due to blind exploitation. However excessive exploration would degrade the performance of Q_learning and it is difficult to meet the trade-off between exploration and exploitation. The active backup is introduced into Q_learning and the corresponding algorithm AB_Q_learning based on Dijkstra backup in dynamic programming is proposed. Then, the memory mechanism based MEAB_Q_Iearning algorithm is given for the agent to learn in completely unknown environment. The experimental results show that these two algorithms not only converge more quickly, but also solve the problem of local optimization.