Simplified online Q-learning for LEGO EV3 robot

Q-learning is a kind of model-free reinforcement learning algorithm which is effective in Robot´s navigation applications. Unfortunately, Lego Mindstorms EV3 robot´s file writing speed is sometimes too slow to implement Q-learning algorithm. In this paper, an approach is proposed to simplify Q-learning discrete value table into a new version that stores only one optimum action and its Q-value instead of storing every action´s Q-value in each state. Exploration and contrast experiments show that our algorithm learns much faster than the original Q-learning without losing the ability to find a better policy in navigation task.