Monte-Carlo tree search in Ms. Pac-Man

This paper proposes a method for solving the problem of avoiding pincer moves of the ghosts in the game of Ms. Pac-Man to enhance the chance of survival for Ms. Pac-Man. To achieve this, the approach of using the UCT (UCB applied to trees) algorithm, a Monte-Carlo tree search algorithm that proved to be successful with a computer game of Go, was employed. The UCT algorithm is one of the tree search algorithms based on simulations and performs many searches on potential moves weighing the mean reward based on random simulation and the number of searches for a node. Although it is difficult to build a complete game tree that considers all situations in a real-time game like Ms. Pac-Man, because of the time limitation and the extent of implicit information, a method was developed to predict the probability of being trapped from pincer moves and avoid such situations at a feasible cost by repeating simulations on similar discretized situations. As a result of a performance comparison between the proposed system and existing programs, significant improvement in the performance of proposed system over existing programs was observed in terms of its ability to survive, implying the effectiveness of proposed method.