DocumentCode
1841527
Title
Transpositions and move groups in Monte Carlo tree search
Author
Childs, Benjamin E. ; Brodeur, James H. ; Kocsis, Levente
Author_Institution
Comput. Sci. Dept., Worcester Polytech. Inst., Worcester, MA
fYear
2008
fDate
15-18 Dec. 2008
Firstpage
389
Lastpage
395
Abstract
Monte Carlo search, and specifically the UCT (Upper Confidence Bounds applied to Trees) algorithm, has contributed to a significant improvement in the game of Go and has received considerable attention in other applications. This article investigates two enhancements to the UCT algorithm. First, we consider the possible adjustments to UCT when the search tree is treated as a graph (and information amongst transpositions are shared). The second modification introduces move groupings, which may reduce the effective branching factor. Experiments with both enhancements were performed using artificial trees and in the game of Go. From the experimental results we conclude that both exploiting the graph structure and grouping moves may contribute to an increase in the playing strength of game programs using UCT.
Keywords
Monte Carlo methods; computer games; trees (mathematics); Monte Carlo tree search; artificial trees; effective branching factor; game programs; graph structure; upper confidence bounds; Algorithm design and analysis; Automation; Computer science; Electronic mail; History; Monte Carlo methods; Statistics; Tree data structures; Tree graphs;
fLanguage
English
Publisher
ieee
Conference_Titel
Computational Intelligence and Games, 2008. CIG '08. IEEE Symposium On
Conference_Location
Perth, WA
Print_ISBN
978-1-4244-2973-8
Electronic_ISBN
978-1-4244-2974-5
Type
conf
DOI
10.1109/CIG.2008.5035667
Filename
5035667
Link To Document