Paradox of AlphaZero: Strategic vs. Optimal Plays
Published in International Performance Computing and Communications Conference, 2020
Abstract. This article analyzes AlphaZero-type algorithms quantitatively from the viewpoint of local and global optimal sequences of play on a 7×7 board. Through targeted evaluation of the AI agent, the authors reveal the strategic, that is, winrate-dominated, nature of such algorithms, and expose thereby certain inherent obstacles against optimal play. Possible remedies are then explored, leading to techniques that may help further quantitative analysis of those algorithms and for the search for optimal solutions, on 7×7 as well as larger boards.
Recommended citation: Ze-Li Dou, Liran Ma, Khiem Nguyen, and Kien X. Nguyen. "Paradox of AlphaZero: Strategic vs. Optimal Plays." In The 39th IEEE International Performance Computing and Communications Conference, 2020.
Download Paper | Download Bibtex