Associate Professor Tsung-Che Chiang
Department of Computer Science and Information Engineering
National Taiwan Normal University

Tel: +886-2-77346692    Fax: +886-2-29322378    Email
¡@
¡@

Hao-Cheng Chia, Tsung-Su Yeh, and Tsung-Che Chiang, Designing card game strategies with genetic programming and Monte-Carlo tree search, Proc. of IEEE Symposium Series on Computational Intelligence (SSCI), pp. 2351 - 2358, Canberra Australia (virtual conference due to COVID-19), Dec. 1-4, 2020.

Abstract

This paper addresses an agent design problem of a digital collectible card game, Hearthstone, which is a two-player turn-based game. The agent has to play cards based on the game state, the hand cards, and the deck of cards to defeat the opponent. First, we design a rule-based agent by searching for the board evaluation criterion through genetic programming (GP). Then, we integrate the rule-based agent into the Monte-Carlo tree search (MCTS) framework to generate an advanced agent. Performance of the proposed agents are verified by playing against three participants in two recent Hearthstone competitions. Experimental results showed that the GP-agent can beat a simple MCTS agent and the mid-level agent in the competition. The MCTS-GP agent showed competitive performance against the best agents in the competition. We also examine the rule found by GP and observed that GP is able to identify key attributes of game states and to combine them into a useful rule automatically.

 

¡@