Learning How to Play Bomberman with Deep Reinforcement and Imitation Learning - Entertainment Computing and Serious Games Access content directly
Conference Papers Year : 2019

Learning How to Play Bomberman with Deep Reinforcement and Imitation Learning

Abstract

Making artificial agents that learn how to play is a long-standing goal in the area of Game AI. Recently, several successful cases have emerged driven by Reinforcement Learning (RL) and neural network-based approaches. However, in most of the cases, the results have been achieved by training directly from pixel frames with valuable computational resources. In this paper, we devise agents that learn how to play the popular game of Bomberman by relying on state representations and RL-based algorithms without looking at the pixel level. To that, we designed five vector-based state representations and implemented Bomberman on the top of the Unity game engine through the ML-agents toolkit. We enhance the ML-agents algorithms by developing an Imitation-based learner (IL) that improves its model with the Actor-Critic Proximal-Policy Optimization (PPO) method. We compared this approach with a PPO-only learner that uses either a Multi-Layer Perceptron or a Long-Short Term-Memory network (LSTM). We conducted several pieces of training and tournament experiments by making the agents play against each other. The hybrid state representation and our IL followed by PPO learning algorithm achieve the best overall quantitative results, and we also observed that their agents learn a correct Bomberman behavior.
Fichier principal
Vignette du fichier
491829_1_En_10_Chapter.pdf (310.29 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03652029 , version 1 (26-04-2022)

Licence

Attribution

Identifiers

Cite

Ícaro Goulart, Aline Paes, Esteban Clua. Learning How to Play Bomberman with Deep Reinforcement and Imitation Learning. 1st Joint International Conference on Entertainment Computing and Serious Games (ICEC-JCSG), Nov 2019, Arequipa, Peru. pp.121-133, ⟨10.1007/978-3-030-34644-7_10⟩. ⟨hal-03652029⟩
62 View
509 Download

Altmetric

Share

Gmail Facebook X LinkedIn More