Please use this identifier to cite or link to this item:
https://www.um.edu.mt/library/oar/handle/123456789/80812
Title: | Experience-driven PCG via reinforcement learning : a Super Mario Bros study |
Authors: | Shu, Tianye Liu, Jialin Yannakakis, Georgios N. |
Keywords: | Level design (Computer science) Computer games -- Design Computational intelligence Artificial intelligence Super Mario Bros. (Game) |
Issue Date: | 2021 |
Publisher: | Institute of Electrical and Electronics Engineers |
Citation: | Shu, T., Liu, J., & Yannakakis, G. N. (2021). Experience-driven PCG via reinforcement learning : a Super Mario Bros study. 3rd IEEE Conference on Games, Copenhagen. |
Abstract: | We introduce a procedural content generation (PCG) framework at the intersections of experience-driven PCG and PCG via reinforcement learning, named ED(PCG)RL, EDRL in short. EDRL is able to teach RL designers to generate endless playable levels in an online manner while respecting particular experiences for the player as designed in the form of reward functions. The framework is tested initially in the Super Mario Bros game. In particular, the RL designers of Super Mario Bros generate and concatenate level segments while considering the diversity among the segments. The correctness of the generation is ensured by a neural net-assisted evolutionary level repairer and the playability of the whole level is determined through AI-based testing. Our agents in this EDRL implementation learn to maximise a quantification of Koster’s principle of fun by moderating the degree of diversity across level segments. Moreover, we test their ability to design fun levels that are diverse over time and playable. Our proposed framework is capable of generating endless, playable Super Mario Bros levels with varying degrees of fun, deviation from earlier segments, and playability. EDRL can be generalised to any game that is built as a segment-based sequential process and features a built-in compressed representation of its game content. |
Description: | This work was supported by the National Natural Science Foundation of China (Grant No. 61906083), the Guangdong Provincial Key Laboratory (Grant No. 2020B121201001), the Program for Guangdong Introducing Innovative and Entrepreneurial Teams (Grant No. 2017ZT07X386), the Guangdong Basic and Applied Basic Research Foundation (Grant No. 2021A1515011830), the Shenzhen Science and Technology Program (Grant No. KQTD2016112514355531) and the Shenzhen Fundamental Research Program (Grant No. JCYJ20190809121403553). |
URI: | https://www.um.edu.mt/library/oar/handle/123456789/80812 |
Appears in Collections: | Scholarly Works - InsDG |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
Experience-driven_PCG_via_reinforcement_learning_a_Super_Mario_Bros_study_2021.pdf Restricted Access | 949.18 kB | Adobe PDF | View/Open Request a copy |
Items in OAR@UM are protected by copyright, with all rights reserved, unless otherwise indicated.