Impressions of the GDMC AI Settlement Generation Challenge in Minecraft

Christoph Salge; Claus Aranha; Adrian Brightmoore; Sean Butler; Rodrigo De Moura Canaan; Michael Cook; Michael Green; Hagen Fischer; Christian Guckelsberger; Jupiter Hadley; Jean Baptiste Herve; Mark Johnson; Quinn Kybartas; David Mason; Mike Preuss; Tristan Smith; Ruck Thawonmas; Julian Togelius

doi:10.1145/3555858.3555940

Impressions of the GDMC AI Settlement Generation Challenge in Minecraft

Christoph Salge, Claus Aranha, Adrian Brightmoore, Sean Butler, Rodrigo De Moura Canaan, Michael Cook, Michael Green, Hagen Fischer, Christian Guckelsberger, Jupiter Hadley, Jean Baptiste Herve, Mark Johnson, Quinn Kybartas, David Mason, Mike Preuss, Tristan Smith, Ruck Thawonmas, Julian Togelius

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

1 Citation (Scopus)

Abstract

The GDMC AI settlement generation challenge is a procedural content generation (PCG) competition about producing an algorithm that can create a settlement in the game Minecraft. In contrast to the majority of AI competitions, the GDMC entries are evaluated by human experts on several criteria such as adaptability, functionality, evocative narrative, and visual aesthetics - all of which represent challenges to state-of-the-art PCG systems. This paper contains a collection of written experiences with this competition, by participants, judges, organizers and advisors. We asked people to reflect both on the artifacts themselves, and on the competition in general. The aim of this paper is to offer a shareable and edited collection of experiences and qualitative feedback which have the potential to push forward PCG and computational creativity, but would be lost once the individual assessments are compressed to scalar ratings. We reflect upon organizational issues for AI competitions, and discuss the future of the GDMC competition.

Original language	English
Title of host publication	FDG '22: Proceedings of the 17th International Conference on the Foundations of Digital Games
Editors	Kostas Karpouzis, Stefano Gualeni, Allan Fowler
Place of Publication	Athens, Greece
Publisher	ACM Press
Number of pages	16
ISBN (Electronic)	9781450397957
DOIs	https://doi.org/10.1145/3555858.3555940
Publication status	Published - 4 Nov 2022
Event	FDG '22: Proceedings of the 17th International Conference on the Foundations of Digital Games - Athens, Greece Duration: 5 Sept 2022 → 8 Sept 2022 https://dl.acm.org/doi/proceedings/10.1145/3555858

Conference

Conference	FDG '22: Proceedings of the 17th International Conference on the Foundations of Digital Games
Abbreviated title	FDG '22
Country/Territory	Greece
City	Athens
Period	5/09/22 → 8/09/22
Internet address	https://dl.acm.org/doi/proceedings/10.1145/3555858

Keywords

Artificial Intelligence
Competition
Computational Creativity
Experience Survey
Minecraft
Procedural Content Generation

Access to Document

10.1145/3555858.3555940Licence: Unspecified

Cite this

Salge, C., Aranha, C., Brightmoore, A., Butler, S., De Moura Canaan, R., Cook, M., Green, M., Fischer, H., Guckelsberger, C., Hadley, J., Herve, J. B., Johnson, M., Kybartas, Q., Mason, D., Preuss, M., Smith, T., Thawonmas, R., & Togelius, J. (2022). Impressions of the GDMC AI Settlement Generation Challenge in Minecraft. In K. Karpouzis, S. Gualeni, & A. Fowler (Eds.), FDG '22: Proceedings of the 17th International Conference on the Foundations of Digital Games Article 45 ACM Press. https://doi.org/10.1145/3555858.3555940

@inproceedings{6b15aba8cacf4b2e952630a9ceeb53ad,

title = "Impressions of the GDMC AI Settlement Generation Challenge in Minecraft",

abstract = "The GDMC AI settlement generation challenge is a procedural content generation (PCG) competition about producing an algorithm that can create a settlement in the game Minecraft. In contrast to the majority of AI competitions, the GDMC entries are evaluated by human experts on several criteria such as adaptability, functionality, evocative narrative, and visual aesthetics - all of which represent challenges to state-of-the-art PCG systems. This paper contains a collection of written experiences with this competition, by participants, judges, organizers and advisors. We asked people to reflect both on the artifacts themselves, and on the competition in general. The aim of this paper is to offer a shareable and edited collection of experiences and qualitative feedback which have the potential to push forward PCG and computational creativity, but would be lost once the individual assessments are compressed to scalar ratings. We reflect upon organizational issues for AI competitions, and discuss the future of the GDMC competition.",

keywords = "Artificial Intelligence, Competition, Computational Creativity, Experience Survey, Minecraft, Procedural Content Generation",

author = "Christoph Salge and Claus Aranha and Adrian Brightmoore and Sean Butler and {De Moura Canaan}, Rodrigo and Michael Cook and Michael Green and Hagen Fischer and Christian Guckelsberger and Jupiter Hadley and Herve, {Jean Baptiste} and Mark Johnson and Quinn Kybartas and David Mason and Mike Preuss and Tristan Smith and Ruck Thawonmas and Julian Togelius",

note = "{\textcopyright} 2022 ACM.; FDG '22: Proceedings of the 17th International Conference on the Foundations of Digital Games, FDG '22 ; Conference date: 05-09-2022 Through 08-09-2022",

year = "2022",

month = nov,

day = "4",

doi = "10.1145/3555858.3555940",

language = "English",

editor = "Kostas Karpouzis and Stefano Gualeni and Allan Fowler",

booktitle = "FDG '22: Proceedings of the 17th International Conference on the Foundations of Digital Games",

publisher = "ACM Press",

address = "United States",

url = "https://dl.acm.org/doi/proceedings/10.1145/3555858",

}

Salge, C, Aranha, C, Brightmoore, A, Butler, S, De Moura Canaan, R, Cook, M, Green, M, Fischer, H, Guckelsberger, C, Hadley, J, Herve, JB, Johnson, M, Kybartas, Q, Mason, D, Preuss, M, Smith, T, Thawonmas, R & Togelius, J 2022, Impressions of the GDMC AI Settlement Generation Challenge in Minecraft. in K Karpouzis, S Gualeni & A Fowler (eds), FDG '22: Proceedings of the 17th International Conference on the Foundations of Digital Games., 45, ACM Press, Athens, Greece, FDG '22: Proceedings of the 17th International Conference on the Foundations of Digital Games, Athens, Greece, 5/09/22. https://doi.org/10.1145/3555858.3555940

Impressions of the GDMC AI Settlement Generation Challenge in Minecraft. / Salge, Christoph; Aranha, Claus; Brightmoore, Adrian et al.
FDG '22: Proceedings of the 17th International Conference on the Foundations of Digital Games. ed. / Kostas Karpouzis; Stefano Gualeni; Allan Fowler. Athens, Greece: ACM Press, 2022. 45.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Impressions of the GDMC AI Settlement Generation Challenge in Minecraft

AU - Salge, Christoph

AU - Aranha, Claus

AU - Brightmoore, Adrian

AU - Butler, Sean

AU - De Moura Canaan, Rodrigo

AU - Cook, Michael

AU - Green, Michael

AU - Fischer, Hagen

AU - Guckelsberger, Christian

AU - Hadley, Jupiter

AU - Herve, Jean Baptiste

AU - Johnson, Mark

AU - Kybartas, Quinn

AU - Mason, David

AU - Preuss, Mike

AU - Smith, Tristan

AU - Thawonmas, Ruck

AU - Togelius, Julian

PY - 2022/11/4

Y1 - 2022/11/4

N2 - The GDMC AI settlement generation challenge is a procedural content generation (PCG) competition about producing an algorithm that can create a settlement in the game Minecraft. In contrast to the majority of AI competitions, the GDMC entries are evaluated by human experts on several criteria such as adaptability, functionality, evocative narrative, and visual aesthetics - all of which represent challenges to state-of-the-art PCG systems. This paper contains a collection of written experiences with this competition, by participants, judges, organizers and advisors. We asked people to reflect both on the artifacts themselves, and on the competition in general. The aim of this paper is to offer a shareable and edited collection of experiences and qualitative feedback which have the potential to push forward PCG and computational creativity, but would be lost once the individual assessments are compressed to scalar ratings. We reflect upon organizational issues for AI competitions, and discuss the future of the GDMC competition.

AB - The GDMC AI settlement generation challenge is a procedural content generation (PCG) competition about producing an algorithm that can create a settlement in the game Minecraft. In contrast to the majority of AI competitions, the GDMC entries are evaluated by human experts on several criteria such as adaptability, functionality, evocative narrative, and visual aesthetics - all of which represent challenges to state-of-the-art PCG systems. This paper contains a collection of written experiences with this competition, by participants, judges, organizers and advisors. We asked people to reflect both on the artifacts themselves, and on the competition in general. The aim of this paper is to offer a shareable and edited collection of experiences and qualitative feedback which have the potential to push forward PCG and computational creativity, but would be lost once the individual assessments are compressed to scalar ratings. We reflect upon organizational issues for AI competitions, and discuss the future of the GDMC competition.

KW - Artificial Intelligence

KW - Competition

KW - Computational Creativity

KW - Experience Survey

KW - Minecraft

KW - Procedural Content Generation

UR - http://www.scopus.com/inward/record.url?scp=85142386197&partnerID=8YFLogxK

U2 - 10.1145/3555858.3555940

DO - 10.1145/3555858.3555940

M3 - Conference contribution

AN - SCOPUS:85142386197

BT - FDG '22: Proceedings of the 17th International Conference on the Foundations of Digital Games

A2 - Karpouzis, Kostas

A2 - Gualeni, Stefano

A2 - Fowler, Allan

PB - ACM Press

CY - Athens, Greece

T2 - FDG '22: Proceedings of the 17th International Conference on the Foundations of Digital Games

Y2 - 5 September 2022 through 8 September 2022

ER -

Impressions of the GDMC AI Settlement Generation Challenge in Minecraft

Abstract

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this