Comparing PCG metrics with Human Evaluation in Minecraft Settlement Generation

Jean-Baptiste Herve, Christoph Salge

Research output: Contribution to conferencePaperpeer-review

70 Downloads (Pure)


There are a range of metrics that can be applied to the artifacts produced by procedural content generation, and several of them
come with qualitative claims. In this paper, we adapt a range of existing PCG metrics to generated Minecraft settlements, develop
a few new metrics inspired by PCG literature, and compare the resulting measurements to existing human evaluations. The aim is
to analyze how those metrics capture human evaluation scores in different categories, how the metrics generalize to another game
domain, and how metrics deal with more complex artifacts. We provide an exploratory look at a variety of metrics and provide
an information gain and several correlation analyses. We found some relationships between human scores and metrics counting
specific elements, measuring the diversity of blocks and measuring the presence of crafting materials for the present complex blocks.
Original languageEnglish
Publication statusAccepted/In press - Jun 2021
EventFoundations of Digital Games 2021 - online
Duration: 2 Aug 20216 Aug 2021


ConferenceFoundations of Digital Games 2021
Abbreviated titleFDG2021
Internet address

Cite this