Unravelling Player's Insights: A Comparative Analysis of Topic Modelling Techniques on Game Reviews and Video Game Developers' Perspectives

Xinge Tong, Ian Willcock, Yi Sun

Research output: Contribution to journalArticlepeer-review

39 Downloads (Pure)

Abstract

Game reviews function as an important customercreated resource for game studies as they allow practitioners and developers to analyse players'opinions.Despite this,there are few studies that under take comparative evaluations of topic modelling approaches in the context of video game data analysis or assess the results' practical efficacy. Accordingly, this paper aims to evaluate the performance of three topic modelling algorithms LDA, NMF and BERTopic–as utilised within game reviews study and further to examine the results' reception within the video game industry. This study first uses the game No Man's Sky as a case study to evaluate the performance of different models in the same game context. According to our experiments based on Steam game reviews, the topic's Uci coherence score as identified by the BERTopic model can reach 0.279, which is higher than the other two models, with the extracted keywords allowing humans to interpret the themes when mapping them to original reviews. Semi-structured interviews with seven developers are then presented which demonstrate that the information we provided is useful to improve their games and track players' opinions.
Original languageEnglish
Pages (from-to)1-14
Number of pages14
JournalIEEE Transactions on Games
DOIs
Publication statusPublished - 10 Jun 2024

Keywords

  • Analytical models
  • Data models
  • Game evaluation
  • Games
  • Industries
  • Interviews
  • Review analysis
  • Reviews
  • Topic modelling
  • Video games

Fingerprint

Dive into the research topics of 'Unravelling Player's Insights: A Comparative Analysis of Topic Modelling Techniques on Game Reviews and Video Game Developers' Perspectives'. Together they form a unique fingerprint.

Cite this