Predicting mid-air gestural interaction with public displays based on audience behaviour

Vito Gentile, Mohamed Khamis, Fabrizio Milazzo, Salvatore Sorce, Alessio Malizia, Florian Alt

Research output: Contribution to journalArticlepeer-review

17 Downloads (Pure)


Knowledge about the expected interaction duration and expected distance from which users will interact with public displays can be useful in many ways. For example, knowing upfront that a certain setup will lead to shorter interactions can nudge space owners to alter the setup. If a system can predict that incoming users will interact at a long distance for a short amount of time, it can accordingly show shorter versions of content (e.g., videos/advertisements) and employ at-a-distance interaction modalities (e.g., mid-air gestures). In this work, we propose a method to build models for predicting users’ interaction duration and distance in public display environments, focusing on mid-air gestural interactive displays. First, we report our findings from a field study showing that multiple variables, such as audience size and behaviour, significantly influence interaction duration and distance. We then train predictor models using contextual data, based on the same variables. By applying our method to a mid-air gestural interactive public display deployment, we build a model that predicts interaction duration with an average error of about 8 s, and interaction distance with an average error of about 35 cm. We discuss how researchers and practitioners can use our work to build their own predictor models, and how they can use them to optimise their deployment.
Original languageEnglish
Article number102497
Number of pages16
JournalInternational Journal of Human Computer Studies
Early online date13 Jun 2020
Publication statusPublished - Dec 2020


  • Audience behaviour
  • Pervasive displays
  • Users behaviour


Dive into the research topics of 'Predicting mid-air gestural interaction with public displays based on audience behaviour'. Together they form a unique fingerprint.

Cite this