Hand Gesture Based Gameplay with a Smoothie Maker Game Using Myo Armband

Research output: Chapter in Book/Report/Conference proceedingConference contribution


Serious games have the potential to guide the relearning process via encouraging and motivating meaningful interaction. This paper focused on assessing the feasibility of gameplay by performing hand gestures using an off the shelf myoelectric armband to make smoothies in a functional game. The game was designed in Unity3D and interfaced with the wireless Myo Armband as an input device for performing the tasks in game. Based on earlier work on feasibility of incorporating machine-learning based gesture recognition, cylindrical, spherical, and tripod grasps were incorporated into the game. Smoothie Maker game was designed with two versions Game-A & Game-B. Participants, (n=20), were randomly assigned to an AB or BA group which differs in order of gameplay for the two games. After playing each game, participants offered their insights using the Intrinsic Motivation Inventory (IMI). The results featured multiple parameters including score, time to pick, idle time, as well as gesture recognition accuracy for both game versions. Most outcomes indicated that games A and B did not have a statistically significant difference, but when comparing using gesture accuracy, the two game differed slightly with statistical significance. Analysis of the qualitative IMI survey did not provide a significant difference between the two game versions. Conclusions are drawn from our findings towards improving the games and their recognition accuracy, highlighted for our future work.

Original languageEnglish
Title of host publicationSocial Robotics - 11th International Conference, ICSR 2019, Proceedings
EditorsMiguel A. Salichs, Shuzhi Sam Ge, Emilia Ivanova Barakova, John-John Cabibihan, Alan R. Wagner, Álvaro Castro-González, Hongsheng He
PublisherSpringer Nature
Number of pages11
ISBN (Print)9783030358877
Publication statusPublished - 2019
Event11th International Conference on Social Robotics, ICSR 2019 - Madrid, Spain
Duration: 26 Nov 201929 Nov 2019

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11876 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349


Conference11th International Conference on Social Robotics, ICSR 2019


  • Hand gestures
  • Serious games
  • Smoothie maker game
  • Virtual reality


Dive into the research topics of 'Hand Gesture Based Gameplay with a Smoothie Maker Game Using Myo Armband'. Together they form a unique fingerprint.

Cite this