When the robotic Maths tutor is wrong - can children identify mistakes generated by ChatGPT?

Research output: Chapter in Book/Report/Conference proceedingConference contribution

49 Downloads (Pure)

Abstract

This study delves into integrating Large Language Models (LLMs), particularly ChatGPT-powered robots, as educational tools in primary school mathematics. Against the backdrop of Artificial Intelligence (AI) increasingly permeating educational settings, our investigation focuses on the response of young learners to errors made by these LLM-powered robots. Employing a user study approach, we conducted an experiment using the Pepper robot in a primary school classroom environment, where
77 primary school students from multiple grades (Year 3 to 5) took part in interacting with the robot. Our statistically significant findings highlight that most students, regardless of the year group, could discern between correct and incorrect responses generated by the robots, demonstrating a promising level of understanding and engagement with the AI-driven educational tool. Additionally, we observed that students’ correctness in answering the Maths questions significantly influenced their
ability to identify errors, underscoring the importance of prior knowledge in verifying LLM responses and detecting errors. Additionally, we examined potential confounding factors such as age and gender. Our findings underscore the importance of gradually integrating AI-powered educational tools under the guidance of domain experts following thorough verification processes. Moreover, our study calls for further research to establish best practices for implementing AI-driven pedagogical
approaches in educational settings.
Original languageEnglish
Title of host publication2024 5th International Conference on Artificial Intelligence, Robotics, and Control (AIRC 2024)
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
Publication statusAccepted/In press - 7 Apr 2024
Event2024 5th International Conference on Artificial Intelligence, Robotics, and Control - The British University in Cairo, Cairo, Egypt
Duration: 22 Apr 202424 Apr 2024
Conference number: 5
https://www.airc.org/

Conference

Conference2024 5th International Conference on Artificial Intelligence, Robotics, and Control
Abbreviated titleAIRC 2024
Country/TerritoryEgypt
CityCairo
Period22/04/2424/04/24
Internet address

Keywords

  • Large Language Models
  • LLM Mathematical Correctness
  • Educational Robots
  • Cognition
  • Social Robotics

Fingerprint

Dive into the research topics of 'When the robotic Maths tutor is wrong - can children identify mistakes generated by ChatGPT?'. Together they form a unique fingerprint.

Cite this