Abstract

The integration of technology in education has become ever more prioritized since the COVID-19 pandemic. Chat Generative Pre-Trained Transformer (ChatGPT) is an artificial intelligence technology that generates conversational interactions to user prompts. The trained model can answer follow-up questions, admit its mistakes, challenge incorrect premises, and reject inappropriate requests. The functionality of ChatGPT in answering chemistry assessment questions requires investigation to ascertain its potential impact on learning and assessment. Two chemistry-focused modules in year 1 and year 2 of a pharmaceutical science program are used to study and evaluate ChatGPT-generated responses in relation to the end-of-year exam assessments. For questions that focused on knowledge and understanding with “describe” and “discuss” verbs, the ChatGPT generated responses. For questions that focused on application of knowledge and interpretation with nontext information, the ChatGPT technology reached a limitation. A further analysis of the quality of responses is reported in this study. ChatGPT is not considered a high-risk technology tool in relation to cheating. Similar to the COVID-19 disruption, ChatGPT is expected to provide a catalyst for educational discussions on academic integrity and assessment design.
Original languageEnglish
Pages (from-to)1672-1675
Number of pages4
JournalJournal of Chemical Education
Volume100
Issue number4
Early online date31 Mar 2023
DOIs
Publication statusPublished - 11 Apr 2023

Keywords

  • First-Year Undergraduate
  • Applications of Chemistry
  • Outreach
  • General
  • Public Understanding
  • Internet
  • Web-Based Learning
  • Communication

Fingerprint

Dive into the research topics of 'Evaluating academic answers generated using ChatGPT'. Together they form a unique fingerprint.

Cite this