Skip to Content
Education SciencesEducation Sciences
  • Article
  • Open Access

20 November 2026

27 Pages

Generative AI for Inorganic Chemistry Problems and Chemistry Students’ Self-Rated Ability to Verify Its Responses: An Exploratory Study

,
,
,
,
and
1
Department of Chemistry, Faculty of Natural Sciences, South Kazakhstan Pedagogical University after O. Zhanibekov (Zhanibekov University), Shymkent 160012, Kazakhstan
2
Department of Ecology and Chemistry, Faculty of Natural Sciences, Khoja Akhmet Yassawi International Kazakh-Turkish University, Turkistan 161200, Kazakhstan
*
Author to whom correspondence should be addressed.
Educ. Sci.2026, 16(11), 1997;https://doi.org/10.3390/educsci16111997 
(registering DOI)
This article belongs to the Special Issue AI Capability and AI Literacy in Higher Education

Abstract

Generative artificial intelligence (AI) is part of chemistry students’ study routines, but little is known about how such tools handle course problems or how students judge their ability to check AI output. In May 2025, free versions of ChatGPT (GPT-4o), Gemini (2.5 Flash) and DeepSeek (V3) each solved 42 inorganic chemistry problems once. On 38 problems with verified statements, 109 of 111 substantive responses were correct. Re-verification revealed naturally occurring defects: on three problems with inconsistent or incomplete statements, none of the eight substantive responses reached the intended solution or stated that the problem could not be solved as written; most noted an inconsistency or missing datum but still answered. A subsequent survey of 570 students at three universities in Southern Kazakhstan showed near-universal ChatGPT use (96.8%); 61.6% rated themselves as able to tell whether AI information in chemistry is correct. This self-rating behaved like an AI self-efficacy item: its association with reported AI use (ρ = 0.59) largely disappeared after adjustment for self-efficacy and attitudes (partial ρ = 0.12). These exploratory findings, limited to this problem set and these versions, suggest that checking the consistency of problem statements deserves attention in chemistry teaching and that students’ verification ability should be tested directly.

Article Metrics

Citations

Article Access Statistics

Multiple requests from the same IP address are counted as one view.