Can ChatGPT Solve Undergraduate Exams from Warehousing Studies? An Investigation

Franke, Sven; Pott, Christoph; Rutinowski, Jérôme; Pauly, Markus; Reining, Christopher; Kirchheim, Alice

doi:10.3390/computers14020052

Open AccessArticle

Can ChatGPT Solve Undergraduate Exams from Warehousing Studies? An Investigation

by

Sven Franke

^1,*

,

Christoph Pott

¹

,

Jérôme Rutinowski

¹

,

Markus Pauly

^2,3

,

Christopher Reining

^1,4

and

Alice Kirchheim

^1,4

¹

Department of Mechanical Engineering, TU Dortmund University, 44227 Dortmund, Germany

²

Department of Statistics, TU Dortmund University, 44227 Dortmund, Germany

³

Research Center Trustworthy Data Science and Security of the University Alliance Ruhr, 44227 Dortmund, Germany

⁴

Fraunhofer Institute for Material Flow and Logistics IML, 44227 Dortmund, Germany

^*

Author to whom correspondence should be addressed.

Computers 2025, 14(2), 52; https://doi.org/10.3390/computers14020052

Submission received: 17 December 2024 / Revised: 31 January 2025 / Accepted: 1 February 2025 / Published: 5 February 2025

(This article belongs to the Special Issue IT in Production and Logistics)

Download

Browse Figures

Review Reports Versions Notes

Abstract

The performance of Large Language Models, such as ChatGPT, generally increases with every new model release. In this study, we investigated to what degree different GPT models were able to solve the exams of three different undergraduate courses on warehousing. We contribute to the discussion of ChatGPT’s existing logistics knowledge, particularly in the field of warehousing. Both the free version (GPT-4o mini) and the premium version (GPT-4o) completed three different warehousing exams using three different prompting techniques (with and without role assignments as logistics experts or students). The o1-preview model was also used (without a role assignment) for six runs. The tests were repeated three times. A total of 60 tests were conducted and compared with the in-class results of logistics students. The results show that the GPT models passed a total of 46 tests. The best run solved 93% of the exam correctly. Compared with the students from the respective semester, ChatGPT outperformed the students in one exam. In the other two exams, the students performed better on average than ChatGPT.

Keywords: GPT-4o; GPT-4o mini; o1-preview; educational assessment; warehousing; LLM

Share and Cite

MDPI and ACS Style

Franke, S.; Pott, C.; Rutinowski, J.; Pauly, M.; Reining, C.; Kirchheim, A. Can ChatGPT Solve Undergraduate Exams from Warehousing Studies? An Investigation. Computers 2025, 14, 52. https://doi.org/10.3390/computers14020052

AMA Style

Franke S, Pott C, Rutinowski J, Pauly M, Reining C, Kirchheim A. Can ChatGPT Solve Undergraduate Exams from Warehousing Studies? An Investigation. Computers. 2025; 14(2):52. https://doi.org/10.3390/computers14020052

Chicago/Turabian Style

Franke, Sven, Christoph Pott, Jérôme Rutinowski, Markus Pauly, Christopher Reining, and Alice Kirchheim. 2025. "Can ChatGPT Solve Undergraduate Exams from Warehousing Studies? An Investigation" Computers 14, no. 2: 52. https://doi.org/10.3390/computers14020052

APA Style

Franke, S., Pott, C., Rutinowski, J., Pauly, M., Reining, C., & Kirchheim, A. (2025). Can ChatGPT Solve Undergraduate Exams from Warehousing Studies? An Investigation. Computers, 14(2), 52. https://doi.org/10.3390/computers14020052

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Menu

Can ChatGPT Solve Undergraduate Exams from Warehousing Studies? An Investigation

Abstract

Share and Cite

Article Metrics

Article Access Statistics

Further Information

Guidelines

MDPI Initiatives

Follow MDPI