Beyond CheatBots: Examining Tensions in Teachers’ and Students’ Perceptions of Cheating and Learning with ChatGPT
Abstract
:1. Introduction
1.1. Background
1.2. Historical Definitions of Responsible Technology Use in Schools
1.3. Responsible Use in the Era of Generative AI
We advise against a policing approach (that focuses on discovering academic misconduct, such as detecting the use of ChatGPT and other AI tools). We favour an approach that builds trusting relationships with our students in a student-centric pedagogy and assessments for and as learning rather than solely assessments of learning [27,30,31].
2. Materials and Methods
2.1. Objectives and Research Questions
Question 1: What criteria did these teachers and students use to define learning about writing with ChatGPT?
Question 2: What criteria did these teachers and students use to define cheating at writing with ChatGPT?
2.2. Participants and Context
2.2.1. Student Participants
2.2.2. Teacher Participants
2.3. Data Collection and Analysis
2.3.1. Student Data Collection
Student A: Give me two possible first sentences for an essay arguing that schools should not require students to wear uniforms.
Student B: Make an outline with only headers and subheaders for me to use as I write an essay arguing that schools should not require students to wear uniforms.
Student C: Fix this paragraph I wrote arguing that school uniforms discourage students’ individuality. (*This prompt included a pre-written paragraph with grammatical and spelling errors.)
Student D: I am going to write an argument where I argue against mandatory school uniforms, but I am having trouble writing it. Please help me write my argument by taking the other side and giving me a list of counterarguments.
2.3.2. Teacher Data Collection
2.4. Data Analysis
2.5. Limitations
3. Results
3.1. Finding 1: Teachers and Students Used Similar Criteria to Describe Learning and Cheating with ChatGPT
3.2. Finding 2: Students and Teachers Had Similar Opinions about Learning with ChatGPT but Different Opinions about Cheating with ChatGPT
3.3. Finding 3: Variation within and between Groups Centered on Four Recurring Tensions
- 1.
- Using ChatGPT as a shortcut versus as a scaffold;
- 2.
- Using ChatGPT to generate ideas versus language;
- 3.
- Getting support from ChatGPT versus analogous support from other sources;
- 4.
- Learning from ChatGPT versus learning as a whole.
3.3.1. Tension 1: Using ChatGPT as a Shortcut versus as a Scaffold
3.3.2. Tension 2: Using ChatGPT to Generate Ideas versus Language
3.3.3. Tension 3: Getting Support from ChatGPT versus Analogous Support from Other Sources
3.3.4. Tension 4: Learning from ChatGPT versus Learning as a Whole
4. Discussion
I have been feeling very nervous about the ways that generative AI will change the teaching of writing, or how I will manage it as a teacher. I thought the activity was so thought provoking because it really pushed us to think about what we consider as “cheating”, which is really the anxiety that so many of us have. The blurry lines between cheating and learning about writing was a new idea for me, and something I will continue to think about. I want to do this exact activity with my department, and I think the idea of doing it with students is incredibly intriguing.
The first digital divide: The rich have technology, while the poor do not. The second digital divide: The rich have technology and the skills to use it effectively, while the poor have technology but lack skills to use it effectively. The third digital divide? The rich have access to both technology and people to help them use it, while the poor have access to technology only.
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Trust, T.; Whalen, J.; Mouza, C. Editorial: ChatGPT: Challenges, opportunities, and implications for teacher education. Contemp. Issues Technol. Teach. Educ. 2023, 23, 1–23. [Google Scholar]
- Rawas, S. ChatGPT: Empowering lifelong learning in the digital age of higher education. In Education and Information Technologie; Springer: Berlin/Heidelberg, Germany, 2023; pp. 1–14. [Google Scholar]
- Zhang, P.; Tur, G. A systematic review of ChatGPT use in K-12 education. In European Journal of Education; Wiley Online Library: Hoboken, NJ, USA, 2023. [Google Scholar]
- Cotton, D.R.; Cotton, P.A.; Shipway, J.R. Chatting and cheating: Ensuring academic integrity in the era of ChatGPT. Innov. Educ. Teach. Int. 2024, 61, 228–239. [Google Scholar] [CrossRef]
- Welsh, R.O.; Little, S. The school discipline dilemma: A comprehensive review of disparities and alternative approaches. Rev. Educ. Res. 2018, 88, 752–794. [Google Scholar] [CrossRef]
- Gregory, A.; Skiba, R.J.; Mediratta, K. Eliminating disparities in school discipline: A framework for intervention. Rev. Res. Educ. 2017, 41, 253–278. [Google Scholar] [CrossRef]
- Long, D.; Magerko, B. What is AI literacy? Competencies and design considerations. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, Honolulu, HI, USA, 25–30 April 2020; pp. 1–16. [Google Scholar]
- Ng, D.T.K.; Leung, J.K.L.; Chu, S.K.W.; Qiao, M.S. Conceptualizing AI literacy: An exploratory review. Comput. Educ. Artif. Intell. 2021, 2, 100041. [Google Scholar] [CrossRef]
- Heyder, T.; Posegga, O. Extending the foundations of AI literacy. In Proceedings of the International Conference on Information Systems 2021, Austin, TX, USA, 12–15 December 2021; Available online: https://aisel.aisnet.org/icis2021/is_future_work/is_future_work/9/ (accessed on 3 March 2024).
- Lee, I.; Ali, S.; Zhang, H.; DiPaola, D.; Breazeal, C. Developing middle school students’ AI literacy. In Proceedings of the 52nd ACM Technical Symposium on Computer Science Education, Virtual, 13–20 March 2021; pp. 191–197. [Google Scholar]
- Cuban, L. Inside the Black Box of Classroom Practice: Change without Reform in American Education; Harvard Education Press: Cambridge, MA, USA, 2013. [Google Scholar]
- Baidoo-Anu, D.; Ansah, L.O. Education in the era of generative artificial intelligence (AI): Understanding the potential benefits of ChatGPT in promoting teaching and learning. J. AI 2023, 7, 52–62. [Google Scholar] [CrossRef]
- Burgason, K.A.; Sefiha, O.; Briggs, L. Cheating is in the eye of the beholder: An evolving understanding of academic misconduct. Innov. High. Educ. 2019, 44, 203–218. [Google Scholar] [CrossRef]
- Burke, M.M.; Bristor, J. Academic integrity policies: Has your institution implemented an effective policy? Account. Educ. J. 2016, 26. [Google Scholar]
- Craig, D.; Evans, E.D. Teacher and student perceptions of academic cheating in middle and senior high schools. J. Educ. Res. 1990, 84, 44–52. [Google Scholar]
- Dick, M.; Sheard, J.; Bareiss, C.; Carter, J.; Joyce, D.; Harding, T.; Laxer, C. Addressing student cheating: Definitions and solutions. ACM SigCSE Bull. 2002, 35, 172–184. [Google Scholar] [CrossRef]
- Gullifer, J.; Tyson, G. Who has read the policy on plagiarism? Unpacking students’ understanding of plagiarism. Stud. High. Educ. 2013, 39, 1202–1218. [Google Scholar] [CrossRef]
- ISTE. ISTE Standards for Students. 2016. Available online: https://iste.org/standards/students (accessed on 3 March 2024).
- ISTE. Artificial Intelligence in Education. 2024. Available online: https://iste.org/ai (accessed on 3 March 2024).
- U.S. Department of Education, Office of Educational Technology. A Call to Action for Closing the Digital Access, Design, and Use Divides. 2024 National Education Technology Plan: Washington, DC, USA, 2024. [Google Scholar]
- Lo, C.K. What is the impact of ChatGPT on education? A rapid review of the literature. Educ. Sci. 2023, 13, 410. [Google Scholar] [CrossRef]
- Dehouche, N. Plagiarism in the age of massive generative pre-trained transformers (GPT-3). Ethics Sci. Environ. Politics 2021, 2, 17–23. [Google Scholar] [CrossRef]
- Chaka, C. Detecting AI content in responses generated by ChatGPT, YouChat, and Chatsonic: The case of five AI content detection tools. J. Appl. Learn. Teach. 2023, 6, 94–104. [Google Scholar]
- Pavlik, J.V. Collaborating with ChatGPT: Considering the implications of Generative Artificial intelligence for journalism and media education. Journal. Mass Commun. Educ. 2023, 78, 84–93. [Google Scholar] [CrossRef]
- Jarrah, A.M.; Wardat, Y.; Fidalgo, P. Using ChatGPT in academic writing is (not) a form of plagiarism: What does the literature say. Online J. Commun. Media Technol. 2023, 13, e202346. [Google Scholar] [CrossRef]
- Perkins, M. Academic Integrity considerations of AI Large Language Models in the post-pandemic era: ChatGPT and beyond. J. Univ. Teach. Learn. Pract. 2023, 20, 7. [Google Scholar] [CrossRef]
- Rudolph, J.; Tan, S.; Tan, S. ChatGPT: Bullshit spewer or the end of traditional assessments in higher education? J. Appl. Learn. Teach. 2023, 6, 342–363. [Google Scholar] [CrossRef]
- Stokel-Walker, C. AI Bot ChatGPT Writes Smart Essays—Should Professors Worry? Nature 2022. Available online: https://www.nature.com/articles/d41586-022-04397-7 (accessed on 1 March 2024).
- Herman, D. The End of High School English; The Atlantic: Washington, DC, USA, 2022. [Google Scholar]
- Wiliam, D. What is assessment for learning? Stud. Educ. Eval. 2011, 37, 3–14. [Google Scholar] [CrossRef]
- Earl, L.M. Assessment as Learning: Using Classroom Assessment to Maximize Student Learning; Corwin Press: Oaks, CA, USA, 2012. [Google Scholar]
- Saldaña, J. Fundamentals of Qualitative Research; Oxford University Press: Oxford, UK, 2011. [Google Scholar]
- Patton, M.Q. Qualitative Research and Evaluation Methods; Sage Publications: Thousand Oaks, CA, USA, 2002; p. 4. [Google Scholar]
- Etikan, I.; Musa, S.A.; Alkassim, R.S. Comparison of convenience sampling and purposive sampling. Am. J. Theor. Appl. Stat. 2016, 5, 1–4. [Google Scholar] [CrossRef]
- Krosnick, J.A. Maximizing questionnaire quality. Meas. Political Attitudes 1999, 2, 37–58. [Google Scholar]
- Bucholtz, M. The politics of transcription. J. Pragmat. 2000, 32, 1439–1465. [Google Scholar] [CrossRef]
- Miles, H.; Huberman, A.M.; Saldana, J. Qualitative Data Analysis: A Methods Sourcebook; Sage Publications, Inc.: New York, NY, USA, 2020. [Google Scholar]
- Campbell, J.L.; Quincy, C.; Osserman, J.; Pedersen, O.K. Coding in-depth semistructured interviews: Problems of unitization and intercoder reliability and agreement. Sociol. Methods Res. 2013, 42, 294–320. [Google Scholar] [CrossRef]
- Dedoose Version 9.0.17, Cloud Application for Managing, Analyzing, and Presenting Qualitative and Mixed Method Research Data; SocioCultural Research Consultants, LLC.: Los Angeles, CA, USA, 2023.
- Doyle, S. Member checking with older women: A framework for negotiating meaning. Health Care Women Int. 2007, 28, 888–908. [Google Scholar] [CrossRef] [PubMed]
- Hennink, M.; Kaiser, B.N. Sample sizes for saturation in qualitative research: A systematic review of empirical tests. Soc. Sci. Med. 2022, 292, 114523. [Google Scholar] [CrossRef] [PubMed]
- Karlan, B. Reasoning with heuristics. Ratio 2021, 34, 100–108. [Google Scholar] [CrossRef]
- Yu, S.; Lu, Y.; Yu, S.; Lu, Y. Prospects and Reflections: Looking into the Future. In An Introduction to Artificial Intelligence in Education; Springer: Berlin/Heidelberg, Germany, 2021; pp. 189–198. [Google Scholar]
- Emig, J. Writing as a Mode of Learning. Coll. Compos. Commun. 1977, 28, 122–128. [Google Scholar] [CrossRef]
- Solorzano, D.G.; Yosso, T.J. From racial stereotyping and deficit discourse toward a critical race theory in teacher education. Multicult. Educ. 2001, 9, 2. [Google Scholar]
- Trucano, M. AI and the Next Digital Divide in Education. Brookings 2023. Available online: https://www.brookings.edu/articles/ai-and-the-next-digital-divide-in-education/ (accessed on 22 February 2024).
- Harrison, L.M.; Hurd, E.; Brinegar, K.M. Critical race theory, books, and ChatGPT: Moving from a ban culture in education to a culture of restoration. Middle Sch. J. 2023, 54, 2–4. [Google Scholar] [CrossRef]
Media | Data Source | Teachers | Students |
---|---|---|---|
Text | Rankings (Google Docs) | n = 16 | n = 12 |
Chat transcript (Zoom) | n = 1 | n = 0 | |
Written explanations (Google Docs) | n = 8 | n = 0 | |
Session feedback forms | n = 16 | n = 0 | |
Video | Paired discussion of rankings and rationales | n = 0 | n = 6 |
Whole group discussion of rankings and rationales | n = 1 | n = 1 |
Theme | Description | Example Quote |
---|---|---|
CognitiveLift | Attending to whether AI or student is doing the “thinking” (e.g. generating ideas, evaluating, analyzing) | [Student] B [outline prompt] cheated the most because ChatGPT did the most intellectual work for them - how to organize an essay, what arguments to have, etc. Student B did not have to generate ideas for writing. Writing is like a puzzle you piece together and with [generative AI] it does most of the work. |
Models | Seeing models or examples and transferring new knowledge to their own writing. | Student B [outline prompt] learned the most about writing because a lot of students don’t know what an outline looks like or how to structure their ideas. |
Edit | Attending to corrections (e.g., grammar, punctuation, spelling). | Student C [edit prompt] learned the second most about writing. They had a starting point, but learned about grammar and word choice in a way that they could probably apply to future writing. |
AltPerspectives | Considering perspectives different from the students’ own. | [Student] D [counterargument prompt] cheated the third most because they used ChatGPT to research counterarguments, but didn’t use it for the actual argument. |
GettingStarted | Getting started independently or moving from nothing to something. | Student A [sentences prompt] *possibly* learned the third most because they are using ChatGPT to get started, and with that start, they may be able to write the rest. |
StyleVoice | Attending to writers’ style, voice, personal experiences, and creativity. | We chose [Student] D [counterargument prompt] second [most learned] because it helps students elevate their style. |
Theme | Description | Example Quote |
---|---|---|
Context | Considering contextual factors such as the assignment goal, student population, or what the student did with ChatGPT’s output. | Depends on the assignment. If the assignment was to write an outline, this is 100% cheating. |
Comparison | Comparing student use of ChatGPT to an existing resource, either digital, analogue, or human. | Student C [edit prompt] cheated the least because they already had their paragraph, but they just asked ChatGPT to edit it—kind of like a spell checker. |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Mah, C.; Walker, H.; Phalen, L.; Levine, S.; Beck, S.W.; Pittman, J. Beyond CheatBots: Examining Tensions in Teachers’ and Students’ Perceptions of Cheating and Learning with ChatGPT. Educ. Sci. 2024, 14, 500. https://doi.org/10.3390/educsci14050500
Mah C, Walker H, Phalen L, Levine S, Beck SW, Pittman J. Beyond CheatBots: Examining Tensions in Teachers’ and Students’ Perceptions of Cheating and Learning with ChatGPT. Education Sciences. 2024; 14(5):500. https://doi.org/10.3390/educsci14050500
Chicago/Turabian StyleMah, Christopher, Hillary Walker, Lena Phalen, Sarah Levine, Sarah W. Beck, and Jaylen Pittman. 2024. "Beyond CheatBots: Examining Tensions in Teachers’ and Students’ Perceptions of Cheating and Learning with ChatGPT" Education Sciences 14, no. 5: 500. https://doi.org/10.3390/educsci14050500
APA StyleMah, C., Walker, H., Phalen, L., Levine, S., Beck, S. W., & Pittman, J. (2024). Beyond CheatBots: Examining Tensions in Teachers’ and Students’ Perceptions of Cheating and Learning with ChatGPT. Education Sciences, 14(5), 500. https://doi.org/10.3390/educsci14050500