Higher Education Students’ Task Motivation in the Generative Artificial Intelligence Context: The Case of ChatGPT
Abstract
:1. Introduction
2. Literature Review
2.1. ChatGPT as AI Driven Tool
2.2. Task Motivation and Underlying Theories
2.3. Research Rationale and Goals
3. Methodology
3.1. Research Context and Participants
- Can you please summarize the following text?
- Can you please reformulate the following text so that it is related to topic A?
- Can you please suggest a model for implementing strategy A?
- What relations do you suggest between the learning strategy A and the theoretical framework B?
- What is the difference between strategy A and strategy B?
- Can you suggest a lesson plan for integrating digital simulations in primary school?
- How can you convince a teacher to use digital simulations in secondary school?
3.2. Data Collection Tools and Procedures
- Describe your personal experience about using ChatGPT.
- Do you prefer using the ChatGPT tool while solving tasks? Why?
- What steps do you take during the solving of your task using ChatGPT?
- Describe your feelings while using ChatGPT. Give please an example.
- Explain the difficulties you faced while solving tasks through ChatGPT. How did you overcome these difficulties?
- What effort do you put into solving your task using ChatGPT? Give please an example.
- If you were asked to evaluate the solution you arrived at using ChatGPT, how would you rate your work compared to your colleagues? And why?
- How would you describe the benefits of using ChatGPT to solve your tasks?
- Do you want to add any information that you think is important and was not covered in the previous questions?
3.3. Data Analysis Method
3.4. Validity and Trustworthiness of the Analysis Method
3.4.1. Saturation
3.4.2. Trustworthiness
4. Results
- Task motivation: The task motivation category consisted of 4 sub-categories:
- Reported Effort: The reported effort category consisted of 3 sub-categories:
- Result Assessment: The result assessment category consisted of 4 sub-categories:
- Perceived Relevance: The reported effort category consisted of 2 sub-categories:
- Interaction: The reported effort category consisted of 2 sub-categories:
5. Discussion
- Task Enjoyment:
- Reported Effort:
- Result Assessment:
- Perceived Relevance:
- Interaction:
6. Conclusions, Limitations, and Recommendations
6.1. Conclusions
6.2. Limitations
6.3. Recommendations
Author Contributions
Funding
Informed Consent Statement
Conflicts of Interest
References
- Yang, W. Artificial intelligence education for young children: Why, what, and how in curriculum design and implementation. Comput. Educ. Artif. Intell. 2022, 3, 100061. [Google Scholar] [CrossRef]
- Cooper, G. Examining Science Education in ChatGPT: An Exploratory Study of Generative Artificial Intelligence. J. Sci. Educ. Technol. 2023, 32, 444–452. [Google Scholar] [CrossRef]
- Daher, W. Students’ Motivation to Learn Mathematics in the Robotics Environment. Comput. Sch. 2022, 39, 230–251. [Google Scholar] [CrossRef]
- Guo, K.; Zhong, Y.; Li, D.; Chu, S.K.W. Effects of chatbot-assisted in-class debates on students’ argumentation skills and task motivation. Comput. Educ. 2023, 203, 104862. [Google Scholar] [CrossRef]
- Wu, R.; Yu, Z. Do AI chatbots improve students’ learning outcomes? Evidence from a meta-analysis. Br. J. Educ. Technol. 2023, 1–24. [Google Scholar] [CrossRef]
- Yilmaz, R.; Karaoglan Yilmaz, F.G. The effect of generative artificial intelligence (AI)-based tool use on students’ computational thinking skills, programming self-efficacy and motivation. Comput. Educ. Artif. Intell. 2023, 4, 100147. [Google Scholar] [CrossRef]
- Zhou, L.; Li, J. The Impact of ChatGPT on Learning Motivation: A Study Based on Self-Determination Theory. Educ. Sci. Manag. 2023, 1, 19–29. [Google Scholar] [CrossRef]
- Ryan, R.M.; Deci, E.L. Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. Am. Psychol. 2000, 55, 68–78. [Google Scholar] [CrossRef]
- Wigfield, A.; Eccles, J.S. Expectancy–Value Theory of Achievement Motivation. Contemp. Educ. Psychol. 2000, 25, 68–81. [Google Scholar] [CrossRef]
- Chen, X.; Zhai, X.; Zhu, Y.; Li, Y. Exploring debaters and audiences’ depth of critical thinking and its relationship with their participation in debate activities. Think. Ski. Creat. 2022, 44, 101035. [Google Scholar] [CrossRef]
- Feng, S.; Law, N. Mapping artificial intelligence in education research: A network-based keyword analysis. Int. J. Artif. Intell. Educ. 2021, 31, 277–303. [Google Scholar] [CrossRef]
- Graesser, A.C.; VanLehn, K.; Rose, C.P.; Jordan, P.W.; Harter, D. Intelligent tutoring systems with conversational dialogue. AI Mag. 2001, 22, 39. [Google Scholar] [CrossRef]
- Rapp, A.; Curti, L.; Boldi, A. The human side of human-chatbot interaction: A systematic literature review of ten years of research on text-based chatbots. Int. J. Hum.-Comput. Stud. 2021, 151, 102630. [Google Scholar] [CrossRef]
- Smutny, P.; Schreiberova, P. Chatbots for learning: A review of educational chatbots for the Facebook messenger. Comput. Educ. 2020, 151, 103862. [Google Scholar] [CrossRef]
- Zhang, R.; Zou, D.; Cheng, G. Chatbot-based training on logical fallacy in EFL argumentative writing. Innov. Lang. Learn. Teach. 2023, 17, 932–945. [Google Scholar] [CrossRef]
- Lameras, P.; Arnab, S. Power to the Teachers: An Exploratory Review on Artificial Intelligence in Education. Information 2022, 13, 14. [Google Scholar] [CrossRef]
- Raschka, S.; Patterson, J.; Nolet, C. Machine Learning in Python: Main Developments and Technology Trends in Data Science, Machine Learning, and Artificial Intelligence. Information 2020, 11, 193. [Google Scholar] [CrossRef]
- How, M.-L.; Cheah, S.-M.; Chan, Y.-J.; Khor, A.C.; Say, E.M.P. Artificial Intelligence-Enhanced Decision Support for Informing Global Sustainable Development: A Human-Centric AI-Thinking Approach. Information 2020, 11, 39. [Google Scholar] [CrossRef]
- Daher, W.; Diab, H.; Rayan, A. Artificial Intelligence Generative Tools and Conceptual Knowledge in Problem Solving in Chemistry. Information 2023, 14, 409. [Google Scholar] [CrossRef]
- Rudolph, J.; Tan, S.; Tan, S. ChatGPT: Bullshit spewer or the end of traditional assessments in higher education? J. Appl. Learn. Teach. 2023, 6, 1. [Google Scholar] [CrossRef]
- Sabzalieva, E.; Valentini, A. ChatGPT and Artificial Intelligence in Higher Education: Quick Start Guide; UNESCO: Paris, France, 2023. [Google Scholar]
- Lin, C.; Huang, A.Y.Q.; Yang, S.J.H. A Review of AI-Driven Conversational Chatbots Implementation Methodologies and Challenges (1999–2022). Sustainability 2023, 15, 4012. [Google Scholar] [CrossRef]
- Wang, J.; Hwang, G.H.; Chang, C.Y. Directions of the 100 most cited chatbot-related human behavior research: A review of academic publications. Comput. Educ. Artif. Intell. 2021, 2, 100023. [Google Scholar] [CrossRef]
- Lo, C.K. What Is the Impact of ChatGPT on Education? A Rapid Review of the Literature. Educ. Sci. 2023, 13, 410. [Google Scholar] [CrossRef]
- Julkunen, K. Situation- and Task-Specific Motivation in Foreign-language Learning and Teaching. Ph.D. Thesis, University of Joensuu, Joensuu, Finland, 1989. [Google Scholar]
- Lamb, M.; Csizér, K.; Henry, A.; Ryan, S. The Palgrave Handbook of Motivation for Language Learning; Springer Nature: Berlin/Heidelberg, Germany, 2020. [Google Scholar]
- Deci, E.L.; Ryan, R.M. Intrinsic Motivation and Self-Determination in Human Behavior; Springer Science & Business Media: Berlin/Heidelberg, Germany, 2013. [Google Scholar]
- Poupore, G. Task Motivation in Process: A Complex Systems Perspective. Can. Mod. Lang. Rev.-Rev. Can. Lang. Vivantes 2013, 69, 91–116. [Google Scholar] [CrossRef]
- Poupore, G. The Influence of Content on Adult L2 Learners’ Task Motivation: An Interest Theory Perspective. Can. J. Appl. Linguist. 2014, 17, 69–90. Available online: https://doaj.org/article/060e43cef96744fb9cab876a76f61864 (accessed on 14 November 2023).
- Ryan, R.M.; Deci, E.L. Self-Determination Theory: Basic Psychological Needs in Motivation, Development, and Wellness; Guilford Publications: New York, NY, USA, 2018. [Google Scholar]
- Guo, K.; Zhong, Y.; Li, D.; Chu, S.K.W. Investigating students’ engagement in chatbot-supported classroom debates. Interact. Learn. Environ. 2023, 1–17. [Google Scholar] [CrossRef]
- Earle, F.; Hockey, B.; Earle, K.; Clough, P.J. Separating the effects of task load and task motivation on the effort–fatigue relationship. Motiv. Emot. 2015, 39, 467–476. [Google Scholar] [CrossRef]
- Safdari, S. Task Motivation and Transfer of Learning across Tasks: The Case of Learning the English Definite Article. Issues Lang. Teach. 2021, 10, 203–232. [Google Scholar] [CrossRef]
- Zare, J.; Delavar, K. Enhancing English learning materials with data-driven learning: A mixed-methods study of task motivation. J. Multiling. Multicult. Dev. 2022, 1–17. [Google Scholar] [CrossRef]
- Lambert, C.; Philp, J.; Nakamura, S. Learner-generated content and engagement in second language task performance. Lang. Teach. Res. 2016, 21, 665–680. [Google Scholar] [CrossRef]
- Wigfield, A.; Gladstone, J.R. What Does Expectancy-value Theory Have to Say about Motivation and Achievement in Times of Change and Uncertainty? In Advances in Motivation and Achievement; Emerald Publishing Limited: Bingley, UK, 2019; pp. 15–32. [Google Scholar] [CrossRef]
- Alfahel, E.; Daher, W.; Anabousy, A. Students’ motivation to study science: The case of Arab students in Israel. Eurasia J. Math. Sci. Technol. Educ. 2023, 19, em2291. [Google Scholar] [CrossRef] [PubMed]
- Daher, W. Middle School Students’ Motivation in Solving Modelling Activities with Technology. Eurasia J. Math. Sci. Technol. Educ. 2021, 17, em1999. [Google Scholar] [CrossRef] [PubMed]
- Daher, W.; Alfahel, E.; Anabousy, A. Moderating the Relationship Between Student’s Gender and Science Motivation. Eurasia J. Math. Sci. Technol. Educ. 2021, 17, 1956. [Google Scholar] [CrossRef] [PubMed]
- Braun, V.; Clarke, V. Using thematic analysis in psychology. Qual. Res. Psychol. 2006, 3, 77–101. [Google Scholar] [CrossRef]
- Bryman, A. Social Research Methods; Taylor & Francis eBooks; Taylor & Francis: Abingdon, UK, 2010; pp. 157–184. [Google Scholar] [CrossRef]
- Clarke, V.; Braun, V. Thematic Analysis. In Encyclopedia of Critical Psychology; Springer: Berlin/Heidelberg, Germany, 2014; pp. 1947–1952. [Google Scholar] [CrossRef]
- Flick, U. An Introduction to Qualitative Research; SAGE: Newcastle upon Tyne, UK, 2009. [Google Scholar]
- Saldana, J. The Coding Manual for Qualitative Researchers; SAGE: Newcastle upon Tyne, UK, 2021. [Google Scholar]
- Ailincai, R.; Gabillon, Z. Analysing Teachers’ Representations of Digital Technology Using a Grounded Theory Approach. Eurasia J. Math. Sci. Technol. Educ. 2018, 14, em1595. [Google Scholar] [CrossRef]
- Daher, W. Saturation in Qualitative Educational Technology Research. Educ. Sci. 2023, 13, 98. [Google Scholar] [CrossRef]
- Lincoln, Y.S.; Guba, E.G.; Pilotta, J.J. Naturalistic inquiry. Int. J. Intercult. Relat. 1985, 9, 438–439. [Google Scholar] [CrossRef]
- Polit, D.F.; Beck, C.T. Nursing Research: Generating and Assessing Evidence for Nursing Practice; Lippincott Williams & Wilkins: Philadelphia, PA, USA, 2020. [Google Scholar]
- Walters, S. Book Review: Chilisa, B., & Preece, J. (Eds.). (2006). Research Methods for Adult Educators in Africa. UNESCO, UNESCO Institute for Lifelong Learning, Institute for International Cooperation of German Adult Education Association, University of Botswana and Pearson Education South Africa. 150 pp. $27.50. Adult Educ. Q. 2008, 59, 84–86. [Google Scholar] [CrossRef]
- Elo, S.; Kääriäinen, M.; Kanste, O.; Pölkki, T.; Utriainen, K.; Kyngäs, H. Qualitative Content Analysis. SAGE Open 2014, 4, 215824401452263. [Google Scholar] [CrossRef]
- Holsti, O.R. Content Analysis for the Social Sciences and Humanities. Am. Sociol. Rev. 1970, 35, 356. [Google Scholar] [CrossRef]
- Huang, W.; Hew, K.F.; Fryer, L.K. Chatbots for language learning—Are they really useful? A systematic review of chatbot-supported language learning. J. Comput. Assist. Learn. 2021, 38, 237–257. [Google Scholar] [CrossRef]
- Tegos, S.; Psathas, G.; Tsiatsos, T.; Katsanos, C.S.; Karakostas, A.; Tsibanis, C.; Demetriadis, S. Enriching Synchronous Collaboration in Online Courses with Configurable Conversational Agents. In Lecture Notes in Computer Science; Springer Science + Business Media: Berlin, Germany, 2020; pp. 284–294. [Google Scholar] [CrossRef]
- Talan, T.; Kalinkara, Y. The Role of Artificial Intelligence in Higher Education: ChatGPT Assessment for Anatomy Course. Uluslar. Yönet. Bilişim Sist. Bilgi. Bilim. Derg. 2023, 7, 33–40. [Google Scholar] [CrossRef]
- Liu, H.; Peng, H.; Song, X.; Xu, C.; Zhang, R. Using AI chatbots to provide self-help depression interventions for university students: A randomized trial of effectiveness. Internet Interv. 2022, 27, 100495. [Google Scholar] [CrossRef] [PubMed]
- Boekaerts, M. Te on-line motivation questionnaire: A self-report instrument to assess students’ context sensitivity. In Advances in Motivation and Achievement; Pintrich, P.R., Maehr, M.L., Eds.; New Directions in Measures and Methods; JAI: Amsterdam, The Netherlands, 2002; Volume 12, pp. 77–120. [Google Scholar]
- Kooli, C. Chatbots in Education and Research: A Critical Examination of Ethical Implications and Solutions. Sustainability 2023, 15, 5614. [Google Scholar] [CrossRef]
- Xia, Q.; Chiu, T.K.F.; Zhou, X.; Chai, C.S.; Cheng, M. Systematic literature review on opportunities, challenges, and future research recommendations of artificial intelligence in education. Comput. Educ. Artif. Intell. 2023, 4, 100118. [Google Scholar] [CrossRef]
- Jeno, L.M.; Vandvik, V.; Eliassen, S.; Grytnes, J. Testing the novelty effect of an m-learning tool on internalization and achievement: A Self-Determination Theory approach. Comput. Educ. 2019, 128, 398–413. [Google Scholar] [CrossRef]
- Degachi, C.; Al Owayyed, M.; Tielman, M.L. Trust and Perceived Control in Burnout Support Chatbots. In Proceedings of the CHI 2023—Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems, Hamburg, Germany, 23–28 April 2023; Association for Computing Machinery (ACM): New York, NY, USA, 2023. [Google Scholar] [CrossRef]
- Mendoza, N.B.; Yan, Z.; King, R.B. Domain-specific motivation and self-assessment practice as mechanisms linking perceived need-supportive teaching to student achievement. Eur. J. Psychol. Educ. 2022, 38, 607–630. [Google Scholar] [CrossRef]
- Tlili, A.; Shehata, B.; Adarkwah, M.A.; Bozkurt, A.; Hickey, D.T.; Huang, R.; Agyemang, B. What if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education. Smart Learn. Environ. 2023, 10, 15. [Google Scholar] [CrossRef]
- Wardat, Y.; Tashtoush, M.; Alali, R.M.A.; Jarrah, A. ChatGPT: A Revolutionary Tool for Teaching and Learning Mathematics. Eurasia J. Math. Sci. Technol. Educ. 2023, 19, em2286. [Google Scholar] [CrossRef]
- Mogavi, R.; Deng, C.; Kim, J.; Zhou, P.; Kwon, Y.D.; Metwally, A.; Tlili, A.; Bassanelli, S.; Bucchiarone, A.; Gujar, S.; et al. Exploring User Perspectives on ChatGPT: Applications, Perceptions, and Implications for AI-Integrated Education. arXiv 2023, arXiv:2305.13114. [Google Scholar] [CrossRef]
- Daher, W.; Baya’a, N.; Jaber, O.; Awawdeh Shahbari, J. A Trajectory for advancing the meta-cognitive solving of mathematics-based programming problems with Scratch. Symmetry 2020, 12, 1627. [Google Scholar] [CrossRef]
- Daher, W. Students’ adoption of social networks as environments for learning and teaching: The case of the Facebook. Int. J. Emerg. Technol. Learn. 2014, 9, 16–24. [Google Scholar] [CrossRef]
Participant | Gender | Ages |
---|---|---|
Ahmed | Male | 39 |
Ali | Male | 45 |
Narmeen | Female | 35 |
Nada | Female | 30 |
Laila | Female | 40 |
Salma | Female | 43 |
Mohammad | Male | 36 |
Omar | Male | 40 |
Abeer | Female | 28 |
Huda | Female | 27 |
Nader | Male | 50 |
Abed | Male | 39 |
Rula | Female | 31 |
Malik | Male | 34 |
Majed | Male | 56 |
Category | Sub-Categories | Codes |
---|---|---|
Task Enjoyment | Enjoyment | Enjoy, Like, Happy, Excited, Interested |
Curiosity | Desire for knowledge, Curiosity about ChatGPT, Curiosity stimuli. | |
Anxiety | Anxious, Distrust, Apprehension, Incorrect Information. | |
Satisfaction | Satisfied, Feeling good, Feeling relieved, Feeling confidence. | |
Reported Effort | Effort/Comfortable | Not tired, Not stressful, Simple, Easy to use, Saves effort. |
Effort/Fatigue | Overthinking, Checking information frequently, effort to verify information. | |
Concentration | Maintain focus, keep attention, high concentration. | |
Time/Spend Time | Time consuming, lose time. | |
Time/Save Time | I do not feel the time, saves time, achievement in a short time. | |
Result Assessment | Self-Assessment | Self-evaluation, Self-performance critique, Reflecting self-perception of progress, Achievement, Self-rating. |
Judgement | Decision making, Judging the validity of information. | |
Verification of Information | Information check, Compare information, and search for other sources. | |
Locus of Control | Performance control during the task, Self-control while dealing with ChatGPT | |
Perceived Relevance | Usefulness/Value | Many tasks can be accomplished through ChatGPT, ChatGPT advantages. |
Usefulness/Useless | ChatGPT disadvantages: Frequent errors, Inaccurate information, Not useful. | |
Self-Goals | Goal setting, self-goal determination, self-goal tracking. | |
Interaction | Feedback | ChatGPT feedback, User feedback, Revision, Response evaluation, Feedback exchange, and Immediate feedback. |
Conversation | Dialogue Interaction, ChatGPT conversation, Conversation flow. |
Categories | Interviews | ||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | |
Enjoyment | x | x | x | x | x | x | x | x | x | x | x | x | |||
Curiosity | x | x | x | x | x | x | x | x | |||||||
Satisfaction | x | x | x | x | x | x | x | x | x | x | x | x | |||
Anxiety | x | x | x | x | x | x | |||||||||
Concentration | x | x | x | x | x | x | x | x | |||||||
Effort | x | x | x | x | x | x | x | x | x | x | x | x | x | x | |
Time | x | x | x | x | x | x | x | x | x | x | x | x | x | x | x |
Verification of Information | x | x | x | x | x | x | x | x | x | x | |||||
Judgement | x | x | x | x | |||||||||||
Self-Assessment | x | x | x | x | x | x | x | x | x | ||||||
Locus of Control | x | x | x | x | x | x | x | x | x | x | |||||
Usefulness | x | x | x | x | x | x | x | x | x | x | x | x | x | x | x |
Self-Goals | x | x | x | x | x | x | x | x | x | x | x | x | x | ||
Feedback | x | x | x | x | x | ||||||||||
Conversation | x | x | x | x | x | x | x | x | x | x | |||||
New codes in each interview | 6 | 3 | 2 | 0 | 1 | 0 | 0 | 1 | 2 | 0 | 0 | 0 | 0 | 0 | 0 |
Subject | Frequency | Categories | Frequency | Sub-Categories | Frequency |
---|---|---|---|---|---|
Students’ task motivation using ChatGPT | 145 | Task Enjoyment | 37 | Enjoyment | 12 |
Curiosity | 8 | ||||
Satisfaction | 11 | ||||
Anxiety | 6 | ||||
Reported Effort | 35 | Concentration | 8 | ||
Effort | 13 | ||||
Time | 14 | ||||
Result Assessment | 32 | Verification of Info. | 10 | ||
Judgement | 4 | ||||
Self-Assessment | 8 | ||||
Locus of Control | 10 | ||||
Perceived Relevance | 26 | Usefulness | 14 | ||
Self-Goals | 12 | ||||
Interaction | 15 | Feedback | 5 | ||
Conversation | 10 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Hmoud, M.; Swaity, H.; Hamad, N.; Karram, O.; Daher, W. Higher Education Students’ Task Motivation in the Generative Artificial Intelligence Context: The Case of ChatGPT. Information 2024, 15, 33. https://doi.org/10.3390/info15010033
Hmoud M, Swaity H, Hamad N, Karram O, Daher W. Higher Education Students’ Task Motivation in the Generative Artificial Intelligence Context: The Case of ChatGPT. Information. 2024; 15(1):33. https://doi.org/10.3390/info15010033
Chicago/Turabian StyleHmoud, Mohammad, Hadeel Swaity, Nardin Hamad, Omar Karram, and Wajeeh Daher. 2024. "Higher Education Students’ Task Motivation in the Generative Artificial Intelligence Context: The Case of ChatGPT" Information 15, no. 1: 33. https://doi.org/10.3390/info15010033
APA StyleHmoud, M., Swaity, H., Hamad, N., Karram, O., & Daher, W. (2024). Higher Education Students’ Task Motivation in the Generative Artificial Intelligence Context: The Case of ChatGPT. Information, 15(1), 33. https://doi.org/10.3390/info15010033