The Impact of AI Usage on University Students’ Willingness for Autonomous Learning
Abstract
:1. Introduction
2. Literature Review and Research Hypotheses
2.1. Expectation-Confirmation Model and Its Limitations
2.2. Digital Efficacy
2.3. Positive Emotions
2.4. Willingness for Autonomous Learning
3. Research Methodology
3.1. Questionnaire Design
3.2. Reliability and Validity Testing
3.3. Research Procedure
4. Research Results
4.1. Descriptive Statistics of Variables
4.2. Path Analysis of the Structural Equation Model
4.3. Mediation Effects
4.4. Moderation Effect Analysis
5. Discussion and Implication
5.1. Discussion and Conclusions
5.2. Implications for Practice
5.2.1. Enhance AI Technology Promotion to Increase Expectation Confirmation
5.2.2. Foster Positive Emotions in AI Use to Achieve a “Human–Machine Symbiosis” Deep Learning Model
5.2.3. Cultivate Digital Efficacy to Empower More Effective Personalized Learning
5.3. Limitations and Directions for Future Research
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- Moscardini, A.O.; Strachan, R.; Vlasova, T. The role of universities in modern society. Stud. High. Educ. 2020, 47, 812–830. [Google Scholar] [CrossRef]
- Cotton, D.R.E.; Cotton, P.A.; Shipway, J.R. Chatting and Cheating: Ensuring Academic Integrity in the era of ChatGPT. Innov. Educ. Teach. Int. 2023, 61, 228–239. [Google Scholar] [CrossRef]
- du Boulay, B.; Mitrović, A.; Yacef, K. Handbook of Artificial Intelligence in Education; Edward Elgar Publishing: Cheltenham, UK, 2023. [Google Scholar]
- Iku-Silan, A.; Hwang, G.-J.; Chen, C.-H. Decision-Guided Chatbots and Cognitive Styles in Interdisciplinary Learning. Comput. Educ. 2023, 201, 104812. [Google Scholar] [CrossRef]
- Ryan, T.; French, S.; Kennedy, G. Beyond the Iron Triangle: Improving the Quality of Teaching and Learning at Scale. Stud. High. Educ. 2019, 46, 1383–1394. [Google Scholar] [CrossRef]
- Essel, H.B.; Vlachopoulos, D.; Tachie-Menson, A.; Johnson, E.E.; Baah, P.K. The Impact of a Virtual Teaching Assistant (Chatbot) on Students’ Learning in Ghanaian Higher Education. Int. J. Educ. Technol. High. Educ. 2022, 19, 57. [Google Scholar] [CrossRef]
- Atlas, S. ChatGPT for Higher Education and Professional Development: A Guide to Conversational AI. 2023. Available online: https://digitalcommons.uri.edu/cba_facpubs/548 (accessed on 6 August 2024).
- Berg, C. The Case for Generative AI in Scholarly Practice. 2023. Available online: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4407587 (accessed on 6 August 2024).
- Popenici, S.A.D.; Kerr, S. Exploring the Impact of Artificial Intelligence on Teaching and Learning in Higher Education. Res. Pract. Technol. Enhanc. Learn. 2017, 12, 22. [Google Scholar] [CrossRef] [PubMed]
- Bhattacherjee, A. Understanding Information Systems Continuance: An Expectation Confirmation Model. MIS Q. 2001, 25, 351–370. [Google Scholar] [CrossRef]
- Kim, S.H.; Bae, J.H.; Jeon, H.M. Continuous Intention on Accommodation Apps: Integrated Value-based Adoption and Expectation Confirmation Model Analysis. Sustainability 2019, 11, 1578. [Google Scholar] [CrossRef]
- Dai, H.M.; Teo, T.; Rappa, N.A.; Huang, F. Explaining Chinese University Students’ Continuance Learning Intention in the MOOC Setting: A Modified Expectation Confirmation Model Perspective. Comput. Educ. 2020, 150, 103850. [Google Scholar] [CrossRef]
- Gupta, A.; Dhiman, N.; Yousaf, A.; Thurasamy, R. Social Comparison and Continuance Intention of Smart Fitness Wearables: An Extended Expectation Confirmation Theory Perspective. Behav. Inf. Technol. 2021, 40, 1341–1354. [Google Scholar] [CrossRef]
- Bhattacherjee, A.; Premkumar, G. Understanding Changes in Belief and Attitude toward Information Technology Usage: A Theoretical Model and Longitudinal Test. MIS Q. 2004, 28, 229–254. [Google Scholar] [CrossRef]
- Davis, F.D. Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology. MIS Q. 1989, 13, 319–340. [Google Scholar] [CrossRef]
- Kuo, Y.-C.; Walker, A.E.; Schroder, K.E.E.; Belland, B.R. Interaction, Internet Self-efficacy, and Self-regulated Learning as Predictors of Student Satisfaction in Online Education Courses. Internet High. Educ. 2014, 20, 35–50. [Google Scholar] [CrossRef]
- Hong, J.; Lee, O.-K.D.; Suh, W. A Study of the Continuous Usage Intention of Social Software in the Context of Instant Messaging. Online Inf. Rev. 2013, 37, 692–710. [Google Scholar] [CrossRef]
- Blondeel, E.; Everaert, P.C.; Opdecam, E. Does Practice Make Perfect? The Effect of Online Formative Assessments on Students’ Self-Efficacy and Test Anxiety; SSRN: Rochester, NY, USA, 2023; Volume 12, Available online: https://papers.ssrn.com/abstract=4357056 (accessed on 17 August 2024).
- Paetsch, J.; Drechsel, B. Factors influencing pre-service teachers’ intention to use digital learning materials: A study conducted during the COVID-19 pandemic in Germany. Front. Psychol. 2021, 12, 733830. [Google Scholar] [CrossRef]
- Bandura, A. Self-efficacy: Toward a Unifying Theory of Behavioral Change. Psychol. Rev. 1977, 84, 191–215. [Google Scholar] [CrossRef]
- Biggs, J.B. Teaching for Quality Learning at University: What the Student Does; McGraw-Hill Education: London, UK, 2011. [Google Scholar]
- Lee, Y.H.; Hsieh, Y.C.; Hsu, C.N. Adding Innovation Diffusion Theory to the Technology Acceptance Model: Supporting Employees’ Intentions to Use E-Learning Systems. Educ. Technol. Soc. 2011, 14, 124–137. [Google Scholar]
- Joo, Y.J.; Lim, K.Y.; Kim, J. Locus of Control, Self-efficacy, and Task Value as Predictors of Learning Outcome in an Online University Context. Comput. Educ. 2013, 62, 149–158. [Google Scholar] [CrossRef]
- Altalhi, M. Toward a Model for Acceptance of MOOCs in Higher Education: The Modified UTAUT Model for Saudi Arabia. Educ. Inf. Technol. 2021, 26, 1589–1605. [Google Scholar] [CrossRef]
- Zadorozhnyy, A.; Ju, S.; Lee, J. Informal Digital Learning of English and Willingness to Communicate in a Second Language: Self-efficacy Beliefs as a Mediator. Comput. Assist. Lang. Learn. 2023, 5, 1–21. [Google Scholar] [CrossRef]
- Chik, A. Digital Gaming and Language Learning: Autonomy and Community. Lang. Learn. Technol. 2014, 18, 85–100. [Google Scholar]
- Jacobs, G.E.; Castek, J. Digital Problem Solving: The Literacies of Navigating Life in the Digital Age. J. Adolesc. Adult Lit. 2018, 61, 681–685. [Google Scholar] [CrossRef]
- Chan, C.K.Y.; Hu, W. Students’ Voices on Generative AI: Perceptions, Benefits, and Challenges in Higher Education. Int. J. Educ. Technol. High. Educ. 2023, 20, 43. [Google Scholar] [CrossRef]
- Ding, Y. Looking Forward: The Role of Hope in Information System Continuance. Comput. Hum. Behav. 2018, 91, 127–137. [Google Scholar] [CrossRef]
- Oliver, R.L. A Cognitive Model of the Antecedents and Consequences of Satisfaction Decisions. J. Mark. Res. 1980, 17, 460–469. [Google Scholar] [CrossRef]
- Bearman, M.; Ajjawi, R. Learning to Work with the Black Box: Pedagogy for a World with Artificial Intelligence. Br. J. Educ. Technol. 2023, 54, 1160–1173. [Google Scholar] [CrossRef]
- Getenet, S.; Cantle, R.; Redmond, P.; Albion, P. Students’ Digital Technology Attitude, Literacy and Self-efficacy and Their Effect on Online Learning Engagement. Int. J. Educ. Technol. High. Educ. 2024, 21, 3. [Google Scholar] [CrossRef]
- Liu, G.; Ma, C. Measuring EFL Learners’ Use of ChatGPT in Informal Digital Learning of English Based on the Technology Acceptance Model. Innov. Lang. Learn. Teach. 2023, 18, 125–138. [Google Scholar] [CrossRef]
- Darvishi, A.; Khosravi, H.; Sadiq, S.; Gašević, D.; Siemens, G. Impact of AI Assistance on Student Agency. Comput. Educ. 2024, 210, 104967. [Google Scholar] [CrossRef]
- Zhang, C.; Meng, Y.; Ma, X. Artificial Intelligence in EFL Speaking: Impact on Enjoyment, Anxiety, and Willingness to Communicate. System 2024, 121, 103259. [Google Scholar] [CrossRef]
- Kamita, T.; Ito, T.; Matsumoto, A.; Munakata, T.; Inoue, T. A Chatbot System for Mental Healthcare Based on SAT Counseling Method. Mob. Inf. Syst. 2019, 2019, 9517321. [Google Scholar] [CrossRef]
- Owens, J.; Lilly, F. The Influence of Academic Discipline, Race, and Gender on Web-use Skills among Graduate-level Students. J. Comput. High. Educ. 2017, 29, 286–308. [Google Scholar] [CrossRef]
- Venkatesh, V.; Morris, M.G.; Davis, G.B.; Davis, F.D. User Acceptance of Information Technology: Toward a Unified View. MIS Q. 2003, 27, 425–478. [Google Scholar] [CrossRef]
- Compeau, D.R.; Higgins, C.A. Computer Self-Efficacy: Development of a Measure and Initial Test. MIS Q. 1995, 19, 189–211. [Google Scholar] [CrossRef]
- Özkan, S.; Koseler, R. Multi-dimensional students’ evaluation of e-learning systems in the higher education context: An empirical investigation. Comput. Educ. 2009, 53, 1285–1296. [Google Scholar] [CrossRef]
- Hu, L.; Bentler, P.M. Cutoff Criteria for Fit Indexes in Covariance Structure Analysis: Conventional Criteria Versus New Alternatives. Struct. Equ. Model. Multidiscip. J. 1999, 6, 1–55. [Google Scholar] [CrossRef]
- Ni, A.; Cheung, A. Understanding Secondary Students’ Continuance Intention to Adopt AI-powered Intelligent Tutoring System for English Learning. Educ. Inf. Technol. 2023, 28, 3191–3216. [Google Scholar] [CrossRef]
- Chai, C.S.; Lin, P.Y.; Jong, M.S.Y.; Dai, Y.; Chiu, T.K.; Qin, J. Perceptions of and Behavioral Intentions towards Learning Artificial Intelligence in Primary School Students. Educ. Technol. Soc. 2021, 24, 89–101. [Google Scholar]
- Bai, B.; Wang, J.; Chai, C.S. Understanding Hong Kong Primary School English Teachers’ Continuance Intention to Teach with ICT. Comput. Assist. Lang. Learn. 2021, 34, 528–551. [Google Scholar] [CrossRef]
- Zheng, J.; Li, S. What Drives Students’ Intention to Use Tablet Computers? An Extended Technology Acceptance Model. Int. J. Educ. Res. 2020, 12, 101612. [Google Scholar] [CrossRef]
- Wang, Q.; Sun, J. Research on the Influencing Factors of Users’ Continuous Contribution Behavior in Network Group Collaboration. Libr. J. 2018, 37, 12–20. (In Chinese) [Google Scholar]
- Liu, Q.; Pang, H.; Wang, X.H.; Zhu, J. Artificial Intelligence Support for Language Study: How Anthropomorphic Technology Affects Study. J. Electrochem. Educ. Res. 2022, 10, 102–109. (In Chinese) [Google Scholar] [CrossRef]
- Tai, T.Y.; Chen, H.J. The Impact of Google Assistant on Adolescent EFL Learners’ Willingness to Communicate. Interact. Learn. Environ. 2023, 31, 1485–1502. [Google Scholar] [CrossRef]
- The Ministry of Education. Notice on Issuing the Action Plan on Artificial Intelligence Innovation in Universities [EB/OL]. (2018-12-31). Available online: https://www.gov.cn/zhengce/zhengceku/2018-12/31/content_5443346.htm (accessed on 24 August 2024).
- Dunn, T.J.; Kennedy, M. Technology Enhanced Learning in Higher Education: Motivations, Engagement and Academic Achievement. Comput. Educ. 2019, 137, 104–113. [Google Scholar] [CrossRef]
- Ouyang, L.; Wu, J.; Jiang, X.; Almeida, D.; Wainwright, C.; Mishkin, P.; Zhang, C.; Agarwal, S.; Slama, K.; Ray, A.; et al. Training Language Models to Follow Instructions with Human Feedback. Adv. Neural Inf. Process. Syst. 2022, 35, 27730–27744. [Google Scholar]
- Lv, L.; Gong, F. Knowledge Purport: The Deep Driving Force Affecting the Quality of Undergraduate Learning Experience in Top Universities: Based on the SERU Survey Data of Eight Universities in China and the United States (2017–2018). High. Educ. Jiangsu 2019, 9, 57–65. (In Chinese) [Google Scholar] [CrossRef]
- Sun, T.; Linzi, T. Game and Construction of Human-Technology Relationship in Artificial Intelligence Education: From Reverse Domestication to Technical Mediation. Open Educ. Res. 2021, 27, 37–43. (In Chinese) [Google Scholar] [CrossRef]
- Trimmel, M.; Bachmann, J. Cognitive, Social, Motivational, and Health Aspects of Students in Laptop Classrooms. J. Comput. Assist. Learn. 2004, 20, 151–158. [Google Scholar] [CrossRef]
- Li, B.; Bonk, C.J.; Wang, C.; Kou, X. Reconceptualizing Self-Directed Learning in the Era of Generative AI: An Exploratory Analysis of Language Learning. IEEE Trans. Learn. Technol. 2024, 17, 15–29. [Google Scholar] [CrossRef]
- Glynn, S.M.; Brickman, P.; Armstrong, N.; Taasoobshirazi, G. Science Motivation Questionnaire II: Validation with Science Majors and Nonscience Majors. J. Res. Sci. Teach. 2011, 48, 1159–1176. [Google Scholar] [CrossRef]
- Dings, R. Meaningful Affordances. Synthese 2020, 199, 1855–1875. [Google Scholar] [CrossRef]
- Huang, A.Y.Q.; Lu, O.H.T.; Yang, S.J.H. Effects of Artificial Intelligence–Enabled Personalized Recommendations on Learners’ Learning Engagement, Motivation, and Outcomes in a Flipped Classroom. Comput. Educ. 2023, 194, 104684. [Google Scholar] [CrossRef]
- Miyagawa, S. Ethics Education Must Accompany AI Development. Times Highigher Education. 2019. Available online: https://www.timeshighereducation.com/cn/news/ethics-education-must-accompany-ai-development-says-mit-expert (accessed on 18 September 2024).
Latent Variable | Measurement Items | Source |
---|---|---|
Expectation Confirmation | 1. The learning outcomes from using generative AI exceeded my expectations. | Adapted from Davis et al. (1989) [15] |
2. Using generative AI has enriched my learning experience. | ||
3. Generative AI provides the learning resources I need. | ||
4. The use of generative AI tools meets my expectations and needs. | ||
Perceived Usefulness | 1. I believe that using generative AI enhances my learning efficiency. | |
2. I believe that using generative AI improves my learning outcomes. | ||
3. I believe that using generative AI helps me achieve my learning goals. | ||
4. Using generative AI aids in my deep understanding of the learning content. | ||
5. Using generative AI tools is an effective use of my time. | ||
Satisfaction | 1. I am satisfied with the benefits that generative AI brings to my learning. | |
2. The information and suggestions provided by generative AI during the learning process are useful. | ||
3. Generative AI technology meets my personalized learning needs. | ||
4. I am satisfied with the way generative AI interacts with me (e.g., response speed, response quality). | ||
Continuance Intention | 1. I intend to continue using generative AI technology. | |
2. I will consider using generative AI to assist me when I have learning needs. | ||
3. I would recommend generative AI technology to other students for learning. | ||
Willingness for Autonomous Learning | 1. I am willing to use generative AI for autonomous learning. | Adapted from Davis (1989) [15] and Venkatesh et al. (2003) [38] |
2. After using generative AI tools, I am better at planning my learning activities. | ||
3. After using generative AI tools, I actively seek and learn more related knowledge. | ||
4. After using generative AI tools, I find it easier to find motivation and direction for learning. | ||
Self-Efficacy | 1. I can use AI technology to obtain the information I need. | Adapted from Compeau and Higgins (1995) [39] |
2. I am confident that I can learn AI-related skills even in unfamiliar areas. | ||
3. I expect that I can keep up with the advancements in AI technology and complete diverse learning tasks. | ||
4. I can customize AI technology based on my learning needs. | ||
Positive Emotions | 1. Using generative AI tools makes me more curious and interested in learning, prompting me to explore further based on specific dialogues. | Adapted from Ozkan and Koseler (2009) [40] |
2. Using generative AI tools effectively reduces my procrastination and learning anxiety. | ||
3. When using generative AI for learning, I often feel positive and optimistic, even when facing challenges. |
Variable | Item Reliability (STD) | Internal Consistency (Cronbach’s Alpha) | Squared Multiple Correlation (SMC) | Convergent Validity (AVE) |
---|---|---|---|---|
Expectation Confirmation | 0.781–0.807 | 0.871 | 0.611–0.652 | 0.628 |
Perceived Usefulness | 0.779–0.813 | 0.898 | 0.606–0.661 | 0.639 |
Satisfaction | 0.790–0.816 | 0.88 | 0.625–0.666 | 0.648 |
Continuance Intention | 0.789–0.804 | 0.838 | 0.622–0.646 | 0.634 |
Willingness for Autonomous Learning | 0.791–0.818 | 0.878 | 0.626–0.670 | 0.643 |
Digital Efficacy | 0.770–0.816 | 0.875 | 0.593–0.665 | 0.637 |
Positive Emotions | 0.794–0.826 | 0.88 | 0.630–0.682 | 0.647 |
Demographic Variables | N | % | |
---|---|---|---|
Gender | Female | 279 | 38.7 |
Male | 442 | 61.3 | |
Types of universities | Double First-Class universities | 258 | 35.78 |
Regular universities | 463 | 64.22 | |
Grade | Freshmen | 119 | 16.5 |
Sophomores | 131 | 18.2 | |
Juniors | 175 | 24.2 | |
Seniors | 296 | 41.1 | |
Disciplinary types | Humanities | 141 | 19.6 |
Social Sciences | 202 | 28 | |
Natural Sciences | 190 | 26.4 | |
Engineering | 188 | 26 | |
Academic Performance | Top 25% | 316 | 43.8 |
26–50% | 208 | 28.9 | |
51–75% | 129 | 17.9 | |
Bottom Quartile | 68 | 9.4 |
Variable | Mean | Standard Deviation | Min | Max | One-Sample t-Test |
---|---|---|---|---|---|
Expectation Confirmation | 3.47 | 1.052 | 1 | 5 | 88.539 *** |
Perceived Usefulness | 3.462 | 1.057 | 1 | 5 | 87.964 *** |
Satisfaction | 3.500 | 1.064 | 1 | 5 | 88.071 *** |
Continuance Intention | 3.472 | 1.089 | 1 | 5 | 85.64 0*** |
Willingness for Autonomous Learning | 3.276 | 1.069 | 1 | 5 | 87.299 *** |
Digital Efficacy | 3.257 | 1.058 | 1 | 5 | 87.697 *** |
Positive Emotions | 3.483 | 1.063 | 1 | 5 | 90.372 *** |
Independent Variable | Dependent Variable | Estimate | Standard Error | p-Value | Result |
---|---|---|---|---|---|
Expectation Confirmation | Perceived Usefulness | 0.52 | 0.035 | 0.000 | Supported |
Expectation Confirmation | Digital Efficacy | 0.235 | 0.037 | 0.001 | Supported |
Expectation Confirmation | Satisfaction | 0.164 | 0.042 | 0.000 | Supported |
Expectation Confirmation | Positive Emotions | 0.561 | 0.034 | 0.000 | Supported |
Digital Efficacy | Satisfaction | 0.216 | 0.034 | 0.000 | Supported |
Perceived Usefulness | Continuance Intention | −0.035 | 0.039 | 0.362 | Not Supported |
Perceived Usefulness | Satisfaction | 0.309 | 0.039 | 0.000 | Supported |
Positive Emotions | Continuance Intention | 0.148 | 0.038 | 0.000 | Supported |
Satisfaction | Continuance Intention | 0.143 | 0.044 | 0.001 | Supported |
Digital Efficacy | Continuance Intention | 0.131 | 0.04 | 0.000 | Supported |
Continuance Intention | Willingness for Autonomous Learning | 0.314 | 0.035 | 0.000 | Supported |
Digital Efficacy | Willingness for Autonomous Learning | 0.234 | 0.035 | 0.000 | Supported |
Dependent Variable | Pathway | Effect | BootSE | BootLLCI | BootULCI |
---|---|---|---|---|---|
Satisfaction | Mediation Effect | 0.211 | 0.024 | 0.16 | 0.256 |
Expectation Confirmation → Perceived Usefulness → Satisfaction | 0.161 | 0.024 | 0.111 | 0.206 | |
Expectation Confirmation → Digital Efficacy → Satisfaction | 0.051 | 0.012 | 0.027 | 0.073 | |
Continuance Intention | Mediation Effect | 0.137 | 0.023 | 0.091 | 0.184 |
Expectation Confirmation → Positive Emotions → Continuance Intention | 0.083 | 0.009 | 0.039 | 0.127 | |
Expectation Confirmation → Digital Efficacy → Continuance Intention | 0.031 | 0.011 | 0.009 | 0.052 | |
Expectation Confirmation → Satisfaction → Continuance Intention | 0.023 | 0.022 | 0.005 | 0.042 |
Pathway | Academic Background | |||
---|---|---|---|---|
Humanities | Social Sciences | Natural Sciences | Engineering Sciences | |
Continuance Intention → Willingness for Autonomous Learning | 0.314 *** | 0.518 *** | 0.442 *** | 0.382 *** |
Digital Efficacy → Willingness for Autonomous Learning | 0.257 *** | 0.264 *** | 0.362 *** | 0.176 *** |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Wang, L.; Li, W. The Impact of AI Usage on University Students’ Willingness for Autonomous Learning. Behav. Sci. 2024, 14, 956. https://doi.org/10.3390/bs14100956
Wang L, Li W. The Impact of AI Usage on University Students’ Willingness for Autonomous Learning. Behavioral Sciences. 2024; 14(10):956. https://doi.org/10.3390/bs14100956
Chicago/Turabian StyleWang, Ling, and Wenye Li. 2024. "The Impact of AI Usage on University Students’ Willingness for Autonomous Learning" Behavioral Sciences 14, no. 10: 956. https://doi.org/10.3390/bs14100956
APA StyleWang, L., & Li, W. (2024). The Impact of AI Usage on University Students’ Willingness for Autonomous Learning. Behavioral Sciences, 14(10), 956. https://doi.org/10.3390/bs14100956