Exploring How AI Literacy and Self-Regulated Learning Relate to Student Writing Performance and Well-Being in Generative AI-Supported Higher Education
Abstract
:1. Introduction
2. Literature Review
2.1. The Influence of Learner Factors in GAI-Supported Writing Environments
2.2. The Opportunities and Challenges of GAI in Academic Writing
2.3. The Impact of GAI on Student Well-Being in Higher Education
2.4. The Present Study and Hypothetical Model
3. Materials and Methods
3.1. Participants and Procedure
3.2. Instruments
3.3. Statistical Analyses
4. Results
4.1. Measurement Validation
4.2. Test of Structural Model
4.3. Exploratory Mediation Analysis
5. Discussion
5.1. The Impact of AI Literacy and SRL on Writing Performance
5.2. The Impact of AI Literacy on GAI-Driven Well-Being
5.3. The Mediating Role of Writing Performance in the Relationship Between AI Literacy, SRL, and GAI-Driven Well-Being
6. Conclusions, Limitations, and Implications
6.1. Conclusions
6.2. Limitations
6.3. Implications
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
Appendix A. Survey Items Used in This Study
- AI Literacy
- 2.
- Self-Regulated Learning (SRL)
- 3.
- Writing Performance
- 4.
- GAI-Driven Well-Being
References
- Akgun, S., & Greenhow, C. (2022). Artificial intelligence in education: Addressing ethical challenges in K-12 settings. AI and Ethics, 2(3), 431–440. [Google Scholar] [CrossRef] [PubMed]
- Alkaissi, H., & McFarlane, S. I. (2023). Artificial hallucinations in ChatGPT: Implications in scientific writing. Cureus, 15(2), e35179. [Google Scholar] [CrossRef] [PubMed]
- Almatrafi, O., Johri, A., & Lee, H. (2024). A systematic review of AI literacy conceptualization, constructs, and implementation and assessment efforts (2019–2023). Computers and Education Open, 6, 100173. [Google Scholar] [CrossRef]
- Bai, B. (2015). The effects of strategy-based writing instruction in Singapore primary schools. System, 53, 96–106. [Google Scholar] [CrossRef]
- Bandura, A. (1991). Social cognitive theory of self-regulation. Organizational Behavior and Human Decision Processes, 50(2), 248–287. [Google Scholar] [CrossRef]
- Barnard, L., Lan, W. Y., To, Y. M., Paton, V. O., & Lai, S. L. (2009). Measuring self-regulation in online and blended learning environments. Internet and Higher Education, 12(1), 1–6. [Google Scholar] [CrossRef]
- Bauer, J. F., & Anderson, R. S. (2000). Evaluating students’ written performance in the online classroom. New Directions for Teaching and Learning, 2000(84), 65–71. [Google Scholar] [CrossRef]
- Bašić, Ž., Banovac, A., Kružić, I., & Jerković, I. (2023). ChatGPT-3.5 as writing assistance in students’ essays. Humanities and Social Sciences Communications, 10(1), 1–5. [Google Scholar] [CrossRef]
- Burr, C., Taddeo, M., & Floridi, L. (2020). The ethics of digital well-being: A thematic review. Science and Engineering Ethics, 26(4), 2313–2343. [Google Scholar] [CrossRef]
- Cambra-Fierro, J. J., Blasco, M. F., López-Pérez, M.-E. E., & Trifu, A. (2025). ChatGPT adoption and its influence on faculty well-being: An empirical research in higher education. Education and Information Technologies, 30(2), 1517–1538. [Google Scholar] [CrossRef]
- Chen, T. J. (2023). ChatGPT and other artificial intelligence applications speed up scientific writing. Journal of the Chinese Medical Association, 86(4), 351–353. [Google Scholar] [CrossRef]
- Choudhuri, R., Liu, D., Steinmacher, I., Gerosa, M., & Sarma, A. (2024, April 14–20). How far are we? The triumphs and trials of generative AI in learning software engineering. IEEE/ACM 46th International Conference on Software Engineering (ICSE ‘24) (Article No. 184, pp. 1–13), Lisbon, Portugal. [Google Scholar] [CrossRef]
- Crawford, J., Allen, K.-A., Pani, B., & Cowling, M. (2024). When artificial intelligence substitutes humans in higher education: The cost of loneliness, student success, and retention. Studies in Higher Education, 49(5), 883–897. [Google Scholar] [CrossRef]
- Davis, F. D. (1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. Mis Quarterly, 13(3), 319–340. [Google Scholar] [CrossRef]
- Davis, F. D., Bagozzi, R. P., & Warshaw, P. R. (1989). User acceptance of computer technology: A comparison of two theoretical models. Management Science, 35(8), 982–1003. [Google Scholar] [CrossRef]
- De Silva, R., & Graham, S. (2015). The effects of strategy instruction on writing strategy use for students of different proficiency levels. System, 53, 47–59. [Google Scholar] [CrossRef]
- Druga, S., Yip, J., Preston, M., & Dillon, D. (2023). The 4 As: Ask, Adapt, Author, Analyze: AI Literacy Framework for Families. In Algorithmic Rights and Protections for Children. The MIT Press. [Google Scholar] [CrossRef]
- Fitria, T. N. (2021). Grammarly as AI-powered english writing assistant: Students’ alternative for writing english. Metathesis: Journal of English Language, Literature, and Teaching, 5(1), 65. [Google Scholar] [CrossRef]
- Flavian, H., & Alstete, J. W. (2024). Guest editorial: Fostering inclusive approaches for learners with special needs. Quality Assurance in Education: An International Perspective, 32(4), 529–532. [Google Scholar] [CrossRef]
- Fyfe, P. (2023). How to cheat on your final paper: Assigning AI for student writing. AI & Society, 38(4), 1395–1405. [Google Scholar] [CrossRef]
- González-López, Ó. R., Buenadicha-Mateos, M., & Isabel Sánchez-Hernández, M. (2021). Overwhelmed by technostress? Sensitive archetypes and effects in times of forced digitalization. International Journal of Environmental Research and Public Health, 18(8), 4216. [Google Scholar] [CrossRef]
- Gui, M., Fasoli, M., & Carradore, R. (2017). Digital well-being. Developing a new theoretical tool for media literacy research. Italian Journal of Sociology of Education, 9(1), 155–173. [Google Scholar] [CrossRef]
- Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (Eds.). (2014). Multivariate data analysis (7th ed.). Pearson. [Google Scholar]
- Hu, M., Chua, X. C. W., Diong, S. F., Kasturiratna, K. T. A. S., Majeed, N. M., & Hartanto, A. (2025). AI as your ally: The effects of AI-assisted venting on negative affect and perceived social support. Applied Psychology: Health and Well-Being, 17(1), e12621. [Google Scholar] [CrossRef] [PubMed]
- Kandlhofer, M., Steinbauer, G., Hirschmugl-Gaisch, S., & Huber, P. (2016, October 12–15). Artificial intelligence and computer science in education: From kindergarten to university. 2016 IEEE Frontiers in Education Conference (FIE) (pp. 1–9), Erie, PA, USA. [Google Scholar]
- Kasneci, E., Seßler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., Krusche, S., Kutyniok, G., Michaeli, T., Nerdel, C., Pfeffer, J., Poquet, O., Sailer, M., Schmidt, A., Seidel, T., … Stadler, M. (2023). ChatGPT for good? On opportunities and challenges of large language models for education. Learning and Individual Differences, 103, 102274. [Google Scholar] [CrossRef]
- Kim, D., Yoon, M., Branch, R. M., & Jo, I.-H. (2018). Learning analytics to support self-regulated learning in asynchronous online courses: A case study at a women’s university in South Korea. Computers and Education, 127, 233–251. [Google Scholar] [CrossRef]
- Kim, J., & Cho, Y. H. (2023). My teammate is AI: Understanding students’ perceptions of student-AI collaboration in drawing tasks. Asia Pacific Journal of Education, 1–15. [Google Scholar] [CrossRef]
- Kim, J., Yu, S., Detrick, R., & Li, N. (2025). Exploring Students’ Perspectives on Generative AI-Assisted Academic Writing. Education and Information Technologies, 30(1), 1265–1300. [Google Scholar] [CrossRef]
- Klimova, B., & Pikhart, M. (2025). Exploring the effects of artificial intelligence on student and academic well-being in higher education: A mini-review. Frontiers in Psychology, 16, 1498132. [Google Scholar] [CrossRef]
- Kline, R. B. (2010). Principles and practice of structural equation modeling (3rd ed.). Guilford Press. [Google Scholar]
- Lin, M. P.-C., & Chang, D. (2020). Enhancing post-secondary writers’ writing skills with a chatbot: A mixed-method classroom study. Educational Technology & Society, 23(1), 78–92. Available online: https://www.jstor.org/stable/26915408 (accessed on 20 April 2025).
- Lin, Z. (2024). Techniques for supercharging academic writing with generative AI. Nature Biomedical Engineering, 9, 426–431. [Google Scholar] [CrossRef] [PubMed]
- Liu, M., Zhang, L. J., & Biebricher, C. (2024). Investigating students’ cognitive processes in generative AI-assisted digital multimodal composing and traditional writing. Computers & Education, 211, 104977. [Google Scholar] [CrossRef]
- Long, D., & Magerko, B. (2020, April 25–30). What is AI literacy? Competencies and design considerations. 2020 CHI Conference on Human Factors in Computing Systems (CHI ‘20) (pp. 1–16), Honolulu, HI, USA. [Google Scholar] [CrossRef]
- Luckin, R., Holmes, W., Griffiths, M., & Forcier, L. B. (2016). Intelligence unleashed: An argument for AI in education. Available online: https://www.pearson.com/content/dam/corporate/global/pearson-dot-com/files/innovation/Intelligence-Unleashed-Publication.pdf (accessed on 4 April 2025).
- Lund, B. D., & Wang, T. (2023). Chatting about ChatGPT: How may AI and GPT impact academia and libraries? Library Hi Tech News, 40(3), 26–29. [Google Scholar] [CrossRef]
- Makhambetova, A., Zhiyenbayeva, N., & Ergesheva, E. (2021). Personalized learning strategy as a tool to improve academic performance and motivation of students. International Journal of Web-Based Learning and Teaching Technologies (IJWLTT), 16(6), 1–17. [Google Scholar] [CrossRef]
- Maleki, N., Padmanabhan, B., & Dutta, K. (2024, June 25–27). AI hallucinations: A misnomer worth clarifying. 2024 IEEE conference on artificial intelligence (CAI) (pp. 133–138), Singapore. [Google Scholar] [CrossRef]
- Malik, A. S., Acharya, S., & Humane, S. (2024). Exploring the impact of security technologies on mental health: A comprehensive review. Cureus, 16(2), e53664. [Google Scholar] [CrossRef] [PubMed]
- Memarian, B., & Doleck, T. (2023). Fairness, Accountability, Transparency, and Ethics (FATE) in Artificial Intelligence (AI) and higher education: A systematic review. Computers and Education: Artificial Intelligence, 5, 100152. [Google Scholar] [CrossRef]
- Miao, F., & Holmes, W. (2023). Guidance for generative AI in education and research. UNESCO Publishing. [Google Scholar] [CrossRef]
- Mzwri, K., & Turcsányi-Szabo, M. (2025). The impact of prompt engineering and a generative AI-driven tool on autonomous learning: A case study. Education Sciences, 15(2), 199. [Google Scholar] [CrossRef]
- Ng, D. T. K., Leung, J. K. L., Chu, S. K. W., & Qiao, M. S. (2021). Conceptualizing AI literacy: An exploratory review. Computers and Education: Artificial Intelligence, 2, 100041. [Google Scholar] [CrossRef]
- Onder, I., & McCabe, S. (2025). How AI hallucinations threaten research integrity in tourism. Annals of Tourism Research, 111, 103900. [Google Scholar] [CrossRef]
- Pekrun, R. (2006). The control-value theory of achievement emotions: Assumptions, corollaries, and implications for educational research and practice. Educational Psychology Review, 18(4), 315–341. [Google Scholar] [CrossRef]
- Pekrun, R., Frenzel, A. C., Goetz, T., & Perry, R. P. (2007). The control-value theory of achievement emotions: An integrative approach to emotions in education. In Emotion in education (pp. 13–36). Academic Press. [Google Scholar] [CrossRef]
- Pekrun, R., Hall, N. C., Goetz, T., & Perry, R. P. (2014). Boredom and academic achievement: Testing a model of reciprocal causation. Journal of Educational Psychology, 106(3), 696. [Google Scholar] [CrossRef]
- Pintrich, P. R. (2000). The role of goal orientation in self-regulated learning. In M. Boekaerts, P. R. Pintrich, & M. Zeidner (Eds.), Handbook of self-regulation (pp. 451–502). Academic Press. [Google Scholar] [CrossRef]
- Prentice, F. M., & Kinden, C. E. (2018). Paraphrasing tools, language translation tools and plagiarism: An exploratory study. International Journal for Educational Integrity, 14(1), 1–16. [Google Scholar] [CrossRef]
- Rodway, P., & Schepman, A. (2023). The impact of adopting AI educational technologies on projected course satisfaction in university students. Computers and Education: Artificial Intelligence, 5, 100150. [Google Scholar] [CrossRef]
- Rogerson, A. M., & McCarthy, G. (2017). Using Internet based paraphrasing tools: Original work, patchwriting or facilitated plagiarism? International Journal for Educational Integrity, 13(1), 2. [Google Scholar] [CrossRef]
- Rowland, D. R. (2023). Two frameworks to guide discussions around levels of acceptable use of generative AI in student academic research and writing. Journal of Academic Language and Learning, 17(1), T31–T69. [Google Scholar]
- Ryff, C. D., & Keyes, C. L. M. (1995). The structure of psychological well-being revisited. Journal of Personality and Social Psychology, 69(4), 719–727. [Google Scholar] [CrossRef] [PubMed]
- Salvagno, M., Taccone, F. S., & Gerli, A. G. (2023). Can artificial intelligence help for scientific writing? Critical Care, 27(1), 75. [Google Scholar] [CrossRef] [PubMed]
- Sethi, S. S., & Jain, K. (2024). AI technologies for social emotional learning: Recent research and future directions. Journal of Research in Innovative Teaching & Learning, 17(2), 213–225. [Google Scholar] [CrossRef]
- Shahzad, M. F., Xu, S., Lim, W. M., Yang, X. B., & Khan, Q. R. (2024). Artificial intelligence and social media on academic performance and mental well-being: Student perceptions of positive impact in the age of smart learning. Heliyon, 10(8), e29523. [Google Scholar] [CrossRef] [PubMed]
- Shen, B., & Bai, B. (2024). Enhancing Chinese university students’ writing performance and self-regulated learning (SRL) writing strategy use through a strategy-based intervention. System, 122, 103249. [Google Scholar] [CrossRef]
- Silva, P. (2015). Davis’ technology acceptance model (TAM) (1989). In Information seeking behavior and technology adoption: Theories and trends (pp. 205–219). IGI Global Scientific Publishing. [Google Scholar] [CrossRef]
- Slater, J., & Humphries, J. (2025). Another reason to call bullshit on AI “hallucinations”. AI & Society, prepublish, 1–2. [Google Scholar] [CrossRef]
- Teng, L. S., & Zhang, L. J. (2020). Empowering learners in the second/foreign language classroom: Can self-regulated learning strategies-based writing instruction make a difference? Journal of Second Language Writing, 48, 100701. [Google Scholar] [CrossRef]
- Tov, W. (2018). Well-being concepts and components. In Handbook of subjective well-being (pp. 1–15). Noba Scholar. Available online: https://ink.library.smu.edu.sg/soss_research/2836 (accessed on 12 March 2025).
- Vanden Abeele, M. M. (2021). Digital wellbeing as a dynamic construct. Communication Theory, 31(4), 932–955. [Google Scholar] [CrossRef]
- Wang, B., Rau, P. L. P., & Yuan, T. (2023). Measuring user competence in using artificial intelligence: Validity and reliability of artificial intelligence literacy scale. Behaviour & Information Technology, 42(9), 1324–1337. [Google Scholar] [CrossRef]
- Wang, C. R., & Wang, Z. Z. (2025). Investigating L2 writers’ critical AI literacy in AI-assisted writing: An APSE model. Journal of Second Language Writing, 67, 101187. [Google Scholar] [CrossRef]
- Warschauer, M., Tseng, W., Yim, S., Webster, T., Jacob, S., Du, Q., & Tate, T. (2023). The affordances and contradictions of AI-generated text for writers of English as a second or foreign language. Journal of Second Language Writing, 62, 101071. [Google Scholar] [CrossRef]
- Xie, T., Pentina, I., & Hancock, T. (2023). Friend, mentor, lover: Does chatbot engagement lead to psychological dependence? Journal of Service Management, 34(4), 806–828. [Google Scholar] [CrossRef]
- Yan, L., Greiff, S., Teuber, Z., & Gašević, D. (2024). Promises and challenges of generative artificial intelligence for human learning. Nature Human Behaviour, 8(10), 1839–1850. [Google Scholar] [CrossRef] [PubMed]
- Yang, L. F., Zhang, L. J., & Dixon, H. R. (2023). Understanding the impact of teacher feedback on EFL students’ use of self-regulated writing strategies. Journal of Second Language Writing, 60, 101015. [Google Scholar] [CrossRef]
- Zawacki-Richter, O., Marín, V. I., Bond, M., & Gouverneur, F. (2019). Systematic review of research on artificial intelligence applications in higher education–where are the educators? International Journal of Educational Technology in Higher Education, 16(1), 1–27. [Google Scholar] [CrossRef]
- Zhai, C., Wibowo, S., & Li, L. D. (2024). The effects of over-reliance on AI dialogue systems on students’ cognitive abilities: A systematic review. Smart Learning Environments, 11(1), 28. [Google Scholar] [CrossRef]
- Zhang, Q., Nie, H., Fan, J., & Liu, H. (2025). Exploring the dynamics of artificial intelligence literacy on english as a foreign language learners’ willingness to communicate: The critical mediating roles of artificial intelligence learning self-efficacy and classroom anxiety. Behavioral Sciences, 15(4), 523. [Google Scholar] [CrossRef]
- Zimmerman, B. J. (1990). Self-regulated learning and academic achievement: An overview. Educational Psychologist, 25(1), 3–17. [Google Scholar] [CrossRef]
- Zimmerman, B. J. (2002). Becoming a self-regulated learner: An overview. Theory into Practice, 41(2), 64–70. [Google Scholar] [CrossRef]
- Zimmerman, B. J., & Pons, M. M. (1986). Development of a structured interview for assessing student use of self-regulated learning strategies. American Educational Research Journal, 23(4), 614–628. Available online: http://www.jstor.org/stable/1163093 (accessed on 19 March 2025). [CrossRef]
- Zimmerman, B. J., & Schunk, D. H. (Eds.). (2001). Reflections on theories of self-regulated learning and academic achievement. In Self-regulated learning and academic achievement: Theoretical perspectives (pp. 289–307). Lawrence Erlbaum. [Google Scholar]
Demographic Factors | Category | n | % |
---|---|---|---|
Gender | Male | 89 | 34.6% |
Female | 168 | 65.3% | |
Grade level | Freshmen | 12 | 4.6% |
Sophomores | 47 | 18.2% | |
Juniors | 74 | 28.7% | |
Seniors | 51 | 19.8% | |
1st-year graduate | 43 | 16.7% | |
2nd-year graduate | 24 | 9.3% | |
3rd-year graduate | 6 | 2.3% | |
Nationality | China | 224 | 87.1% |
Other countries | 33 | 12.8% | |
Academic discipline | Humanities and arts | 76 | 29.5% |
Social sciences | 130 | 50.5% | |
Natural sciences | 28 | 10.8% | |
Engineering sciences | 23 | 8.9% |
Measure | Number of Items | Cronbach’s α | KMO | CR | AVE |
---|---|---|---|---|---|
AI literacy | 5 | 0.83 | 0.83 | 0.85 | 0.54 |
Self-regulated learning | 3 | 0.75 | 0.70 | 0.76 | 0.51 |
Writing performance | 4 | 0.68 | 0.70 | 0.83 | 0.57 |
GAI-driven well-being | 4 | 0.82 | 0.75 | 0.91 | 0.74 |
Path | Standardized Coefficient (β) | SE | t |
---|---|---|---|
AI literacy→writing performance | 0.153 | 0.026 | 1.982 * |
Self-regulated learning→writing performance | 0.237 | 0.041 | 2.642 ** |
AI literacy→GAI-driven well-being | 0.503 | 0.095 | 5.131 *** |
Writing performance→GAI-driven well-being | 0.120 | 0.129 | 2.657 ** |
Independent Variables | AI Literacy | Self-Regulated Learning | Writing Performance | ||
---|---|---|---|---|---|
Dependent Variables | |||||
Standardized Direct effects | Writing performance | 0.153 | 0.237 | — | |
GAI-driven well-being | 0.503 | — | 0.120 | ||
Standardized Indirect effects | GAI-driven well-being | 0.018 | 0.029 | — | |
Standardized Total effects | Writing performance | 0.153 | 0.237 | — | |
GAI-driven well-being | 0.521 | 0.029 | 0.120 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Shi, J.; Liu, W.; Hu, K. Exploring How AI Literacy and Self-Regulated Learning Relate to Student Writing Performance and Well-Being in Generative AI-Supported Higher Education. Behav. Sci. 2025, 15, 705. https://doi.org/10.3390/bs15050705
Shi J, Liu W, Hu K. Exploring How AI Literacy and Self-Regulated Learning Relate to Student Writing Performance and Well-Being in Generative AI-Supported Higher Education. Behavioral Sciences. 2025; 15(5):705. https://doi.org/10.3390/bs15050705
Chicago/Turabian StyleShi, Jiajia, Weitong Liu, and Ke Hu. 2025. "Exploring How AI Literacy and Self-Regulated Learning Relate to Student Writing Performance and Well-Being in Generative AI-Supported Higher Education" Behavioral Sciences 15, no. 5: 705. https://doi.org/10.3390/bs15050705
APA StyleShi, J., Liu, W., & Hu, K. (2025). Exploring How AI Literacy and Self-Regulated Learning Relate to Student Writing Performance and Well-Being in Generative AI-Supported Higher Education. Behavioral Sciences, 15(5), 705. https://doi.org/10.3390/bs15050705