Adaptation and Psychometric Validation of the Spanish Version of Two Measures of Agentic Engagement
Abstract
1. Introduction
1.1. Conceptual Framework
1.2. Literature Review
1.3. Measurement Instruments of Agentic Engagement
1.4. The Present Study
2. Method
2.1. Participants
2.2. Instruments
2.2.1. The Agentic Engagement Scale (AES; Reeve, 2013)
2.2.2. The Enlarged Version of the Agentic Engagement Scale (EVAES; Mameli & Passini, 2019)
2.2.3. The Mini International Personality Item Pool-Five-Factor Model-Positively Worded Scale (Mini-IPIP-PW; Donnellan et al., 2006; Spanish Version by Martínez-Molina & Arias, 2018)
2.2.4. The Utrecht Work Engagement Scale for Students (UWES-9S; Schaufeli & Bakker, 2004; Spanish Version by Schaufeli & Bakker, 2011)
2.2.5. Sociodemographic Questionnaire
2.3. Procedure
2.4. Data Analysis
3. Findings
3.1. Item-Level Descriptive Statistics
3.2. Factor Structure
3.3. Internal Consistency and Temporal Stability
3.4. Validity Based on Correlations with Other Variables
4. Discussion
4.1. Limitations and Future Research
4.2. Theoretical and Practical Implications
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
Appendix A
| (1) Totalmente en Desacuerdo [Strongly Disagree] | (2) En Desacuerdo [Disagree] | (3) Algo en Desacuerdo [Sligthly Disagree] | (4) Ni de Acuerdo ni en Desacuerdo [Neither Agree nor Disagree] | (5) Algo de Acuerdo [Sligthly Agree] | (6) De Acuerdo [Agree] | (7) Totalmente de Acuerdo [Strongly Agree] | |
|---|---|---|---|---|---|---|---|
| |||||||
| |||||||
| |||||||
| |||||||
| |||||||
| |||||||
| |||||||
| |||||||
| |||||||
|
References
- Alonso-Tapia, J., Merino-Tejedor, E., & Huertas-Martínez, J. A. (2023). Academic engagement: Assessment, conditions, and effects—A study in higher education from the perspective of the person–situation interaction. European Journal of Psychology of Education, 38, 631–655. [Google Scholar] [CrossRef]
- Bandalos, D. L., & Finney, S. J. (2010). Factor analysis: Exploratory and confirmatory. In G. R. Hancock, & R. O. Mueller (Eds.), Reviewer’s guide to quantitative methods. Routledge. [Google Scholar]
- Bergan, S., & Matei, L. (2020). The future of the bologna process and the European higher education area: New perspectives on a recurring topic. In European higher education area: Challenges for a new decade (pp. 361–373). Springer Nature. [Google Scholar] [CrossRef]
- Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Routledge. [Google Scholar]
- Crisol-Moya, E., Romero-López, M. A., & Caurcel-Cara, M. J. (2020). Active methodologies in higher education: Perception and opinion as evaluated by professors and their students in the teaching–learning process. Frontiers in Psychology, 11, 1703. [Google Scholar] [CrossRef] [PubMed]
- Cuevas, R., Sánchez-Oliva, D., & Fernández-Bustos, J. G. (2016). Adaptation and validation of the agentic engagement scale to the Spanish educational context. Revista Mexicana de Psicología, 2, 135–142. [Google Scholar]
- De Clercq, M., Galand, B., Dupont, S., & Frenay, M. (2013). Achievement among first-year university students: An integrated and contextualised approach. European Journal of Psychology of Education, 28(3), 641–662. [Google Scholar] [CrossRef]
- Donnellan, M. B., Oswald, F. L., Baird, B. M., & Lucas, R. E. (2006). The Mini-IPIP scales: Tiny-yet-effective measures of the Big Five factors of personality. Psychological Assessment, 18(2), 192–203. [Google Scholar] [CrossRef] [PubMed]
- Ganotice, F. A., & King, R. B. (2014). Social influences on students’ academic engagement and science achievement. Psychological Studies, 59(1), 30–35. [Google Scholar] [CrossRef]
- Horlenko, K., & Kaminskiene, L. (2022). Systematic literature review on agentic engagement: Clarifying a co-creation perspective. Society. Integration. Education. Proceedings of the International Scientific Conference, 1, 382–393. [Google Scholar] [CrossRef]
- Hu, L. T., & Bentler, P. M. (1998). Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification. Psychological Methods, 3(4), 424–453. [Google Scholar] [CrossRef]
- Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. [Google Scholar] [CrossRef]
- Kim, R., & Song, H. D. (2023). Developing an agentic engagement scale in a self-paced MOOC. Distance Education, 44(1), 120–136. [Google Scholar] [CrossRef]
- Koo, T. K., & Li, M. Y. (2016). A guideline of selecting and reporting intraclass correlation coefficients for reliability research. Journal of Chiropractic Medicine, 15(2), 155–163. [Google Scholar] [CrossRef]
- Krpanec, E., Popović, D., & Babarović, T. (2024). How can teachers encourage students’ agentic engagement? The role of autonomy-supportive teaching and students’ autonomous motivation. In I. Tucak Junaković (Ed.), 23rd psychology days in zadar: Book of selected proceedings (pp. 65–72). Morepress Books. [Google Scholar]
- Kuncel, N. R., Credé, M., & Thomas, L. L. (2005). The validity of self-reported grade point averages, class ranks, and test scores: A meta-analysis and review of the literature. Review of Educational Research, 75(1), 63–82. [Google Scholar] [CrossRef]
- Lardy, L., Bressoux, P. P., & De Clercq, M. (2022). Achievement of first-year students at the university: A multilevel analysis of the role of background diversity and student engagement. European Journal of Psychology of Education, 37(3), 949–969. [Google Scholar] [CrossRef]
- Li, S., Xu, K., & Huang, J. (2023). Exploring the influence of teachers’ motivating styles on college students’ agentic engagement in online learning: The mediating and suppressing effects of self-regulated learning ability. Humanities and Social Sciences Communications, 10(1), 924. [Google Scholar] [CrossRef]
- Ljubin-Golub, T., Rijavec, M., & Olčar, D. (2020). Student flow and burnout: The role of teacher autonomy support and student autonomous motivation. Psychological Studies, 65(2), 145–156. [Google Scholar] [CrossRef]
- Mameli, C., Grazia, V., & Molinari, L. (2023). Student agency: Theoretical elaborations and implications for research and practice. International Journal of Educational Research, 122(2023), 102258. [Google Scholar] [CrossRef]
- Mameli, C., & Passini, S. (2017). Measuring four-dimensional engagement in school: A validation of the student engagement scale and of the agentic engagement scale. TPM—Testing, Psychometrics, Methodology in Applied Psychology, 24(4), 527–541. [Google Scholar] [CrossRef]
- Mameli, C., & Passini, S. (2019). Development and validation of an enlarged version of the student agentic engagement scale. Journal of Psychoeducational Assessment, 37(4), 450–463. [Google Scholar] [CrossRef]
- Marginson, S. (2024). Student self-formation: An emerging paradigm in higher education. Studies in Higher Education, 49(4), 748–762. [Google Scholar] [CrossRef]
- Martínez-Molina, A., & Arias, V. B. (2018). Balanced and positively worded personality short-forms: Mini-IPIP validity and cross-cultural invariance. PeerJ, 6, e5542. [Google Scholar] [CrossRef]
- Michou, A., Altan, S., Mouratidis, A., Reeve, J., & Malmberg, L. E. (2023). Week-to-week interplay between teachers’ motivating style and students’ engagement. Journal of Experimental Education, 91(1), 166–185. [Google Scholar] [CrossRef]
- Morcillo-Martínez, A., Infantes-Paniagua, Á., García-Notario, A., & Contreras-Jordán, O. R. (2021). Validation of the Spanish version of the academic engagement scale for primary education. RELIEVE, 27(2), 7. [Google Scholar] [CrossRef]
- Nieminen, J. H., Tai, J., Boud, D., & Henderson, M. (2022). Student agency in feedback: Beyond the individual. Assessment and Evaluation in Higher Education, 47(1), 95–108. [Google Scholar] [CrossRef]
- Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory (3rd ed.). McGraw-Hill. [Google Scholar]
- OECD. (2019). OECD future of education and skills 2030. OECD Publishing. Available online: https://www.oecd.org/content/dam/oecd/en/about/projects/edu/education-2040/1-1-learning-compass/OECD_Learning_Compass_2030_Concept_Note_Series.pdf (accessed on 20 February 2024).
- Panadero, E., Lipnevich, A., & Broadbent, J. (2019). Turning self-assessment into self-feedback. In M. Henderson, R. Ajjawi, D. Boud, & E. Molloy (Eds.), The impact of feedback in higher education (pp. 147–163). Springer. [Google Scholar]
- Qureshi, A., Wall, H., Humphries, J., & Bahrami Balani, A. (2016). Can personality traits modulate student engagement with learning and their attitude to employability? Learning and Individual Differences, 51, 349–358. [Google Scholar] [CrossRef]
- Reeve, J. (2013). How students create motivationally supportive learning environments for themselves: The concept of agentic engagement. Journal of Educational Psychology, 105(3), 579–595. [Google Scholar] [CrossRef]
- Reeve, J., Cheon, S. H., & Jang, H. (2020). How and why students make academic progress: Reconceptualizing the student engagement construct to increase its explanatory power. Contemporary Educational Psychology, 62, 101899. [Google Scholar] [CrossRef]
- Reeve, J., & Tseng, C. M. (2011). Agency as a fourth aspect of students’ engagement during learning activities. Contemporary Educational Psychology, 36(4), 257–267. [Google Scholar] [CrossRef]
- Rodríguez-Fernández, A., Ramos-Díaz, E., Madariaga, J. M., Arrivillaga, A., & Galende, N. (2016). Steps in the construction and verification of an explanatory model of psychosocial adjustment. European Journal of Education and Psychology, 9(1), 20–28. [Google Scholar] [CrossRef]
- Rosseel, Y. (2012). lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48, 1–36. [Google Scholar] [CrossRef]
- Saqr, M., López-Pernas, S., Helske, S., & Hrastinski, S. (2023). The longitudinal association between engagement and achievement varies by time, students’ profile, and achievement state: A full program study. Computers & Education, 199, 104787. [Google Scholar] [CrossRef]
- Schaufeli, W. B., & Bakker, A. (2004). UWES Utrecht Work Engagement Scale—Preliminary manual. In Occupational health psychology unit—Utrecht university (1.1). Utrecht University. [Google Scholar]
- Schaufeli, W. B., & Bakker, A. (2011). Escala Utrecht de Engagement en el Trabajo [Spanish translation of the UWES-Utrecht Work engagement Scale. Preliminary manual. Version 1, Novembre 2003; translated by Valdez, H., & Ron, C.]. Utrecht University. [Google Scholar]
- Schaufeli, W. B., Salanova, M., Gonzales-Roma, V., & Bakker, A. (2002). The measurement of engagement and burnout: A two sample confirmatory factor analytic approach. Journal of Happiness Studies, 3(1), 71–92. [Google Scholar] [CrossRef]
- Schermelleh-Engel, K., Moosbrugger, H., & Müller, H. (2003). Evaluating the fit of structural equation models: Tests of significance and descriptive goodness-of-fit measures. Methods of Psychological Research Online, 8(2), 23–74. [Google Scholar] [CrossRef]
- Shi, D., & Maydeu-Olivares, A. (2020). The effect of estimation methods on SEM fit indices. Educational and Psychological Measurement, 80(3), 421–445. [Google Scholar] [CrossRef]
- Stenalt, M. H., & Lassesen, B. (2022). Does student agency benefit student learning? A systematic review of higher education research. Assessment & Evaluation in Higher Education, 47(5), 653–669. [Google Scholar] [CrossRef]
- Stevenson, N. A., Swain-Bradway, J., & LeBeau, B. C. (2019). Examining high school student engagement and critical factors in dropout prevention. Assessment for Effective Intervention, 46(2), 155–164. [Google Scholar] [CrossRef]
- Tomás, J. M., Gutiérrez, M., Alberola, S., & Georgieva, S. (2022). Psychometric properties of two major approaches to measure school engagement in university students. Current Psychology, 41(5), 2654–2667. [Google Scholar] [CrossRef]
- Uçar, F. M., & Semra, S. (2018). Adaptation of engagement questionnaire to Turkish for science classes: Validity and reliability study. Elementary Education Online, 17(3), 1691–1705. [Google Scholar] [CrossRef]
- World Medical Association. (2013). Declaration of Helsinki—Ethical principles for medical research involving human subjects. Available online: https://www.wma.net/policies-post/wma-declaration-of-helsinki-ethical-principles-for-medical-research-involving-human-subjects/ (accessed on 10 March 2024).
- Xia, Y., & Yang, Y. (2019). RMSEA, CFI, and TLI in structural equation modeling with ordered categorical data: The story they tell depends on the estimation methods. Behavior Research Methods, 51(1), 409–428. [Google Scholar] [CrossRef]
- Xu, X., Shi, Z., Bos, N. A., & Wu, H. (2023). Student engagement and learning outcomes: An empirical study applying a four-dimensional framework. Medical Education Online, 28(1), 2268347. [Google Scholar] [CrossRef] [PubMed]
- Yu, W., & Wu, C. (2025). Development and validation of the Interpreting Learning Engagement Scale (ILES). Behavioral Sciences, 15(1), 16. [Google Scholar] [CrossRef]
- Zambrano, J., Kennedy, A. A. U., Aguilera, C., Yates, N., & Patall, E. A. (2022). Students’ beliefs about agentic engagement: A Phenomenological study in urban high school physical science and engineering classes. Journal of Educational Psychology, 114(5), 1028–1047. [Google Scholar] [CrossRef]

| Variable | n | % |
|---|---|---|
| Gender | ||
| Female | 166 | 59.7 |
| Male | 112 | 40.3 |
| Educational Background | ||
| Health sciences | 154 | 55.4 |
| Social sciences | 84 | 30.2 |
| Engineering | 17 | 6.1 |
| Arts and Humanities | 9 | 3.2 |
| Natural Sciences | 8 | 2.9 |
| Mixed background | 4 | 1.4 |
| No data | 2 | 0.7 |
| Marital status | ||
| Single | 197 | 70.9 |
| Married/with a partner | 79 | 28.4 |
| Separated/divorced | 2 | 0.7 |
| Living arrangements | ||
| Family of origin | 206 | 71.4 |
| Partner or own family | 10 | 3.6 |
| Friends | 40 | 14.4 |
| Alone | 7 | 2.5 |
| Residential institution | 9 | 3.2 |
| Other | 6 | 2.2 |
| Item * | M | SD | PIE (%) | SK | K | rjx | ||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | 2 | 3 | 4 | 5 | 6 | 7 | ||||||
| I1 (I3) | 3.44 | 1.85 | 17.3 | 24.5 | 10.8 | 13.7 | 16.5 | 12.6 | 4.7 | 0.26 | −1.20 | 0.80 (0.75) |
| I2 | 3.08 | 1.79 | 21.6 | 28.4 | 13.7 | 9.4 | 14.7 | 8.6 | 3.6 | 0.56 | −0.88 | 0.77 |
| I3 (I1) | 3.32 | 1.80 | 17.6 | 24.1 | 16.5 | 11.2 | 16.2 | 9.7 | 4.7 | 0.39 | −1.0 | 0.79 (0.75) |
| I4 (I2) | 3.18 | 1.77 | 20.9 | 25.6 | 11.2 | 13.7 | 17.6 | 7.9 | 3.2 | 0.38 | −1.05 | 0.78 (0.77) |
| I5 | 3.39 | 1.84 | 18.3 | 23.0 | 12.2 | 14.4 | 16.5 | 10.4 | 5.0 | 0.29 | −1.11 | 0.66 |
| I6 | 3.01 | 1.67 | 22.3 | 24.5 | 16.5 | 15.1 | 12.9 | 5.8 | 2.9 | 0.54 | −0.67 | 0.74 |
| I7 | 2.80 | 1.70 | 29.1 | 25.9 | 11.5 | 12.6 | 12.9 | 5.8 | 2.2 | 0.66 | −0.70 | 0.75 |
| I8 (I5) | 3.54 | 1.84 | 18.7 | 17.6 | 12.9 | 12.9 | 21.6 | 11.9 | 4.3 | 0.08 | −1.23 | 0.63 (0.68) |
| I9 (I4) | 3.62 | 1.98 | 18.3 | 20.9 | 10.8 | 11.2 | 17.6 | 12.2 | 9.0 | 0.19 | −1.28 | 0.74 (0.75) |
| I10 | 4.59 | 1.94 | 9.7 | 11.2 | 6.5 | 12.9 | 21.2 | 19.4 | 19.1 | −0.49 | −0.93 | 0.53 |
| M | SD | SK | K | α | ω | r (AES) | r (EVAES) | |
|---|---|---|---|---|---|---|---|---|
| AES | 17.1 | 7.75 | 0.16 | −0.92 | 0.89 | 0.90 | - | 0.96 *** |
| EVAES | 34.0 | 14.1 | 0.17 | −0.86 | 0.93 | 0.93 | 0.96 *** | - |
| UWES-9S | 38.7 | 11.7 | −0.30 | −0.36 | 0.94 | 0.94 | 0.32 *** | 0.29 *** |
| Admission GPA | 7.88 | 1.20 | −0.57 | 1.25 | - | - | −0.02 | −0.07 |
| Mini-IPIP-PW | ||||||||
| Extraversion | 10.8 | 3.6 | 0.18 | −0.58 | 0.73 | 0.73 | 0.28 *** | 0.30 *** |
| Agreeableness | 15.3 | 3.1 | −0.46 | −0.35 | 0.83 | 0.83 | 0.16 ** | 0.14 * |
| Conscientiousness | 13.1 | 3.5 | −0.15 | −0.52 | 0.81 | 0.82 | 0.16 ** | 0.14 * |
| Emotional stability | 10.4 | 3.1 | 0.19 | −0.20 | 0.66 | 0.67 | 0.13 * | 0.12 * |
| Openness to experience | 13.4 | 4.0 | −0.14 | −0.80 | 0.86 | 0.86 | 0.17 ** | 0.20 *** |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Guerrero, E.; Guilera, G.; Aza, A.; Gómez-Benito, J.; Barrios, M. Adaptation and Psychometric Validation of the Spanish Version of Two Measures of Agentic Engagement. Behav. Sci. 2025, 15, 1545. https://doi.org/10.3390/bs15111545
Guerrero E, Guilera G, Aza A, Gómez-Benito J, Barrios M. Adaptation and Psychometric Validation of the Spanish Version of Two Measures of Agentic Engagement. Behavioral Sciences. 2025; 15(11):1545. https://doi.org/10.3390/bs15111545
Chicago/Turabian StyleGuerrero, Estefania, Georgina Guilera, Alba Aza, Juana Gómez-Benito, and Maite Barrios. 2025. "Adaptation and Psychometric Validation of the Spanish Version of Two Measures of Agentic Engagement" Behavioral Sciences 15, no. 11: 1545. https://doi.org/10.3390/bs15111545
APA StyleGuerrero, E., Guilera, G., Aza, A., Gómez-Benito, J., & Barrios, M. (2025). Adaptation and Psychometric Validation of the Spanish Version of Two Measures of Agentic Engagement. Behavioral Sciences, 15(11), 1545. https://doi.org/10.3390/bs15111545

