Construct Validation of the STEM Motivation Scale for Children: A Multi-Timepoint Study
Abstract
1. Introduction
2. Materials, Participants and Methods
2.1. Survey Questionnaire
2.2. Study Participans
2.3. Procedure
2.4. Data Analysis
3. Results
3.1. Pilot Study
3.2. Internal Consistency
3.3. Test–Retest Reliability
3.4. Analysis of the Experimental and Control Groups Before the Multi-Day STEM Program
3.5. Factor Analysis Exploratory and Confirmatory Phases
- Interest for STEM field;
- Future Career Orientation;
- Desire for Practical Instruction;
- STEM Curiosity.
3.6. Discriminant Validity
3.7. Distributional Properties
3.8. Inter-Factor Correlations
4. Discussion
5. Conclusions
Limitations and Future Research
Supplementary Materials
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
Abbreviations
ANOVA | Analysis of Variance |
CFA | Confirmatory Factor Analysis |
CFI | Comparative Fit Index |
EFA | Exploratory Factor Analysis |
ICCs | Intraclass Correlation Coefficients |
M | Mean |
NCVVO | National Center for External Evaluation of Education |
NSF | National Science Foundation |
OECD | Organization for Economic Co-operation and Development |
PISA | Program for International Student Assessment |
RMSEA | Root Mean Square Error of Approximation |
SD | Standard Deviation |
SRMR | Standardized Root Mean Square Residual |
STEM | Science, Technology, Engineering, and Mathematics |
TLI | Tucker–Lewis Index |
UNESCO | United Nations Educational, Scientific and Cultural Organization |
Appendix A. Questionnaire Items and Factor Structure
Item Code | Survey Statement | Assigned Factor |
Q9 | I would like to conduct practical work in Nature and Society lessons that will teach me more. | Desire for Practical Instruction |
Q10 | I would like more materials in Nature and Society lessons that spark my curiosity. | Desire for Practical Instruction |
Q11 | I would like teaching materials that spark curiosity in Nature and Society lessons, even if they are difficult. | Desire for Practical Instruction |
Q12 | I think the knowledge from Nature and Society lessons will be useful in life. | Interest for STEM Field |
Q13 | I would like more practical projects in Nature and Society lessons to help me learn more. | Desire for Practical Instruction |
Q14 | I find conducting experiments interesting. | Desire for Practical Instruction |
Q15 | I am curious about how clouds are formed. | STEM Curiosity |
Q16 | I am curious about how rainbows are formed. | STEM Curiosity |
Q17 | I think the knowledge from Informatics lessons will be useful in life. | Interest for STEM Field |
Q18 | I am curious about how robots can be made. | STEM Curiosity |
Q19 | I think the knowledge from Mathematics lessons will be useful in life. | Interest for STEM Field |
Q20 | When I grow up, I want to program computers. | Future Career Orientation in STEM |
Q21 | When I grow up, I want to research volcanoes. | Future Career Orientation in STEM |
Q22 | When I grow up, I want to study viruses and bacteria. | Future Career Orientation in STEM |
Q23 | When I grow up, I want to study space. | Future Career Orientation in STEM |
References
- Açıksöz, S., Yildiz, M., & Bozkurt, Y. (2024a). Development and validation of STEM motivation scale for middle school students. International Journal of Assessment Tools in Education, 11(4), 699–720. [Google Scholar] [CrossRef]
- Açıksöz, S., Yıldırım, A., & Demir, B. (2024b). Do scientific attitude and intelligence affect motivation towards STEM? Frontiers in Psychology, 15, 1481229. [Google Scholar]
- Artino, A. R., Jr., La Rochelle, J. S., Dezee, K. J., & Gehlbach, H. (2014). Developing questionnaires for educational research: AMEE Guide No. 87. Medical Teacher, 36(6), 463–474. [Google Scholar] [CrossRef] [PubMed]
- ASPIRES. (2013). Department of education & professional studies, Young people’s science and career aspirations, age 10–14. ASPIRES. [Google Scholar]
- Berlyne, D. E. (1960). Conflict, arousal, and curiosity. McGraw-Hill. [Google Scholar]
- Burušić, J., & Šerić, M. (2015). Girls’ and boys’ achievements differences in the school context: An overview of possible explanations. Croatian Journal of Education, 17(4), 137–173. [Google Scholar] [CrossRef]
- Costello, A. B., & Osborne, J. W. (2005). Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical Assessment, Research, and Evaluation, 10(1), 7. [Google Scholar] [CrossRef]
- Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16(3), 297–334. [Google Scholar] [CrossRef]
- Çelik, R., & Yıldız, E. (2023). Active learning and student motivation in undergraduate STEM courses: A mixed-methods study. Advances in Physiology Education, 47(2), 123–134. [Google Scholar]
- Deci, E. L., & Ryan, R. M. (1985). Intrinsic motivation and self-determination in human behavior. Plenum. [Google Scholar]
- DeVellis, R. F. (2016). Scale development: Theory and applications. Sage Publications. [Google Scholar]
- European Schoolnet & DIGITALEUROPE. (2016). The e-skills manifesto. European Schoolnet. Available online: https://kometa.edu.pl/uploads/publication/652/60 (accessed on 15 April 2023).
- Freeman, S., Eddy, S. L., McDonough, M., Smith, M. K., Okoroafor, N., Jordt, H., & Wenderoth, M. P. (2014). Active learning increases student performance in science, engineering, and mathematics. Proceedings of the National Academy of Sciences, 111(23), 8410–8415. [Google Scholar] [CrossRef] [PubMed]
- Gardner, P., & Tamir, P. (1989). Interest in biology. Part I: A multidimensional construct. Journal of Research in Science Teaching, 26, 409–423. [Google Scholar] [CrossRef]
- Glasser, W. (1994). Quality school. Educa. [Google Scholar]
- Hulleman, C. S., Godes, O., Hendricks, C., & Harackiewicz, J. M. (2015). Measures of student motivation for STEM classrooms. Motivate Lab, University of Virginia. Available online: https://education.virginia.edu/research-initiatives/research-centers-labs/research-labs/motivate-lab/research-projects/measures-student-motivation-stem-classrooms (accessed on 6 May 2025).
- Illeris, K. (2007). How we learn: Learning and non-learning in school and beyond. Routledge. [Google Scholar]
- Kelley, T. R., & Knowles, J. G. (2016). A conceptual framework for integrated STEM education. International Journal of STEM Education, 3, 11. [Google Scholar] [CrossRef]
- Kline, P. (2015). Psychological testing: A practical approach to design and evaluation. Sage. [Google Scholar]
- Kolb, D. A. (1984). Experiential learning: Experience as the source of learning and development. Prentice-Hall. [Google Scholar]
- Koo, T. K., & Li, M. Y. (2016). A guideline of selecting and reporting intraclass correlation coefficients for reliability research. Journal of Chiropractic Medicine, 15(2), 155–163. [Google Scholar] [CrossRef] [PubMed]
- Lindahl, B. (2007, April 15–18). A Longitudinal study of students’ attitudes towards science and choice of career. Annual Meeting of the National Association for Research in Science Teaching, New Orleans, LA, USA. [Google Scholar]
- Lujan, H. L., & DiCarlo, S. E. (2006). Too much teaching, not enough learning: What is the solution? Advances in Physiology Education, 30, 17–22. [Google Scholar] [CrossRef] [PubMed]
- Ministry of Science and Education. (2019). Experimental program “school for life”. Ministry of Science and Education.
- National Research Council. (1996). National science education standards. National Research Council. [Google Scholar]
- NCVVO. (2018). Publication of the results of the OECD PISA 2018 survey. Available online: https://pisa.ncvvo.hr/wp-content/uploads/2019/12/PISA-2018_izvje%C5%A1taj.pdf (accessed on 1 September 2021).
- Osborne, J., & Dillon, J. (2008). Science education in Europe: Critical reflections. A report to the Nuffield Foundation. Available online: https://www.researchgate.net/profile/Jonathan-Osborne-3/publication/252404504_Science_Education_in_Europe_Critical_Reflections/links/543178e40cf277d58e982a32/Science-Education-in-Europe-Critical-Reflections.pdf (accessed on 5 May 2021).
- Paechter, M., Sins, P., & Nguyen, A. (2024). From early interest to career persistence: Understanding and supporting STEM pathways. Education Sciences, 14(7), 767. [Google Scholar] [CrossRef]
- Papert, S. (1980). Mindstorms: Children, computers, and powerful ideas. Basic Books. [Google Scholar]
- Qureshi, A., & Qureshi, N. (2021). Challenges and issues of STEM education. Advances in Mobile Learning Educational Research, 1(2), 146–161. [Google Scholar] [CrossRef]
- Said, Z., Summers, R., Abd-El-Khalick, F., & Wang, S. (2016). Attitudes toward science among grades 3 through 12 Arab students in Qatar: Findings from a cross-sectional national study. International Journal of Science Education, 38(4), 621–643. [Google Scholar] [CrossRef]
- Savickas, M. L. (2005). The theory and practice of career construction. In S. D. Brown, & R. W. Lent (Eds.), Career development and counseling: Putting theory and research to work (pp. 42–70). John Wiley & Sons. [Google Scholar]
- Shrout, P. E., & Fleiss, J. L. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86(2), 420. [Google Scholar] [CrossRef] [PubMed]
- Sustainable Development Goals. (2019). Available online: https://ec.europa.eu/info/strategy/international-strategies/sustainable-development-goals_hr (accessed on 13 June 2021).
- Tai, R. H., Liu, C. Q., Maltese, A. V., & Fan, X. (2006). Early planning for careers in science. Science, 312, 1143–1144. [Google Scholar] [CrossRef] [PubMed]
- Tavakol, M., & Dennick, R. (2011). Making sense of Cronbach’s alpha. International Journal of Medical Education, 2, 53–55. [Google Scholar] [CrossRef] [PubMed]
- Wells, J. G. (2019). STEM education: The potential of technology education. Council on Technology and Engineering Teacher Education. Available online: http://hdl.handle.net/10919/93963 (accessed on 13 February 2022).
- Wiebe, E. N., Williams, L., & Felder, R. M. (2018). The relationship of STEM attitudes and career interest. Eurasia Journal of Mathematics, Science and Technology Education, 14(6), 2451–2460. [Google Scholar] [CrossRef] [PubMed]
NE = 272; NC = 257 | Mc | SDc | ME | SDE | t | p |
---|---|---|---|---|---|---|
Question 9 | 4.46 | 0.80 | 4.48 | 0.94 | 0.158 | 0.438 |
Question 10 | 4.43 | 0.82 | 4.52 | 0.84 | 0.894 | 0.187 |
Question 11 | 3.54 | 1.15 | 3.69 | 1.16 | 0.960 | 0.169 |
Question 12 | 4.57 | 0.71 | 4.44 | 0.90 | −1.266 | 0.104 |
Question 13 | 3.98 | 0.90 | 3.94 | 1.42 | −0.268 | 0.388 |
Question 14 | 4.57 | 0.92 | 4.44 | 0.90 | 1.319 | 0.095 |
Question 15 | 3.77 | 1.28 | 4.03 | 1.26 | 1.612 | 0.055 |
Question 16 | 3.89 | 0.90 | 4.15 | 1.20 | 1.944 | 0.027 |
Question 17 | 3.80 | 1.16 | 4.03 | 1.32 | 1.398 | 0.082 |
Question 18 | 3.69 | 1.27 | 3.91 | 1.30 | 1.321 | 0.094 |
Question 19 | 4.27 | 1.00 | 4.35 | 1.07 | 0.664 | 0.254 |
Question 20 | 4.23 | 1.06 | 4.13 | 1.21 | −0.730 | 0.233 |
Question 21 | 3.55 | 1.44 | 3.28 | 1.63 | −1.476 | 0.071 |
Question 22 | 4.23 | 1.06 | 4.13 | 1.21 | −0.730 | 0.233 |
Question 23 | 3.55 | 1.44 | 3.28 | 1.63 | −1.476 | 0.071 |
Factor | Before | After | Follow-Up |
---|---|---|---|
Interest for STEM field | 0.81 | 0.85 | 0.84 |
Future Career Orientation | 0.76 | 0.79 | 0.78 |
Desire for Practical Instruction | 0.83 | 0.87 | 0.85 |
STEM Curiosity | 0.77 | 0.79 | 0.81 |
Question | Interest for STEM Field | Future Career Orientation in STEM | Desire for Practical Instruction | STEM Curiosity |
---|---|---|---|---|
Q9 | 0.71 | 0.56 | ||
Q10 | 0.58 | 0.60 | ||
Q11 | 0.52 | 0.46 | ||
Q12 | 0.54 | |||
Q13 | 0.66 | 0.61 | ||
Q14 | 0.59 | 0.52 | ||
Q15 | 0.74 | |||
Q16 | 0.70 | |||
Q17 | 0.50 | |||
Q18 | 0.65 | 0.42 | ||
Q19 | 0.52 | |||
Q20 | 0.77 | |||
Q21 | 0.69 | |||
Q22 | 0.72 | |||
Q23 | 0.74 |
Factor | Group | Before | After | Three-Month Follow-Up |
---|---|---|---|---|
Interest for STEM field | Experimental group | 4.10 ± 0.50 | 4.58 ± 0.48 | 4.51 ± 0.50 |
Control group | 4.12 ± 0.50 | 4.15 ± 0.51 | 4.20 ± 0.49 | |
Future Career Orientation in STEM | Experimental group | 3.72 ± 0.60 | 4.22 ± 0.58 | 4.01 ± 0.59 |
Control group | 3.68 ± 0.60 | 3.71 ± 0.61 | 3.69 ± 0.63 | |
Desire for Practical Instruction | Experimental group | 4.05 ± 0.50 | 4.73 ± 0.46 | 4.52 ± 0.47 |
Control group | 4.01 ± 0.50 | 4.10 ± 0.51 | 4.13 ± 0.50 | |
STEM Curiosity | Experimental group | 4.22 ± 0.50 | 4.35 ± 0.55 | 4.47 ± 0.53 |
Control group | 4.19 ± 0.50 | 4.21 ± 0.56 | 4.20 ± 0.57 |
Factor | Measurement Time | p-Value | Conclusion |
---|---|---|---|
Interest for STEM field | Before | 0.6754 | No significant difference |
After | <0.0001 | Significant difference | |
Three-month follow-up | <0.0001 | Significant difference | |
Future Career Orientation | Before | 0.6542 | No significant difference |
After | <0.0001 | Significant difference | |
Three-month follow-up | 0.0002 | Significant difference | |
Desire for Practical Instruction | Before | 0.6213 | No significant difference |
After | <0.0001 | Highly significant difference | |
Three-month follow-up | <0.0001 | Highly significant difference | |
STEM Curiosity | Before | 0.7439 | No significant difference |
After | 0.0121 | Significant difference | |
Three-month follow-up | 0.0003 | Significant difference |
Psychometric Characteristic | Value/Result |
---|---|
Factor Structure (EFA) | 4 factors, loadings > 0.40 |
Cronbach’s α (all factors) | 0.76–0.87 |
CFA Fit indices | CFI = 0.94, RMSEA = 0.045 |
Test–Retest Reliability | r = 0.62–0.78 |
Discriminant Validity | Significant differences between experimental and control groups (p < 0.05) |
Floor/Ceiling Effects | Not present |
Item Distribution Normality | Assumptions met (skew < 1, kurtosis < 1.5) |
Interest for STEM Field | Future Career Orientation in STEM | Desire for Practical Instruction | STEM Curiosity | |
---|---|---|---|---|
Interest for STEM field | 1.00 | 0.45 (moderate) | 0.87 (strong) | 0.51 (strong) |
Future Career Orientation in STEM | 0.45 (moderate) | 1.00 | 0.34 (moderate) | 0.70 (strong) |
Desire for Practical Instruction | 0.87 (strong) | 0.34 (moderate) | 1.00 | 0.41 (moderate) |
STEM Curiosity | 0.51 (strong) | 0.70 (strong) | 0.41 (moderate) | 1.00 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Ribarić, N.; Novoselić, D.; Ajduković, D.; Kovač-Andrić, E. Construct Validation of the STEM Motivation Scale for Children: A Multi-Timepoint Study. Educ. Sci. 2025, 15, 1241. https://doi.org/10.3390/educsci15091241
Ribarić N, Novoselić D, Ajduković D, Kovač-Andrić E. Construct Validation of the STEM Motivation Scale for Children: A Multi-Timepoint Study. Education Sciences. 2025; 15(9):1241. https://doi.org/10.3390/educsci15091241
Chicago/Turabian StyleRibarić, Nikolina, Daniela Novoselić, Dean Ajduković, and Elvira Kovač-Andrić. 2025. "Construct Validation of the STEM Motivation Scale for Children: A Multi-Timepoint Study" Education Sciences 15, no. 9: 1241. https://doi.org/10.3390/educsci15091241
APA StyleRibarić, N., Novoselić, D., Ajduković, D., & Kovač-Andrić, E. (2025). Construct Validation of the STEM Motivation Scale for Children: A Multi-Timepoint Study. Education Sciences, 15(9), 1241. https://doi.org/10.3390/educsci15091241