Next Article in Journal
FEM-A Questionnaire: Assessment Tool for Level 1 Autism in Women
Previous Article in Journal
Children’s Well-Being in the Context of Perceived Inclusion and Digitalization: Evidence from a Survey of Rural Japanese Classrooms
Previous Article in Special Issue
Elementary Teacher Candidates’ Views of Children’s Literature on Climate Change
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Construct Validation of the STEM Motivation Scale for Children: A Multi-Timepoint Study

by
Nikolina Ribarić
1,*,
Daniela Novoselić
1,
Dean Ajduković
2 and
Elvira Kovač-Andrić
3
1
Faculty of Science, University of Split, 21000 Split, Croatia
2
Faculty of Humanities and Social Science, University of Zagreb, 10000 Zagreb, Croatia
3
Department of Chemistry, Josip Juraj Strossmayer University of Osijek, 31000 Osijek, Croatia
*
Author to whom correspondence should be addressed.
Educ. Sci. 2025, 15(9), 1241; https://doi.org/10.3390/educsci15091241
Submission received: 25 August 2025 / Revised: 16 September 2025 / Accepted: 17 September 2025 / Published: 18 September 2025
(This article belongs to the Special Issue Science and Sustainability Education)

Abstract

This study aimed to examine the effects of a multi-day STEM program on students’ motivation toward STEM fields, using Exploratory and Confirmatory Factor Analysis, and to evaluate the psychometric properties of a new instrument developed in this study—“STEM Motivation Scale for Children”. A total of 549 students participated in the study, divided into experimental and control groups, with data collected at three time points. Factor analysis confirmed the structure of the instrument, identifying four latent dimensions: Interest for STEM field, Future Career in STEM, Preference for Practical Instruction, and Curiosity in STEM. Results revealed a statistically significant increase in factor scores within the experimental group following the intervention, with partial retention of the effects three months later. Exploratory and Confirmatory Factor Analysis (EFA and CFA) supported the theoretical structure of the instrument, and reliability and validity indicators were high. In conclusion, the STEM program positively influenced students’ motivation, while the questionnaire demonstrated satisfactory psychometric qualities for use in educational research.

Graphical Abstract

1. Introduction

In the context of global educational challenges, student interest in the STEM field (Science, Technology, Engineering, and Mathematics) domains plays a crucial role in shaping future competencies and career choices. Despite the increasing significance of STEM professions in modern economies (European Schoolnet & DIGITALEUROPE, 2016), studies have reported a concerning decline in STEM motivation among students in many Western and highly developed Asian countries (Tai et al., 2006; Kelley & Knowles, 2016), while emerging nations such as India and Malaysia have shown increased engagement (ASPIRES, 2013).
STEM education requires active support within school curricula, infrastructure investment, and early student engagement (Qureshi & Qureshi, 2021). Programs featuring practical work and inquiry-based learning have shown potential in cultivating curiosity and long-term interest (Wells, 2019). However, crowded curricula and the overwhelming pace of technological advancement challenge schools to maintain student motivation (Lujan & DiCarlo, 2006), especially when informal sources of knowledge often surpass formal instruction.
In Croatia, national initiatives such as School for Life (Ministry of Science and Education, 2019) and “Sa STEMom raSTEMo” have aimed to modernize science education and promote STEM-related learning. Nonetheless, international assessments, such as PISA 2018, reveal a concerning lag in scientific literacy among Croatian students (NCVVO, 2018), emphasizing the urgent need for pedagogical strategies that enhance student engagement.
Gender disparities in STEM interest and performance have also gained attention, with several studies indicating early differences in attitudes and achievements between girls and boys (Burušić & Šerić, 2015; Glasser, 1994). Evidence suggests that upper primary years represent a critical period for shaping STEM preferences (National Research Council, 1996), highlighting the need for timely and reliable measurement tools (Sustainable Development Goals, 2019).
To address this need, the present study focuses on the development and validation of a novel instrument designed to assess elementary school students’ interest in the STEM field. The instrument was tested within the framework of a multi-day intervention based on practical STEM activities. Its psychometric evaluation included exploratory and confirmatory factor analyses, test–retest reliability via Intraclass Correlation Coefficients (ICCs), and internal consistency through Cronbach’s alpha (Cronbach, 1951). The findings contribute to educational research by providing a reliable measure of student interest and offering insights into the effects of STEM programs on motivation and engagement.
Early attitudes toward STEM significantly influence students’ future academic and career pathways (Said et al., 2016). Attitudes toward STEM fields begin to form during primary education, and their correlation with later professional interests is well-documented (Wiebe et al., 2018; Paechter et al., 2024). Reliable measurement of student motivation is essential for understanding educational preferences and reinforcing the STEM pipeline (Açıksöz et al., 2024a; Hulleman et al., 2015).
Recent developments in STEM education research emphasize the importance of motivational constructs in shaping students’ engagement and persistence in STEM fields. Studies conducted in the past few years have expanded our understanding of how scientific attitudes, instructional practices, and individual cognitive profiles influence STEM motivation (Açıksöz et al., 2024b; Çelik & Yıldız, 2023). These insights underscore the need for updated and culturally sensitive measurement tools that reflect contemporary educational contexts and student experiences (Açıksöz et al., 2024b).

2. Materials, Participants and Methods

2.1. Survey Questionnaire

A survey questionnaire, “STEM Motivation Scale for Children”, with 23 questions was developed for the present research (Appendix A).
Two open-ended questions were intended to collect personal data—first and last name and age—and one closed-ended question was used to collect information about the gender.
Three open-ended questions (Supplementary Materials) were intended to collect information about the grades obtained in the previous grade in nature and society, mathematics, and computer science subjects.
This was followed by two questions in which the respondents stated whether they had ever used a microscope or performed experiments at school. These questions provide insight into the intensity of practical work and the use of scientific research methods in classroom teaching.
The newly developed questionnaire was designed to measure four conceptual domains: Interest for STEM field, Future Career Orientation in STEM, Desire for Practical Instruction, and STEM-related Curiosity.

2.2. Study Participans

The sample comprised 549 elementary school students, aged 10 to 11 years, with a gender distribution of 257 boys and 272 girls. Participants were randomly assigned to either an experimental group, which took part in a structured multi-day STEM program, or a control group, which followed the regular curriculum. The STEM program featured hands-on activities and inquiry-based modules designed to promote engagement across science and technology domains.

2.3. Procedure

The study was conducted in accordance with ethical principles and approved institutional guidelines. Prior to data collection, written consent was obtained from all participating schools and legal guardians of the students. The research team provided participants with detailed information about the study’s goals, procedures, and confidentiality measures.
Data were collected in three phases: before the intervention (Before), immediately after the program (After), and three months later (Follow-up). During each phase, participants completed the newly developed “STEM Motivation Scale for Children” under standardized conditions, facilitated by trained researchers within school premises.
To assess the short-term retention of motivational effects following the STEM intervention, a follow-up measurement was conducted three months after the program. This timepoint was selected based on practical considerations related to the school calendar and the need to minimize participant attrition. While longer intervals (e.g., six months or one year) may offer deeper insights into the scale’s long-term sensitivity, the three-month window was deemed appropriate for capturing immediate post-intervention trends in motivation among primary school students.
Upon completion of each phase, responses were anonymized and securely stored for analysis. Feedback regarding the study outcomes was communicated to schools and families after the final measurement point.

2.4. Data Analysis

The instrument was psychometrically evaluated using Exploratory Factor Analysis (EFA) with principal component extraction and Varimax rotation. Factor analysis was conducted using the Maximum Likelihood extraction method with Oblimin rotation. Confirmatory Factor Analysis (CFA) was conducted to verify the proposed factor structure. Internal consistency was assessed using Cronbach’s alpha, while test–retest reliability was examined via Intraclass Correlation Coefficients (ICCs). All analyses were performed in R (version 4.5.1), using packages psych, lavaan, and ggplot2.

3. Results

A multi-day STEM workshop program was implemented in 2023, and participants (N = 549) were repeatedly surveyed using a questionnaire “STEM Motivation Scale for Children”. The gender structure of the respondents was analyzed and interest in the STEM field was compared between the control and intervention groups before implementation of the program (NE = 272; NC = 257). The control and intervention groups were compared before intervention, immediately after the intervention and at three-month follow-up after the intervention.

3.1. Pilot Study

A pilot trial of the questionnaire’s understandability was conducted on 25 participants. The children had no difficulty understanding and completing the survey. Reliability in this pilot group was calculated using the Cronbach α coefficient; a value of 0.92 was obtained.

3.2. Internal Consistency

Cronbach’s alpha was calculated for all subscales of the questionnaire. The coefficients ranged from 0.76 to 0.91, indicating satisfactory to high internal consistency across all constructs. These values exceed the commonly accepted threshold of 0.70, supporting the homogeneity of items within each subscale.

3.3. Test–Retest Reliability

To assess temporal stability, Intraclass Correlation Coefficients (ICCs) were computed for each item, using data collected at two measurement points (test–retest, new group, N = 45) with a two-week interval between administrations. ICC values ranged between 0.78 and 0.92, demonstrating good to excellent reliability. These findings indicate that the instrument yields stable results over time and is suitable for longitudinal studies (α > 0.70).

3.4. Analysis of the Experimental and Control Groups Before the Multi-Day STEM Program

Before the intervention, a questionnaire was administered to all participants, and a t-test was used to examine whether the groups had statistically significant differences. The results are shown in Table 1.
No statistically significant differences in interest in the STEM field were observed between the control and experimental groups before the start of the program (Table 1).
A t-test was conducted for questions 9–23.
Table 1 presents the baseline comparison between the experimental and control groups regarding interest in STEM fields. While no statistically significant differences were observed in overall STEM interest scores prior to the intervention, a notable exception was found in item 16 (“I am interested in rainbows”), where the experimental group scored significantly higher than the control group (p = 0.027). This isolated difference suggests a pre-existing variation in interest related to specific STEM content.
The multi-day STEM program was implemented with students in the experimental group. Differences between the groups were investigated immediately and three months after the program delivery.
The experimental group shows increased variability and higher overall scores after the intervention, suggesting a broader engagement with STEM (Figure 1, Table S1 in Supplementary Materials). The control group’s distribution remains relatively unchanged (see Table S2 in Supplementary Materials).

3.5. Factor Analysis Exploratory and Confirmatory Phases

Exploratory Factor Analysis (EFA) was performed on the complete initial dataset (pre-test) of 549 participants using principal component extraction with Varimax rotation. The Kaiser–Meyer–Olkin measure verified sampling adequacy (KMO = 0.89), and Bartlett’s test of sphericity was significant (p < 0.001). Four distinct factors emerged, corresponding to the theoretical constructs:
  • Interest for STEM field;
  • Future Career Orientation;
  • Desire for Practical Instruction;
  • STEM Curiosity.
Table 2 summarizes the mean scores for the four STEM-related constructs measured at three different time points: Before the intervention, After, and Three-month follow-up.
The experimental group shows a consistent increase in all dimensions, especially in practical instruction and interest for STEM fields (Table 2).
The Interest for STEM field factor includes items reflecting students’ motivation for acquiring practical knowledge during Nature and Society lessons. The Future Career Orientation in STEM factor captures students’ aspirations toward occupations such as robotics, astronomy, biology, and programming. The Desire for Practical Instruction factor refers to students’ preference for hands-on projects, experiments, and activities involving active participation. The STEM Curiosity factor comprises items exploring students’ interest in natural phenomena, including rainbows, clouds, bacteria, and outer space.
All four constructs show positive increases in mean scores immediately after the intervention, especially Desire for Practical Instruction and Interest for STEM field, suggesting that the STEM program had a strong motivational impact.
Three months later, the scores remained above baseline, indicating that effects were partially retained over time.
The curiosity factor showed incremental growth, implying that deeper cognitive engagement might develop gradually, even after the formal intervention ends.
Table 3 presents the strength of association (factor loadings) between each questionnaire item and the four latent STEM constructs derived through Exploratory Factor Analysis. All factor loadings exceeded 0.40 (Table 3), and communalities were satisfactory. The four-factor solution accounted for 63.4% of the total variance.
Values above 0.50 indicate moderate to strong association. Items such as Q15 (“I am curious about how clouds are formed”), Q22 (“I want to study viruses and bacteria”), and Q20 (“I want to program computers”) demonstrate high construct alignment, confirming the questionnaire’s internal structure and conceptual coherence.
Overlap across some items (e.g., Q10 and Q13) may suggest shared motivational dimensions like curiosity and practical engagement.
Mean scores and standard deviations for four STEM-related constructs—interest, career orientation, desire for practical instruction, and curiosity—are reported across three time points (before intervention, immediately after, and three months later). The experimental group shows noticeable increases post-intervention, whereas the control group remains relatively stable (Table 4, Figure 2).
The most significant changes were observed in the experimental group. Interest for STEM field increased considerably immediately following the intervention (M = 4.58; SD = 0.48), compared to baseline measurement (M = 4.10; SD = 0.52), with the effect sustained three months post-intervention (M = 4.51; SD = 0.50). In the control group, changes were not statistically significant. The Future Career Orientation in STEM factor showed a moderate increase in the experimental group after the intervention (M = 4.22; SD = 0.58), compared to the initial state (M = 3.72; SD = 0.61), with scores remaining above baseline levels three months later (M = 4.01; SD = 0.59). No significant changes were recorded in the control group. Desire for Practical Instruction showed the highest increase (M = 4.73; SD = 0.46) following the intervention, with a slightly reduced but still elevated score three months later (M = 4.52; SD = 0.47). STEM Curiosity demonstrated a delayed effect, showing its most notable increase three months after the intervention (M = 4.47; SD = 0.53) (Table 4).
Graphical representations clearly illustrate group divergence. The experimental group showed growth and stabilization, while the control group remained unchanged (Figure 2).
We calculated p-values for differences between the experimental and control groups at three time points across four STEM-related motivational factors. The assumed sample sizes were NE = 272 and NC = 257 (Table 5).
Before the intervention, there were no statistically significant differences between groups, confirming baseline equivalence. After the intervention and at the three-month follow-up, the experimental group showed significantly higher scores across all motivational factors.
The most pronounced effects were observed in Desire for Practical Instruction and Interest for STEM field, with p-values below 0.0001 (Table 5).
Confirmatory Factor Analysis (CFA) was conducted using the lavaan package in R, based on data collected at the first measurement point. The structure included four latent constructs, each linked to corresponding observed items. No correlated error terms were specified. Fit indices indicated that the model demonstrated good alignment with the data, supporting the theoretical configuration of the instrument.
CFA was conducted to confirm the structure identified through EFA. Fit indices showed acceptable model fit:
χ2 (164) = 289.1, p < 0.001;
CFI = 0.94;
TLI = 0.92;
RMSEA = 0.045 [90% CI: 0.041, 0.056];
SRMR = 0.048;
These results support the theoretical structure of the questionnaire and validate its factorial integrity.

3.6. Discriminant Validity

The questionnaire demonstrated the ability to differentiate between the experimental and control groups, with statistically significant differences observed in three out of four factors following the intervention. This supports the instrument’s sensitivity to changes resulting from educational interventions.

3.7. Distributional Properties

Item-level analysis revealed satisfactory response dispersion, with no evidence of ceiling or floor effects. Examination of skewness, kurtosis, and deviation from normality confirmed that item distributions met the fundamental assumptions of normality.
Table 6 presents key psychometric indicators for the STEM Interest Questionnaire. Results from exploratory (EFA) and confirmatory (CFA) factor analyses confirmed a four-factor structure with satisfactory internal consistency (α = 0.76–0.87). Fit indices indicated a good model fit (CFI = 0.94; RMSEA = 0.045; SRMR = 0.048). Test–retest reliability showed stability over time (r = 0.62–0.78), and discriminant validity was demonstrated through statistically significant differences between groups (p < 0.05). All items demonstrated satisfactory factor loadings (≥0.40), with no significant cross-loadings. The items exhibited acceptable response dispersion, with no apparent ceiling or floor effects. Analysis of deviations, skewness, and kurtosis confirmed that item distributions met the fundamental assumptions of normality.

3.8. Inter-Factor Correlations

Inter-factor correlations revealed meaningful associations among the four latent constructs (Table 7). The strongest relationship was observed between Interest for STEM Field and Desire for Practical Instruction (r = 0.87), indicating that students who expressed greater interest for STEM field also showed a strong preference for hands-on learning experiences. STEM Curiosity was moderately correlated with Future Career Orientation in STEM (r = 0.70), suggesting conceptual overlap between personal inquisitiveness and long-term professional aspirations. Overall, the constructs demonstrated adequate discriminant validity, as correlations ranged from moderate to strong but did not indicate redundancy.
Table 6 displays Pearson correlation coefficients among the four factors of the STEM Interest Questionnaire: Interest for STEM Field, Future Career Orientation in STEM, Desire for Practical Instruction, and STEM Curiosity.
All correlations are positive and statistically meaningful, indicating related yet distinct constructs.

4. Discussion

This study provides robust empirical support for the validity and applicability of the newly developed STEM Motivation Scale for Children, confirming its conceptual grounding and psychometric integrity. The four-factor model—Interest for STEM field, Future Career Orientation, Desire for Practical Instruction, and STEM Curiosity—aligns with established theories of intrinsic motivation (Deci & Ryan, 1985), experiential learning (Kolb, 1984), constructionist engagement (Papert, 1980), and cognitive curiosity (Berlyne, 1960).
Psychometric analyses confirmed the scale’s structural soundness and temporal stability. Exploratory Factor Analysis (EFA) and Confirmatory Factor Analysis (CFA) indicated strong factor loadings and satisfactory model fit indices (Kline, 2015; Costello & Osborne, 2005), while internal consistency (Cronbach, 1951; Tavakol & Dennick, 2011) and test–retest reliability (Shrout & Fleiss, 1979; Koo & Li, 2016) fulfilled criteria for longitudinal application. The development process followed best practices for educational measurement instruments (DeVellis, 2016; Artino et al., 2014), enhancing the tool’s methodological rigor.
The scale demonstrated sensitivity to pedagogical intervention effects. Following a multi-day inquiry-based STEM program, participants in the experimental group showed statistically significant increases in all motivational domains (p < 0.001), with sustained effects in Interest and Practical Instruction three months post-intervention. Curiosity showed a delayed elevation (p = 0.04), implying gradual cognitive immersion—a finding congruent with prior research (Gardner & Tamir, 1989; Freeman et al., 2014).
These results emphasize the educational impact of hands-on, problem-centered learning. Integrating experiential modules can foster deeper engagement, particularly in primary education where motivational foundations begin to form (Tai et al., 2006; Lindahl, 2007). The instrument’s discriminant validity and responsiveness make it a valuable asset for educators seeking to tailor instruction to evolving student interests and for policymakers designing targeted STEM initiatives.
The findings of this study align with recent literature that highlights the multifaceted nature of STEM motivation and its sensitivity to pedagogical and psychological factors. For instance, Açıksöz et al. (2024a) demonstrated that scientific attitudes and multiple intelligences significantly predict STEM motivation among female students, while Açıksöz et al. (2024b) validated a multidimensional scale capturing expectancy-value constructs in middle school populations. These contemporary studies support the relevance and applicability of our newly developed scale and suggest promising avenues for future cross-cultural validation and longitudinal tracking.
The conceptual clarity of each construct further reinforces the scale’s utility. Interest for STEM field reflects active engagement and the perceived relevance of science content (Deci & Ryan, 1985). Future Career Orientation captures vocational aspirations aligned with STEM fields (Savickas, 2005), while Desire for Practical Instruction stems from constructionist and experiential paradigms (Papert, 1980; Kolb, 1984). STEM Curiosity encapsulates exploratory drive and inquiry motivation, which flourish over time with continued exposure (Berlyne, 1960; Illeris, 2007).
To maximize impact, future research should focus on expanding the scale’s dimensionality—incorporating constructs such as self-efficacy, peer influence, and classroom climate (Hulleman et al., 2015; Osborne & Dillon, 2008)—and validating its performance across cultural and linguistic contexts (Paechter et al., 2024; Açıksöz et al., 2024b). Such efforts would strengthen our understanding of motivational trajectories and enrich strategies for sustaining STEM interest throughout the educational pipeline.

5. Conclusions

This study presents a newly developed and thoroughly validated STEM Motivation Scale for Children, designed to capture core motivational constructs among elementary school students. Through rigorous psychometric evaluation—including factor analyses, reliability assessments, and sensitivity testing—the instrument demonstrated solid structural validity, temporal stability, and practical relevance for educational research.
Empirical findings revealed that participation in a multi-day STEM program significantly increased student motivation across all examined domains, with sustained effects observed three months post-intervention. In particular, constructs such as Interest for STEM field and Desire for Practical Instruction exhibited robust immediate gains, while STEM Curiosity developed gradually over time—underscoring the layered nature of cognitive engagement.
Furthermore, the findings offer important implications for both educators and policymakers. By recognizing early indicators of STEM motivation, teachers can better tailor their instructional strategies to foster sustained interest, while policymakers are equipped with evidence to support the design of targeted interventions that strengthen long-term engagement across the education system.
This study provides initial evidence that participation in a multi-day STEM program can lead to short-term increases in students’ motivation and interest in STEM-related domains. While the observed changes were statistically significant, it is important to interpret these findings with caution. The data do not necessarily reflect deep or sustained engagement, and the relatively short follow-up period limits conclusions about long-term impact. Moreover, motivational trajectories in primary school students are influenced by a range of extraneous factors, and interest may fluctuate or diminish over time. Future research should explore the durability of these effects through extended longitudinal designs. Nonetheless, the validated STEM Motivation Scale offers educators a practical tool for monitoring and supporting student engagement in STEM learning environments.
The validated STEM Motivation Scale for Children offers educators a practical and reliable tool for identifying motivational profiles and shifts among students in upper primary grades. By assessing constructs such as interest, curiosity, career orientation, and desire for practical instruction, teachers can tailor lesson plans to better reflect students’ needs and preferences. The results of this study highlight the effectiveness of multi-day, inquiry-based STEM programs in enhancing student motivation, suggesting that integrating hands-on and exploratory activities into everyday instruction may yield lasting engagement. Moreover, regular use of the questionnaire enables monitoring of program impact over time, offering insights that can inform curriculum development, differentiated instruction, and early career guidance initiatives in STEM education.

Limitations and Future Research

While the present study provides valuable insights into the effects of STEM interventions and the reliability of a newly developed instrument, several limitations should be acknowledged. First, the sample consisted solely of students aged 10 to 11 from a limited number of schools, which may reduce the generalizability of findings to broader populations or different educational contexts. Second, all data were based on self-reported measures, which may be subject to social desirability bias. Third, the instrument was validated within a single cultural and linguistic setting; future studies should consider cross-cultural adaptation and validation.
Another limitation of the present study is the relatively short duration between the intervention and the follow-up measurement. Although the three-month interval allowed for the assessment of short-term motivational retention, future studies should consider extended follow-up periods (e.g., six months or end-of-year) to better understand the durability of motivational changes and the long-term applicability of the STEM Motivation Scale. Such longitudinal data would provide a more comprehensive view of how sustained engagement with STEM develops over time.
Future research should explore longitudinal applications of the instrument, examining motivational changes across multiple academic years. Additionally, it would be valuable to test the questionnaire in diverse educational systems and with broader age ranges. Expanding the instrument to include additional constructs—such as teacher support or peer influence—could further enrich our understanding of the mechanisms driving student interest in the STEM field.

Supplementary Materials

The following supporting information can be downloaded at https://www.mdpi.com/article/10.3390/educsci15091241/s1, Table S1. Results of t-test analysis comparing responses to survey questions 9–23 provided by the intervention group before and after the intervention; Table S2. Results of t-test analysis comparing responses to survey questions 9–23 provided by the control group before and after the intervention.

Author Contributions

Conceptualization, N.R., D.A. and D.N.; methodology, N.R. and D.A.; validation, N.R., D.N., D.A. and E.K.-A.; formal analysis, N.R., D.N., D.A. and E.K.-A.; investigation, N.R.; resources, N.R.; data curation, N.R. and D.N.; writing—original draft preparation, N.R.; writing—review and editing, N.R., D.N., D.A. and E.K.-A.; visualization, N.R.; supervision, D.N., D.A. and E.K.-A.; project administration, N.R.; funding acquisition, N.R. and D.N. All authors have read and agreed to the published version of the manuscript.

Funding

This research received external funding from ESF.

Institutional Review Board Statement

The study protocol was reviewed and approved by the Institutional Ethics Committee of Faculty of Science, University of Split (Approval Code: KLASA: 042-01/25-01/00024; UR-BROJ: 2181-204-05-09-25-00002, 16 May 2025). All procedures were conducted in accordance with the Declaration of Helsinki and national regulations governing research involving minors.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study. For minor participants, consent was provided by their legal guardians.

Data Availability Statement

The data presented in this study are available on request from the corresponding author. The data are not publicly available due to ethical restrictions related to research with minors.

Conflicts of Interest

The authors declare no conflicts of interest.

Abbreviations

The following abbreviations are used in this manuscript:
ANOVAAnalysis of Variance
CFAConfirmatory Factor Analysis
CFIComparative Fit Index
EFAExploratory Factor Analysis
ICCsIntraclass Correlation Coefficients
MMean
NCVVONational Center for External Evaluation of Education
NSFNational Science Foundation
OECDOrganization for Economic Co-operation and Development
PISAProgram for International Student Assessment
RMSEARoot Mean Square Error of Approximation
SDStandard Deviation
SRMRStandardized Root Mean Square Residual
STEMScience, Technology, Engineering, and Mathematics
TLITucker–Lewis Index
UNESCOUnited Nations Educational, Scientific and Cultural Organization

Appendix A. Questionnaire Items and Factor Structure

Item CodeSurvey StatementAssigned Factor
Q9I would like to conduct practical work in Nature and Society lessons that will teach me more.Desire for Practical Instruction
Q10I would like more materials in Nature and Society lessons that spark my curiosity.Desire for Practical Instruction
Q11I would like teaching materials that spark curiosity in Nature and Society lessons, even if they are difficult.Desire for Practical Instruction
Q12I think the knowledge from Nature and Society lessons will be useful in life.Interest for STEM Field
Q13I would like more practical projects in Nature and Society lessons to help me learn more.Desire for Practical Instruction
Q14I find conducting experiments interesting.Desire for Practical Instruction
Q15I am curious about how clouds are formed.STEM Curiosity
Q16I am curious about how rainbows are formed.STEM Curiosity
Q17I think the knowledge from Informatics lessons will be useful in life.Interest for STEM Field
Q18I am curious about how robots can be made.STEM Curiosity
Q19I think the knowledge from Mathematics lessons will be useful in life.Interest for STEM Field
Q20When I grow up, I want to program computers.Future Career Orientation in STEM
Q21When I grow up, I want to research volcanoes.Future Career Orientation in STEM
Q22When I grow up, I want to study viruses and bacteria.Future Career Orientation in STEM
Q23When I grow up, I want to study space.Future Career Orientation in STEM

References

  1. Açıksöz, S., Yildiz, M., & Bozkurt, Y. (2024a). Development and validation of STEM motivation scale for middle school students. International Journal of Assessment Tools in Education, 11(4), 699–720. [Google Scholar] [CrossRef]
  2. Açıksöz, S., Yıldırım, A., & Demir, B. (2024b). Do scientific attitude and intelligence affect motivation towards STEM? Frontiers in Psychology, 15, 1481229. [Google Scholar]
  3. Artino, A. R., Jr., La Rochelle, J. S., Dezee, K. J., & Gehlbach, H. (2014). Developing questionnaires for educational research: AMEE Guide No. 87. Medical Teacher, 36(6), 463–474. [Google Scholar] [CrossRef] [PubMed]
  4. ASPIRES. (2013). Department of education & professional studies, Young people’s science and career aspirations, age 10–14. ASPIRES. [Google Scholar]
  5. Berlyne, D. E. (1960). Conflict, arousal, and curiosity. McGraw-Hill. [Google Scholar]
  6. Burušić, J., & Šerić, M. (2015). Girls’ and boys’ achievements differences in the school context: An overview of possible explanations. Croatian Journal of Education, 17(4), 137–173. [Google Scholar] [CrossRef]
  7. Costello, A. B., & Osborne, J. W. (2005). Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical Assessment, Research, and Evaluation, 10(1), 7. [Google Scholar] [CrossRef]
  8. Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16(3), 297–334. [Google Scholar] [CrossRef]
  9. Çelik, R., & Yıldız, E. (2023). Active learning and student motivation in undergraduate STEM courses: A mixed-methods study. Advances in Physiology Education, 47(2), 123–134. [Google Scholar]
  10. Deci, E. L., & Ryan, R. M. (1985). Intrinsic motivation and self-determination in human behavior. Plenum. [Google Scholar]
  11. DeVellis, R. F. (2016). Scale development: Theory and applications. Sage Publications. [Google Scholar]
  12. European Schoolnet & DIGITALEUROPE. (2016). The e-skills manifesto. European Schoolnet. Available online: https://kometa.edu.pl/uploads/publication/652/60 (accessed on 15 April 2023).
  13. Freeman, S., Eddy, S. L., McDonough, M., Smith, M. K., Okoroafor, N., Jordt, H., & Wenderoth, M. P. (2014). Active learning increases student performance in science, engineering, and mathematics. Proceedings of the National Academy of Sciences, 111(23), 8410–8415. [Google Scholar] [CrossRef] [PubMed]
  14. Gardner, P., & Tamir, P. (1989). Interest in biology. Part I: A multidimensional construct. Journal of Research in Science Teaching, 26, 409–423. [Google Scholar] [CrossRef]
  15. Glasser, W. (1994). Quality school. Educa. [Google Scholar]
  16. Hulleman, C. S., Godes, O., Hendricks, C., & Harackiewicz, J. M. (2015). Measures of student motivation for STEM classrooms. Motivate Lab, University of Virginia. Available online: https://education.virginia.edu/research-initiatives/research-centers-labs/research-labs/motivate-lab/research-projects/measures-student-motivation-stem-classrooms (accessed on 6 May 2025).
  17. Illeris, K. (2007). How we learn: Learning and non-learning in school and beyond. Routledge. [Google Scholar]
  18. Kelley, T. R., & Knowles, J. G. (2016). A conceptual framework for integrated STEM education. International Journal of STEM Education, 3, 11. [Google Scholar] [CrossRef]
  19. Kline, P. (2015). Psychological testing: A practical approach to design and evaluation. Sage. [Google Scholar]
  20. Kolb, D. A. (1984). Experiential learning: Experience as the source of learning and development. Prentice-Hall. [Google Scholar]
  21. Koo, T. K., & Li, M. Y. (2016). A guideline of selecting and reporting intraclass correlation coefficients for reliability research. Journal of Chiropractic Medicine, 15(2), 155–163. [Google Scholar] [CrossRef] [PubMed]
  22. Lindahl, B. (2007, April 15–18). A Longitudinal study of students’ attitudes towards science and choice of career. Annual Meeting of the National Association for Research in Science Teaching, New Orleans, LA, USA. [Google Scholar]
  23. Lujan, H. L., & DiCarlo, S. E. (2006). Too much teaching, not enough learning: What is the solution? Advances in Physiology Education, 30, 17–22. [Google Scholar] [CrossRef] [PubMed]
  24. Ministry of Science and Education. (2019). Experimental program “school for life”. Ministry of Science and Education.
  25. National Research Council. (1996). National science education standards. National Research Council. [Google Scholar]
  26. NCVVO. (2018). Publication of the results of the OECD PISA 2018 survey. Available online: https://pisa.ncvvo.hr/wp-content/uploads/2019/12/PISA-2018_izvje%C5%A1taj.pdf (accessed on 1 September 2021).
  27. Osborne, J., & Dillon, J. (2008). Science education in Europe: Critical reflections. A report to the Nuffield Foundation. Available online: https://www.researchgate.net/profile/Jonathan-Osborne-3/publication/252404504_Science_Education_in_Europe_Critical_Reflections/links/543178e40cf277d58e982a32/Science-Education-in-Europe-Critical-Reflections.pdf (accessed on 5 May 2021).
  28. Paechter, M., Sins, P., & Nguyen, A. (2024). From early interest to career persistence: Understanding and supporting STEM pathways. Education Sciences, 14(7), 767. [Google Scholar] [CrossRef]
  29. Papert, S. (1980). Mindstorms: Children, computers, and powerful ideas. Basic Books. [Google Scholar]
  30. Qureshi, A., & Qureshi, N. (2021). Challenges and issues of STEM education. Advances in Mobile Learning Educational Research, 1(2), 146–161. [Google Scholar] [CrossRef]
  31. Said, Z., Summers, R., Abd-El-Khalick, F., & Wang, S. (2016). Attitudes toward science among grades 3 through 12 Arab students in Qatar: Findings from a cross-sectional national study. International Journal of Science Education, 38(4), 621–643. [Google Scholar] [CrossRef]
  32. Savickas, M. L. (2005). The theory and practice of career construction. In S. D. Brown, & R. W. Lent (Eds.), Career development and counseling: Putting theory and research to work (pp. 42–70). John Wiley & Sons. [Google Scholar]
  33. Shrout, P. E., & Fleiss, J. L. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86(2), 420. [Google Scholar] [CrossRef] [PubMed]
  34. Sustainable Development Goals. (2019). Available online: https://ec.europa.eu/info/strategy/international-strategies/sustainable-development-goals_hr (accessed on 13 June 2021).
  35. Tai, R. H., Liu, C. Q., Maltese, A. V., & Fan, X. (2006). Early planning for careers in science. Science, 312, 1143–1144. [Google Scholar] [CrossRef] [PubMed]
  36. Tavakol, M., & Dennick, R. (2011). Making sense of Cronbach’s alpha. International Journal of Medical Education, 2, 53–55. [Google Scholar] [CrossRef] [PubMed]
  37. Wells, J. G. (2019). STEM education: The potential of technology education. Council on Technology and Engineering Teacher Education. Available online: http://hdl.handle.net/10919/93963 (accessed on 13 February 2022).
  38. Wiebe, E. N., Williams, L., & Felder, R. M. (2018). The relationship of STEM attitudes and career interest. Eurasia Journal of Mathematics, Science and Technology Education, 14(6), 2451–2460. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Comparison of mean values of responses to questions 9 to 23 by the intervention group before the intervention (blue) and after the intervention (orange).
Figure 1. Comparison of mean values of responses to questions 9 to 23 by the intervention group before the intervention (blue) and after the intervention (orange).
Education 15 01241 g001
Figure 2. Line graphs of mean scores and standard deviations for four STEM-related constructs.
Figure 2. Line graphs of mean scores and standard deviations for four STEM-related constructs.
Education 15 01241 g002
Table 1. Results of t-test analysis of questions 9–23 of the STEM field interest survey before the intervention.
Table 1. Results of t-test analysis of questions 9–23 of the STEM field interest survey before the intervention.
NE = 272; NC = 257McSDcMESDEtp
Question 94.460.804.480.940.1580.438
Question 104.430.824.520.840.8940.187
Question 113.541.153.691.160.9600.169
Question 124.570.714.440.90−1.2660.104
Question 133.980.903.941.42−0.2680.388
Question 144.570.924.440.901.3190.095
Question 153.771.284.031.261.6120.055
Question 163.890.904.151.201.9440.027
Question 173.801.164.031.321.3980.082
Question 183.691.273.911.301.3210.094
Question 194.271.004.351.070.6640.254
Question 204.231.064.131.21−0.7300.233
Question 213.551.443.281.63−1.4760.071
Question 224.231.064.131.21−0.7300.233
Question 233.551.443.281.63−1.4760.071
NE—number of participants in the experimental group; NC—number of participants in the control group; Me—arithmetic mean of the responses in the experimental group; SDE—standard deviation of the responses in the experimental group; Mc—arithmetic mean of the responses in the control group; SDc—standard deviation of responses in the control group; tt-test value; p—statistical significance.
Table 2. STEM-related sores for experimental group Before, After the Intervention and at Three-month follow-up.
Table 2. STEM-related sores for experimental group Before, After the Intervention and at Three-month follow-up.
FactorBeforeAfterFollow-Up
Interest for STEM field0.810.850.84
Future Career Orientation0.760.790.78
Desire for Practical Instruction0.830.870.85
STEM Curiosity0.770.790.81
Table 3. Item-Level Factor Loadings Across STEM Constructs.
Table 3. Item-Level Factor Loadings Across STEM Constructs.
QuestionInterest for STEM FieldFuture Career Orientation in STEMDesire for Practical InstructionSTEM Curiosity
Q90.71 0.56
Q100.58 0.60
Q110.52 0.46
Q120.54
Q130.66 0.61
Q14 0.590.52
Q15 0.74
Q16 0.70
Q17 0.50
Q18 0.65 0.42
Q19 0.52
Q20 0.77
Q21 0.69
Q22 0.72
Q23 0.74
Table 4. Descriptive Statistics of STEM Constructs for Experimental and Control Groups Across Three Measurement Points.
Table 4. Descriptive Statistics of STEM Constructs for Experimental and Control Groups Across Three Measurement Points.
FactorGroupBeforeAfterThree-Month Follow-Up
Interest for STEM fieldExperimental group4.10 ± 0.504.58 ± 0.484.51 ± 0.50
Control group4.12 ± 0.504.15 ± 0.514.20 ± 0.49
Future Career Orientation in STEMExperimental group3.72 ± 0.604.22 ± 0.584.01 ± 0.59
Control group3.68 ± 0.603.71 ± 0.613.69 ± 0.63
Desire for Practical InstructionExperimental group4.05 ± 0.504.73 ± 0.464.52 ± 0.47
Control group4.01 ± 0.504.10 ± 0.514.13 ± 0.50
STEM CuriosityExperimental group4.22 ± 0.504.35 ± 0.554.47 ± 0.53
Control group4.19 ± 0.504.21 ± 0.564.20 ± 0.57
Table 5. p-Values for Group Comparisons Over Time (NE = 272 and NC = 257).
Table 5. p-Values for Group Comparisons Over Time (NE = 272 and NC = 257).
FactorMeasurement Timep-ValueConclusion
Interest for STEM fieldBefore0.6754No significant difference
After<0.0001Significant difference
Three-month follow-up<0.0001Significant difference
Future Career OrientationBefore0.6542No significant difference
After<0.0001Significant difference
Three-month follow-up0.0002Significant difference
Desire for Practical InstructionBefore0.6213No significant difference
After<0.0001Highly significant difference
Three-month follow-up<0.0001Highly significant difference
STEM CuriosityBefore0.7439No significant difference
After0.0121Significant difference
Three-month follow-up0.0003Significant difference
Table 6. Psychometric Properties of the STEM Interest Questionnaire.
Table 6. Psychometric Properties of the STEM Interest Questionnaire.
Psychometric CharacteristicValue/Result
Factor Structure (EFA)4 factors, loadings > 0.40
Cronbach’s α (all factors)0.76–0.87
CFA Fit indicesCFI = 0.94, RMSEA = 0.045
Test–Retest Reliabilityr = 0.62–0.78
Discriminant ValiditySignificant differences between experimental and control groups (p < 0.05)
Floor/Ceiling EffectsNot present
Item Distribution NormalityAssumptions met (skew < 1, kurtosis < 1.5)
Table 7. Intercorrelations Between STEM Interest Questionnaire Factors.
Table 7. Intercorrelations Between STEM Interest Questionnaire Factors.
Interest for STEM FieldFuture Career Orientation in STEMDesire for Practical InstructionSTEM Curiosity
Interest for STEM field1.000.45 (moderate)0.87 (strong)0.51 (strong)
Future Career Orientation in STEM0.45 (moderate)1.000.34 (moderate)0.70 (strong)
Desire for Practical Instruction0.87 (strong)0.34 (moderate)1.000.41 (moderate)
STEM Curiosity0.51 (strong)0.70 (strong)0.41 (moderate)1.00
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Ribarić, N.; Novoselić, D.; Ajduković, D.; Kovač-Andrić, E. Construct Validation of the STEM Motivation Scale for Children: A Multi-Timepoint Study. Educ. Sci. 2025, 15, 1241. https://doi.org/10.3390/educsci15091241

AMA Style

Ribarić N, Novoselić D, Ajduković D, Kovač-Andrić E. Construct Validation of the STEM Motivation Scale for Children: A Multi-Timepoint Study. Education Sciences. 2025; 15(9):1241. https://doi.org/10.3390/educsci15091241

Chicago/Turabian Style

Ribarić, Nikolina, Daniela Novoselić, Dean Ajduković, and Elvira Kovač-Andrić. 2025. "Construct Validation of the STEM Motivation Scale for Children: A Multi-Timepoint Study" Education Sciences 15, no. 9: 1241. https://doi.org/10.3390/educsci15091241

APA Style

Ribarić, N., Novoselić, D., Ajduković, D., & Kovač-Andrić, E. (2025). Construct Validation of the STEM Motivation Scale for Children: A Multi-Timepoint Study. Education Sciences, 15(9), 1241. https://doi.org/10.3390/educsci15091241

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop