Evaluation of Education Programmes and Policies

A special issue of Education Sciences (ISSN 2227-7102).

Deadline for manuscript submissions: closed (30 September 2024) | Viewed by 16732

Special Issue Editors


E-Mail Website
Guest Editor
School of Education, Durham University, Durham, DH1 1TA, UK
Interests: teacher supply; teacher development; teacher effectiveness; education policy; parental involvement; critical thinking; arts education; evaluation of education programmes; research methods
Special Issues, Collections and Topics in MDPI journals

E-Mail Website
Guest Editor Assistant
School of Education, Durham University, Durham DH1 1TA, UK
Interests: research synthesis; metacognition and self-regulated learning; teacher supply, evaluation of education programmes; STEM learning; English as a second language (ESL)

Special Issue Information

Dear Colleagues,

The last decade has been an exciting era for education research. It has seen a burgeoning of rigorous evaluations of education programmes and policies, not only in the UK, US and Europe, but also in Latin America, Africa, Asia and elsewhere. New and more robust approaches have been developed, tried and applied to the evaluation of education programmes.

More organisations and countries are recognising the importance of evidence-based practices in education. The Education Endowment Foundation (EEF) in the UK and the Institute of Education Sciences in the US are just two examples of organisations that are committed to evaluating education programmes and policies to ensure that programmes and policies used in schools are based on the best evidence.

International assessments, such as PISA, TIMSS, PIRLS and TALIS, provide valuable data on the performance of students and education systems across different countries and regions, which can be used to inform education policies and practices.  Access to administrative datasets has also made it possible to evaluate the effectiveness of education policies on a large scale. The use of robust research methods and the availability of data have greatly enhanced our ability to evaluate education policies and programmes and make evidence-based decisions. This Special Issue aims to curate a collection of such evaluations.

Why the need to evaluate education programmes and policies?

Whilst many education programmes have been evaluated, there is also an abundance of education classroom practices that have not been rigorously evaluated. For example, there is still no clear evidence whether class sizes, streaming or tracking, academic selection, academisation of schools (England) and grade retention are beneficial, and for which phase of education and in what context. Further, the proliferation of education technology and online teaching resources, especially during the lockdown in the recent COVID-19 pandemic, has seen many of these resources and this technology used by schools. Most of these have not been tested. Some may, indeed, be detrimental to learning.

Evaluating education policies and practices is crucial to ensure that our children receive the best possible education. It is important to recognise that different contexts and different groups of children may require different approaches to education. What works well in one school or community may not work as well in another, and what works for one group of students may not work for another. Evaluating education programmes and policies allows us to understand these nuances and tailor our approach to education to best meet the needs of all students.

In this Special Issue, we would like to invite papers that evaluate education policies, practices and programmes for all phases of education, from early years to higher education. We are particularly interested in rigorous research in the evaluation of education programmes and policies. These could be systematic reviews, meta-analyses and experimental studies, such as randomised control trials and quasi-experimental studies, e.g., regression discontinuity and difference-in-difference approaches. We also welcome articles that focus on methodological issues, conceptual pieces on policy evaluations and replication works.

If you would like to contribute to this Special Issue, please submit an abstract of between 250 and 300 words.

Prof. Dr. Beng Huat See
Guest Editor

Loraine Hitt
Guest Editor Assistant

Manuscript Submission Information

Manuscripts should be submitted online at www.mdpi.com by registering and logging in to this website. Once you are registered, click here to go to the submission form. Manuscripts can be submitted until the deadline. All submissions that pass pre-check are peer-reviewed. Accepted papers will be published continuously in the journal (as soon as accepted) and will be listed together on the special issue website. Research articles, review articles as well as short communications are invited. For planned papers, a title and short abstract (about 100 words) can be sent to the Editorial Office for announcement on this website.

Submitted manuscripts should not have been published previously, nor be under consideration for publication elsewhere (except conference proceedings papers). All manuscripts are thoroughly refereed through a double-blind peer-review process. A guide for authors and other relevant information for submission of manuscripts is available on the Instructions for Authors page. Education Sciences is an international peer-reviewed open access monthly journal published by MDPI.

Please visit the Instructions for Authors page before submitting a manuscript. The Article Processing Charge (APC) for publication in this open access journal is 1800 CHF (Swiss Francs). Submitted papers should be well formatted and use good English. Authors may use MDPI's English editing service prior to publication or during author revisions.

Keywords

  • programme evaluation
  • policy evaluation
  • systematic reviews
  • education interventions
  • experimental designs
  • process or implementation evaluations

Benefits of Publishing in a Special Issue

  • Ease of navigation: Grouping papers by topic helps scholars navigate broad scope journals more efficiently.
  • Greater discoverability: Special Issues support the reach and impact of scientific research. Articles in Special Issues are more discoverable and cited more frequently.
  • Expansion of research network: Special Issues facilitate connections among authors, fostering scientific collaborations.
  • External promotion: Articles in Special Issues are often promoted through the journal's social media, increasing their visibility.
  • e-Book format: Special Issues with more than 10 articles can be published as dedicated e-books, ensuring wide and rapid dissemination.

Further information on MDPI's Special Issue policies can be found here.

Published Papers (8 papers)

Order results
Result details
Select all
Export citation of selected articles as:

Research

16 pages, 257 KiB  
Article
How Public School Districts’ Characteristics Relate to Their Students’ Postsecondary Intentions
by Cassie L. Barnhardt, Nicole Tennessen, Jeff Ching-Fan Lai, Sameer Ali, Brian An, Man Phan, Erin Bovid and Bridget A. Wright
Educ. Sci. 2025, 15(3), 331; https://doi.org/10.3390/educsci15030331 - 7 Mar 2025
Viewed by 557
Abstract
In this study, we explore characteristics of public-school districts in the state of Iowa (USA) that contribute to high school graduates’ postsecondary intentions classified as either a four-year university (public or private), a community college, professional training (identified as private two-year or other [...] Read more.
In this study, we explore characteristics of public-school districts in the state of Iowa (USA) that contribute to high school graduates’ postsecondary intentions classified as either a four-year university (public or private), a community college, professional training (identified as private two-year or other training), employment or military, or other (homemaker or unknown). To explore this topic, we utilize census, population-level data associated with all Iowa public school districts for a period of three academic years using a series of linear regression models. Findings emphasize the importance of the disciplinary climate in the overall climate of the district as an important factor that contributes to structuring students’ future intentions, with added nuance related to the total enrollment or size of the district. Full article
(This article belongs to the Special Issue Evaluation of Education Programmes and Policies)
21 pages, 241 KiB  
Article
An Evaluation of the Attainment Gaps in State Schools in England: Evidence from Next Steps’ Age 25 Sweep Dataset
by Xin Shao and Binwei Lu
Educ. Sci. 2025, 15(2), 179; https://doi.org/10.3390/educsci15020179 - 4 Feb 2025
Viewed by 707
Abstract
This paper evaluates the higher education (HE) admissions policy by examining the educational attainment gaps in state schools of young people from different socio-economic backgrounds in England. We analysed data for a cohort of 5192 state-educated young people from the large-scale nationally representative [...] Read more.
This paper evaluates the higher education (HE) admissions policy by examining the educational attainment gaps in state schools of young people from different socio-economic backgrounds in England. We analysed data for a cohort of 5192 state-educated young people from the large-scale nationally representative longitudinal Next Steps dataset from 2004 to 2015, linked to the robust administrative National Pupil Database (NPD) for England. The analytical methods used include effect sizes and correlations. The results show a clear pattern of the socio-economic stratification of young people’s educational attainment. Pupil deprivation is a key indicator which is consistently associated with lower educational attainment. While this is not surprising, our study also suggests that there are other factors besides the family backgrounds which are associated with young people’s educational outcomes. Pupils’ enjoyment of school, their educational aspirations, and their parent’s aspirations for their children are found to have a positive correlation with attainment at school, suggesting that educational aspirations and positive school experiences might contribute to a narrowing of deprivation-related gaps. As the analyses also suggest that young people who went to university and those in professional occupations consistently achieved higher academic performance than their peers, the findings have policy implications for improving social mobility. While it is not possible to alter parents’ socioeconomic backgrounds, raising children’s aspirations and making school enjoyable are amenable to policies and interventions. The common practice of using academic attainment as a selection criterion for admission to HE is likely to disadvantage children from low socioeconomic families, with implications for social mobility. The contextualised admission (CA) policy should lead to fairer approaches, which could be used for admissions to HE. Full article
(This article belongs to the Special Issue Evaluation of Education Programmes and Policies)
27 pages, 983 KiB  
Article
An Evaluation of Secondary School Students’ Use and Understanding of Learning Strategies to Study and Revise for Science Examinations
by Fatema Sultana, Richard C. Watkins, Tarek Al Baghal and J. Carl Hughes
Educ. Sci. 2025, 15(1), 101; https://doi.org/10.3390/educsci15010101 - 17 Jan 2025
Viewed by 3631
Abstract
There is currently no population-based data evaluating secondary school-aged students’ use, or understanding of, learning strategies to study/revise independently for science. There is also no research evaluating the effort students make towards independent science study and revision, nor how schools support students with [...] Read more.
There is currently no population-based data evaluating secondary school-aged students’ use, or understanding of, learning strategies to study/revise independently for science. There is also no research evaluating the effort students make towards independent science study and revision, nor how schools support students with study and/or revision strategies for science examinations. In this paper, we report data from a representative sample of 385 students (aged 14 to 15 years) from 29 secondary schools in the UK, using the Effective Revision and Study Strategies Questionnaire (ERaSSQ) survey. We conducted a cross-sectional survey using a multistage implicitly stratified sampling method. Our results show that the learning strategies most frequently used by students for independent science study and revision were making notes, repeatedly reading information, and highlighting or underlining information (i.e., lower utility learning strategies). Our findings also suggest many students do not have a complete understanding of the strategies that are known to have higher utility (i.e., retrieval and spaced practice). These results represent the first attempt to gather information using robust survey methods and are of interest to secondary school science teachers and education policymakers. Full article
(This article belongs to the Special Issue Evaluation of Education Programmes and Policies)
Show Figures

Figure 1

17 pages, 241 KiB  
Article
Do School Exclusions and Attainment Outcomes Disproportionately Impact Minority Ethnic Pupils? Analysis of Pupil Characteristics, Segregation, and Outcomes in England
by Stephen Gorard, Nadia Siddiqui, Beng Huat See and Yiyang Gao
Educ. Sci. 2025, 15(1), 6; https://doi.org/10.3390/educsci15010006 - 24 Dec 2024
Viewed by 2741
Abstract
Large-scale administrative datasets show disproportionate figures for attainment outcomes and school exclusions for pupils in some ethnic groups in England. This surface gap in attainment and school exclusion is concerning, and we consider whether ethnicity is really the driver here. In this paper, [...] Read more.
Large-scale administrative datasets show disproportionate figures for attainment outcomes and school exclusions for pupils in some ethnic groups in England. This surface gap in attainment and school exclusion is concerning, and we consider whether ethnicity is really the driver here. In this paper, we present the findings on KS2 and KS4 attainment and exclusion outcomes for the cohorts in 2019, which are available from the National Pupil Database in England (with around 600,000 pupils per cohort). We present the outcomes and other characteristics for each ethnic category available. The analyses then modelled the attainment and exclusion outcomes via multivariate regression, in terms of individual pupil characteristics and school-level figures including school segregation by pupil ethnicity and disability. The predictors were entered in batches from pupil background, through prior attainment, and school-level measures, to individual ethnicity. The findings show that prior attainment and special needs/disability status are the main drivers of attainment at both KS2 and KS4. Individual pupil ethnicity did not help to explain either attainment or exclusions, over and above these other factors, and this finding largely corroborates the descriptive results. However, the factors related to school-level segregation by ethnicity, free school meal eligibility (FSM), and having English as an additional language (EAL) are somewhat relevant in predicting pupils’ permanent school exclusion at KS4. These findings have implications for admission policies that can reduce school segregation and interventions that can support disadvantaged pupils’ wider learning experiences. Full article
(This article belongs to the Special Issue Evaluation of Education Programmes and Policies)
19 pages, 638 KiB  
Article
An Evaluation of Education Policy in England since 2010 and the Policy Consequences for Small Primary Schools
by Tanya Ovenden-Hope
Educ. Sci. 2024, 14(11), 1164; https://doi.org/10.3390/educsci14111164 - 26 Oct 2024
Viewed by 2015
Abstract
The fate of small primary schools (pupils aged five–eleven years old) in England is linked to education policy reforms. This paper presents an evaluation of selected education policy reforms in England since 2010 with suggested consequences for small primary schools. The research was [...] Read more.
The fate of small primary schools (pupils aged five–eleven years old) in England is linked to education policy reforms. This paper presents an evaluation of selected education policy reforms in England since 2010 with suggested consequences for small primary schools. The research was undertaken using a qualitative research methodology that employed a document analysis method to create a Policy Document Analysis Frame (PDAF) for the policy evaluation. The implications of the policy reforms for small primary schools were examined through the conceptual lens of Educational Isolation. Educational Isolation identifies the limiting factors of place for a school’s access to the resources required for school improvement. Education policy reform is focused on school improvement. Small primary schools in England are typically located in rural neighbourhoods with sparse populations, resulting in an average of just over 100 pupils per school. The findings suggest that the contextual factors of place and size for small primary schools in England present disadvantages in relation to the selected national education policy reforms. The national funding formula, Multi Academy Trusts (groups of schools independently regulated but centrally funded by the state), and National Standards are the key policy reforms, driven by a neo-liberal ideology, that are suggested to have implications for the future of small schools. Recommendations are offered to the new 2024 Labour government that would support the re-instatement of small primary schools as an integral part of the education landscape in England. Full article
(This article belongs to the Special Issue Evaluation of Education Programmes and Policies)
Show Figures

Figure 1

28 pages, 882 KiB  
Article
Where Are the Costs? Using an Economic Analysis of Educational Interventions Approach to Improve the Evaluation of a Regional School Improvement Programme
by Emma Tiesteel, Richard C. Watkins, Carys Stringer, Adina Grigorie, Fatema Sultana and J. Carl Hughes
Educ. Sci. 2024, 14(9), 957; https://doi.org/10.3390/educsci14090957 - 29 Aug 2024
Viewed by 1930
Abstract
Education systems are moving to a more evidence-informed paradigm to improve outcomes for learners. To help this journey to evidence, robust qualitative and quantitative research can help decisionmakers identify more promising approaches that provide value for money. In the context of the utilisation [...] Read more.
Education systems are moving to a more evidence-informed paradigm to improve outcomes for learners. To help this journey to evidence, robust qualitative and quantitative research can help decisionmakers identify more promising approaches that provide value for money. In the context of the utilisation of scarce resources, an important source of evidence commonly used in health and social care research is an understanding of the economic impact of intervention choices. However, there are currently very few examples where these methodologies have been used to improve the evaluation of education interventions. In this paper we describe the novel use of an economic analysis of educational interventions (EAEI) approach to understand both the impact and the cost of activities in the evaluation of a formative assessment implementation project (FAIP) designed to improve teachers’ understanding and use of formative assessment strategies. In addition to utilising a mixed method quasi-experimental design to explore the impact on learner wellbeing, health utility and attainment, we describe the use of cost-consequence analysis (CCA) to help decisionmakers understand the outcomes in the context of the resource costs that are a crucial element of robust evaluations. We also discuss the challenges of evaluating large-scale, universal educational interventions, including consideration of the economic tools needed to improve the quality and robustness of these evaluations. Finally, we discuss the importance of triangulating economic findings alongside other quantitative and qualitative information to help decisionmakers identify more promising approaches based on a wider range of useful information. We conclude with recommendations for more routinely including economic costs in education research, including the need for further work to improve the utility of economic methods. Full article
(This article belongs to the Special Issue Evaluation of Education Programmes and Policies)
Show Figures

Figure 1

11 pages, 227 KiB  
Article
Research, Science Identity, and Intent to Pursue a Science Career: A BUILD Intervention Evaluation at CSULB
by Hector V. Ramos and Kim-Phuong L. Vu
Educ. Sci. 2024, 14(6), 647; https://doi.org/10.3390/educsci14060647 - 15 Jun 2024
Cited by 1 | Viewed by 1105
Abstract
This paper presents an analysis of survey data to examine the association between participating in one of the National Institute of Health’s (NIH) funded Building Infrastructure Leading to Diversity Initiative (BUILD) program and students’ intent to pursue a career in science. Data were [...] Read more.
This paper presents an analysis of survey data to examine the association between participating in one of the National Institute of Health’s (NIH) funded Building Infrastructure Leading to Diversity Initiative (BUILD) program and students’ intent to pursue a career in science. Data were collected from students at California State University Long Beach (CSULB) to examine the effectiveness of the BUILD Scholars program. Both BUILD Scholars and non-BUILD students were surveyed. Propensity score matching was used to generate the non-BUILD comparison group. Multinomial logistic regression results revealed that students participating in the BUILD intervention were associated with significantly higher intent to pursue a career in science. Results also showed the importance of variables such as science identity and research participation when assessing interest in science careers. These findings have implications for STEM program evaluation and practice in higher education. Full article
(This article belongs to the Special Issue Evaluation of Education Programmes and Policies)
12 pages, 794 KiB  
Article
An Investigation of the Cross-Language Transfer of Reading Skills: Evidence from a Study in Nigerian Government Primary Schools
by Steve Humble, Pauline Dixon, Louise Gittins and Chris Counihan
Educ. Sci. 2024, 14(3), 274; https://doi.org/10.3390/educsci14030274 - 6 Mar 2024
Cited by 2 | Viewed by 2123
Abstract
This paper investigates the linguistic interdependence of Grade 3 children studying in government primary schools in northern Nigeria who are learning to read in Hausa (L1) and English (L2) simultaneously. There are few studies in the African context that consider linguistic interdependence and [...] Read more.
This paper investigates the linguistic interdependence of Grade 3 children studying in government primary schools in northern Nigeria who are learning to read in Hausa (L1) and English (L2) simultaneously. There are few studies in the African context that consider linguistic interdependence and the bidirectional influences of literacy skills in multilingual contexts. A total of 2328 Grade 3 children were tested on their Hausa and English letter sound knowledge (phonemes) and reading decoding skills (word) after participating in a two-year English structured reading intervention programme as part of their school day. In Grade 4, these children will become English immersion learners, with English becoming the medium of instruction. Carrying out bivariate correlations, we find a large and strongly positively significant correlation between L1 and L2 test scores. Concerning bidirectionality, a feedback path model illustrates that the L1 word score predicts the L2 word score and vice versa. Multi-level modelling is then used to consider the variation in test scores. Almost two thirds of the variation in the word score is attributable to the pupil level and one third to the school level. The Hausa word score is significantly predicted through Hausa sound and English word score. English word score is significantly predicted through Hausa word and English sound score. The findings have implications for language policy and classroom instruction, showing the importance of cross-language transfer between reading skills. The overall results support bidirectionality and linguistic interdependence. Full article
(This article belongs to the Special Issue Evaluation of Education Programmes and Policies)
Show Figures

Figure 1

Back to TopTop