Development of Public Health Core Outcome Sets for Systems-Wide Promotion of Early Life Health and Wellbeing
1.1. Background and Objectives
- Identify an agreed minimal dataset of potential outcomes from locally relevant frameworks.
- Achieve expert consensus on the COS through a two-stage Delphi consultation process.
- Incorporate the perspective of the local communities in which early years and childhood interventions are targeted, in the COS development.
- Arrive at a final COS-EY.
2. Materials and Methods
2.3. Information Sources (Development of the Minimal Dataset)
2.4. Consensus Process
2.4.2. Community Consultation
2.5.1. Outcome Scoring/Feedback
2.5.2. Consensus Definition
- Automatic inclusion: More than 80% of the participants scored the outcome 7, 8 or 9.
- Automatic exclusion: More than 80% of the participants scored the outcome 1, 2, or 3.
- For all remaining outcomes: the decision whether to include or exclude items from the subsequent round (Round 2) of the survey was considered following discussion within the immediate study team (M.B. & L.M.). Key considerations were the distance from the 80% automatic inclusion agreement index cut-off (% of experts ranking outcome 7 or higher); Round 1 median score; the balance of representation of outcomes across the outcome domains; and feedback from the open-ended comments made by participants in the survey. Adaptations to the approach were considered as appropriate based on the outcomes identified for the minimum dataset and how they were constructed, in addition to our need to reduce outcome lists to represent ‘core sets’ where participants were unable to deprioritize their importance.
2.5.3. Community Consultation—Analysis
3.2. Outcomes Considered at the Start of the Process (Minimal Dataset)
3.3. Delphi Studies
3.4. Final COS-EY
4.1. Comparisons with Existing Outcomes Frameworks and Literature
4.3. Next Steps
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
- Williamson, P.R.; Altman, D.G.; Blazeby, J.M.; Clarke, M.; Devane, D.; Gargon, E.; Tugwell, P. Developing core outcome sets for clinical trials: Issues to consider. Trials 2012, 13, 1–8. [Google Scholar] [CrossRef][Green Version]
- Williamson, P.R.; Altman, D.G.; Bagley, H.; Barnes, K.L.; Blazeby, J.M.; Brookes, S.T.; Clarke, M.; Gargon, E.; Gorst, S.; Harman, N.; et al. The COMET Handbook: Version 1.0. Trials 2017, 18, 1–50. [Google Scholar] [CrossRef][Green Version]
- Public Health England. Proposed Changes to the Public Health Outcomes Framework from 2019/20: A Consultation about Public Health England; Public Health England: London, UK, 2019. [Google Scholar]
- NHS Outcomes Framework Indicators-August 2021 Release. Available online: https://digital.nhs.uk/data-and-information/publications/statistical/nhs-outcomes-framework/august-2021 (accessed on 22 May 2022).
- Gargon, E.; Gorst, S.L.; Matvienko-Sikar, K.; Williamson, P.R. Choosing important health outcomes for comparative effectiveness research: 6th annual update to a systematic review of core outcome sets for research. PLoS ONE 2021, 16, e0244878. [Google Scholar] [CrossRef]
- Wright, J.; Hayward, A.C.; West, J.; Pickett, K.; McEachan, R.M.; Mon-Williams, M.; Christie, N.; Vaughan, L.; Sheringham, J.; Haklay, M.; et al. ActEarly: A City Collaboratory approach to early promotion of good health and wellbeing. Wellcome Open Res. 2019, 4, 156. [Google Scholar] [CrossRef][Green Version]
- Stansfield, J.; South, J.; Mapplethorpe, T. What are the elements of a whole system approach to community-centred public health? A qualitative study with public health leaders in England’s local authority areas. BMJ Open 2020, 10, 1–11. [Google Scholar] [CrossRef]
- Lockyer, B.; Islam, S.; Rahman, A.; Dickerson, J.; Pickett, K.; Sheldon, T.; Wright, J.; McEachan, R.; Sheard, L. Understanding COVID-19 misinformation and vaccine hesitancy in context: Findings from a qualitative study involving citizens in Bradford, UK. Health Expect. 2021, 24, 1158–1167. [Google Scholar] [CrossRef]
- McEachan, R.R.C.; Dickerson, J.; Bridges, S.; Bryant, M.; Cartwright, C.; Islam, S.; Lockyer, B.; Rahman, A.; Sheard, L.; West, J.; et al. The Born in Bradford COVID-19 Research Study: Protocol for an adaptive mixed methods research study to gather actionable intelligence on the impact of COVID-19 on health inequalities amongst families living in Bradford. Wellcome Open Res. 2020, 5, 1–19. [Google Scholar] [CrossRef]
- Skarda, I.; Asaria, M.; Cookson, R. (Preprint)LifeSim: A Lifecourse Dynamic Microsimulation Model of the Millennium Birth Cohort in England. medRxiv 2021. [Google Scholar] [CrossRef]
- ActEarly. ActEarly [Internet]. 2022. Available online: https://actearly.org.uk/our-projects/ (accessed on 22 May 2022).
- Brown, B.B. Delphi process: A methodology used for the elicitation of opinions of experts. ASTME Vectors 1968, 1–15. [Google Scholar]
- COMET. Development of Public Health Core Outcome Sets for Early Life Health and Wellbeing: ActEarly Consortium [Internet]. COMET Initiative. 2021. Available online: https://comet-initiative.org/Studies/Details/1910 (accessed on 22 May 2022).
- Kirkham, J.J.; Gorst, S.; Altman, D.G.; Blazeby, J.M.; Clarke, M.; Devane, D.; Gargon, E.; Moher, D.; Schmitt, J.; Tugwell, P.; et al. Core Outcome Set–STAndards for Reporting: The COS-STAR Statement. PLoS Med. 2016, 13, e1002148. [Google Scholar] [CrossRef][Green Version]
- Qualtrics. Qualtrics: Provo, UT, USA, 2020; Available online: https://www.qualtrics.com/ (accessed on 22 May 2022).
- Delbecq, A.; Van de Ven, A. A Group Process Model for Problem Identification and Problem Planning. J. Appl. Behav. Sci. 1971, 7, 466–492. [Google Scholar] [CrossRef]
- Fallon, S.; Smith, J.; Morgan, S.; Stoner, M.; Austin, C. “Pizza, patients and points of view”: Involving young people in the design of a post registration module entitled the adolescent with cancer. Nurse Educ. Pract. 2008, 8, 140–147. [Google Scholar] [CrossRef]
- Donald, M.; Beanlands, H.; Straus, S.; Ronksley, P.; Tam-Tham, H.; Finlay, J.; Smekal, M.; Elliott, M.J.; Farragher, J.; Herrington, G.; et al. Preferences for a self-management e-health tool for patients with chronic kidney disease: Results of a patient-oriented consensus workshop. CMAJ Open 2019, 7, E713–E720. [Google Scholar] [CrossRef][Green Version]
- De Meyer, D.; Kottner, J.; Beele, H.; Schmitt, J.; Lange, T.; Van Hecke, A.; Verhaeghe, S.; Beeckman, D. Delphi procedure in core outcome set development: Rating scale and consensus criteria determined outcome selection. J. Clin. Epidemiol. 2019, 111, 23–31. [Google Scholar] [CrossRef]
- StataCorp. Stata Statistical Software: Release 16; StataCorp LLC: College Station, TX, USA, 2019. [Google Scholar]
- Diamond, I.R.; Grant, R.C.; Feldman, B.M.; Pencharz, P.B.; Ling, S.C.; Moore, A.M.; Wales, P.W. Defining consensus: A systematic review recommends methodologic criteria for reporting of Delphi studies. J. Clin. Epidemiol. 2014, 67, 401–409. [Google Scholar] [CrossRef]
- Keeney, S.; Hasson, F.; McKenna, H. Consulting the oracle: Ten lessons from using the Delphi technique in nursing research. J. Adv. Nurs. 2006, 53, 205–212. [Google Scholar] [CrossRef]
- Meijering, J.V.; Kampen, J.K.; Tobi, H. Quantifying the development of agreement among experts in Delphi studies. Technol. Forecast. Soc. Chang. 2013, 80, 1607–1614. [Google Scholar] [CrossRef]
- Sohal, K.; Mason, D.; Birkinshaw, J.; West, J.; McEachan, R.; Elshehaly, M.; Cooper, D.; Shore, R.; McCooe, M.; Lawton, T.; et al. Connected Bradford: A Whole System Data Linkage Accelerator. Wellcome Open Res. 2022, 7, 26. [Google Scholar] [CrossRef]
- The Bromley by Bow ActEarly Community Research Team. What Makes the Best Start in Life for Children in Tower Hamlets? [Internet]. London; 2021. Available online: https://actearly.org.uk/wp-content/uploads/2022/03/ActEarly-BBB-The-Best-Start-In-Life-Final-Report-for-publication.pdf (accessed on 22 May 2022).
- Hug, L.; Alexander, M.; You, D.; Alkema, L. National, regional, and global levels and trends in neonatal mortality between 1990 and 2017, with scenario-based projections to 2030: A systematic analysis. Lancet Glob. Health 2019, 7, e710–e720. [Google Scholar] [CrossRef][Green Version]
- Naghavi, M.; Abajobir, A.A.; Abbafati, C.; Abbas, K.M.; Abd-Allah, F.; Abera, S.F.; Aboyans, V.; Adetokunboh, O.; Ärnlöv, J.; Afshin, A.; et al. Global, regional, and national age-sex specifc mortality for 264 causes of death, 1980–2016: A systematic analysis for the Global Burden of Disease Study 2016. Lancet 2017, 390, 1151–1210. [Google Scholar] [CrossRef][Green Version]
- Cao, X.; Hou, Y.; Zhang, X.; Xu, C.; Jia, P.; Sun, X.; Sun, L.; Gao, Y.; Yang, H.; Cui, Z.; et al. A Comparative, Correlate Analysis and Projection of Global and Regional Life Expectancy, Healthy Life Expectancy, and their GAP: 1995–2025. J. Glob. Health 2020, 10, 020407. [Google Scholar]
- Petruccelli, K.; Davis, J.; Berman, T. Adverse childhood experiences and associated health outcomes: A systematic review and meta-analysis. Child Abus. Negl. 2019, 97, 104127. [Google Scholar] [CrossRef]
- Boullier, M.; Blair, M. Adverse childhood experiences. Paediatr. Child Health 2018, 28, 132–137. [Google Scholar] [CrossRef]
- Public Health England. PHE Strategy 2020-25 Executive Summary [Internet]. London; 2019. Available online: https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/830105/PHE_Strategy__2020-25__Executive_Summary.pdf (accessed on 22 May 2022).
- WHO Europe. Action Plan for the Prevention and Control of Noncommunicable Diseases in the WHO European Region [Internet]. Copenhagen; 2016. Available online: http://www.euro.who.int/en/who-we-are/governance (accessed on 22 May 2022).
- Kennedy, A.C.; Prock, K.A. “I Still Feel Like I Am Not Normal”: A Review of the Role of Stigma and Stigmatization Among Female Survivors of Child Sexual Abuse, Sexual Assault, and Intimate Partner Violence. Trauma Violence Abus. 2018, 19, 512–527. [Google Scholar] [CrossRef]
- Meyrick, J.; Gray, D. Evidence-based patient/public voice: A patient and public involvement audit in the field of sexual health. BMJ Sex. Reprod. Health 2018, 44, 267–271. [Google Scholar] [CrossRef]
- Powell, C. The Delphi technique: Myths and realities. J. Adv. Nurs. 2003, 41, 376–382. [Google Scholar] [CrossRef][Green Version]
|Participant Group||Delphi Round 1|
|Delphi Round 2|
|Core Outcome Set||Outcome Name|
|COS-EY 1: Development & education||1.1 Access to education|
|1.2 Speech, language & communication|
|1.3 Emotional & social development|
|1.4 Children get best start in life|
|1.5 Educational attainment|
|1.6 Access to books|
|COS-EY 2: Physical health & health behaviors||2.1 Child physical activity|
|2.2 Child sedentary behavior|
|2.3 Healthy eating|
|2.4 Child weight|
|2.5 Childhood obesity|
|2.6 Adult obesity|
|COS-EY 3: Mental health||3.1 Child happiness|
|3.2 Child mental health (incl. children’s stress and anxiety)|
|3.3 Child mental well-being|
|3.4 Parental mental health|
|3.5 Parental mental well-being|
|COS-EY 4: Social environment||4.1 Family & social relationships|
|4.2 Safety at home|
|4.3 Domestic abuse|
|4.4 Child social relationships & bullying|
|COS-EY 5: Physical environment||5.1 Use, quality, and satisfaction with open space|
|5.2 Parks & green spaces (incl. access to green space)|
|5.3 Access to high quality health services|
|5.4 Air pollution|
|5.5 Food availability|
|5.6 Quality of local environment|
|5.7 Traffic (incl. traffic levels outside schools, parking)|
|COS-EY 6: Poverty & inequality||6.1 Housing (incl. homelessness; house crowding; availability of affordable housing)|
|6.2 Access to opportunity|
|6.3 Basic care needs met|
|6.5 Financial stability|
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Mansukoski, L.; Albert, A.; Vafai, Y.; Cartwright, C.; Rahman, A.; Sheringham, J.; Lockyer, B.; Yang, T.C.; Garnett, P.; Bryant, M. Development of Public Health Core Outcome Sets for Systems-Wide Promotion of Early Life Health and Wellbeing. Int. J. Environ. Res. Public Health 2022, 19, 7947. https://doi.org/10.3390/ijerph19137947
Mansukoski L, Albert A, Vafai Y, Cartwright C, Rahman A, Sheringham J, Lockyer B, Yang TC, Garnett P, Bryant M. Development of Public Health Core Outcome Sets for Systems-Wide Promotion of Early Life Health and Wellbeing. International Journal of Environmental Research and Public Health. 2022; 19(13):7947. https://doi.org/10.3390/ijerph19137947Chicago/Turabian Style
Mansukoski, Liina, Alexandra Albert, Yassaman Vafai, Chris Cartwright, Aamnah Rahman, Jessica Sheringham, Bridget Lockyer, Tiffany C. Yang, Philip Garnett, and Maria Bryant. 2022. "Development of Public Health Core Outcome Sets for Systems-Wide Promotion of Early Life Health and Wellbeing" International Journal of Environmental Research and Public Health 19, no. 13: 7947. https://doi.org/10.3390/ijerph19137947