Development of the Dutch Chaplaincy Outcome Measure
Abstract
:1. Introduction
Background: PROM Development
2. Materials and Methods
2.1. Design
2.2. Participants
2.3. Data Collection and Analysis
2.3.1. Stage 1: Goals of Chaplaincy
2.3.2. Stage 2: Outcomes of Chaplaincy
2.3.3. Stage 3: Instrument Construction
2.3.4. Stage 4: Evaluation
3. Results
3.1. Goal and Form of the PROM
3.2. Selecting Outcomes and Statements
3.3. Constructing the NUGV
3.3.1. Acceptability and Face Validity
3.3.2. Clarity
3.3.3. Changes Made
3.3.4. Pilot Studies
4. Discussion
Limitations
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
1 | In the north of the Netherlands the extraction of natural gasses has been causing earthquakes since 1986. In 2013, the number of earthquakes a year with a magnitude of over 1.5 on the Richter scale reached a peak of 30 earthquakes. The number of small earthquakes was highest in 2017, with over 120 tremors recorded that year. There has been a decrease in the number of tremors since then (Royal Netherlands Meteorological Institute n.d.). The earthquakes have caused material, psychological, and social damage in the region, which long went unnoticed by the Dutch government (Stroebe et al. 2021). In 2014, the Church and Earthquake platform was founded by several churches in the region, to provide spiritual support and draw attention to the problems. In 2018, this culminated in a government subsidy for the employment of two chaplains (de Kraker-Zijlstra et al. 2021). Currently, eight chaplains are active in the region, who provide care at both individual and community levels (GVA Groningen n.d.). |
References
- Austin, Philip, Jessica Macdonald, and Roderick MacLeod. 2018. Measuring Spirituality and Religiosity in Clinical Settings: A Scoping Review of Available Instruments. Religions 9: 70. [Google Scholar] [CrossRef]
- Banasick, Shawn. 2019. KADE: A desktop application for Q methodology. Journal of Open Source Software 4: 1360. [Google Scholar] [CrossRef]
- Berning, Joel N., Armeen D. Poor, Sarah M. Buckley, Komal R. Patel, David J. Lederer, Nathan E. Goldstein, Daniel Brodie, and Matthew R. Baldwin. 2016. A Novel Picture Guide to Improve Spiritual Care and Reduce Anxiety in Mechanically Ventilated Adults in the Intensive Care Unit. Annals of the American Thoracic Society 13: 1333–42. [Google Scholar] [CrossRef] [PubMed]
- Carey, Lindsay B., Timothy J. Hodgson, Lillian Krikheli, Rachel Y. Soh, Annie-Rose Armour, Taranjeet K. Singh, and Cassandra G. Impiombato. 2016. Moral Injury, Spiritual Care and the Role of Chaplains: An Exploratory Scoping Review of Literature and Resources. Journal of Religion and Health 55: 1218–45. [Google Scholar] [CrossRef]
- Churruca, Kate, Kristiana Ludlow, Wendy Wu, Kate Gibbons, Hoa Mi Nguyen, Louise A. Ellis, and Jeffrey Braithwaite. 2021. A scoping review of Q-methodology in healthcare research. BMC Medical Research Methodology 21: 125. [Google Scholar] [CrossRef]
- Damen, Annelieke, Anja Visser-Nieraeth, Carmen Schuhmann, Sujin Rosie, Marjo van Zundert, Gaby Jacobs, Hanneke Muthert, and Erik Olsman. 2024. Doelen van geestelijke verzorging in de thuissituatie. Tijdschrift Geestelijke Verzorging 27: 22–32. [Google Scholar]
- Danbolt, Lars J., Valerie DeMarinis, Mats Rydinger, and Hetty Zock. 2019. Chaplaincy—How and why. Tidsskrift for Praktisk Teologi 36: 4–10. [Google Scholar] [CrossRef]
- de Kraker-Zijlstra, Anieljah, Hanneke Muthert, Hetty Zock, and Martin Walton. 2021. Attention for meaning-making processes: Context and practice of spiritual care in the earthquake area of Groningen. NTT Journal for Theology and the Study of Religion 75: 31–52. [Google Scholar] [CrossRef]
- De Ruiter, Ellen. 2024. Zin Schrijven. Een Onderzoek Naar de Zingevende Kracht van Schrijven voor Slachtoffers van Seksueel Misbruik. Master’s thesis, University of Groningen, Groningen, The Netherlands. [Google Scholar]
- GVA Groningen. n.d. Het GVA Team. Available online: https://gvagroningen.nl/het-gva-team/ (accessed on 3 June 2025).
- Iler, William L., Don Obenshain, and Mary Camac. 2001. The Impact of Daily Visits from Chaplains on Patients with Chronic Obstructive Pulmonary Disease (COPD): A Pilot Study. Chaplaincy Today 17: 5–11. [Google Scholar] [CrossRef]
- Jacobs, Gaby, Carmen Schuhmann, and Iris Wierstra. 2024. Healthcare chaplains’ conflicting and ambivalent positions regarding meaning in life and worldview. Journal of Health Care Chaplaincy 30: 107–21. [Google Scholar] [CrossRef]
- Kirchoff, Robert W., Beba Tata, Jack McHugh, Thomas Kingsley, M. Caroline Burton, Dennis Manning, Maria Lapid, and Rahul Chaudhary. 2021. Spiritual Care of Inpatients Focusing on Outcomes and the Role of Chaplaincy Services: A Systematic Review. Journal of Religion and Health 60: 1406–22. [Google Scholar] [CrossRef] [PubMed]
- Krippendorff, Klaus. 2019. Content Analysis: An Introduction to Its Methodology. Thousand Oaks: SAGE Publications, Inc. [Google Scholar] [CrossRef]
- Lutfallah, Susan, and Lori Buchanan. 2019. Quantifying subjective data using online Q-methodology software. The Mental Lexicon 14: 415–23. [Google Scholar] [CrossRef]
- Macdonald, Gordon W. 2019. Primary care chaplaincy: An intervention for complex presentation. Primary Health Care Research & Development 20: e69. [Google Scholar] [CrossRef]
- McMillan, Sara S., Michelle King, and Mary P. Tully. 2016. How to use the nominal group and Delphi techniques. International Journal of Clinical Pharmacy 38: 655–62. [Google Scholar] [CrossRef]
- McSherry, Wilfred, Adam Boughey, and Peter Kevern. 2016. “Chaplains for Wellbeing” in Primary Care: A Qualitative Investigation of Their Perceived Impact for Patients’ Health and Wellbeing. Journal of Health Care Chaplaincy 22: 151–70. [Google Scholar] [CrossRef]
- Morea, Nicola. 2022. Investigating change in subjectivity: The analysis of Q-sorts in longitudinal research. Research Methods in Applied Linguistics 1: 100025. [Google Scholar] [CrossRef]
- Peterman, Amy H., George Fitchett, Marianne J. Brady, Lesbia Hernandez, and David Cella. 2002. Measuring spiritual well-being in people with cancer: The Functional Assessment of Chronic Illness Therapy-Spiritual Well-Being scale (FACIT-Sp). Annals of Behavioral Medicine 24: 49–58. [Google Scholar] [CrossRef]
- Rosie, X. J. S. (Sujin), Anja Visser, Annelieke Damen, Erik Olsman, Carmen Schuhmann, Gaby Jacobs, Marjo van Zundert, and Hanneke Muthert. 2025. Goals and outcomes of chaplaincy in varying outpatient, primary, and community care contexts. Journal of Health Care Chaplaincy, 1–15. [Google Scholar] [CrossRef]
- Royal Netherlands Meteorological Institute. n.d. Aardbevingen Door Gaswinning. Available online: https://www.knmi.nl/kennis-en-datacentrum/uitleg/aardbevingen-door-gaswinning (accessed on 3 June 2025).
- Smeets, Wim, and M. Manley. 2006. Goals and Tasks of Spiritual Care. In Spiritual Care in a Hospital Setting. Leiden: BRILL, pp. 145–85. [Google Scholar] [CrossRef]
- Snowden, Austin, and Iain Telfer. 2017. Patient Reported Outcome Measure of Spiritual Care as Delivered by Chaplains. Journal of Health Care Chaplaincy 23: 131–55. [Google Scholar] [CrossRef]
- Stroebe, Katherine, Babet Kanis, Justin Richardson, Frans Oldersma, Jan Broer, Frans Greven, and Tom Postmes. 2021. Chronic disaster impact: The long-term psychological and physical health consequences of housing damage due to induced earthquakes. BMJ Open 11: 40710. [Google Scholar] [CrossRef]
- Sulmasy, Daniel P. 2002. A Biopsychosocial-Spiritual Model for the Care of Patients at the End of Life. The Gerontologist 42: 24–33. [Google Scholar] [CrossRef]
- Tan, Heather, Bruce Rumbold, Fiona Gardner, Austyn Snowden, David Glenister, Annie Forest, Craig Bossie, and Lynda Wyles. 2022. Understanding the outcomes of spiritual care as experienced by patients. Journal of Health Care Chaplaincy 28: 147–61. [Google Scholar] [CrossRef] [PubMed]
- ten Klooster, Peter M., Martijn Visser, and Menno D. T. de Jong. 2008. Comparing two image research instruments: The Q-sort method versus the Likert attitude questionnaire. Food Quality and Preference 19: 511–18. [Google Scholar] [CrossRef]
- Terwee, Caroline B., Philip van der Wees, and Sandra Beurskens. 2015. Handreiking voor de Selectie van PROs en PROMs [Suggestions for the Selection of PROs and PROMs]. Utrecht: Nederlandse Federatie van UMC’s. [Google Scholar]
- Timmins, Fiona, Sílvia Caldeira, Maryanne Murphy, Nicolas Pujol, Greg Sheaf, Elizabeth Weathers, Jacqueline Whelan, and Bernadette Flanagan. 2018. The Role of the Healthcare Chaplain: A Literature Review. Journal of Health Care Chaplaincy 24: 87–106. [Google Scholar] [CrossRef] [PubMed]
- Tunks Leach, Katie, Joanne Lewis, and Tracy Levett-Jones. 2020. Staff perceptions on the role and value of chaplains in first responder and military settings: A scoping review. Journal of High Threat & Austere Medicine 2: 1–16. [Google Scholar] [CrossRef]
- Tunks Leach, Katie, Paul Simpson, Joanne Lewis, and Tracy Levett-Jones. 2022. The Role and Value of Chaplains in the Ambulance Service: Paramedic Perspectives. Journal of Religion and Health 61: 929–47. [Google Scholar] [CrossRef]
- Verkerk, Eva, Marjolein Verbiest, Simone van Dulmen, Philip van der Wees, Caroline Terwee, Sandra Beurskens, Dolf de Boer, Carla Bakker, Ildikó Vajda, and Marloes Zuidgeest. 2017. De PROM-Toolbox: Tools voor de Selectie en Toepassing van PROMs in de Gezondheidszorg [The PROM-Toolbox: Tools for the Selection and Application of PROMs in Healthcare]. Diemen: Zorginstituut Nederland. [Google Scholar]
- Visser, Anja. 2019. Patient-reported outcome measures (PROMs) in healthcare chaplaincy: What, why and how? Tidsskrift for Praktisk Theologi: Nordic Journal of Practical Theology 2: 90–99. [Google Scholar]
- Visser, Anja, Annelieke Damen, and Carmen Schuhmann. 2023. Goals of chaplaincy care: A scoping review of Dutch literature. Journal of Health Care Chaplaincy 29: 176–95. [Google Scholar] [CrossRef]
- Watts, Simon, and Paul Stenner. 2012. Doing Q Methodological Research: Theory, Method and Interpretation. Thousand Oaks: SAGE Publications Ltd. [Google Scholar]
1. Formulating Goals of Chaplaincy | 2. Selecting Outcomes | 3. Advice on Instrument Construction | 4. Evaluation Acceptability, Clarity, and Face Validity | |
---|---|---|---|---|
Learning networks primary care and social domain | X | X | X | |
Learning network gas extraction | X | X | X | |
Learning network pediatric palliative care | X | X | X | |
Learning network unhoused | X | X | ||
Client council | X | X | ||
Participants at a meeting of the Dutch Association of Spiritual Caregivers * | X | |||
Participants in a workshop of the Knowledge Workplace * | X | |||
Number and role of participants | ||||
Chaplains | 16 | 14 | 22 | 14 |
Clients | 13 | 8 | 12 | 3 |
Healthcare workers | 8 | 9 | 9 | 3 |
Researchers | 7 | 5 | 7 | 2 |
Managers | 0 | 2 | 2 | 0 |
Policymakers | 0 | 0 | 0 | 4 |
Students | 0 | 0 | 0 | 3 |
Outcomes a | Frequency | PROM Statements (Statement Number) |
---|---|---|
Being able to bear circumstances in life | 52 | I can cope with my circumstances (s13) |
Being better able to cope with events | 19 | |
Being able to bare the life circumstance | 19 | |
Sorrow can be there/being able to bear yourself/life | 3 | |
Being able to handle it again | 3 | |
Being able to handle trauma | 3 | |
Being able to relate to the family situation | 2 | |
Being able to cope with what comes up in relationship | 2 | |
Accepting that bad days are part of life | 1 | |
Being able to express or allow thoughts and feelings | 49 | I have words to express how I feel (s8) I can allow my feelings (s17) |
Being able to give words to thoughts and feelings | 23 | |
Facing what happens internally | 9 | |
Seeing what’s behind the anger | 8 | |
Facing one’s own sorrow | 8 | |
Reaching the core of a thought/feeling | 1 | |
Not feeling alone in one’s circumstance | 37 | I have to do it alone (s6) |
Feeling less alone | 14 | |
Feeling closeness | 11 | |
Not having to do it alone | 6 | |
Being able to fall back on someone | 3 | |
Not being abandoned | 3 | |
Feeling okay with the situation | 32 | I can accept the situation or what has happened (s4) |
Acceptance of life circumstance | 15 | |
Feelings of mourning are less acute | 9 | |
At peace with the situation | 4 | |
Given the life circumstance a place | 4 | |
Having a broader perspective on events | 31 | I am the only one going through this (s19) I understand why things have gone this way (s9) |
Being able to relativize events | 9 | |
Being able to feel more compassion | 5 | |
Understanding the situation | 5 | |
Realizing I’m not the only one | 5 | |
Being able to view it from a different angle | 4 | |
Better understanding of other people | 3 | |
Feeling accepted by others | 29 | I can be myself (s14) I’m being seen as a human being (s10) |
Being seen as a human being | 14 | |
Allowed to be there fully | 5 | |
A place where you can be yourself | 5 | |
Being fully seen | 3 | |
Showing myself to others | 2 | |
Being able to talk about anything | 27 | I can tell my story (s12) |
Having been able to tell the story | 18 | |
Having been able to talk about everything | 9 | |
Feeling self-worth | 27 | I matter (s11) I am good the way I am (s21) I feel connected to myself (s23) I take care of myself (s7) |
Connection to myself | 9 | |
Feeling self-love | 7 | |
Awareness of self-worth | 4 | |
Self-acceptance | 2 | |
My life also matters (again) | 2 | |
Experiencing more self-compassion/kindness toward myself | 2 | |
Allowing myself to feel good without feeling guilty toward others | 1 | |
Moving forward | 25 | I can move on with my life (s1) |
Came out of a vicious cycle | 8 | |
Being able to carry on with life | 8 | |
Found a way forward | 5 | |
Put life on track | 2 | |
Made fitting next step | 2 | |
(Re)connecting to people | 25 | I dare to contact people (s2) I feel connected to people who are important to me (s5) |
Daring to make contact with other people | 5 | |
Contact with other people healed | 4 | |
Connection to others | 4 | |
Answers from the afterlife | 4 | |
Connection to your child after their passing | 3 | |
Balanced connection in relationship | 2 | |
Experiencing depth in relationship | 2 | |
Seeing or (re)discovering valuable people and daring to make contact with them | 1 | |
Feeling hope again | 24 | I feel hope for the future (s22) |
Feeling seen and heard | 23 | I feel really seen and heard (s15) |
Connection to sources of strength | 22 | I feel connected to what gives me strength (s20) |
Feeling calmer | 22 | I feel calm (s25) |
Ordered one’s thoughts | 19 | I have arranged my thoughts (s16) |
Thoughts are ordered | 14 | |
Space in the head | 4 | |
Developing my own story | 1 | |
Self-understanding | 14 | I have insight into who I am (s3) I understand myself (s24) |
Getting to know yourself better | 8 | |
More understanding of oneself | 6 | |
Being able to let go of feelings | 14 | I get stuck in my feelings (s18) |
Less stuck in feelings | 8 | |
Letting go of shame | 4 | |
Letting go of anger | 2 | |
Seeing meaning in life | 19 | |
Feeling inner space | 18 | |
Experiencing resilience | 13 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Visser, A.; Damen, A.; Schuhmann, C.; Rosie, X.J.S.; Muthert, H.; Olsman, E.; van Zundert, M.; Jacobs, G. Development of the Dutch Chaplaincy Outcome Measure. Religions 2025, 16, 742. https://doi.org/10.3390/rel16060742
Visser A, Damen A, Schuhmann C, Rosie XJS, Muthert H, Olsman E, van Zundert M, Jacobs G. Development of the Dutch Chaplaincy Outcome Measure. Religions. 2025; 16(6):742. https://doi.org/10.3390/rel16060742
Chicago/Turabian StyleVisser, Anja, Annelieke Damen, Carmen Schuhmann, X. J. S. (Sujin) Rosie, Hanneke Muthert, Erik Olsman, Marjo van Zundert, and Gaby Jacobs. 2025. "Development of the Dutch Chaplaincy Outcome Measure" Religions 16, no. 6: 742. https://doi.org/10.3390/rel16060742
APA StyleVisser, A., Damen, A., Schuhmann, C., Rosie, X. J. S., Muthert, H., Olsman, E., van Zundert, M., & Jacobs, G. (2025). Development of the Dutch Chaplaincy Outcome Measure. Religions, 16(6), 742. https://doi.org/10.3390/rel16060742