A Randomized Controlled Simulation Trial of a Neonatal Resuscitation Digital Game Simulator for Labour and Delivery Room Staff
Abstract
:1. Introduction
Hypotheses and Research Questions
2. Literature Review
2.1. Performance in the Simulators
2.2. Attitudes toward Simulators
3. Method
3.1. Participants, Procedure, and Measurement Instruments
3.2. Intervention: The RETAIN Digital Game Simulator
3.3. The RETAIN Tutorial Scenario
3.4. The RETAIN Game Scenarios
3.5. Measures
3.6. Analyses
4. Results
4.1. What Were Participants’ Perceptions of the RETAIN Digital Game Simulator?
4.2. Is There an Interaction between the Instructional Method and Time on Participants’ Neonatal Resuscitation Performance?
4.3. Multiple Pairwise Comparisons
5. Discussion, Contributions, and Limitations
5.1. What Were Participants’ Perceptions of the RETAIN Digital Game Simulator?
5.2. Is There an Interaction between the Instructional Method and Time on Participants’ Neonatal Resuscitation Performance?
6. Contributions and Implications
7. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
Appendix A
Appendix B
Variable | Lecture Video | Digital Game | ||
---|---|---|---|---|
Shapiro–Wilk | p | Shapiro–Wilk | p | |
Pre-test | 0.88 * | 0.02 | 0.93 | 0.14 |
Post-test | 0.86 ** | <0.01 | 0.92 | 0.11 |
Post-test after 2 Months | 0.63 *** | <0.001 | 0.76 *** | <0.001 |
Effect | W | p | GGε | pGG | HFε | pHF |
---|---|---|---|---|---|---|
Time | 0.30 *** | <0.001 | 0.59 *** | <0.001 | 0.60 *** | <0.001 |
Group × Time | 0.30 *** | <0.001 | 0.59 | 0.23 | 0.60 | 0.23 |
Effect | df1 | df2 | F | p | ηp2 |
---|---|---|---|---|---|
Group | 1 | 40 | 0.17 | 0.68 | 0.004 |
Time | 1.18 | 47.14 | 51.32 *** | <0.001 | 0.562 (large) |
Group × Time | 1.18 | 47.14 | 1.48 | 0.23 | 0.036 |
References
- Aziz, K.; Lee, H.C.; Escobedo, M.B.; Hoover, A.V.; Kamath-Rayne, B.D.; Kapadia, V.S.; Magid, D.J.; Niermeyer, S.; Schmölzer, G.M.; Szyld, E.; et al. Part 5: Neonatal resuscitation: 2020 American Heart Association guidelines for cardiopulmonary resuscitation and emergency cardiovascular care. Circulation 2020, 142, S524–S550. [Google Scholar] [CrossRef] [PubMed]
- Wyckoff, M.H.; Wyllie, J.; Aziz, K.; de Almeida, M.F.; Fabres, J.; Fawke, J.; Guinsburg, R.; Hosono, S.; Isayama, T.; Kapadia, V.S.; et al. Neonatal life support: 2020 international consensus on cardiopulmonary resuscitation and emergency cardiovascular care science with treatment recommendations. Circulation 2020, 142, S185–S221. [Google Scholar] [CrossRef] [PubMed]
- Lee, A.C.; Cousens, S.; Wall, S.N.; Niermeyer, S.; Darmstadt, G.L.; Carlo, W.A.; Keenan, W.J.; Bhutta, Z.A.; Gill, C.; Lawn, J.E. Neonatal resuscitation and immediate newborn assessment and stimulation for the prevention of neonatal deaths: A systematic review, meta-analysis and Delphi estimation of mortality effect. BMC Public Health 2011, 11, S12. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
- Canadian Paediatric Society. Neonatal Resuscitation Program. 2024. Available online: https://cps.ca/en/nrp-prn (accessed on 14 May 2024).
- Yousef, N.; Moreau, R.; Soghier, L. Simulation in neonatal care: Towards a change in traditional training? Eur. J. Pediatr. 2022, 181, 1429–1436. [Google Scholar] [CrossRef] [PubMed]
- Bardelli, S.; Del Corso, G.; Ciantelli, M.; Del Pistoia, M.; Lorenzoni, F.; Fossati, N.; Scaramuzzo, R.T.; Cuttano, A. Improving pediatric/neonatology residents’ newborn resuscitation skills with a digital serious game: DIANA. Front. Pediatr. 2022, 10, 842302. [Google Scholar] [CrossRef] [PubMed]
- Yeo, C.L.; Ho, S.K.Y.; Tagamolila, V.C.; Arunachalam, S.; Bharadwaj, S.S.; Poon, W.B.; Tan, M.G.; Edison, P.E.; Yip, W.Y.; Haium, A.A.A.; et al. Use of web-based game in neonatal resuscitation-is it effective? BMC Med. Educ. 2020, 20, 170. [Google Scholar] [CrossRef] [PubMed]
- Steinkuehler, C.; Squire, K. Gaming in educational contexts. In Handbook of Educational Psychology, 4th ed.; Schutz, P.A., Muis, K.R., Eds.; Routledge: London, UK, 2024; pp. 674–695. ISBN 9780429433726. [Google Scholar] [CrossRef]
- Zhang, C. A literature study of medical simulations for non-technical skills training in emergency medicine: Twenty years of progress, an integrated research framework, and future research avenues. Int. J. Environ. Res. Public Health 2023, 20, 4487. [Google Scholar] [CrossRef] [PubMed]
- Deci, E.L.; Ryan, R.M. The “what” and “why” of goal pursuits: Human needs and the self-determination of behavior. Psychol. Inq. 2000, 11, 227–268. [Google Scholar] [CrossRef]
- Ryan, R.M.; Rigby, C.S.; Przybylski, A. The motivational pull of video games: A self-determination theory approach. Motiv. Emot. 2006, 30, 344–360. [Google Scholar] [CrossRef]
- Ghoman, S.K.; Cutumisu, M.; Schmölzer, G.M. Using the RETAIN Neonatal Resuscitation Game to Train and Assess Health Care Professionals’ Competence in an Observational Study Design; SAGE Research Methods Cases: Medicine and Health; SAGE Publications Limited: Washington, DC, USA, 2020; pp. 1–15. [Google Scholar] [CrossRef]
- Cutumisu, M.; Ghoman, S.K.; Lu, C.; Patel, S.D.; Garcia-Hidalgo, C.; Fray, C.; Brown, M.R.G.; Greiner, R.; Schmölzer, G.M. Health care providers’ performance, mindset, and attitudes toward a neonatal resuscitation computer-based simulator: Empirical study. J. Med. Internet Res. Serious Games 2020, 8, e21855. [Google Scholar] [CrossRef] [PubMed]
- Ghoman, S.K.; Patel, S.D.; Cutumisu, M.; von Hauff, P.; Jeffery, T.; Brown, M.R.; Schmölzer, G.M. Serious games, a game changer in teaching neonatal resuscitation? A review. Arch. Dis. Child.-Fetal Neonatal Ed. 2020, 105, 98–107. [Google Scholar] [CrossRef] [PubMed]
- Ghoman, S.K.; Schmölzer, G.M. The RETAIN simulation-based serious game—A review of the literature. Healthcare 2019, 8, 3. [Google Scholar] [CrossRef] [PubMed]
- Cutumisu, M.; Schmölzer, G.M. The effects of a digital game simulator versus a traditional intervention on paramedics’ neonatal resuscitation performance. Children 2024, 11, 174. [Google Scholar] [CrossRef]
- Lajoie, S.P. Multimedia Learning with Simulations. In The Cambridge Handbook of Multimedia Learning, 3rd ed.; Mayer, R., Fiorella, L., Eds.; Cambridge Handbooks in Psychology; Cambridge University Press: Cambridge, UK, 2021; pp. 461–471. [Google Scholar]
- Mayer, R.E. The promise of multimedia learning: Using the same instructional design methods across different media. Learn. Instr. 2003, 13, 125–139. [Google Scholar] [CrossRef]
- Wiseman, J.; Blanchard, E.G.; Lajoie, S. The deteriorating patient smartphone app: Towards serious game design. In Educational Technologies in Medical and Health Sciences Education; Springer International Publishing: Cham, Switzerland, 2016; pp. 215–234. [Google Scholar]
- Bang, A.; Patel, A.; Bellad, R.; Gisore, P.; Goudar, S.S.; Esamai, F.; Liechty, E.A.; Meleth, S.; Goco, N.; Niermeyer, S.; et al. Helping Babies Breathe (HBB) training: What happens to knowledge and skills over time? BMC Pregnancy Childbirth 2016, 16, 364. [Google Scholar] [CrossRef] [PubMed]
- Ergenekon, E.; Koç, E.; Atalay, Y.; Soysal, O. Neonatal resuscitation course experience in Turkey. Resuscitation 2000, 45, 225–227. [Google Scholar] [CrossRef] [PubMed]
- Morris, S.M.; Fratt, E.M.; Rodriguez, J.; Ruman, A.; Wibecan, L.; Nelson, B.D. Implementation of the Helping Babies Breathe training program: A systematic review. Pediatrics 2020, 146, e20193938. [Google Scholar] [CrossRef]
- Skidmore, M.; Urquhart, H. Retention of skills in neonatal resuscitation. J. Paediatr. Child Health 2001, 6, 31–35. [Google Scholar] [CrossRef] [PubMed]
- Gilbart, M.K.; Hutchison, C.R.; Cusimano, M.D.; Regehr, G. A computer-based trauma simulator for teaching trauma management skills. Am. J. Surg. 2000, 179, 223–238. [Google Scholar] [CrossRef]
- Curran, V.R.; Aziz, K.; O’Young, S.; Bessell, C. Evaluation of the effect of a computerized training simulator (ANAKIN) on the retention of neonatal resuscitation skills. Teach. Learn. Med. 2004, 16, 157–164. [Google Scholar] [CrossRef]
- McCaw, J.M.; Yelton, S.E.G.; Tackett, S.A.; Rapal, R.M.; Gamalinda, A.N.; Arellano-Reyles, A.; Tupas, G.D.; Derecho, C.; Ababon, F.; Edwardson, J.; et al. Effect of repeat refresher courses on neonatal resuscitation skill decay: An experimental comparative study of in-person and video-based simulation training. Adv. Simul. 2023, 8, 7. [Google Scholar] [CrossRef] [PubMed]
- Brydges, R.; Manzone, J.; Shanks, D.; Hatala, R.; Hamstra, S.J.; Zendejas, B.; Cook, D.A. Self-regulated learning in simulation-based training: A systematic review and meta-analysis. Med. Educ. 2015, 49, 368–378. [Google Scholar] [CrossRef] [PubMed]
- Taub, M.; Azevedo, R. Using sequence mining to analyze metacognitive monitoring and scientific inquiry based on levels of efficiency and emotions during game-based learning. J. Educ. Data Min. 2018, 10, 1–26. [Google Scholar] [CrossRef]
- Garvey, A.A.; Dempsey, E.M. Simulation in neonatal resuscitation. Front. Pediatr. 2020, 8, 59. [Google Scholar] [CrossRef] [PubMed]
- Finan, E.; Bismilla, Z.; Whyte, H.E.; Leblanc, V.; McNamara, P.J. High-fidelity simulator technology may not be superior to traditional low-fidelity equipment for neonatal resuscitation training. J. Perinatol. 2012, 32, 287–292. [Google Scholar] [CrossRef] [PubMed]
- Faul, F.; Erdfelder, E.; Lang, A.-G.; Buchner, A. G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav. Res. Methods 2007, 39, 175–191. [Google Scholar] [CrossRef] [PubMed]
- Randomizer. Computer-Generated Randomization Software. Available online: http://www.randomizer.org (accessed on 14 May 2024).
- R Core Team. R: A Language and Environment for Statistical Computing; R Foundation for Statistical Computing: Vienna, Austria, 2024; Available online: https://www.R-project.org (accessed on 14 May 2024).
- Tan, W.Y.; Tabatabai, M.A. Some robust ANOVA procedures under heteroscedasticity and nonnormality. Commun. Stat.—Simul. Comput. 1985, 14, 1007–1026. [Google Scholar] [CrossRef]
- Mair, P.; Wilcox, R. Robust Statistical Methods in R Using the WRS2 Package. Behav. Res. Methods 2020, 52, 464–488. [Google Scholar] [CrossRef]
- McGaghie, W.C.; Issenberg, S.B.; Cohen, E.R.; Barsuk, J.H.; Wayne, D.B. Does simulation-based medical education with delib-erate practice yield better results than traditional clinical education? A meta-analytic comparative review of the evidence. Acad. Med. 2011, 86, 706–711. [Google Scholar] [CrossRef]
Digital Game Group (n = 21) | Mean (SD) | Range |
---|---|---|
Realistic Scenario | 3.86 (0.91) | 1–5 |
Appropriate Game Length and Pacing | 3.76 (1.00) | 1–5 |
Enjoyed Learning in this Game Format | 3.29 (1.15) | 1–5 |
Enjoyed Playing the Game | 3.48 (1.17) | 1–5 |
Game was Useful to Teach NRP Algorithm | 3.67 (1.11) | 1–5 |
Game Allowed Appropriate Decisions | 3.67 (0.97) | 1–5 |
Intervention (n = 21) | Pre-Test Mean (SD; IQR) | Post-Test Mean (SD; IQR) | Post-Test-2-Months Mean (SD; IQR) |
---|---|---|---|
Lecture Video | 8.00 (2.07; 2) | 9.86 (1.71; 2) | 2.48 (4.14; 6) |
Digital Game | 7.33 (1.88; 3) | 9.62 (1.56; 2) | 3.95 (4.42; 9) |
Effect | df1 | df2 | F | p |
---|---|---|---|---|
Group | 1 | 23.44 | 0.29 | 0.60 |
Time | 2 | 20.56 | 33.13 *** | <0.001 |
Group × Time | 2 | 20.56 | 1.28 | 0.30 |
Function | Effect | Estimate | p |
---|---|---|---|
Sppbb | Time (Pre–Post) | −2.171 *** | <0.001 |
Time (Pre–Post2M) | 5.368 | ||
Time (Post–Post2M) | 9.621 | ||
Sppba | Group (Digital–Traditional) | −0.5881 | 0.484 |
Sppbi | Interaction (Pre–Post × Digital–Traditional) | −0.5816 | 0.474 |
Interaction (Pre–Post2M × Digital–Traditional) | −4.3690 | ||
Interaction (Post–Post2M × Digital–Traditional) | −2.9167 |
Variable 1 (n = 42) | Variable 2 (n = 42) | t(41) | Estimated MD | Cohen’s d |
---|---|---|---|---|
Pre-test | Post-test | −7.76 *** | −2.07 | −1.14 (large) |
Pre-test | Post-test After 2 Months | 5.69 *** | 4.45 | 1.33 (large) |
Post-test | Post-test After 2 Months | 8.21 *** | 6.52 | 2.01 (large) |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Bilodeau, C.; Schmölzer, G.M.; Cutumisu, M. A Randomized Controlled Simulation Trial of a Neonatal Resuscitation Digital Game Simulator for Labour and Delivery Room Staff. Children 2024, 11, 793. https://doi.org/10.3390/children11070793
Bilodeau C, Schmölzer GM, Cutumisu M. A Randomized Controlled Simulation Trial of a Neonatal Resuscitation Digital Game Simulator for Labour and Delivery Room Staff. Children. 2024; 11(7):793. https://doi.org/10.3390/children11070793
Chicago/Turabian StyleBilodeau, Christiane, Georg M. Schmölzer, and Maria Cutumisu. 2024. "A Randomized Controlled Simulation Trial of a Neonatal Resuscitation Digital Game Simulator for Labour and Delivery Room Staff" Children 11, no. 7: 793. https://doi.org/10.3390/children11070793
APA StyleBilodeau, C., Schmölzer, G. M., & Cutumisu, M. (2024). A Randomized Controlled Simulation Trial of a Neonatal Resuscitation Digital Game Simulator for Labour and Delivery Room Staff. Children, 11(7), 793. https://doi.org/10.3390/children11070793