The Impact of COVID-19 Confinement on Substance Use and Mental Health in Portuguese Higher Education Students
Abstract
:1. Introduction
2. Materials and Methods
2.1. Study Design
2.2. Data Collection
2.3. Statistical Analysis
3. Results
3.1. Sociodemographic Characteristics
3.2. Association between Sex and Personal Characteristics and Substance Use
3.3. Considering the Association between Mental Health and Substance Use in Higher Education in Portugal during Confinement
4. Discussion
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- WHO. Statement on the First Meeting of the International Health Regulations (2005) Emergency Committee Regarding the Outbreak of novel Coronavirus (2019-nCoV). Available online: https://www.who.int/news/item/23-01-2020-statement-on-the-meeting-of-the-international-health-regulations-(2005)-emergency-committee-regarding-the-outbreak-of-novel-coronavirus-(2019-ncov) (accessed on 23 November 2022).
- Brooks, S.K.; Webster, R.K.; Smith, L.E.; Woodland, L.; Wessely, S.; Greenberg, N.; Rubin, G.J. The psychological impact of quarantine and how to reduce it: Rapid review of the evidence. Lancet 2020, 395, 912–920. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Hull, H.F. SARS control and psychological effects of quarantine, Toronto, Canada. Emerg. Infect. Dis. 2005, 11, 354–355. [Google Scholar] [CrossRef]
- Marinoni, G.; van’t Land, H.; Jensen, T. The Impact of COVID-19 on Higher Education around the World; International Association of Universities: Paris, France, 2020; p. 50. [Google Scholar]
- Marsden, J.; Darke, S.; Hall, W.; Hickman, M.; Holmes, J.; Humphreys, K.; Neale, J.; Tucker, J.; West, R. Mitigating and learning from the impact of COVID-19 infection on addictive disorders. Addiction 2020, 115, 1007–1010. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Pedrelli, P.; Nyer, M.; Yeung, A.; Zulauf, C.; Wilens, T. College Students: Mental Health Problems and Treatment Considerations. Acad. Psychiatry 2015, 39, 503–511. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Xiao, H.; Carney, D.M.; Youn, S.J.; Janis, R.A.; Castonguay, L.G.; Hayes, J.A.; Locke, B.D. Are we in crisis? National mental health and treatment trends in college counseling centers. Psychol. Serv. 2017, 14, 407–415. [Google Scholar] [CrossRef] [PubMed]
- Sharp, J.; Theiller, S. A review of psychological distress among university students: Pervasiveness, implications and potential points of intervention. Int. J. Adv. Counceling 2018, 40, 193–212. [Google Scholar] [CrossRef]
- Leshner, A.I.; Scherer, L.A.; National Academies of Sciences, Engineering, and Medicine; Health and Medicine Division; Policy and Global Affairs; Board on Health Sciences Policy; Board on Higher Education and Workforce; Committee on Mental Health, Substance Use; Wellbeing in STEMM Undergraduate and Graduate Education. Mental Health, Substance Use, and Wellbeing in Higher Education: Supporting the Whole Student; National Academies Press (US): Washington, DC, USA, 2021; p. 198. [Google Scholar]
- Layman, H.M.; Thorisdottir, I.E.; Halldorsdottir, T.; Sigfusdottir, I.D.; Allegrante, J.P.; Kristjansson, A.L. Substance Use Among Youth During the COVID-19 Pandemic: A Systematic Review. Curr. Psychiatry Rep. 2022, 24, 307–324. [Google Scholar] [CrossRef] [PubMed]
- Kristjansson, A.L.; Lilly, C.L.; Thorisdottir, I.E.; Allegrante, J.P.; Mann, M.J.; Sigfusson, J.; Soriano, H.E.; Sigfusdottir, I.D. Testing risk and protective factor assumptions in the Icelandic model of adolescent substance use prevention. Health Educ. Res. 2021, 36, 309–318. [Google Scholar] [CrossRef]
- Tavolacci, M.P.; Wouters, E.; Van de Velde, S.; Buffel, V.; Dechelotte, P.; Van Hal, G.; Ladner, J. The Impact of COVID-19 Lockdown on Health Behaviors among Students of a French University. Int. J. Environ. Res. Public Health 2021, 18, 4346. [Google Scholar] [CrossRef]
- Tholen, R.; Ponnet, K.; Van Hal, G.; De Bruyn, S.; Buffel, V.; Van de Velde, S.; Bracke, P.; Wouters, E. Substance Use among Belgian Higher Education Students before and during the First Wave of the COVID-19 Pandemic. Int. J. Environ. Res. Public Health 2022, 19, 4348. [Google Scholar] [CrossRef]
- Wicki, M.; Kuntsche, E.; Gmel, G. Drinking at European universities? A review of students’ alcohol use. Addict. Behav. 2010, 35, 913–924. [Google Scholar] [CrossRef] [PubMed]
- Bennett, T.H.; Holloway, K.R. Drug use among college and university students: Findings from a national survey. J. Subst. Use 2015, 20, 50–55. [Google Scholar] [CrossRef]
- Kuntsche, E.; Kuntsche, S.; Thrul, J.; Gmel, G. Binge drinking: Health impact, prevalence, correlates and interventions. Psychol. Health 2017, 32, 976–1017. [Google Scholar] [CrossRef] [Green Version]
- Mellos, E.; Paparrigopoulos, T. Substance use during the COVID-19 pandemic: What is really happening? Psychiatriki 2022, 33, 17–20. [Google Scholar] [CrossRef] [PubMed]
- Busse, H.; Buck, C.; Stock, C.; Zeeb, H.; Pischke, C.R.; Fialho, P.M.M.; Wendt, C.; Helmer, S.M. Engagement in Health Risk Behaviours before and during the COVID-19 Pandemic in German University Students: Results of a Cross-Sectional Study. Int. J. Environ. Res. Public Health 2021, 18, 1410. [Google Scholar] [CrossRef] [PubMed]
- Gavurova, B.; Ivankova, V.; Rigelsky, M. Relationships between Perceived Stress, Depression and Alcohol Use Disorders in University Students during the COVID-19 Pandemic: A Socio-Economic Dimension. Int. J. Environ. Res. Public Health 2020, 17, 8853. [Google Scholar] [CrossRef] [PubMed]
- Khantzian, E.J. The self-medication hypothesis of substance use disorders: A reconsideration and recent applications. Harv. Rev. Psychiatry 1997, 4, 231–244. [Google Scholar] [CrossRef]
- Hawkins, E.H. A tale of two systems: Co-occurring mental health and substance abuse disorders treatment for adolescents. Annu. Rev. Psychol. 2009, 60, 197–227. [Google Scholar] [CrossRef] [Green Version]
- Deas, D.; Brown, E.S. Adolescent substance abuse and psychiatric comorbidities. J. Clin. Psychiatry 2006, 67 (Suppl. 7), 18–23. [Google Scholar] [CrossRef]
- Horita, R.; Nishio, A.; Yamamoto, M. Lingering effects of COVID-19 on the mental health of first-year university students in Japan. PloS ONE 2022, 17, e0262550. [Google Scholar] [CrossRef]
- Maia, B.R.; Dias, P.C. Ansiedade, depressão e estresse em estudantes universitários: O impacto da COVID-19. Estud. Psicol. 2020, 37, e200067. [Google Scholar] [CrossRef]
- Vasconcelos, M.; Crego, A.; Rodrigues, R.; Almeida-Antunes, N.; Lopez-Caneda, E. Effects of the COVID-19 Mitigation Measures on Alcohol Consumption and Binge Drinking in College Students: A Longitudinal Survey. Int. J. Environ. Res. Public Health 2021, 18, 9822. [Google Scholar] [CrossRef] [PubMed]
- Carneiro, A.C.B. Impactos da COVID-19 em Jovens Adultos: O Papel Moderador da Satisfação Com o Suporte Social na Relação Entre Stress e Comportamentos de Risco; Instituto Universitário de Lisboa: Lisboa, Portugal, 2020. [Google Scholar]
- WHO. Promoting Mental Health: Concepts, Emerging Evidence, Practice (Summary Report); WHO: Geneva, Switzerland, 2004. [Google Scholar]
- Pais Ribeiro, J.L. Mental Health Inventory: Um estudo de adaptação à população portuguesa. Psicol. Saude Doenças 2001, 2, 77–99. [Google Scholar]
- Ware, J.E.; Sherbourne, C.D.; Davies, A.R. Developing and Testing the MOS 20-item Short-Form Health Survey: A general Population Application; Duke University Press: Durham, NC, USA, 1992. [Google Scholar]
- Marôco, J. Análise Estatistica com o SPSS Statistics; reportNumber: Pêro Pinheiro, Portugal, 2011. [Google Scholar]
- Ruiz-Zaldibar, C.; Garcia-Garces, L.; Vicario-Merino, A.; Mayoral-Gonzalo, N.; Lluesma-Vidal, M.; Ruiz-Lopez, M.; Perez-Manchon, D. The Impact of COVID-19 on the Lifestyles of University Students: A Spanish Online Survey. Healthcare 2022, 10, 309. [Google Scholar] [CrossRef] [PubMed]
- Villanueva, V.J.; Motos, P.; Isorna, M.; Villanueva, V.; Blay, P.; Vazquez-Martinez, A. Impact of confinement measures on the Covid-19 pandemic on alcohol risk consumption. Rev. Esp. Salud Publica 2021, 95, e202101015. [Google Scholar] [PubMed]
- Jackson, K.M.; Merrill, J.E.; Stevens, A.K.; Hayes, K.L.; White, H.R. Changes in Alcohol Use and Drinking Context due to the COVID-19 Pandemic: A Multimethod Study of College Student Drinkers. Alcohol. Clin. Exp. Res. 2021, 45, 752–764. [Google Scholar] [CrossRef] [PubMed]
- Villanueva-Blasco, V.J.; Villanueva Silvestre, V.; Isorna, M.; Motos, P.; Blay, P.; Vazquez-Martinez, A. Changes in Alcohol Consumption Pattern Based on Gender during COVID-19 Confinement in Spain. Int. J. Environ. Res. Public Health 2021, 18, 8028. [Google Scholar] [CrossRef]
- Sokolovsky, A.W.; Hertel, A.W.; Micalizzi, L.; White, H.R.; Hayes, K.L.; Jackson, K.M. Preliminary impact of the COVID-19 pandemic on smoking and vaping in college students. Addict. Behav. 2021, 115, 106783. [Google Scholar] [CrossRef]
- Roges, J.; Bosque-Prous, M.; Colom, J.; Folch, C.; Baron-Garcia, T.; Gonzalez-Casals, H.; Fernandez, E.; Espelt, A. Consumption of Alcohol, Cannabis, and Tobacco in a Cohort of Adolescents before and during COVID-19 Confinement. Int. J. Environ. Res. Public Health 2021, 18, 7849. [Google Scholar] [CrossRef]
- Daigre, C.; Grau-Lopez, L.; Palma-Alvarez, R.F.; Perea-Ortueta, M.; Sorribes-Puertas, M.; Serrano-Perez, P.; Quesada, M.; Segura, L.; Coronado, M.; Ramos-Quiroga, J.A.; et al. A Multicenter Study on the Impact of Gender, Age, and Dual Diagnosis on Substance Consumption and Mental Health Status in Outpatients Treated for Substance Use Disorders During COVID-19 Lockdown. J. Dual Diagn. 2022, 18, 71–80. [Google Scholar] [CrossRef]
- Hawryluck, L.; Gold, W.L.; Robinson, S.; Pogorski, S.; Galea, S.; Styra, R. SARS control and psychological effects of quarantine, Toronto, Canada. Emerg. Infect. Dis. 2004, 10, 1206–1212. [Google Scholar] [CrossRef] [PubMed]
- Ammar, A.; Chtourou, H.; Boukhris, O.; Trabelsi, K.; Masmoudi, L.; Brach, M.; Bouaziz, B.; Bentlage, E.; How, D.; Ahmed, M.; et al. COVID-19 Home Confinement Negatively Impacts Social Participation and Life Satisfaction: A Worldwide Multicenter Study. Int. J. Environ. Res. Public Health 2020, 17, 6237. [Google Scholar] [CrossRef] [PubMed]
- Son, C.; Hegde, S.; Smith, A.; Wang, X.; Sasangohar, F. Effects of COVID-19 on College Students’ Mental Health in the United States: Interview Survey Study. J. Med. Internet Res. 2020, 22, e21279. [Google Scholar] [CrossRef] [PubMed]
- Alemany-Arrebola, I.; Rojas-Ruiz, G.; Granda-Vera, J.; Mingorance-Estrada, A.C. Influence of COVID-19 on the Perception of Academic Self-Efficacy, State Anxiety, and Trait Anxiety in College Students. Front. Psychol. 2020, 11, 570017. [Google Scholar] [CrossRef] [PubMed]
- Husky, M.M.; Kovess-Masfety, V.; Swendsen, J.D. Stress and anxiety among university students in France during COVID-19 mandatory confinement. Compr. Psychiatry 2020, 102, 152191. [Google Scholar] [CrossRef] [PubMed]
- Schroeder, S.A.; Morris, C.D. Confronting a neglected epidemic: Tobacco cessation for persons with mental illnesses and substance abuse problems. Annu. Rev. Public Health 2010, 31, 297–314. [Google Scholar] [CrossRef] [Green Version]
- WHO. Tobacco Use and Mental Health Conditions. A policy Brief. Available online: https://www.euro.who.int/en/health-topics/disease-prevention/tobacco/publications/2020/tobacco-use-and-mental-health.-policy-brief-2020 (accessed on 23 November 2022).
Additive Substance Use | Consumption Period | Consumption Type | Students | ||
---|---|---|---|---|---|
n | % | MHI-5 | |||
Tobacco | Before confinement | Does not smoke | 221 | 67.1 | |
Smokes sporadically | 40 | 21.2 | |||
Smokes 1 to 4 cigarettes a day | 16 | 4.8 | |||
Smokes 5 to 10 cigarettes a day | 36 | 10.9 | |||
Smokes more than 10 cigarettes a day | 16 | 4.8 | |||
During confinement | Does not smoke | 259 | 78.7 | 19.8 | |
Smokes sporadically | 29 | 8.8 | 18.9 | ||
Smokes 1 to 4 cigarettes a day | 15 | 4.5 | 20.6 | ||
Smokes 5 to 10 cigarettes a day | 17 | 5.1 | 19.8 | ||
Smokes more than 10 cigarettes a day | 9 | 2.7 | 18.5 | ||
Cannabis (hashish, weed, marijuana) | Before confinement | No consumption | 301 | 91.4 | |
I consume rarely | 11 | 3.3 | |||
Sometimes | 10 | 3.0 | |||
I consume every day | 2 | 0.6 | |||
Frequently | 5 | 1.5 | |||
During confinement | No consumption | 317 | 96.3 | 19.7 | |
I consume rarely | 7 | 2.1 | 20.1 | ||
Sometimes | 2 | 0.6 | 18 | ||
I consume every day | 0 | 0 | |||
Frequently | 3 | 0.9 | 18 | ||
Cocaine (coke and crack) | Before confinement | No consumption | 329 | 100 | |
During confinement | No consumption | 329 | 100 | 19.7 | |
Stimulants (speed, amphetamines, ecstasy) | Before confinement | No consumption | 325 | 98.7 | |
I consume rarely | 2 | 0.6 | |||
Sometimes | 2 | 0. | |||
During confinement | No consumption | 329 | 100 | 19.5 | |
Opioids (heroin, morphine, methadone) | Before confinement | No consumption | 329 | 100 | |
During confinement | No consumption | 329 | 100 | 19.7 | |
Anxiolytics, sedatives or hypnotics (pharmaceutical products) | Before confinement | No consumption | 293 | 89.3 | |
I consume rarely | 14 | 4.3 | |||
Sometimes | 11 | 3.4 | |||
I consume every day | 8 | 2.4 | |||
Frequently | 2 | 0.6 | |||
During confinement | No consumption | 301 | 91.5 | 19.7 | |
I consume rarely | 8 | 2.4 | 19.5 | ||
Sometimes | 9 | 2.7 | 19.4 | ||
I consume every day | 7 | 2.1 | 22 | ||
Frequently | 4 | 1.2 | 19.2 | ||
Wine or beer | Before confinement | No consumption | 103 | 31.3 | |
I consume rarely | 73 | 22.1 | |||
Sometimes | 98 | 29.7 | |||
I consume every day | 8 | 24.3 | |||
Frequently | 47 | 14.2 | |||
During confinement | No consumption | 199 | 60.4 | 20.0 | |
I consume rarely | 77 | 23.4 | 18.4 | ||
Sometimes | 41 | 12.4 | 21.0 | ||
I consume every day | 2 | 0.6 | 17.0 | ||
Frequently | 10 | 3.0 | 19.8 | ||
Distilled beverages (shots, whisky, liqueurs, brandy) | Before confinement | No consumption | 122 | 37.0 | |
I consume rarely | 100 | 30.3 | |||
Sometimes | 84 | 25.5 | |||
I consume every day | 0 | 0 | |||
Frequently | 23 | 6.9 | |||
During confinement | No consumption | 252 | 76.5 | 19.7 | |
I consume rarely | 55 | 16.7 | 20.6 | ||
Sometimes | 19 | 5.7 | 18.7 | ||
I consume every day | 0 | 0 | |||
Frequently | 3 | 0.9 | 18.3 |
Main Place of Substance Consumption before Confinement | Students | |
---|---|---|
n = 329 | % | |
Not applicable | 97 | 29.4 |
Academic parties or festivals | 59 | 17.9 |
Any place or occasion | 34 | 10.3 |
Outings (in the late afternoon or evening) to bars or nightclubs | 138 | 41.9 |
Alone at home | 5 | 1.5 |
Effects of Alcohol Consumption | before Confinement | during Confinement | ||||
---|---|---|---|---|---|---|
n = 329 | % | n = 329 | % | MHI-5 | ||
Drinks alcoholic beverages until he gets drunk | Not applicable | 151 | 45.8 | 298 | 9.0 | 19.9 |
Rarely | 81 | 24.6 | 21 | 6.3 | 18.2 | |
Sometimes | 70 | 21.2 | 8 | 2.4 | 18.8 | |
Frequently | 19 | 5.7 | 0 | 0 | - | |
Almost always | 8 | 2.4 | 2 | 0.6 | 21.5 | |
Drinks alcoholic beverages until he gets drunk and loses track of his attitudes | Not applicable | 269 | 81.7 | 319 | 96.9 | 19.8 |
Rarely | 46 | 13.9 | 9 | 2.7 | 18.2 | |
Sometimes | 11 | 3.3 | 1 | 0.3 | 22 | |
Frequently | 1 | 0.3 | 0 | 0 | - | |
Almost always | 2 | 0.6 | 0 | 0 | - | |
When you drink too much and have trouble concentrating in class the next day | Not applicable | 190 | 57.7 | 304 | 92.4 | 19.8 |
Rarely | 75 | 22.7 | 16 | 4.8 | 19.1 | |
Sometimes | 44 | 13.3 | 7 | 2.1 | 19 | |
Frequently | 12 | 3.6 | 1 | 0.3 | 24 | |
Almost always | 8 | 2.4 | 1 | 0.3 | 24 |
Sex and Personal Characteristics | Alcohol Decrease before vs. during | Tobacco Decrease before vs. during | Cannabis Decrease before vs. during | Anxiolytics Decrease before vs. during | |
---|---|---|---|---|---|
Sex | Female Male | p < 0.001 p = 0.004 | p < 0.001 p < 0.001 | p < 0.001 p < 0.001 | p < 0.001 p = 0.011 |
Age | 18 to 24 25 to 30 31 to 35 36 to 44 >44 | p = 0.001 p = 0.001 p > 0.050 p = 0.013 p > 0.050 | p < 0.001 p < 0.001 p < 0.019 p < 0.001 p > 0.050 | p < 0.001 p = 0.013 p > 0.050 p = 0.007 p > 0.050 | p > 0.050 p = 0.008 p = 0.014 p = 0.007 p > 0.050 |
Marital/Relational status | Married/civil union Single/divorced No relationship Widowed | p = 0.047 p < 0.001 p < 0.001 no cases | p < 0.005 p < 0.005 p < 0.005 no cases | p > 0.050 p < 0.001 p < 0.001 no cases | p = 0.003 p < 0.001 p < 0.001 no cases |
Love/Relationship type | Not applicable Long and non-conflictive (+6 months) Occasional, short and non-conflictive Long and conflictive (+6 months) Occasional, short and conflictive | p < 0.001 p < 0.001 p > 0.005 p > 0.050 p > 0.050 | p < 0.001 p < 0.001 p = 0.007 p > 0.050 p > 0.050 | p < 0.001 p < 0.001 p > 0.050 p = 0.034 p > 0.050 | p < 0.001 p < 0.001 p > 0.050 p > 0.050 p = 0.005 |
Academic Classification | Mediocre Adequate Good Very Good | p > 0.050 p < 0.001 p < 0.001 p = 0.007 | p > 0.050 p < 0.001 p < 0.001 p < 0.001 | p > 0.050 p < 0.001 p < 0.001 p > 0.050 | p > 0.050 p < 0.001 p < 0.001 p > 0.050 |
Social life—Integrates a religious group, social solidarity or volunteer work | Not Applicable 1 group 2 groups 3 groups 4 groups or + | p < 0.001 p = 0.025 p = 0.018 p > 0.050 p > 0.050 | p < 0.001 p < 0.001 p = 0.034 p > 0.050 p > 0.050 | p < 0.001 p > 0.050 p > 0.050 p > 0.050 p > 0.050 | p < 0.001 p = 0.023 p = 0.010 p > 0.050 p > 0.050 |
Social life—member of a sports, recreational, or political group | Not Applicable 1 group 2 groups 3 groups 4 groups or + | p < 0.001 p = 0.005 p > 0.050 p > 0.050 p > 0.050 | p < 0.005 p < 0.005 p = 0.019 p > 0.050 p > 0.050 | p < 0.001 p = 0.043 p > 0.050 p > 0.050 p > 0.050 | p < 0.001 p = 0.010 p > 0.050 p > 0.050 p > 0.050 |
Attended academic parties and festival before confinement | Does not attend Attends 1 to 2 Attends 3 to 5 Attends 6 to 10 +10 | p < 0.001 p < 0.001 p = 0.002 p = 0.030 p > 0.050 | p < 0.001 p < 0.001 p < 0.001 p < 0.001 p < 0.001 | p < 0.001 p = 0.004 p = 0.021 p > 0.050 p < 0.001 | p < 0.005 p < 0.005 p < 0.005 p < 0.005 p < 0.005 |
Member of academic group before confinement | Not Applicable 1 group 2 groups 3 groups 4 groups or + | p < 0.001 p = 0.020 p > 0.050 p > 0.050 p > 0.050 | p < 0.001 p < 0.001 p = 0.037 p > 0.050 p > 0.050 | p < 0.001 p = 0.002 p > 0.050 p > 0.050 p < 0.034 | p < 0.001 p > 0.050 p > 0.050 p > 0.050 p > 0.050 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Oliveira, A.P.; Luis, H.; Luís, L.S.; Nobre, J.R.; Pinho, L.G.; Albacar-Riobóo, N.; Sequeira, C. The Impact of COVID-19 Confinement on Substance Use and Mental Health in Portuguese Higher Education Students. Healthcare 2023, 11, 619. https://doi.org/10.3390/healthcare11040619
Oliveira AP, Luis H, Luís LS, Nobre JR, Pinho LG, Albacar-Riobóo N, Sequeira C. The Impact of COVID-19 Confinement on Substance Use and Mental Health in Portuguese Higher Education Students. Healthcare. 2023; 11(4):619. https://doi.org/10.3390/healthcare11040619
Chicago/Turabian StyleOliveira, Ana Paula, Henrique Luis, Luís Soares Luís, Joana Rita Nobre, Lara Guedes Pinho, Núria Albacar-Riobóo, and Carlos Sequeira. 2023. "The Impact of COVID-19 Confinement on Substance Use and Mental Health in Portuguese Higher Education Students" Healthcare 11, no. 4: 619. https://doi.org/10.3390/healthcare11040619