Next Article in Journal
Regional Odontodysplasia: A Systematic Review of Case Reports
Previous Article in Journal
The Role of Parenting Practices on the Parent Perceived Impact of Child Oral Health on Family Wellbeing
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Study Protocol

Neurological, Psychiatric, and Psychological Implications of the COVID-19 Pandemic: Protocol for a Large-Scale Umbrella Review of Observational Studies

1
National Defense Medical Center, Department of Psychiatry, Tri-Service General Hospital, Taipei 114, Taiwan
2
Department of Psychiatry, Penghu Branch, Tri-Service General Hospital, Penghu 880, Taiwan
3
Institute of Brain Science, National Yang Ming Chiao Tung University, Taipei 112, Taiwan
4
Department of Psychiatry, Beitou Branch, Tri-Service General Hospital, National Defense Medical Center, Taipei 112, Taiwan
5
Department of Neurology, Tri-Service General Hospital, National Defense Medical Center, Taipei 114, Taiwan
6
Department of Psychiatry, University of Ottawa, Ottawa, ON K1Z 7K4, Canada
7
Department of Mental Health, The Ottawa Hospital, Ottawa, ON K1Z 7K4, Canada
8
Ottawa Hospital Research Institute (OHRI), Clinical Epidemiology Program, University of Ottawa, Ottawa, ON K1Z 7K4, Canada
9
Bipolar Research Program, Department and Institute of Psychiatry, University of São Paulo Medical School, São Paulo 05403-903, Brazil
10
Prospect Clinic for Otorhinolaryngology & Neurology, Kaohsiung 811, Taiwan
11
Institute of Biomedical Sciences, National Sun Yat-sen University, Kaohsiung 804, Taiwan
12
Department of Psychology, College of Medical and Health Science, Asia University, Taichung 413, Taiwan
13
Department of Psychiatry, Kaohsiung Chang Gung Memorial Hospital, Chang Gung University College of Medicine, Kaohsiung 833, Taiwan
14
Department of Computer Science and Information Engineering, National Cheng Kung University, Tainan 701, Taiwan
15
Institute for Translational Research in Biomedical Sciences, Kaohsiung Chang Gung Memorial Hospital, Kaohsiung 833, Taiwan
16
Division of Psychology and Mental Health, Manchester Academic Health Science Centre, The University of Manchester, Manchester M13 9PL, UK
17
Physiotherapy Department, South London and Maudsley NHS Foundation Trust, London SE13 6QJ, UK
18
Department of Psychological Medicine, Institute of Psychiatry, Psychology and Neuroscience (IoPPN), King’s College London, London SE5 8AF, UK
19
Section of Psychiatry, Department of Neuroscience, Reproductive Science, and Dentistry, Federico II University of Naples, 80138 Naples, Italy
20
Bipolar and Depressive Disorders Unit, Institute of Neuroscience, Hospital Clinic, University of Barcelona, 08035 Barcelona, Spain
21
Centre for Chronic Illness and Ageing, University of Greenwich, London SE10 9LS, UK
22
Department of Pediatrics, Yonsei University College of Medicine, Seoul 03722, Korea
23
Innovation in Mental and Physical Health and Clinical Treatment Strategic Research Centre, School of Medicine, Barwon Health, Deakin University, Geelong, VIC 3220, Australia
*
Authors to whom correspondence should be addressed.
These authors contributed equally to this work.
Int. J. Environ. Res. Public Health 2022, 19(3), 1681; https://doi.org/10.3390/ijerph19031681
Submission received: 12 December 2021 / Revised: 29 January 2022 / Accepted: 30 January 2022 / Published: 1 February 2022
(This article belongs to the Topic Burden of COVID-19 in Different Countries)

Abstract

:
The severe acute respiratory syndrome coronavirus 2 disease (SARS-CoV-2) is the most severe manifestation of the coronavirus disease 2019 (COVID-19) pandemic. Accruing evidence indicates that the COVID-19 pandemic may have profound deleterious neurological, psychiatric, and psychological outcomes. The number of systematic reviews (SRs) and meta-analyses (MAs) on this topic has grown exponentially. This protocol aims to synthesize all evidence from SRs and MAs on the associations between the COVID-19 pandemic and neuropsychiatric outcomes. The following electronic databases will be systematically searched from inception up to 15 January 2022: PubMed, Embase, APA PsycINFO, and Cochrane Reviews. An umbrella review (UR) of SRs and MAs of observational studies will be conducted. SRs and/or MAs of observational studies examining any direct or indirect association of COVID-19 with the neuropsychiatric outcomes will be deemed eligible for potential inclusion in this UR. The direct associations include the impact on the (1) prognosis of COVID-19 and (2) neuropsychiatric sequelae after COVID-19 infection. The indirect associations include the influence of the COVID-19 pandemic on the (1) treatments and (2) outcomes of neurological and psychiatric conditions associated with the COVID-19 pandemic.

1. Introduction

In December 2019, the world witnessed the emergence of the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection, which posed an extraordinary threat to global public health and human safety [1]. SARS-CoV-2, a highly contagious and pathogenic virus, rapidly disseminated across the world, causing a pandemic of coronavirus disease 2019 (COVID-19). In addition to pulmonary pathology, COVID-19 is now recognized as a systemic disease associated with a broad spectrum of manifestations (e.g., hematological, cardiovascular, renal, and neuropsychiatric) [2,3,4]. The mechanisms driving multi-organ damage may involve direct viral infection and toxicity, endothelial cell damage, dysregulated immune response, cytokine storm, and maladaptive functions of the renin-angiotensin-aldosterone system [3,4]. Moreover, accumulating evidence suggests persistent and prolonged effects on multiple organs and the brain after the acute COVID-19 subsides [2,5,6,7,8].
The COVID-19 pandemic presents unprecedented challenges to the lives of people around the world. It has caused devastating impacts on livelihood, society, health care systems, and economic activity [9,10]. Major stressors may include social restrictions, lockdowns, boredom, loneliness, infection fears, conflicting messages from authorities, inadequate supplies, financial loss, stigma, and shifting priorities of governments in their attempt to control COVID-19 outbreaks [9,10,11,12]. The utilization of healthcare services may also be affected because of measures such as stay-at-home orders and lockdowns [9,11,12]. As a consequence of the devastating impact of the COVID-19 pandemic at all these levels, evidence has indicated a meaningful and deleterious mental health impact on populations worldwide [9,11,12]. For example, a global study reported an increase of 27.6% and 25.6%, in the prevalence of major depressive disorder and anxiety disorders, respectively, since before the pandemic [13].
Though the clinical presentation of the SARS-CoV-2 infection is mainly associated with cardiac or pulmonary complications, it has been reported that coronaviruses may also invade the central and peripheral nervous systems, inducing neurological and psychiatric symptoms. According to a previous comprehensive review, COVID-19 infected patients were more likely to demonstrate a variety of neurological pathologies, such as microgliosis (52.5%), astrogliosis (45.6%), inflammatory infiltrates (44.0%), hypoxic-ischemic lesions (40.8%), edema (25.3%), and hemorrhagic lesions (20.5%) [14]. Importantly, several meta-analyses have indicated that health care workers (HCWs) working in pandemics are at increased risk of a range psychiatric symptoms. Among HCWs, the overall prevalence of generalized anxiety disorder was 30.5% [15], prevalence of acute ost-traumatic stress disorder ranged from 25.1% to 71.5% [16], and prevalence of depression was about 20.2% [17].
The literature has also witnessed an increase in the number of published systematic reviews (SRs) and meta-analyses (MAs) related to possible neurological, psychiatric, and psychological implications of the COVID-19 pandemic [18,19]; however, concerns have been raised regarding the methodological quality of published SRs and MAs related to the COVID-19 pandemic [20]. An evidence mapping included 243 systematic reviews about COVID-19 infection and reported that 25.9% were of low quality and 61.7% were of critically low quality [20]. An umbrella review is a knowledge synthesis approach that enables a quality-based assessment of the available evidence derived from SRs and MAs on a given topic of interest [21]. Therefore, we propose to undertake an umbrella review to summarize and synthesize evidence from observational studies reporting on bidirectional associations of the COVID-19 infection with neurological, psychiatric, and psychological outcomes in a direct or indirect manner.

2. Materials and Methods

This umbrella review follows methods that were previously used in another similar knowledge synthesis [22]. The PubMed, Embase, APA PsycINFO, and Cochrane Reviews computerized databases will be systematically searched from inception to 15 January 2022, with no date or language restrictions, to identify SRs and MAs on the associations between COVID-19 and neurological, psychiatric, and psychological outcomes. The protocol of umbrella review follows the of Preferred Reporting Items for Systematic Review and Meta-analysis Protocols (PRISMA-P) [23]. The final results of this study will be reported according to PRISMA [24]. Figure 1 shows the study process.

2.1. Search Strategy

A search strategy was built by a professional librarian (Risa Shorr; The Ottawa Hospital, Ottawa, Ontario, Canada) and is available as a supplementary online material. According to the indices of various databases, the following keywords will be used with Boolean operators: “COVID-19”, “Coronavirus Disease 2019”, “new coronavirus”, “2019-nCoV”, “novel coronavirus”, “SARS-CoV-2”, “pandemic” and “mental disorders”, “psychiatric disorders”, “neurological disorders”, “nervous system diseases”, “brain disorders”, “psychological phenomena”, “systematic review” or “meta-analysis” on PubMed, EMBASE, APA PsycINFO, and the Cochrane Reviews. Two investigators with considerable clinical research experience and expertise in the field of the umbrella review independently screen the titles and abstracts of retrieved references for eligibility. Duplicated articles will be removed. The full text of the remaining articles will be read and reference lists of these papers will be searched for additional relevant articles. These are reviewed for inclusion using the same method as articles found through database searches. Disagreements are resolved by consensus or via discussion with a third investigator.

2.2. Inclusion Criteria

We include SRs and MAs focusing on the direct or indirect associations of COVID-19 with neurological, psychological, and psychiatric outcomes. The direct associations may include (1) neurological, psychiatric, and psychological sequelae due to COVID-19 infection (e.g., olfactory dysfunction, delirium, anxiety, depression) and (2) the impact of neurological and psychiatric disorders as well as psychological factors on the prognosis of COVID-19 (e.g., mortality). The indirect associations include (but are not limited to) (1) the influence of the COVID-19 pandemic on treatments (e.g., service utilization) for neurological or mental health conditions and (2) neurological, psychiatric, and psychological outcomes associated with the COVID-19 pandemic [25].
SRs and MAs must meet the following criteria: (i) use of a comprehensive search strategy involving two or more electronic databases; (ii) use of an explicit statement describing the inclusion criteria; (iii) use of a formal critical appraisal or quality assessment process for all included studies and report the outcome of that process; and (iv) report findings on outcomes of interest using details on the study and patient characteristics of three or more studies and provide the direction of the findings from any pooled analyses (narrative or MA) carried out, including direction of effect and any statistical significance.
Eligible SRs or MAs of psychiatric diagnoses must be validated by psychiatrists or by semi-structured interviews relying on standard diagnostic criteria (i.e., the Diagnostic and Statistical Manual of Mental Disorders or the International Classification of Diseases). Similarly, the neurological diagnoses are coded according to the International Classification of Diseases or any standard alternative coding system.
The subgroup analyses conducted in the original included SRs and MAs are considered and reported in the current umbrella review. The mental health response to the COVID-19 pandemic examines the following populations, including but not limited to (1) medical staff, (2) people with mental disorders, (3) people with neurological disorders, (4) people with other physical diseases, (5) children and adolescents, and (6) elderly people. The stressors-associated mental health responses are also explored, including (1) fear of infection (e.g., self or family), (2) infection control measures (e.g., stay-at-home, lockdown), (3) societal changes, and (4) economic impact (e.g., loss of job/income). If possible, the impact of different COVID-19 variants (e.g., alpha, beta, gamma, delta) are explored whenever available on the eligible SR and/or MAs.
We select SRs and MAs of observational studies (case-control, cohort, cross-sectional, or ecological studies). When data are incomplete, the corresponding author is contacted and invited to send additional information. We only include SRs and/or MAs reporting associations, whilst ones reporting only prevalence or incidence rates are excluded. Whenever two or more SRs and/or MAs are available reporting on the same association, we select the one with the largest number of included studies. If there are SRs and MAs with the same number of included studies, then we select the most recent one. Finally, as a third criterion, we select the one with the highest overall methodological quality (vide infra).

2.3. Quality of Evidence

Two independent investigators assess the methodological quality of SRs and MAs by using A Measurement Tool for the Assessment of Multiple Systematic Reviews (AMSTAR 2) to quantify the methodological and content quality [26]. AMSTAR 2 includes assessment of study eligibility criteria, identification and selection of studies, data collection methods, study appraisal methods and findings, and synthesis methods. The methodological quality is categorized into low (<4), medium (4–7), and high (>7). Content quality is categorized into low (<4), medium (4–6), and high (>6). The lowest score between methodological and content quality determines the overall quality. Any disagreements are solved by consensus.
Many systematic reviews and meta-analyses focusing on a similar topic include a different number of primary studies; the overall results and conclusions of an umbrella review can therefore be biased. To assess the potential impact of the overlap in the inclusion of the same primary studies, the degree of overlap within and between reviews are measured using the validated corrected cover area (CCA) method [27]. A CCA score of 0–5 indicates slight overlap, 6–10 moderate, 11–15 high, and >15 very high [27]. Each SRs and MAs with sufficient evidence and no hints of bias are reassessed after examination of any data errors and the eligibility of each study. After that, we then appraise the evidence by using the Grading of Recommendations Assessment, Development and Evaluation tool [28].

2.4. Data Extraction

All data are re-extracted from each primary study onto piloted forms. One author performs the primary data extraction, and this is independently reviewed by at least one other author. Disagreements are resolved through consensus. The original, primary publication for each included review is used for data extraction.
The data extracted includes specific details about the included studies (e.g., study population) and the review methods (e.g., number of databases searched, search date, and any date, location, nor language restrictions on the search). Patient characteristics (e.g., age, sex, history of physical illness) are also extracted from the included review, if reported. Where results are presented for pooled outcomes and subgroups, we extract pooled outcomes to maximize sample size. If results are presented across several different measures on the same outcome, effect sizes are averaged across all reported assessment measures, to avoid bias associated with selective preference for significant results. The authors’ overall conclusion or recommendation is also extracted.
If both unadjusted and adjusted associations are available, we extract the adjusted effect size because the latter adjusted associations attempt to address confounding as best as possible. If only unadjusted relationships are available, we extract these and plan a sensitivity analysis to exclude such studies. Where data are only available in graphical format, we use WebPlot to digitize the data into an extractable format.

2.5. Primary and Secondary Outcomes

The primary outcomes will include the direct and indirect associations between COVID-19 and neurological, psychiatric, and psychological implications. Studies are required to summarize the clinical symptoms using continuous outcomes or binary outcomes to be included (e.g., change in depression rating scales, risk ratio of sleep disorder). Studies that only addressed outcomes in a narrative way without any assessment of clinical status are excluded. The secondary outcomes will include the subgroup analyses conducted according to the categorical moderating variables (e.g., specific populations, specific stressor-related mental health responses, and COVID-19 variants).

2.6. Statistical Analysis

A tabular summary of review characteristics (e.g., year of publication, months of data collection, county of origin, geographical regions, respective waves of the pandemics, number of included studies, settings, design of included studies, and other moderators, and/or context as provided in the included SR and/or MAs) is reported. We convert continuous non-standardized outcomes, such as weighted mean differences, to standardized mean differences, and binary outcomes to the odds ratio with 95% confidence intervals. Whenever data conversion is not be possible, we maintain the original effect sizes as reported in the original SRs and/or MAs. Whenever the data are derived from MAs with fixed-effects models, we recalculate the effect sizes using random-effects models. Random-effects models are used because we anticipate considerable heterogeneity in methodology, outcome definitions, and sample characteristics. We calculate the 95% prediction intervals for the summary estimates based on random-effects modelling. This statistic represents the range in which the effect estimates of future studies examining the same associations will fall [29].
We extract the degree of heterogeneity across studies using the p value of the chi-squared based Q test and the I2 metric of inconsistency [30]. For the Q statistic, p < 0.05  is considered significant. The I2 metric ranges between 0% and 100%. The degree of heterogeneity is defined as substantial (I2 > 50%) and considerable (I2 > 75%).
We examine whether smaller studies provide higher side effects estimates than larger studies, which is an indication of publication bias, true heterogeneity, or chance [31,32]. An indication of small study effects is evaluated by the Egger’s regression asymmetry test (p < 0.10) and whether the random effects summary estimate is larger than the point estimate of the largest study in each association. We assess excess significance bias by evaluating whether the observed number of studies with nominally statistically significant results (“positive” studies, p < 0.005) in the published literature are different from the expected number of studies with statistically significant results [33]. The expected number of statistically significant studies in each association is calculated from the sum of the statistical power estimates for each component study using an algorithm from a non-central t distribution [34,35,36]. The power estimates of each component study depends on the plausible effect size for the tested association, which is assumed to be the effect of the largest study (that is, the smallest standard error) in each association [27,36]. Excess significance for individual meta-analyses is determined at p < 0.10. In addition, we extract any adjustment for publication bias as reported in the original meta-analytic studies.
For SRs that do not provide a meta-analytic estimate, we annotate the main conclusion of the study and also take note of the reasons reported by the authors for not conduction a quantitative summary of the results.

2.7. Credibility of Evidence

We use the following criteria to assess the credibility of the evidence of observational studies. On the basis of previously proposed criteria considering the amount of evidence, statistical significance, heterogeneity, small-study effect, excess significance, and PI [29,37,38,39]. The classification rules include: (1) having p < 10−6 on the basis of the random-effect model; (2) having >1000 participants in a single meta-analysis; (3) having low or moderate heterogeneity (I2 < 50%); (4) having 95% PI that excludes the null value; (5) having no evidence of small-study effect; (6) having no evidence of excess significance bias. The meta-analyses of observational studies with summary results of p < 0.05 are classified into four categories. Meta-analysis that meets criteria (1)–(6) is classified as convincing evidence (not suggestive of bias; class I evidence); meta-analysis that meets criteria (1)–(4) is classified as highly suggestive evidence (class II evidence); meta-analysis that meets criteria (2) and has p < 0.001 is classified as suggestive evidence (class III evidence); meta-analysis that has only p < 0.05 ais classified as weak evidence (class IV evidence). The classification rules are detailed in Table 1.

3. Discussion

In this umbrella review, we will undertake a comprehensive review of previously published SRs and/or MAs assessing the direct and indirect associations between COVID-19 and neurological, psychiatric, and psychological outcomes. Using evidence from this review, we expect to examine which neuro-psycho-psychiatric and psychological implications of COVID-19 are supported by the highest quality of evidence. We anticipate that the methodological quality of most included SRs and/or MAs will fall short from optimal standards [40]. The results of our UR will be of interest to clinicians, policymakers, and patients. However, findings from the present protocol should be considered in several limitations. First, studies related to some topics which are not yet synthesized on systematic reviews and meta-analyses might not be captured by this umbrella review and comprises a potential limitation of this work. Second, umbrella reviews focus on existing MAs; therefore, SR with no meta-analytic approach are excluded. Therefore, generalizability and the final results should be interpreted with caution. Additionally, umbrella reviews do not appraise the quality of all the individual studies included in each meta-analysis, so we will conduct the umbrella analysis and then to determine the necessity of sensitivity analysis based on the quality level of AMSTAR 2. Finally, the poor quality of rapid and poorly transparent protocols for the systematic reviews and/or meta-analyses included in our study may also limit the generalizability of some of the reported associations.

4. Conclusions

This UR will be among the first to systematically explore and integrate the highest level of evidence available on bidirectional associations of the COVID-19 pandemic with neurological, psychiatric, and psychological outcomes. The findings of our study will provide relevant evidence from a public health perspective on the neurological, psychiatric, and psychological implications of the ongoing COVID-19 pandemic. Some of our findings may also have health policy implications within the context of possible upcoming pandemics.

Author Contributions

Conceptualization, C.-K.T., C.-S.L. and A.F.C.; methodology, P.-T.T., C.-W.H., P.-Y.L.; software, C.-W.H. and C.-S.L.; formal analysis, C.-S.L.; investigation, M.S. and B.L.; data curation, J.F., B.S., L.H., and M.F.; writing—original draft preparation, T.-C.Y.; writing—review and editing, C.-S.L., E.V., T.T., J.S. and A.F.C.; funding acquisition, C.-K.T. and T.-C.Y. All authors have read and agreed to the published version of the manuscript.

Funding

The study was supported by from the Ministry of Science and Technology (MOST-110-2314-B-016-035- to C.-K.T.) and from Tri-Service General Hospital Penghu Branch (TSGH-PH-E-110011 to T.-C.Y.). The funding source had no role in any process of our study.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Acknowledgments

The authors would like to thank Risa Shorr for her great support in the literature search.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Hu, B.; Guo, H.; Zhou, P.; Shi, Z.L. Characteristics of SARS-CoV-2 and COVID-19. Nat. Rev. Microbiol. 2021, 19, 141–154. [Google Scholar] [CrossRef] [PubMed]
  2. Nalbandian, A.; Sehgal, K.; Gupta, A.; Madhavan, M.V.; McGroder, C.; Stevens, J.S.; Cook, J.R.; Nordvig, A.S.; Shalev, D.; Sehrawat, T.S.; et al. Post-acute COVID-19 syndrome. Nat. Med. 2021, 27, 601–615. [Google Scholar] [CrossRef]
  3. Tay, M.Z.; Poh, C.M.; Rénia, L.; MacAry, P.A.; Ng, L.F. The trinity of COVID-19: Immunity, inflammation and intervention. Nat. Rev. Immunol. 2020, 20, 363–374. [Google Scholar] [CrossRef] [PubMed]
  4. Gupta, A.; Madhavan, M.V.; Sehgal, K.; Nair, N.; Mahajan, S.; Sehrawat, T.S.; Bikdeli, B.; Ahluwalia, N.; Ausiello, J.C.; Wan, E.Y.; et al. Extrapulmonary manifestations of COVID-19. Nat. Med. 2020, 26, 1017–1032. [Google Scholar] [CrossRef]
  5. Del Rio, C.; Collins, L.F.; Malani, P. Long-term Health Consequences of COVID-19. JAMA 2020, 324, 1723–1724. [Google Scholar] [CrossRef]
  6. Boldrini, M.; Canoll, P.D.; Klein, R.S. How COVID-19 Affects the Brain. JAMA Psychiatry 2021, 78, 682–683. [Google Scholar] [CrossRef]
  7. Marshall, M. How COVID-19 can damage the brain. Nature 2020, 585, 342–343. [Google Scholar] [CrossRef]
  8. Llach, C.D.; Vieta, E. Mind long COVID: Psychiatric sequelae of SARS-CoV-2 infection. Eur. Neuropsychopharmacol. 2021, 49, 119–121. [Google Scholar] [CrossRef]
  9. Blumenthal, D.; Fowler, E.J.; Abrams, M.; Collins, S.R. COVID-19—Implications for the henewalth care system. N. Engl. J. Med. 2020, 383, 1483–1488. [Google Scholar] [CrossRef] [PubMed]
  10. Nicola, M.; Alsafi, Z.; Sohrabi, C.; Kerwan, A.; Al-Jabir, A.; Iosifidis, C.; Agha, M.; Agha, R. The socio-economic implications of the coronavirus pandemic (COVID-19): A review. Int. J. Surg. 2020, 78, 185–193. [Google Scholar] [CrossRef]
  11. Betty, P.; Carol, S.N. Mental Health and the Covid-19 Pandemic. N. Engl. J. Med. 2020, 383, 510–512. [Google Scholar]
  12. Amsalem, D.; Dixon, L.B.; Neria, Y. The Coronavirus Disease 2019 (COVID-19) Outbreak and Mental Health: Current Risks and Recommended Actions. JAMA Psychiatry 2021, 78, 9–10. [Google Scholar] [CrossRef] [PubMed]
  13. Santomauro, D.F.; Herrera, A.M.; Shadid, J.; Zheng, P.; Ashbaugh, C.; Pigott, D.M.; Abbafati, C.; Adolph, C.; Amlag, J.O.; Aravkin, A.Y.; et al. Global prevalence and burden of depressive and anxiety disorders in 204 countries and territories in 2020 due to the COVID-19 pandemic. Lancet 2021, 398, 1700–1712. [Google Scholar] [CrossRef]
  14. Cosentino, G.; Todisco, M.; Hota, N.; Della Porta, G.; Morbini, P.; Tassorelli, C.; Pisani, A. Neuropathological findings from COVID-19 patients with neurological symptoms argue against a direct brain invasion of SARS-CoV-2: A critical systematic review. Eur. J. Neurol. 2021, 28, 3856–3865. [Google Scholar] [CrossRef]
  15. Adibi, A.; Golitaleb, M.; Farrahi-Ashtiani, I.; Pirani, D.; Yousefi, K.; Jamshidbeigi, Y.; Sahebi, A. The prevalence of generalized anxiety disorder among health care workers during the COVID-19 pandemic: A systematic review and meta-analysis. Front. Psychiatry 2021, 12, 658846. [Google Scholar] [CrossRef] [PubMed]
  16. Al Falasi, B.; Al Mazrouei, M.; Al Ali, M.; Al Dhamani, M.; Al Ali, A.; Al Kindi, M.; Dalkilinc, M.; Al Qubaisi, M.; Campos, L.A.; Al Tunaiji, H.; et al. Prevalence and determinants of immediate and long-term PTSD consequences of coronavirus-related (CoV-1 and CoV-2) pandemics among healthcare professionals: A systematic review and meta-analysis. Int. J. Environ. Res. Public Health 2021, 18, 2182. [Google Scholar] [CrossRef] [PubMed]
  17. Allan, S.M.; Bealey, R.; Birch, J.; Cushing, T.; Parke, S.; Sergi, G.; Bloomfield, M.; Meiser-Stedman, R. The prevalence of common and stress-related mental health disorders in healthcare workers based in pandemic-affected hospitals: A rapid systematic review and meta-analysis. Eur. J. Psychotraumatol. 2020, 11, 1810903. [Google Scholar] [CrossRef]
  18. Fusar-Poli, P. Mental disorders and risk of COVID-19 related mortality, hospitalization and intensive care unit admission: A systematic review and meta-analysis. Lancet Psychiatry 2021, 8, 797–812. [Google Scholar]
  19. Ceban, F.; Nogo, D.; Carvalho, I.P.; Lee, Y.; Nasri, F.; Xiong, J.; Lui, L.M.; Subramaniapillai, M.; Gill, H.; Liu, R.N.; et al. Association between Mood Disorders and Risk of COVID-19 Infection, Hospitalization, and Death: A Systematic Review and Meta-analysis. JAMA Psychiatry 2021, 78, 1079–1091. [Google Scholar] [CrossRef]
  20. Li, Y.; Cao, L.; Zhang, Z.; Hou, L.; Qin, Y.; Hui, X.; Li, J.; Zhao, H.; Cui, G.; Cui, X.; et al. Reporting and methodological quality of COVID-19 systematic reviews needs to be improved: An evidence mapping. J. Clin. Epidemiol. 2021, 135, 17–28. [Google Scholar] [CrossRef]
  21. Papatheodorou, S. Umbrella reviews: What they are and why we need them. Eur. J. Epidemiol. 2019, 34, 543–546. [Google Scholar] [CrossRef]
  22. Correll, C.U.; Cortese, S.; Croatto, G.; Monaco, F.; Krinitski, D.; Arrondo, G.; Ostinelli, E.G.; Zangani, C.; Fornaro, M.; Estradé, A.; et al. Efficacy and acceptability of pharmacological, psychosocial, and brain stimulation interventions in children and adolescents with mental disorders: An umbrella review. World Psychiatry 2021, 20, 244–275. [Google Scholar] [CrossRef] [PubMed]
  23. Shamseer, L.; Moher, D.; Clarke, M.; Ghersi, D.; Liberati, A.; Petticrew, M.; Shekelle, P.; Stewart, L.A. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: Elaboration and explanation. BMJ 2015, 349, g7647. [Google Scholar] [CrossRef] [Green Version]
  24. Moher, D.; Liberati, A.; Tetzlaff, J.; Altman, D.G. Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. BMJ 2009, 339, b2535. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  25. Vieta, E.; Pérez, V.; Arango, C. Psychiatry in the aftermath of COVID-19. Rev. Psiquiatr. Salud. Ment. 2020, 13, 105–110. [Google Scholar] [CrossRef] [PubMed]
  26. Shea, B.J.; Grimshaw, J.M.; Wells, G.A.; Boers, M.; Andersson, N.; Hamel, C.; Porter, A.C.; Tugwell, P.; Moher, D.; Bouter, L.M. Development of AMSTAR: A measurement tool to assess the methodological quality of systematic reviews. BMC Med. Res. Methodol. 2007, 7, 10. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  27. Pieper, D.; Antoine, S.L.; Mathes, T.; Neugebauer, E.A.; Eikermann, M. Systematic review finds overlapping reviews were not mentioned in every other overview. J. Clin. Epidemiol. 2014, 67, 368–375. [Google Scholar] [CrossRef] [PubMed]
  28. Guyatt, G.; Oxman, A.D.; Akl, E.A.; Kunz, R.; Vist, G.; Brozek, J.; Norris, S.; Falck-Ytter, Y.; Glasziou, P.; DeBeer, H.; et al. GRADE guidelines: 1. Introduction-GRADE evidence profiles and summary of findings tables. J. Clin. Epidemiol. 2011, 64, 383–394. [Google Scholar] [CrossRef]
  29. Riley, R.D.; Higgins, J.P.T.; Deeks, J.J. Interpretation of random effects meta-analyses. BMJ 2011, 342, d549. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  30. Higgins, J.P.; Thompson, S.G.; Deeks, J.J.; Altman, D.G. Measuring inconsistency in meta-analyses. BMJ 2003, 327, 557–560. [Google Scholar] [CrossRef] [Green Version]
  31. Tsilidis, K.K.; Kasimis, J.C.; Lopez, D.S.; Ntzani, E.E.; Ioannidis, J.P. Type 2 diabetes and cancer: Umbrella review of meta-analyses of observational studies. BMJ 2015, 350, g7607. [Google Scholar] [CrossRef] [Green Version]
  32. Sterne, J.A.; Sutton, A.J.; Ioannidis, J.P.; Terrin, N.; Jones, D.R.; Lau, J.; Carpenter, J.; Rücker, G.; Harbord, R.M.; Schmid, C.H.; et al. Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials. BMJ 2011, 343, d4002. [Google Scholar] [CrossRef] [Green Version]
  33. Ioannidis, J.P.; Trikalinos, T.A. The appropriateness of asymmetry tests for publication bias in meta-analyses: A large survey. CMAJ 2007, 176, 1091–1096. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  34. Tsilidis, K.K.; Panagiotou, O.A.; Sena, E.S.; Aretouli, E.; Evangelou, E.; Howells, D.W.; Salman, R.A.; Macleod, M.R.; Ioannidis, J.P. Evaluation of excess significance bias in animal studies of neurological diseases. PLoS Biol. 2013, 11, e1001609. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  35. Tsilidis, K.K.; Papatheodorou, S.I.; Evangelou, E.; Ioannidis, J.P. Evaluation of excess statistical significance in meta-analyses of 98 biomarker associations with cancer risk. J. Natl. Cancer Inst. 2012, 104, 1867–1878. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  36. Dragioti, E.; Karathanos, V.; Gerdle, B.; Evangelou, E. Does psychotherapy work? An umbrella review of meta-analyses of randomized controlled trials. Acta Psychiatr. Scand. 2017, 136, 236–246. [Google Scholar] [CrossRef] [PubMed]
  37. Naci, H.; Ioannidis, J.P. Comparative effectiveness of exercise and drug interventions on mortality outcomes: Metaepidemiological study. BMJ 2013, 347, f5577. [Google Scholar] [CrossRef] [Green Version]
  38. He, Y.; Li, X.; Gasevic, D.; Brunt, E.; McLachlan, F.; Millenson, M.; Timofeeva, M.; Ioannidis, J.P.; Campbell, H.; Theodoratou, E. Statins and Multiple Noncardiovascular Outcomes: Umbrella Review of Meta-analyses of Observational Studies and Randomized Controlled Trials. Ann. Intern. Med. 2018, 169, 543–553. [Google Scholar] [CrossRef]
  39. Chen, M.; Tang, T.C.; He, T.H.; Du, Y.J.; Qin, D.; Zheng, H. Management of haemorrhoids: Protocol of an umbrella review of systematic reviews and meta-analyses. BMJ Open 2020, 10, e035287. [Google Scholar] [CrossRef] [Green Version]
  40. Rosenberger, K.J.; Xu, C.; Lin, L. Methodological assessment of systematic reviews and meta-analyses on COVID-19: A meta-epidemiological study. J. Eval. Clin. Pract. 2021, 27, 1123–1133. [Google Scholar] [CrossRef]
Figure 1. Flowchart of study process. PI = prediction interval.
Figure 1. Flowchart of study process. PI = prediction interval.
Ijerph 19 01681 g001
Table 1. Credibility assessment criteria.
Table 1. Credibility assessment criteria.
Evidence ClassificationDetailed Criteria
Convincing (class I)Associations with p < 10−6; having >1000 participants in a single meta-analysis; having low or moderate heterogeneity (I2 < 50%); having 95% PI 1 that excludes the null value; having no evidence of small-study effect; having no evidence of excess significance bias.
Highly suggestive (class II)Associations with p < 10−6; having >1000 participants in a single meta-analysis; having low or moderate heterogeneity (I2 < 50%); having 95% PI that excludes the null value
Suggestive (class III)Associations with p < 0.001 and having >1000 participants in a single meta-analysis.
Weak (class IV)Remaining statistically significant associations with p < 0.05
1 PI = prediction interval.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Yeh, T.-C.; Liang, C.-S.; Tsai, C.-K.; Solmi, M.; Lafer, B.; Tseng, P.-T.; Hsu, C.-W.; Lin, P.-Y.; Firth, J.; Stubbs, B.; et al. Neurological, Psychiatric, and Psychological Implications of the COVID-19 Pandemic: Protocol for a Large-Scale Umbrella Review of Observational Studies. Int. J. Environ. Res. Public Health 2022, 19, 1681. https://doi.org/10.3390/ijerph19031681

AMA Style

Yeh T-C, Liang C-S, Tsai C-K, Solmi M, Lafer B, Tseng P-T, Hsu C-W, Lin P-Y, Firth J, Stubbs B, et al. Neurological, Psychiatric, and Psychological Implications of the COVID-19 Pandemic: Protocol for a Large-Scale Umbrella Review of Observational Studies. International Journal of Environmental Research and Public Health. 2022; 19(3):1681. https://doi.org/10.3390/ijerph19031681

Chicago/Turabian Style

Yeh, Ta-Chuan, Chih-Sung Liang, Chia-Kuang Tsai, Marco Solmi, Beny Lafer, Ping-Tao Tseng, Chih-Wei Hsu, Pao-Yen Lin, Joseph Firth, Brendon Stubbs, and et al. 2022. "Neurological, Psychiatric, and Psychological Implications of the COVID-19 Pandemic: Protocol for a Large-Scale Umbrella Review of Observational Studies" International Journal of Environmental Research and Public Health 19, no. 3: 1681. https://doi.org/10.3390/ijerph19031681

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop