Next Article in Journal
Application of an Intraoperative Limb Positioner for Adjustable Traction in Both-Column Fractures of the Acetabulum: A Technical Note with Clinical Outcome
Next Article in Special Issue
Ferroptosis-Related Gene SLC1A5 Is a Novel Prognostic Biomarker and Correlates with Immune Microenvironment in HBV-Related HCC
Previous Article in Journal
Supplementary Pharmacotherapy for the Behavioral Abnormalities Caused by Stressors in Humans, Focused on Post-Traumatic Stress Disorder (PTSD)
Previous Article in Special Issue
Does Having Rheumatoid Arthritis Increase the Dose of Depression Medications? A Mendelian Randomization Study
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Causal Inference of Central Nervous System-Regulated Hormones in COVID-19: A Bidirectional Two-Sample Mendelian Randomization Study

1
Scientific Research Center, Sun Yat-sen University, The Seventh Affiliated Hospital, Shenzhen 518107, China
2
The Herbert Wertheim School of Public Health and Longevity, University of California San Diego, La Jolla, CA 92093, USA
3
School of Public Health, Sun Yat-sen University, Guangzhou 510275, China
*
Author to whom correspondence should be addressed.
J. Clin. Med. 2023, 12(4), 1681; https://doi.org/10.3390/jcm12041681
Submission received: 9 January 2023 / Revised: 13 February 2023 / Accepted: 16 February 2023 / Published: 20 February 2023
(This article belongs to the Special Issue New Advances in Clinical Genetics and Genetic Epidemiology)

Abstract

:
We assessed the causal association of three COVID-19 phenotypes with insulin-like growth factor 1, estrogen, testosterone, dehydroepiandrosterone (DHEA), thyroid-stimulating hormone, thyrotropin-releasing hormone, luteinizing hormone (LH), and follicle-stimulating hormone. We used bidirectional two-sample univariate and multivariable Mendelian randomization (MR) analyses to evaluate the direction, specificity, and causality of the association between CNS-regulated hormones and COVID-19 phenotypes. Genetic instruments for CNS-regulated hormones were selected from the largest publicly available genome-wide association studies of the European population. Summary-level data on COVID-19 severity, hospitalization, and susceptibility were obtained from the COVID-19 host genetic initiative. DHEA was associated with increased risks of very severe respiratory syndrome (odds ratio [OR] = 4.21, 95% confidence interval [CI]: 1.41–12.59), consistent with multivariate MR results (OR = 3.72, 95% CI: 1.20–11.51), and hospitalization (OR = 2.31, 95% CI: 1.13–4.72) in univariate MR. LH was associated with very severe respiratory syndrome (OR = 0.83; 95% CI: 0.71–0.96) in univariate MR. Estrogen was negatively associated with very severe respiratory syndrome (OR = 0.09, 95% CI: 0.02–0.51), hospitalization (OR = 0.25, 95% CI: 0.08–0.78), and susceptibility (OR = 0.50, 95% CI: 0.28–0.89) in multivariate MR. We found strong evidence for the causal relationship of DHEA, LH, and estrogen with COVID-19 phenotypes.

1. Introduction

Coronavirus disease 2019 (COVID-19), caused by severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), has infected more than 452 million individuals and resulted in more than 6 million deaths worldwide as of 12 March 2022 [1]. SARS-CoV-2 infection has high variability in susceptibility, hospitalization, and severity, with clinical severity ranging from asymptomatic or mild upper respiratory illness to moderate and severe diseases such as respiratory failure, acute respiratory distress syndrome, and multi-organ failure with fatal outcomes [2]. A report on COVID-19 suggests that 80% of infections are mild or asymptomatic, while 20% are moderate to severe [3]. At the early infection stage, the innate immune system recognizes SARS-CoV-2 and induces proinflammatory cytokines to remove the viruses [4]. However, SARS-CoV-2 disrupts the normal immune response in severely and critically ill patients, leading to an uncontrolled inflammatory response and cytokine storm, resulting in systemic and local damage [4,5]. Understanding the host factors influencing this infectious disease is crucial for elucidating the viral life cycle, identifying risk factors, drug development, and disease prevention.
CNS-regulated hormones have received special attention in the context of COVID-19, considering their modulatory effects on cytokines. The gender disparity, with reports that men experience more severe metabolic syndromes and have higher mortality than women do, suggests that metabolome influenced by sex hormones such as estrogen and testosterone may play a role in COVID-19 morbidity and mortality [6,7,8]. Androgens may be associated with an increased risk of COVID-19 due to their modulatory effects on angiotensin-converting enzyme 2 (ACE2) and transmembrane serine protease 2 (TMPRSS2), the two key factors associated with the entrance of SARS-CoV-2 [9]. Indeed, anti-androgen therapy in patients with prostate cancer has reportedly protected them against infection with SARS-CoV-2 [10]. A recent study also suggested a causal effect of increased testosterone levels with a higher risk of COVID-19 hospitalization and severe disease [11]. In contrast, a retrospective study found that older females who received estradiol therapy had a lower fatality risk than older females who did not receive the therapy, indicating a potential immune protective effect of estrogen in females [12]. Meanwhile, in a study comparing critically and non-critically ill patients, low insulin growth-like factor-1 (IGF-1) levels showed a potential association with severe forms of COVID-19 [13].
Despite the possible effect of CNS-regulated hormones on COVID-19, there appears to be a reverse directional effect of COVID-19 on hormones. A cohort study found that as the severity of COVID-19 increased, the concentration of dehydroepiandrosterone (DHEA) significantly increased [14]. However, another observational study of hospitalized patients did not find any difference in DHEA levels between males and females with severe COVID-19 [15]. Another study on thyroid function found that thyroid-stimulating hormone (TSH) levels in COVID-19 patients were obviously lower than those in non-COVID-19 patients, which suggested the possible effects of COVID-19 on TSH [16].
Although observational studies provide some evidence for the conferral of hormonal effects on COVID-19, the liability of these findings is challenged by confounding factors, reverse causation, and other factors [17]. Therefore, the causal impact of hormones on COVID-19 risk has not been ascertained. Mendelian randomization (MR) uses genetic variants following Mendel’s law of independent assortment as unconfounded proxies of an adjustable exposure to examine whether the exposure has causal effects on an outcome, overcoming the limitations of observational studies [18].
In this study, we used two-sample MR univariate and multivariable analyses to examine potential causal associations between three types of COVID-19 (very severe respiratory syndrome, hospitalization, and susceptibility) and eight CNS-regulated hormones [IGF-1, estrogen, testosterone, DHEA, TSH, thyrotropin-releasing hormone (TRH), luteinizing hormone (LH), and follicle-stimulating hormone (FSH)]. We also performed a bidirectional analysis to detect the possible reverse causal relationship between CNS-regulated hormones and COVID-19. Anti-Coronavirus vaccines such as the BioNTech/Pfizer, Moderna, and Oxford/AstraZeneca vaccines have been proven to have prophylactic and therapeutic effects, which were highly recommended for protection [19,20,21]. However, more therapeutics for COVID-19 are still needed. By assessing and establishing the causal role of CNS-regulated hormones, possible hormonal therapies could be applied as therapeutics for COVID-19 to reduce mortality and morbidity in COVID-19-infected patients.

2. Material and Methods

2.1. CNS-Regulated Hormones and COVID-19

Single-nucleotide polymorphisms (SNPs) associated with the levels of the eight selected hormones were selected based on summary-level data from either the Integrative Epidemiology Unit (IEU) open genome-wide association study (GWAS) project [22,23] or the largest meta GWAS of thyroid-related traits [24]. Strict European samples were selected as exposure sets, part of which were from the UK Biobank. The sample sizes of the exposure set varied from 468,343 to 1000. Genetic instruments for TSH were extracted from a meta-analysis of thyroid hormones in 26,420 participants of European ancestry [25]. Estradiol is the most potent form of estrogen in the human body; thus, it was used to represent the function of estrogens [26]. In addition, DHEA-sulfate (DHEA-S) was adopted to represent DHEA because it circulates at a far higher concentration than DHEA in the blood [27]. All GWAS summary data were adjusted for age, sex, and other study-specific covariates. Detailed information is provided in Table S1.
Summary statistics for the three COVID-19 phenotypes were obtained from the release of the five COVID-19 Host Genetics Initiative (HGI) GWAS meta-analysis [28]. The COVID-19 HGI is a consortium of scientists from over 54 countries working collaboratively to investigate human genetic variation related to very severe respiratory syndrome (cases: 5582; controls: 709,010), hospitalization (cases: 17,992; controls: 1,810,493), and susceptibility (cases: 87,870; controls: 2,210,804) (Table S2). All individuals included in our analysis were of European ancestry. Very severe respiratory syndromes were cases that ended with respiratory support or death from COVID-19. Hospitalizations were cases that involved hospitalized patients. Susceptibility was defined as cases that tested positive, including laboratory-confirmed COVID-19 using reverse transcription-quantitative polymerase chain reaction (RT-qPCR) or serological testing, clinically diagnosed COVID-19, and self-reported COVID-19. In the GWAS meta-analysis, single-variant association analyses of COVID-19 traits were performed after adjusting for age, age2, sex, age × sex, top principal components for ancestry, and study-specific covariates of each contributing cohort. All studies contributing data to the analyses were approved by the relevant ethics committees.

2.2. Selection of Genetic Instruments for CNS-Regulated Hormones and COVID-19 Traits

Genetic instruments were selected from the exposure data with genome-wide significance (p < 5 × 10−8). SNPs were excluded if (1) they were not present in the outcome GWAS summary data, (2) SNPs in linkage disequilibrium were within a 1-Mb genomic distance (R-squares above 0.01) using the 1000 Genome European reference panel and retained the SNP with the lowest p-value, and (3) minor allele frequency was greater than 0.42 for non-inferable palindromic alleles. For exposures with a relatively small number of SNPs, such as DHEA-S and TRH, if an SNP was absent in the outcome dataset, an LD proxy SNP was searched using the 1000 Genome European panel to replace the missing SNP [29]. Exposure and outcome GWAS summary statistics were harmonized by aligning the effect alleles. The number of genetic instruments used in bidirectional MR analyses is shown in Table S1. The proportion of variance was calculated using the sum of the variance explained by individual SNPs divided by the variance of phenotype [30] (Table S2).

2.3. Bidirectional Two-Sample MR and Statistical Analysis

We conducted bidirectional two-sample MR analyses. CNS-regulated hormones were considered exposures in the forward direction, and COVID-19 severity, hospitalization, and susceptibility were the outcomes. Conversely, COVID-19 severity, hospitalization, and susceptibility were exposures, and CNS-regulated hormones were outcomes in the reverse direction. The procedures for genetic instrument selection were similar in both directions of analysis.
We applied three MR methods to estimate causal effects: inversed-variance weighted (IVW) regression/Wald ratio, weighted median (WM), and MR-Egger regression. IVW regression was the primary approach used to derive causal estimates, where at least two exposure SNPs were available for analysis. Under the assumption of no horizontal pleiotropy, the IVW approach could generate an unbiased causal estimate [31]. The Wald ratio method was used when only one instrumental SNP was available for analysis. When the pleiotropy assumption was not satisfied, the WM method would have a lower bias but a higher type I error rate than the IVW method and would therefore be used to further verify the inference effects [31]. The MR-Egger test was used to assess horizontal pleiotropy. The intercept of MR-Egger represents the average horizontal pleiotropic effect across the exposure genetic instruments, where the slope of the regression was the casual estimate [32].
Multivariable Mendelian randomization (MVMR) analyses were conducted to account for potential confounding factors due to the possible genetic correlation of sex hormones, including estradiol, testosterone, DHEA-S, LH, and FSH [33]. Multivariable MR analysis could account for pleiotropy in a univariable MR analysis by including a set of covariates and could distinguish between the direct effects of the exposures on the outcome and the total effects inclusive of mediators, which cannot be accessed in the univariable MR analysis [34]. Multivariable lasso was used to perform MVMR analyses, as multivariable lasso is mostly a robust multivariate method, accounting for outliers and pleiotropy caused by invalid instruments [34]. After combining SNPs of sex hormones, we clumped SNPs for linkage disequilibrium r2 < 0.01 within a 1-Mb genomic distance, excluded overlapping SNPs, and removed SNPs lacking linkage information. The remaining SNPs were used for MVMR analysis. We also conducted MVMR in the reverse direction to account for possible confounding due to the genetic correlation of three types of COVID-19 on CNS-regulated hormones, showing evidence of univariable MR associations with at least one COVID-19 trait. For traits with insufficient SNPs (N ≤ 3) to perform MVMR analyses, genetic instruments were selected with a suggestive genome-wide significant p-value threshold (p < 1 × 10−5).
Sensitivity analyses were performed to verify the robustness of the results. Heterogeneity among the SNPs included in each analysis was examined using Cochran’s Q test. We used the MR-Egger regression intercept test and MR pleiotropy residual sum and outlier (MR-PRESSO) global test to check for horizontal pleiotropy. The MR-PRESSO method was used to check and correct for outliers [35]. I2GX statistic was used to examine the measurement error in the SNP-exposure association [36]. The strength of the selected SNPs was assessed by F-statistic [37] calculated using the total sample size, the number of SNPs used, and the proportion of variance explained.
The significance threshold was corrected for multiple testing with each MR analysis using the Bonferroni method (p-value < 0.05/number of exposures). In the sensitivity analysis, as the p-value evaluated the precision of the effect estimation and given the large number of statistical tests performed, we evaluated each result with a p-value < 0.05 individually by considering heterogeneity, pleiotropy, and removal of outliers. All data analyses were performed in R [38] using the TwoSampleMR [23], MendelianRandomization [39], and MR-PRESSO [35] packages.

3. Results

3.1. Forward MR Results: Impact of CNS-Regulated Hormones on COVID-19

3.1.1. Univariable MR Analysis Using CNS-Regulated Hormones as Exposures

As shown in Figure 1, genetically predicted DHEA-S concentrations were nominally associated with very severe respiratory syndrome (OR = 4.21, 95% CI: 1.41–12.59, p = 0.010). This means that each standard deviation increase in DHEA-S level would dramatically increase the odds of having very severe respiratory syndrome by 4.21-fold. Additionally, DHEA-S was significantly associated with hospitalization (OR = 2.31, 95% CI: 1.13–4.72, p = 0.021). Along with the insignificant but positive association between DHEA-S and susceptibility (OR = 0.94, 95% CI: 0.67–1.31, p = 0.703), the results showed a possible trend between DHEA-S and COVID-19; DHEA-S had an increased OR and significance level for the three COVID-19 phenotypes (susceptibility, hospitalization, and very severe respiratory syndrome). There was evidence of a negative association between LH level and very severe respiratory syndrome (OR = 0.83, 95% CI: 0.71–0.96, p = 0.013). In the susceptibility analysis, we did not find significant causal effects of CNS-regulated hormones on COVID-19 phenotypes (Table S3). The F statistics of all instrument variables were > 10, with the proportion of variance explained ranging from 0.069% to 17.879%, indicating the absence of weakness in the selected instruments (Table S2).

3.1.2. Multivariable MR Analysis with Sex Hormones

After adjusting for other sex hormones, genetically predicted DHEA-S was still significantly associated with an increased risk of very severe respiratory syndrome at a nominal significance level (OR = 3.72, 95% CI: 1.20–11.51, p = 0.023) (Table 1). Although the association between DHEA-S and hospitalization and susceptibility became insignificant, the trend matched what we found in the univariable analysis; DHEA-S had an increasing effect size and significance level as COVID-19 severity increased. In addition, the effect estimates of LH on very severe respiratory syndrome were invalidated by conditioning the genetic effects of other sex hormones. However, we observed significant associations between estradiol and very severe respiratory syndrome (OR = 0.09, 95% CI: 0.02–0.51, p = 0.006), hospitalization (OR = 0.25, 95% CI: 0.08–0.78, p = 0.016), and susceptibility (OR = 0.50, 95% CI: 0.28–0.89, p = 0.019). The different results of LH and estradiol levels between univariate and multivariable analyses indicated that sex hormones interacted with each other during COVID-19. Notably, estradiol consistently increased the effect size and significance level as COVID-19 severity decreased, as in the univariate analysis, which further supported progressive interactions with COVID-19. Other than estradiol and DHEA-S, we did not find any significant associations between CNS-regulated hormones and COVID-19. Meanwhile, in the MVMR analysis, hormones other than testosterone also exhibited a similar increasing OR trend as DHEA-S in the univariate analysis, suggesting possible progressive immune interactive mechanisms during COVID-19.

3.2. Reverse MR Results: Testing for Bidirectionality Using COVID-19 Traits as Exposures

We did not find evidence supporting reverse causality between DHEA and all three COVID-19 phenotypes. However, there was evidence of the promoting effects of very severe respiratory syndrome on IGF-1 (OR = 1.01, 95% CI: 1.00–1.02, p = 0.040), and susceptibility on testosterone (OR = 1.05, 95% CI: 1.03–1.06, p < 0.001) after outlier correction (Table S4).
In MVMR analysis, after adjusting for other COVID-19, very severe respiratory syndrome still had promoting effects on testosterone (OR = 1.11, 95% CI: 1.03–1.19, p = 0.003) and hospitalization was found to have significantly decreasing effects on testosterone (OR = 0.89, 95% CI: 0.84–0.94, p < 0.001) (Table S5).

3.3. Sensitivity Analysis

3.3.1. Test for Horizontal Pleiotropy

In univariate analysis with the COVID-19 phenotype as the outcome, the MR-Egger regression intercept test did not find any horizontal pleiotropy in the association between eight CNS-regulated hormones and three COVID-19 phenotypes (all p-values > 0.05) (Table S6). However, the MR-PRESSO global test suggested horizontal pleiotropy in the association of IGF-1 and testosterone with COVID-19 phenotypes (p-value < 0.05).
In the bidirectional analysis using CNS-regulated hormones as outcomes, there was no evidence of horizontal pleiotropy in any associations between COVID-19 and hormone traits using the MR-Egger regression intercept test (all p-values > 0.05). The MR-PRESSO global test suggested potential horizontal pleiotropy effects associated with very severe respiratory syndrome COVID-19 and susceptibility to IGF-1 and the three COVID-19 phenotypes with testosterone (all p-values < 0.05). Apart from IGF-1 and testosterone, no horizontal pleiotropy effect was found in either direction for any of the three COVID-19 phenotypes, which indicates the validity of the significant findings in the univariable MR analysis (Table S7).

3.3.2. Test for Heterogeneity of Instruments

As shown in Table S6, in the univariate analysis with COVID-19 severity as an outcome, heterogeneity was found in IGF-1 and testosterone estimates. Cochran’s Q test indicated heterogeneity in the association of IGF-1 with very severe respiratory syndrome (p = 0.001) and susceptibility (p = 0.007). Heterogeneity was only associated with very severe respiratory syndrome (p < 0.001).
For the analysis using COVID-19 as exposure, heterogeneity was found in the association among very severe respiratory syndrome, susceptibility, and IGF-1 and in the association between very severe respiratory syndrome and testosterone (p < 0.001 for all analyses) (Table S7).

3.3.3. Test for Measurement Error

In the analysis using COVID-19 severity as an outcome, only TSH was found to have a low I2GX statistic associated with COVID-19, which indicated a potential bias to MR-Egger estimators (Table S6).
In the analysis using very severe respiratory syndrome as exposure, only DHEA-S had an I2GX statistic > 0.900, which suggested that MR-Egger estimates of all other hormones could be biased by measurement errors (Table S7). We did not find any measurement errors in the hospitalization analysis based on the I2GX statistics. Like very severe respiratory syndrome, almost all the associations between susceptibility and hormones were biased by measurement errors, except for DHEA-S.

4. Discussion

4.1. Main Findings

Bidirectional two-sample MR analyses using large publicly available genomic datasets were used to analyze the causal association between the genetic liability of CNS-regulated hormones and COVID-19 susceptibility, hospitalization, and severity. We found strong evidence supporting the causal associations of DHEA and LH with very severe respiratory syndrome COVID-19 and the association of DHEA with hospitalization due to COVID-19. We did not find evidence supporting an association between CNS-regulated hormones and COVID-19 susceptibility. In MVMR analyses, we found evidence of a negative association between estradiol and COVID-19 susceptibility, hospitalization, and severity, adjusted for other sex-related hormones. In the reverse direction, we found that very severe respiratory syndrome was associated with IGF-1 levels, and COVID-19 susceptibility was associated with testosterone levels. Together with previous observational studies, we revealed possible causal associations between CNS-regulated hormones, especially sex hormones, and COVID-19 severity, suggesting the possibility of applying hormonal therapies to COVID-19 severe patients.
The effects of DHEA on COVID-19 are contradictory. On the one hand, DHEA can exert immunomodulatory and anti-inflammatory functions, which means that DHEA could have potential protective effects. Conversely, as a type of androgen, DHEA is suspected to be associated with an increased risk of COVID-19. Our analysis clearly indicated that DHEA is associated with an increased risk of COVID-19, especially the risk of very severe respiratory syndrome COVID-19. As mentioned before, DHEA, as a type of androgen, has regulatory effects on the ACE-2 receptor and TMPRSS2, promoting the fusion of the SARS-CoV-2 virus into host cells, thereby increasing the susceptibility and severity of COVID-19 [40,41]. Indeed, with its androgenic effect, DHEA also acts as a powerful inhibitor of glucose-6-phosphate dehydrogenase (G6PD) [42]. G6PD deficiency has been demonstrated to enhance cell infection with human coronavirus 229E (HCoV 229E) [43]. Considering that SARS-CoV-2 is also a human coronavirus, DHEA may greatly increase the risk of COVID-19 due to its inhibition of G6PD.
In contrast to androgens, estrogen is the main reason why the female immune system responds more efficiently to pathogens [44]. In the analysis, when adjusting for all other sex hormones, estrogen was found to have significantly decreasing effects on all types of COVID-19, which supports the possible protective effects of estrogen and indicates the potential for the implementation of hormonal therapy [45]. In fact, clinical trials are in progress to test the effect of additional estrogen on COVID-19 patients [46].
Moreover, the effects of DHEA and estrogen all displayed a progressively increasing effect size and significance level as the COVID-19 severity increased. Two possible mechanisms may play a role in this pattern. The first is the difference in viral load between severe and mild cases. A study of the viral load during COVID-19 reported that compared with mild cases, patients with severe COVID-19 tend to have higher viral loads [47]. Considering the effects of DHEA in enhancing the fusion of viruses into host cells, DHEA might result in a higher risk for people with higher viral loads than those with lower viral loads. Another possible explanation is the mechanism of COVID-19. The key factor affecting severity is cytokine storms. Estrogen has powerful anti-inflammatory effects due to its inhibition of proinflammatory cytokines such as IL-1β, IL-6, and others [48]. Meanwhile, estrogen has strong regulation effects on several aspects of metabolism, especially glucose metabolism [49]. Glucose metabolism dysregulation has been found to be associated with the severity of COVID-19 as viral replication depends on glucose [50]. Furthermore, the cytokine storm is also associated with the dysregulation in glucose metabolism, which contributes to the severity of COVID-19 [50]. A study also showed that severe cases have higher blood glucose levels compared with mild cases of COVID-19 [51]. As COVID-19 severity increases, uncontrolled immune responses produce more proinflammatory cytokines as well as increased glucose levels; therefore, the regulatory effect of estrogen becomes more powerful, which leads to increasing effect size and significance level. However, due to the regulatory effect of estrogen, hormonal therapy should be used carefully in patients with dysmetabolic conditions such as diabetes.
We did not find any association between testosterone and the three types of COVID-19. A recent MR study on serum testosterone and bioavailable testosterone found that only the bioavailable testosterone level was associated with a higher risk of hospitalization due to COVID-19, indicating that different forms of testosterone may have different effects on COVID-19 [11]. Indeed, we found the promoting effect of COVID-19 susceptibility on testosterone levels. Some studies have observed decreased testosterone levels in severe cases. However, other studies have also proposed that the inflammatory response caused by SARS-CoV-2 viruses may trigger testosterone secretion to initiate an anti-viral reaction considering the anti-inflammatory and immune-modulatory effects of testosterone [52,53,54]. In addition to testosterone levels, we also observed that COVID-19 severity was associated with increased levels of IGF-1. However, a phenome-wide association study [55] found that genetically determined severe COVID-19 was associated with lower IGF-1 levels. The contradiction of the results suggests that further studies and an understanding of IGF-1’s mechanisms and pathways are needed.

4.2. Additional Findings

Our findings also elucidate the possible interactive effects of sex hormones on COVID-19. We found significant effects of LH on very severe respiratory syndrome COVID-19. A recent COVID-19 case–control study involving 89 men with COVID-19 suggested that impaired testosterone in infected males may stimulate LH release to maintain testosterone levels based on negative-feedback regulation [53]. Analysis using COVID-19 as exposure indicated that COVID-19 was associated with increased testosterone levels. Combined with the anti-inflammatory function of testosterone, increased LH levels could decrease the risk of severe COVID-19. Another possible reason could be the interaction between LH and estradiol. Univariate analysis did not find a possible causal association between estradiol and COVID-19.
In contrast, after adjusting for other hormones in multivariable analysis, estradiol was found to be significantly negatively associated with all three types of COVID-19 with alterations in the effect direction and significance level of LH. LH is the upstream hormone of testosterone and estrogen, which controls the secretion and transformation of these hormones based on the negative-feedback loop. The true effect of LH may be influenced by both estrogen and testosterone levels.

4.3. Strengths and Limitations

The strengths of our study include the integration of univariate, multivariate, and bidirectional MR analyses using genetic instrument variables drawn from the largest GWASs to date. We also included a variety of CNS-regulated hormone levels and COVID-19 phenotypes. Furthermore, follow-up sensitivity analyses such as the MR-Egger intercept test, the Cochran’s Q test demonstrated the robustness of our findings. The F-statistic of the instrument variables also illustrated the strength of our selected SNPs. Finally, applying multivariable and univariable approaches is an advantage highlighted by the converging findings for COVID-19 phenotypes. We minimized the chances of population stratification between exposure datasets and outcome datasets by using GWAS of the European population for CNS-regulated hormones and by excluding the 23andMe cohort from COVID-19 datasets.
Our study has the following limitations. First, it is possible that the severity of COVID-19 and the immune response of patients were infected by different strains of COVID-19. Our study aimed to assess the general causal relationship between CNS-regulated hormones and COVID-19 instead of assessing the association with certain strains of COVID-19. Thus, we did not include the strain of COVID-19 in the study. Secondly, the selected genetic instruments generally explain a small to moderate proportion of the variance in exposure, although well within the typical ranges for complex traits [56]. Investigations of genetic variants associated with CNS-regulated hormones are needed. In addition, some exposures had only one or two SNPs, which were not suitable for sensitivity analyses. The use of weak genetic instruments may limit our ability to detect subtle, causal associations. However, the roughly similar pattern between univariate and multivariate analysis, and the high F-statistic, suggested the robustness and reliability of our results. Considering the possible sex effects, we used the UK Biobank sex-stratified data to assess the effects of testosterone, estrogen, IGF-1, and TSH on COVID-19. The results showed an effect direction consistent with that of the univariate two-sample MR analysis (Table S8).

5. Conclusions

In conclusion, our study found a possible causal association between CNS-regulated hormones and COVID-19. In contrast to previous observational studies focusing on a single hormone, such as testosterone or estrogen, our study was the first to use MR analysis to investigate the causal association between CNS-regulated hormones and COVID-19 severity, hospitalization, and susceptibility. We found that genetically predicted DHEA and LH had significant causal associations with COVID-19; and that significant effects of estrogen on COVID-19 were observed after adjusting for other hormones, supporting the feasibility of hormonal therapy for COVID-19. Future studies may need to be designed to further understand the mechanisms and pathways underlying the causal relationship between CNS-regulated hormones and COVID-19, with the goal of developing potential therapeutic strategies.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/jcm12041681/s1, Table S1: Information of data source and candidate genetic instruments [24]; Table S2: Estimated variance explained by SNPs and F statistics.; Table S3: MR analyses of CNS-regulated hormone SNPs and COVID-19 very severe respiratory syndromes, hospitalization, and susceptibility; Table S4: Bidirectional MR Analysis using COVID-19 very severe respiratory syndromes, hospitalization, and susceptibility as exposures; Table S5: MVMR analysis using COVID-19 as exposures; Table S6: Cochran Test of heterogeneity, Measurement Error test, and MRPRESSO Test for horizontal pleiotropy of forward direction MR analysis; Table S7: Cochran Test of heterogeneity, Measurement Error test and MRPRESSO Test for horizontal pleiotropy of bidirectional MR analysis; Table S8: MR analysis of associations of sex-stratified hormones with COVID-19 infections.

Author Contributions

Y.S. contributed to data analysis and drafted the manuscript. R.S. was responsible for the study conception, design, and revision of the paper. Z.D., Y.G. and J.Y. contributed to the interpretation of results. C.Z. and Y.P. contributed to the study design. All authors have read and agreed to the published version of the manuscript.

Funding

This study is supported by the Research Start-up Fund of the Seventh Affiliated Hospital, Sun Yat-sen University (Grant No. 392016).

Institutional Review Board Statement

The requirement for ethical review and approval was waived because the study analyzed public databases.

Informed Consent Statement

The requirement for informed consent was waived because the study analyzed public databases.

Data Availability Statement

GWAS summary data of seven hormone traits are available in the IEU open GWAS project (Accessed 2 December 2021; https://gwas.mrcieu.ac.uk/) with GWAS ID as ukb-d-30770_irnt for IGF-1, ukb-d-30800_irnt for Estradiol, ukb-d-30850_irnt for Testosterone, met-a-478 for DHEA-S, prot-a-3102 for TRH, prot-a-529 for LH, and prot-c-3032_11_2 for FSH. GWAS summary data of TSH are collected in a GWAS meta-analysis of thyroid-related traits (20). Summary statistics (release 5) of GWAS meta-analysis for the three COVID-19 phenotypes are available in the COVID-19 Host Genetics Initiative (HGI) at https://www.COVID19hg.org/results/r5/ (Accessed 2 December 2021).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. WHO COVID-19 Dashboard; World Health Organization: Geneva, Switzerland, 2020.
  2. Wu, Z.; McGoogan, J.M. Characteristics of and important lessons from the coronavirus disease 2019 (COVID-19) outbreak in China: Summary of a report of 72,314 cases from the Chinese Center for Disease Control and Prevention. JAMA 2020, 323, 1239–1242. [Google Scholar] [CrossRef] [PubMed]
  3. Team, E. The epidemiological characteristics of an outbreak of 2019 novel coronavirus diseases (COVID-19)—China, 2020. China CDC Wkly. 2020, 2, 113. [Google Scholar] [CrossRef]
  4. Yang, L.; Liu, S.; Liu, J.; Zhang, Z.; Wan, X.; Huang, B.; Chen, Y.; Zhang, Y. COVID-19: Immunopathogenesis and Immunotherapeutics. Signal Transduct. Target. Ther. 2020, 5, 128. [Google Scholar] [CrossRef] [PubMed]
  5. Lopez Bernal, J.; Andrews, N.; Gower, C.; Gallagher, E.; Simmons, R.; Thelwall, S.; Stowe, J.; Tessier, E.; Groves, N.; Dabrera, G. Effectiveness of COVID-19 vaccines against the B. 1.617. 2 (Delta) variant. N. Engl. J. Med. 2021, 385, 585–594. [Google Scholar] [CrossRef] [PubMed]
  6. Jin, J.M.; Bai, P.; He, W.; Wu, F.; Liu, X.F.; Han, D.M.; Liu, S.; Yang, J.K. Gender Differences in Patients With COVID-19: Focus on Severity and Mortality. Front. Public Health 2020, 8, 152. [Google Scholar] [CrossRef]
  7. Papadopoulos, V.; Li, L.; Samplaski, M. Why does COVID-19 kill more elderly men than women? Is there a role for testosterone? Andrology 2021, 9, 65–72. [Google Scholar] [CrossRef]
  8. Costanzo, M.; Caterino, M.; Sotgiu, G.; Ruoppolo, M.; Franconi, F.; Campesi, I. Sex differences in the human metabolome. Biol. Sex Differ. 2022, 13, 30. [Google Scholar] [CrossRef]
  9. Nyce, J. Alert to US physicians: DHEA, widely used as an OTC androgen supplement, may exacerbate COVID-19. Endocr.-Relat. Cancer 2021, 28, R47–R53. [Google Scholar] [CrossRef]
  10. Bhowmick, N.A.; Oft, J.; Dorff, T.; Pal, S.; Agarwal, N.; Figlin, R.A.; Posadas, E.M.; Freedland, S.J.; Gong, J. COVID-19 and androgen-targeted therapy for prostate cancer patients. Endocr. Relat. Cancer 2020, 27, R281–R292. [Google Scholar] [CrossRef]
  11. Liu, L.; Fan, X.; Guan, Q.; Yu, C. Bioavailable testosterone level is associated with COVID-19 severity in female: A sex-stratified Mendelian randomization study. J. Infect. 2022, 85, 174–211. [Google Scholar] [CrossRef]
  12. Seeland, U.; Coluzzi, F.; Simmaco, M.; Mura, C.; Bourne, P.E.; Heiland, M.; Preissner, R.; Preissner, S. Evidence for treatment with estradiol for women with SARS-CoV-2 infection. BMC Med. 2020, 18, 369. [Google Scholar] [CrossRef] [PubMed]
  13. Ilias, I.; Diamantopoulos, A.; Botoula, E.; Athanasiou, N.; Zacharis, A.; Tsipilis, S.; Jahaj, E.; Vassiliou, A.G.; Vassiliadi, D.A.; Kotanidou, A.; et al. Covid-19 and Growth Hormone/Insulin-Like Growth Factor 1: Study in Critically and Non-Critically Ill Patients. Front. Endocrinol. 2021, 12, 644055. [Google Scholar] [CrossRef] [PubMed]
  14. Vaez Mahdavi, M.R.; Kaboudanian Ardestani, S.; Rezaei, A.; Mohammadi, S.; Rajabnia Chenary, M.; Gharegozlou, B.; Naghizadeh, M.M.; Ghazanfari, T. COVID-19 patients suffer from DHEA-S sufficiency. Immunoregulation 2020, 3, 135–144. [Google Scholar] [CrossRef]
  15. Beltrame, A.; Salguero, P.; Rossi, E.; Conesa, A.; Moro, L.; Bettini, L.R.; Rizzi, E.; D’Angió, M.; Deiana, M.; Piubelli, C. Association between Sex Hormone Levels and Clinical Outcomes in Patients with COVID-19 Admitted to Hospital: An Observational, Retrospective, Cohort Study. Front. Immunol. 2022, 13, 834851. [Google Scholar] [CrossRef]
  16. Wang, W.; Su, X.; Ding, Y.; Fan, W.; Zhou, W.; Su, J.; Chen, Z.; Zhao, H.; Xu, K.; Ni, Q.; et al. Thyroid Function Abnormalities in COVID-19 Patients. Front. Endocrinol. 2020, 11, 623792. [Google Scholar] [CrossRef]
  17. Schuemie, M.J.; Ryan, P.B.; Hripcsak, G.; Madigan, D.; Suchard, M.A. Improving reproducibility by using high-throughput observational studies with empirical calibration. Philos. Trans. R. Soc. A Math. Phys. Eng. Sci. 2018, 376, 20170356. [Google Scholar] [CrossRef] [Green Version]
  18. Smith, G.D. Mendelian randomization for strengthening causal inference in observational studies: Application to gene× environment interactions. Perspect. Psychol. Sci. 2010, 5, 527–545. [Google Scholar] [CrossRef]
  19. Amazeen, M.A.; Krishna, A.; Eschmann, R. Cutting the bunk: Comparing the solo and aggregate effects of prebunking and debunking COVID-19 vaccine misinformation. Sci. Commun. 2022, 44, 387–417. [Google Scholar] [CrossRef]
  20. Whitaker, H.J.; Tsang, R.S.; Byford, R.; Andrews, N.J.; Sherlock, J.; Pillai, P.S.; Williams, J.; Button, E.; Campbell, H.; Sinnathamby, M. Pfizer-BioNTech and Oxford AstraZeneca COVID-19 vaccine effectiveness and immune response amongst individuals in clinical risk groups. J. Infect. 2022, 84, 675–683. [Google Scholar] [CrossRef]
  21. Jain, S.; Venkataraman, A.; Wechsler, M.E.; Peppas, N.A. Messenger RNA-based vaccines: Past, present, and future directions in the context of the COVID-19 pandemic. Adv. Drug Deliv. Rev. 2021, 179, 114000. [Google Scholar] [CrossRef]
  22. Elsworth, B.; Lyon, M.; Alexander, T.; Liu, Y.; Matthews, P.; Hallett, J.; Bates, P.; Palmer, T.; Haberland, V.; Smith, G.D. The MRC IEU OpenGWAS data infrastructure. BioRxiv 2020. [Google Scholar] [CrossRef]
  23. Hemani, G.; Zheng, J.; Elsworth, B.; Wade, K.H.; Haberland, V.; Baird, D.; Laurin, C.; Burgess, S.; Bowden, J.; Langdon, R.; et al. The MR-Base platform supports systematic causal inference across the human phenome. Elife 2018, 7, e34408. [Google Scholar] [CrossRef] [PubMed]
  24. Porcu, E.; Medici, M.; Pistis, G.; Volpato, C.B.; Wilson, S.G.; Cappola, A.R.; Bos, S.D.; Deelen, J.; den Heijer, M.; Freathy, R.M.; et al. A meta-analysis of thyroid-related traits reveals novel loci and gender-specific differences in the regulation of thyroid function. PLoS Genet 2013, 9, e1003266. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  25. Bos, M.M.; Smit, R.A.J.; Trompet, S.; van Heemst, D.; Noordam, R. Thyroid Signaling, Insulin Resistance, and 2 Diabetes Mellitus: A Mendelian Randomization Study. J. Clin. Endocrinol. Metab. 2017, 102, 1960–1970. [Google Scholar] [CrossRef] [PubMed]
  26. Salole, E.G. Estradiol. In Analytical Profiles of Drug Substances; Elsevier: Amsterdam, The Netherlands, 1986; Volume 15, pp. 283–318. [Google Scholar]
  27. Prough, R.A.; Clark, B.J.; Klinge, C.M. Novel mechanisms for DHEA action. J. Mol. Endocrinol. 2016, 56, R139–R155. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  28. Initiative, C.-H.G. The COVID-19 host genetics initiative, a global initiative to elucidate the role of host genetic factors in susceptibility and severity of the SARS-CoV-2 virus pandemic. Eur. J. Hum. Genet. 2020, 28, 715. [Google Scholar] [CrossRef] [PubMed]
  29. Purcell, S.; Neale, B.; Todd-Brown, K.; Thomas, L.; Ferreira, M.A.; Bender, D.; Maller, J.; Sklar, P.; de Bakker, P.I.; Daly, M.J.; et al. PLINK: A tool set for whole-genome association and population-based linkage analyses. Am. J. Hum. Genet. 2007, 81, 559–575. [Google Scholar] [CrossRef] [Green Version]
  30. Shim, H.; Chasman, D.I.; Smith, J.D.; Mora, S.; Ridker, P.M.; Nickerson, D.A.; Krauss, R.M.; Stephens, M. A multivariate genome-wide association analysis of 10 LDL subfractions, and their response to statin treatment, in 1868 Caucasians. PLoS ONE 2015, 10, e0120758. [Google Scholar] [CrossRef] [Green Version]
  31. Burgess, S.; Foley, C.N.; Allara, E.; Staley, J.R.; Howson, J.M.M. A robust and efficient method for Mendelian randomization with hundreds of genetic variants. Nat. Commun. 2020, 11, 376. [Google Scholar] [CrossRef] [Green Version]
  32. Bowden, J.; Davey Smith, G.; Burgess, S. Mendelian randomization with invalid instruments: Effect estimation and bias detection through Egger regression. Int. J. Epidemiol. 2015, 44, 512–525. [Google Scholar] [CrossRef] [Green Version]
  33. Burgess, S.; Thompson, S.G. Multivariable Mendelian randomization: The use of pleiotropic genetic variants to estimate causal effects. Am. J. Epidemiol. 2015, 181, 251–260. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  34. Grant, A.J.; Burgess, S. Pleiotropy robust methods for multivariable Mendelian randomization. Stat. Med. 2021, 40, 5813–5830. [Google Scholar] [CrossRef] [PubMed]
  35. Verbanck, M.; Chen, C.-Y.; Neale, B.; Do, R. Detection of widespread horizontal pleiotropy in causal relationships inferred from Mendelian randomization between complex traits and diseases. Nat. Genet. 2018, 50, 693–698. [Google Scholar] [CrossRef]
  36. Bowden, J.; Del Greco M, F.; Minelli, C.; Davey Smith, G.; Sheehan, N.A.; Thompson, J.R. Assessing the suitability of summary data for two-sample Mendelian randomization analyses using MR-Egger regression: The role of the I2 statistic. Int. J. Epidemiol. 2016, 45, 1961–1974. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  37. Pierce, B.L.; Ahsan, H.; Vanderweele, T.J. Power and instrument strength requirements for Mendelian randomization studies using multiple genetic variants. Int. J. Epidemiol. 2011, 40, 740–752. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  38. Team, R.C. R: A Language and Environment for Statistical Computing; R Core Team: Vienna, Austria, 2013. [Google Scholar]
  39. Yavorska, O.O.; Burgess, S. MendelianRandomization: An R package for performing Mendelian randomization analyses using summarized data. Int. J. Epidemiol. 2017, 46, 1734–1739. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  40. Samuel, R.M.; Majd, H.; Richter, M.N.; Ghazizadeh, Z.; Zekavat, S.M.; Navickas, A.; Ramirez, J.T.; Asgharian, H.; Simoneau, C.R.; Bonser, L.R. Androgen signaling regulates SARS-CoV-2 receptor levels and is associated with severe COVID-19 symptoms in men. Cell Stem Cell 2020, 27, 876–889.e812. [Google Scholar] [CrossRef] [PubMed]
  41. Clinckemalie, L.; Spans, L.; Dubois, V.; Laurent, M.; Helsen, C.; Joniau, S.; Claessens, F. Androgen regulation of the TMPRSS2 gene and the effect of a SNP in an androgen response element. Mol. Endocrinol. 2013, 27, 2028–2040. [Google Scholar] [CrossRef] [PubMed]
  42. Gordon, G.; Mackow, M.C.; Levy, H.R. On the mechanism of interaction of steroids with human glucose 6-phosphate dehydrogenase. Arch. Biochem. Biophys. 1995, 318, 25–29. [Google Scholar] [CrossRef]
  43. Vick, D.J. Glucose-6-phosphate dehydrogenase deficiency and COVID-19 infection. Mayo Clin. Proc. 2020, 95, 1803–1804. [Google Scholar] [CrossRef]
  44. Al-Lami, R.A.; Urban, R.J.; Volpi, E.; Algburi, A.M.; Baillargeon, J. Sex hormones and novel corona virus infectious disease (COVID-19). Mayo Clin. Proc. 2020, 95, 1710–1714. [Google Scholar] [CrossRef]
  45. Bennink, H.J.C.; Foidart, J.-M.; Debruyne, F.M. Treatment of serious COVID-19 with testosterone suppression and high-dose estrogen therapy. Eur. Urol. 2021, 80, 523. [Google Scholar] [CrossRef]
  46. Tulane University. Estradiol and Progesterone in Hospitalized COVID-19 Patients. Available online: https://ClinicalTrials.gov/show/NCT04865029 (accessed on 26 July 2022).
  47. Liu, Y.; Yan, L.M.; Wan, L.; Xiang, T.X.; Le, A.; Liu, J.M.; Peiris, M.; Poon, L.L.M.; Zhang, W. Viral dynamics in mild and severe cases of COVID-19. Lancet Infect Dis 2020, 20, 656–657. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  48. Al-Kuraishy, H.M.; Al-Gareeb, A.I.; Faidah, H.; Al-Maiahy, T.J.; Cruz-Martins, N.; Batiha, G.E.-S. The looming effects of estrogen in COVID-19: A rocky rollout. Front. Nutr. 2021, 8, 649128. [Google Scholar] [CrossRef] [PubMed]
  49. Faulds, M.H.; Zhao, C.; Dahlman-Wright, K.; Gustafsson, J.-Å. The diversity of sex steroid action: Regulation of metabolism by estrogen signaling. J. Endocrinol. 2012, 212, 3–12. [Google Scholar] [CrossRef]
  50. Ardestani, A.; Azizi, Z. Targeting glucose metabolism for treatment of COVID-19. Signal Transduct. Target. Ther. 2021, 6, 112. [Google Scholar] [CrossRef] [PubMed]
  51. He, B.; Wang, J.; Wang, Y.; Zhao, J.; Huang, J.; Tian, Y.; Yang, C.; Zhang, H.; Zhang, M.; Gu, L. The metabolic changes and immune profiles in patients with COVID-19. Front. Immunol. 2020, 11, 2075. [Google Scholar] [CrossRef]
  52. Rastrelli, G.; Di Stasi, V.; Inglese, F.; Beccaria, M.; Garuti, M.; Di Costanzo, D.; Spreafico, F.; Greco, G.F.; Cervi, G.; Pecoriello, A.; et al. Low testosterone levels predict clinical adverse outcomes in SARS-CoV-2 pneumonia patients. Andrology 2021, 9, 88–98. [Google Scholar] [CrossRef]
  53. Kadihasanoglu, M.; Aktas, S.; Yardimci, E.; Aral, H.; Kadioglu, A. SARS-CoV-2 pneumonia affects male reproductive hormone levels: A prospective, cohort study. J. Sex. Med. 2021, 18, 256–264. [Google Scholar] [CrossRef]
  54. Younis, J.S.; Skorecki, K.; Abassi, Z. The Double Edge Sword of Testosterone’s Role in the COVID-19 Pandemic. Front. Endocrinol. 2021, 12, 607179. [Google Scholar] [CrossRef]
  55. Papadopoulou, A.; Musa, H.; Sivaganesan, M.; McCoy, D.; Deloukas, P.; Marouli, E. COVID-19 susceptibility variants associate with blood clots, thrombophlebitis and circulatory diseases. PLoS ONE 2021, 16, e0256988. [Google Scholar] [CrossRef] [PubMed]
  56. Brion, M.J.; Shakhbazov, K.; Visscher, P.M. Calculating statistical power in Mendelian randomization studies. Int. J. Epidemiol. 2013, 42, 1497–1501. [Google Scholar] [CrossRef] [PubMed] [Green Version]
Figure 1. MR analyses the association of CNS-regulated Hormones and COVID-19 phenotypes.
Figure 1. MR analyses the association of CNS-regulated Hormones and COVID-19 phenotypes.
Jcm 12 01681 g001
Table 1. MVMR analysis of CNS-regulated hormone SNPs and COVID-19 severity and susceptibility.
Table 1. MVMR analysis of CNS-regulated hormone SNPs and COVID-19 severity and susceptibility.
Very Severe Respiratory SyndromeHospitalizationSusceptibility
ExposureOR (95% CI)p-ValueOR (95% CI)p-ValueOR (95% CI)p-Value
DHEA-S3.72 (1.20–11.51)0.0231.69 (0.83–3.42)0.1440.94 (0.67–1.31)0.703
Estradiol0.09 (0.02–0.51)0.0060.25 (0.08–0.78)0.0160.50 (0.28–0.89)0.019
LH1.23 (0.81–1.86)0.3431.16 (0.88–1.52)0.2961.08 (0.94–1.24)0.251
FSH1.11 (0.84–1.48)0.4641.03 (0.85–1.24)0.7511.00 (0.91–1.10)0.947
Testosterone0.42 (0.17–1.03)0.0580.74 (0.41–1.33)0.3120.76 (0.56–1.02)0.067
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Sun, Y.; Ding, Z.; Guo, Y.; Yuan, J.; Zhu, C.; Pan, Y.; Sun, R. Causal Inference of Central Nervous System-Regulated Hormones in COVID-19: A Bidirectional Two-Sample Mendelian Randomization Study. J. Clin. Med. 2023, 12, 1681. https://doi.org/10.3390/jcm12041681

AMA Style

Sun Y, Ding Z, Guo Y, Yuan J, Zhu C, Pan Y, Sun R. Causal Inference of Central Nervous System-Regulated Hormones in COVID-19: A Bidirectional Two-Sample Mendelian Randomization Study. Journal of Clinical Medicine. 2023; 12(4):1681. https://doi.org/10.3390/jcm12041681

Chicago/Turabian Style

Sun, Yuxuan, Ziyi Ding, Yawei Guo, Jinqiu Yuan, Chengming Zhu, Yihang Pan, and Rui Sun. 2023. "Causal Inference of Central Nervous System-Regulated Hormones in COVID-19: A Bidirectional Two-Sample Mendelian Randomization Study" Journal of Clinical Medicine 12, no. 4: 1681. https://doi.org/10.3390/jcm12041681

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop