Next Article in Journal
Frontal Fibrosing Alopecia Quality of Life Index: A Validated Disease-Specific Questionnaire Involving Women
Next Article in Special Issue
The Development and Effect of Systemic Hypertension on Clinical and Radiological Outcome in Adult Moyamoya Angiopathy Following Revascularization Surgery: Experience of a Single European Institution
Previous Article in Journal
Does Age Influence the Preoperative Condition and, Thus, the Outcome in Endocarditis Patients?
Previous Article in Special Issue
Clinical Outcome, Cognition, and Cerebrovascular Reactivity after Surgical Treatment for Moyamoya Vasculopathy: A Dutch Prospective, Single-Center Cohort Study
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
JCM
Volume 12
Issue 3
10.3390/jcm12030823
jcm-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Circulating Inflammatory Cytokine Associated with Poor Prognosis in Moyamoya Disease: A Prospective Cohort Study

by
Wei Liu
1,†,
Jian Sun
1,2,†,
Zhiyong Shi
1,
Zheng Huang
1,
Lebao Yu
1,
Haibin Du
1,2,
Peicong Ge
1,*,‡ and
Dong Zhang
1,*,‡
1
Department of Neurosurgery, Beijing Tiantan Hospital, Capital Medical University, Beijing 100070, China
2
Department of Neurosurgery, Beijing Changping District Hospital, Beijing 100071, China
*
Authors to whom correspondence should be addressed.
†
These authors contributed equally to this work and share first authorship.
‡
These authors contributed equally to this work and share last authorship.
J. Clin. Med. 2023, 12(3), 823; https://doi.org/10.3390/jcm12030823
Submission received: 30 November 2022 / Revised: 7 January 2023 / Accepted: 18 January 2023 / Published: 19 January 2023
(This article belongs to the Special Issue Diagnosis and Treatment of Moyamoya Disease)
Browse Figures
Review Reports Versions Notes

Abstract

:
Inflammation is a key factor in the development of moyamoya disease. However, the cytokine distribution in moyamoya disease and its impact on prognosis remain unclear. A total of 204 patients with moyamoya disease were enrolled in this study. The peripheral blood was analyzed for baseline data and cytokines, which included IL-6, IL-1β, IL-2R, IL-8, and TNF-α. Patients with the RNF213 mutation and those without the mutation were compared in terms of their differences in cytokines. A mRS score ≥ 2 was defined as a poor prognosis, and a mRS score < 2 was described as a good prognosis, and differences in cytokines were compared between the two groups. Regression analysis was performed to identify markers affecting prognosis. TNF-α and IL-6 levels were higher in the group without the RNF213 mutation compared to the mutation group. Multivariate stepwise regression analysis indicated that the G3 subgroup of IL-6 and the G4 subgroup of TNF-α were the independent risk factors for adverse prognosis in adults with moyamoya disease (OR 3.678, 95% CI [1.491, 9.074], p = 0.005; OR 2.996, 95% CI [1.180, 7.610], p = 0.021). IL-6 and TNF-α were associated with poor prognosis in adult patients with moyamoya disease.

1. Introduction

Moyamoya disease (MMD) is a rare progressive cerebrovascular disease that is mainly characterized by progressive stenosis and occlusion at the ends of the bilateral internal carotid arteries and Willis rings [1,2], resulting in the creation of abnormal collateral vessels at the base of the brain, with the compensatory abnormal vascular network, the so-called ‘moyamoya vessels’ [3]. MMD was first defined by Suzuki and Takahisa in Japan in 1969, with a high prevalence rate in East Asian populations and an incidence rate of 0.94/100,000 person-years in the Japanese population [4]. According to recent studies, the incidence of MMD in mainland Chinese populations is 1.14 per 100,000 person-years [5]. This value is lower in Europe and the United States, where the incidence of moyamoya disease is 0.07/100,000 person-years in Europe and 0.293/100,000 person-years in the United States [6,7]. However, the incidence of moyamoya disease in various places shows an increasing trend year by year.
Various physiological and biochemical processes are regulated by inflammation. Previous studies have shown that inflammation is closely related to the incidence and progression of MMD [8,9,10]. Several cytokines are elevated in MMD compared to normal subjects, including IL-17, TNF-α, IL-6, and IL-23 [11]. However, the prognostic impact of cytokines in MMD remains unclear. The routine measurement of inflammatory markers to predict functional outcomes in MMD is not yet recommended by updated guidelines, and there are limited data available on the prognostic contribution of inflammatory co-markers in MMD.
Ring finger protein 213 (RNF213), an E3 ubiquitin ligase, is reported to be a susceptibility gene for MMD. The p.R4810 k mutation in RNF213 is the prevalent variant in East Asian MMD patients [12,13]. Previous studies have shown that the transcription of RNF213 is regulated by cytokines [14,15], yet the linkage between polymorphisms in RNF213 and cytokines remains unclear in clinical practice.
We collected blood samples from patients with MMD from Beijing Tiantan Hospital, Capital Medical University, to identify inflammatory markers that can predict the functional prognosis of MMD and facilitate early identification and assessment of high-risk patients. In addition to establishing the role of cytokines, the RNF213 mutation was also studied, and its relation to the distribution of cytokines was evaluated in MMD.

2. Methods

2.1. Study Design and Subjects

We consecutively collected 259 patients with MMD who visited Beijing Tiantan Hospital, all of whom had undergone digital subtraction angiography (DSA) and whose diagnosis followed the updated guidelines for managing MMD. We excluded 48 pediatric patients, 7 patients aged >60 years. Finally, 204 patients with MMD were enrolled in the current study. The inclusion and exclusion criteria followed are shown in Supplementary Figure S1. The laboratory testing department at Beijing Tiantan Hospital verified that all the cytokine data were of clinical diagnostic significance. The primary outcome was a poor functional outcome at post-operative discharge, defined as a mRS score ≥ 2 [16]. This study was approved by the Ethics Committee of Beijing Tiantan Hospital. A documented informed consent agreement has been signed by all patients.

2.2. Clinical Data Collection

We collected risk factors that may be associated with prognosis in MMD, including demographic data, medical history, clinical features, modified Rankin Scale (mRS) score, imaging findings, and laboratory tests. Demographic information included age and gender. Hypertension (self-declared history of hypertension, or use of any BP-lowering medication, with a systolic blood pressure ≥ 140 mmHg or diastolic blood pressure ≥ 90 mmHg), diabetes (self-declared history of diabetes, or use of any glucose-lowering medication, with any fasting blood glucose level ≥ 7.0 mmol/L) and hyperlipidemia (self-declared history of hyperlipidemia, or use of any lipid-lowering medication, with LDL cholesterol ≥ 3.37 mmol/L, HDL cholesterol < 1.04 mmol/L, triglycerides ≥ 1.7 mmol/L, or total cholesterol ≥ 5.17 mmol/L) were considered as medical history. Clinical features were summarized as symptom manifestations, surgical approach, and body mass index (BMI). The Suzuki stage was judged by DSA on the surgical side. The side with the highest bilateral Suzuki stage was taken to represent the patient’s total Suzuki stage. According to the Suzuki stage, stages 0–3 are defined as the early stages, and stages 4–6 are defined as the late stages. Laboratory test data included white blood cell count (WBC), red blood cell count (RBC), hemoglobin concentration (HGB), platelet count (PLT), urea, uric acid (UA), triglyceride (TG), total cholesterol (CHO), and homocysteine (Hcy).
Blood samples were collected from the 166 patients mentioned above after written informed consent was obtained. Genomic DNA was extracted from 166 patients using the QIA amp blood kit (QIAGEN, Hilden, Germany). Primers were designed as follows: RNF213–4810F(rs112735431):5′-GCCCCTCTAGCACAC-3′; and RNF213–4810R: 5′-AGCTGTGGCGAAAGCTTCTA-3′. In total, 36 patients with the RNF213 rare variant p.R4810 k (rs112735431) were found in the 166 sequenced patients.

2.3. Statistical Analysis

IL-6 and TNF-α were divided into two groups, normal and high, according to their in-human normal value criteria (3.40 and 8.10 pg/mL, respectively). These criteria were formulated by the Clinical Laboratory Department of Beijing Tiantan Hospital with clinical diagnostic significance. Within the normal and high groups, the groups were further divided into two groups according to the median. IL-6: group 1 (G1): ≤2.00 pg/mL; group 2 (G2): 2.00–3.40 pg/mL; group 3 (G3): 3.40–4.83 pg/mL; group 4 (G4): >4.83 pg/mL. TNF-α: group 1 (G1): ≤6.24 pg/mL; group 2 (G2): 6.24–8.10 pg/mL; group 3 (G3): 8.10–9.26 pg/mL; group 4 (G4): >9.26 pg/mL. IL-1β was divided into a normal group (0–5.00 pg/mL) and a high group (>5.00 pg/mL) according to the level of normal values.
Statistical analysis was performed using SPSS (version 26.0, IBM, Armonk, NY, USA). To analyze the relationship between the p.R4810K mutation in RNF213 with cytokines, the raw baseline was assessed using t-tests for continuous variables and chi-square tests for categorical variables. To evaluate the relationship between cytokines and prognosis, we performed univariate and multifactorial regression analysis on cytokines and other confounding factors. We performed three regression models to assess risk factors for poor outcomes in moyamoya disease patients: the crude model was the unadjusted model. Model 1 adjusted for sex and age. Model 2 further adjusted for hypertension, hyperlipidemia, diabetes, Image stage, white blood cell count, hemoglobin, triglycerides, total cholesterol, Hcy, BMI, and surgical approach [7]. Unadjusted and adjusted risk ratios (OR) and their 95% confidence intervals (CI) were calculated. Receiver operating characteristic (ROC) curve analysis was performed to evaluate the utility of a continuous biomarker. The choice of cut-off point in the ROC curve analysis is based on the maximum value of the Uden index.

3. Results

3.1. Baseline Characteristics

Baseline characteristics of subjects grouped according to prognosis are shown in Table 1. A cohort of 204 patients with MMD was enrolled: 81 men and 123 women, with a median age of 44 years. There were 101 patients in the group with a mRS score < 2 and 103 patients with a mRS score ≥ 2. Compared to those in the group with mRS scores < 2, patients in the group with mRS scores ≥ 2 were older (p < 0.001), more patients presented with bilateral MMD (92.233% vs. 83.168%, p < 0.05), and a higher proportion had hypertension (43.689% vs. 22.772%, p < 0.05). IL-6 levels differed between the two groups (p < 0.05). A comparative analysis was performed, and a statistical difference between IL-6 and TNF-α among diabetics and non-diabetics was found. The results showed that the diabetic group had higher IL-6 levels than the non-diabetic group (5.785 ± 6.837 vs. 2.904 ± 2.650 pg/mL, p < 0.05). There were no significant differences observed in other clinical features, including sex, image stage, history of diabetes mellitus, hyperlipidemia, clinical manifestation, body mass index, IL-1β, IL-2R, IL-8, and other laboratory results. The differences between the above-mentioned inflammatory factors and between the diabetic and non-diabetic groups are shown in Figure 1 and Supplementary Table S1.

3.2. Higher TNF-α and IL-6 Levels in the p.R4810K Variant of RNF213

The enrolled patients were divided into mutation and no mutation groups based on the presence of the p.R4810 k mutation in RNF213. Analysis of TNF-α and IL-6 as continuous variables showed higher levels of IL-6 in the no mutation group compared to the mutation group (3.437 ± 3.098 vs. 2.496 ± 1.460, p < 0.05). When investigating TNF-α and IL-6 in groups, statistical analysis showed that a higher proportion of the patients in the no-mutation group had high TNF-α values compared to the mutation group (26.05% vs. 10.64%, p < 0.05). Other cytokine levels were not significantly different between the two groups. The differences in IL-6 and TNF-α in the mutant and non-mutant groups are shown in Figure 2 and Supplementary Table S2.

3.3. IL-6 and TNF-α Are Associated with Poor Functional Prognosis after Surgery for Adult MMD

Inflammatory factors were analyzed in univariate regression along with other factors that may affect the prognosis of MMD. Univariate logistic regression analysis revealed that IL-6 and TNF-α subgroups were associated with an increased risk of poor functional outcome after surgery in adults with MMD. In the G3 subgroup of IL-6 and the G4 subgroup of TNF-α, the risk of poor prognosis of MMD was higher than that of the G1 subgroup. (OR 3.678, 95% CI [1.491, 9.074], p = 0.005; OR 2.996, 95% CI [1.180, 7.610], p = 0.021). Univariate logistic regression analysis showed that advanced age (OR 1.081, 95%CI [1.047, 1.116], p < 0.001) and hypertension (OR 2.631, 95%CI [1.435, 4.826], p < 0.05) Risk factors for poor functional outcome after MMD surgery. The specific univariate logistic regression analysis results are shown in Supplementary Table S3.
Trend regression analysis showed that with the increase in TNF-α level in blood, the risk of poor prognosis in MMD patients gradually increased, with a significant trend (P for trend = 0.013). After adjusting more confounding factors by multivariate logistic regression analysis, the results showed that the G4 subgroup of TNF-α and the G3 subgroup of IL-6 were independent risk factors for poor functional prognosis in MMD (OR 4.626, 95% CI [1.493, 14.337], p = 0.008; OR 4.794, 95% CI 4.794, p = 0.004). The results of the stepwise regression analysis are shown in Table 2. The ROC curve showed that compared with the Crude model and model 1, the predictive value of model 2 for the poor prognosis of MMD was always significantly improved. (AUCs of TNF-α were 0.609, 0.724, 0.743; AUCs of IL-6 were 0.569, 0.713, 0.735). The risk forest plot and stepwise regression ROC curve of TNF-α and IL-6 levels and MMD prognosis are shown in Figure 3. By separately incorporating IL-6 and TNF-α, ROC curve analysis showed that TNF-α levels; 6.620 ng/mL could predict adverse functional outcomes in adults with MMD, with a sensitivity of 64.1%, a specificity of 56.4%, and an area under the curve is 0.609. The combination of TNF-α and IL-6 did not increase the predictive power of the model. The results of the ROC analysis are shown in Figure 4.
The crude model was the unadjusted model. Model 1 adjusted for sex and age. Model 2 further adjusted for hypertension, hyperlipidemia, diabetes, Image stage, white blood cell count, hemoglobin, triglycerides, total cholesterol, Hcy, BMI, and surgical approach.

4. Discussion

Our cohort study analyzed multiple cytokines to demonstrate the comprehensive role of cytokines in MMD. Rather than exploring the relationship between inflammation and the pathogenesis of MMD, as in previous studies, the focus of the present study was on the impact of inflammation on the prognosis of MMD. Our study shows that the severity of systemic inflammation affects functional outcomes in MMD. The prognostic marker of inflammation identified in the current study was TNF-α, which at pre-operative blood levels of >9.24 pg/mL, was significantly associated with an increased risk of adverse functional outcomes after surgery and was an independent risk factor for poor prognosis in MMD. Our study demonstrates the relationship between RNF213 polymorphism and cytokine levels in MMD patients. TNF-α and IL-6 in patients without p.R4810K mutation of RNF213 were higher than those in the mutation group. The cytokine IL-6 acts on a variety of target cells, activates intracellular tyrosine kinases, and has been implicated in the activation of many pathways, including the signal transducer and activator of transcription (STAT) pathway, the MAPK pathway, the PI3K pathway, and the insulin receptor substrate (IRS) [17]. PI3K-Akt and PKR are two major upstream pathways that regulate RNF213 expression in endothelial cells and are associated with endothelial cell proliferation and angiogenic potential [14,18]. Cytokine stimulation significantly induces RNF213 transcription through the PI3K-Akt and PKR pathways. Thus, IL-6 may regulate angiogenesis in MMD patients through the regulation of RNF213 transcription, consequently affecting their prognosis.
Hypercoagulation is an essential manifestation of inflammation, and cytokines play a decisive role in this process [19]. Increased levels of IL-6 in peripheral blood and tissues can stimulate the production of platelet-derived growth factors, leading to a thrombosis-promoting state [20]. Thrombosis is tightly associated with the development of intracranial arterial thickening. In autopsy specimens of internal carotid arteries from patients with MMD, a thrombus was present in 16 out of 22 patients [21]. In addition to the thickened intima, occlusion of blood vessels is a vital component of MMD. The susceptibility to thrombotic disease is therefore elevated in patients with MMD [22].
According to studies by Su et al., ischemia and hypoxia, oxidative stress, vascular occlusion, and inflammation induce dysregulation of IL-6, leading to the hepatic generation of acute phase proteins that facilitate leukocyte recruitment and thrombosis, eventually causing various cardiovascular diseases, including ischemic stroke [23]. Enhanced levels of blood IL-6 are associated with an increased risk of stroke and contribute to racial differences in stroke through the influence of inflammatory risk factors [24]. Elevated plasma IL-6 is reported as a feature of post-stroke delirium [25]. Furthermore, in the case of large vessel occlusion in patients with acute ischemic stroke, high levels of IL-6 within 24 h of thrombus recanalization are associated with ineffective reperfusion [26]. It has been shown that complete or near-complete reperfusion following thrombus recanalization is associated with lower admission levels of IL-6, suggesting that IL-6 may predict favorable outcomes in patients with acute ischemic stroke [27]. These findings suggest that IL-6 may be a predictor of prognosis in patients with ischemic stroke. Thus, in MMD, IL-6 may induce an exacerbation of the pre-operative ischemic state by promoting thrombosis as well as amplifying inflammation and impeding revascularization following bypass surgery, leading to a poorer functional outcome. Previous studies have reported that IL-6 can promote glucagon secretion and induce insulin resistance. Elevated circulating levels of IL-6 are an independent predictor of type 2 diabetes development [28,29]. Since elevated levels of IL-6 have been found in patients with co-morbid diabetes mellitus, it may not be specific to MMD. However, diabetes is also a cardiovascular risk factor, and its impact on the prognosis of MMD has been reported in previous studies [30], and this might be seen as a way in which IL-6 could influence the functional outcome of MMD.
TNF-α is an inflammatory cytokine that is expressed at low levels in the healthy central nervous system. However, previous studies have shown that following experimental and human ischemic stroke, the expression levels of TNF-α and its two identified receptors (TNFR1 and TNFR2) [31] are elevated and can influence the progression of infarct [32,33,34]. Common polymorphisms in the TNF-α gene promoter result in elevated TNF-α levels, which appear to be associated with cardiovascular risk factors and ischemic stroke in Asians. Furthermore, plasma TNF-α levels were elevated in stroke patients compared to healthy controls [34]. Chen et al. also showed that TNF-α leads to endothelial cell apoptosis, resulting in blood–brain barrier disruption. Additionally, they suggested that activating NF-κB nuclear translocation induces increased TNF-α production, which may lead to increased barrier disruption [35]. One known piece of information is that the NF-κB pathway was found to be upregulated in MMD [36]. RNF213 induces NF-κB activation and mediates apoptosis, which is similar to TNF-α effects. Additionally, blood–brain barrier dysfunction has been found in patients with MMD, and TNF-α may exacerbate this outcome and thus affect the prognosis of MMD. The inclusion of mutations in RNF213 in stepwise regression analysis masked the predictive role of TNF-α for poor prognosis. This suggests that TNF-α acts synergistically with RNF213, possibly through the same mechanism. This is in line with earlier studies showing that cytokines regulate the transcription of RNF213. TNF-α may also influence MMD prognosis by regulating the transcription of RNF213.
In a Japanese epidemiological survey, patients with RNF213 mutations accounted for only 73%, and this proportion was even lower in China [37]. Therefore, factors other than gene mutations such as inflammation may be involved in the pathogenesis of MMD. MMD cases with systemic sclerosis, autoimmune thyroiditis, and central nervous system infection have all been reported [38,39,40,41], and autoimmune abnormalities may be related to the pathogenesis of MMD [42]. In mutation-free MMD, inflammatory factors may be the main triggers of MMD, rather than genetic mutations, such as the pR4810K mutation in RNF213. Therefore, in the mutation-free group of MMD, the role played by inflammatory factors accounted for a larger proportion. This could explain why the levels of cytokines were higher in the no-mutation group compared to the mutant group. At the same time, this result further confirmed that the p.R4810K gene mutation of RNF213 is a susceptibility factor for MMD. This is due to the fact that RNF213 mutations can promote the development of MMD in patients with lower inflammatory factors. Our study showed that both RNF213 mutation and inflammatory factors are important in the pathogenesis of MMD, consistent with previous findings [10].
Our study also has some limitations. Firstly, the patient group was not compared with healthy controls; rather, the relationship between cytokines and prognostic-related indicators was compared between MMD subgroups. However, the expression patterns of the aforementioned inflammatory factors in MMD patients, and healthy controls have been compared in previous studies [11,43,44]. Secondly, no further analysis of the longer-term prognosis in relation to inflammatory factors has been undertaken, and further studies are required to collect data during follow-up. Thirdly, more research is needed to explore the exact role of inflammatory factors in the pathophysiology of MMD. Fourthly, the prognostic outcomes of this study did not take into account the reduced quality of life in patients with moyamoya disease due to transient ischemia, headache, and cognitive impairment, which may have a more serious impact on the individuals daily life, Therefore, more in-depth research is required. Finally, further validation in other cohorts is required because a single cohort from a single-center study has limited interpretability of the results.

5. Conclusions

TNF-α was associated with the risk of the poor short-term prognosis in adults with MMD. TNF-α and IL-6 levels were higher in the group without the pR4810K mutation of RNF213 compared to the mutation group. Our study demonstrates a comprehensive profile of cytokines in patients with MMD and identifies an inflammatory target for future research and treatment of MMD.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/jcm12030823/s1, Figure S1: Flow chart of the study participants. Table S1: Differences in IL-6 and TNF-α levels between the diabetic and non-diabetic groups. Table S2: Differences in IL-6 and TNF-α levels between the RNF213 mutant and non-mutant groups. Table S3: Univariate regression analysis of risk factors associated with poor prognosis of moyamoya disease.

Author Contributions

P.G. and D.Z. conceived the idea; W.L. and J.S. conducted the analyses; W.L. wrote this paper; Z.S., Z.H., L.Y. and H.D. provided the data; all authors contributed to the writing and revisions. All authors have read and agreed to the published version of the manuscript.

Funding

This study was supported by National Key Research and Development Program of China, grant number 2021YFC2500502.

Institutional Review Board Statement

This study was conducted in accordance with the Declaration of Helsinki, and approved by the Ethics Committee of Beijing Tiantan Hospital, Capital Medical University (protocol code KY2022-051-02 and date of 16 June 2022).

Informed Consent Statement

Informed consent was obtained from all subjects involved in this study. Written informed consent has been obtained from the patients to publish this paper.

Data Availability Statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Acknowledgments

We acknowledge all individuals for their participation in this study.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Huang, S.; Guo, Z.N.; Shi, M.; Yang, Y.; Rao, M. Etiology and pathogenesis of Moyamoya Disease: An update on disease prevalence. Int. J. Stroke 2017, 12, 246–253. [Google Scholar] [CrossRef] [PubMed]
  2. Weinberg, D.G.; Arnaout, O.M.; Rahme, R.J.; Aoun, S.G.; Batjer, H.H.; Bendok, B.R. Moyamoya disease: A review of histopathology, biochemistry, and genetics. Neurosurg. Focus 2011, 30, E20. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  3. Scott, R.M.; Smith, E.R. Moyamoya disease and moyamoya syndrome. N. Engl. J. Med. 2009, 360, 1226–1237. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Suzuki, J.; Takaku, A. Cerebrovascular “moyamoya” disease. Disease showing abnormal net-like vessels in base of brain. Arch Neurol. 1969, 20, 288–299. [Google Scholar] [CrossRef]
  5. Zhang, D.; Huang, L.; Huang, Z.; Zhou, Q.; Yang, X.; Gu, H.; Li, Z.; Shi, Y.; Gan, L.; Wang, H.; et al. Epidemiology of Moyamoya disease in China: A nationwide hospital-based study. Lancet Reg Health West Pac. 2022, 18, 100331. [Google Scholar] [CrossRef]
  6. Birkeland, P.; Tharmabalan, V.; Lauritsen, J.; Ganesan, V.; Bjarkam, C.R.; von Weitzel-Mudersbach, P. Moyamoya disease in a European setting: A Danish population-based study. Eur. J. Neurol. 2020, 27, 2446–2452. [Google Scholar] [CrossRef]
  7. Ghaffari-Rafi, A.; Ghaffari-Rafi, S.; Leon-Rojas, J. Socioeconomic and demographic disparities of moyamoya disease in the United States. Clin. Neurol. Neurosurg. 2020, 192, 105719. [Google Scholar] [CrossRef]
  8. Mejia-Munne, J.C.; Ellis, J.A.; Feldstein, N.A.; Meyers, P.M.; Connolly, E.S. Moyamoya and Inflammation. World Neurosurg. 2017, 100, 575–578. [Google Scholar] [CrossRef]
  9. Kronenburg, A.; Braun, K.P.J.; van der Zwan, A.; Klijn, C.J.M. Recent advances in moyamoya disease: Pathophysiology and treatment. Curr. Neurol. Neurosci. Rep. 2014, 4, 423. [Google Scholar] [CrossRef]
  10. Mikami, T.; Suzuki, H.; Komatsu, K.; Mikuni, N. Influence of Inflammatory Disease on the Pathophysiology of Moyamoya Disease and Quasi-moyamoya Disease. Neurol. Med. Chir. 2019, 59, 361–370. [Google Scholar] [CrossRef]
  11. Weng, L.; Cao, X.; Han, L.; Zhao, H.; Qiu, S.; Yan, Y.; Wang, X.; Chen, X.; Zheng, W.; Xu, X.; et al. Association of increased Treg and Th17 with pathogenesis of moyamoya disease. Sci. Rep. 2017, 7, 3071. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  12. Fujimura, M.; Sonobe, S.; Nishijima, Y.; Niizuma, K.; Sakata, H.; Kure, S.; Tominaga, T. Genetics and Biomarkers of Moyamoya Disease: Significance of RNF213 as a Susceptibility Gene. J. Stroke 2014, 16, 65–72. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  13. Ahel, J.; Lehner, A.; Vogel, A.; Schleiffer, A.; Meinhart, A.; Haselbach, D.; Clausen, T. Moyamoya disease factor RNF213 is a giant E3 ligase with a dynein-like core and a distinct ubiquitin-transfer mechanism. Elife 2020, 9, e56185. [Google Scholar] [CrossRef] [PubMed]
  14. Ohkubo, K.; Sakai, Y.; Inoue, H.; Akamine, S.; Ishizaki, Y.; Matsushita, Y.; Sanefuji, M.; Torisu, H.; Ihara, K.; Sardiello, M.; et al. Moyamoya disease susceptibility gene RNF213 links inflammatory and angiogenic signals in endothelial cells. Sci. Rep. 2015, 5, srep13191. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  15. Sarkar, P.; Thirumurugan, K. New insights into TNFalpha/PTP1B and PPARgamma pathway through RNF213-a link between inflammation, obesity, insulin resistance, and Moyamoya disease. Gene 2021, 771, 145340. [Google Scholar] [CrossRef] [PubMed]
  16. Li, J.; Lin, J.; Pan, Y.; Wang, M.; Meng, X.; Li, H.; Wang, Y.; Zhao, X.; Qin, H.; Liu, L.; et al. Interleukin-6 and YKL-40 predicted recurrent stroke after ischemic stroke or TIA: Analysis of 6 inflammation biomarkers in a prospective cohort study. J. Neuroinflamm. 2022, 19, 131. [Google Scholar] [CrossRef] [PubMed]
  17. Boulanger, M.J.; Chow, D.; Brevnova, E.E.; Garcia, K.C. Hexameric structure and assembly of the interleukin-6/IL-6 alpha-receptor/gp130 complex. Science 2003, 300, 2101–2104. [Google Scholar] [CrossRef]
  18. Hitomi, T.; Habu, T.; Kobayashi, H.; Okuda, H.; Harada, K.H.; Osafune, K.; Taura, D.; Sone, M.; Asaka, I.; Ameku, T.; et al. Downregulation of Securin by the variant RNF213 R4810K (rs112735431, G>A) reduces angiogenic activity of induced pluripotent stem cell-derived vascular endothelial cells from moyamoya patients. Biochem. Biophys. Res. Commun. 2013, 438, 13–19. [Google Scholar] [CrossRef]
  19. Bester, J.; Pretorius, E. Effects of IL-1β, IL-6 and IL-8 on erythrocytes, platelets and clot viscoelasticity. Sci. Rep. 2016, 6, 32188. [Google Scholar] [CrossRef] [Green Version]
  20. Zimmermann, M.; Aguilera, F.B.; Castellucci, M.; Rossato, M.; Costa, S.; Lunardi, C.; Ostuni, R.; Girolomoni, G.; Natoli, G.; Bazzoni, F.; et al. Chromatin remodelling and autocrine TNFα are required for optimal interleukin-6 expression in activated human neutrophils. Nat. Commun. 2015, 6, 1–14. [Google Scholar] [CrossRef]
  21. Yamashita, M.; Oka, K.; Tanaka, K. Cervico-cephalic arterial thrombi and thromboemboli in moyamoya disease—Possible correlation with progressive intimal thickening in the intracranial major arteries. Stroke 1984, 15, 264–270. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  22. Larson, A.A.-O.; Rinaldo, L.; Lanzino, G.; Klaas, J.P. High prevalence of pro-thrombotic conditions in adult patients with moyamoya disease and moyamoya syndrome: A single center study. Acta Neurochir. 2020, 162, 1853–1859. [Google Scholar] [CrossRef] [PubMed]
  23. Su, J.H.; Luo, M.Y.; Liang, N.; Gong, S.X.; Chen, W.; Huang, W.Q.; Tian, Y.; Wang, A.-P. Interleukin-6: A Novel Target for Cardio-Cerebrovascular Diseases. Front. Pharmacol. 2021, 12, 745061. [Google Scholar] [CrossRef]
  24. Jenny, N.S.; Callas, P.W.; Judd, S.E.; McClure, L.A.; Kissela, B.; Zakai, N.A.; Cushman, M. Inflammatory cytokines and ischemic stroke risk: The REGARDS cohort. Neurology 2019, 92, e2375–e2384. [Google Scholar] [CrossRef] [PubMed]
  25. Kowalska, K.; Klimiec, E.; Weglarczyk, K.; Pera, J.; Slowik, A.; Siedlar, M.; Dziedzic, T. Reduced ex vivo release of pro-inflammatory cytokines and elevated plasma interleukin-6 are inflammatory signatures of post-stroke delirium. J. Neuroinflammation 2018, 15, 111. [Google Scholar] [CrossRef]
  26. Mechtouff, L.; Bochaton, T.; Paccalet, A.; Da Silva, C.C.; Buisson, M.; Amaz, C.; Derex, L.; Ong, E.; Berthezene, Y.; Eker, O.F.; et al. Association of Interleukin-6 Levels and Futile Reperfusion After Mechanical Thrombectomy. Neurology 2020, 96, e752–e757. [Google Scholar] [CrossRef]
  27. Mechtouff, L.; Bochaton, T.; Paccalet, A.; Crola Da Silva, C.; Buisson, M.; Amaz, C.; Derex, L.; Ong, E.; Berthezene, Y.; Dufay, N.; et al. A lower admission level of interleukin-6 is associated with first-pass effect in ischemic stroke patients. BMJ 2022, 14, 248–251. [Google Scholar] [CrossRef]
  28. Akbari, M.; Hassan-Zadeh, V. IL-6 signalling pathways and the development of type 2 diabetes. Inflammopharmacology 2018, 26, 685–698. [Google Scholar] [CrossRef]
  29. Ellingsgaard, H.; Hauselmann, I.; Schuler, B.; Habib, A.M.; Baggio, L.L.; Meier, D.T.; Eppler, E.; Bouzakri, K.; Wueest, S.; Muller, Y.D.; et al. Interleukin-6 enhances insulin secretion by increasing glucagon-like peptide-1 secretion from L cells and alpha cells. Nat. Med. 2011, 17, 1481–1489. [Google Scholar] [CrossRef] [Green Version]
  30. Ren, B.; Zhang, Z.-S.; Liu, W.-W.; Bao, X.-Y.; Li, D.-S.; Han, C.; Xian, P.; Zhao, F.; Wang, H.; Wang, H.; et al. Surgical outcomes following encephaloduroarteriosynangiosis in adult moyamoya disease associated with Type 2 diabetes. J. Neurosurg. 2016, 125, 308–314. [Google Scholar] [CrossRef]
  31. Clausen, B.H.; Wirenfeldt, M.; Høgedal, S.S.; Frich, L.H.; Nielsen, H.H.; Schrøder, H.D.; Østergaard, K.; Finsen, B.; Kristensen, B.W.; Lambertsen, K.L. Characterization of the TNF and IL-1 systems in human brain and blood after ischemic stroke. J. Neurosurg. 2016, 125, 308–314. [Google Scholar] [CrossRef] [PubMed]
  32. Dziewulska, D.; Mossakowski, M.J. Cellular expression of tumor necrosis factor a and its receptors in human ischemic stroke. Clin. Neuropathol. 2003, 22, 35–40. [Google Scholar] [PubMed]
  33. Lambertsen, K.L.; Biber, K.; Finsen, B. Inflammatory cytokines in experimental and human stroke. J. Cereb. Blood Flow Metab. 2012, 32, 1677–1698. [Google Scholar] [CrossRef] [Green Version]
  34. Cui, G.; Wang, H.; Li, R.; Zhang, L.; Li, Z.; Wang, Y.; Hui, R.; Ding, H.; Wang, D.W. Polymorphism of tumor necrosis factor alpha (TNF-alpha) gene promoter, circulating TNF-alpha level, and cardiovascular risk factor for ischemic stroke. J. Neuroinflamm. 2012, 9, 235. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  35. Chen, A.Q.; Fang, Z.; Chen, X.L.; Yang, S.; Zhou, Y.F.; Mao, L.; Xia, Y.P.; Jin, H.J.; Li, Y.N.; You, M.F.; et al. Microglia-derived TNF-α mediates endothelial necroptosis aggravating blood brain-barrier disruption after ischemic stroke. Cell Death Dis. 2019, 10, 487. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  36. Takeda, M.; Tezuka, T.; Kim, M.; Choi, J.; Oichi, Y.; Kobayashi, H.; Harada, K.H.; Mizushima, T.; Taketani, S.; Koizumi, A.; et al. Moyamoya disease patient mutations in the RING domain of RNF213 reduce its ubiquitin ligase activity and enhance NFκB activation and apoptosis in an AAA+ domain-dependent manner. Biochem. Biophys. Res. Commun. 2020, 525, 668–674. [Google Scholar] [CrossRef] [PubMed]
  37. Hammond, C.K.; Shapson-Coe, A.; Govender, R.; van Toorn, R.; Ndondo, A.; Wieselthaler, N.; Eley, B.; Mubaiwa, L.; Wilmshurst, J.M. Moyamoya Syndrome in South African Children With HIV-1 Infection. J. Child Neurol. 2016, 31, 1010–1017. [Google Scholar] [CrossRef]
  38. Chen, H.; Jiang, X.; Shi, Y.; Yuan, F.; Hu, Z. Systemic sclerosis associated with moyamoya syndrome: A case report and literature review. Immunobiology 2020, 225, 121882. [Google Scholar] [CrossRef]
  39. Kamada, F.; Aoki, Y.; Narisawa, A.; Abe, Y.; Komatsuzaki, S.; Kikuchi, A.; Kanno, J.; Niihori, T.; Ono, M.; Ishii, N.; et al. A genome-wide association study identifies RNF213 as the first Moyamoya disease gene. J. Hum. Genet. 2011, 56, 34–40. [Google Scholar] [CrossRef] [Green Version]
  40. Imani, S.Z.H.; Hojati, Z.; Khalilian, S.; Dehghanian, F.; Kheirollahi, M.; Khorrami, M.; Shaygannejad, V.; Mirmosayyeb, O. Expression and clinical significance of IL7R, NFATc2, and RNF213 in familial and sporadic multiple sclerosis. Sci. Rep. 2021, 11, 1–10. [Google Scholar] [CrossRef]
  41. Lin, Y.A.-O.; Huang, H.; Hwang, W.Z. Moyamoya disease with Sjogren disease and autoimmune thyroiditis presenting with left intracranial hemorrhage after messenger RNA-1273 vaccination: A case report. Medicine 2022, 101, e28756. [Google Scholar] [CrossRef] [PubMed]
  42. Chen, J.B.; Liu, Y.; Zhou, L.X.; Sun, H.; He, M.; You, C. Prevalence of autoimmune disease in moyamoya disease patients in Western Chinese population. J. Neurol. Sci. 2015, 351, 184–186. [Google Scholar] [CrossRef]
  43. Mineharu, Y.; Miyamoto, S. RNF213 and GUCY1A3 in Moyamoya Disease: Key Regulators of Metabolism, Inflammation, and Vascular Stability. Front. Neurol. 2021, 12, 687088. [Google Scholar] [CrossRef] [PubMed]
  44. Han, W.; Jin, F.; Zhang, H.; Yang, M.; Cui, C.; Wang, C.; Jiang, P. Association of Brain-Gut Peptides with Inflammatory Cytokines in Moyamoya Disease. Mediat. Inflamm. 2020, 2020, 5847478. [Google Scholar] [CrossRef] [PubMed]
Jcm 12 00823 g001 550
Figure 1. Comparison of serum TNF-α and IL-6 concentrations. (a) Differences in TNF-α between mRS < 2 and mRS ≥ 2 groups. (b) Differences in IL-6 between mRS < 2 and mRS ≥ 2 groups. (c) Differences in IL-6 between diabetes and no diabetes groups. ns, no significance; ** p < 0.01.
Figure 1. Comparison of serum TNF-α and IL-6 concentrations. (a) Differences in TNF-α between mRS < 2 and mRS ≥ 2 groups. (b) Differences in IL-6 between mRS < 2 and mRS ≥ 2 groups. (c) Differences in IL-6 between diabetes and no diabetes groups. ns, no significance; ** p < 0.01.
Jcm 12 00823 g001
Jcm 12 00823 g002 550
Figure 2. Comparison of IL-6 and TNF-α levels between p.R4810K mutated and unmutated in RNF213. (a,b) are the differences between the mutation group and the non-mutation group when TNF-α and IL-6 were analyzed as continuous variables. (c,d) are the differences between the mutation group and the non-mutation group when TNF-α and IL-6 are divided into a high-level group and a low-level group for analysis. ns, no significance; * p < 0.05.
Figure 2. Comparison of IL-6 and TNF-α levels between p.R4810K mutated and unmutated in RNF213. (a,b) are the differences between the mutation group and the non-mutation group when TNF-α and IL-6 were analyzed as continuous variables. (c,d) are the differences between the mutation group and the non-mutation group when TNF-α and IL-6 are divided into a high-level group and a low-level group for analysis. ns, no significance; * p < 0.05.
Jcm 12 00823 g002
Jcm 12 00823 g003 550
Figure 3. Risk in IL-6 and TNF-alpha grouping in correlation with the prognosis of MMD.
Figure 3. Risk in IL-6 and TNF-alpha grouping in correlation with the prognosis of MMD.
Jcm 12 00823 g003
Jcm 12 00823 g004 550
Figure 4. The risk forest plot of the relationship between IL-6, TNF-α and the prognosis of moyamoya disease and the ROC curve of the stepwise regression model.
Figure 4. The risk forest plot of the relationship between IL-6, TNF-α and the prognosis of moyamoya disease and the ROC curve of the stepwise regression model.
Jcm 12 00823 g004
Table
Table 1. Baseline characteristics of 204 patients with moyamoya disease.
Table 1. Baseline characteristics of 204 patients with moyamoya disease.
VariablesValueALL Patients
(n = 204) 		mRS < 2 (n = 101) mRS ≥ 2 (n = 103)p-Value
Age, median[IQR]-44.000 [34.000, 50.000]38.000 [31.000, 47.000]47.000 [40.000, 52.000]<0.001
Gender/male, n (%)-81 (39.706)37 (36.634)44 (42.718)0.375
Clinical manifestation, n (%)-
ischemic143 (70.098)77 (76.238)66 (64.078)0.058
hemorrhagic61 (29.902)24 (23.762)37 (35.922)
RNF213 mutation, n (%)
Unmutated130/166 (78.313)57/75 (76.000)73/91 (80.220)0.511
mutated36/166 (21.687)18/75 (24.000)18/91 (19.780)
Unilateral or bilateral, n (%)
unilateral25 (12.255)17 (16.832)8 (7.767)0.048
bilateral179 (87.745)84 (83.168)95 (92.233)
Image Stage, n (%)
early127 (62.255)65 (64.356)62 (60.194)0.54
late77 (37.745)36 (35.644)41 (39.806)
suzuki stage, n (%)
11 (0.490)1 (0.990)0 (0.000)<0.001
256 (27.451)32 (31.683)24 (23.301)
370 (34.314)32 (31.683)38 (36.893)
432 (15.686)13 (12.871)19 (18.447)
529 (14.216)14 (13.861)15 (14.563)
616 (7.843)9 (8.911)7 (6.796)
Hyperlipidemia, n (%) 30 (14.706)12 (11.881)18 (17.476)0.259
Hypertension, n (%) 68 (33.333)23 (22.772)45 (43.689)0.002
Diabetes, n (%) 29 (14.216)11 (10.891)18 (17.476)0.178
BMI, median[IQR] 24.977 [22.491, 28.040]25.352 [22.583, 28.040]24.768 [22.266, 28.028]0.549
WBC, median[IQR] 6.810 [5.620, 8.300]6.940 [5.690, 8.510]6.780 [5.520, 8.140]0.456
RBC, mean (±SD) 4.605 ± 0.5294.573 ± 0.5744.637 ± 0.4800.394
HGB, mean (±SD) 140.000 [129.000, 155.000]137.000 [129.000, 154.000]142.000 [130.000, 155.000]0.639
PLT, median[IQR] 237.000 [204.000, 278.000]245.000 [204.000, 279.000]236.000 [204.000, 276.000]0.827
PCT, median[IQR] 0.230 [0.200, 0.260]0.230 [0.190, 0.260]0.230 [0.200, 0.270]0.876
Hcy, median[IQR] 10.560 [8.600, 13.100]10.330 [8.160, 12.940]10.810 [9.200, 13.400]0.264
CHO, mean (±SD) 4.346 ± 0.9384.398 ± 0.9244.296 ± 0.9490.438
TG, median[IQR] 1.220 [0.860, 1.590]1.220 [0.820, 1.720]1.220 [0.910, 1.530]0.728
UA, median[IQR] 305.600 [253.200, 367.600]301.200 [244.500, 363.400]307.800 [274.000, 380.000]0.064
Urea, median[IQR] 4.700 [3.800, 5.800]4.700 [3.800, 5.800]4.600 [3.800, 5.600]0.801
Glu, median[IQR] 5.120 [4.710, 5.640]5.060 [4.740, 5.490]5.150 [4.710, 5.860]0.175
IL-6, median[IQR] 2.430 [1.000, 3.990]2.200 [1.000, 3.520]2.980 [1.000, 4.190]0.051
IL-6, n (%)
G1 (≤2.00)69 (33.824)40 (39.604)29 (28.155)0.035
G2 (2.00–3.40)69 (33.824)35 (34.653)34 (33.010)
G3 (3.40–4.83)33 (16.176)9 (8.911)24 (23.301)
G4 (>4.83)33 (16.176)17 (16.832)16 (15.534)
TNF-α, median[IQR] 6.790 [5.460, 8.140]6.350 [5.290, 7.650]7.130 [6.060, 8.470]0.007
TNF-α, n (%)
G1 (≤6.24)75 (36.765)46 (45.545)29 (28.155)0.058
G2 (6.24–8.10)76 (37.255)34 (33.663)42 (40.777)
G3 (8.10–9.26)27 (13.235)12 (11.881)15 (14.563)
G4 (>9.26)26 (12.745)9 (8.911)17 (16.505)
IL-1β, n (%)
NORMAL (0–5.00)162 (79.412)81 (80.198)81 (78.641)0.783
HIGH (>5.00)42 (20.588)20 (19.802)22 (21.359)
IL2R, mean (±SD) 332.564 ± 103.813341.386 ± 110.318323.913 ± 96.2290.231
IL8, median[IQR] 16.700 [11.500, 26.700]15.400 [11.300, 26.300]17.000 [12.300, 27.400]0.461
Surgical approach, n (%)
indirect85 (41.667)44 (43.564)41 (39.806)0.586
direct119 (58.333)57 (56.436)62 (60.194)
SD, standard deviation; BMI, body mass index; IQR, interquartile range; mRS, Modified Rankin Scale score; WBC, white blood cell; RBC, red blood cell; HGB, hemoglobin; PLT, platelet; PCT, procalcitonin; CHO, total cholesterol; TG, triglyceride; UA, Uric acid;Glu, glucose; Hcy, homocysteine; G1–G4, Level grading of IL-6 and TNF-α.
Table
Table 2. Association of inflammatory markers IL-6 and TNF-α with postoperative modified Rankin Scale score ≥ 2.
Table 2. Association of inflammatory markers IL-6 and TNF-α with postoperative modified Rankin Scale score ≥ 2.
Marker and LevelsEvents [no., (%)]Crude ModelModel 2Model 2
OR (95% CI)p ValueOR (95% CI)p ValueOR (95% CI)p Value
IL-6 (ng/L)G1 (≤2.00)42.029Reference–Reference–Reference–
G2 (2.00–3.40)49.2751.34 [0.684, 2.623]0.3931.367 [0.664, 2.817]0.3961.321 [0.605, 2.886]0.485
G3 (3.40–4.83)72.7273.678 [1.491, 9.074]0.0054.522 [1.671, 12.234]0.0034.794 [1.669, 13.775]0.004
G4 (>4.83)48.4851.298 [0.564, 2.987]0.5390.994 [0.401, 2.463]0.9890.982 [0.371, 2.595]0.97
P for trend--1.232 [0.948, 1.601]0.1191.179 [0.889, 1.564]0.2521.187 [0.880, 1.600]0.261
TNF-α (ng/L)G1 (≤6.24)38.667Reference–Reference–Reference–
G2 (6.24–8.10)55.2631.959 [1.025, 3.747]0.0422.017 [1.000, 4.067]0.052.023 [0.957, 4.274]0.065
G3 (8.10–9.26)55.5561.983 [0.814, 4.829]0.1321.271 [0.490, 3.300]0.6221.2 [0.438, 3.288]0.722
G4 (>9.26)65.3852.996 [1.180, 7.610]0.0213.393 [1.211, 9.505]0.024.616 [1.485, 14.355]0.008
P for trend--1.432 [1.077, 1.903]0.0131.385 [1.021, 1.877]0.0361.467 [1.055, 2.040]0.023
G1–G4, Level grading of IL-6 and TNF-α; OR, odds ratio.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Liu, W.; Sun, J.; Shi, Z.; Huang, Z.; Yu, L.; Du, H.; Ge, P.; Zhang, D. Circulating Inflammatory Cytokine Associated with Poor Prognosis in Moyamoya Disease: A Prospective Cohort Study. J. Clin. Med. 2023, 12, 823. https://doi.org/10.3390/jcm12030823

AMA Style

Liu W, Sun J, Shi Z, Huang Z, Yu L, Du H, Ge P, Zhang D. Circulating Inflammatory Cytokine Associated with Poor Prognosis in Moyamoya Disease: A Prospective Cohort Study. Journal of Clinical Medicine. 2023; 12(3):823. https://doi.org/10.3390/jcm12030823

Chicago/Turabian Style

Liu, Wei, Jian Sun, Zhiyong Shi, Zheng Huang, Lebao Yu, Haibin Du, Peicong Ge, and Dong Zhang. 2023. "Circulating Inflammatory Cytokine Associated with Poor Prognosis in Moyamoya Disease: A Prospective Cohort Study" Journal of Clinical Medicine 12, no. 3: 823. https://doi.org/10.3390/jcm12030823

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop