Next Article in Journal
Bone Morphogenetic Protein-8B Expression is Induced in Steatotic Hepatocytes and Promotes Hepatic Steatosis and Inflammation In Vitro
Next Article in Special Issue
Distinct Expression of Inflammatory Features in T Helper 17 Cells from Multiple Sclerosis Patients
Previous Article in Journal
Cross-Talk between Fibroblast Growth Factor Receptors and Other Cell Surface Proteins
Previous Article in Special Issue
IL-6, IL-12, and IL-23 STAT-Pathway Genetic Risk and Responsiveness of Lymphocytes in Patients with Multiple Sclerosis
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

CD4+/CD45RO+: A Potential Biomarker of the Clinical Response to Glatiramer Acetate

1
Department of Neurology, Faculty of Medicine and University Hospital Hradec Králové, Charles University in Prague, Sokolská 581, 500 05 Hradec Králové, Czech Republic
2
Department of Clinical Immunology and Allergology, University Hospital Hradec Králové, Sokolská 581, 500 05 Hradec Králové, Czech Republic
*
Author to whom correspondence should be addressed.
Cells 2019, 8(5), 456; https://doi.org/10.3390/cells8050456
Submission received: 5 March 2019 / Revised: 10 May 2019 / Accepted: 11 May 2019 / Published: 15 May 2019
(This article belongs to the Special Issue The Molecular and Cellular Basis for Multiple Sclerosis)

Abstract

:
Background: Glatiramer acetate (GA) is an effective treatment for the earliest stages of multiple sclerosis (MS)—clinically isolated syndrome (CIS) or clinically definite MS (CDMS). Objective: This study aims to determine the differences in the lymphocyte population (at baseline and the course of five years) between confirmed sustained progression (CSP) and non-CSP groups and to identify potential biomarkers among these parameters that can predict a positive response to the treatment. Methods: Twelve male and 60 female patients were included in the study. Peripheral blood samples were collected before and five years after treatment with GA. The authors compared lymphocyte parameters between the CSP and non-CSP groups by statistical analyses. Univariate and penalized logistic regression models were fitted to identify the best lymphocyte parameters at baseline and their combination for potential biomarkers. Subsequently, the ROC analysis was used to identify cut-offs for selected parameters. Results: The parameter CD4+/CD45RO+ was identified as the best single potential biomarker, demonstrating the ability to identify patients with CSP. Moreover, a combination of four lymphocyte parameters at baseline, relative lymphocyte counts, CD3+/CD69+, CD4+/CD45RO+, and CD4+/CD45RA+ab, was identified as a potential composite biomarker. This combination explains 23% of the variability in CSP, which is better than the best univariate parameter when compared to CD4+/CD45RO+ at baseline. Conclusions: The results suggest that other biomarkers can help monitor the conditions of patients and predict a favourable outcome.

1. Introduction

Multiple sclerosis (MS) is a chronic inflammatory demyelinating disease affecting the central nervous system. Glatiramer acetate (GA) is one of the basic drugs used for the treatment of multiple sclerosis and has shown a persistent and sufficient clinical efficacy by reducing the number of attacks and stabilizing and improving disability [1,2,3,4]. The direct mechanism of the GA effect is not known. GA treatment influences both innate and adaptive immunity: GA causes a shift from the activity of the Th1 subset to the activity of the Th2 subset. Through its action on APCs (antigen-presenting cells) such as dendritic cells and monocytes, GA changes the function of CD4+ and CD8+ T-lymphocytes. It possess a high affinity to MHC (major histocompatibility complex) II molecules on cells [5]. A meta-analysis of three randomized, double blind, placebo-controlled trials (n = 540) concluded that GA decreased the pooled adjusted annualized relapse rate (ARR) and decreased the accumulated disability (RR 0.6; 95% CI = 0.4–0.9; p = 0.02) [3]. Veugelers et al. [6] showed that the relative progression was significantly lower after starting GA (relative progression: 0.89; 95% CI = 0.81–0.97) compared with pretreatment rates. Ford et al. also concluded that MS patients who received GA for up to 15 years had reduced relapse rates, decreased disability progression and fewer transitions to SPMS; the mean duration of their disease was 22 years [7]. On the contrary, Munari et al. concluded that GA had no effect on MS disease progression [8]. GA is not sufficiently efficient for all patients with MS. Therefore, it is necessary to identify biomarkers that may predict a favourable response to the GA treatment.
In this study, individual populations of lymphocytes in MS patients (clinically isolated syndrome/CIS and relapsing-remitting multiple sclerosis/RR MS) were examined after five years of GA treatment. Patients were monitored for a period of five years. The aim of this study was to describe the differences in the lymphocyte population groups (at baseline and five-year changes) between patients with CSP (confirmed sustained progression) and those without CSP (non-CSP) and to identify among the baseline values of parameters potential biomarkers that may predict a positive response to the treatment.

2. Materials and Methods

2.1. Study Population

Participating subjects were all patients of the Department of Neurology at the University Hospital in Hradec Králové, Czech Republic. The study was conducted between 2008 and 2017. Twelve male patients and 60 female patients were included in this cohort study. Their age range was between 17 and 55 years. The mean age was 35 ± 9 years. All MS patients were of Caucasian background and met the McDonald criteria or revised McDonald criteria for RR MS [9,10]. The patients provided a proper medical history to obtain the necessary information about the expanded disability status scale (EDSS), disease duration and MS treatment history. Peripheral blood samples were collected before and five years after the treatment with GA. They were treated with subcutaneous injections of GA (20 mg each day).
The validation group for the ROC analysis consisted of 97 patients (25 male patients and 72 female patients) treated with interferon β-1b (subcutaneous injection, 250 µg every other day). Their ages ranged between 19 and 69 years. All MS patients were Caucasian and met the McDonald criteria or revised McDonald criteria for RR MS [11].
All participants provided written informed consent. The study protocol was approved by the Ethics Committee of the University Hospital Hradec Králové (reference number 201706S18P).

2.2. FACS Analysis

The blood samples of patients were collected from the antecubital fossa vein. The relative numbers of CD3+, CD4+, CD8+, CD19+, CD3-/CD16+56+, CD3+CD69+, CD3+CD25+, CD4+/CD45RA+, CD4+/CD45RO+, CD8+/CD38+, CD19+/CD5+, CD40 and CD40L lymphocytes were assessed by two-colour flow cytometry. For surface staining, 100 µL of blood was added to tubes containing 10 µL of fluorochrome-labelled mAbs, including fluorescein isothiocyanate (FITC)-conjugated anti-CD3 (clone UCHT1), anti-CD4 (clone 13B8.2), anti-CD45RA (clone ALB11), anti-CD8 (clone B9.11) and anti-CD19 (clone J3-119), as well as phycoerythrin (PE)-conjugated anti-CD25 (clone B1.49.9), anti-CD69 (clone TP1.55.3), anti-CD4 (13B8.2), anti-CD45RO (clone UCHL1), anti-CD38 (clone LS198-4-3), anti-CD5 (clone BL1a), anti-CD40 (clone MAB89) and anti-CD40L (clone TRAP-1), which were provided by Beckman Coulter (Miami, FL, USA). Class-matched isotype immunoglobulin FITC and PE-conjugated negative control monoclonal antibodies were added to individual tubes for all samples to identify nonspecific binding. All the antibodies used, their source information and dilution factors are summarized in Supplementary Table S1.
Thereafter, 100 µL of heparinised peripheral blood was mixed with the cocktail monoclonal antibody solution and incubated for 15 min at room temperature. A lysing solution (OptiLyse C, Beckman Coulter) was added, and the mixture was incubated for another 10 min. The flow cytometric evaluation was conducted with a Cytomics FC 500 cytometer (Beckman Coulter) equipped with a 15-mW air-cooled 488-nm argon laser and a 625-nm neon diode laser. All the data were assessed using the CXP Analysis Software (Beckman Coulter). A minimum of 10,000 events were obtained for each staining and supplied as a list mode. Multiple peripheral blood parameters were assessed in absolute and relative values. The 37 parameters included lymphocytes, CD4+ T-lymphocytes, CD8+ T-lymphocytes, CD 19+ B-lymphocytes, CD3-/CD16+/CD56+ natural killer cells, CD3+/CD69+ early activated T cells, CD5+ T cells, CD25+ cells, CD3+/CD25+ T cells, CD5+/CD19+ B cells, CD4+/CD45RA+ helper naïve T cells, CD4+/CD45RO+ helper memory T cells, CD8+/CD38+ T cells, CD69+ cells, CD40+ cells, and CD40L+ cells. The complete blood cell count was also determined. The data designated as ab represents an absolute count and the data without ab represent a relative count. The absolute values were calculated from the blood count, and the relative values were calculated as the percentage of lymphocytes.

2.3. Statistical Analysis

Statistical Processing

The patients were divided into two groups: CSP (confirmed sustained progression) and non-CSP group. The CSP group was defined by changes of the EDSS (1.0-point increase or greater if the EDSS result was more than 0.0 at baseline, or a 1.5-point increase or greater if the EDSS result was 0.0 at baseline). The non-CSP was defined by changes of less than a 1.0-point increase if the EDSS result was greater than 0.0 at baseline or less than a 1.5-point increase if the EDSS result was 0.0 at baseline.
First, we compared the lymphocyte populations (37 parameters) at baseline, at the end of the follow-up (same 37 parameters measured after five years) and their changes (37 absolute and 37 relative) near the end of the follow-up (last time point) between the CSP and non-CSP groups by running Welch’s one-way analysis of means (parametric t-test) for normally distributed parameters and Mann-Whitney test (nonparametric t-test) for non-normally distributed parameters. For the categorical parameter sex, a chi-square test of independence was used instead. The Lilliefors normality test was used to assess whether the parameters were normally or non-normally distributed. The effect size for all numerical parameters (except for sex) was assessed by Cohen’s d, which is the standardized difference between group means. Cramer’s V is reported for sex.
The association strength between the lymphocyte parameters and progression of EDSS were investigated by estimating a series of univariate logistic regression models for each explanatory variable (parameter) of 148 (4 × 37), where the binary response variable was the patient’s group (non-CSP or CSP). Thereafter, the statistical significance of parameters was validated by an adjusted (multivariate) logistic regression model with added covariates, sex, age and EDSS at baseline, to reduce the (latent) possible effect of these covariates on the response (dependent) random variable (non-CSP or CSP). The data were screened for the presence of the outliers for the regression modelling. We defined an outlier as a value that lies three times the interquartile range away from the median.
To identify the composite predictor (set of biomarkers) of clinical progression, we fitted two multivariate logistic regression models of CSP. In both models, only baseline lymphocyte values were entered as explanatory variables. Strongly articulated explanatory variables (multi-collinearity) are not appropriate to combine in one model. Multi-collinearity was determined to exist if the absolute value of the Spearman’s correlation coefficient exceeded 0.8. Strong (pair) dependence has been identified in a number of lymphocytic pairs. For this reason, the best combinations of explanatory variables use multivariate models (penalized logistic regression) that take into account multi-collinearity and multivariate models that do not have highly dependent variables together.
First, a penalized (lasso) logistic regression model was fitted via the penalized maximum likelihood with a 10-fold cross-validation. This model included all individual 37 parameters (their values at baseline). Subsequently, the identified combination (set), which was not strongly mutually correlated, of parameters entered the multivariate logistic regression model to compare the goodness of fit of this combination with each parameter independently and with further combinations (the second multivariate model). Not strongly correlated pair of parameters were defined as when the absolute value of their correlation coefficient was lower than 0.9. The choice of one explanatory parameter from the strongly correlated pair was made with the objective criterion Nagelkerke pseudo R2 (R2).
The second (fitted) multivariate model contained all statistically significant parameters (values at baseline) from the univariate models. The same selection of not strongly correlated parameters was applied as described above. The goodness of fit of each univariate and multivariate logistic regression model (strength of association) was evaluated by R2.
To control the false discovery rate, the Benjamini-Hochberg procedure using p < 0.05 as threshold of statistical significance was applied. The calculations were performed in the statistical system R (r-project.org) to obtain the penalized logistic regression model fit; the package glmnet was used [12,13].
We run ROC analysis to identify cut-offs (thresholds) for the four parameters, relative lymphocyte counts, and CD3+/CD69+, CD4+/CD45RO+, and CD4+/CD45RA+ab levels at baseline, which were chosen by the penalized logistic regression as potential biomarkers for CSP. The closest top left point lying on a built ROC curve was chosen as a cut-off for CSP.

3. Results

3.1. Statistical Comparison of CSP vs. Non-CSP Groups (GA Administered)

The group of patients treated with GA consisted of 72 patients (12 male and 60 female patients). Group A (CSP) consisted of 32 patients (6 male and 26 female patients), group B (non-CSP) consisted of 40 patients (6 male and 34 female patients). Therefore, there were 4.33 times more women than men in group A and 5.67 times more women than men in group B. The difference between the groups and the proportion of women was not statistically significant (p value 0.916) at a 5% significance level. The groups were not significantly different in age. The mean age (standard deviation) of patients in groups differed on average by 2.2 years (A 36.2 (8.09), and B 34.0 (9.9)). This is not a statistically significant difference (p value = 0.309). Groups with a statistically significant difference (p < 0.438) did not differ in basal EDSS (median A 2.0 vs. B 1.5).
Of the lymphocyte characteristics, the differences between A and B were statistically significant (at the 5% level of significance) for baseline CD4+/CD45RO+ (mean A 25.1 vs. B 19.9; p value < 0.001; effect size = 0.9), relative lymphocyte counts (26.3 vs. 32.2; 0.005; 0.69) and CD3+/CD69+ab (0.07 vs. 0.05; 0.043; 0.32).
In the fifth year, the groups differed significantly in absolute lymphocyte counts (2.0 vs. 2.11; 0.016; 0.59), CD3ab (1.5 vs. 1.8; 0.01; 0.63), CD8ab (0.48 vs. 0.53; 0.003; 0.72), CD4+/CD45RO+ (26.5 vs. 21.7; 0,001; 0,84), CD38ab (0.9 vs. 1.2; 0.005; 0.68), CD69ab (0.06 vs. 0.07; 0.029; 0.42), CD4+/CD45RA+ (0.41 vs. 0.54; 0.044; 0.49) and CD8+/CD38+ab (0.16 vs. 0.23; 0.003; 0.63).
Out of the changes in the course of five years, the change of CD3 was statistically significant at the 5% level of significance (absolute and relative). For groups of CSPs (A), CD3 decreased over five years; on the contrary, in the non-CSP groups, CD3 increased. For the CSP group, the mean absolute decrease was three units, and in the non CSP group, there was an increase of 2.2 (p value = 0.004; effect size = 0.73). Another significant change was for CD8. In the CSP group, there was a decrease (4.3 units, (11.7%)), and in the group non-CSP, there was an increase (one unit (4.8%).) The effect size was the highest of all parameters (0.88 for absolute change and 0.79 for relative change.) Other statistically significant differences were found in the changes in the characteristics: CD8ab, CD19, absolute total leukocyte count, CD3+/CD69+ab, CD5, CD40, CD69, CD69ab and CD8+/CD38+ab.
Changes and values obtained in the fifth year can be interpreted as significantly correlated with the CSP.
According to the effect size, the most significant correlation of the EDSS progression appears to be the change in CD8 (0.88), change in CD3 (0.73) and baseline value relative lymphocyte count (0.69), which can be thought of as the CSP predictor. In addition, the CD4+/CD45RO+ and CD3+/CD69+ab parameters are interesting: the groups differ both in the measured values and in their changes (Table 1). The descriptive statistics for all 37 parameters are summarized in Supplementary Table S2.

3.2. Validation of CSP Dependence on Significant Parameters after Correction of Influential Factors

The values of the lymphocyte characteristics at the baseline can be considered as potential biomarkers for MS if they can predict CSP with high reliability (accuracy). Using the logistic regression, we have estimated the predictive potential for each parameter. EDSS, age at baseline, and gender, based on our patient population, do not appear to be appropriate predictors (do not predict whether patient belongs has CSP; CSP = yes/no, pseudo R2 = 0; 0.02; 0).
The statistically significant parameters (baseline values of lymphocyte characteristics) and, therefore, potential biomarkers according to the pseudo R2 are: CD4+/CD45RO+ (0.31), CD3+/CD69+ab (0.27), CD69 (0.23), CD3+/CD69+ (0.19), CD19 (0.19), CD4+/CD45RA+ (0.18), CD4+/CD45RO+ab (0.18), relative lymphocyte count (0.15), and CD8 (0.07).
Except for CD19, the presented values of the lymphocyte characteristics relative to the baseline are statistically significant, even after adjusting for the influential factors EDSS, age, and sex.
Table 2 and Supplementary Table S3 provide estimates of the odds ratio (OR) and pseudo R2 for all described parameters above (not only baseline) with ORs that are statistically significant without and/or with adjustment for influential factors.

3.3. Identification of Combinations of Explanatory Variables

3.3.1. Penalized Logistic Regression (Identification of All 37 Explanatory Variables)

The lasso logistic regression was used to identify a significant combination of explanatory variables from all 37 explanatory variables. A combination of four parameters was selected at the baseline: relative lymphocyte counts, CD3+/CD69+, CD4+/CD45RO+, and CD4+/CD45RA+ab.
The selected four parameters were entered as explanatory variables into a multiple model. The value of R2 is 0.38. This model, which contains four lymphocyte parameters to baseline, fits the data by 23% (0.38/0.31) better than the best univariate parameter, CD4+/CD45RO+, at baseline. The statistically significant difference at the 5% level of significance explaining the parameter is CD4+/CD45RO+ (even after the influential factor adjustment). This finding confirms the results of the univariate analysis.
The estimated ORs and their statistical significance are provided in Table 3.

3.3.2. Combination of Statistically Significant Variables from One-dimensional Models

The statistically significant baseline parameters in the one-dimensional regression models are: CD4+/CD45RO+, CD3+/CD69+ab, CD69, CD3+/CD69, CD19, CD4+/CD45RA+, CD4+/CD45RO+ab, relative lymphocyte count, and CD8.
Two parameters are strongly correlated: CD3+/CD69+ and CD3+/CD69+ab (Spearman’s correlation coefficient 0.92). In the multiple regression model, the CD3+/CD69+ab parameter was selected from this pair based on the higher R2 value of the one-dimensional models.
As an explanatory variable for the multiple regression model, a combination of the following eight parameters was selected: CD4+/CD45RO+, CD3+/CD69+ab, CD69, CD19, CD4+/CD45RA+, CD4+/CD45RO+ab, relative lymphocyte count, and CD8.
The R2 value of the multiple model R2 is 0.52. This model, which contains eight lymphocyte parameters to the baseline, fits the data 68% (0.52/0.31) better than the best univariate parameter at baseline CD4+/CD45RO+. The results of this model (regression parameter estimates) are not statistically significant due to the small number of patients in the groups and the complexity of the model, in which nine model parameters are estimated (intercept + eight for each lymphocyte parameter).
This combination of lymphocytic characteristics also fits the data better (R2 = 0.46 versus 0.38) than the combination of four variables described in the previous section.
The estimated ORs and their statistical significance are provided in Table 4.
The predicted probability of the CSP for the values of significant parameters, i.e., CD3+/CD69+ (at baseline), CD3+/CD69+ab (at baseline), CD4+/CD45RA+ (at baseline), CD4+/CD45R0+ (at baseline), CD4+/CD45RO+ab (at baseline), CD8 (at baseline), CD69 (at baseline), ad relative lymphocyte count (at baseline) is presented in Supplementary Figures S1–S8.

3.3.3. ROC Analysis

Table 5 below presents the results of the ROC analysis for the four most appropriate parameters (lymphocyte characteristics).
The best discriminatory ability to distinguish the CSP patients from the non-CSP patients in our groups (sample) is illustrated by CD4+/CD45RO+ (AUC 76%). The higher the value of this parameter is, the more likely it is that the patient reaches CSP within five years. The cut-off for this parameter is 22.55 (accuracy 72.1%, sensitivity 70%, specificity 74%). The remaining parameters have a lower prediction potential (AUC 62–65%). Their cut-offs are provided in Table 5.
The results (the CSP prediction ability of identified cut-offs) were further validated in an independent cohort of patients treated with interferon β-1b (IFN). In Table 6, the original cut-offs (identified in the new, current data, i.e., patients treated with IFN) were verified. Table 7 summarizes the search for cut-off values for eight parameters in the independent set of patients treated with IFN.

4. Discussion

The objective of this study was to find a parameter or a combination of parameters that can predict the progression of disability in MS patients treated with GA (evaluated over a five-year period). In our study, using the ROC analysis, we determined cut-off values to the baseline that can determine the CSP and the non-CSP patients. The parameter, which helps best to identify the patients with an increased risk of disease progression within five years, is CD4+/CD45RO+.
For the CD4+/CD45RO+ characteristics, the cut-off value is set to baseline 22.55. If the patient has a value greater than 22.55, 70% of the patients can reliably be identified in the CSP group (sensitivity); in other words, 70% of the patients with a value >22.55 actually have CSP, and with a 74% probability, this cut-off can correctly identify the non-CSP patients (specificity).
We validated the ability of identified potential biomarkers and their cut-offs to predict CSP on an independent group of patients treated with IFN, i.e., with a drug with a different mechanism of action against GA, in order to assess the robustness of these cut-offs (general utilization for patients with MS independent of their treatment). When comparing the results, the CD4+/CD45RO+ > 22.55 cut-off retained a high sensitivity (72%) on the test file, i.e., it was able to identify correctly with this CSP validator group but failed to correctly identify the non-CSP patients (low specificity) (Figure 1). Other parameters did not reach satisfactory results.
The leucocyte molecule CD45 deserves special attention in the pathophysiology of MS. CD45 is a transmembrane molecule with tyrosine phosphatase activity, which is expressed at different density on all cells of haematopoietic origin, and exist in many different isoforms. Most naïve human T cells express a form of CD45R that is called CD45RA, and memory T cells express a different isoform called CD45RO. Several subtypes of memory T cells could be identified by mapping the expression of selected membrane molecules. Central memory T cells (TCM) express CD45RO, C-C chemokine receptor type 7 (CCR7), and L-selectin (CD62L) and are predominantly localized in lymphoid tissue. Effector memory T cells (TEM) that express CD45RO but lack expression of CCR7 and L-selectin are found both in the blood and tissues. Tissue resident memory T cells (TRM) occupy tissues without circulating in the blood.
The role of CD4+/CD45RO+ cells in the pathogenesis of MS is not yet fully understood. CD4+/CD45RO+ are memory helper T-lymphocytes, i.e., lymphocytes that have already been activated by antigens. This population changes with age, reaching a peak later in adulthood. In the experimental autoimmune encephalomyelitis, encephalitogenic T cells differ from the non-encephalitogenic ones by their expression of CD49d. The CD49d molecule is a β chain of the VLA4 integrin heterodimer adhesion molecule. The ligand for VLA4 adhesion molecule is VCAM1 (CD106) molecule expressed on endothelial cells of the brain-blood barrier. The interaction between VLA4 and VCAM1 molecules is a prerequisite for T cell entry from blood into the brain. The disease-inducing CD49d+(high) cells but not the CD49d+(low) cells enter the brain parenchyma. In this context, Barrau et al. characterized CD4+/CD45RO+/CD49d+(high) cells in RR MS patients. These cells, showing characteristics of activated cells able to produce proinflammatory cytokines, were found to be increased in the peripheral blood during relapses and present in high numbers in the cerebrospinal fluid. These results suggested that the CD4+/CD45RO+/CD49d+(high) subpopulation in RR MS patients includes autoreactive cells. CD4+/CD45RO+/CD49d+(high) cells show characteristics of activated T cells and are able to produce major TH1 cytokines such as IFN-γ [14].
CD4+/CD45RO+ memory T-cells from MS patients also showed a reduced ability to suppress NLRP3 inflammasome activation. NLRP3 inflammasome, which is assembled via both damage-associated molecular patterns (DAMPs) and pathogen-associated molecular patterns (PAMPs) is activating caspase 1. Caspase 1 in cooperation with several other molecules is able to cleave latent forms of proIL-1β and IL-18 cytokines. Fully active pluripotent proinflammatory cytokines IL-1β and IL-18 are produced in this way. NLRP3 inflammasomes exert key roles in the initiation and propagation of the inflammation [15].
As other potentially suitable biomarkers, we separately identified the relative lymphocyte count, CD3+/CD69+ and CD4+/CD45RA+ab or combined with CD4+/CD45RO+.
Blanco et al. and Pavelek et al. observed an increase in the CD4+/CD45RA+ count in GA-treatment responders. This observation is probably the result of the switch from CD4+/CD45RO+ memory T cells to naïve CD4+/CD45RA+ T cells, which is likely the result of GA action. The upregulation of CD4+/CD45RA+ appears to be one of the mechanisms by which GA inhibits MS activity [16,17]. CD3+/CD69+ cells represent early-activated T lymphocytes. A decrease in the CD3+/CD69+ count was also seen during the GA treatment [17].
According to the ROC analysis, the cut-off values for relative lymphocyte count are 26.2, for CD3+/CD69+ are 2.25 and for CD4+/CD45RA+ab are 0.435. The cut-off value of 26.2 relative lymphocyte count has a specificity of 71%. The sensitivity of this cut-off is low at 50%. The specificity of cut-off 2.25 for CD3+/CD69 + again has a low sensitivity of 53% and a high specificity of 76%. Conversely, the cut-off of 0.435 for CD4+/CD45RA+ab has a high sensitivity of 70% and a low specificity of 51%.
Although much is left to be clarified about pathogenic mechanisms of MS, understanding the mechanisms of the immunity-mediated damage to CNS components with MS enables the introduction of new medicines that positively modulate the damaging inflammation. With the development of the MS treatment, the early escalation of treatment has gained ground, which has given hope to patients in terms of curbing irreversible disease progression and maintaining a satisfactory quality of life. To achieve this goal, the monitoring of the clinical and subclinical disease activity is crucial.
Currently, there are several potential biomarkers, which are known as responders to the GA therapy. Despite this, none of these biomarkers have been introduced in common clinical practice. A high IL-18 level at baseline and a reduction in TNF-alpha over time are associated with the response to GA [18]. Regarding the association with clinical responders to the GA treatment, Mindur et al. [19] reported an increase in serum IL-27 production. Another study found increased expression of the Response Gene to Complement 32 (RGC-32) (p < 0.0001) and FasL (Fas ligand, CD178) (p < 0.0001) and decreased expression of IL-21 (p = 0.02) [20] as potential biomarkers. RGC-32 was also detected by Tatomir et al. as a potential biomarker of relapse and response to the GA therapy, as the RGC-32 mRNA expression is significantly decreased during relapse and increased in responders to the GA treatment. The predictive accuracy of RGC-32 as a potential biomarker (by ROC analysis) is 90% for detecting relapses and 85% for detecting a response to the GA treatment [21].
Other biomarkers for responders to the GA treatment may be SIRT1 mRNA (a NAD-dependent histone and protein deacetylase) and H3K9me2 (H3K9 dimethylation). GA responders had significantly higher SIRT1 mRNA (p = 0.01) and H3K9me2 levels than non-responders (p = 0.018) [22]. The results were further evaluated by Cieriello et al. Statistically significant lower levels of p-SIRT1 protein (p = 0.02) and H3K9me3 (p = 0.004) were found in GA non-responders compared to the responders. Non-responders to the GA treatment were defined as patients who exhibited at least two relapses following initiation of the GA treatment. Using the receiver operating characteristic analysis, the area under the curve (AUC) for the prediction of relapse was 77% (p = 0.007) for p-SIRT1 and was 81% (p = 0.002) for H3K9me3. For predicting responsiveness to the GA treatment, the AUC was 75% (p = 0.01) for H3K9me3. H3K9me3 could serve as potential biomarker to predict response to the GA treatment [23].
Furthermore, patterns of TH1/TH2 cytokines can predict clinical response in MS patients treated with GA. The quotient (IL-2 + IFN-γ)/(IL-4 + IL-10) was elevated in patients with relapses compared to relapse-free patients after 12 (p = 0.04), 24 (p = 0.02) and 36 months (p = 0.04) [24].
This present study has some limitations. Pregnancy and compliance rate were not observed, and the results can be influenced by these factors. Although a worsening of the neurological findings measured by the EDSS scale was found in a number of patients over the five-year period, these patients did not meet the criteria for escalation of treatment or SPMS [25]. As they were patients in routine clinical practice, escalation was tied to valid local Czech insurance reimbursement criteria for treatment.
The disadvantage of peripheral blood biomarkers is that they are released more extracerebrally than directly from the brain [26]. However, the collection of cerebrospinal fluid to evaluate biomarkers is a relatively invasive method with more frequent adverse effects. In contrast, peripheral blood collection and subsequent analysis is a quick and simple method. We are aware that absolute lymphocyte counts are highly variable and may even change considerably during a day. Therefore, peripheral blood collection was performed in the morning at approximately the same time. We believe that analysing the CD4+/CD45RO+ parameter and finding baseline values before starting MS treatment can help doctors consider the use of GA in common clinical practice.

5. Conclusions

From the univariate and multivariate regression analyses, CD4+/CD45RO+ lymphocytes best describe the CSP dependence on lymphocyte parameters in our cohort. In addition, the following promising biomarkers seem worth examining: relative lymphocyte count, CD3+/CD69+ for early activated T cells and CD4+/CD45RA+ for naïve T cells, which can be considered either alone or in combination with CD4+/CD45RO+ memory T cells. The analysis of the difference between groups confirms that strong differences exist in these parameters. Furthermore, the groups differ strongly in the change of CD8 and CD3 T cell populations. The correlation analysis confirms our findings from regression modelling. The CD4+/CD45RO+ parameter was also identified by the ROC analysis as a potential biomarker, and a measured value above 23 means an increased risk of disease progression within five years.

Supplementary Materials

The Supplementary Materials are available online at https://www.mdpi.com/2073-4409/8/5/456/s1.

Author Contributions

M.V., L.S. and Z.P. designed the manuscript. M.V., B.K., C.A., D.V., J.M. and Z.P. performed literature studies and collected data. L.S. and O.V. prepared the figures. M.V., L.S. and Z.P. wrote the manuscript. All authors provided conceptual input, edited the text, and approved the final version of the manuscript.

Funding

This study was partially supported by grants from the Ministry of Health of the Czech Republic (FN HK 00179906) and the Charles University in Prague, Czech Republic (PROGRES Q40) and by the project PERSONMED—Center for the Development of Personalized Medicine in Age-Related Diseases, Reg. Nr. CZ.02.1.01/0.0/0.0/17_048/0007441, co-financed by ERDF and the state budget of the Czech Republic.

Conflicts of Interest

The authors have no commercial or financial conflict of interest to declare.

References

  1. Boneschi, F.M.; Rovaris, M.; Johnson, K.P.; Miller, A.; Wolinsky, J.S.; Ladkani, D.; Shifroni, G.; Comi, G.; Filippi, M. Effects of glatiramer acetate on relapse rate and accumulated disability in multiple sclerosis: Meta-analysis of three double-blind, randomized, placebo-controlled clinical trials. Mult. Scler. J. 2003, 9, 349–355. [Google Scholar] [CrossRef] [PubMed]
  2. Comi, G.; Martinelli, V.; Rodegher, M.; Moiola, L.; Bajenaru, O.; Carra, A.; Elovaara, I.; Fazekas, F.; Hartung, H.P.; Hillert, J.; et al. Effect of glatiramer acetate on conversion to clinically definite multiple sclerosis in patients with clinically isolated syndrome (PreCISe study): A randomised, double-blind, placebo-controlled trial. Lancet 2009, 374, 1503–1511. [Google Scholar] [CrossRef]
  3. Khan, O.; Rieckmann, P.; Boyko, A.; Selmaj, K.; Zivadinov, R.; GALA Study Group. Three times weekly glatiramer acetate in relapsing-remitting multiple sclerosis. Ann. Neurol. 2013, 73, 705–713. [Google Scholar] [CrossRef]
  4. Khan, O.; Rieckmann, P.; Boyko, A.; Selmaj, K.; Ashtamker, N.; Davis, M.D.; Kolodny, S.; Zivadinov, R. Efficacy and safety of a three-times-weekly dosing regimen of glatiramer acetate in relapsing-remitting multiple sclerosis patients: 3-year results of the Glatiramer Acetate Low-Frequency Administration open-label extension study. Mult. Scler. 2017, 23, 818–829. [Google Scholar] [CrossRef]
  5. Schrempf, W.; Ziemssen, T. Glatiramer acetate: Mechanisms of action in multiple sclerosis. Autoimmun. Rev. 2007, 6, 469–475. [Google Scholar] [CrossRef]
  6. Veugelers, P.; Fisk, J.; Brown, M.; Stadnyk, K.; Sketris, I.; Murray, T.; Bhan, V.; Sketris, I. Disease progression among multiple sclerosis patients before and during a disease-modifying drug program: A longitudinal population-based evaluation. Mult. Scler. J. 2009, 15, 1286–1294. [Google Scholar] [CrossRef]
  7. Ford, C.; Goodman, A.D.; Johnson, K.; Kachuck, N.; Lindsey, J.W.; Lisak, R.; Luzzio, C.; Myers, L.; Panitch, H.; Preiningerova, J.; et al. Continuous long-term immunomodulatory therapy in relapsing multiple sclerosis: Results from the 15-year analysis of the US prospective open-label study of glatiramer acetate. Mult. Scler. 2010, 16, 342–350. [Google Scholar] [CrossRef]
  8. Munari, L.; Lovati, R.; Boiko, A. Therapy with glatiramer acetate for multiple sclerosis. Cochrane Database Syst. Rev. 2004, CD004678. [Google Scholar] [CrossRef]
  9. Polman, C.H.; Reingold, S.C.; Edan, G.; Filippi, M.; Hartung, H.-P.; Kappos, L.; Lublin, F.D.; Metz, L.M.; McFarland, H.F.; O’Connor, P.W.; et al. Diagnostic criteria for multiple sclerosis: 2005 revisions to the “McDonald Criteria”. Ann. Neurol. 2005, 58, 840–846. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  10. Polman, C.H.; Reingold, S.C.; Banwell, B.; Clanet, M.; Cohen, J.A.; Filippi, M.; Fujihara, K.; Havrdova, E.K.; Hutchinson, M.; Kappos, L.; et al. Diagnostic criteria for multiple sclerosis: 2010 Revisions to the McDonald criteria. Ann. Neurol. 2011, 69, 292–302. [Google Scholar] [CrossRef] [Green Version]
  11. Vališ, M.; Vyšata, O.; Sobíšek, L.; Klímová, B.; Andrýs, C.; Vokurková, D.; Pavelek, Z. Monitoring of Lymphocyte Populations During Treatment with Interferon-β-1b to Predict Multiple Sclerosis Disability Progression. J. Interferon Cytokine Res. 2018, 39, 164–173. [Google Scholar] [CrossRef]
  12. R Core Team. R: A Language and Environment for Statistical Computing; R Foundation for Statistical Computing: Vienna, Austria, 2017. [Google Scholar]
  13. Friedman, J.H.; Hastie, T.; Tibshirani, R. Regularization Paths for Generalized Linear Models via Coordinate Descent. J. Stat. Softw. 2010, 33, 1–22. [Google Scholar] [CrossRef] [PubMed]
  14. Barrau, M.A.; Montalban, X.; Sáez-Torres, I.; Brieva, L.; Barberà, N.; Martínez-Cáceres, E.M. CD4(+)CD45RO(+)CD49d(high) cells are involved in the pathogenesis of relapsing-remitting multiple sclerosis. J. Neuroimmunol. 2000, 111, 215–223. [Google Scholar] [CrossRef]
  15. Beynon, V.; Quintana, F.J.; Weiner, H.L. Activated human CD4+CD45RO+ memory T-cells indirectly inhibit NLRP3 inflammasome activation through downregulation of P2X7R signalling. PLoS ONE 2012, 7, e39576. [Google Scholar] [CrossRef] [PubMed]
  16. Blanco, Y.; Moral, E.; Costa, M.; Gómez-Choco, M.; Torres-Peraza, J.; Alonso-Magdalena, L.; Alberch, J.; Jaraquemada, D.; Arbizu, T.; Graus, F.; et al. Effect of glatiramer acetate (Copaxone®) on the immunophenotypic and cytokine profile and BDNF production in multiple sclerosis: A longitudinal study. Neurosci. Lett. 2006, 406, 270–275. [Google Scholar] [CrossRef]
  17. Pavelek, Z.; Vyšata, O.; Sobíšek, L.; Klímová, B.; Andrýs, C.; Vokurková, D.; Mazurová, R.; Štourač, P.; Vališ, M. Lymphocyte populations and their change during five-year glatiramer acetate treatment. Neurol. Neurochir. Pol. 2018, 52, 587–592. [Google Scholar] [CrossRef] [PubMed]
  18. Valenzuela, R.M.; Kaufman, M.; Balashov, K.E.; Ito, K.; Buyske, S.; Dhib-Jalbut, S. Predictive cytokine biomarkers of clinical response to glatiramer acetate therapy in multiple sclerosis. J. Neuroimmunol. 2016, 15, 59–65. [Google Scholar] [CrossRef]
  19. Mindur, J.E.; Valenzuela, R.M.; Yadav, S.K.; Boppana, S.; Dhib-Jalbut, S.; Ito, K. IL-27: A potential biomarker for responders to glatiramer acetate therapy. J. Neuroimmunol. 2017, 15, 21–28. [Google Scholar] [CrossRef] [PubMed]
  20. Kruszewski, A.M.; Rao, G.; Tatomir, A.; Hewes, D.; Tegla, C.A.; Cudrici, C.D.; Nguyen, V.; Royal, W., 3rd; Bever, C.T., Jr.; Rus, V.; et al. RGC-32 as a potential biomarker of relapse and response to treatment with glatiramer acetate in multiple sclerosis. Exp. Mol. Pathol. 2015, 99, 498–505. [Google Scholar] [CrossRef]
  21. Tatomir, A.; Talpos-Caia, A.; Anselmo, F.; Kruszewski, A.M.; Boodhoo, D.; Rus, V.; Rus, H. The complement system as a biomarker of disease activity and response to treatment in multiple sclerosis. Immunol. Res. 2017, 65, 1103–1109. [Google Scholar] [CrossRef]
  22. Hewes, D.; Tatomir, A.; Kruszewski, A.M.; Rao, G.; Tegla, C.A.; Ciriello, J.; Nguyen, V.; Royal, W., 3rd; Bever, C.T., Jr.; Rus, V.; et al. SIRT1 as a potential biomarker of response to treatment with glatiramer acetate in multiple sclerosis. Exp. Mol. Pathol. 2017, 102, 191–197. [Google Scholar] [CrossRef]
  23. Ciriello, J.; Tatomir, A.; Hewes, D.; Boodhoo, D.; Anselmo, F.; Rus, V.; Rus, H. Phosphorylated SIRT1 as a biomarker of relapse and response to treatment with glatiramer acetate in multiple sclerosis. Exp. Mol. Pathol. 2018, 105, 175–180. [Google Scholar] [CrossRef]
  24. Tumani, H.; Kassubek, J.; Hijazi, M.; Lehmensiek, V.; Unrath, A.; Süssmuth, S.; Lauda, F.; Kapfer, T.; Fang, L.; Senel, M.; et al. Patterns of TH1/TH2 cytokines predict clinical response in multiple sclerosis patients treated with glatiramer acetate. Eur. Neurol. 2011, 65. [Google Scholar] [CrossRef]
  25. Lublin, F.D.; Reingold, S.C.; Cohen, J.A.; Cutter, G.R.; Sørensen, P.S.; Thompson, A.J.; Wolinsky, J.S.; Balcer, L.J.; Banwell, B.; Barkhof, F.; et al. Defining the clinical course of multiple sclerosis: The 2013 revisions. Neurology 2014, 83, 278–286. [Google Scholar] [CrossRef]
  26. Zetterberg, H.; Teunissen, C. Fluid biomarkers for disease activity in multiple sclerosis. Mult. Scler. J. 2017, 23, 1660–1661. [Google Scholar] [CrossRef]
Figure 1. ROC curve for CD4+/CD45RO+ at baseline in the validation group (IFN). Legend: The receiver-operating characteristic (ROC) curve (in bold) for the CD4+/CD45RO+ lymphocytes is shown. This lymphocyte parameter performed best to distinguish between CSP and non-CSP patients in this study. The presented curve was estimated on independent (test) data.
Figure 1. ROC curve for CD4+/CD45RO+ at baseline in the validation group (IFN). Legend: The receiver-operating characteristic (ROC) curve (in bold) for the CD4+/CD45RO+ lymphocytes is shown. This lymphocyte parameter performed best to distinguish between CSP and non-CSP patients in this study. The presented curve was estimated on independent (test) data.
Cells 08 00456 g001
Table 1. Descriptive characteristics and EDSS progression groups.
Table 1. Descriptive characteristics and EDSS progression groups.
CharacteristicAll (72)CSP (32)Non-CSP (40)Groups’ Comparison
p ValueEffect Size
EDSSBaseline2.40 ± 1.35 (2.00)2.42 ± 1.13 (2.00)2.38 ± 1.51 (1.5)0.4380.03
5 Years3.31 ± 1.7 (3.00)4.22 ± 1.37 (4.00)2.58 ± 1.59 (2.00)<0.0011.1
abs.0.91 ± 1.01 (0.50)1.80 ± 0.90 (1.50)0.20 ± 0.25 (0.00)<0.0012.56
rel. (%)47.43 ± 59.16 (28.57)92.35 ± 62.01 (87.50)11.50 ± 18.30 (0.00)<0.0011.86
CD3Baseline76.27 ± 7.1977.92 ± 7.0974.96 ± 7.080.0730.42
5 Years76.15 ± 7.0274.94 ± 6.8877.13 ± 7.060.190.31
abs.−0.12 ± 7.45−2.98 ± 7.972.17 ± 6.200.0040.73
rel. (%)0.35 ± 9.85−3.29 ± 10.153.27 ± 8.670.0040.7
CD8Baseline26.9 ± 6.5228.54 ± 7.5025.59 ± 5.360.0550.46
5 Years25.51 ± 5.9324.21 ± 4.9626.55 ± 6.480.0960.4
abs.−1.39 ± 6.52−4.33 ± 6.930.97 ± 5.14<0.0010.88
rel. (%)−2.53 ± 22.5−11.74 ± 20.644.84 ± 21.380.0010.79
Relative lymphocyte countBaseline29.45 ± 8.6826.28 ± 7.9131.98 ± 8.520.0050.69
5 Years30.94 ± 7.7829.16 ± 8.5232.37 ± 6.920.0820.42
abs.1.49 ± 9.92.88 ± 11.310.39 ± 8.600.2920.25
rel. (%)13.27 ± 44.2722.65 ± 56.165.77 ± 30.520.4210.39
CD4+/CD45RO+Baseline22.2 ± 6.3725.13 ± 5.8819.88 ± 5.83<0.0010.9
5 Years23.79 ± 6.1126.45 ± 5.3921.66 ± 5.870.0010.84
abs.1.46 ± 5.211.33 ± 6.151.56 ± 4.420.860.04
rel. (%)10.05 ± 25.538.74 ± 25.7511.09 ± 25.650.7090.09
CD3+/CD69+abBaseline0.06 ± 0.060.07 ± 0.050.05 ± 0.060.0430.32
5 Years0.03 ± 0.020.03 ± 0.010.03 ± 0.020.0610.41
abs.−0.03 ± 0.06−0.05 ± 0.05−0.02 ± 0.060.0040.43
rel. (%)−11.63 ± 78.81−39.76 ± 59.2110.42 ± 85.740.0030.67
Legend: The reported statistics are mean ± standard deviation, except for gender and EDSS (expanded disability status scale). Gender is summarized according to the frequency and proportion of females. The median is added (in brackets) to the mean and standard deviation of EDSS due to its positively skewed distribution. The effect size is assessed by Cohen’s D. All p values are reported after the Benjamini-Hochberg correction.
Table 2. Univariate logistic regression models for baseline values of lymphocyte parameters and multivariate models with adjustment by the covariates EDSS, age and gender.
Table 2. Univariate logistic regression models for baseline values of lymphocyte parameters and multivariate models with adjustment by the covariates EDSS, age and gender.
VariableUnivariate Logistic RegressionMultivariate Logistic Regression with Covariates
OR95% LCI OR95% UCI ORpR2OR95% LCI OR95% UCI ORpR2
EDSS1.030.721.460.8826<0.0010.920.611.380.70080.02
age1.030.981.090.3060.02
sex1.310.374.640.672<0.001
CD81.0811.170.06070.071.0811.180.04770.1
CD190.870.760.980.03670.190.880.7610.06010.21
Relative lymphocyte count0.920.850.970.0080.150.90.830.970.00770.17
CD3+/CD69+1.31.041.690.02970.191.311.041.710.02960.23
CD691.271.051.570.01780.231.261.041.560.02650.25
CD4+/CD45RO+1.171.071.310.0020.311.171.071.320.00270.32
CD4+/CD45RA+0.930.870.990.03590.180.930.8710.04810.21
CD3+/CD69+ab13411659.631.19E+120.02760.2714549618.831.36E+120.02770.29
CD4+/CD45RO+ab37.951.421536.950.03860.1841.791.22304.940.04940.21
Legend: OR, odds ratio; 95% LCI OR, lower 95% confidence limit of OR; 95% UCI, upper 95% confidence limit of OR; R2, Nagelkerke’s pseudo R squared to assess the quality of fit (the higher, the better).
Table 3. Multivariate logistic regression model and its adjustment by the covariates EDSS, age and gender.
Table 3. Multivariate logistic regression model and its adjustment by the covariates EDSS, age and gender.
VariableUnivariate Logistic RegressionMultivariate Logistic Regression with Covariates
OR95% LCI OR95% UCI ORpR2OR95% LCI OR95% UCI ORpR2
(Intercept)0.100.004.530.240.380.070.0010.680.320.39
Relative lymphocyte count0.960.881.040.330.950.861.040.31
CD3+/CD69+1.280.991.720.071.280.981.720.08
CD4+/CD45RO+1.121.011.270.041.131.021.290.03
CD4+/CD45RA+ab0.950.0426.110.981.100.0434.990.95
Legend: OR, odds ratio; 95% LCI OR, lower 95% confidence limit of OR; 95% UCI, upper 95% confidence limit of OR; R2, Nagelkerke’s pseudo R squared to assess the quality of fit (the higher, the better).
Table 4. The second multivariate logistic regression model and its adjustment by covariates: EDSS, age and gender.
Table 4. The second multivariate logistic regression model and its adjustment by covariates: EDSS, age and gender.
VariableMultivariate Logistic RegressionMultivariate Logistic Regression after Adjustment
OR95% LCI OR95% UCI ORpR2OR95% LCI OR95% UCI ORpR2
(Intercept)0.580614.570.8770.460.6903074.750.9290.54
CD81.030.921.160.61.030.921.160.6
CD190.920.781.060.2540.920.771.060.269
Relative lymphocyte count0.950.861.040.2560.940.831.040.219
CD3+/CD69+1.90.567.440.3211.970.587.690.295
CD691.030.681.550.8750.980.631.490.92
CD4+/CD45RO+1.010.821.260.9071.020.831.260.869
CD4+/CD45RA+0.950.861.040.2620.940.851.040.238
CD3+/CD69+ab001.67E+160.534002.29E+160.542
CD4+/CD45RO+ab74.450.0214747310.341125.860.0316303200.272
Legend: OR, odds ratio; 95% LCI OR, lower 95% confidence limit of OR; 95% UCI, upper 95% confidence limit of OR; R2, Nagelkerke’s pseudo R squared to assess the quality of fit (the higher, the better).
Table 5. Discriminative ability of cut-offs of parameters to correctly distinguish between CSP and non-CSP patients.
Table 5. Discriminative ability of cut-offs of parameters to correctly distinguish between CSP and non-CSP patients.
ParameterAUCCut-offSensitivitySpecificityAccuracy
Relative lymphocyte count64%<26.250%71%62%
CD3+/CD69+65%>2.2553%76%66%
CD4+/CD45RO+76%>22.5570%74%72.1%
CD4+/CD45RA+ab62%<0.43570%51%59.7%
Table 6. Validation of the predictive ability of the identified cut-offs on an independent data set (IFN).
Table 6. Validation of the predictive ability of the identified cut-offs on an independent data set (IFN).
ParameterAUCCut-offOld Cut-offs Verified on a New Independent Data Set (Testing Data Set—IFN Data)
SensitivitySpecificityAccuracy
Relative lymphocyte count58%<26.2049%77%62%
CD3+/CD69+53%>2.2572%39%57%
CD4+/CD45RO+60%>22.5572%36%56%
CD4+/CD45RA+ab56%<0.4472%43%59%
Table 7. Identification of new cut-offs in the interferon data (IFN) data.
Table 7. Identification of new cut-offs in the interferon data (IFN) data.
ParameterAUCCut-offSensitivitySpecificityAccuracy
Relative lymphocyte count58%<23.5038%86%61%
CD3+/CD69+53%>2.5570%43%57%
CD4+/CD45RO+60%>26.0060%67%62.9%
CD4+/CD45RA+ab56%<0.4574%43%59.6%
CD856%>25.3060%55%57%
CD6952%>3.1583%34%60%
CD3848%<54.0051%57%54%
CD3+/CD25+48%<4.9549%64%56%

Share and Cite

MDPI and ACS Style

Vališ, M.; Sobíšek, L.; Vyšata, O.; Klímová, B.; Andrýs, C.; Vokurková, D.; Masopust, J.; Pavelek, Z. CD4+/CD45RO+: A Potential Biomarker of the Clinical Response to Glatiramer Acetate. Cells 2019, 8, 456. https://doi.org/10.3390/cells8050456

AMA Style

Vališ M, Sobíšek L, Vyšata O, Klímová B, Andrýs C, Vokurková D, Masopust J, Pavelek Z. CD4+/CD45RO+: A Potential Biomarker of the Clinical Response to Glatiramer Acetate. Cells. 2019; 8(5):456. https://doi.org/10.3390/cells8050456

Chicago/Turabian Style

Vališ, Martin, Lukáš Sobíšek, Oldřich Vyšata, Blanka Klímová, Ctirad Andrýs, Doris Vokurková, Jiří Masopust, and Zbyšek Pavelek. 2019. "CD4+/CD45RO+: A Potential Biomarker of the Clinical Response to Glatiramer Acetate" Cells 8, no. 5: 456. https://doi.org/10.3390/cells8050456

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop