Next Article in Journal
Underlying Causes of Myocardial Infarction with Nonobstructive Coronary Arteries: Optical Coherence Tomography and Cardiac Magnetic Resonance Imaging Pilot Study
Previous Article in Journal
“Orphaned” Stomach—An Infrequent Complication of Gastric Bypass Revision
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

The Effects of Four Weeks of Chiropractic Spinal Adjustments on Blood Biomarkers in Adults with Chronic Stroke: Secondary Outcomes of a Randomized Controlled Trial

1
Centre for Chiropractic Research, New Zealand College of Chiropractic, Auckland 1060, New Zealand
2
Faculty of Health & Environmental Sciences, Health & Rehabilitation Research Institute, AUT University, Auckland 1010, New Zealand
3
Department of Health Science and Technology, Aalborg University, 9220 Aalborg, Denmark
4
Faculty of Rehabilitation and Allied Health Sciences and Department of Biomedical Engineering, Riphah International University, Islamabad 46000, Pakistan
5
Connor Whole Health, University Hospitals Cleveland Medical Center, Cleveland, OH 44106, USA
*
Authors to whom correspondence should be addressed.
J. Clin. Med. 2022, 11(24), 7493; https://doi.org/10.3390/jcm11247493
Submission received: 30 November 2022 / Revised: 9 December 2022 / Accepted: 15 December 2022 / Published: 17 December 2022
(This article belongs to the Section Clinical Neurology)

Abstract

:
Certain blood biomarkers are associated with neural protection and neural plasticity in healthy people and individuals with prior brain injury. To date, no studies have evaluated the effects chiropractic care on serum brain-derived neurotrophic factor (BDNF), insulin-like growth factor-II (IGF-II) and glial cell-derived neurotrophic factor (GDNF) in people with stroke. This manuscript reports pre-specified, exploratory, secondary outcomes from a previously completed parallel group randomized controlled trial. We evaluated differences between four weeks of chiropractic spinal adjustments combined with the usual physical therapy (chiro + PT) and sham chiropractic with physical therapy (sham + PT) on resting serum BDNF, IGF-II and GDNF in 63 adults with chronic stroke. Blood samples were assessed at baseline, four weeks (post-intervention), and eight weeks (follow-up). Data were analyzed using a linear multivariate mixed effects model. Within both groups there was a significant decrease in the mean log-concentration of BDNF and IGF-II at each follow-up, and significant increase log-concentration of GDNF at eight-weeks’ follow-up. However, no significant between-group differences in any of the blood biomarkers at each time-point were found. Further research is required to explore which factors influence changes in serum BDNF, IGF-II and GDNF following chiropractic spinal adjustments and physical therapy.

1. Introduction

Stroke is one of the leading causes of long-term disability and has significant physical, emotional, social and financial consequences on survivors and their families [1,2,3]. Spontaneous and rehabilitation-driven recovery is critical for improvement in post-stroke function [4,5,6]. The underlying mechanisms of recovery include cascades of cellular and molecular processes that induce neurogenesis, angiogenesis and neuroplasticity [7]. There is growing interest in understanding the changes in biomarkers accompanying stroke recovery, which may help personalize and improve stroke treatments [8,9].
Blood biomarkers are indicators found in blood that reflect underlying molecular or cellular events of behavioral state, disease state, or recovery, and may be used to examine treatment mechanisms and response to therapy [8]. Biomarkers can be measured in the central nervous system (CNS) or peripherally (via serum or plasma). Biomarkers, such as brain-derived neurotrophic factor (BDNF), glial cell-derived neurotrophic factor (GDNF) and insulin-like growth factor-II (IGF-II), are proteins associated with neural protection and neural plasticity in both healthy and injured brains [10,11].
The BDNF protein belongs to the neurotrophin family of growth factors [12,13,14,15] and is active in the hippocampus and areas of the brain responsible for learning, memory and thinking [16]. Insulin-like growth factor-II (IGF-II) is a protein-based hormone that shares structural similarities to insulin [17]. It is expressed by neurons as well as myocytes (i.e., as a myokine), is secreted by the liver, and can cross the blood brain barrier (BBB) to influence metabolic and endocrine function in the brain [18]. Along with the IGF system that includes IGF-I, receptors (IGF-I, IGF-II, and the insulin receptor) and IGF binding proteins, IGF-II plays a role in growth, metabolism and nervous system development and function [19,20,21]. In addition, IGF-I and IGF-II play a role in the repair of muscles in response to injury or exercise through their expression in skeletal muscle cells [22,23]. Specifically, IGF-II contributes to the maintenance of neurogenesis in the supraventricular zone and the hippocampus [24,25]. Another neurotrophin, GDNF, is expressed in the neurons of a healthy adult brain, and can also be expressed in the injured or diseased brain [26]. Expression of GDNF can promote axonal survival and growth, but prolonged overexpression or ectopic expression of GDNF can lead to abnormal neuronal sprouting [26]. GDNF supports other neurons like spinal motoneurons [23] and brain noradrenergic neurons [24], and regulates the survival, migration and differentiation of several peripheral neurons [25,26].
Motor rehabilitation is critical to stroke recovery [27,28,29,30,31,32]. Accumulated evidence has shown that motor rehabilitation programs consisting of repetitive task-specific training, such as constraint-induced movement therapy function (CIMT), robotic training, and body weight-supported treadmill training, promote neural plasticity for post-stroke recovery [27,28,29,30,31,32]. Currently, evidence suggests that physical activity can modulate central levels of GDNF [33,34,35] and both central and peripheral levels of BDNF and IGF-II [36,37,38]. Studies using animal stroke models have shown that multiple sessions of aerobic exercise can increase central BDNF concentrations, while BDNF responses following functional exercises, such as reaching and CIMT, are inconsistent [37]. In humans, peripheral BDNF levels have mainly been evaluated after an aerobic, strength, or endurance exercise program [39,40]. A meta-analysis of 11 studies including 303 individuals with neurological conditions found low-quality evidence supporting increased levels of BDNF following a program of aerobic exercise, while the results for a single bout of aerobic exercise were mixed [41]. Only one fair-quality study has evaluated the effect of multiple sessions of aerobic exercise plus physical therapy care in post-stroke individuals and reported increased serum BDNF levels [42]. However, there are no studies that have evaluated the effects of a single or multi-session exercise on serum IGF-II or GDNF levels in people with stroke.
Another intervention that may have the potential to enhance recovery after stroke is chiropractic care. Chiropractic care is a holistic health approach that focuses on correcting central segmental motor control (CSMC) problems in the spine, often referred to by chiropractors as vertebral subluxations, using spinal adjustments (i.e., manipulations) [43,44,45]. Stroke survivors commonly seek chiropractic care, potentially to treat painful musculoskeletal disorders such as myalgia that arise following stroke [46,47]. A study using national survey data (2017) from the United States reported that 9.2% of respondents with a stroke indicated they had seen a chiropractor in the previous 12 months [47]. Previously, case reports provided limited evidence to suggest that chiropractic spinal adjustments could potentially trigger a stroke. However, several large epidemiologic studies have instead found that there is no increase in risk of stroke following chiropractic spinal adjustments relative to primary care physician visits [48,49,50,51]. Chiropractic spinal adjustments therefore appear to be safe in the post-stroke population [47], provided there are no absolute contraindications to this therapy, such as cervical arterial dissection [52].
There is a growing body of evidence indicating that chiropractic spinal adjustments significantly influence the function of the CNS [44,53,54]. A single session of chiropractic spinal adjustment has been shown to modulate somatosensory processing, sensorimotor integration and motor control [44,53,55,56,57,58,59,60,61,62]. Sensorimotor integration is the ability of the CNS to integrate and transform sensory inputs from multiple sources within the body to task-specific motor actions [63]. Effective sensorimotor integration and accurate internal awareness of the position of limbs and body in space are important for learning new motor skills and recovering from CNS lesions [64,65,66,67,68].
Recently, chiropractic care has been shown to have a positive impact on motor function in chronic stroke patients [69,70]. In one study, a single session of chiropractic spinal adjustment significantly increased plantar flexor muscle strength in 12 stroke survivors [69]. In a follow-up study, when four weeks of chiropractic spinal adjustment was combined with physical therapy, it resulted in a greater improvement in motor function compared to physical therapy combined with sham chiropractic care [70]. Further research is now needed to investigate the mechanisms underlying these findings.
While research on this topic is limited, previous studies have reported that the mechanical stimulation of a chiropractic spinal adjustment may produce a neuro-immunomodulatory response and affect several biomarkers [71]. One study found that chiropractic spinal adjustment produced significant alterations in interferon-gamma, interleukin (IL)-5 and IL6 [71]. Another study found that this therapy reduced urine levels of tumor necrosis factor alpha [72]. An animal-based study reported increases in mechano growth factor, a variant of IGF-1, after chiropractic spinal adjustment [73]. Importantly, previous researchers have suggested that chiropractic spinal adjustment may stimulate the release of several neurotrophins, including BDNF; however, this has not been confirmed to date [74]. Accordingly, we sought to explore the effect of chiropractic spinal adjustment on biomarkers relevant to stroke recovery in individuals with chronic stroke.
It is currently not known if chiropractic spinal adjustments affect blood biomarkers associated with neural protection and neural plasticity in people with stroke. When investigating this research question it should be acknowledged that current interventions, such as physical therapy, are known to be beneficial to the recovery of stroke survivors [75,76]. These accepted interventions should not be withheld when investigating the impact of a relatively novel intervention. Therefore, this study aimed to investigate the effects of four weeks of chiropractic spinal adjustments combined with the usual physical therapy, compared to physical therapy alone on BDNF, IGF-II and GDNF levels in people with chronic stroke.
The current study represents unpublished secondary outcomes from a previously published randomized controlled trial (RCT) which examined the primary clinical outcome of motor function in the same patient population, with stroke receiving an identical intervention as described in the present manuscript [70]. Although the two manuscripts are related, it was not feasible to report the current secondary outcomes in the original RCT manuscript as there were several biomarkers studied which had a distinct collection methodology, statistical analysis plan and analysis. Readers should interpret the present manuscript with the awareness that the related RCT findings, as reported previously [70], identified that four weeks of combined chiropractic spinal adjustment and physiotherapy resulted in statistically significant, and likely clinically relevant, improvements in motor function, compared to a control group.

2. Materials and Methods

2.1. Design and Setting

This manuscript describes unpublished, pre-planned, secondary outcomes of exploratory biomarker analysis from a previously conducted parallel group RCT, the “Chiropractic Care Plus Physiotherapy Compared to Physiotherapy Alone in Chronic Stroke Patients Trial” (clinical trial registry: NCT03849794). The main RCT investigated the effects of four weeks of chiropractic spinal adjustments combined with the usual physical therapy on motor function in people with stroke [70]. Data were collected at the Rehabilitation Center of Railway General Hospital, Rawalpindi, Pakistan from January to June 2019. The Riphah International University Research Ethical Review Committee approved the study (Riphah/RCRS/REC/000458). All procedures performed in this study were in accordance with the 1964 Helsinki Declaration and its later amendments or comparable ethical standards.

2.2. Study Participants

Participants were recruited by telephone from the Railway General Hospital database. Potential participants were required to have suffered from a stroke at least 12 weeks prior to their participation in the trial and have previously completed a rehabilitation program at the hospital. To be eligible, volunteers had to have ongoing significant motor impairment, indicated by a score of 80 or less on the combined upper and lower limb Fugl-Meyer Assessment (FMA) of motor function [77]. Participants were ineligible if they showed no evidence of spinal dysfunction (i.e., no presence of vertebral subluxation indicators identified by a chiropractor), had absolute contraindications to spinal adjustments (history of spinal fracture, atlantoaxial instability, cervical arterial dissection, spinal infection, spinal tumor, or cauda equina syndrome) or previously had an adverse event in response to chiropractic adjustment(s). Written consent was obtained from all volunteers before participation in the study.

2.3. Interventions

The study interventions were either four weeks of chiropractic adjustments plus physical therapy (chiro + PT), or four weeks of sham chiropractic adjustments plus physical therapy (sham + PT). As this was an exploratory study, a standalone chiropractic intervention was not considered as it would have meant withholding an intervention known to be effective in order to evaluate a novel intervention [76].

2.3.1. Chiropractic Intervention

The chiro + PT group were assessed for CSMC problems by New Zealand registered chiropractors approximately three times per week for four weeks and adjusted when necessary. The clinical indicators for CSMC problems that were used in this study are routinely used by chiropractors when analyzing the spine and included tenderness to palpation, restricted intersegmental motion, asymmetric muscle tension and altered joint-play [78]. These clinical indicators have previously been shown to be reliable when identifying CSMC problems when used as part of a multidimensional battery of tests [78,79]. Chiropractic adjustments included high-velocity, low-amplitude thrusts or instrument assisted thrusts to any region of the spine or pelvic joints [80]. The choice of spinal level(s) to adjust was left to the discretion of the chiropractor and generally involved adjustments to multiple levels on each visit. Chiropractic visits lasted approximately 15 min and no other interventions were provided by the chiropractor.

2.3.2. Sham Chiropractic Intervention

Due to the manual nature of the intervention, blinding of participants in trials receiving physical interventions is usually challenging [81,82]. One advantage of performing this study in Pakistan was that chiropractic is relatively unknown [83]. A recent survey found that more than 67% of university students studying pharmacy in Lahore, Pakistan, were unaware that chiropractic care was related to spinal manipulation and that it is often used as a low back pain intervention [83]. This lack of knowledge about chiropractic provided a unique opportunity to study chiropractic’s effects with the enhanced potential of successful participant blinding. To reduce the impact of contextual effects on study outcomes, the control group received a sham chiropractic intervention.
Participants in the sham + PT group also saw a chiropractor approximately three times per week for four weeks. The chiropractor performed a similar assessment as the chiro + PT group, however, no thrusts to the spine were applied. Instead, the participant was positioned as if a thrust was going to be provided, but no thrust was given. Alternatively, an adjusting instrument was set to the minimum setting and placed on the chiropractor’s hand or arm, lateral to the spine, and a clicking sound was produced with the instrument. To assess how effective participant blinding was, participants in both groups were asked to indicate whether they perceived they had received active chiropractic care after the four-week intervention period was complete.

2.3.3. Physical Therapy Intervention

Approximately 40 min of intensive physical therapy intervention was delivered three times per week to both the groups during the four-week intervention period. The physical therapy program consisted of muscle stretching and strengthening, sitting and standing balance training, sit-to-stand practice, transfer practices relative to patient needs, walking, stair climbing, upper limb functional training (reach, grasp and hand to mouth activities), muscle tone inhibition techniques, postural stability control, sensory techniques and functional daily activities. Occasionally, depending on the participants requirements, hot packs and transcutaneous electrical nerve stimulation were used to reduce pain or promote muscle relaxation [84]. Participants were also encouraged to continue performing exercises at home where appropriate. The physical therapists providing care in the study were experienced and qualified in treating neurological disorders. The physical therapy intervention did not include any spinal manipulation or mobilization.

2.4. Outcome Measures

Serum levels of BDNF, IGF-II and GDNF were used as outcome measures. Levels of serum BDNF, IGF-II and GDNF were assessed prior to the intervention, at four weeks of the intervention and at eight weeks as a follow-up assessment. A five-milliliter venous blood sample was collected in an anticoagulant free tube (EDTA K3). Samples were kept for an hour at 4 °C before the serum was isolated. Serum was then stored at −80 °C for batch assessment. Serum levels of BDNF, IGF-II and GDNF were measured by a sandwich, two-site enzyme linked immunoassay (ELISA) using the BDNF, IGF-II and GDNF Elabscience® Immunassay System reagents. Optical density (OD) was determined by using a micro-plate reader set to 450 nanometers. Four-parameter logistic curves were plotted between standard concentration and OD values. These procedures were performed at the Riphah Institute of Pharmacology Sciences, Riphah International University, Islamabad, Pakistan.

2.5. Randomization and Blinding

Following assessment for eligibility, an online minimization tool (QMinim, Telethon Kids Institute, Perth, Australia) was used to randomly assign participants to the chiro + PT or sham + PT group [85]. Fugl-Meyer Assessment (FMA) score, gender and age at baseline were entered as prognostic factors for minimization. All participants, outcome assessors and physical therapists providing the physical therapy intervention were blinded to group allocation. The technician who ran the ELISA procedure, the data analysts and the statistician who analyzed the data were also blinded to group allocation. This was accomplished by allocating a code to all the recorded data prior to sending for analysis. The chiropractic providers could not be blinded to group allocation.

2.6. Statistical Analysis

The null hypothesis for this study was that there would be no difference between groups in any of the blood biomarker concentrations at either of the two post-intervention time-points. Blood biomarker concentration data was collated in Microsoft Excel (Microsoft Corp. Redmond, WA, USA) and exported to R statistical computing environment (version 4.02) for analysis [86]. A detailed report of the statistical analysis is available as a Supplementary File.
Normality of blood biomarker concentrations was evaluated using QQ-plots. The concentration for all biomarkers—BDNF, GDNF and IGF-II—was not normally distributed. To mitigate the non-normality, natural log transformations were applied, and the remaining analysis was conducted and reported using log-concentrations. The blood biomarker concentration along with independent variables including biomarker type, participants, group and time comprised a hierarchical longitudinal data structure having within-participant correlations and loss-to-follow-up.
To match the needs of the data structure, a linear multivariate mixed effects model was constructed [87]. This model included log-concentration from the three biomarkers as the dependent variables. It had Outcome (BDNF, GDNF, IGF-II), Time (Baseline, four weeks, and eight weeks), Group (chiro + PT and sham + PT), and their two-way and three-way interactions as fixed effect independent categorical variables. Baseline was added as a time point rather than as a covariate because the concentration data were found to lack a linear relationship between baseline and post-intervention values. To cater to within-participant correlations, a random effects variance-covariance structure was also added. This random-effects structure estimated random intercepts for each participant separately for each outcome and allowed for between-outcome correlations. Positive definiteness was the only constraint on this structure which allowed correlations to take any value. From this model, a multivariate analysis of variance table was generated. Between-group mean differences and within group means were also estimated along with their standard errors and 95% confidence intervals. Between-group differences were computed at the four-week and eight-week time points while subtracting the baseline mean values to adjust for baseline differences. The statistical significance level was set at 0.05.

3. Results

Out of 100 individuals with stroke who were screened for eligibility, 63 adults were eligible and were recruited between January and March 2019 (See study flow in Figure 1 and baseline demographic characteristics in Table 1). Fifty-five participants completed the four-week assessment and eight participants dropped out during the first four weeks of the study due to issues with caregiver availability or transportation limitations. There was a substantial number of dropouts between the four- and eight-week assessments that resulted in 38 participants completing the eight-week assessment. The loss-to-follow-up was due to the inability of some participants to stay away from their home longer than the duration of the active intervention, as they had travelled from surrounding regions with their caregivers so they could be involved in the study. There were no adverse events or reports of harm noted during the study.

3.1. Within and between-Group Comparisons

Table 2 shows a significant two-way interaction between outcome and time, which means that the change of log-concentration across the three time points was different for the different blood biomarkers. For example, for IGF-II, the log concentration decreased across the time points, whereas, for GDNF, the log concentration followed an entirely different change across the time points. However, no significant interaction of Group at any level was present. The main effect of Group is also not significant. This suggests that there were no differences between the two groups in any of the blood biomarkers, at either the four- or eight-week time-points. The estimated marginal means for chiropractic plus physical therapy and sham chiropractic plus physical therapy at the three time points is given in Table 3.

3.2. Between-Group Differences

Table 4 summarizes the mean between group difference scores in log-concentration units. None of these mean differences were statistically significant.

3.3. Within-Group Estimates

Within-group means along with their confidence intervals at the three time points are plotted in Figure 2. Mean log-concentration of BDNF and IGF-II significantly decreased over time at four and eight weeks in both chiro + PT and sham + PT groups. The log-concentration of GDNF did not vary from baseline to the four-week time point but significantly increased at the eight-week time point for both groups.

4. Discussion

These secondary RCT outcomes represent the first multi-session study to evaluate the effects of chiropractic adjustments on serum BDNF, IGF-II and GDNF in people with stroke. In both groups there was a significant decrease in the serum levels of BDNF and IGF-II over time, with a significant increase in serum GNDF levels at the eight-weeks follow-up. No significant between-group differences were found. This suggests that the addition of chiropractic care to a physical therapy program did not significantly alter the impact of physical therapy alone on these biomarkers.
The significant decrease in BDNF levels observed in the present study supports the findings from previous studies that showed decreased serum BDNF levels after single or multi-session aerobic exercise training in people with chronic stroke [88,89,90,91,92]. A significant decrease in serum BDNF was noted in people with chronic stroke who underwent a 36-session moderate-intensity (60% VO2 peak) continuous training program on a bicycle ergometer. Mild-intensity treadmill training [89,90], moderate-intensity continuous treadmill training [91], high-intensity treadmill training [89,90,92] and total-body ergometers [89] were also reported to decrease serum BDNF levels in people with chronic stroke. A significant reduction was also noted when serum BDNF levels were compared between week one and week three of acute inpatient stroke rehabilitation [93].
In contrast, other studies have found increased serum BDNF levels in individuals with stroke following rehabilitative programs. Eight weeks of aerobic exercise training after physical therapy in people with sub-acute and chronic stroke resulted in increased serum BDNF levels compared to physical therapy alone, which led to no significant change in serum BDNF levels [42]. One study in 2018 reported an increase in serum BDNF levels in people with chronic stroke after a single-session walking task [88]. Another recent study found that augmented reality-based rehabilitation consisting of motor rehabilitation using motion sensors and augmented reality significantly increased serum BDNF levels and improved motor function in people with sub-acute stroke [94]. An increase in serum BDNF levels has also been reported immediately after a single session of exercise in people with chronic stroke [88].
Brain-derived neurotrophic factor is an important regulator of neural regeneration and recovery [15,95,96,97]. An activity-driven increase in peri-infarct BDNF has been shown to promote motor recovery after stroke [98]. While the evidence regarding increases or decreases in BDNF levels with treatment is contradictory and somewhat confusing [99], there are several possible explanations for this predicament. Previous studies have suggested that increases in BDNF levels occur only after moderate-intensity physical exercise. Morais et al. (2018) reported a pre-post increase in serum BDNF levels in people with chronic stroke after a single session moderate-intensity walking task [88]. King et al. (2019) found no change in pre-post serum BDNF levels after a single session of incremental maximal aerobic exercise in people with chronic stroke [92]. The authors hypothesized that the participants’ reduced physical capacity might have prevented them from achieving the optimal intensity to induce a change in BDNF levels. Notably, increased problem-solving and reasoning ability (i.e., fluid intelligence) predicted larger increases in BDNF levels after exercise [92]. As similar brain areas are thought to be necessary for both fluid intelligence and cognition [100], impairment in cognition may influence the change in BDNF levels. However, a direct relationship between fluid intelligence and exercise dependent BDNF levels is yet to be explored. Inadequate exercise duration was speculated as another reason for the lack of change in BDNF levels, as the duration of the incremental maximal exercise was shorter than other protocols that reported an increase in BDNF [92]. A significant change with a large effect size was found when the average volume of hours spent exercising was over 20 ± 20 h in a three-to-eight-week program [41]. Whereas, those who exercised less, but over more weeks (12.9 ± 3.9 h over a length of four-to-24 weeks), did not exhibit any significant difference [41]. Studies on animals and healthy individuals have also shown that exercise-induced increases in BDNF levels require sufficient intensity [101] and duration [102] of exercise to significantly change. Therefore, exercise intensity, exercise duration and presence of cognitive impairment may be essential factors for exercise-induced changes in serum BDNF levels. In the present study, the intensity and duration of the interventions may have been insufficient to induce an increase in the serum BDNF levels.
Another factor responsible for the decrease in BDNF level estimates may be the timing of BDNF measurement. An RCT on people with progressive multiple sclerosis reported a significant increase in serum BDNF levels after 30 min of bicycling, which decreased below baseline levels when measured 30 min post-exercise [103]. A systematic review also revealed that the increase in BDNF levels after acute aerobic exercise and/or training were not long-lasting in healthy individuals as well as those with chronic disease or disability [40]. A transient increase in peripheral BDNF was reported in 69% of the studies of healthy individuals and 86% of the studies of people with chronic disease or disability [40]. The lack of a long-lasting effect was speculated to be due to absorption of BDNF by central tissues (via the BBB) and use/clearance in the peripheral tissues, effectively normalizing BDNF levels post-exercise [40]. Therefore, the timing of BDNF measurement may explain the decrease in serum BDNF found in our study, as the blood samples were collected 30 min to 24 h after the completion of a four-week intervention program.
Lastly, the observed decrease in BDNF levels could also be attributed to a mutation in the BDNF gene, referred to as Val66Met polymorphism. The BDNF val66met polymorphism impairs the beneficial effects induced by physical exercise [104] and results in 18% to 30% less activity-dependent release of BDNF [105]. In people with stroke, presence of the BDNF val66met polymorphism is associated with decreased brain activation in the primary sensorimotor cortex contralateral to the movement [106] as well as slower or reduced behavioral recovery from stroke [107]. In the present study, as the genotype of included participants was not evaluated, it is not known if the decrease in BDNF estimates was related to the BDNF val66met polymorphism. However, it must be noted that val66met is a common polymorphism present in humans and is more frequent in Asian populations compared to Caucasian ones [108]. Future studies may consider including genetic testing for val66met polymorphism to determine its influence on the findings.
In the present study, a statistically significant decrease in IGF-II levels was noted in both groups across time. To date, there are no studies that have evaluated the effects of a single session of exercise or chiropractic care on serum IGF-II levels in people with stroke. Studies on healthy individuals are limited and have reported inconsistent findings. An RCT including 34 elderly Korean women found that 10 weeks of combined resistance and aerobic exercise increased IGF-II levels in the intervention group as compared to the control group [38], however, this study was limited as the results were inferred from the interaction effect (time × group) on the levels of IGF-II (F = 8.592, p = 0.006), rather than the main effect of groups. In addition, the lack of reporting on the blinding and randomization processes and the choice of statistical analysis (repeated analysis of variance for a between-subject design) further suggest that these results should be interpreted with caution. Studies evaluating the effect of a single exercise session on serum IGF-II have either reported no change [109] or an increase in IGF-II levels [110,111]. A crossover RCT including seven healthy men reported no change in levels of total IGF-II when evaluated immediately after a single, brief, high-intensity exercise, or after a delay of 10-, 20- or 30-min post-exercise [109]. In contrast, a crossover RCT [111] reported an increase in serum IGF-II in 10 healthy men when evaluated immediately after a single session of high-intensity exercise on a cycle ergometer. However, IGF-II returned to baseline levels when evaluated after 10-, 20-, 30-, 40- and 50-min post-exercise [111]. The authors speculated that the change in serum IGF-II levels may have been dependent on the intensity of exercise as the increase in serum IGF-II estimates with low-intensity exercise did not reach statistical significance [111]. A significant increase was also noted with a single session of moderate-intensity endurance exercise when six untrained healthy individuals were evaluated 10 min post-exercise [112]. However, based on the literature on IGF-I levels in people with stroke, a related blood marker, the decrease in IGF-II observed in our study may be due to absorption of IGF-II across the BBB [112]. More studies are needed to further understand changes observed in IGF-II in people with stroke.
Lastly, significantly increased GDNF levels were noted at the eight-week follow-up in both groups in the present study. The function and expression of GDNF could be regulated by physical activity. Studies in rodents have shown that short-term and long-term exercise increases the expression of GDNF in different CNS structures [35,113]. In one of these studies, GDNF increased significantly in the striatum corresponding to the overused limb subjected to forced limb use by applying a cast on the other limb [35]. Another study showed that both passive and active exercise increased GDNF in the spinal cord of young rats [113]. Whereas in stroke, due to the occlusion of the middle cerebral artery in rats, GDNF receptors were upregulated in the cerebral cortex and striatum, which are two structures affected by lack of blood supply [34,114].

Limitations, Implications and Future Research

A limitation of the present study was that blood samples were not evaluated immediately after each intervention, yet instead were collected at four-week intervals, thus not revealing any potential acute post-adjustment or post-exercise changes. As activity-induced changes in biomarkers may be transient, particularly for BDNF [40], evaluating the time course of change in biomarkers can be explored in further research. The present study did not track patients’ heart rate, VO2max or other measures of exercise intensity, which could have affected the magnitude or directionality of change in biomarkers. This study is also limited by the lack of information on participants’ genotypes, for example, the presence or absence of the BDNF val66met polymorphism. As this study included chronic stroke patients of a mean age of over 50, it is possible that physical and/or cognitive impairments limited participants’ exercise intensity and subsequent biomarker changes. The present study lacked an a-priori sample size calculation for the studied secondary outcomes, as the sample was designed to sufficiently power the primary objectives in the main RCT.
The secondary outcomes in the present study explored the potential of combining chiropractic adjustments with physical therapy to change serum BDNF, GDNF and IGF-II levels in people with chronic stroke. In our previously published RCT, which included the same 63 patients with stroke, statistically significant improvements in motor function were seen in both chiro + PT and sham + PT groups [70]. Importantly, the chiro + PT group had greater motor function improvements than sham + PT [70]. However, the current study did not show any differences between chiro + PT compared to PT alone on serum BDNF, GDNF and IGF-II levels. The current study findings therefore suggest that the previously demonstrated greater improvements in motor function in the chiro + PT group are not the result of changes in BDNF, GDNF and IFG-II. However, we cannot rule out that the overall change seen in blood biomarkers in both groups could relate to the motor improvements seen in both groups in the main RCT. Further research is needed to elucidate the factors that influence changes in BDNF, GDNF and IGF-II levels in people with stroke receiving physical therapy and chiropractic adjustments.

5. Conclusions

The present secondary RCT outcomes demonstrated significant changes in BDNF, GDNF and IGF-II levels in people with chronic stroke who received a chiropractic + physical therapy intervention and in those who received a sham chiropractic + physical therapy intervention. However, including chiropractic spinal adjustments in the intervention did not cause significant differences in these changes. These findings suggest that motor function improvements following chiropractic spinal adjustment in individuals with stroke are not explained by changes in BDNF, GDNF and IGF-II. The changes in BDNF, GDNF and IGF-II in both groups may be related to several variables including the intensity and duration of the intervention, timing of measurement, genetic polymorphism and cognitive impairment, which may be clarified in future studies.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/jcm11247493/s1, File S1: Stats Reort:The effects of four weeks of chiropractic spinal adjustments on blood biomarkers in adults with chronic stroke: A randomized controlled trial. File S2: CONSORT 2010 checklist of information to include when reporting a randomised trial.

Author Contributions

Conceptualization, H.H., I.K.N., I.A., N.K., J.D., M.S.N., R.J.T., M.S. and K.H.; Data curation, I.A., N.K., U.R. and J.D.; Formal analysis, I.K.N., I.A., U.R. and M.S.N.; Funding acquisition, H.H., I.K.N., M.S. and K.H.; Investigation, H.H., I.K.N., I.A., N.K., U.R., R.J.T., M.S. and K.H.; Methodology, H.H., I.K.N., I.A., N.K., U.R., M.S.N., R.J.T., M.S. and K.H.; Project administration, I.K.N., M.S. and K.H.; Resources, H.H., I.A., J.D. and M.S.; Software, U.R., M.S.N. and K.H.; Supervision, H.H. and M.S.; Validation, I.K.N., I.A., U.R., M.S.N. and K.H.; Visualization, U.R. and M.S.N.; Writing—original draft, I.K.N., I.A., N.K., R.J.T. and K.H.; Writing—review & editing, H.H., I.K.N., I.A., N.K., U.R., J.D., M.S.N., R.J.T., M.S. and K.H. All authors have read and agreed to the published version of the manuscript.

Funding

This study was funded by Centre for Chiropractic Research Supporters Program at the New Zealand College of Chiropractic.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki. The Ethics Committee of Riphah International University approved the study (Riphah/RCRS/REC/000458).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Reasonable requests for data can be made to the corresponding author but ethics committee approval will needed to be granted prior to sharing any data.

Acknowledgments

The authors thank all the patients and the staff from Rehabilitation Center of Railway General Hospital, Rawalpindi, Pakistan who contributed to this study.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Benjamin, E.J.; Muntner, P.; Alonso, A.; Bittencourt, M.S.; Callaway, C.W.; Carson, A.P.; Chamberlain, A.M.; Chang, A.R.; Cheng, S.; Das, S.R.; et al. Heart disease and stroke statistics—2019 update: A report from the American heart association. Circulation 2019, 139, e56–e528. [Google Scholar] [CrossRef] [PubMed]
  2. Bennett, D.A.; Krishnamurthi, R.V.; Barker-Collo, S.; Forouzanfar, M.H.; Naghavi, M.; Connor, M.; Lawes, C.M.; Moran, A.E.; Anderson, L.M.; Roth, G.A.; et al. The Global Burden of Ischemic Stroke: Findings of the GBD 2010 Study. Glob. Heart 2014, 9, 107–112. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  3. Kaji, R. Global burden of neurological diseases highlights stroke. Nat. Rev. Neurol. 2019, 15, 371–372. [Google Scholar] [CrossRef]
  4. Murphy, T.H.; Corbett, D. Plasticity during stroke recovery: From synapse to behaviour. Nat. Rev. Neurosci. 2009, 10, 861–872. [Google Scholar] [CrossRef] [PubMed]
  5. Carey, L. Neuroplasticity and learning lead a new era in stroke rehabiliation. Int. J. Ther. Rehabil. 2007, 14, 250–251. [Google Scholar] [CrossRef]
  6. Krakauer, J.W. Motor learning: Its relevance to stroke recovery and neurorehabilitation. Curr. Opin. Neurol. 2006, 19, 84–90. [Google Scholar] [CrossRef]
  7. Ng, K.L.; Carmichael, S.T. Chapter 35—Mechanisms of Stroke Recovery. In Primer on Cerebrovascular Diseases, 2nd ed.; Caplan, L.R., Biller, J., Leary, M.C., Lo, E.H., Thomas, A.J., Yenari, M., Zhang, J.H., Eds.; Academic Press: San Diego, CA, USA, 2017; pp. 171–174. [Google Scholar]
  8. Burke, E.; Cramer, S.C. Biomarkers and Predictors of Restorative Therapy Effects After Stroke. Curr. Neurol. Neurosci. Rep. 2013, 13, 329. [Google Scholar] [CrossRef]
  9. Gandolfi, M.; Smania, N.; Vella, A.; Picelli, A.; Chirumbolo, S. Assessed and Emerging Biomarkers in Stroke and Training-Mediated Stroke Recovery: State of the Art. Neural Plast. 2017, 2017, 1389475. [Google Scholar] [CrossRef] [Green Version]
  10. Beck, K.D.; Valverde, J.; Alexi, T.; Poulsen, K.; Moffat, B.; Vandlen, R.A.; Rosenthal, A.; Hefti, F. Mesencephalic dopaminergic neurons protected by GDNF from axotomy-induced degeneration in the adult brain. Nature 1995, 373, 339–341. [Google Scholar] [CrossRef]
  11. Duarte, E.; Curcio, M.; Canzoniero, L.M.; Duarte, C.B. Neuroprotection by GDNF in the ischemic brain. Growth Factors 2012, 30, 242–257. [Google Scholar] [CrossRef]
  12. Binder, D.K.; Scharfman, H.E. Brain-derived neurotrophic factor. Growth Factors 2004, 22, 123. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  13. Baydyuk, M.; Xu, B. BDNF signaling and survival of striatal neurons. Front. Cell. Neurosci. 2014, 8, 254. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  14. Schabitz, W.-R.; Steigleder, T.; Cooper-Kuhn, C.M.; Schwab, S.; Sommer, C.; Schneider, A.; Kuhn, H.-G. Intravenous Brain-Derived Neurotrophic Factor Enhances Poststroke Sensorimotor Recovery and Stimulates Neurogenesis. Stroke 2007, 38, 2165–2172. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  15. Ploughman, M.; Windle, V.; MacLellan, C.L.; White, N.; Doré, J.J.; Corbett, D. Brain-Derived Neurotrophic Factor Contributes to Recovery of Skilled Reaching after Focal Ischemia in Rats. Stroke 2009, 40, 1490–1495. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  16. Tyler, W.J.; Alonso, M.; Bramham, C.R.; Pozzo-Miller, L.D. From Acquisition to Consolidation: On the Role of Brain-Derived Neurotrophic Factor Signaling in Hippocampal-Dependent Learning. Learn. Mem. 2002, 9, 224–237. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  17. Nakae, J.; Kido, Y.; Accili, D. Distinct and overlapping functions of insulin and IGF-I receptors. Endocr. Rev. 2001, 22, 818–835. [Google Scholar] [CrossRef]
  18. Reinhardt, R.R.; Bondy, C.A. Insulin-like growth factors cross the blood-brain barrier. Endocrinology 1994, 135, 1753–1761. [Google Scholar] [CrossRef]
  19. Barzilai, N.; Huffman, D.M.; Muzumdar, R.H.; Bartke, A. The Critical Role of Metabolic Pathways in Aging. Diabetes 2012, 61, 1315–1322. [Google Scholar] [CrossRef] [Green Version]
  20. O’Kusky, J.; Ye, P. Neurodevelopmental effects of insulin-like growth factor signaling. Front. Neuroendocr. 2012, 33, 230–251. [Google Scholar] [CrossRef] [Green Version]
  21. Baptista, P.; Andrade, J.P. Adult Hippocampal Neurogenesis: Regulation and Possible Functional and Clinical Correlates. Front. Neuroanat. 2018, 12, 44. [Google Scholar] [CrossRef] [Green Version]
  22. Jiao, S.; Ren, H.; Li, Y.; Zhou, J.; Duan, C.; Lu, L. Differential regulation of IGF-I and IGF-II gene expression in skeletal muscle cells. Mol. Cell. Biochem. 2013, 373, 107–113. [Google Scholar] [CrossRef] [PubMed]
  23. Zanou, N.; Gailly, P. Skeletal muscle hypertrophy and regeneration: Interplay between the myogenic regulatory factors (MRFs) and insulin-like growth factors (IGFs) pathways. Cell. Mol. Life Sci. 2013, 70, 4117–4130. [Google Scholar] [CrossRef] [PubMed]
  24. Ziegler, A.N.; Levison, S.; Wood, T. Insulin and IGF receptor signalling in neural-stem-cell homeostasis. Nat. Rev. Endocrinol. 2015, 11, 161. [Google Scholar] [CrossRef] [Green Version]
  25. Alberini, C.M.; Chen, D.Y. Memory enhancement: Consolidation, reconsolidation and insulin-like growth factor 2. Trends Neurosci. 2012, 35, 274–283. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  26. Azevedo, M.D.; Sander, S.; Tenenbaum, L. GDNF, A Neuron-Derived Factor Upregulated in Glial Cells during Disease. J. Clin. Med. 2020, 9, 456. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  27. Høyer, E.; Jahnsen, R.; Stanghelle, J.K.; Strand, L.I. Body weight supported treadmill training versus traditional training in patients dependent on walking assistance after stroke: A randomized controlled trial. Disabil. Rehabil. 2012, 34, 210–219. [Google Scholar] [CrossRef]
  28. Langhorne, P.; Coupar, F.; Pollock, A. Motor recovery after stroke: A systematic review. Lancet Neurol. 2009, 8, 741–754. [Google Scholar] [CrossRef]
  29. Liepert, J.; Bauder, H.; Miltner, W.H.R.; Taub, E.; Weiller, C. Treatment-Induced Cortical Reorganization After Stroke in Humans. Stroke 2000, 31, 1210–1216. [Google Scholar] [CrossRef] [Green Version]
  30. Takeuchi, N.; Izumi, S.-I. Rehabilitation with Poststroke Motor Recovery: A Review with a Focus on Neural Plasticity. Stroke Res. Treat. 2013, 2013, 128641. [Google Scholar] [CrossRef] [Green Version]
  31. Volpe, B.; Krebs, H.I.; Hogan, N.; Edelsteinn, L.; Diels, C.M.; Aisen, M.L. Robot training enhanced motor outcome in patients with stroke maintained over 3 years. Neurology 1999, 53, 1874. [Google Scholar] [CrossRef]
  32. Wolf, S.L.; Winstein, C.J.; Miller, J.P.; Taub, E.; Uswatte, G.; Morris, D.; Giuliani, C.; Light, K.E.; Nichols-Larsen, D.; EXCITE Investigators. Effect of constraint-induced movement therapy on upper extremity function 3 to 9 months after stroke: The EXCITE randomized clinical trial. JAMA 2006, 296, 2095–2104. [Google Scholar] [CrossRef]
  33. Afzalpour, M.E.; Chadorneshin, H.T.; Foadoddini, M.; Eivari, H.A. Comparing interval and continuous exercise training regimens on neurotrophic factors in rat brain. Physiol. Behav. 2015, 147, 78–83. [Google Scholar] [CrossRef] [PubMed]
  34. Arvidsson, A.; Kokaia, Z.; Airaksinen, M.; Saarma, M.; Lindvall, O. Stroke induces widespread changes of gene expression for glial cell line-derived neurotrophic factor family receptors in the adult rat brain. Neuroscience 2001, 106, 27–41. [Google Scholar] [CrossRef] [PubMed]
  35. Cohen, A.D.; Tillerson, J.L.; Smith, A.D.; Schallert, T.; Zigmond, M.J. Neuroprotective effects of prior limb use in 6-hydroxydopamine-treated rats: Possible role of GDNF. J. Neurochem. 2003, 85, 299–305. [Google Scholar] [CrossRef] [PubMed]
  36. Szuhany, K.L.; Bugatti, M.; Otto, M.W. A meta-analytic review of the effects of exercise on brain-derived neurotrophic factor. J. Psychiatr. Res. 2015, 60, 56–64. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  37. Alcantara, C.C.; García-Salazar, L.-F.; Silva-Couto, M.A.; Santos, G.L.; Reisman, D.S.; Russo, T. Post-stroke BDNF Concentration Changes Following Physical Exercise: A Systematic Review. Front. Neurol. 2018, 9, 637. [Google Scholar] [CrossRef] [PubMed]
  38. So, W.-Y.; Han, T.-K. Effect of ten weeks of combined exercise on growth hormone, insulin-like growth factor-2 and myostatin levels in elderly Korean women. S. Afr. J. Res. Sport Phys. Educ. Recreat. 2016, 38, 61–67. [Google Scholar]
  39. Dinoff, A.; Herrmann, N.; Swardfager, W.; Liu, C.S.; Sherman, C.; Chan, S.; Lanctôt, K.L. The Effect of Exercise Training on Resting Concentrations of Peripheral Brain-Derived Neurotrophic Factor (BDNF): A Meta-Analysis. PLoS ONE 2016, 11, e0163037. [Google Scholar] [CrossRef] [Green Version]
  40. Knaepen, K.; Goekint, M.; Heyman, E.; Meeusen, R. Neuroplasticity—Exercise-Induced Response of Peripheral Brain-Derived Neurotrophic Factor. Sports Med. 2010, 40, 765–801. [Google Scholar] [CrossRef]
  41. Mackay, C.P.; Kuys, S.S.; Brauer, S.G. The Effect of Aerobic Exercise on Brain-Derived Neurotrophic Factor in People with Neurological Disorders: A Systematic Review and Meta-Analysis. Neural Plast. 2017, 2017, 4716197. [Google Scholar] [CrossRef] [Green Version]
  42. El-Tamawy, M.S.; Abd-Allah, F.; Ahmed, S.M.; Darwish, M.H.; Khalifa, H.A. Aerobic exercises enhance cognitive functions and brain derived neurotrophic factor in ischemic stroke patients. Neurorehabilitation 2014, 34, 209–213. [Google Scholar] [CrossRef] [PubMed]
  43. Rosner, A.L. Chiropractic identity: A neurological, professional, and political assessment. J. Chiropr. Humanit. 2016, 23, 35–45. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  44. Haavik, H.; Murphy, B. The role of spinal manipulation in addressing disordered sensorimotor integration and altered motor control. J. Electromyogr. Kinesiol. 2012, 22, 768–776. [Google Scholar] [CrossRef]
  45. Haavik, H.; Kumari, N.; Holt, K.; Niazi, I.K.; Amjad, I.; Pujari, A.N.; Türker, K.S.; Murphy, B. The contemporary model of vertebral column joint dysfunction and impact of high-velocity, low-amplitude controlled vertebral thrusts on neuromuscular function. Eur. J. Appl. Physiol. 2021, 121, 2675–2720. [Google Scholar] [CrossRef]
  46. Vining, R.D.; Salsbury, S.A.; Cooley, W.C.; Gosselin, D.; Corber, L.; Goertz, C.M. Patients receiving chiropractic care in a neurorehabilitation hospital: A descriptive study. J. Multidiscip. Health 2018, 11, 223. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  47. Kohl-Heckl, W.K.; Koch, A.K.; Cramer, H. Complementary medicine use in stroke survivors: A US nationally representative survey. BMC Complement. Med. Ther. 2022, 22, 41. [Google Scholar] [CrossRef] [PubMed]
  48. Cassidy, J.D.; Boyle, E.; Côté, P.; He, Y.; Hogg-Johnson, S.; Silver, F.L.; Bondy, S.J. Risk of vertebrobasilar stroke and chiropractic care: Results of a population-based case-control and case-crossover study. J. Manip. Physiol. Ther. 2009, 32, S201–S208. [Google Scholar] [CrossRef]
  49. Cassidy, J.D.; Boyle, E.; Côté, P.; Hogg-Johnson, S.; Bondy, S.J.; Haldeman, S. Risk of Carotid Stroke after Chiropractic Care: A Population-Based Case-Crossover Study. J. Stroke Cerebrovasc. Dis. 2017, 26, 842–850. [Google Scholar] [CrossRef]
  50. Whedon, J.M.; Song, Y.; Mackenzie, T.A.; Phillips, R.B.; Lukovits, T.G.; Lurie, J.D. Risk of Stroke After Chiropractic Spinal Manipulation in Medicare B Beneficiaries Aged 66 to 99 Years with Neck Pain. J. Manip. Physiol. Ther. 2015, 38, 93–101. [Google Scholar] [CrossRef] [Green Version]
  51. Kosloff, T.M.; Elton, D.; Tao, J.; Bannister, W.M. Chiropractic care and the risk of vertebrobasilar stroke: Results of a case–control study in U.S. commercial and Medicare Advantage populations. Chiropr. Man. Ther. 2015, 23, 19. [Google Scholar] [CrossRef] [Green Version]
  52. Chu, E.C.-P.; Trager, R.J.; Tao, C.; Lee, L.Y.-K. Chiropractic Management of Neck Pain Complicated by Symptomatic Vertebral Artery Stenosis and Dizziness. Am. J. Case Rep. 2022, 23, e937991. [Google Scholar] [CrossRef] [PubMed]
  53. Niazi, I.K.; Türker, K.S.; Flavel, S.; Kinget, M.; Duehr, J.; Haavik, H. Changes in H-reflex and V-waves following spinal manipulation. Exp. Brain Res. 2015, 233, 1165–1173. [Google Scholar] [CrossRef] [PubMed]
  54. Pickar, J.; Bolton, P. Spinal manipulative therapy and somatosensory activation. J. Electromyogr. Kinesiol. 2012, 22, 785–794. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  55. Haavik, H.; Murphy, B. Subclinical Neck Pain and the Effects of Cervical Manipulation on Elbow Joint Position Sense. J. Manip. Physiol. Ther. 2011, 34, 88–97. [Google Scholar] [CrossRef] [PubMed]
  56. Taylor, H.H.; Murphy, B.A. Altered cortical integration of dual somatosensory input following the cessation of a 20 min period of repetitive muscle activity. Exp. Brain Res. 2007, 178, 488–498. [Google Scholar] [CrossRef] [PubMed]
  57. Haavik-Taylor, H.; Murphy, B. Cervical spine manipulation alters sensorimotor integration: A somatosensory evoked potential study. Clin. Neurophysiol. 2007, 118, 391–402. [Google Scholar] [CrossRef]
  58. Haavik Taylor, H.; Murphy, B. Transient modulation of intracortical inhibition following spinal manipulation. Chiropr. J. Aust. 2007, 37, 106–116. [Google Scholar]
  59. Taylor, H.H.; Murphy, B. Altered Sensorimotor Integration with Cervical Spine Manipulation. J. Manip. Physiol. Ther. 2008, 31, 115–126. [Google Scholar] [CrossRef]
  60. Haavik Taylor, H.; Murphy, B. Altered Central Integration of Dual Somatosensory Input Following Cervical Spine Manipulation. J. Manip. Physiol. Ther. 2010, 33, 178–188. [Google Scholar] [CrossRef] [PubMed]
  61. Haavik Taylor, H.; Murphy, B. The effects of spinal manipulation on central integration of dual somatosensory input observed following motor training: A crossover study. J. Manip. Physiol. Ther. 2010, 33, 261–272. [Google Scholar] [CrossRef]
  62. Marshall, P.; Murphy, B. The Effect of Sacroiliac Joint Manipulation on Feed-Forward Activation Times of the Deep Abdominal Musculature. J. Manip. Physiol. Ther. 2006, 29, 196–202. [Google Scholar] [CrossRef] [PubMed]
  63. Machado, S.; Cunha, M.; Velasques, B.; Minc, D.; Teixeira, S.; Domingues, C.A.; Silva, J.G.; Bastos, V.H.; Budde, H.; Cagy, M.; et al. Sensorimotor integration: Basic concepts, abnormalities related to movement disorders and sensorimotor training-induced cortical reorganization. Rev. Neurol. 2010, 51, 427–436. [Google Scholar] [PubMed]
  64. Treleaven, J. Sensorimotor disturbances in neck disorders affecting postural stability, head and eye movement control. Man. Ther. 2008, 13, 2–11. [Google Scholar] [CrossRef] [PubMed]
  65. Jax, S.A.; Coslett, H.B. Disorders of the perceptual-motor system. In Progress in Motor Control; Springer: New York, NY, USA, 2009; pp. 377–391. [Google Scholar]
  66. Andrew, D.; Haavik, H.; Dancey, E.; Yielder, P.; Murphy, B. Somatosensory evoked potentials show plastic changes following a novel motor training task with the thumb. Clin. Neurophysiol. 2015, 126, 575–580. [Google Scholar] [CrossRef] [PubMed]
  67. Pazzaglia, M.; Zantedeschi, M. Plasticity and Awareness of Bodily Distortion. Neural Plast. 2016, 2016, 9834340. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  68. Reynolds, J.E.; Licari, M.K.; Elliott, C.; Lay, B.S.; Williams, J. Motor imagery ability and internal representation of movement in children with probable developmental coordination disorder. Hum. Mov. Sci. 2015, 44, 287–298. [Google Scholar] [CrossRef]
  69. Holt, K.; Niazi, I.K.; Nedergaard, R.W.; Duehr, J.; Amjad, I.; Shafique, M.; Anwar, M.N.; Ndetan, H.; Turker, K.S.; Haavik, H. The effects of a single session of chiropractic care on strength, cortical drive, and spinal excitability in stroke patients. Sci. Rep. 2019, 9, 2673. [Google Scholar] [CrossRef]
  70. Holt, K.; Niazi, I.; Amjad, I.; Kumari, N.; Rashid, U.; Duehr, J.; Navid, M.; Shafique, M.; Haavik, H. The Effects of 4 Weeks of Chiropractic Spinal Adjustments on Motor Function in People with Stroke: A Randomized Controlled Trial. Brain Sci. 2021, 11, 676. [Google Scholar] [CrossRef]
  71. Duarte, F.C.; Funabashi, M.; Starmer, D.; Partata, W.A.; West, D.W.; Kumbhare, D.A.; Injeyan, S. Effects of Distinct Force Magnitude of Spinal Manipulative Therapy on Blood Biomarkers of Inflammation: A Proof of Principle Study in Healthy Young Adults. J. Manip. Physiol. Ther. 2022, 45, 20–32. [Google Scholar] [CrossRef]
  72. Gevers-Montoro, C.; Romero-Santiago, M.; Losapio, L.; Conesa-Buendía, F.M.; Newell, D.; Álvarez-Galovich, L.; Piché, M.; Mues, A.O.-D. Presence of Tumor Necrosis Factor-Alpha in Urine Samples of Patients with Chronic Low Back Pain Undergoing Chiropractic Care: Preliminary Findings from a Prospective Cohort Study. Front. Integr. Neurosci. 2022, 16, 879083. [Google Scholar] [CrossRef]
  73. López-Herradón, A.; Fujikawa, R.; Gómez-Marín, M.; Stedile-Lovatel, J.P.; Mulero, F.; Ardura, J.A.; Ruiz, P.; Muñoz, I.; Esbrit, P.; Mahíllo-Fernández, I.; et al. Impact of Chiropractic Manipulation on Bone and Skeletal Muscle of Ovariectomized Rats. Calcif. Tissue Res. 2017, 101, 519–529. [Google Scholar] [CrossRef] [PubMed]
  74. Kiani, A.K.; Maltese, P.E.; Dautaj, A.; Paolacci, S.; Kurti, D.; Picotti, P.M.; Bertelli, M. Neurobiological basis of chiropractic manipulative treatment of the spine in the care of major depression. Acta Bio Med. Atenei Parm. 2020, 91, e2020006. [Google Scholar] [CrossRef]
  75. Greisberger, A.; Aviv, H.; Garbade, S.; Diermayr, G. Clinical relevance of the effects of reach-to-grasp training using trunk restraint in individuals with hemiparesis poststroke: A systematic review. J. Rehabil. Med. 2016, 48, 405–416. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  76. Wist, S.; Clivaz, J.; Sattelmayer, K.M. Muscle strengthening for hemiparesis after stroke: A meta-analysis. Ann. Phys. Rehabil. Med. 2016, 59, 114–124. [Google Scholar] [CrossRef]
  77. Fugl-Meyer, A.R. Post-stroke hemiplegia assessment of physical properties. Scand. J. Rehabil. Med. Suppl. 1980, 7, 85–93. [Google Scholar]
  78. Triano, J.J.; Budgell, B.; Bagnulo, A.; Roffey, B.; Bergmann, T.; Cooperstein, R.; Gleberzon, B.; Good, C.; Perron, J.; Tepe, R. Review of methods used by chiropractors to determine the site for applying manipulation. Chiropr. Man. Ther. 2013, 21, 36. [Google Scholar] [CrossRef] [Green Version]
  79. Holt, K.; Russell, D.; Cooperstein, R.; Younes, M.; Sherson, M.; Haavik, H. Interexaminer reliability of a multidimensional battery of tests used to assess for vertebral subluxations. Chiropr. J. Aust. 2018, 46, 101–117. [Google Scholar]
  80. Cooperstein, R.; Gleberzon, B. Technique Systems in Chiropractic; Churchill Livingstone: London, UK, 2004. [Google Scholar]
  81. Hancock, M.J.; Maher, C.G.; Latimer, J.; McAuley, J.H. Selecting an appropriate placebo for a trial of spinal manipulative therapy. Aust. J. Physiother. 2006, 52, 135–138. [Google Scholar] [CrossRef] [Green Version]
  82. Rosner, A.L. Evidence-based medicine: Revisiting the pyramid of priorities. J. Bodyw. Mov. Ther. 2012, 16, 42–49. [Google Scholar] [CrossRef]
  83. Ashraf, M.; Saeed, H.; Saleem, Z.; Rathore, H.A.; Rasool, F.; Tahir, E.; Bhatti, T.; Khalid, J.; Bhatti, I.; Tariq, A. A cross-sectional assessment of knowledge, attitudes and self-perceived effectiveness of complementary and alternative medicine among pharmacy and non-pharmacy university students. BMC Complement. Altern. Med. 2019, 19, 95. [Google Scholar] [CrossRef]
  84. Pollock, A.; St George, B.; Fenton, M.; Firkins, L. Top 10 research priorities relating to life after stroke–consensus from stroke survivors, caregivers, and health professionals. Int. J. Stroke 2014, 9, 313–320. [Google Scholar] [CrossRef] [PubMed]
  85. Saghaei, M.; Saghaei, S. Implementation of an open-source customizable minimization program for allocation of patients to parallel groups in clinical trials. J. Biomed. Sci. Eng. 2011, 4, 734–739. [Google Scholar] [CrossRef] [Green Version]
  86. The R Development Core Team. R: A Language and Environment for Statistical Computing; GBIF: Copenhagen, Denmark, 2020. [Google Scholar]
  87. Pinheiro, J.; Bates, D.; DebRoy, S.; Sarkar, D. nlme: Linear and Nonlinear Mixed Effects Models 2020; R Core Team: Copenhagen, Denmark, 2020. [Google Scholar]
  88. De Morais, V.A.C.; Tourino, M.F.D.S.; Almeida, A.C.D.S.; Albuquerque, T.B.D.; Linhares, R.C.; Christo, P.P.; Martinelli, P.M.; Scalzo, P.L. A single session of moderate intensity walking increases brain-derived neurotrophic factor (BDNF) in the chronic post-stroke patients. Top. Stroke Rehabil. 2018, 25, 1–5. [Google Scholar] [CrossRef] [PubMed]
  89. Charalambous, C.C.; Alcantara, C.C.; French, M.; Li, X.; Matt, K.S.; Kim, H.E.; Morton, S.M.; Reisman, D.S. A single exercise bout and locomotor learning after stroke: Physiological, behavioural, and computational outcomes. J. Physiol. 2018, 596, 1999–2016. [Google Scholar] [CrossRef] [PubMed]
  90. Charalambous, C.C.; Helm, E.E.; Lau, K.A.; Morton, S.M.; Reisman, D.S. The feasibility of an acute high-intensity exercise bout to promote locomotor learning after stroke. Top. Stroke Rehabil. 2017, 25, 83–89. [Google Scholar] [CrossRef]
  91. Boyne, P.; Meyrose, C.; Westover, J.; Whitesel, D.; Hatter, K.; Reisman, D.S.; Cunningham, D.; Carl, D.; Jansen, C.; Khoury, J.C.; et al. Exercise intensity affects acute neurotrophic and neurophysiological responses poststroke. J. Appl. Physiol. 2019, 126, 431–443. [Google Scholar] [CrossRef]
  92. King, M.; Kelly, L.P.; Wallack, E.M.; Hasan, S.M.M.; Kirkland, M.C.; Curtis, M.E.; Chatterjee, T.; McCarthy, J.; Ploughman, M. Serum levels of insulin-like growth factor-1 and brain-derived neurotrophic factor as potential recovery biomarkers in stroke. Neurol. Res. 2019, 41, 354–363. [Google Scholar] [CrossRef]
  93. Luo, W.; Liu, T.; Li, S.; Wen, H.; Zhou, F.; Zafonte, R.; Luo, X.; Xu, M.; Black-Schaffer, R.; Wood, L.J.; et al. The Serum BDNF Level Offers Minimum Predictive Value for Motor Function Recovery after Stroke. Transl. Stroke Res. 2019, 10, 342–351. [Google Scholar] [CrossRef]
  94. Koroleva, E.; Tolmachev, I.; Alifirova, V.; Boiko, A.; Levchuk, L.; Loonen, A.; Ivanova, S. Serum BDNF’s Role as a Biomarker for Motor Training in the Context of AR-Based Rehabilitation after Ischemic Stroke. Brain Sci. 2020, 10, 623. [Google Scholar] [CrossRef]
  95. Panja, D.; Bramham, C.R. BDNF mechanisms in late LTP formation: A synthesis and breakdown. Neuropharmacology 2014, 76, 664–676. [Google Scholar] [CrossRef]
  96. Pikula, A.; Beiser, A.S.; Chen, T.C.; Preis, S.R.; Vorgias, D.; DeCarli, C.; Au, R.; Kelly-Hayes, M.; Kase, C.S.; Wolf, P.A.; et al. Serum brain-derived neurotrophic factor and vascular endothelial growth factor levels are associated with risk of stroke and vascular brain injury: Framingham Study. Stroke 2013, 44, 2768–2775. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  97. Mamounas, L.A.; Altar, C.A.; Blue, M.E.; Kaplan, D.R.; Tessarollo, L.; Lyons, W.E. BDNF Promotes the Regenerative Sprouting, But Not Survival, of Injured Serotonergic Axons in the Adult Rat Brain. J. Neurosci. 2000, 20, 771–782. [Google Scholar] [CrossRef] [PubMed]
  98. Clarkson, A.; Overman, J.J.; Zhong, S.; Mueller, R.; Lynch, G.; Carmichael, S.T. AMPA Receptor-Induced Local Brain-Derived Neurotrophic Factor Signaling Mediates Motor Recovery after Stroke. J. Neurosci. 2011, 31, 3766–3775. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  99. Limaye, N.S.; Carvalho, L.B.; Kramer, S. Effects of Aerobic Exercise on Serum Biomarkers of Neuroplasticity and Brain Repair in Stroke: A Systematic Review. Arch. Phys. Med. Rehabil. 2021, 102, 1633–1644. [Google Scholar] [CrossRef]
  100. Barbey, A.K.; Colom, R.; Paul, E.J.; Grafman, J. Architecture of fluid intelligence and working memory revealed by lesion mapping. Brain Struct. Funct. 2014, 219, 485–494. [Google Scholar] [CrossRef]
  101. Ploughman, M.; Granter-Button, S.; Chernenko, G.; Attwood, Z.; Tucker, B.; Mearow, K.M.; Corbett, D. Exercise intensity influences the temporal profile of growth factors involved in neuronal plasticity following focal ischemia. Brain Res. 2007, 1150, 207–216. [Google Scholar] [CrossRef]
  102. Ploughman, M.; Granter-Button, S.; Chernenko, G.; Tucker, B.; Mearow, K.; Corbett, D. Endurance exercise regimens induce differential effects on brain-derived neurotrophic factor, synapsin-I and insulin-like growth factor I after focal ischemia. Neuroscience 2005, 136, 991–1001. [Google Scholar] [CrossRef]
  103. Briken, S.; Rosenkranz, S.C.; Keminer, O.; Patra, S.; Ketels, G.; Heesen, C.; Hellweg, R.; Pless, O.; Schulz, K.-H.; Gold, S.M. Effects of exercise on Irisin, BDNF and IL-6 serum levels in patients with progressive multiple sclerosis. J. Neuroimmunol. 2016, 299, 53–58. [Google Scholar] [CrossRef]
  104. Ieraci, A.; Madaio, A.I.; Mallei, A.; Lee, F.S.; Popoli, M. Brain-Derived Neurotrophic Factor Val66Met Human Polymorphism Impairs the Beneficial Exercise-Induced Neurobiological Changes in Mice. Neuropsychopharmacology 2016, 41, 3070–3079. [Google Scholar] [CrossRef] [Green Version]
  105. Egan, M.F.; Kojima, M.; Callicott, J.H.; Goldberg, T.E.; Kolachana, B.S.; Bertolino, A.; Zaitsev, E.; Gold, B.; Goldman, D.; Dean, M.; et al. The BDNF val66met Polymorphism Affects Activity-Dependent Secretion of BDNF and Human Memory and Hippocampal Function. Cell 2003, 112, 257–269. [Google Scholar] [CrossRef] [Green Version]
  106. Kim, D.Y.; Quinlan, E.B.; Gramer, R.; Cramer, S.C. BDNF Val66Met Polymorphism Is Related to Motor System Function after Stroke. Phys. Ther. 2016, 96, 533–539. [Google Scholar] [CrossRef] [Green Version]
  107. Cramer, S.; Procaccio, V.; Americas, G.; Investigators, G.I.S. Correlation between genetic polymorphisms and stroke recovery: Analysis of the GAIN Americas and GAIN International Studies. Eur. J. Neurol. 2012, 19, 718–724. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  108. Verhagen, M.; Van Der Meij, A.; Van Deurzen, P.; Janzing, J.; Arias-Vasquez, A.; Buitelaar, J.; Franke, B. Meta-analysis of the BDNF Val66Met polymorphism in major depressive disorder: Effects of gender and ethnicity. Mol. Psychiatry 2010, 15, 260–271. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  109. Stokes, K.A.; Sykes, D.; Gilbert, K.L.; Chen, J.-W.; Frystyk, J. Brief, high intensity exercise alters serum ghrelin and growth hormone concentrations but not IGF-I, IGF-II or IGF-I bioactivity. Growth Horm. IGF Res. 2010, 20, 289–294. [Google Scholar] [CrossRef]
  110. Bang, P.; Brandt, J.; Degerblad, M.; Enberg, G.; Kaijser, L.; Thorén, M.; Hall, K. Exercise-induced changes in insulin-like growth factors and their low molecular weight binding protein in healthy subjects and patients with growth hormone deficiency. Eur. J. Clin. Investig. 1990, 20, 285–292. [Google Scholar] [CrossRef] [PubMed]
  111. Schwarz, A.J.; Brasel, J.; Hintz, R.L.; Mohan, S.; Cooper, D. Acute effect of brief low-and high-intensity exercise on circulating insulin-like growth factor (IGF) I, II, and IGF-binding protein-3 and its proteolysis in young healthy men. J. Clin. Endocrinol. Metab. 1996, 81, 3492–3497. [Google Scholar] [PubMed] [Green Version]
  112. Bailey, D.M.; Evans, K.A.; McEneny, J.; Young, I.S.; Hullin, D.A.; James, P.E.; Ogoh, S.; Ainslie, P.N.; Lucchesi, C.; Rockenbauer, A.; et al. Exercise-induced oxidative-nitrosative stress is associated with impaired dynamic cerebral autoregulation and blood-brain barrier leakage. Exp. Physiol. 2011, 96, 1196–1207. [Google Scholar] [CrossRef]
  113. McCullough, M.; Gyorkos, A.; Spitsbergen, J. Short-term exercise increases GDNF protein levels in the spinal cord of young and old rats. Neuroscience 2013, 240, 258–268. [Google Scholar] [CrossRef] [Green Version]
  114. Kitagawa, H.; Hayashi, T.; Mitsumoto, Y.; Koga, N.; Itoyama, Y.; Abe, K. Reduction of Ischemic Brain Injury by Topical Application of Glial Cell Line–Derived Neurotrophic Factor after Permanent Middle Cerebral Artery Occlusion in Rats. Stroke 1998, 29, 1417–1422. [Google Scholar] [CrossRef]
Figure 1. CONSORT study flow diagram. Abbreviations: Fugl-Meyer Assessment (FMA).
Figure 1. CONSORT study flow diagram. Abbreviations: Fugl-Meyer Assessment (FMA).
Jcm 11 07493 g001
Figure 2. Estimated marginal means for chiro + PT and sham + PT at the three time points: baseline (TB), at four weeks (T4) and at eight weeks (T8). CI = confidence interval.
Figure 2. Estimated marginal means for chiro + PT and sham + PT at the three time points: baseline (TB), at four weeks (T4) and at eight weeks (T8). CI = confidence interval.
Jcm 11 07493 g002
Table 1. Clinical characteristics of participants in each group.
Table 1. Clinical characteristics of participants in each group.
VariablesChiro + PTSham + PT
Gender
Male (n)1816
Female (n)1011
Age, years (mean ± SD)53.3 ± 14.058.5 ± 11.3
Side of body affected by stroke
Left (n)1412
Right (n)1415
Time since stroke, months (mean ± SD)30.0 ± 36.627.3 ± 31.5
12–24 weeks, n54
>24 weeks, n2323
Type of stroke
Ischemic (n)2425
Hemorrhagic (n)42
n: number of participants, SD: standard deviation.
Table 2. Multivariate analysis of variance table with tests for variance explained by the categorical independent variables and their interactions.
Table 2. Multivariate analysis of variance table with tests for variance explained by the categorical independent variables and their interactions.
Independent VariableDFnumDFdenF-Valuep-Value
Outcome32761836.18<0.001
Time22763.660.027
Group1400.760.39
Outcome × Time427616.56<0.001
Outcome × Group22761.520.22
Time × Group22761.180.31
Outcome × Time × Group42760.490.75
DFnum = numerator degrees of freedom, DFden = denominator degrees of freedom.
Table 3. Estimated marginal means for chiropractic plus physical therapy and sham chiropractic plus physical therapy at the three time points.
Table 3. Estimated marginal means for chiropractic plus physical therapy and sham chiropractic plus physical therapy at the three time points.
OutcomeGroupTimeMean ± SE95% CI
BDNFSham chiropractic + PTBaseline5.8 ± 0.15.5, 6.0
Chiropractic + PTBaseline5.9 ± 0.15.7, 6.2
Sham chiropractic + PTAt 4 weeks5.6 ± 0.15.3, 5.8
Chiropractic + PTAt 4 weeks5.8 ± 0.15.6, 6.1
Sham chiropractic + PTAt 8 weeks5.3 ± 0.25.0, 5.6
Chiropractic + PTAt 8 weeks5.2 ± 0.15.0, 5.5
IGF-IISham chiropractic + PTBaseline7.3 ± 0.27.0, 7.6
Chiropractic + PTBaseline7.5 ± 0.27.2, 7.8
Sham chiropractic + PTAt 4 weeks6.7 ± 0.26.4, 7.1
Chiropractic + PTAt 4 weeks6.8 ± 0.26.5, 7.1
Sham chiropractic + PTAt 8 weeks6.2 ± 0.25.8, 6.6
Chiropractic + PTAt 8 weeks6.2 ± 0.25.9, 6.6
GDNFSham chiropractic + PTBaseline5.7 ± 0.15.5, 5.9
Chiropractic + PTBaseline5.6 ± 0.15.4, 5.7
Sham chiropractic + PTAt 4 weeks5.6 ± 0.15.4, 5.8
Chiropractic + PTAt 4 weeks5.4 ± 0.15.2, 5.6
Sham chiropractic + PTAt 8 weeks6.5 ± 0.16.2, 6.7
Chiropractic + PTAt 8 weeks6.3 ± 0.16.1, 6.5
SE = standard error and CI stands for confidence interval.
Table 4. Mean differences between chiro + PT and sham + PT in log-concentration of bloodwork biomarkers.
Table 4. Mean differences between chiro + PT and sham + PT in log-concentration of bloodwork biomarkers.
OutcomeTimeMean Difference ± SE95% CIH0: Mean Difference = 0,
t [df], p-Value
BDNFAt 4 weeks0.12 ± 0.21−0.31, 0.540.54 [276], 0.59
At 8 weeks−0.24 ± 0.23−0.70, 0.22−1.03 [276], 0.30
IGF-IIAt 4 weeks−0.18 ± 0.29−0.75, 0.40−0.61 [276], 0.54
At 8 weeks−0.16 ± 0.32−0.79, 0.47−0.50 [276], 0.62
GDNFAt 4 weeks−0.03 ± 0.16−0.35, 0.29−0.18 [276], 0.86
At 8 weeks−0.03 ± 0.18−0.38, 0.33−0.14 [276], 0.89
SE = standard error, CI = confidence interval, df = degrees of freedom, H0 = the null hypothesis. Mean difference is defined as [chiro + PT at each assessment—chiro + PT at baseline]—[sham + PT at each assessment -sham + PT as baseline].
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Haavik, H.; Niazi, I.K.; Amjad, I.; Kumari, N.; Rashid, U.; Duehr, J.; Navid, M.S.; Trager, R.J.; Shafique, M.; Holt, K. The Effects of Four Weeks of Chiropractic Spinal Adjustments on Blood Biomarkers in Adults with Chronic Stroke: Secondary Outcomes of a Randomized Controlled Trial. J. Clin. Med. 2022, 11, 7493. https://doi.org/10.3390/jcm11247493

AMA Style

Haavik H, Niazi IK, Amjad I, Kumari N, Rashid U, Duehr J, Navid MS, Trager RJ, Shafique M, Holt K. The Effects of Four Weeks of Chiropractic Spinal Adjustments on Blood Biomarkers in Adults with Chronic Stroke: Secondary Outcomes of a Randomized Controlled Trial. Journal of Clinical Medicine. 2022; 11(24):7493. https://doi.org/10.3390/jcm11247493

Chicago/Turabian Style

Haavik, Heidi, Imran Khan Niazi, Imran Amjad, Nitika Kumari, Usman Rashid, Jens Duehr, Muhammad Samran Navid, Robert J. Trager, Muhammad Shafique, and Kelly Holt. 2022. "The Effects of Four Weeks of Chiropractic Spinal Adjustments on Blood Biomarkers in Adults with Chronic Stroke: Secondary Outcomes of a Randomized Controlled Trial" Journal of Clinical Medicine 11, no. 24: 7493. https://doi.org/10.3390/jcm11247493

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop