Next Article in Journal
Counteractive Effects of IL-33 and IL-37 on Inflammation in Osteoarthritis
Next Article in Special Issue
Exploring the Influence of a Community-Based Peer-Led Wheelchair Skills Training on Satisfaction with Participation in Children and Adolescents with Cerebral Palsy and Spina Bifida: A Pilot Study
Previous Article in Journal
Regional Differences and Convergence of Inter-Provincial Green Total Factor Productivity in China under Technological Heterogeneity
Previous Article in Special Issue
Wheelchair Skills Test Outcomes across Multiple Wheelchair Skills Training Bootcamp Cohorts
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Influence of Core-Stability Exercises Guided by a Telerehabilitation App on Trunk Performance, Balance and Gait Performance in Chronic Stroke Survivors: A Preliminary Randomized Controlled Trial

by
Carina Salgueiro
1,*,
Gerard Urrútia
2 and
Rosa Cabanas-Valdés
1
1
Physiotherapy Department, Faculty of Medicine and Health Science Campus Sant Cugat, Universitat Internacional de Catalunya, 08195 Barcelona, Spain
2
Institut d’Investigació Biomèdica Sant Pau (IIB Sant Pau), CIBER de Epidemiología y Salud Pública (CIBERESP), 08025 Barcelona, Spain
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2022, 19(9), 5689; https://doi.org/10.3390/ijerph19095689
Submission received: 9 April 2022 / Revised: 2 May 2022 / Accepted: 5 May 2022 / Published: 7 May 2022

Abstract

:
Stroke is one of the main causes of disability. Telerehabilitation could face the growing demand and a good strategy for post-stroke rehabilitation. The aim of this study is to examine the possible effects of therapeutic exercises performed by an App on trunk control, balance, and gait in stroke survivors. A preliminary 12-week randomized controlled trial was developed. Thirty chronic stroke survivors were randomly allocated into two groups. Both groups performed conventional physiotherapy, in addition to, the experimental group (EG) had access to a telerehabilitation App to guide home-based core-stability exercises (CSE). Trunk performance was measured with the Spanish-Trunk Impairment Scale (S-TIS 2.0) and Spanish-Function in Sitting Test. Balance and gait were measured with Spanish-Postural Assessment Scale for Stroke patient, Berg Balance Scale and an accelerometer system. In EG was observed an improvement of 2.76 points in S-TIS 2.0 (p = 0.001). Small differences were observed in balance and gait. Adherence to the use of the App was low. CSE guided by a telerehabilitation App, combined with conventional physiotherapy, seem to improve trunk function and sitting balance in chronic post-stroke. Active participation in the rehabilitation process should be increased among stroke survivors. Further confirmatory studies are necessary with a large sample size.

1. Introduction

Stroke is the most frequent cerebrovascular disease and is the leading cause of adult disability in the developed countries [1,2]. Sensory and motor deficits derived from neurological injury, such as paralysis, impaired balance or spasticity, are the most common impairments and are the basis of the resulting degree of physical disability [3]. The affectations not only come out in face and in upper and lower limb, but also in the trunk. Trunk performance plays an important role in biomechanics of human movement and is closely related to lower limb function, balance and gait [4,5]. For this reason, in physiotherapy sessions, improve the trunk function of stroke patient is essential, in all phases of rehabilitation [6,7].
The practice of specific lumbopelvic stability exercises, known as core-stability exercises (CSE), incorporate the direct activation of muscle groups of the trunk and improving their performance. This approach is recommended in the guidelines of good clinical practice, and it is more effective than conventional therapy not only in the recovery of trunk control but also exerts a great influence on the balance and gait [8,9,10,11,12,13,14]. In the recent review by Gamble et al. [15], the authors conclude that the addition of CSE to usual care after stroke can improve trunk control and dynamic balance.
Strategies must be found to introduce the practice of personalized exercises, as CSE, in the daily life of individuals. Telerehabilitation can be a good plan of action for this purpose. This rehabilitation modality could reduce costs in patient assistance, as transfers, human and material resources. Telerehabilitation can also contribute to equalize healthcare access, especially in rural areas. It could also be used to prevent deterioration of the health condition or to detect unfavorable situations outside the acute healthcare phase [16,17]. Creating exercise groups can be used to reduce costs in human resources, however patient care is no longer personalized. The introduction of telerehabilitation in the process of recovery and follow-up of stroke survivors may be a solution to the growing demand and has positive results related to the satisfaction of the participants [18]. Providing immediate home rehabilitation services through telerehabilitation would ensure continuous monitoring of patients and improve not only their state of health but even their Quality of Life [18]. This need has been prioritized during lockdown due to the COVID-19 epidemic [19,20].
It is possible to find neurorehabilitation Apps such as language rehabilitation, cognitive disorders and incentives to physical activity [21,22,23]. However, most of the apps for self-management or sensorimotor stroke recovery are incomplete, depersonalized, and their results are not clear [23,24,25,26]. Home-based trunk training is effective in improving trunk muscle strength, functional sitting range and trunk motor control after stroke in subjects without somatosensory deficits [27]. However, there are currently no references on the practice of CSE at home guided and monitored by an App. Therefore, a preliminary study was carried out to evaluate the effectiveness of CSE guided by a telerehabilitation application on Quality of Life, participation in activities of daily living and functionality of chronic stroke survivors. Trunk, balance and gait performance were also assessed. This study aims to find out if CSE performed via an App can have possible positive effects on trunk control, sitting and standing balance and gait performance in chronic stroke survivors as a study of the integrity of the protocol.

2. Materials and Methods

2.1. Study Design, Ethics and Sample Characteristics

This preliminary trial was a prospective single-blinded, prospective, randomized, controlled trial. The study protocol was approved by the Clinical Research Ethics Committee of the Universitat Internacional de Catalunya (FIS-2020-01) and registered in the ClinicalTrials.gov database (NCT04477252). The study followed the research principles of Declaration of Helsinki 2013.
As this is a novel and preliminary study, and is limited by the COVID-19 pandemic, no sample study calculation has been performed and the minimum number of 30 participants was established. This study was carried out during the COVID-19 pandemic in which stroke patient care was limited. All eligible participants were recruited from the Neurorehabilitation Clinic, a procedure that limited the loss of trial subjects. The inclusion criteria for this study included medical diagnosis of stroke with cortical or subcortical, ischemic or hemorrhagic involvement with more than 6 months of recovery, clinical symptoms of hemiplegia or hemiparesis, being over 18 years of age, have the ability to understand and execute simple instructions, a score equal to or less than 10 in the Spanish version of the Trunk Impairment Scale 2.0 (S-TIS2.0) [28,29] and be a frequent user of smartphones or tablets (a family member or caregiver could be considered). The exclusion criteria were presence of any neurological or neuromuscular disease or worsening of any of the comorbidities, to suffer another episode of stroke and fractures or important structural alterations in any of the lower limbs (e.g., orthopedic problem of the lower limbs). Individuals with aphasia but capable of understanding and executing simple commands were included with prior consultation with the respective neuropsychologist or speech therapist. Likewise, the caregiver was considered as the user of the App.
Randomization, using random.org program, was carried out by the main researcher of the study, assigning a value of 1 to the experimental group (EG) and a value of 2 to the control group (CG) in a 1:1 ratio.
Participants who fulfilled the inclusion criteria were informed about the study by the main researcher and signed the informed consent. Both groups received conventional physiotherapy, and, in addition, the EG (n = 15) performed CSE by Farmalarm App. The evaluator physiotherapist was unaware of the intervention group of the participants and all the data collected were blinded to the principal investigator, who controlled the interventions. The interventions have had a total duration of 12 weeks for all participants and 3 data collection periods.

2.2. Interventions

Both groups (CG and EG) underwent the conventional physiotherapy according to the recommend by Teasell et al., 2020 [6]. It consisted of one-hour face-to-face session of therapeutic techniques such as muscle stretching to reduce hipertonicity or spasticity, passive and functional mobilization of body segments affected by stroke, practice of sitting and standing posture and gait, task and aerobic training as cycling or treadmill training [6]. The techniques used were chosen at the discretion of the physiotherapist in charge following the clinical practice guidelines. The intervention was totally adapted and personalized to the needs and capacities of the patient. Participants maintained their usual dose of treatment during participation in this study. In accordance with clinical recommendations the mean frequency of the sessions was 1 h two times a week for 12 weeks [30]. The physiotherapy sessions were face-to-face and individualized under the responsibility of a physiotherapist with special training and more than 2 years of work experience in neurorehabilitation. The conventional therapy was under responsibility of Clínica de Neurorehabilitación, respecting the health security protocol adopted to face the COVID-19 pandemic.
The participants of the EG, in addition to conventional physiotherapy, had individual access to the Farmalarm App as a telerehabilitation tool to guide adapted home-based CSE [31]. The Farmalarm App (Inmovens Solution, Barcelona, Spain) was specifically adapted for this study. Previously, it was used to monitor adherence to pharmacological treatment in stroke patients [32]. It can be downloaded for free on Android and IOS, but access is limited by a unique code and password assigned by the main researcher. The CSE program, which is part of the rehabilitation section, was developed and introduced by the researchers. Although the exercises should be personalized for each user, in this study phase the CSE guide introduced in the App was common [11,12]. Users have been able to voluntarily access the exercises guide (description, photo and video) and to confirm its performance. Participants were asked to perform 10 repetitions of each of the 32 exercises proposed in the program and were encouraged to perform as many exercises as possible, respecting their perception of tiredness, taking as many breaks as they found necessary. The exercises were introduced in order of difficulty, from the supine position to a seated position on an unstable base. Although the exercises were always presented in the same order, the participants were free to navigate through the menu of the exercises choosing the order they preferred or skipping the exercises that they could not perform or did not feel safe to do so. Figure 1 shows the proposed CSE program to be carried out at home with the help of the App for 12 weeks, 5 days a week.
The main researcher has carried out a face-to-face session of initiation training to use of the App (explanation and a short practice of the proposed exercises) and had access to the administration panel of the App for individual monitoring of each user. The participants were contacted by phone on a regular basis to ensure that they did not have problems with the use of the App.

2.3. Outcome Measures

The measure outcomes were trunk performance and sitting balance, assessed using S-TIS2.0 [28,29] and the Spanish version of Function in Sitting Test (S-FIST) [33,34,35]. Standing balance was assessed by Spanish version of Postural Assessment Scale for Stroke Patients (S-PASS) [36,37], by Berg Balance Scale (BBS) [38] and the number of falls registered. G-Walk accelerometer system from BTS Bioengineering [39] was used to assess gait parameters. This gait analysis system allows the collection of several gait parameters objectively (e.g., step length, speed, cadence and symmetry) in a single test and, seems to be a good assessment tool with stroke patients [40,41]. Adherence to telerehabilitation as an exercise guide and the number of exercises performed daily has been recorded in the control panel of the App. The assessments were carried out in a single session by a physiotherapist expert in neurorehabilitation, who was unaware of the group to which the patient had been assigned. The interval between assessment times, baseline (T0), 6 (T1) and 12 (T2) weeks were respected. In order to respect the protocol against the COVID-19 epidemic, phone or video-calls were made in case of not being able to carry out face-to-face assessments. The outcomes that could not be assessed, were considered absent and have not been taken into account in the statistical analysis.

2.4. Statistical Analysis

Descriptive statistics have been used for the characterization of the sample. The mean value and standard deviation were calculated for continuous data in both groups and individual’s characteristics were described using frequencies and percentages. Statistical analysis was performed with IBM SPSS Statistics software (Version 24) and R Project software [42]. The parametric analysis was performed, and the Shapiro–Wilk test was used to verify the distribution of the variables. The difference between the pre- and post-intervention value (ΔT0–T2) was studied in order to facilitate the interpretation of the results. Paired-samples t-test was used to study changes from baseline to the end of the intervention and independent-samples t-test was used to analyses changes between groups. Two-sided of p-value  < 0.05 were considered statistically significant. Absolute and relative values have been taken into account to study the usability of the telerehabilitation App Farmalarm.
As this was a preliminary study an analysis of the measure of change over time was not considered relevant.

3. Results

Thirty-two participants were recruited from Clínica de Neurorehabilitación in Barcelona, from May 2020 to May 2021. The 30 participants who met the inclusion criteria, were allocated in the CG (n = 15) and EG (n = 15) (Figure 2). Although small differences were observed between the groups in terms of age, number of risk factors and side of the body affected, the differences were not significant. (Table 1). In the CG, the mean age was higher than in the EG but showed less variation. The CG participants presented, on average, a greater number of risk factors, representing a sample with a more precarious health condition than that of the EG. Relatively to the affected body side, in the CG there was a predominance of participants with left hemiplegia or hemiparesis while in the EG there was a predominance of right hemiplegia or hemiparesis.
Table 2 presents the results of trunk function measures, where the p-value reflects the significance of the differences obtained intragroup and between groups pre- and post-intervention. According to the analysis of sitting balance by S-TIS 2.0, EG was observed to be superior to CG in balance and total score, whereas for coordination a significant difference at the end of intervention was observed only in the EG although. Specifically, between the beginning and the middle of the study, was observed an increase of 1.71 points, and between the beginning and end of this study, was observed an increase of 2.76 points. In contrast, no significant improvement was observed in the CG in any of these outcomes. In relation to the balance in sitting position, measured with the S-FIST, no changes were observed.
Table 3 presents the results of standing balance, where the p-value reflects the significance of the differences obtained intragroup and between groups pre- and post-intervention. In the first section of the S-PASS test, corresponding to the assessment of mobility, improvements were observed in both groups but only, the rise of 1.5 points observed in EG had statistical significance in intragroup comparison. No significant differences were observed between interventions. In the balance section of this assessment test, no significant changes were observed in each group separately or in the comparison between groups. In the total score of the S-PASS test, no statistical significance was observed between groups.
In BBS, also used to assess balance, an increase in the score has been observed in both groups. This difference had statistical significance in intragroup comparison but did not achieve statistical significance in comparison between groups.
Relative to the number of falls, no differences have been observed. The rise of number of falls in CG is due to a participant who started to use a bicycle outdoor.
The gait parameters have been studied and analyzed individually (Table 4). Two participants in this study were not capable of walking at the beginning of the study, one from the CG and the other from the EG. The statistical analysis of means and variances was carried out on 14 individuals in each group. No obtained data was taken into account as omission. The difference obtained between the evaluation values and the normal or expected values has been calculated using the G-Walk system software data. Higher results represent a greater deviation compare with the expected data, and a worse result and values close to zero represent a small deviation and a better result. About stance and swing phase, the expected values were 57–61% and 36.5–43.6%, respectively. Major deviations were observed in swing phase of the affected limb in both groups, and the bigger improvement was observed in this parameter in EG.
About gait support, the expected value for double support of the stance phase was 7.2–13.4% and the expected value for single support was 36.3–41.4%. The most affected parameter was single support of the affected limb of EG. Plus, the bigger improvement was observed in double support of the affected limb in EG (Table 5).
Gait cadence, measured in steps per minute, gait speed, measured in meters per second, and stride, measured in meters, varies from individual to individual because it depends on anthropometric characteristics. For this reason, the study was carried out with the value of the difference between the data obtained and the expected values. No regular results were obtained.
In relation to the length of the step, where is expected the symmetry between the right and left limbs (50%/50%), small variations were observed, in this case, between affected and less affected limbs. At baseline, an asymmetry of 52.72–47.28% was observed in the control group and 55.32–44.68% in the experimental group (affected limb-less affected limb). At the end of the study, asymmetry was maintained in the control group at 52.74–47.26% and was reduced to 51–67–48.33% in the experimental group.
Adherence to the use of the App to perform CSE at home, was monitored by the App’s administration panel. This panel recorded the time of use of the App and the exercises consulted and marked as carried out. Adherence has been low, with an average use of 13.66%. On average, the patients performed 12 exercises for each connected day, which corresponds to 37.09% of the total of the exercise program proposed to be performed 5 days/week (Table 5).
In summary, in the analysis of the different measure outcomes of this study, significant changes were observed in the EG in trunk function measured by S-TIS2.0. Improvements were observed in the other outcomes of this preliminary study in the EG, but without statistical significance.

4. Discussion

CSE exercises by means of Farmalarm App in addition to conventional physiotherapy seems to improve trunk function and sitting balance in chronic post-stroke. This preliminary study illustrated the utility of the telerehabilitation App as a guide to CSE, whose effectiveness is already known [43]. In a recent review by Cabrera-Martos et al. [44], the authors conclude that CSE, performed alone or in combination with other physiotherapy techniques, are effective in relation to trunk performance. Similar results were found in this preliminary study in which Farmalarm App was used to administer the CSE. The greatest change was observed in trunk performance or sitting balance, directly related to trunk function. These results also reinforce the introduction of the trunk approach as CSE in the recovery process of stroke survivors [6,7].
Physiotherapy is essential for people with disabilities and the use of telerehabilitation as a physiotherapy method seems to have several benefits [16,17]. It can be useful in situations such as confinement during the COVID-19 health crisis [45]. The use of the telerehabilitation App to perform CSE seems to bring benefits to users with regard to standing balance, but the results are not obvious. About gait, the results were very dispersed in both groups, and it is recommended to add other assessment methods to the gait analysis for future studies. No clear results have been obtained in this measure outcomes, but previous studies establish the relationship between the trunk and balance and gait [4,5]. In the last review about the efficacy of CSE in stroke survivors [15], there is evidence about these therapeutic exercises on gait speed but not on other gait parameters.
About trunk function, standing balance and gait, similar results were found in a study with individuals with stroke in the sub-acute stage [46]. It leads to the conclusion that CSE seem to be more effective in relation to trunk function and balance in sitting position at all stages of post-stroke rehabilitation.
The lack of greater results on this preliminary study may be related to poor adherence to performing exercises autonomously at home. This was the first study in which adherence levels have been objectively measured, and according to an interview at the end of the study, the lack of adherence may be related to a high demand for using the App in this study and the high number of exercises proposed to be performed in each session. However, some participants have completed all 32 proposed exercises in a single session. In addition, technical challenges and access problems may pose potential barriers to telerehabilitation as a service delivery model [47]. However, resistance to telerehabilitation is expected to decrease due to the introduction of new technology in daily life in modern society. The participants who had access to telerehabilitation were contacted periodically by phone call to guarantee the absence of problems with the use of the App. This continuous contact may have influenced the participants’ regular physical activity. On the other hand, the participants could have memorized the exercises and performed them without using the App. Future studies with a shorter therapeutic exercise program and a lower weekly frequency are recommended. It is thought that these small intervention changes will make it easier to introduce telerehabilitation into the daily routine of stroke patients.
Telerehabilitation seems to be as effective as face-to-face therapy [48,49]. However, the levels of adherence are different. Saywell et al. [50], conclude that telerehabilitation can be effective in maintaining the physical condition of users and preventing deterioration. This aspect is important for stroke survivors due to the chronicity of the dysfunction and secondary complications. Furthermore, telerehabilitation should not completely replace face-to-face therapy due to the good results and satisfaction of stroke survivors relative to the direct interaction with therapists [51].
In the last year there was a significant increase in publications related to telerehabilitation in general and in stroke survivors [52]. It seems that the health crisis experienced due to the COVID-19 pandemic aroused the interest in this area. In 2018 there were 33 indexed research papers in PubMed library, and in 2021 there were 83 [52]. In the latest systematic review on telerehabilitation in stroke patients, the authors state that studies regarding acceptability and reliability are important for the study of telerehabilitation [53]. This study provides information to measure the effect of telerehabilitation, and relevant information for the future introduction of telerehabilitation in clinical practice with patients with post-stroke disorders.
Stroke survivors’ self-responsibility behaviors should be reinforced in their recovery process. One of the strategies could be to clarify to the patients and their families the relationship between the recommended exercises and the improvement of functional prognosis.

5. Limitations

Firstly, this preliminary study did not have a sample size calculation, which limits the scope of interpretation of the results. However, it is exploratory in nature regarding the possible therapeutic impact and the acceptability. This study provides relevant base information for future clinical trials. Low adherence made it difficult to validate the results. However, the results suggest clinical changes.
For this publication, the authors have focused on the secondary measure outcomes of the study registered in Clinicaltrials.gov.

6. Conclusions

CSE guided by a telerehabilitation app, combined with conventional physiotherapy, are feasible and seems to improve trunk function and sitting balance in patients with chronic stage stroke. Although CSE seem to improve standing balance, no significant results were obtained. To measure the effects on gait, other methods of analysis must be incorporated. Adherence to telerehabilitation, as a guide tool for performing exercises autonomously at home, seems to be low. Future studies are needed to find out the reasons for low adherence to the use of telerehabilitation. Strategies must be found to increase self-responsibility and involvement in the recovery process by survivors and their families. Strategies to improve access and adherence to telerehabilitation as a guide to specific and personalized therapeutic exercises for stroke patients should also be studied.

Author Contributions

The three authors designed the study protocol. C.S. was responsible for coordinating the research, including data collection, supervision of interventions, and statistical analysis. G.U. acted as an intermediary with the technical support team of the App. C.S. and R.C.-V. wrote the article. All authors have read and agreed to the published version of the manuscript.

Funding

This research was partial funded by Fundació Marató de TV3, grant number 201737-83.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki, and approved by the Clinical Research Ethics Committee of the Universitat Internacional de Catalunya (FIS-2020-01) and registered in the ClinicalTrials.gov database (NCT04477252).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Data is contained within the article.

Acknowledgments

The authors wish to thank the INMovens Solutions S.L. for the technical support and the patients from the Clínica de Neurorehabilitación (Sant Cugat del Vallés) for their participation in this study that it certainly contributed to the future conduct of a definitive clinical trial.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Feigin, V.L.; Norrving, B.; Mensah, G.A. Global Burden of Stroke. Circ. Res. 2017, 120, 439–448. [Google Scholar] [CrossRef] [PubMed]
  2. Katan, M.; Luft, A. Global Burden of Stroke. Semin. Neurol. 2018, 38, 208–211. [Google Scholar] [CrossRef] [Green Version]
  3. Seitz, R.J.; Donnan, G.A. Recovery potential after acute stroke. Front. Neurol. 2015, 6, 238. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Van Criekinge, T.; Saeys, W.; Hallemans, A.; Velghe, S.; Viskens, P.J.; Vereeck, L.; De Hertogh, W.; Truijen, S. Trunk biomechanics during hemiplegic gait after stroke: A systematic review. Gait Posture. 2017, 54, 133–143. [Google Scholar] [CrossRef] [PubMed]
  5. Kong, K.H.; Krishnan, R. Truncal impairment after stroke: Clinical correlates, outcome and impact on ambulatory and functional outcomes after rehabilitation. Singapore Med. J. 2021, 62, 87–91. [Google Scholar] [CrossRef] [PubMed]
  6. Teasell, R.; Salbach, N.M.; Foley, N.; Mountain, A.; Cameron, J.I.; Jong, A.D.; Acerra, N.E.; Bastasi, D.; Carter, S.L.; Fung, J.; et al. Canadian Stroke Best Practice Recommendations: Rehabilitation, Recovery, and Community Participation following Stroke. Part One: Rehabilitation and Recovery Following Stroke. 6th Edition Update 2019. Int. J. Stroke 2020, 15, 763–788. [Google Scholar] [CrossRef] [Green Version]
  7. Arienti, C.; Lazzarini, S.G.; Pollock, A.; Negrini, S. Rehabilitation interventions for improving balance following stroke: An overview of systematic reviews. PLoS ONE 2019, 14, e0219781. [Google Scholar] [CrossRef] [Green Version]
  8. Karthikbabu, S.; Chakrapani, M.; Ganesan, S.; Ellajosyula, R.; Solomon, J.M. Efficacy of Trunk Regimes on Balance, Mobility, Physical Function, and Community Reintegration in Chronic Stroke: A Parallel-Group Randomized Trial. J. Stroke Cerebrovasc. Dis. 2018, 27, 1003–1011. [Google Scholar] [CrossRef]
  9. Souza, D.; de Sales Santos, M.; da Silva Ribeiro, N.; Maldonado, I. Inpatient trunk exercises after recent stroke: An update meta-analysis of randomized controlled trials. NeuroRehabilitation 2019, 44, 369–377. [Google Scholar] [CrossRef]
  10. Cabanas-Valdés, R.; Cuchi, G.U.; Bagur-Calafat, C. Trunk training exercises approaches for improving trunk performance and functional sitting balance in patients with stroke: A systematic review. NeuroRehabilitation 2013, 33, 575–592. [Google Scholar] [CrossRef]
  11. Cabanas-Valdés, R.; Bagur-Calafat, C.; Girabent-Farrés, M.; Caballero-Gómez, F.M.; Hernández-Valiño, M.; Urrútia Cuchí, G. The effect of additional core stability exercises on improving dynamic sitting balance and trunk control for subacute stroke patients: A randomized controlled trial. Clin. Rehabil. 2016, 30, 1024–1033. [Google Scholar] [CrossRef] [PubMed]
  12. Sharma, V.; Kaur, J. Effect of core strengthening with pelvic proprioceptive neuromuscular facilitation on trunk, balance, gait, and function in chronic stroke. J. Exerc. Rehabil. 2017, 13, 200–205. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  13. Haruyama, K.; Kawakami, M.; Otsuka, T. Effect of Core Stability Training on Trunk Function, Standing Balance, and Mobility in Stroke Patients. Neurorehabilit. Neural Repair. 2017, 31, 240–249. [Google Scholar] [CrossRef] [Green Version]
  14. Verheyden, G.; Vereeck, L.; Truijen, S.; Troch, M.; Herregodts, I.; Lafosse, C.; Nieuwboer, A.; De Weerdt, W. Trunk performance after stroke and the relationship with balance, gait and functional ability. Clin. Rehabil. 2006, 20, 451–458. [Google Scholar] [CrossRef]
  15. Gamble, K.; Chiu, A.; Peiris, C. Core Stability Exercises in Addition to Usual Care Physiotherapy Improve Stability and Balance After Stroke: A Systematic Review and Meta-analysis. Arch. Phys. Med. Rehabil. 2021, 102, 762–775. [Google Scholar] [CrossRef]
  16. Chen, Y.; Abel, K.; Janecek, J.; Chen, Y.; Zheng, K.; Cramer, S. Home-based technologies for stroke rehabilitation: A systematic review. Int. J. Med. Inform. 2019, 123, 11–22. [Google Scholar] [CrossRef]
  17. Leochico, C.F.D.; Espiritu, A.I.; Ignacio, S.D.; Mojica, J.A.P. Challenges to the Emergence of Telerehabilitation in a Developing Country: A Systematic Review. Front. Neurol. 2020, 11, 1007. [Google Scholar] [CrossRef]
  18. Tchero, H.; Tabue Teguo, M.; Lannuzel, A.; Rusch, E. Telerehabilitation for Stroke Survivors: Systematic Review and Meta-Analysis. J. Med. Internet Res. 2018, 20, e10867. [Google Scholar] [CrossRef]
  19. Ostrowska, P.M.; Śliwiński, M.; Studnicki, R.; Hansdorfer-Korzon, R. Telerehabilitation of post-stroke patients as a therapeutic solution in the era of the covid-19 pandemic. Healthcare 2021, 9, 654. [Google Scholar] [CrossRef]
  20. Turolla, A.; Rossettini, G.; Viceconti, A.; Palese, A.; Geri, T. Musculoskeletal Physical Therapy During the COVID-19 Pandemic: Is Telerehabilitation the Answer? Phys. Ther. 2020, 100, 1260–1264. [Google Scholar] [CrossRef]
  21. Øra, H.P.; Kirmess, M.; Brady, M.C.; Partee, I.; Hognestad, R.B.; Johannessen, B.B.; Thommessen, B.; Becker, F. The effect of augmented speech-language therapy delivered by telerehabilitation on poststroke aphasia—a pilot randomized controlled trial. Clin. Rehabil. 2020, 34, 369–381. [Google Scholar] [CrossRef] [PubMed]
  22. Sánchez Rodríguez, M.T.; Collado Vázquez, S.; Martín Casas, P.; Cano de la Cuerda, R. Apps en neurorrehabilitación. Una revisión sistemática de aplicaciones móviles. Neurología. 2018, 33, 313–326. [Google Scholar] [CrossRef] [PubMed]
  23. Moral-Munoz, J.A.; Zhang, W.; Cobo, M.J.; Kaber, D.B. Smartphone-based systems for physical rehabilitation applications: A systematic review. Assist. Technol. 2019, 33, 223–236. [Google Scholar] [CrossRef] [PubMed]
  24. Zhou, X.; Du, M.; Zhou, L. Use of mobile applications in post-stroke rehabilitation: A systematic review. Top. Stroke Rehabil. 2018, 13. [Google Scholar] [CrossRef]
  25. Rodríguez, M.T.S.; Vázquez, S.C.; Casas, P.M.; De Cuerda, R.C. Neurorehabilitation and apps: A systematic review of mobile applications. Neurología 2018, 33, 313–326. [Google Scholar] [CrossRef]
  26. Nussbaum, R.; Kelly, C.; Quinby, E.; Mac, A.; Parmanto, B.; Dicianno, B.E. Systematic Review of Mobile Health Applications in Rehabilitation. Arch. Phys. Med. Rehabil. 2019, 100, 115–127. [Google Scholar] [CrossRef]
  27. Chan, B.K.S.; Ng, S.S.M.; Ng, G.Y.F. A Home-Based Program of Transcutaneous Electrical Nerve Stimulation and Task-Related Trunk Training Improves Trunk Control in Patients with Stroke: A Randomized Controlled Clinical Trial. Neurorehabil. Neural Repair. 2015, 29, 70–79. [Google Scholar] [CrossRef]
  28. Verheyden, G.; Kersten, P. Investigating the internal validity of the Trunk Impairment Scale (TIS) using Rasch analysis: The TIS 2.0. Disabil. Rehabil. 2010, 32, 2127–2137. [Google Scholar] [CrossRef]
  29. Cabanas-Valdés, R.; Urrútia, G.; Bagur-Calafat, C.; Caballero-Gómez, F.M.; Germán-Romero, A.; Girabent-Farrés, M. Validation of the Spanish version of the Trunk Impairment Scale Version 2.0 (TIS 2.0) to assess dynamic sitting balance and coordination in post-stroke adult patients. Top. Stroke Rehabil. 2016, 23, 225–232. [Google Scholar] [CrossRef]
  30. Health Quality Ontario, Ministry of Health and Long-Term Care. Quality-Based Procedures: Clinical Handbook for Stroke (Acute and Postacute) [Internet]; Queen’s Printer for Ontario: Toronto, ON, Canada, 2016. Available online: http://health.gov.on.ca/en/pro/programs/ecfa/docs/qbp_stroke.pdf (accessed on 10 March 2022).
  31. Salgueiro, C.; Urrùtia, G.; Cabanas-Valdés, R. Available apps for stroke telerehabilitation during corona virus disease 2019 confinement in Spain. Disabil. Rehabil. Assist. Technol. 2021, 12. [Google Scholar] [CrossRef]
  32. Requena, M.; Montiel, E.; Baladas, M.; Muchada, M.; Boned, S.; López, R.; Rodríguez-Villatoro, N.; Juega, J.; García-Tornel, Á.; Rodríguez-Luna, D.; et al. Farmalarm. Stroke 2019, 50, 1819–1824. [Google Scholar] [CrossRef] [PubMed]
  33. Gorman, S.L.; Radtka, S.; Melnick, M.E.; Abrams, G.M.; Byl, N.N. Development and validation of the Function In Sitting Test in adults with acute stroke. J. Neurol. Phys. Ther. 2010, 34, 150–160. [Google Scholar] [CrossRef] [PubMed]
  34. Gorman, S.L.; Rivera, M.; McCarthy, L. Reliability of the Function in Sitting Test (FIST). Rehabil Res. Pract. 2014, 2014, 593280. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  35. Cabanas-Valdés, R.; Bagur-Calafat, C.; Caballero-Gómez, F.M.; Cervera-Cuenca, C.; Moya-Valdés, R.; Rodríguez-Rubio, P.R.; Urrútia, G. Validation and reliability of the Spanish version of the Function in Sitting test (S-FIST) to assess sitting balance in subacute post-stroke adult patients. Top. Stroke Rehabil. 2017, 24, 472–478. [Google Scholar] [CrossRef] [PubMed]
  36. Benaim, C.; Pérennou, D.A.; Villy, J.; Rousseaux, M.; Pelissier, J.Y. Validation of a standardized assessment of postural control in stroke patients: The Postural Assessment Scale for Stroke Patients (PASS). Stroke 1999, 30, 1862–1868. [Google Scholar] [CrossRef] [Green Version]
  37. Cabanas Valdés, R.M.; Girabent Farrés, M.; Cánovas Vergé, D.; Caballero Gómez, F.M.; Germán Romero, A.; Bagur Calafat, C. Traducción y validación al español de la Postural Assessment Scale for Stroke Patients (PASS) para la valoración del equilibrio y del control postural en pacientes postictus. Rev. Neurol. 2015, 60, 151. [Google Scholar] [CrossRef]
  38. Alghadir, A.H.; Al-Eisa, E.S.; Anwer, S.; Sarkar, B. Reliability, validity, and responsiveness of three scales for measuring balance in patients with chronic stroke. BMC Neurol. 2018, 18, 141. [Google Scholar] [CrossRef] [Green Version]
  39. BTS Bioengineering. G-WALK: Sistema Inercial Inalámbrico Para la Evaluación Funcional de Movimiento. Available online: https://www.btsbioengineering.com/es/products/g-walk-inertial-motion-system/ (accessed on 16 January 2022).
  40. Zhang, W.; Smuck, M.; Legault, C.; Ith, M.A.; Muaremi, A.; Aminian, K. Gait Symmetry Assessment with a Low Back 3D Accelerometer in Post-Stroke Patients. Sensors 2018, 18, 3322. [Google Scholar] [CrossRef] [Green Version]
  41. Terui, Y.; Suto, E.; Konno, Y.; Kubota, K.; Iwakura, M.; Satou, M.; Nitta, S.; Hasegawa, K.; Satake, M.; Shioya, T. Evaluation of gait symmetry using a tri-axial accelerometer in stroke patients. NeuroRehabilitation 2018, 42, 173–180. [Google Scholar] [CrossRef]
  42. R Core Team. R: A Language and Environment for Statistical Computing; R Foundation for Statistical Computing: Vienna, Austria, 2020; Available online: https://www.R-project.org (accessed on 10 March 2022).
  43. Van Criekinge, T.; Truijen, S.; Schröder, J.; Maebe, Z.; Blanckaert, K.; van der Waal, C.; Vink, M.; Saeys, W. The effectiveness of trunk training on trunk control, sitting and standing balance and mobility post-stroke: A systematic review and meta-analysis. Clin. Rehabil. 2019, 33, 992–1002. [Google Scholar] [CrossRef]
  44. Cabrera-Martos, I.; Ortiz-Rubio, A.; Torres-Sánchez, I.; López-López, L.; Jarrar, M.; Valenza, M.C. The Effectiveness of Core Exercising for Postural Control in Patients with Stroke: A Systematic Review and Meta-Analysis. PM R 2020, 12, 1157–1168. [Google Scholar] [CrossRef]
  45. Marotta, N.; Demeco, A.; Moggio, L.; Ammendolia, A. Why is telerehabilitation necessary? A pre-post COVID-19 comparative study of ICF activity and participation. J. Enabling Technol. 2021, 15, 117–121. [Google Scholar] [CrossRef]
  46. Salgueiro, C.; Urrútia, G.; Cabanas-Valdés, R. Telerehabilitation for balance rehabilitation in the subacute stage of stroke: A pilot controlled trial. NeuroRehabilitation 2022, 15, 1–9. [Google Scholar] [CrossRef]
  47. Howes, S.; Stephenson, A.; Murphy, P.; Deutsch, J.; Stokes, M.; Pedlow, K.; McDonough, S. Factors influencing the delivery of telerehabilitation for stroke: A systematic review. Physiotherapy 2021, 114, e71–e244. [Google Scholar] [CrossRef]
  48. Knepley, K.D.; Mao, J.Z.; Wieczorek, P.; Okoye, F.O.; Jain, A.P.; Harel, N.Y. Impact of Telerehabilitation for Stroke-Related Deficits. Telemed. e-Health 2020, 27, 239–246. [Google Scholar] [CrossRef]
  49. Cramer, S.C.; Dodakian, L.; Le, V.; See, J.; Augsburger, R.; McKenzie, A.; Zhou, R.J.; Chiu, N.L.; Heckhausen, J.; Cassidy, J.M.; et al. Efficacy of Home-Based Telerehabilitation vs In-Clinic Therapy for Adults After Stroke: A Randomized Clinical Trial. JAMA Neurol. 2019, 76, 1079–1087. [Google Scholar] [CrossRef]
  50. Saywell, N.L.; Vandal, A.C.; Mudge, S.; Hale, L.; Brown, P.; Feigin, V.; Hanger, C.; Taylor, D. Telerehabilitation After Stroke Using Readily Available Technology: A Randomized Controlled Trial. Neurorehabilit. Neural Repair 2021, 35, 88–97. [Google Scholar] [CrossRef]
  51. Tenforde, A.S.; Zafonte, R.; Hefner, J.; Iaccarino, M.A.; Silver, J.; Paganoni, S. Evidence-Based Physiatry: Efficacy of Home-Based Telerehabilitation vs In-Clinic Therapy for Adults After Stroke. Am. J. Phys. Med. Rehabil. 2020, 99, 764–765. [Google Scholar] [CrossRef]
  52. National Library of Medicine. “Telerehabilitation and Stroke” Research Results. Available online: https://pubmed.ncbi.nlm.nih.gov/?term=telerehabilitation+stroke&filter=years.2018-2021&timeline=expanded (accessed on 16 January 2022).
  53. Laver, K.E.; Adey-Wakeling, Z.; Crotty, M.; Lannin, N.A.; George, S.; Sherrington, C. Telerehabilitation services for stroke. Cochrane Database Syst. Rev. 2020, 1, CD010255. [Google Scholar] [CrossRef]
Figure 1. Core-stability exercise protocol for stroke patients included in the telerehabilitation App.
Figure 1. Core-stability exercise protocol for stroke patients included in the telerehabilitation App.
Ijerph 19 05689 g001
Figure 2. Flowchart of the study.
Figure 2. Flowchart of the study.
Ijerph 19 05689 g002
Table 1. Characteristics of the experimental and control group at baseline.
Table 1. Characteristics of the experimental and control group at baseline.
VariablesPre-Intervention
Control Group (n = 15)Experimental Group (n = 15)
Characteristics
Age (years), mean (SD)64.53 (9.40)57.27 (14.35)
Weight (Kilograms), mean (SD)75.83 (12.76)80.83 (11.05)
Height (centimeters), mean (SD)164.40 (10.18)169.13 (9.49)
Body Mass Index, mean (SD)27.73 (3.54)26.15 (3.61)
Sex (male/female)10/510/5
Stroke risk factors (yes/no)8/74/11
Predominant risk factorHigh Blood PressureHigh Blood Pressure
Active lifestyle before stroke (yes/no)7/88/7
Stroke (hemorrhagic/ischaemic)5/105/10
Predominant stroke localizationMiddle Cerebral ArteryMiddle Cerebral Artery
Hemiplegia (right/left)7/810/5
Time post-stroke (years), mean (SD)4.06 (4.43)4.61 (3.38)
Smartphone user (yes/no)14/115/0
Coventional Physiotherapy
Times/week (frequency)
>410
3–4 02
1–2 1312
no therapy11
Scales
Sitting balance, mean (SD)
S-TIS 2.0 (balance)4.27 (1.62)4.73 (2.12)
S-TIS 2.0 (coordination)3.07 (1.33)2.87 (1.13)
S-TIS 2.0 (total)7.33 (2.38)7.60 (2.77)
S-FIST (total)56.86 (3.40)52.6 (9.58)
Standing balance, mean (SD)
S-PASS (mobility)18.67 (2.85)18.93 (2.89)
S-PASS (balance)10.47 (2.61)9.46 (2.23)
S-PASS (total)29.13 (5.00)28.4 (4.90)
BBS41.27 (15.42)43.2 (12.73)
Falls00
Gait—G-Walk, mean (SD)
Stance phase % (affected limb)5.18 (4.36)6.13 (4.70)
Stance phase % (less affected limb)5.38 (5)5.13 (3.72)
Swing phase % (affected limb)8.11 (8.03)10.05 (9.10)
Swing phase % (less affected limb)7.13 (6.71)7.54 (8.20)
Double Support % (affected limb)4.56 (5.28)4.51 (5.84)
Double Support % (less affected limb)4.50 (4.89)1.57 (1.33)
Single Support % (affected limb)5.68 (5.18)6.20 (4.39)
Single Support % (less affected limb)5.86 (4.75)4.85 (4.18)
Cadence (steps/minute)30.47 (20.01)22.49 (23.07)
Speed (meters/seconds)0.39 (0.38)0.36 (0.35)
Stride (meters), (affected limb)0.33 (0.28)0.35 (0.40)
Stride (meters), (less affected limb)0.34 (0.28)0.36 (0.40)
Values are presented as mean (SD) or absolute frequency. BBS (Berg Balance Scale); S-FIST (Spanish version of Function in Sitting Test); S-PASS (Spanish version of Postural Assessment Scale for Stroke Patients); S-TIS 2.0 (Spanish version of the Trunk Impairment Scale 2.0); SD (standard deviation).
Table 2. Trunk function measures, sitting balance middle and post-intervention.
Table 2. Trunk function measures, sitting balance middle and post-intervention.
Sitting BalanceControl GroupExperimental Group
Middle InterventionPost-InterventionΔT0–T2Middle InterventionPost-InterventionΔT0–T2p-Value (Intergroup *)
S-TIS 2.0 (balance)4.15 (2.54)4.31 (1.84)0.23 (1.30)6.15 (2.12)6.71 (2.33)1.86 (1.56)0.007
p-value (intragroup *) 0.534 0.001
S-TIS 2.0 (coordination)3.00 (1.91)3.15 (1.91)0.08 (1.44)3.15 (1.72)3.64 (1.15)0.71 (0.91)0.424
p-value (intragroup *) 0.851 0.012
S-TIS 2.0 (total)7.15 (4.20)7.46 (3.57)0.31 (2.10)9.31 (3.5)10.36 (3.03)2.57 (1.87)0.032
p-value (intragroup *) 0.606 0.000
S-FIST (total)54.15 (3.87)53.54 (6.84)−1.15 (4.36)52.69 (10.26)54.71 (3.47)2.36 (6.66)0.574
p-value (intragroup *) 0.358 0.208
Values are presented as mean (SD). * pre and post-intervention values. p-value (statistical significance); SD (standard deviation); S-FIST (Spanish version of Function in Sitting Test); S-TIS 2.0 (Spanish version of the Trunk Impairment Scale 2.0); ΔT0–T2 (intragroup improvement).
Table 3. Balance outcome measures, standing balance middle and post-intervention.
Table 3. Balance outcome measures, standing balance middle and post-intervention.
Standing BalanceControl GroupExperimental Group
Middle InterventionPost-InterventionΔT0–T2Middle InterventionPost-interventionΔT0–T2p-Value (Intergroup *)
S-PASS (mobility)18.85 (3.31)18.69 (3.50)0.15 (1.52)19.54 (3.13)20.43 (3.48)1.43 (2.28)0.208
p-value (intragroup *) 0.721 0.035
S-PASS (balance)10.46 (2.70)10.46 (3.01)−0.08 (1.04)9.69 (2.39)9.79 (2.52)0.29 (0.91)0.532
p-value (intragroup *) 0.794 0.263
S-PASS (total)29.31 (5.54)29.15 (6.04)0.08 (1.93)28.54 (5.43)30.21 (5.35)1.71 (2.43)0.633
p-value (intragroup *) 0.888 0.02
BBS40.69 (15.69)42.54 (14.49)2.46 (2.85)44 (13.22)44.93 (12.29)1.93 (2.95)0.647
p-value (intragroup *) 0.009 0.029
Falls0.47 (0.88)0.15 (0.38)0.150.15 (0.38)0.14 (0.36)0.140.999
p-value (intragroup *) 0.165 0.165
Values are presented as mean (SD). * pre and post-intervention values. BBS (Berg Balance Scale); p-value (statistical significance); SD (standard deviation); S-PASS (Spanish version of Postural Assessment Scale for Stroke Patients); ΔT0–T2 (intragroup improvement).
Table 4. Gait analysis middle and post-intervention.
Table 4. Gait analysis middle and post-intervention.
GaitControl GroupExperimental Group
Middle InterventionPost-InterventionΔT0–T2Middle InterventionPost-InterventionΔT0–T2p-Value (Intergroup *)
Phase
Stance phase % ** (affected limb)4.53 (2.99)4.01 (2.21)1.74 (5.14)5.25 (3.25)6.43 (4.21)0.16 (6.13)0.568
p-value (intragroup *) 0.541 0.833
Stance phase % ** (less affected limb)4.07 (3.03)4.95 (2.99)1.14 (5.78)5.19 (4.97)6.53 (4.63)−0.93 (5.23)0.395
p-value (intragroup *) 0.334 0.334
Swing phase % ** (affected limb)5.00 (5.22)6.13 (4.60)1.98 (8.36)5.87 (6.54)8.33 (8.19)1.71 (9.85)0.909
p-value (intragroup *) 0.800 0.648
Swing phase % ** (less affected limb)3.71 (3.99)4.99 (4.04)2.14 (7.81)5.35 (6.45)7.02 (6.30)0.52 (7.76)0.923
p-value (intragroup *) 0.881 0.848
Support
Double Support % ** (affected limb)2.65 (3.92)2.77 (3.47)1.79 (4.65)0.82 (0.97)1.27 (1.76)0.30 (2.51)0.299
p-value (intragroup *) 0.512 0.096
Double Support % ** (less affected limb)3.82 (9.52)2.68 (3.36)1.82 (6.38)2.49 (3.17)4.56 (3.95)−0.05 (7.06)0.034
p-value (intragroup *) 0.370 0.022
Single Support % ** (affected limb)5.16 (6.86)5.3 (2.79)0.56 (5.98)4.23 (3.46)6.03 (4.98)−1.18 (6.53)0.921
p-value (intragroup) 0.498 0.405
Single Support %** (less affected limb)5.16 (6.86)5.30 (2.79)0.56 (5.98)4.23 (3.46)6.03 (4.98)−1,18 (6.53)0.840
p-value (intragroup *) 0.117 0.428
Others
Cadence (steps/minute **)30.88 (21.93)26.88 (24.97)7.44 (16.74)32.9 (22.19)29.49 (21.68)−4.89 (18.57)0.292
p-value (intragroup *) 0.606 0.929
Speed (meters/seconds)0.86 (0.44)0.94 (0.35)0.01 (0.05)0.95 (0.34)0.94 (0.36)−0.08 (0.45)0.951
p-value (intragroup *) 0.940 0.929
Stride (meters), (affected limb)1.20 (0.50)1.26 (0.31)0.01 (0.15)1.28 (0.70)1.30 (0.55)−0.06 (0.52)0.984
p-value (intragroup *) 0.55 0.606
Stride (meters), (less affected limb)1.21 (0.50)1.26 (0.32)−0.02 (0.14)1.30 (0.71)1.30 (0.56)−0.06 (0.52)0.987
p-value (intragroup *) 0.547 0.615
Values are presented as mean (SD). * pre and post-intervention values. ** difference between normal values and measurements. p-value (statistical significance); SD (standard deviation); ΔT0–T2 (intragroup improvement).
Table 5. Telerehabilitation app adherence.
Table 5. Telerehabilitation app adherence.
AdherenceExercises Performed
(%)Exercises/Day(%)
Mean (SD)8.2 (8.1)13.6611.84 (9.41)37.09
Min-max0–23 0–32
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Salgueiro, C.; Urrútia, G.; Cabanas-Valdés, R. Influence of Core-Stability Exercises Guided by a Telerehabilitation App on Trunk Performance, Balance and Gait Performance in Chronic Stroke Survivors: A Preliminary Randomized Controlled Trial. Int. J. Environ. Res. Public Health 2022, 19, 5689. https://doi.org/10.3390/ijerph19095689

AMA Style

Salgueiro C, Urrútia G, Cabanas-Valdés R. Influence of Core-Stability Exercises Guided by a Telerehabilitation App on Trunk Performance, Balance and Gait Performance in Chronic Stroke Survivors: A Preliminary Randomized Controlled Trial. International Journal of Environmental Research and Public Health. 2022; 19(9):5689. https://doi.org/10.3390/ijerph19095689

Chicago/Turabian Style

Salgueiro, Carina, Gerard Urrútia, and Rosa Cabanas-Valdés. 2022. "Influence of Core-Stability Exercises Guided by a Telerehabilitation App on Trunk Performance, Balance and Gait Performance in Chronic Stroke Survivors: A Preliminary Randomized Controlled Trial" International Journal of Environmental Research and Public Health 19, no. 9: 5689. https://doi.org/10.3390/ijerph19095689

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop