Next Article in Journal
Development of a New Method for Calculating Intraocular Lens Power after Myopic Laser In Situ Keratomileusis by Combining the Anterior–Posterior Ratio of the Corneal Radius of the Curvature with the Double-K Method
Previous Article in Journal
Paclitaxel-Loaded PLGA Coating Stents in the Treatment of Benign Cicatrical Airway Stenosis
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Functional Status Following Pulmonary Rehabilitation: Responders and Non-Responders

1
Lab3R-Respiratory Research and Rehabilitation Laboratory, and Institute of Biomedicine (iBiMED), School of Health Sciences (ESSUA), University of Aveiro, 3810-193 Aveiro, Portugal
2
Department of Medical Sciences, University of Aveiro, 3810-193 Aveiro, Portugal
3
Department of Respiratory Medicine, Maastricht University Medical Centre, NUTRIM School of Nutrition and Translational Research in Metabolism, Faculty of Health, Medicine and Life Sciences, Maastricht University, 6200 MD Maastricht, The Netherlands
4
Department of Pulmonology, Centro Hospitalar do Baixo Vouga, E.P.E., 3810-164 Aveiro, Portugal
5
Department of Research and Development, Ciro, 6085 NM Horn, The Netherlands
*
Author to whom correspondence should be addressed.
J. Clin. Med. 2022, 11(3), 518; https://doi.org/10.3390/jcm11030518
Submission received: 20 November 2021 / Revised: 18 January 2022 / Accepted: 19 January 2022 / Published: 20 January 2022
(This article belongs to the Section Pulmonology)

Abstract

:
The 6 min walking test (6MWT) has been largely studied. Less is, however, known about responders and non-responders to pulmonary rehabilitation (PR) in other meaningful activities. We explored responders and non-responders and the predictors of response to PR in the 1 min sit-to-stand test (1 min STS) and the 6MWT and compared both measures in classifying responders. An observational study was conducted with 121 people with chronic obstructive pulmonary disease (COPD). The functional status was assessed before and after PR. Baseline differences between responders and non-responders were tested with Mann–Whitney U, chi-square, or Fisher exact tests. Predictors were explored with binary logistic regressions. Agreement between both measures was assessed with chi-square, Cohen’s kappa, and McNemar tests. There were 54.5% and 57.0% of responders in the 1 min STS and the 6MWT, respectively. The proportion of responders was significantly different (p = 0.048), with a small agreement between the measures (kappa = 0.180; p = 0.048). The baseline 6MWT was the only significant predictor of response in the 6MWT (OR = 0.995; pseudo-r2 = 0.117; p < 0.001). No significant predictors were found for the 1 min STS. A large number of non-responders in terms of functional status exist. The 1 min STS and the 6MWT should not be used interchangeably. Future studies should explore the added benefit of personalizing PR to this outcome and investigate other potential predictors.

1. Introduction

Pulmonary rehabilitation (PR) is a cornerstone for the daily management of people with chronic obstructive pulmonary disease (COPD) [1]. Improvements in physical, psychological, and social traits have been widely demonstrated with this comprehensive intervention [2]. However, there are still poor responders to PR and this is partially influenced by the outcomes and measures selected [3].
Functional status, the individual’s ability to perform normal daily activities required to meet basic needs, fulfill usual roles, and maintain health and well-being [4], is a highly valued outcome of PR by patients, informal caregivers, and healthcare professionals [5]. The 6 min walking test (6MWT) is a widely used measure in PR [6], but its use is limited to long corridors and thus it cannot be applied in all settings, such as patients’ homes. Furthermore, PR should be focused on improving not only people’s ability to walk but also other meaningful activities of daily living (ADL), such as sitting down on and standing up from a chair. The 1 min sit-to-stand test (1 min STS) has been much less used but has gained popularity in recent years as it is a simple, reliable, and responsive test that elicits physiological responses similar to those by the 6MWT [7,8,9,10]. Although a responder analysis for the 6MWT has been previously conducted [3,11,12,13,14,15], less is known about the responders in the 1 min STS and whether the type of response is similar in both measures.
Hence, this study aimed to explore the (1) responders and non-responders of PR in the 1 min STS and the 6MWT, (2) predictors of response to PR in these measures, and (3) agreement between both measures in classifying responders and non-responders to PR.

2. Materials and Methods

2.1. Study Design and Population

An observational study was conducted with data collected between 2017 and 2020. The study was approved by the Ethics Committee of Centro Hospitalar do Baixo Vouga (ref. 086892), and informed consent was obtained by all participants. The study was reported following the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement [16].
People with a spirometry-based diagnosis of COPD (forced expiratory volume in 1 s (FEV1)/forced vital capacity (FVC) < 70) [17] who completed a community-based PR program were included. Those who had a history of an acute cardiac/respiratory condition within the previous month; significant cardiac, musculoskeletal, or neuromuscular diseases that impaired the ability to perform tests; signs of cognitive impairment; and a history of neoplasia or immunological disease were excluded. A complete case analysis was performed, with only variables with less than 5% missing data considered for the analysis [18].

2.2. Measurements

Sociodemographic and anthropometric data, such as age, sex, height, weight, and body mass index, were firstly collected. Clinical data collected included data on smoking status, use of long-term oxygen therapy, use of non-invasive ventilation, comorbidities using the Charlson comorbidity index [19], severity of airflow limitation and symptom burden and risk of exacerbation as defined by the Global Initiative for Chronic Obstructive Lung Disease (GOLD) [20], lung function with spirometry, respiratory-related hospital admissions, acute exacerbations of COPD, impact of the disease with the COPD assessment test (CAT) [21], dyspnea during activities with the modified medical research council dyspnea scale (mMRC) [22], health-related quality of life with Saint George’s respiratory questionnaire (SGRQ) [23], quadriceps maximum voluntary contraction with a handheld dynamometer [24] (microFET2, Hoggan Health, The best Salt Lake City, Utah), handgrip strength with a hand dynamometer (W50174, Baseline, UK), physical activity with the brief physical activity assessment tool (BPAAT) [25], balance with the brief balance evaluation systems test (Brief-BESTest) [26], and functional status with the 6MWT [27] and the 1 min STS [28]. Measurements were taken at baseline and after PR.
Participants with impairment in the 6MWT and the 1 min STS were defined as those with values below 70% of the percentage predicted [29]. For the 6MWT, the percentage predicted was computed from the equation proposed by Marques and colleagues [30] and for the 1 min STS, the reference values established by Strassmann and colleagues were used [28]. Responders were defined based on previously established minimal clinically important differences. For the 6MWT, responders were those with a pre–post mean difference of 30 m or more and non-responders were those with a change of less than 30 m [6]. For the 1 min STS, responders were those with a mean difference of 3 or more repetitions and non-responders were those with a mean difference of less than 3 repetitions [7].

2.3. Intervention

Participants completed a 12-week community-based PR program, with exercise training (aerobic and resistance muscle strength training) twice a week and education and psychosocial support once every 2 weeks. The program was provided by a multidisciplinary team of physiotherapists, medical doctors, nurses, psychologists, dietitians, and social workers. Details of the program have been published elsewhere [31].

2.4. Data Analysis

Descriptive statistics were computed for baseline characteristics. Effects of PR were explored through paired-samples t-test, Wilcoxon, and Chi-square tests as appropriate, and effect sizes were computed using Cohen’s d estimates.
Baseline differences between responders and non-responders were analyzed through independent samples t-tests, Mann–Whitney U tests, chi-square, or Fisher exact tests depending on data distribution. Normal distributed variables were reported as the mean ± standard deviation, non-normal distributed variables as the median (interquartile range), and frequencies as n (%).
Possible relationships between the mean difference in functional status and other outcomes were explored with Spearman correlations. Potential predictors of good response were explored with binary logistic regressions using a forward conditional model. Correlations were interpreted as follows: <30 small, 0.30–0.49 medium, and ≥0.50 large [32].
Chi-square tests were performed to compare the proportion of responders and non-responders in the 6MWT and in the 1 min STS. The agreement between the two measures in classifying responders and non-responders was assessed using Cohen’s kappa and McNemar tests. Cohen’s kappa was interpreted as ≤0 indicating no agreement, 0.01–0.20 none-to-slight agreement, 0.21–0.40 fair agreement, 0.41–0.60 moderate agreement, 0.61–0.80 substantial agreement, and 0.81–1.00 almost perfect agreement [33].
All analysis were performed using SPSS Statistics (v27, IBM). Plots were created using Prism (v7, GraphPad Software).

3. Results

3.1. Sample Characteristics

One hundred and twenty-one individuals were included. Most participants were male (81.8%), with a median FEV1 of 50% predicted, mostly GOLD grades 2 (43.0%) and 3 (38.8%) and GOLD group B (54.5%). At baseline, 48.8% of participants had an impairment in the 1 min STS and 22.3% in the 6MWT. The full baseline characteristics of participants are presented in Table 1.

3.2. General Effects of PR

PR was effective in improving all outcomes (p < 0.05) excepting BMI (p = 0.591) and handgrip strength (p = 0.619) (Table 1). Improvements above the minimal clinically important difference were seen in the number of repetitions on the 1 min STS (mediandiff 3.0; ES = 0.58; p < 0.001) and on the distance walked in the 6MWT (mediandiff 41.0; ES = 0.56; p < 0.001).
Negative and small-to-moderate correlations were found between the mean change in the 1 min STS and the mean change in the mMRC (rs = −0.249; 95% CI (−0.415; −0.068); p = 0.006) and the SGRQ (rs = −0.279; 95% CI (−0.441; −0.099); p = 0.002). A positive and moderate correlation was found between the mean change of the 1 min STS and the mean change of the 6MWT (rs = 0.317; 95% CI (0.141; 0.473); p < 0.001).
Small correlations were also found between the mean change in the 6MWT and the mean change in the SGRQ (rs = −0.197; 95% CI (−0.368; −0.013); p = 0.031) and the handgrip strength (rs = 0.193; 95% CI (0.010; 0.364); p = 0.034). No other correlations were found (Tables S1 and S2 of Supplementary Materials).

3.3. Responders, Non-Responders, and Predictors of Response

After PR, 54.5% of the patients were responders in the 1 min STS and 57% in the 6MWT. Differences between the baseline characteristics of responders and non-responders in both the 1 min STS and the 6MWT were found. Responders in the 1 min STS had a higher baseline BMI (27.0 (24.3–30.1)) kg/m2 vs. non-responders (24.2 (22.1–28.3)) kg/m2 (p = 0.008) and a lower baseline performance (22.5 (18.0–27.0)) repetitions vs. non-responders (25.0 (20.5–31.0)) repetitions (p = 0.035). Responders in the 6MWT had lower BPAAT scores (0.0 (0.0–2.0)) points vs. non-responders (1.0 (0.0–4.0)) points (p = 0.038), walked a smaller distance (390.0 (295.0–480.0)) m vs. non-responders (489.2 (363.2–534.5)) m (p < 0.001), and had a higher percentage of people with a functional capacity impairment (30.4%) vs. non-responders (11.5%; p = 0.013).
When comparing the subgroups of responders and non-responders of both tests (n = 43, 35.5% vs. n = 78, 64.5%), differences were found, with responders having a higher BMI (27.5 (25.0–30.2)) kg/m2 vs. non-responders (24.6 (22.4–28.6)) kg/m2 (p = 0.006), showing worse performance in the 1 min STS (22.0 (17.5–26.5) repetitions vs. non-responders (24.5 (20.0–30.0)) repetitions (p = 0.041), being more frequently impaired in the 1 min STS (65.1%) vs. non-responders (39.7%; p = 0.008), walking a smaller distance in the 6MWT (386.4 (287.4–478.1)) m vs. non-responders (441.3 (356.2–523.5)) m (p = 0.042), and being more frequently impaired in the 6MWT (34.5%) vs. non-responders (15.4%; p = 0.014). No other significant differences were found.
Detailed comparisons of the baseline characteristics of responders and non-responders can be found in Table 2.
A positive and moderate correlation was found between the mean difference in the 1 min STS and the baseline BMI (rs = 0.32; 95% CI (0.143; 0.474); p < 0.001). Negative and low correlations were also found between the mean difference in the 1 min STS and the baseline GOLD grade (rs = −0.22; 95% CI (−0.390; −0.040); p = 0.014) and the 1 min STS (rs = −0.20; 95% CI (−0.368; −0.014); p = 0.030) (Table S3 Supplementary Materials).
Negative and moderate and low correlations were found between the mean difference in the 6MWT and the baseline 6MWT (rs = −0.33; 95% CI (−0.483; −0.154); p < 0.001) and the baseline 1 min STS (rs = −0.19; 95% CI (−0.360; −0.005); p = 0.038). No other significant correlations were found (Table S4 Supplementary Materials).
No significant predictors were found for being a good responder in the 1 min STS (p = 0.05) (Table S5 Supplementary Materials). The baseline 6MWD was the only significant predictor of a response to PR in the 6MWT (p = 0.002), with decreases of 1 m in the baseline 6MWT corresponding to 1.0 increasing the odds of being a good responder (OR = 0.995 95% CI (0.992; 0.998); pseudo-r2 = 0.117; p < 0.001) (Table S6 Supplementary Materials).

3.4. Comparison of Responders and Non-Responders Classified with the 1 min STS and the 6MWT

There were significant differences in the proportion of responders and non-responders in the two measures (p = 0.048), with 35.5% being responders in both measures, 24.0% being non-responders in both measures, 19.0% being responders only in the 1 min STS, and 21.5% being responders only in the 6MWT.
There was a slight but significant agreement between the two measures (kappa = 0.180; pkappa = 0.048; pMcNemar = 0.755) in classifying responders and non-responders. Individual distributions of mean differences achieved in both tests across responders and non-responders can be seen in Figure 1.

4. Discussion

Our study has shown that although PR is effective in improving the functional status, there are also a significant number of non-responders in this outcome, independently of the measure used. This result is coherent with other studies that have shown a large and similar proportion of non-responders in the 6MWT after PR [3,11,34,35]. Since functional status is a highly valued outcome [5,36] and one of the goals of PR is to improve the physical condition, it is important to better understand why some patients are not responding to the intervention in several activities of daily living and how to better tailor PR to these patients.
Including ADL-specific training in PR has been shown to further improve the impact of the disease [37]; the average oxygen uptake; and the time to perform ADL activities, such as stair climbing, which were correlated with improvements in the 6MWT [38]. Nonetheless, the authors did not perform a responder analysis and, therefore, the impact of such intervention on the proportion of responders is unknown. It is, therefore, possible that the addition of specific ADL training to the standard aerobic and resistance training is needed, at least for some people, to achieve additional benefits in terms of not only functional capacity but also functional performance and, hence, optimize each person’s functional status. Furthermore, since non-responders seem to be more fit at baseline than those responding to PR, it is possible that these measures are not responsive enough for these patients or that more challenging exercise modalities, such as high-intensity functional training [39], are needed. The best way to tailor PR to this outcome is, however, yet to be determined.
Additionally, these measures might not be sufficient to have a comprehensive view of the patient functional status as they are focused on functional capacity. In fact, only low-to-moderate correlations were found between both physical tests and between these tests and other important outcomes, such as health-related quality of life. Similar results have been reported during acute states of the disease [40]. Therefore, using composite measures of functional capacity and functional performance, such as the combined use of physical tests and patient-reported outcome measures, might be the way forward to provide a full picture of the patient functional status.
Patients with higher baseline BMIs, worse physical activity levels, and worse performance in the 1 min STS and the 6MWT seem to be better responders in terms of functional status. Having a worse baseline status and being a good responder is a commonly observed pattern for several outcomes, and it might be due to having more room for improvement [3,35,41]. A low baseline 6MWD was the only significant predictor of good response, with little explanation for the variability in the response. Hence, reasons for being a good or poor responder in this outcome remain unclear and require further investigation.
Other patient features, such as muscle function or body composition, could potentially explain why patients respond or do not respond to the intervention. A previous study has shown isometric quadriceps muscle strength to be a predictor of response to PR in the 6MWT [42]. However, we did not find it as a predictor and a recent study found no correlations between isometric measurements of muscle function and the 1 min STS, with muscle power measured by isokinetic or the 5-time STS being the main contributor to the 1 min STS and the 6MWT performance [43]. Hence, dynamic measurements and more robust measures (e.g., isokinetic) should be further explored in the future, as they could be highly relevant to assess and predict the response to PR.
Responders and non-responders in each test shared some features at baseline, such as a similar age, severity of airflow obstruction, comorbidities, symptoms, muscle strength, health-related quality of life, and balance. Thus, improvements in functional status seem to occur independently of these characteristics, and therefore they should prevent healthcare professionals from planning exercise interventions to target this outcome.
We found significant differences in the proportion of responders between the 1 min STS and the 6MWT, with a small agreement between the two measures in classifying responders and non-responders. This result suggests that using the 1 min STS and the 6MWT interchangeably might not be the most appropriate approach, as it can lead to a misclassification of the person as a good or poor responder to PR in this outcome. In fact, since both tests mimic different ADL, it is possible that some people find it more difficult to stand up from a chair repeatedly than to perform a self-paced walk and vice-versa. Although similar physiological responses (e.g., oxygen consumption) have been found between both measures [7], other factors, such as muscle fatigue or mobility, may play a role in explaining the differences in response to the two measures. Differences due to the different contributions of muscle strength, power, and endurance to the 1 min STS and the 6MWT might explain differences obtained [42], but this was not tested in this study. Caution is, therefore, recommended when using the 1 min STS as a surrogate measure of the 6MWT.
This study has some limitations. Although we explored correlations between the type of response with commonly used measures, other measures, such as DEXA and isokinetic muscle assessment, could have proved stronger predictors of response to PR in terms of functional status. Additionally, other patient characteristics, such as fatigue, objective physical activity, and mobility, may influence the response to PR in this outcome and should, therefore, be explored in future studies.

5. Conclusions

Community-based pulmonary rehabilitation improves the functional status of people with COPD; however, a large number of non-responders exist. A low baseline 6MWD was the only significant predictor of a good response in the 6MWT, with no predictors found for the 1 min STS. Future studies should explore the added benefit of tailoring PR to this outcome (e.g., including ADL training) to maximize the response to PR. The small agreement in classifying responders and non-responders between the 1 min STS and the 6MWT suggests that these measures should not be used interchangeably to assess the results of PR in this outcome. Future prospective studies with larger samples are needed to confirm these findings and explore other potential factors influencing the response to PR in this outcome.

Supplementary Materials

The following supporting information can be downloaded at: www.mdpi.com/article/10.3390/jcm11030518/s1, Table S1: Correlation coefficients between mean difference in 1 min sit-to-stand test and mean differences of all variables included in analysis; Table S2: Correlation coefficients between mean difference in 6 min walk test and mean differences of all variables included in analysis; Table S3: Correlation coefficients between mean difference in 1 min sit-to-stand test and baseline characteristics; Table S4: Correlation coefficients between mean difference in 6 min walk test and baseline characteristics; Table S5: Logistic regression for response in 1 min STS; Table S6: Logistic regression for response in 6MWT.

Author Contributions

Conceptualization, S.S.-M., M.A.S. and A.M.; methodology, S.S.-M., M.A.M., J.C. and L.A.; validation, M.A.M. and A.M.; formal analysis, S.S.-M.; investigation, S.S.-M.; resources, A.M.; data curation, S.S.-M. and A.M.; writing—original draft preparation, S.S.-M.; writing—review and editing, S.S.-M., M.A.M., J.C., L.A., M.A.S. and A.M.; visualization, S.S.-M., M.A.M. and A.M.; supervision, M.A.M. and A.M.; project administration, S.S.-M. and A.M.; funding acquisition, A.M. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by Fundação para a Ciência e a Tecnologia (FCT) through the European Social Fund and Programa Operacional Regional do Centro, under the PhD grant SFRH/BD/146134/2019 and by Programa Operacional de Competitividade e Internacionalização—POCI, through Fundo Europeu de Desenvolvimento Regional—FEDER (POCI-01-0145-FEDER-028806), Fundação para a Ciência e Tecnologia (PTDC/SAU-SER/28806/2017), and under the project UIDB/04501/2020.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki and approved by the Ethics Committee of Centro Hospitalar do Baixo Vouga (086892).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are available from the corresponding author on reasonable request.

Acknowledgments

We would like to acknowledge Ana Machado, Patrícia Rebelo, Cátia Paixão, Ana Alves, Vânia Rocha, and Tânia Pinho for their help in collecting data and conducting PR programs.

Conflicts of Interest

The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript; or in the decision to publish the results.

References

  1. Spruit, M.A.; Singh, S.J.; Garvey, C.; ZuWallack, R.; Nici, L.; Rochester, C.; Hill, K.; Holland, A.E.; Lareau, S.C.; Man, W.D.-C.; et al. An Official American Thoracic Society/European Respiratory Society Statement: Key Concepts and Advances in Pulmonary Rehabilitation. Am. J. Respir. Crit. Care Med. 2013, 188, e13–e64. [Google Scholar] [CrossRef]
  2. McCarthy, B.; Casey, D.; Devane, D.; Murphy, K.; Murphy, E.; Lacasse, Y. Pulmonary rehabilitation for chronic obstructive pulmonary disease. Cochrane Database Syst. Rev. 2015, Cd003793. [Google Scholar] [CrossRef]
  3. Spruit, M.A.; Augustin, I.M.; Vanfleteren, L.E.; Janssen, D.J.; Gaffron, S.; Pennings, H.-J.; Smeenk, F.; Pieters, W.; Bergh, J.J.V.D.; Michels, A.-J.; et al. Differential response to pulmonary rehabilitation in COPD: Multidimensional profiling. Eur. Respir. J. 2015, 46, 1625–1635. [Google Scholar] [CrossRef] [PubMed]
  4. Leidy, N.K. Functional status and the forward progress of merry-go-rounds: Toward a coherent analytical framework. Nurs. Res. 1994, 43, 196–202. [Google Scholar] [CrossRef]
  5. Souto-Miranda, S.; Marques, A. Triangulated perspectives on outcomes of pulmonary rehabilitation in patients with COPD: A qualitative study to inform a core outcome set. Clin. Rehabil. 2018, 33, 805–814. [Google Scholar] [CrossRef] [Green Version]
  6. Singh, S.J.; Puhan, M.; Andrianopoulos, V.; Hernandes, N.A.; Mitchell, K.E.; Hill, C.J.; Lee, A.L.; Camillo, C.A.; Troosters, T.; Spruit, M.A.; et al. An official systematic review of the European Respiratory Society/American Thoracic Society: Measurement properties of field walking tests in chronic respiratory disease. Eur. Respir. J. 2014, 44, 1447–1478. [Google Scholar] [CrossRef]
  7. Crook, S.; Büsching, G.; Schultz, K.; Lehbert, N.; Jelusic, D.; Keusch, S.; Wittmann, M.; Schuler, M.; Radtke, T.; Frey, M.; et al. A multicentre validation of the 1-min sit-to-stand test in patients with COPD. Eur. Respir. J. 2017, 49, 1601871. [Google Scholar] [CrossRef] [Green Version]
  8. Reychler, G.; Boucard, E.; Peran, L.; Pichon, R.; Le Ber-Moy, C.; Ouksel, H.; Liistro, G.; Chambellan, A.; Beaumont, M. One minute sit-to-stand test is an alternative to 6MWT to measure functional exercise performance in COPD patients. Clin. Respir. J. 2017, 12, 1247–1256. [Google Scholar] [CrossRef] [PubMed]
  9. Vaidya, T.; de Bisschop, C.; Beaumont, M.; Ouksel, H.; Jean, V.; Dessables, F.; Chambellan, A. Is the 1-minute sit-to-stand test a good tool for the evaluation of the impact of pulmonary rehabilitation? Determination of the minimal important difference in COPD. Int. J. Chronic Obstr. Pulm. Dis. 2016, 11, 2609–2616. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  10. Ozalevli, S.; Ozden, A.; Itil, O.; Akkoclu, A. Comparison of the Sit-to-Stand Test with 6min walk test in patients with chronic obstructive pulmonary disease. Respir. Med. 2007, 101, 286–293. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  11. Troosters, T.; Gosselink, R.; Decramer, M. Exercise Training in COPD: How to Distinguish Responders from Nonresponders. J. Cardiopulm. Rehabil. 2001, 21, 10–17. [Google Scholar] [CrossRef] [PubMed]
  12. Walsh, J.R.; McKeough, Z.; Morris, N.; Chang, A.T.; Yerkovich, S.; Seale, H.E.; Paratz, J.D. Metabolic Disease and Participant Age Are Independent Predictors of Response to Pulmonary Rehabilitation. J. Cardiopulm. Rehabil. Prev. 2013, 33, 249–256. [Google Scholar] [CrossRef]
  13. Scott, A.S.; Baltzan, M.A.; Fox, J.; Wolkove, N. Success in pulmonary rehabilitation in patients with chronic obstructive pulmonary disease. Can. Respir. J. 2010, 17, 219–223. [Google Scholar] [CrossRef]
  14. De Torres, J.P.; Pinto-Plata, V.; Ingenito, E.; Bagley, P.; Gray, A.; Berger, R.; Celli, B. Power of outcome measurements to detect clinically significant changes in pulmonary rehabilitation of patients with COPD. Chest 2002, 121, 1092–1098. [Google Scholar] [CrossRef] [PubMed]
  15. Crisafulli, E.; Costi, S.; Luppi, F.; Cirelli, G.; Cilione, C.; Coletti, O.; Fabbri, L.; Clini, E. Role of comorbidities in a cohort of patients with COPD undergoing pulmonary rehabilitation. Thorax 2008, 63, 487–492. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  16. Von Elm, E.; Altman, D.G.; Egger, M.; Pocock, S.J.; Gøtzsche, P.C.; Vandenbroucke, J.P.; STROBE Initiative. Strengthening the reporting of observational studies in epidemiology (STROBE) statement: Guidelines for reporting observational studies. Int. J. Surg. 2014, 12, 1495–1499. [Google Scholar] [CrossRef] [Green Version]
  17. Miller, M.R.; Hankinson, J.; Brusasco, V.; Burgos, F.; Casaburi, R.; Coates, A.; Crapo, R.; Enright, P.; Van Der Grinten, C.P.M.; Gustafsson, P.; et al. Standardisation of spirometry. Eur. Respir. J. 2005, 26, 319–338. [Google Scholar] [CrossRef] [Green Version]
  18. Jakobsen, J.C.; Gluud, C.; Wetterslev, J.; Winkel, P. When and how should multiple imputation be used for handling missing data in randomised clinical trials—A practical guide with flowcharts. BMC Med. Res. Methodol. 2017, 17, 162. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  19. Charlson, M.E.; Pompei, P.; Ales, K.L.; MacKenzie, C.R. A new method of classifying prognostic comorbidity in longitudinal studies: Development and validation. J. Chronic Dis. 1987, 40, 373–383. [Google Scholar] [CrossRef]
  20. GOLD. Global Strategy for the Diagnosis, Management, and Prevention of Chronic Obstructive Pulmonary Disease. 2022. Available online: https://goldcopd.org/2022-gold-reports-2 (accessed on 16 November 2021).
  21. Jones, P.W.; Harding, G.; Berry, P.; Wiklund, I.; Chen, W.H.; Kline Leidy, N. Development and first validation of the COPD Assessment Test. Eur. Respir. J. 2009, 34, 648–654. [Google Scholar] [CrossRef] [Green Version]
  22. Bestall, J.C.; Paul, E.A.; Garrod, R.; Garnham, R.; Jones, P.W.; Wedzicha, J.A. Usefulness of the Medical Research Council (MRC) dyspnoea scale as a measure of disability in patients with chronic obstructive pulmonary disease. Thorax 1999, 54, 581–586. [Google Scholar] [CrossRef] [Green Version]
  23. Jones, P.W.; Quirk, F.; Baveystock, C.M.; Littlejohns, P. A Self-complete Measure of Health Status for Chronic Airflow Limitation: The St. George’s Respiratory Questionnaire. Am. Rev. Respir. Dis. 1992, 145, 1321–1327. [Google Scholar] [CrossRef] [PubMed]
  24. Bui, K.-L.; Mathur, S.; Dechman, G.; Maltais, F.; Camp, P.; Saey, D. Fixed Handheld Dynamometry Provides Reliable and Valid Values for Quadriceps Isometric Strength in People with Chronic Obstructive Pulmonary Disease: A Multicenter Study. Phys. Ther. 2019, 99, 1255–1267. [Google Scholar] [CrossRef]
  25. Marshall, A.L.; Smith, B.; E Bauman, A.; Kaur, S. Reliability and validity of a brief physical activity assessment for use by family doctors * Commentary. Br. J. Sports Med. 2005, 39, 294–297. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  26. Jácome, C.; Cruz, J.; Oliveira, A.; Marques, A. Validity, Reliability, and Ability to Identify Fall Status of the Berg Balance Scale, BESTest, Mini-BESTest, and Brief-BESTest in Patients With COPD. Phys. Ther. 2016, 96, 1807–1815. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  27. Holland, A.E.; Spruit, M.A.; Troosters, T.; Puhan, M.A.; Pepin, V.; Saey, D.; McCormack, M.C.; Carlin, B.W.; Sciurba, F.C.; Pitta, F.; et al. An official European Respiratory Society/American Thoracic Society technical standard: Field walking tests in chronic respiratory disease. Eur. Respir. J. 2014, 44, 1428–1446. [Google Scholar] [CrossRef]
  28. Strassmann, A.; Steurer-Stey, C.; Dalla Lana, K.; Zoller, M.; Turk, A.J.; Suter, P.; Puhan, M.A. Population-based reference values for the 1-min sit-to-stand test. Int. J. Public Health 2013, 58, 949–953. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  29. Koolen, E.H.; van Hees, H.W.; van Lummel, R.C.; Dekhuijzen, R.; Djamin, R.S.; Spruit, M.A.; van’t Hul, A.J. “Can do” versus “do do”: A Novel Concept to Better Understand Physical Functioning in Patients with Chronic Obstructive Pulmonary Disease. J. Clin. Med. 2019, 8, 340. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  30. Marques, A.; Rebelo, P.; Paixão, C.; Almeida, S.; Jácome, C.; Cruz, J.; Oliveira, A. Enhancing the assessment of cardiorespiratory fitness using field tests. Physiotherapy 2019, 109, 54–64. [Google Scholar] [CrossRef] [PubMed]
  31. Marques, A.; Jácome, C.; Rebelo, P.; Paixão, C.; Oliveira, A.; Cruz, J.; Freitas, C.; Rua, M.; Loureiro, H.; Peguinho, C.; et al. Improving access to community-based pulmonary rehabilitation: 3R protocol for real-world settings with cost-benefit analysis. BMC Public Heal. 2019, 19, 676. [Google Scholar] [CrossRef] [Green Version]
  32. Cohen, J. Statistical Power Analysis for the Behavioral Sciences; Academic Press: Cambridge, MA, USA, 2013. [Google Scholar]
  33. McHugh, M.L. Interrater reliability: The kappa statistic. Biochem. Med. 2012, 22, 276–282. [Google Scholar] [CrossRef]
  34. Gugg, K.; Zwick, R.H. Non-responders to outpatient pulmonary rehabilitation: A retrospective, controlled cohort study. Eur. Respir. J. 2020, 56, 715. [Google Scholar] [CrossRef]
  35. Stoilkova-Hartmann, A.; Janssen, D.J.; Franssen, F.M.; Wouters, E.F. Differences in change in coping styles between good responders, moderate responders and non-responders to pulmonary rehabilitation. Respir. Med. 2015, 109, 1540–1545. [Google Scholar] [CrossRef]
  36. Spruit, M.A.; Pitta, F.; Garvey, C.; ZuWallack, R.L.; Roberts, C.M.; Collins, E.G.; Goldstein, R.; McNamara, R.; Surpas, P.; Atsuyoshi, K.; et al. Differences in content and organisational aspects of pulmonary rehabilitation programmes. Eur. Respir. J. 2013, 43, 1326–1337. [Google Scholar] [CrossRef] [Green Version]
  37. Mahoney, K.; Pierce, J.; Papo, S.; Imran, H.; Evans, S.; Wu, W.-C. Efficacy of adding activity of daily living simulation training to traditional pulmonary rehabilitation on dyspnea and health-related quality-of-life. PLoS ONE 2020, 15, e0237973. [Google Scholar] [CrossRef]
  38. Vaes, A.W.; Delbressine, J.M.; Mesquita, R.; Goertz, Y.M.; Janssen, D.J.; Nakken, N.; Franssen, F.M.; Vanfleteren, L.E.; Wouters, E.F.; Spruit, M.A. Impact of pulmonary rehabilitation on activities of daily living in patients with chronic obstructive pulmonary disease. J. Appl. Physiol. 2019, 126, 607–615. [Google Scholar] [CrossRef] [PubMed]
  39. Feito, Y.; Heinrich, K.M.; Butcher, S.J.; Poston, W.S.C. High-Intensity Functional Training (HIFT): Definition and Research Implications for Improved Fitness. Sports 2018, 6, 76. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  40. Quadflieg, K.; Machado, A.; Haesevoets, S.; Daenen, M.; Thomeer, M.; Ruttens, D.; Spruit, M.A.; Burtin, C. Physical Tests Are Poorly Related to Patient-Reported Outcome Measures during Severe Acute Exacerbations of COPD. J. Clin. Med. 2021, 11, 150. [Google Scholar] [CrossRef] [PubMed]
  41. Van Herck, M.; Antons, J.; Vercoulen, J.H.; Goërtz, Y.M.J.; Ebadi, Z.; Burtin, C.; Janssen, D.J.A.; Thong, M.S.Y.; Otker, J.; Coors, A.; et al. Pulmonary Rehabilitation Reduces Subjective Fatigue in COPD: A Responder Analysis. J. Clin. Med. 2019, 8, 1264. [Google Scholar] [CrossRef] [Green Version]
  42. Walsh, J.R.; Morris, N.R.; McKeough, Z.J.; Yerkovich, S.T.; Paratz, J.D. A Simple Clinical Measure of Quadriceps Muscle Strength Identifies Responders to Pulmonary Rehabilitation. Pulm. Med. 2014, 2014, 782702. [Google Scholar] [CrossRef]
  43. Gephine, S.; Frykholm, E.; Nyberg, A.; Mucci, P.; Van Hees, H.W.H.; Lemson, A.; Klijn, P.; Maltais, F.; Saey, D. Specific Contribution of Quadriceps Muscle Strength, Endurance, and Power to Functional Exercise Capacity in People with Chronic Obstructive Pulmonary Disease: A Multicenter Study. Phys. Ther. 2021, 101, pzab052. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Scatter plot of responders and non-responders to community-based pulmonary rehabilitation of people with chronic obstructive pulmonary disease (COPD) with the mean difference achieved in the 6 min walking test (X-axis) and the 1 -min sit-to-stand test (Y-axis). The axes are intersected at minimal clinically important differences, 6MWT: 30 m and 1 min STS: 3 repetitions. 1 min STS: 1 min sit-to-stand test; 6MWT: 6 min walking test.
Figure 1. Scatter plot of responders and non-responders to community-based pulmonary rehabilitation of people with chronic obstructive pulmonary disease (COPD) with the mean difference achieved in the 6 min walking test (X-axis) and the 1 -min sit-to-stand test (Y-axis). The axes are intersected at minimal clinically important differences, 6MWT: 30 m and 1 min STS: 3 repetitions. 1 min STS: 1 min sit-to-stand test; 6MWT: 6 min walking test.
Jcm 11 00518 g001
Table 1. Baseline characteristics and effects of pulmonary rehabilitation in people with chronic obstructive pulmonary disease (COPD) (n = 121).
Table 1. Baseline characteristics and effects of pulmonary rehabilitation in people with chronic obstructive pulmonary disease (COPD) (n = 121).
BaselinePost∆ Pre-PostEffect Size (d)p-Value
Age, years69.0 (65.0–75.0)
Sex, n (%)
Male99 (81.8)
Female22 (18.2)
BMI, kg/m226.4 ± 4.826.4 ± 4.6−0.0 ± 0.90.0490.591
Underweight, <21, n (%)13 (10.7)10 (8.3)3 (2.4) <0.001 *
Obese >30, n (%)28 (23.1)27 (22.5)1 (0.6)
Smoking status, n (%)
Never22 (18.2)
Former82 (67.8)
Current17 (14.0)
Pack-years31.2 (10.0–60.0)
LTOT, n (%)12 (9.9)
NIV, n (%)16 (13.2)
CCI, score4.0 (3.0–5.0)
FEV1 % predicted50.0 (37.0–63.7)
GOLD grade, n (%)
19 (7.4)
252 (43.0)
347 (38.8)
413 (10.7)
GOLD group, n (%)
A32 (26.4)
B66 (54.5)
C3 (2.5)
D20 (16.5)
Respiratory-related hospital admissions in the previous 12 months, n0.0 (0.0–0.0)
AECOPD in the previous 12 months, n0.0 (0.0–1.0)
mMRC, score2.0 (1.0–3.0)1.0 (1.0–2.0)0.0 (−1.0–0.0)0.39<0.001 *
CAT score, points14.8 ± 8.012.1 ± 7.0−2.7 ± 5.80.46<0.001 *
SGRQ, total score45.1 ± 19.838.7 ± 19.1−6.4 ± 12.20.52<0.001 *
QVC, KgF30.6 ± 8.433.4 ± 10.22.7 ± 8.70.31<0.001 *
Handgrip strength, KgF34.3 ± 9.234.0 ± 10.1−0.3 ± 7.50.050.619
BPAAT, score0.0 (0.0–3.0)4.0 (2.0–6.0)2.0 (1.0–4.0)0.69<0.001 *
Brief-BESTest19.0 (15.0–22.0)21.0 (18.0–24.0)2.0 (0.0–4.0)0.63<0.001 *
1 min STS, repetitions23.0 (18.0–29.0)27.0 (21.0–33.0)3.0 (0.0–6.0)0.58<0.001 *
1 min STS <70% predicted, n (%)59 (48.8)38 (31.4)21 (17.4) <0.001 *
6MWD, m419.6 (331.9–508.6)465.0 (386.7–540.3)41.0 (7.0–75.3)0.56<0.001 *
6MWD < 70% predicted, n (%)27 (22.3)20 (16.5)7 (5.8) <0.001 *
BMI: body mass index; LTOT: long-term oxygen therapy; NIV: non-invasive ventilation; CCI: Charlson comorbidity index; FEV1: forced expiratory volume in the first second; GOLD: global initiative for chronic obstructive lung disease. 1–4: Severity of airflow limitation, 1—FEV1 ≥ 80% predicted, 2—50% ≤ FEV1 < 80% predicted, 3—30% ≤ FEV1 < 50% predicted, and 4—FEV1 < 30% predicted. CAT: COPD assessment test; A–D: A—CAT < 10 points and 0–1 moderate-to-severe exacerbations (not leading to hospitalization), B—CAT ≥ 10 points and 0–1 moderate-to-severe exacerbations (not leading to hospitalization), C—CAT < 10 points and ≥2 moderate-to-severe exacerbations or ≥1 moderate-to-severe exacerbations leading to hospitalization, and D—CAT ≥ 10 points and ≥2 moderate-to-severe exacerbations or ≥1 moderate-to-severe exacerbations leading to hospitalization; AECOPD: acute exacerbations of COPD; mMRC: modified medical research council dyspnea scale; SGRQ: Saint George’s respiratory questionnaire; QVC: quadriceps voluntary contraction; BPAAT: brief physical activity assessment tool; Brief-BESTest: brief-balance evaluation system test; 1 min STS: 1 min sit-to-stand test; 6MWD: 6 min walking distance. ∆ represents the mean or median difference according to data distribution. * Statistically significant difference.
Table 2. Baseline differences between responders and non-responders in terms of pulmonary rehabilitation of people with chronic obstructive pulmonary disease (COPD) in the 1 min sit-to-stand test and the 6 min walking test (n = 121).
Table 2. Baseline differences between responders and non-responders in terms of pulmonary rehabilitation of people with chronic obstructive pulmonary disease (COPD) in the 1 min sit-to-stand test and the 6 min walking test (n = 121).
1-Min STS6MWT1-Min STS and 6MWT
Responders (n = 66)Non-Responders (n = 55)p-ValueResponders (n = 69)Non-Responders (n = 52)p-ValueResponders in Both Measures (n = 43)Non-Responders in Both Measures (n = 78)p-Value
Age, years69.0 (64.0–75.0)70.0 (67.5–74.5)0.15069.0 (65.0–71.5)69.0 (65.0–71.5)0.34469.0 (61.5–73.0)70.0 (66.0–75.0)0.178
Sex, n (%)
Male50 (75.8)49 (89.1)0.05857 (82.6)42 (80.8)0.79534 (79.1)65 (83.3)0.561
Female16 (24.2)6 (10.9)12 (17.4)10 (19.2)9 (20.9)13 (16.7)
BMI, kg/m227.0 (24.3–30.1)24.2 (22.1–28.3)0.00827.0 ± 4.625.7 ± 5.00.14327.5 (25.0–30.2)24.6 (22.4–28.6)0.009
Smoking status, n (%)
Never13 (19.7)9 (16.4)0.47511 (15.9)11 (21.2)0.6686 (14.0)16 (20.5)0.504
Former46 (69.7)36 (65.5)49 (71.0)33 (63.5)32 (74.4)50 (64.1)
Current7 (10.6)10 (18.2)9 (13.0)8 (15.4)5 (11.6)12 (15.4)
Pack-years, n38.8 (12.3–64.0)30.0 (6.1–55.0)0.34234.1 (13.1–60.0)28.5 (3.2–69−0)0.75638.8 (17.0–60.0)30.0 (5.9–60.8)0.510
LTOT, n (%)8 (12.1)4 (7.3)0.3746 (8.7)6 (11.5)0.6054 (9.3)8 (10.3)0.867
NIV, n (%)11 (16.7)5 (9.1)0.22111 (15.9)5 (9.6)0.3099 (20.9)7 (9.0)0.063
CCI, score4.0 (3.0–5.0)4.0 (3.0–5.0)0.5134.0 (3.0–5.0)4.0 (3.0–4.5)0.3134.0 (3.0–5.0)4.0 (3.0–5.0)0.980
FEV1, % predicted54.3 ± 17.047.8 ± 18.40.04950.4 ± 16.052.6 ± 20.30.52154.0 (41.0–63.0)47.0 (36.0–63.7)0.273
GOLD grade, n (%)
16 (9.1)3 (5.5)0.0543 (4.3)6 (11.5)0.1802 (4.7)7 (9.0)0.064
233 (50.0)19 (34.5)33 (47.8)19 (36.5)25 (58.1)27 (34.6)
324 (36.4)23 (41.8)28 (40.6)19 (36.5)14 (32.6)33 (42.3)
43 (4.5)10 (18.2)5 (7.2)8 (15.4)2 (4.7)11 (14.1)
GOLD group, n (%)
A14 (21.2)18 (32.7)0.52516 (23.2)16 (30.8)0.4059 (20.9)23 (29.5)0.375
B39 (59.1)27 (49.1)42 (60.9)24 (46.2)28 (65.1)38 (48.7)
C2 (3.0)1 (1.8)1 (1.4)2 (3.8)1 (2.3)2 (2.6)
D11 (16.7)9 (16.4)10 (14.5)10 (19.2)5 (11.6)15 (19.2)
Respiratory-related hospital admissions in the previous 12 months, n0.0 (0.0–0.0)0.0 (0.0–0.0)0.7750.0 (0.0–0.0)0.0 (0.0–0.0)0.2980.0 (0.0–0.0)0.0 (0.0–0.0)0.455
AECOPD in the previous 12 months, n0.0 (0.0–1.0)0.0 (0.0–1.0)0.0830.0 (0.0–1.0)0.0 (0.0–1.0)0.9830.0 (0.0–1.0)0.0 (0.0–1.0)0.399
mMRC, score2.0 (1.0–3.0)2.0 (1.0–3.0)0.4412.0 (1.0–3.0)2.0 (1.0–3.0)0.6792.0 (1.0–2.5)2.0 (1.0–3.0)0.420
CAT, total score15.9 ± 8.213.4 ± 7.50.07815.5 ± 7.913.8 ± 8.00.22813.2 ± 7.814.4 ± 8.00.425
SGRQ, total score53.7 (30.2–62.8)43.1 (30.1–53.5)0.06052.6 (30.1–61.8)45.1 (30.2–56.9)0.32153.7 (29.6–61.1)45.1 (30.2–57.4)0.399
QVC, KgF30.2 ± 8.631.0 ± 8.20.56130.7 ± 8.930.4 ± 7.70.87530.1 ± 9.130.8 ± 8.00.679
Handgrip strength, KgF34.3 ± 10.434.4 ± 7.70.92434.3 ± 9.934.3 ± 8.40.98734.6 ± 10.534.2 ± 8.50.803
BPAAT, score0.0 (0.0–3.0)1.0 (0.0–3.0)0.5130.0 (0.0–2.0)1.0 (0.0–4.0)0.0380.0 (0.0–1.0)0.5 (0.0–3.0)0.156
Brief-BESTest, score19.0 (14.0–22.0)18.0 (16.0–22.0)0.87618.0 (15.0–22.0)19.0 (16.0–22.0)0.37319.0 (13.5–22.0)18.0 (16.0–22.0)0.580
1 min STS, repetitions22.5 (18.0–27.0)25.0 (20.5–31.0)0.03522.0 (18.0–28.0)25.5 (20.0–31.5)0.11322.0 (17.5–26.5)24.5 (20.0–30.0)0.041
1 min STS <70% predicted, n (%)37 (56.1)22 (40.0)0.07837 (53.6)22 (42.3)0.21828 (65.1)31 (39.7)0.008
6MWD, m404.4 ± 135.2419.2 ± 115.90.524390.0 (295.0–480.0)489.2 (363.2–534.5)<0.001386.4 (287.4–478.1)441.3 (356.2–523.5)0.042
6MWD <70% predicted, n (%)17 (25.8)10 (18.2)0.31921 (30.4)6 (11.5)0.01315 (34.9)12 (15.4)0.014
BMI: body mass index; LTOT: long-term oxygen therapy; NIV: non-invasive ventilation; CCI: Charlson comorbidity index; FEV1: forced expiratory volume in 1 s; GOLD: global initiative for chronic obstructive lung disease. 1–4: Severity of airflow limitation, 1—FEV1 ≥ 80% predicted, 2—50% ≤ FEV1 < 80% predicted, 3—30% ≤ FEV1 < 50% predicted, and 4—FEV1 < 30% predicted. CAT: COPD assessment test; A–D: A—CAT < 10 points and 0–1 moderate-to-severe exacerbations (not leading to hospitalization), B—CAT ≥ 10 points and 0–1 moderate-to-severe exacerbations (not leading to hospitalization), C—CAT < 10 points and ≥2 moderate-to-severe exacerbations or ≥1 moderate-to-severe exacerbations leading to hospitalization, and D—CAT ≥ 10 points and ≥2 moderate-to-severe exacerbations or ≥1 moderate-to-severe exacerbations leading to hospitalization; AECOPD: acute exacerbations of COPD; mMRC: modified medical research council dyspnea scale; SGRQ: Saint George’s respiratory questionnaire; QVC: quadriceps voluntary contraction; BPAAT: brief physical activity assessment tool; Brief-BESTest: brief-balance evaluation systems test; 1 min STS: 1 min sit-to-stand test; 6MWD: 6 min walking distance.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Souto-Miranda, S.; Mendes, M.A.; Cravo, J.; Andrade, L.; Spruit, M.A.; Marques, A. Functional Status Following Pulmonary Rehabilitation: Responders and Non-Responders. J. Clin. Med. 2022, 11, 518. https://doi.org/10.3390/jcm11030518

AMA Style

Souto-Miranda S, Mendes MA, Cravo J, Andrade L, Spruit MA, Marques A. Functional Status Following Pulmonary Rehabilitation: Responders and Non-Responders. Journal of Clinical Medicine. 2022; 11(3):518. https://doi.org/10.3390/jcm11030518

Chicago/Turabian Style

Souto-Miranda, Sara, Maria A. Mendes, João Cravo, Lília Andrade, Martijn A. Spruit, and Alda Marques. 2022. "Functional Status Following Pulmonary Rehabilitation: Responders and Non-Responders" Journal of Clinical Medicine 11, no. 3: 518. https://doi.org/10.3390/jcm11030518

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop