Next Article in Journal
Analysis of the Characteristics of Cross-Regional Patient Groups and Differences in Hospital Service Utilization in Beijing
Next Article in Special Issue
Predictors of Psychological Distress in Women with Endometriosis during the COVID-19 Pandemic
Previous Article in Journal
Evolution of Select Epidemiological Modeling and the Rise of Population Sentiment Analysis: A Literature Review and COVID-19 Sentiment Illustration
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

Effectiveness of Telematic Behavioral Techniques to Manage Anxiety, Stress and Depressive Symptoms in Patients with Chronic Musculoskeletal Pain: A Systematic Review and Meta-Analysis

by
Ferran Cuenca-Martínez
1,
Luis Suso-Martí
1,*,
Aida Herranz-Gómez
1,
Clovis Varangot-Reille
1,
Joaquín Calatayud
1,
Mario Romero-Palau
2,
María Blanco-Díaz
3,
Cristina Salar-Andreu
4 and
Jose Casaña
1
1
Exercise Intervention for Health Research Group (EXINH-RG), Department of Physiotherapy, University of Valencia, 46010 Valencia, Spain
2
Department of Developmental and Educational Psychology, University of Valencia, 46010 Valencia, Spain
3
Surgery and Medical Surgical Specialties Department, Faculty of Medicine and Health Sciences, University of Oviedo, 33003 Oviedo, Spain
4
Universidad CEU Cardenal Herrera, CEU Universities, 46115 Valencia, Spain
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2022, 19(6), 3231; https://doi.org/10.3390/ijerph19063231
Submission received: 15 February 2022 / Revised: 5 March 2022 / Accepted: 8 March 2022 / Published: 9 March 2022
(This article belongs to the Special Issue Clinical Approach to Chronic Pain and Mental Health)

Abstract

:
Anxiety, depressive symptoms and stress have a significant influence on chronic musculoskeletal pain. Behavioral modification techniques have proven to be effective to manage these variables; however, the COVID-19 pandemic has highlighted the need for an alternative to face-to-face treatment. We conducted a search of PubMed, the Cumulative Index to Nursing and Allied Health Literature (CINAHL), Web of Science, APA PsychInfo, and Psychological and Behavioural Collections. The aim was to assess the effectiveness of telematic behavioral modification techniques (e-BMT) on psychological variables in patients with chronic musculoskeletal pain through a systematic review with meta-analysis. We used a conventional pairwise meta-analysis and a random-effects model. We calculated the standardized mean difference (SMD) with the corresponding 95% confidence interval (CI). Forty-one randomized controlled trials were included, with a total of 5018 participants. We found a statistically significant small effect size in favor of e-BMT in depressive symptoms (n = 3531; SMD = −0.35; 95% CI −0.46, −0.24) and anxiety (n = 2578; SMD = −0.32; 95% CI −0.42, −0.21) with low to moderate strength of evidence. However, there was no statistically significant effect on stress symptoms with moderate strength of evidence. In conclusion, e-BMT is an effective option for the management of anxiety and depressive symptoms in patients with chronic musculoskeletal pain. However, it does not seem effective to improve stress symptoms.

1. Introduction

The COVID-19 pandemic has shaken our lives and jeopardized the treatment of countless patients with chronic pain [1,2]. Chronic pain patients have shown a significant increase in their perceived pain in comparison with the pre-pandemic period [3], as well as an increase in depressive symptoms, anxiety, loneliness, tiredness and catastrophizing [3]. Nearly half of a sample of 2423 chronic pain patients had moderate to severe psychological distress [4]. The worsening of mental health in patients with chronic pain is not without consequences; these variables have been linked to higher pain catastrophizing, pain-related fear and avoidance, and a higher risk of misuse of opioids [5,6].
These patients need follow-up, a close relationship with health professionals and appropriate treatment, but social distancing prevents them from doing so [1]. Chronic pain patients had higher self-isolation than participants without pain during the pandemic [3]. Because it does not require being physically present, telerehabilitation, or the therapeutic use of technological devices, has been recommended for chronic pain management worldwide [2]. Over the last few decades, behavioral modification techniques (BMT) have showed to be effective in the management of psychological variables in chronic pain patients [7,8]. However, it is not clear if telematic BMT (e-BMT) is also effective to improve psychological variables and if it is as effective as in-person BMT. Some previous systematic reviews have assessed the effect of telerehabilitation based on BMT on variables such as pain intensity, disability, disease impact, physical function, pain-related fear of movement, and psychological distress [9,10,11,12], showing promising results.
The primary aim of this systematic review with meta-analysis was to evaluate the effectiveness of e-BMT compared with usual care/waiting list or in-person BMT in psychological variables. Secondly, we aimed to sub-analyze the results by intervention parameters and diagnostic conditions. The main reason for the secondary aim was because the “BMT” label includes a large range of interventions and so we can isolate effects by intervention or by clinical entities.

2. Materials and Methods

This systematic review and meta-analysis was performed according to the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) 2020 statement [13]. This systematic review was registered prospectively in an international database (PROSPERO), where it can be accessed (CRD42021278086).

2.1. Search Strategy

The search strategy of this systematic review is the same as another systematic review from our research group on this topic, which is currently under review. The search for studies was performed using Medline (PubMed), the Cumulative Index to Nursing and Allied Health Literature (CINAHL), Web of Science, APA PsychInfo, and Psychological and Behavioural Collections, from inception to (30) August 2021. In addition, we manually checked the references of the studies included in the review and checked the studies included in systematic reviews related to this topic. The search was also adapted and performed in Google Scholar due to its capacity to search for relevant articles and grey literature [14]. No restrictions were applied to any specific language. The different search strategies used are detailed in Appendix A.1.
Two independent reviewers (CVR and FCM) conducted the search using the same methodology, and the differences were resolved by consensus moderated by a third reviewer (JCG). We used Rayyan software to organize studies, assess studies for eligibility and remove duplicates [15].

2.2. Study Eligibility Criteria

The selection criteria used in this systematic review and meta-analysis were based a Population, Intervention, Control, Outcomes, and Study design framework (PICOS). We included randomized controlled trials that have applied e-BMT through a technology device (Website, online, telephone or mobile application). The intervention could be applied alone or embedded with another treatment, only if the control group contains only the additional treatment. Control group could be usual care, waiting list, no intervention, or in-person equivalent BMT. The participants selected for the studies were patients older than 18 years with any kind of chronic musculoskeletal disorder. The participants’ gender was irrelevant. We excluded patients with musculoskeletal pain due to oncologic or traumatic process. The measures used to assess the results were depressive symptoms, anxiety, and stress. Time of measurement was restrained to post-treatment results.

2.3. Selection Process and Data Extraction

The two phases of studies selection (title/abstract screening and full-text evaluation) were realized by two independent reviewers (CVR and FCM). First, they assessed the relevance of the studies regarding the study questions and aims, based on information from the title, abstract, and keywords of each study. If there was no consensus or the abstracts did not contain sufficient information, the full text was reviewed. In the second phase of the analysis, the full text was used to assess whether the studies met all the inclusion criteria. Differences between the two independent reviewers were resolved by a consensus process moderated by a third reviewer (JCG). Data described in the results were extracted by means of a structured protocol that ensured that the most relevant information was obtained from each study [16].

2.4. Risk of Bias and Methodological Quality Assessment

The Risk Of Bias 2 (RoB 2) tool was used to assess randomized trials [17]. It covers a total of 5 domains: (1) Bias arising from the randomization process, (2) Bias due to deviations from the intended interventions, (3) Bias due to missing outcome data, (4) Bias in measurement of the outcome, (5) Bias in selection of the reported result. The study will be categorized as having (a) low risk of bias if all domains shown low risk of bias, (b) some concerns if one domain is rated with some concerns without any with high risk of bias, and (c) high risk of bias, if one domain is rated as having high risk of bias or multiple with some concerns.
The studies’ methodological quality was assessed using the PEDro scale [18], which assesses the internal and external validity of a study and consists of 11 criteria. The methodological criteria were scored as follows: yes (1 point), no (0 points), or do not know (0 points). The PEDro score for each selected study provided an indicator of the methodological quality (9–10 = excellent; 6–8 = good; 4–5 = fair; 3–0 = poor) [19]. We used the data obtained from the PEDro scale to map the results of the quantitative analyses.
Two independent reviewers (LSM and FCM) examined the quality and the risk of bias of all the selected studies using the same methodology. Disagreements between the reviewers were resolved by consensus with a third reviewer (JCG). Concordance between the results (inter-rater reliability) was measured using Cohen’s kappa coefficient (κ) as follows: (1) κ > 0.7 indicated a high level of agreement between assessors; (2) κ = 0.5–0.7 indicated a moderate level of agreement; and (3) κ < 0.5 indicated a low level of agreement [20].

2.5. Quality of Evidence

The quality of evidence analysis was based on classifying the results into levels of evidence according to the Grading of Recommendations, Assessment, Development and Evaluation (GRADE) framework, which is based on 5 domains: study design, imprecision, indirectness, inconsistency, and publication bias [21]. The assessment of the 5 domains was conducted according to GRADE criteria [22,23]. Evidence was categorized into the following 4 levels accordingly: (a) High quality. Further research is very unlikely to change our confidence in the effect estimate. All 5 domains are also met. (b) Moderate quality. Further research is likely to have an important impact on our confidence in the effect estimate and might change the effect estimate. One of the 5 domains is not met. (c) Low quality. Further research is very likely to have a significant impact on our confidence in the effect estimate and is likely to change the estimate. Two of the 5 domains are not met. (d) Very low quality. Any effect estimates highly uncertain. Three of the 5 domains are not met [22,23].
For the risk of bias domain, the recommendations were downgraded one level in the event there was an uncertain or high risk of bias and serious limitations in the effect estimate (more that 25% of the participants were from studies with high risk of bias, as measured by the RoB 2 scale). In terms of inconsistency, the recommendations were downgraded one level when the point estimates varied widely among studies, the confidence intervals showed minimal overlap or when the I2 was substantial or large (greater than 50%). For the indirectness domain, recommendations were downgraded when severe differences in interventions, study populations or outcomes were found. (The recommendations were downgraded in the absence of direct comparisons between the interventions of interest or when there are no key outcomes, and the recommendation is based only on intermediate outcomes or if more than 50% of the participants were outside the target group.) For the imprecision domain, the recommendations were downgraded one level if there were fewer than 300 participants for the continuous data. Finally, the recommendations were downgraded due to strong influence of publication bias if the results changed significantly after adjusting for publication bias.

2.6. Data Synthesis

The statistical analysis was conducted using RStudio software version 1.4.1717, which is based on R software version 4.1.1 [24,25]. To compare the outcomes reported by the studies, we calculated the standardized mean difference (SMD), as Hedge’s g, over time and the corresponding 95% confidence interval (CI) for the continuous variables. It was interpreted as described by Hopkins et al. [26]. If necessary, CI and standard error (SE) were converted into standard deviation (SD) [27]. The estimated SMDs were interpreted as described by Hopkins et al. [26]; that is, we considered an SMD of 4.0 to represent an extremely large clinical effect, 2.0–4.0 represented a very large effect, 1.2–2.0 represented a large effect, 0.6–1.2 represented a moderate effect, 0.2–0.6 represented a small effect, and 0.0–0.2 represented a trivial effect.
We used the same inclusion criteria for the systematic review and the meta-analysis and included 3 additional criteria: (1) In the results, there was detailed information regarding the comparative statistical data of the exposure factors, therapeutic interventions, and treatment responses; (2) the intervention was compared with a similar control group; and (3) data on the analyzed variables were represented in at least 3 studies.
As we pooled different treatments, we could not assume that there was a unique true effect. So, we anticipated between-study heterogeneity and used a random-effects model to pool effect sizes. In order the calculate the heterogeneity variance τ2, we used the Restricted Maximum Likelihood Estimator as recommended for continuous outcomes [28,29]. To calculate the confidence interval around the pooled effect, we used Knapp–Hartung adjustments [30,31].
We estimated the degree of heterogeneity among the studies using Cochran’s Q statistic test (a p-value < 0.05 was considered significant), the inconsistency index (I2) and the prediction interval (PI) based on the between-study variance τ2 [26]. Cochran’s Q test allows us to assess the presence of between-study heterogeneity [32]. Despite its common use to assess heterogeneity, the I2 index only represents the percentage of variability in the effect sizes not caused by a sampling error [33]. Therefore, as recommended, we additionally report PIs. The PIs are an equivalent to standard deviation and represent a range within which the effects of future studies are expected to fall based on current data [33,34].
To detect the presence of outliers that could potentially influence the estimated pooled effect and assess the robustness of our results, we applied an influence analysis based on the leave-one-out method [35]. If the study’s results had an important influence on the pooled effect, we conducted a sensitivity analysis removing it or them. We additionally ran a drapery plot, which is based on p-value functions and gives us the p-value curve for the pooled estimate for all possible alpha levels [36].
To detect publication bias, we performed a visual evaluation of the Doi plot and the funnel plot [37], seeking asymmetry. We also performed a quantitative measure of the Luis Furuya Kanamori (LFK) index, which has been shown to be more sensitive than the Egger test in detecting publication bias in a meta-analysis of a low number of studies [38]. An LFK index within ±1 represents no asymmetry, exceeding ±1 but within ±2 represents minor asymmetry, and exceeding ±2 involves major asymmetry. If there was significant asymmetry, we applied a small-study effect method to correct for publication bias using the Duval and Tweedie trim and fill method [39].
For the qualitative analysis, we reported the between-group mean difference (MD) with the 95% CI for the outcomes of interest. If it was not reported by the authors, we calculated it [40].

3. Results

3.1. Descriptions of the Studies

From the 749 studies initially detected, a total of 41 RCTs were included [41,42,43,44,45,46,47,48,49,50,51,52,53,54,55,56,57,58,59,60,61,62,63,64,65,66,67,68,69,70,71,72,73,74,75,76,77,78,79,80,81]. The PRISMA 2020 flow chart is detailed in Appendix A.2. We included 5018 participants with a mean age ranging from 33.7 to 65.8 years. The patients were mostly women (N = 3631, 72.4%) diagnosed with chronic back pain [47,52,72,79,80], chronic low back pain [41,55], unspecific chronic pain [43,51,53,56,59,67,68,69,70,71,73,74,75,76,81], fibromyalgia [42,46,48,49,58,63,66], headache [44,60,61,78], rheumatic disorders [45,57,62,64], or others [50,54,65]. Details of the participant’s characteristics and studies are shown in Appendix A.3.
The studies compared online cognitive-behavioral therapy [42,43,45,46,47,54,55,59,63,70,72,79,80,81], acceptance and commitment therapy [56,58,70,71,73,76], self-management [52,59,62,66,67,68,69,77], mindfulness therapy [61,65,70,72,76], or other e-BMT [41,44,48,49,50,53,57,60,64,74,75,78], against most frequently waiting list [43,44,46,48,51,54,56,57,60,62,64,68,71,72,74,75,77,79,80,81], usual care [42,45,47,49,52,55,58,59,61,63,66,67,69,70,73,78], or in-person intervention [50,63,76]. The intervention duration ranged between a single day [65] and 6 months [41,50,62,66,78]. The details of the interventions are described in Appendix A.4 using the Behavior Change Technique Taxonomy (v1) [82].

3.2. Methodological Quality and Risk of Bias

According to the PEDro scale, 30 were evaluated as having good [41,42,43,44,45,46,47,48,49,50,51,55,56,58,59,62,63,64,65,66,68,70,71,72,73,75,76,77,78,80] and 11 as having fair methodological quality [52,53,54,57,60,61,67,69,74,79,81] (Appendix A.5). The inter-rater reliability of the methodological quality assessment between assessors was high (κ = 0.823). According to the Rob 2 scale, all the studies have a high risk of bias (100%) (Figure 1 and Appendix A.6). The inter-rater reliability of the risk of bias assessment between assessors was high (κ = 0.884).

3.3. Qualitative Synthesis

Four studies compared e-BMT with in-person BMT. They applied CBT [47,63], ACT [76] or person-centered intervention [50]. Two found non-statistically significant differences between groups for depressive symptoms (n = 253; MD = 0.24, 95% CI −2.32 to 2.80 [47] and MD = −0.51, 95% CI −2.42 to 1.40 [76]); however, Vallejo et al. found statistically significant between-group differences post-treatment in favor of e-BMT (n = 40; MD = −5.06, 95% CI −7.39 to −2.73) [63]. One found a non-statistically significant difference between groups for anxiety (n = 128; MD = −4.20, 95% CI −10.58 to 2.17) [76] and one found a non-statistically significant difference between groups for stress (n = 109; MD = −2.76, 95% CI −5.94 to 1.28) [50].

3.4. Quantitative Synthesis

3.4.1. Depressive Symptoms

According to the influence analyses, we conducted a sensitivity analysis without Dear et al. [43]. We found a statistically significant small effect size (32 RCTs; n = 3531; SMD = −0.35; 95% CI −0.46, −0.24) of e-BMT on depressive symptoms compared with usual care or waiting list, with significant heterogeneity (Q = 74.06 (p < 0.01); I2 = 57% (36%, 71%); PI −0.82, 0.12) and a low strength of evidence (Figure 2). Since PI crosses zero, we cannot be confident that future studies will not find contradictory results; however, the results appear to be robust to different p-value functions. With respect to the presence of publication bias, the funnel and Doi plots show an asymmetrical pattern, demonstrating minor asymmetry (LFK index = −1.62). When the sensitivity analysis is adjusted for publication bias, there is still a small significant effect. Statistical analyses are detailed in Appendix A.7. Subgroup analyses are detailed in Table 1a.

3.4.2. Anxiety

According to the influence analyses, we conducted a sensitivity analysis without Trudeau et al. [62]. We found a statistically significant small effect size (21 RCTs; n = 2578; SMD = −0.32; 95% CI −0.42, −0.21) of e-BMT on anxiety compared with usual care or waiting list, with significant heterogeneity (Q = 33.47 (p = 0.04); I2 = 37% (0%, 63%); PI −0.64, 0.00) and a moderate strength of evidence (Figure 3). Since PI crosses zero, we cannot be confident that future studies will not find contradictory results; however, the results appear to be robust to different p-value functions. With respect to the presence of publication bias, the funnel and Doi plots show a symmetrical pattern, demonstrating no asymmetry (LFK index = −0.48). Statistical analyses are detailed in Appendix A.8. Subgroup analyses are detailed in Table 1b.

3.4.3. Stress

We found no statistically significant effect size (4 RCTs; n = 789; SMD = −0.13; 95% CI −0.28, 0.02) of e-BMT on stress compared with usual care or waiting list, with significant heterogeneity (Q = 1.33 (p = 0.72); I2 = 0% (0%, 85%); PI −0.34, 0.07) and a moderate strength of evidence (Figure 4). Since PI crosses zero, we cannot be confident that future studies will not find contradictory results. With respect to the presence of publication bias, the funnel and Doi plots show an asymmetrical pattern, demonstrating minor asymmetry (LFK index = −1.55). When the sensitivity analysis is adjusted for publication bias, there is no influence on the estimated effect. Statistical analyses are detailed in Appendix A.9.
GRADE’s overall strength of the evidence is detailed in Table 2.

4. Discussion

The primary aim of this systematic review with meta-analysis was to evaluate the effectiveness of e-BMT compared with usual care/waiting list or in-person BMT in terms of psychological variables. Secondly, we aimed to sub-analyze the results by intervention parameters and diagnostic conditions. The main results found that e-BMT seems to be an effective option for the management of anxiety and depressive symptoms in patients with musculoskeletal conditions causing chronic pain but not to improve stress symptoms. e-BMT does not seem to provide greater improvement than in-person BMT for psychological variables.
Several research studies have been published and have shown similar results to those found in this review with meta-analysis with regard to depressive and anxiety symptoms. For example, the rapid review conducted by Varker et al. [83] aimed to evaluate the effectiveness of e-BMT (by videoconference) and also through conventional mobile phone calls for people with high levels of anxiety and depression. The main results showed that both rehabilitation modalities produced significant positive results in terms of decreasing the levels of both psychological variables. In addition to this, the review conducted by McCall et al. [84] found that delivering psychological telematic interventions resulted in a significant decrease in depressive symptoms but could not be proven to be effective in comparison to face-to-face psychological intervention. Anxiety symptoms could not be assessed. This work included few studies, so the results have to be interpreted with caution.
In addition to being a possible alternative to in-person treatment, e-BMT appears to be a cost-effective technique compared to in-person BMT. De Boer et al. compared e-BMT and in-person BMT in patients with chronic pain and found that the costs of online CBT were EUR 199 lower than in-person BMT [85]. Similarly, Aspvall et al. found that after 6 months of follow-up in children and adolescents with obsessive compulsive disorder, there was a difference of USD 1688 in favor of e-BMT [86]. Healthcare systems and guidelines should seriously consider implementing e-BMT in the management of patients with musculoskeletal disorders causing chronic pain.

4.1. Practical Implication

Concerning clinical implications, the results showed good results in favor of e-BMT. This gives us an effective treatment window in the COVID-19 era, so we are going to have a greater impact on patients with persistent pain. In addition, there is a decentralization of interventions, which may have some positive effects such as improving and increasing adherence to treatments due to easier accessibility, as well as lowering barriers to access or facilitating follow-up. Future studies should also focus on longer follow-ups to see this effectiveness and evaluate variables such as motivation or adherence to chronic pain treatments. Finally, telemedicine rehabilitation may lead to lower costs for both patients and therapists, which may reduce waiting lists for clinical treatments.

4.2. Limitations

We found limited evidence for depressive symptoms; true effects might be different from our estimated effects. We found the presence of publication bias for depressive and stress symptoms; however, adjustments did not influence the results. All the studies have a high risk of bias; results should be interpreted cautiously. Future studies should improve their design quality to enhance our trust in their results. We have pooled together different BMT and conditions. However, we also provided sub-analyses where depressive symptoms and anxiety are analyzed by treatment and by condition.

5. Conclusions

e-BMT is an effective option for the management of anxiety and depressive symptoms in patients with musculoskeletal conditions causing chronic pain and should be introduced when in-person intervention is not possible. However, it does not seem effective to improve stress symptoms.

Author Contributions

Conceptualization, F.C.-M. and C.V.-R.; methodology, F.C.-M., C.V.-R. and L.S.-M.; software, C.V.-R.; validation, J.C. (Joaquín Calatayud), M.R.-P., M.B.-D., C.S.-A. and J.C. (Jose Casaña); formal analysis, F.C.-M. and C.V.-R.; investigation, F.C.-M., C.V.-R., L.S.-M., C.S.-A., M.B.-D. and J.C. (Jose Casaña); resources, A.H.-G., J.C. (Joaquín Calatayud) and J.C. (Jose Casaña); data curation, F.C.-M., L.S.-M., A.H.-G., M.R.-P. and C.V.-R.; writing—original draft preparation, all authors; writing—review and editing, all authors; visualization, all authors; supervision, F.C.-M. and J.C. (Jose Casaña); project administration, J.C. (Jose Casaña). All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Appendix A.1

Pubmed—350 results.
((“Web”) OR (“ehealth”) OR (“mhealth”) OR (“remote treatment”) OR (“digital treatment”) OR (“Mobile Applications”[MesH]) OR (“Software”[Mesh]) OR (“Online”) OR (“Telephone”) OR (“Cell phone”[MesH]) OR (“eTherapy”) OR (“Internet”) OR (“Online”) OR (“Telerehabilitation”) OR (“Internet-Based Intervention”[MesH]) OR (“Telerehabilitation”[MesH]) OR (Telemedicine[MesH])) AND ((“Chronic Pain”) OR (“Chronic Pain”[Mesh])) AND (randomized controlled trial[pt] OR controlled clinical trial[pt] OR randomized[tiab] OR placebo[tiab] OR clinical trials as topic[mesh:noexp] OR randomly[tiab] OR trial[ti] NOT (animals[mh] NOT humans [mh]) NOT (“protocol”) NOT (“Review”)).
CINAHL—173 results.
(web or internet or online or mobile or remote treatment or digital treatment or Internet-Based Intervention or Telerehabilitation or Telemedicine) AND (chronic pain or persistent pain or long term pain or long-term pain) AND (randomized controlled trials or rct or randomised control trials) NOT (systematic review or meta-analysis or literature review or review of literature) NOT (pediatric or child or children or infant or adolescent)
Psychology and Behavioral Sciences Collection (EBSCO)—12 results.
(web or internet or online or mobile or remote treatment or digital treatment or Internet-Based Intervention or Telerehabilitation or Telemedicine or) AND (chronic pain or persistent pain or long term pain or long-term pain) AND (randomized controlled trials or rct or randomised control trials) NOT (systematic review or meta-analysis or literature review or review of literature) NOT (pediatric).
APA PsychINFO—75 results.
(web or websites or internet or online or Online Therapy or mobile or Mobile Applications or remote treatment or digital treatment or Digital Interventions or Internet-Based Intervention or Telerehabilitation or Telemedicine) AND (chronic pain or persistent pain or long term pain or long-term pain) AND (randomized controlled trials or rct or randomised control trials) NOT (systematic review or meta-analysis or literature review or review of literature) NOT (pediatric or child or children or infant or adolescent).
Web of science—49 studies.
TI = (Web OR eearth OR melth OR remote treatment OR digital treatment OR Mobile Applications OR Software OR Online OR Telephone OR Cell phone OR estherapy OR Internet OR Online OR Telerehabilitation OR Internet-Based Intervention OR Telerehabilitation OR Telemedicine) AND TI = (Chronic pain) AND TI = (randomi?ed controlled trial* OR rct).
Google Scholar.
(“web” OR “online” OR “internet” OR “mobile” OR “telerehabilitation” OR “telemedicine”) AND [allintitle:”chronic pain” OR “persistent pain”] AND (“randomized controlled trial” OR “randomised controlled trial OR “RCT”)-review.

Appendix A.2

Figure A1. PRISMA Flowchart of studies selection.
Figure A1. PRISMA Flowchart of studies selection.
Ijerph 19 03231 g0a1

Appendix A.3. Details of the Studies Included in the Systematic Review

Table A1. Details of the Studies Included in the Systematic Review.
Table A1. Details of the Studies Included in the Systematic Review.
Authors, Year

Design

Country
Participants
Sample Size (n)
Age (Mean (SD))
Gender
Condition
Intervention
Modality

Format
ComparatorOutcomesResults
Amorim et al., 2019

Pilot RCT

Australia
N = 68
58.3 (13.4) yrs
50%F/50%M

Chronic LBP
Activity tracker and monitoring application.
+ Telephone follow-up
Mobile application
Advice to stay active and booklet Depressive symptoms, anxiety and stress: DASSNo significant differences on the outcomes.
Ang et al., 2010

RCT

USA
N = 32
48.9 (10.9) yrs
100%F

Fibromyalgia
CBT
+ Usual care
Telephone
Usual careDepressive symptoms: PHQ-8Non-significant difference on depressive symptoms (p = 0.8).
Berman et al., 2009

RCT

USA
N = 89
65.8 (N/R) yrs
87%F/13%M
Unspecified chronic pain
Self-care intervention
Internet-based
No interventionDepressive symptoms: CES-D 10Small non-significant effect on anxiety and depressive symptoms only in self-care group (p > 0.05).
Boselie et al., 2018

RCT

The Netherlands
N = 33
N/R yrs
N/R%F/N/R%M

Unspecified chronic pain
Positive psychology
Internet-based
Waiting listDepressive symptoms and anxiety: HADS
Significant main effect of PPI condition on anxiety (p = 0.02) and depressive symptoms (p = 0.01).
Bossen et al., 2013

RCT

The Netherlands
N = 199
62.0 (5.7) yrs
65%F/35%M

Knee and hip OA
Behavior-graded activity program
Internet-based
Waiting listAnxiety and depressive symptoms: HADSAt the end of the intervention, intervention group showed less anxiety (p = 0.007). Other outcomes showed no significant differences.
Brattberg, 2007

RCT

Sweden
N = 60
47.0 (8.0) yrs
90%F/10%M

Unspecified chronic pain
Support/self-help group about pain.
Internet-based videos or CDs
Waiting listAnxiety and Depressive symptoms: HADSIntervention group showed a higher improvement in depressive symptoms over time (p = 0.04) but not in anxiety (p = 0.4).
Brattberg, 2008

RCT

Sweden
N = 66
43.8 (8.8) yrs
100%F

Fibromyalgia
Emotional freedom techniques
Internet-based
Waiting listAnxiety and Depressive symptoms: HADSIntervention group showed a statistically significant time*group interaction in depressive symptoms (p = 0.02) and anxiety (p = 0.03).
Bromberg et al., 2012

RCT

USA
N = 189
42.6 (11.5) yrs
89%F/11%M

Chronic migraine
Structured behavior changes program
+Usual care
Internet-based
Usual careDepressive symptoms, anxiety and stress: DASS-21Intervention group showed a higher improvement in depressive symptoms (p = 0.008) and stress (p = 0.04), but not on anxiety.
Buhrman et al., 2004

RCT

Sweden
n = 56
44.6 (10.4) yrs
63%F/37%M

Chronic back pain
Online CBT + Relaxation with CDs + Telephone calls about goals
Internet-based
Waiting listAnxiety and depressive symptoms: HADSThere was no significant main effects difference on anxiety and depressive symptoms.
Buhrman et al., 2011

RCT

Sweden
N = 54
43.2 (9.8) yrs
69%F/32%M

Chronic back pain
Online CBT
Internet-based
Waiting listAnxiety and depressive symptoms: HADSThere were no significant differences between group for anxiety and depressive symptoms.
Dear et al., 2013

RCT

Australia
N = 63
49.0 (13) yrs
85%F/15%M

Unspecified chronic pain
Online CBT
Internet-based
Waiting list-Depressive symptoms: PHQ-9
-Anxiety: GAD-7
Intervention had a significantly higher post-treatment improvement in depressive symptoms (p < 0.001), anxiety (p < 0.001).
Dear et al., 2015

RCT

Australia
N = 490
50 (13) yrs
80%F/20%M

Unspecified chronic pain
G1: Online CBT + Regular online contact
G2: Online CBT + optimal online contact
G3: Online CBT
Internet-based
Waiting list-Depressive symptoms: PHQ-9
-Anxiety: GAD-7
Intervention groups had significantly lower scores than waiting list for depressive symptoms and anxiety (p < 0.001) post-treatment.
Devineni and Blanchard, 2005

RCT

USA
N = 86
42.2 (11.9) yrs
62%F/38%M

Chronic migraine and/or tension-type headache
Behavioral headache-related intervention
Internet-based
Waiting listDepressive symptoms: CES-D
There was no statistically significant difference for depressive symptoms (p = 0.11) and anxiety (p = 0.20).
Ferwerda et al.,2017

RCT

The Netherlands
N = 133
56.4(10) yrs
64%F/36%M

Rheumatoid arthritis
CBT
Internet-based
Usual care-Depressive symptoms: BDI
-Negative mood and Anxiety: IRGL
Intervention group report a larger decrease in anxiety (p < 0.001) and depressed mood (p < 0.001) than control group.
Friesen et al., 2017

RCT

Canada
N = 60
48.0 (11.0) yrs
95%F/5%M

Fibromyalgia
CBT + Telephone calls
Internet-based
Waiting list-Anxiety: GAD-7
-Depressive symptoms: PHQ-9
-Anxiety and depressive symptoms: HADS
Intervention group had a significantly higher improvement in anxiety (p = 0.030) and depressive symptoms (p < 0.001).
There were also statistically significant time by group interactions for HADS-depressive symptoms (p = 0.007), and HADS-anxiety (p = 0.001).
Heapy et al., 2017

RCT

USA
N = 125
57.9 (11.6) yrs
22%F/78%M

Chronic back pain
CBT
Interactive voice response
Face-to-Face CBTDepressive symptoms: BDI-II
There were no significant differences between e-CBT and face-to-face CBT in depressive symptoms.
Hedman-Lagerlöf et al., 2018

RCT

Sweden
N = 140
50.8 (24--77) yrs
98%F/2%M

Fibromyalgia
Online exposure therapy
Internet-based
Waiting list-Depressive symptoms: PHQ-9
-Anxiety: GAD-7
There were statistically significant interactions in favor of intervention group for depressive symptoms and anxiety (all, p < 0.001).
Herbert et al., 2017

RCT

USA
N = 128
18%F/82%M
52.0 (13.3) yrs

Unspecific chronic pain
ACT
Video teleconferencing
Face-to-face ACT-Depressive symptoms: PHQ-9
-Pain-related anxiety: PASS-20
There were no significant differences for any outcomes.
Hernando-Garijo et al., 2021

RCT

Spain
N = 34
53.4 (8.8) yrs
100%F

Fibromyalgia
Video-guided aerobic training + usual medical prescription
Videoconferencing
Usual medical prescriptionAnxiety and depressive symptoms: HADSThere was a statistically significant higher improvement in psychological distress (p = 0.002) according to HADS than control group.
Juhlin et al., 2021

RCT

Sweden
N = 139
47.6 (10.1) yrs
90%F/10%M

Chronic widespread pain
Person-centered intervention supported by online platform
Internet-based
Person-centered interventionStress: SCI-93No statistically significant differences between groups for stress (p = 0.21).
Lin et al., 2017

RCT

Germany
N = 201
51.0 (12.4) yrs
86%F/14%M

Unspecific chronic pain
Online guided ACT
Internet-based
Waiting listDepressive symptoms: PHQ-9
Anxiety: GAD-7
There was a significant interaction effect for group x time on depressive symptoms (p < 0.05) in favor of intervention group.
Moessner et al., 2012

RCT

Germany
N = 75
45.9 (9.1) yrs
56%F/44%M

Chronic back pain
Self-monitoring + Online guided chat
Internet-based
Usual careAnxiety and depressive symptoms: HADSThere were no significant differences in other outcomes.
Peters et al., 2017

RCT

Sweden
N = 284
48.6 (12.0) yrs
85%F/15%M

Chronic back, neck or shoulder pain
G1: Online Positive psychology
G2: Online CBT
Internet-based
Waiting listDepressive symptoms and Anxiety: HADSBoth intervention groups showed significant differences with the waiting list group for depressive symptoms (p < 0.001). There were also significant differences for anxiety.
Petrozzi et al., 2019

RCT

New Zealand
N = 108
50.4 (13.6) yrs
50%F/50%M

Chronic LBP
Online CBT+
Usual care
Internet-based
Usual careDepressive symptoms, anxiety and stress: DASS-21There were no statistically significant differences between the two groups for depressive symptoms (0.98), anxiety (p = 0.19) or stress (p = 0.41) at any time-points.
Rickardsson et al., 2021

RCT

Sweden
N = 113
49.5 (12.1) yrs
75%F/25%M

Unspecific chronic pain
Online ACT
Internet-based
Waiting listAnxiety: GAD-7
Depressive symptoms: PHQ-9
The intervention group showed significant interaction effects of time x group for anxiety (p = 0.03) and depressive symptoms (p = 0.001).
Ruehlman et al., 2012

RCT

USA
N = 305
44.9 (N/R) yrs
64%F/36%M

Unspecific chronic pain
Online self-management
Internet-based

Usual care
-Depressive symptoms: CES-D
-Depressive symptoms, anxiety and stress: DASS
Intervention group showed a significant group x time interaction in depressive symptoms (p = 0.03 and p = 0.04), stress (p = 0.00) and anxiety (p = 0.05)
Sander et al., 2020
N = 295
52.8 (7.7) yrs
62%F/38%M

Unspecific chronic pain
Online CBT + Usual care

Internet-based
Usual CareDepressive symptoms: HamD, QIDS score and PHQ-9Intervention group had a statistically significant greater improvement of all the outcomes compared with control group.
Schlickler et al., 2020

RCT

Germany
N = 76
50.8 (7.9) yrs
55%F/45%M

Chronic back pain
Online CBT-based intervention
Internet-based and mobile-based
Waiting list-Depressive symptoms: CES-D and QIDS-SR16
-Anxiety: HamADS
There was a significant reduction in both treatment in depressive symptoms according to CES-D (p < 0.001) with a significant difference in favor of the intervention group post-treatment (p = 0.03). Intervention group also showed a significant greater reduction in anxiety (p = 0.001).
Scott et al., 2018

RCT

UK
N = 63
45.5 (14.0) yrs
64%F/36%M

Unspecific chronic pain
Online ACT + Usual care
Internet-based
Usual careDepressive symptoms: PHQ-9Intervention group showed medium effects on depressive symptoms.
Shigaki et al., 2013

RCT

USA
N = 108
49.8 (11.9) yrs
94%F/6%M

Rheumatoid arthritis
Education and social network website about Rheumatoid arthritis + Telephone calls
Internet-based
Waiting listDepressive symptoms: CES-DNo statistically significant differences in depressive symptoms (p = 0.14).
Simister al., 2018

RCT

N = 67
39.7 (9.4) yrs
95%F/5%M

Fibromyalgia
Online ACT + Usual care
Internet-based
Usual careDepressive symptoms: CES-DIntervention group significantly improved, relative to control group, on depressive symptoms (p = 0.02).
Smith et al., 2019

RCT

Australia
N = 80
45.0 (13.9) yrs
88%F/12%M

Unspecific chronic pain
Online self-management and CBT-based intervention
Internet-based
Usual careDepressive symptoms: PHQ-9There was no statistically significant interaction for depressive symptoms.
Ström et al., 2000

RCT

Sweden

N = 45
36.7 (N/R) yrs
69%F/31%M

Recurrent headache sufferers
Online relaxation and problem-solving intervention
Internet-based
Wait-listDepressive symptoms: BDIThere were no significant differences for depressive symptoms.
Tavallaei et al., 2018

RCT

Iran
N = 30
33.7 (9.0) yrs
100%F

Migraine and tension-type headache
Mindfulness-based Stress Reduction Bibliotherapy
Internet-based
Usual careDepressive symptoms, anxiety and stress: DASS-21N/R
Trompetter et al., 2015

RCT

The Netherlands
N = 238
52.7 (12.4) yrs
76%F/24%M

Unspecific chronic pain
Online ACT
Internet-based
Waiting list Depressive symptoms and Anxiety: HADSThere was a statistically significant difference in depressive symptoms (p = 0.006).
Trudeau et al., 2015

RCT

USA
N = 228
49.9 (11.6)
68%F/32%M

Arthritis
Online self-management intervention
Internet-based
Waiting ListDepressive symptoms, anxiety, and stress: DASS-21No statistically significant condition-by-time effect on the three subscales of the DASS-21.
Vallejo et al., 2015

RCT

Spain
N = 60
51.6 (9.9) yrs
100%F

Fibromyalgia
Online CBT + Usual care
Internet-based
G1: Face-to-face CBT + Usual care

G2: Usual care
Depressive symptoms and anxiety: HADS
Depressive symptoms: BDI
Both groups improved depressive symptoms (both, p < 0.01) and HADS scores.
Westenberg et al., 2018

RCT

USA
N = 126
54.5 (15.0) yrs
50%F/50%M

Upper limb disorders
Online Mindfulness
Internet-based
Attention control-Depressive symptoms: N/R
-Anxiety: N/R
Intervention group had statistically significant improvements in depressive symptoms (p = 0.004) and anxiety (p = 0.024).
Williams et al., 2010

RCT

USA
N = 118
50.5 (11.5) yrs
95%F/5%M

Fibromyalgia
Online CBT + Usual care
Internet-based
Usual care-Depressive symptoms: CES-D
-Anxious mood: STPI—state anxiety
There were no statistically significant differences in anxiety and depressive symptoms.
Wilson et al., 2015

RCT

USA
N = 114
49.3 (11.6) yrs
78%F/12%M

Unspecific chronic pain
Online pain management program
Internet-based
Waiting listDepressive symptoms: PHQ-9There were no statistically significant interactions for group-by-time on depressive symptoms.
Wilson et al., 2018

RCT

USA
N = 60
44.3 (12.0) yrs
44%F/56%M

Unspecific chronic pain
Online self-management program
Internet-based
Waiting listDepressive symptoms: PHQ-8Intervention group had higher depressive symptoms score at the end of the intervention (p = 0.001).
Abbreviatures: %F: Proportion of women; %M: Proportion of men; ACT: Acceptance and Commitment therapy; BDI: Beck Depression Inventory; BDI-II: Beck Depression Inventory-II, CBT: Cognitive-behavioral therapy; CES-D: Center for Epidemiological Studies Depression Scale; CES-D 10: Center for Epidemiologic Studies Short Depression Scale; DASS: Depression Anxiety Stress Scale; DASS-21: 21-Item Depression Anxiety Stress Scales; GAD-7: 7-Item Generalized Anxiety Disorder; HADS: Hospital Anxiety and Depression Scale; LBP: Low back pain; HamADS: Hamilton Anxiety and Depression Scale; HamD: Hamilton Depression Rating Scale; IRGL: Impact of Rheumatic Diseases on General Health and Lifestyle; N/R: Not reported; PASS-20: 20-item Pain Anxiety Symptoms Scale-Short Form; PHQ-8: 8-Item Personal Health Questionnaire Depression Scale; PHQ-9: 9-Item Personal Health Questionnaire Depression Scale; QIDS: Quick Inventory of Depressive Symptomatology; RCT: Randomized controlled trial; SD: Standard deviation; SCI-93: Stress and Crisis Inventory; STPI: State-Trait Personality Inventory; QIDS-SR16: Quick Inventory of Depressive Symptomatology Self-Report.

Appendix A.4. Details of the Interventions

Table A2. Details of the Interventions.
Table A2. Details of the Interventions.
Authors, YearInterventionComparator
Format
Equipment and Contact Form
Modality and ContentDuration and Frequency,
Follow-Up
Format
Equipment
Modality and ContentDuration and Frequency, Follow-Up
Amorim et al., 2019Mobile application

Written, pedometer
Telephone call, message
Physical exercise, activity tracker, lessons
-
Goal setting (behavior)
-
Problem solving
-
Action planning
-
Social support (emotional)
-
Instruction on how to perform the behavior
-
Feedback on outcomes of behavior
-
Graded tasks
6 months
1 face-to-face interview and
2 calls/month

Follow-up: N/A
Recommendations

Written, brief advice
-
Autonomous increase in physical activity
-
Benefits of physical activity
6 months
N/A

Follow-up: N/A
Ang et al., 2010Telephone call + usual care

Written
Telephone call
CBT. Lessons, relaxation
-
Action planning
-
Reduce negative emotions
-
Framing/reframing
6 weeks
1 session/week

Follow-up: 12 weeks
Usual care
-
Usual treatment by the physician
6 weeks
N/A

Follow-up: 12 weeks
Berman et al., 2009Internet-based

Images, audio
Email
Self-care. Mind–body exercises and lessons
-
Problem solving
-
Action planning
-
Monitoring of behavior by others without feedback
-
Instruction on how to perform the behavior
6 weeks
≥1 session/week

Follow-up: N/A
No intervention

N/A
N/AN/A
N/A

Follow-up: N/A
Boselie et al., 2018Internet-based

Online platform
Telephone call, email
Positive psychology exercises
-
Problem solving
-
Social support (unspecified)
-
Instruction on how to perform the behavior
8 weeks
Call: weeks 1, 3, 5,7
Email: weeks 2, 4, 6, 8

Follow-up: N/A
Waiting list

N/A
N/AN/A
N/A

Follow-up: N/A
Bossen et al., 2013Internet-based

Written, video
Email
Behavior-graded activity and exercises
-
Goal setting (behavior)
-
Instruction on how to perform the behavior
-
Graded tasks
9 weeks
≥1 session/week

Follow-up: 12 weeks
Waiting list

N/A
N/AN/A
N/A

Follow-up: 12 weeks
Brattberg, 2007Internet-based

Written, video
Internet guided chat
Self-help about pain.
-
Problem solving
-
Monitoring of emotional consequences
-
Anticipated regret
-
Reduce negative emotions
20 weeks
1 video/week


Follow-up: 12 months
Waiting listMaintain pharmacotherapy20 weeks
N/A


Follow-up: 12 months
Brattberg, 2008Internet-based

Written
Telephone call, email
Self-management. Emotional Freedom TechniquesSelf-monitoring of outcome of behavior8 weeks
1 time/day

Follow-up: N/A
Waiting listN/AN/A
N/A

Follow-up: N/A
Bromberg et al., 2012Internet-based +usual care

Written
Email
Behavior change, physical activity, lessons
-
Goal setting (outcome)
-
Monitoring of behavior by others without feedback
-
Self-monitoring of behavior
-
Graded tasks
6 months
≥2 sessions/week (first 4 weeks)
≥1 sessions/month (final 5 month)

Follow-up: N/A
Usual care

N/A
Maintain the routine care and self-management effortN/A
N/A

Follow-up: N/A
Buhrman et al., 2004Internet-based

Slideshow, audio
Telephone call
CBT. Physical and psychological exercises, relaxation
-
Goal setting (behavior)
-
Problem solving
-
Instruction on how to perform the behavior
-
Self-monitoring of behavior
-
Graded tasks
6 weeks
1 call/week

Follow-up: 3 months
Waiting list

N/A
N/AN/A
N/A

Follow-up: 3 months
Buhrman et al., 2011Internet-based

Written
Email
CBT. Physical exercise, relaxation, cognitive skills
-
Self-monitoring of behavior
8 weeks
N/R

Follow-up: 12 weeks
Waiting list

N/A
N/AN/A
N/A

Follow-up: 12 weeks
Dear et al., 2013Internet-based

Written
Telephone call
CBT. Lessons, homework
-
Goal setting (behavior)
-
Graded tasks
8 weeks
1 lesson/7–10 days
1 call/week

Follow-up: 3 months
Waiting list

N/A
N/AN/A
N/A

Follow-up: 3 months
Dear et al., 2015Internet-based
-
G1: CBT + Regular online contact
-
G2: CBT + optimal online contact
-
G3: CBT


Slideshow
Telephone call, email
CBT.
Lessons, homework
-
Problem solving
-
Instruction on how to perform the behavior
-
Behavioral practice
-
Graded tasks
8 weeks
1 lesson/7–10 days
G1: 1 call/week
G2: as-needed calls
G3: no contact

Follow-up: 3 months
Waiting list

N/A
N/AN/A
N/A

Follow-up: 3 months
Devineni and Blanchard, 2005Internet-based

Written, audio, web pages
Email
Lessons, exercises, relaxation,
Behavioral headache-related intervention
Autogenic training
-
Self-monitoring of outcome
-
Reduce negative emotions
4 weeks
N/R

Follow-up: 2 months
Waiting listN/AN/A
N/A

Follow-up: 2 months
Ferwerda et al., 2017Internet-based

Written
Email
CBT. Lessons, homework
-
Goal setting (behavior)
-
Problem solving
-
Action planning
-
Instruction on how to perform the behavior
-
Reduce negative emotions
-
Distraction
-
Framing/reframing
17 to 32 weeks
1 email/1–2 weeks

Follow-up: 12 months
Usual care

N/R
Rheumatological careN/R
N/R

Follow-up: 12 months
Friesen et al., 2017Internet-based

Slideshow
Telephone call, email
CBT. Lessons, homework
-
Problem solving
-
Feedback on perform the behavior
-
Instruction on how to perform the behavior
8 weeks
1 email and call/week

Follow-up: N/A
Waiting list

N/A
N/AN/A
N/A

Follow up: N/A
Heapy et al., 2017Interactive voice response

Written, images, audio, pedometer
Telephone call
CTB. Lessons, relaxation
-
Goal setting (outcome)
-
Feedback on behavior
-
Graded tasks
-
Reduce negative emotions
10 weeks
1 call/day

Follow-up: 9 months
Face-to-face

Written, images, audio, pedometer
CBT. Lessons, relaxation
-
Goal setting (outcome)
-
Feedback on behavior
-
Graded tasks
-
Reduce negative emotions
10 weeks
1 session/week

Follow-up: 9 months
Hedman-Lagerlöf et al., 2018Internet-based

Written
Telephone call, message
Lessons, homework, mindfulness
-
Goal setting (behavior)
-
Problem solving
-
Monitoring of behavior by others without feedback
-
Exposure
-
Graded tasks
10 weeks
1–3 contact/week

Follow-up: 12 months
Waiting list

N/A
N/AN/A
N/A

Follow-up: 12 months
Herbert et al., 2017Videoconferencing

Written
N/R
ACT. Mindfulness, lessons
-
Goal setting
-
Information about emotional consequences
8 weeks
1 session/week

Follow-up: 6 months
Face-to-face

Written
ACT. Mindfulness, lessons
-
Goal setting
-
Information about emotional consequences
8 weeks
1 session/week

Follow-up: 6 months
Hernando-Garijo et al., 2021Videoconferencing + usual care

Video
Video call
Aerobic exercise
-
Low-impact exercise
15 weeks
2 session/week

Follow-up: N/A
Usual care

N/A
-
Maintain pharmacotherapy
15 weeks
N/A

Follow-up: NA
Juhlin et al., 2021Internet-based

Digital platform
Message
Person-centered intervention. Physical and psychological exercises
-
Goal setting (behavior)
-
Problem solving
-
Action planning
6 months
1 contact/week

Follow-up: N/A
Face-to-face
(1 session)

N/A
-
Person-centered intervention. Physical and psychological exercises
6 months
N/A

Follow-up: N/A
Lin et al., 2017Internet-based

Written, audio, video
Email, message
ACT. Lessons, mindfulness
-
Goal setting (behavior)
-
Reduce negative emotions
9 weeks
1 session/week

Follow-up: 6 months
Waiting list

N/A
-
N/A
N/A
N/A

Follow-up: 6 months
Moessner et al., 2012Internet-based

N/R
Internet guided chat
Self-monitoring. Lessons
-
Self-monitoring of behavior
-
Behavioral practice/rehearsal
12–15 weeks
1 session/week

Follow-up: 6 months
Usual care

N/A
N/R12–15 weeks
1 session/week

Follow-up: 6 months
Peters et al., 2017Internet-based

Written
Telephone call, email
G1: Positive psychology. Psychological exercises
-
Goal setting (behavior)
-
Graded tasks
-
Reduce negative emotions
G2: CBT. Lessons, homework, relaxation
-
Problem solving
-
Action planning
-
Social support (unspecified)
-
Framing/reframing
8 weeks
1 lesson/week
Call: weeks 1, 3, 5, 7
Email: weeks: 2, 4, 6, 8

Follow-up: 6 months
Waiting list

N/A
N/AN/A
N/A

Follow-up: 6 months
Petrozzi et al., 2019Internet-based + usual care

Written
Telephone call
CBT. Lessons, homework
-
Problem solving
-
Self-monitoring behavior
-
Instruction on how to perform the behavior
-
Distraction
8 weeks
1 lesson/week
1 call/week

Follow-up: 12 months
Usual care

N/A
-
Physical treatment (manual therapy, exercise and/or education)
-
Recommendation for physical activity
8 weeks
12 sessions (variable frequency)

Follow-up: 12 months
Rickardsson et al., 2021Internet-based

Written, image, audio
Telephone call, message
ACT. Lessons
-
Instruction on how to perform the behavior
-
Feedback on behavior
-
Graded tasks
-
Non-specific reward
-
Distraction
8 weeks
7 sessions/week
≥2 messages/week

Follow-up: 12 months
Waiting list

N/A
-
Maintain usual treatment
N/A
N/A

Follow-up: 12 months
Ruehlman et al., 2012Internet-based

Written, image
Email, message
Self-management + e-community. Physical exercise, lessons, homework, relaxation
-
Goal setting (outcome)
-
Action planning
-
Self-monitoring of outcome of behavior
-
Instruction on how to perform the behavior
-
Reduce negative emotions
6 weeks
N/R

Follow-up: 14 weeks
Usual care

N/A
N/R6 weeks
N/A

Follow-up: 14 weeks
Sander et al., 2020Internet-based + usual care

Written, audio, video
Telephone call, email, message
CBT. Lessons, homework, relaxation
-
Problem solving
-
Action planning
-
Feedback on behavior
-
Reduce negative emotions
9 weeks
7 sessions/week

Follow-up:
12 months
Usual care

N/A
Medical or psychological treatment9 weeks
N/R

Follow-up:
12 months
Schlickler et al., 2020Internet-based + mobile-based

N/R
Email, message
CBT. Lessons, mindfulness, relaxation
-
Problem solving
-
Feedback on behavior
-
Social support
-
Non-specific reward
-
Reduce negative emotions
-
Framing/reframing
9 weeks
7 lessons/week

Follow-up: 6 months
Waiting list

N/A
N/AN/A
N/A

Follow-up: 6 months
Scott et al., 2018Internet-based + usual care

Video
Telephone call, email
ACT. Lessons
-
Goal setting (behavior)
-
Feedback on behavior
-
Instruction on how to perform the behavior
-
Monitoring of emotional consequences
5 weeks
2 lesson/week (first 3 weeks), 1 lesson/week (final 2 weeks)

Follow-up: 9 months
Usual care

N/A
-
Medical treatment
-
Instruction on how to perform the behavior
5 weeks
N/A

Follow-up: 9 months
Shigaki et al., 2013Internet-based

Slideshow
Telephone call, message, online chat
Lessons, homework
-
Problem solving
-
Self-monitoring behavior
10 weeks
1 lesson/week
1 call/week

Follow-up: N/A
Waiting list
-
N/A
N/A
N/A

Follow-up: N/A
Simister al., 2018Internet-based + usual care

Written, audio, video
Email
ACT. Lessons, homeworkFeedback on behaviorNon-specific reward8 weeks
N/R

Follow-up: 3 months
Usual care

N/A
-
Maintain usual treatment
8 weeks
N/A

Follow-up: 3 months
Smith et al., 2019Internet-based

Written, image, audio, video
Telephone call, email
CBT and self-management. Multidisciplinary program with physical exercise, lessons, homework, relaxation
-
Goal setting (behavior and outcome)
-
Problem solving
-
Instruction on how to perform the behavior
-
Graded tasks
-
Multidisciplinary program
-
Physical therapy, psychologist
4 months
2 lessons/month

Follow-up: 7 months
Usual care

N/A
-
Maintain usual treatment
4 months
N/A

Follow-up: 7 months
Ström et al., 2000Internet-based

Written
Email
Lessons, relaxation
-
Problem solving
-
Instruction on how to perform the behavior
-
Feedback on outcome of behavior
6 weeks
1 lesson/week

Follow-up: N/A
Waiting list

N/A
N/AN/A
N/A

Follow-up: N/A
Tavallaei et al., 2018Internet-based

Written
N/R
Mindfulness-based stress reduction bibliotherapy
-
Problem solving
-
Action planning
-
Distraction
8 weeks
1 lesson/week

Follow-up: N/A
Usual care

N/A
-
Pharmacotherapy
8 weeks
N/A

Follow-up: N/A
Trompetter et al., 2015Internet-based

Written

Email
ACT. Lessons, mindfulness
-
Self-monitoring of behavior
-
Non-specific reward
-
Distraction
3 months
≥3 h/week

Follow-up: 6 months
Waiting list

N/A
N/AN/A
N/A

Follow-up: 6 months
Trudeau et al., 2015Internet-based

Multimedia materials
Telephone call, email
Self-management. Lessons
-
Problem solving
-
Instruction on how to perform the behavior
-
Reduce negative emotions
6 months
≥2 sessions/week (1 month)
1 session/month (5 months)

Follow-up: N/A
Waiting list

N/A
N/AN/A
N/A

Follow-up: N/A
Vallejo et al., 2015Internet-based + usual care

Written, images, audio
Message
CBT. Lessons, homework, relaxation
-
Problem solving
-
Feedback on behavior
-
Reduce negative emotions
-
Framing/reframing
10 weeks
1 session/week

Follow-up: 12 months
G1: Face-to-face + usual care

Written, images, audio

G2: Usual care

N/A
G1: CBT. Lessons, homework, relaxation
-
Problem solving
-
Reduce negative emotions
-
Framing/reframing
G2: Pharmacotherapy
10 weeks
G1: 1 session/week
G2: N/A

Follow-up (only G1): 12 months
Westenberg et al., 2018Internet-based

Written, video
N/R
Mindfulness
-
Reduce negative emotions
60-s video
N/R

Follow-up: N/A
Attention control

Written
-
Health information
60-s read
N/R

Follow-up: N/A
Williams et al., 2010Internet-based + usual care

Written, audio, video
No contact
Self-management. Lessons, homework, relaxation
-
Goal setting (behavior)
-
Problem solving
-
Self-monitoring of behavior
-
Social support (unspecified)
-
Instruction on how to perform the behavior
-
Graded tasks
-
Framing/reframing
6 months
N/R

Follow-up: N/A
Usual care
-
Maintain usual treatment from care physician
6 months
N/A

Follow-up: N/A
Wilson et al., 2015Internet-based

N/R
N/R
Self-management. Lessons, exercises, relaxation
-
Goal setting (outcome)
-
Self-monitoring or outcome of behavior
8 weeks
N/R

Follow-up: N/A
Usual care

N/A
N/A8 weeks
N/R

Follow-up: N/A
Wilson et al., 2018Internet-based

Written
Interactive activity
Self-management. Lessons, homework
-
Self-monitoring of behavior
-
Behavioral practice/rehearsal
8 weeks
N/R

Follow-up: N/A
Waiting list

Written
-
Educational tips
8 weeks
1 email/week

Follow-up: N/A
ACT: Acceptance and Commitment therapy; CBT: Cognitive-behavioral therapy; N/A: Not applicable; N/R: Not reported; NSAIDs: Nonsteroidal anti-inflammatory drugs.

Appendix A.5. Assessment of the Quality of the Studies Based on the PEDro Scale

Table A3. PEDro scale.
Table A3. PEDro scale.
Items
Articles1234567891011Total
Amorim et al., 2019111100101117
Ang et al., 2010110100110116
Berman et al., 2009110100010115
Boselie et al., 2018010100000114
Bossen et al., 2013111100001116
Brattberg, 2007111100011117
Brattberg, 2008111100011117
Bromberg et al., 2012110100011116
Buhrman et al., 2004110100010115
Buhrman et al., 2011111100011117
Dear et al., 2013110100010115
Dear et al., 2015111100010116
Devineni and Blanchard, 2005111100010116
Ferwerda et al., 2017111100011117
Friesen et al., 2017111100010116
Heapy et al., 2017111100001116
Hedman-Lagerlöf et al., 2018111100010116
Herbert et al., 2017110100111117
Hernando-Garijo et al., 2021110100111117
Juhlin et al., 2021111100001116
Lin et al., 2017111100001116
Moessner et al., 2012110100001115
Peters et al., 2017110100001115
Petrozzi et al., 2019111100011117
Rickardsson et al., 2020111100011117
Ruehlman et al., 2012110100001115
Sander et al., 2020111100101117
Schlicker et al., 2021110100011116
Scott et al., 2018111100011117
Shigaki et al., 2013110000010114
Simister et al., 2018111100011117
Smith et al., 2019110100101116
Ström et al., 2000110100001115
Tavallaei et al., 2018110000010114
Trompetter et al., 2014110100011116
Trudeau et al., 2015111100011117
Vallejo et al., 2015110100011116
Westenberg et al., 2018110110011117
Williams et al., 2010111100011117
Wilson et al., 2015110100001115
Wilson et al., 2018110110011117
Notes: 1: subject choice criteria are specified; 2: random assignment of subjects to groups; 3: hidden assignment; 4: groups were similar at baseline; 5: all subjects were blinded; 6: all therapists were blinded; 7: all evaluators were blinded; 8: measures of at least one of the key outcomes were obtained from more than 85% of baseline subjects; 9: intention-to-treat analysis was performed; 10: results from statistical comparisons between groups were reported for at least one key outcome; 11: the study provides point and variability measures for at least one key outcome.

Appendix A.6. Risk of Bias 2

Figure A2. Risk of Bias 2.
Figure A2. Risk of Bias 2.
Ijerph 19 03231 g0a2

Appendix A.7. Statistical Exploration of Heterogeneity, Outliers, Robustness and Publication Bias for the Depressive Symptoms Variable

Figure A3. Forest plot of all the studies.
Figure A3. Forest plot of all the studies.
Ijerph 19 03231 g0a3
Figure A4. Influence analyses of all the studies.
Figure A4. Influence analyses of all the studies.
Ijerph 19 03231 g0a4
Figure A5. Leave-one-out figure of all the studies.
Figure A5. Leave-one-out figure of all the studies.
Ijerph 19 03231 g0a5
Figure A6. Contour-enhanced funnel plot of the studies included in the sensitivity analysis.
Figure A6. Contour-enhanced funnel plot of the studies included in the sensitivity analysis.
Ijerph 19 03231 g0a6
Figure A7. Doi plot and LFK index of the studies included in the sensitivity analysis.
Figure A7. Doi plot and LFK index of the studies included in the sensitivity analysis.
Ijerph 19 03231 g0a7
Figure A8. Drapery plot of the studies included in the sensitivity analysis.
Figure A8. Drapery plot of the studies included in the sensitivity analysis.
Ijerph 19 03231 g0a8
Figure A9. Contour-enhanced funnel plot of the studies included in the sensitivity analysis and the studies filled to adjust for publication bias.
Figure A9. Contour-enhanced funnel plot of the studies included in the sensitivity analysis and the studies filled to adjust for publication bias.
Ijerph 19 03231 g0a9
Figure A10. Forest plot of the studies included in the sensitivity analysis and the studies filled to adjust for publication bias.
Figure A10. Forest plot of the studies included in the sensitivity analysis and the studies filled to adjust for publication bias.
Ijerph 19 03231 g0a10

Appendix A.8. Statistical Exploration of Heterogeneity, Outliers, Robustness and Publication Bias for the Anxiety Variable

Figure A11. Forest plot with all the studies.
Figure A11. Forest plot with all the studies.
Ijerph 19 03231 g0a11
Figure A12. Influence analyses of all the studies.
Figure A12. Influence analyses of all the studies.
Ijerph 19 03231 g0a12
Figure A13. Leave-one-out figure of all the studies.
Figure A13. Leave-one-out figure of all the studies.
Ijerph 19 03231 g0a13
Figure A14. Contour-enhanced funnel plot of the studies included in the sensitivity analysis.
Figure A14. Contour-enhanced funnel plot of the studies included in the sensitivity analysis.
Ijerph 19 03231 g0a14
Figure A15. Doi plot and LFK index of the studies included in the sensitivity analysis.
Figure A15. Doi plot and LFK index of the studies included in the sensitivity analysis.
Ijerph 19 03231 g0a15
Figure A16. Drapery plot of the studies included in the sensitivity analysis.
Figure A16. Drapery plot of the studies included in the sensitivity analysis.
Ijerph 19 03231 g0a16

Appendix A.9. Statistical Exploration of Heterogeneity, Outliers, Robustness and Publication Bias for the Stress Variable

Figure A17. Influence analyses of all the studies.
Figure A17. Influence analyses of all the studies.
Ijerph 19 03231 g0a17
Figure A18. Leave-one-out figure of all the studies.
Figure A18. Leave-one-out figure of all the studies.
Ijerph 19 03231 g0a18
Figure A19. Contour-enhanced funnel plot of all the studies.
Figure A19. Contour-enhanced funnel plot of all the studies.
Ijerph 19 03231 g0a19
Figure A20. Doi plot and LFK index of all the studies.
Figure A20. Doi plot and LFK index of all the studies.
Ijerph 19 03231 g0a20
Figure A21. Drapery plot of all the studies.
Figure A21. Drapery plot of all the studies.
Ijerph 19 03231 g0a21
Figure A22. Contour-enhanced funnel plot of the studies included in the sensitivity analysis and the studies filled to adjust for publication bias. The trim and fill method did not add any study.
Figure A22. Contour-enhanced funnel plot of the studies included in the sensitivity analysis and the studies filled to adjust for publication bias. The trim and fill method did not add any study.
Ijerph 19 03231 g0a22
Figure A23. Forest plot of the studies included in the sensitivity analysis and the studies filled to adjust for publication bias The trim and fill method did not add any study.
Figure A23. Forest plot of the studies included in the sensitivity analysis and the studies filled to adjust for publication bias The trim and fill method did not add any study.
Ijerph 19 03231 g0a23

References

  1. Clauw, D.J.; Häuser, W.; Cohen, S.P.; Fitzcharles, M.A. Considering the potential for an increase in chronic pain after the COVID-19 pandemic. Pain 2020, 161, 1694–1697. [Google Scholar] [CrossRef] [PubMed]
  2. Eccleston, C.; Blyth, F.M.; Dear, B.F.; Fisher, E.A.; Keefe, F.J.; Lynch, M.E.; Palermo, T.M.; Reid, M.C.; Williams, A.C.d.C. Managing patients with chronic pain during the COVID-19 outbreak: Considerations for the rapid introduction of remotely supported (eHealth) pain management services. Pain 2020, 161, 889–893. [Google Scholar] [CrossRef] [PubMed]
  3. Fallon, N.; Brown, C.; Twiddy, H.; Brian, E.; Frank, B.; Nurmikko, T.; Stancak, A. Adverse effects of COVID-19-related lockdown on pain, physical activity and psychological well-being in people with chronic pain. Br. J. Pain 2021, 15, 357–368. [Google Scholar] [CrossRef] [PubMed]
  4. Pagé, M.G.; Lacasse, A.; Dassieu, L.; Hudspith, M.; Moor, G.; Sutton, K.; Thompson, J.M.; Dorais, M.; Montcalm, A.J.; Sourial, N.; et al. A cross-sectional study of pain status and psychological distress among individuals living with chronic pain: The chronic pain & COVID-19 pan-canadian study. Health Promot. Chronic Dis. Prev. Can. 2021, 41, 141–152. [Google Scholar]
  5. Arteta, J.; Cobos, B.; Hu, Y.; Jordan, K.; Howard, K. Evaluation of how depression and anxiety mediate the relationship between pain catastrophizing and prescription opioid misuse in a chronic pain population. Pain Med. 2016, 17, 295–303. [Google Scholar] [CrossRef] [Green Version]
  6. Curtin, K.B.; Norris, D. The relationship between chronic musculoskeletal pain, anxiety and mindfulness: Adjustments to the Fear-Avoidance Model of Chronic Pain. Scand. J. Pain 2017, 17, 156–166. [Google Scholar] [CrossRef]
  7. Veehof, M.M.; Oskam, M.J.; Schreurs, K.M.G.; Bohlmeijer, E.T. Acceptance-based interventions for the treatment of chronic pain: A systematic review and meta-analysis. Pain 2011, 152, 533–542. [Google Scholar] [CrossRef] [Green Version]
  8. Williams, A.C.d.C.; Fisher, E.; Hearn, L.; Eccleston, C. Psychological therapies for the management of chronic pain (excluding headache) in adults. Cochrane Database Syst. Rev. 2020, 12, CD007407. [Google Scholar] [CrossRef]
  9. Du, S.; Hu, L.; Dong, J.; Xu, G.; Chen, X.; Jin, S.; Zhang, H.; Yin, H. Self-management program for chronic low back pain: A systematic review and meta-analysis. Patient Educ. Couns. 2017, 100, 37–49. [Google Scholar] [CrossRef]
  10. Ariza-Mateos, M.J.; Cabrera-Martos, I.; Prados-Román, E.; Granados-Santiago, M.; Rodríguez-Torres, J.; Carmen Valenza, M. A systematic review of internet-based interventions for women with chronic pain. Br. J. Occup. Ther. 2020, 84, 6–14. [Google Scholar] [CrossRef]
  11. White, V.; Linardon, J.; Stone, J.E.; Holmes-Truscott, E.; Olive, L.; Mikocka-Walus, A.; Hendrieckx, C.; Evans, S.; Speight, J. Online psychological interventions to reduce symptoms of depression, anxiety, and general distress in those with chronic health conditions: A systematic review and meta-analysis of randomized controlled trials. Psychol. Med. 2020, 52, 1–26. [Google Scholar] [CrossRef]
  12. Dario, A.B.; Moreti Cabral, A.; Almeida, L.; Ferreira, M.L.; Refshauge, K.; Simic, M.; Pappas, E.; Ferreira, P.H. Effectiveness of telehealth-based interventions in the management of non-specific low back pain: A systematic review with meta-analysis. Spine J. 2017, 17, 1342–1351. [Google Scholar] [CrossRef] [PubMed]
  13. Page, M.J.; McKenzie, J.E.; Bossuyt, P.M.; Boutron, I.; Hoffmann, T.C.; Mulrow, C.D.; Shamseer, L.; Tetzlaff, J.M.; Akl, E.A.; Brennan, S.E.; et al. The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ 2021, 372, n71. [Google Scholar] [CrossRef] [PubMed]
  14. Haddaway, N.R.; Collins, A.M.; Coughlin, D.; Kirk, S. The Role of Google Scholar in Evidence Reviews and Its Applicability to Grey Literature Searching. PLoS ONE 2015, 10, e0138237. [Google Scholar]
  15. Ouzzani, M.; Hammady, H.; Fedorowicz, Z.; Elmagarmid, A. Rayyan—A web and mobile app for systematic reviews. Syst. Rev. 2016, 5, 210. [Google Scholar] [CrossRef] [Green Version]
  16. Higgins, J.; Green, S. Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0[M]; Wiley-Blackwell: Hoboken, NJ, USA, 2008. [Google Scholar]
  17. Sterne, J.A.C.; Savović, J.; Page, M.J.; Elbers, R.G.; Blencowe, N.S.; Boutron, I.; Cates, C.J.; Cheng, H.-Y.; Corbett, M.S.; Eldridge, S.M.; et al. RoB 2: A revised tool for assessing risk of bias in randomised trials. BMJ 2019, 366, l4898. [Google Scholar] [CrossRef] [Green Version]
  18. De Morton, N.A. The PEDro scale is a valid measure of the methodological quality of clinical trials: A demographic study. Aust. J. Physiother. 2009, 55, 129–133. [Google Scholar] [CrossRef] [Green Version]
  19. Hariohm, K.; Prakash, V.; Saravankumar, J. Quantity and quality of randomized controlled trials published by Indian physiotherapists. Perspect. Clin. Res. 2015, 6, 91. [Google Scholar] [CrossRef]
  20. Landis, J.R.; Koch, G.G. An Application of Hierarchical Kappa-type Statistics in the Assessment of Majority Agreement among Multiple Observers. Biometrics 1977, 33, 363. [Google Scholar] [CrossRef]
  21. Guyatt, G.H.; Oxman, A.D.; Vist, G.E.; Kunz, R.; Falck-Ytter, Y.; Alonso-Coello, P.; Schünemann, H.J. GRADE Working Group GRADE: An emerging consensus on rating quality of evidence and strength of recommendations. BMJ 2008, 336, 924–926. [Google Scholar] [CrossRef] [Green Version]
  22. Andrews, J.; Guyatt, G.; Oxman, A.D.; Alderson, P.; Dahm, P.; Falck-Ytter, Y.; Nasser, M.; Meerpohl, J.; Post, P.N.; Kunz, R.; et al. GRADE guidelines: 14. Going from evidence to recommendations: The significance and presentation of recommendations. J. Clin. Epidemiol. 2013, 66, 719–725. [Google Scholar] [CrossRef] [PubMed]
  23. Balshem, H.; Helfand, M.; Schünemann, H.J.; Oxman, A.D.; Kunz, R.; Brozek, J.; Vist, G.E.; Falck-Ytter, Y.; Meerpohl, J.; Norris, S.; et al. GRADE guidelines: 3. Rating the quality of evidence. J. Clin. Epidemiol. 2011, 64, 401–406. [Google Scholar] [CrossRef]
  24. RStudio Team RStudio: Integrated Development Environment for R. 2021. Available online: https://support.rstudio.com/hc/en-us/articles/206212048-Citing-RStudio (accessed on 10 February 2022).
  25. R Core Team R: A Language and Environment for Statistical Computing. 2021. Available online: https://www.eea.europa.eu/data-and-maps/indicators/oxygen-consuming-substances-in-rivers/r-development-core-team-2006 (accessed on 10 February 2022).
  26. Hopkins, W.G.; Marshall, S.W.; Batterham, A.M.; Hanin, J. Progressive statistics for studies in sports medicine and exercise science. Med. Sci. Sports Exerc. 2009, 41, 3–13. [Google Scholar] [CrossRef] [Green Version]
  27. Higgins, J.P.; Li, T.; Deeks, J.J. 6.5.2.3 Obtaining Standard Deviations from Standard Errors, Confidence Intervals, T Statistics and p Values for Differences in Means. Available online: https://training.cochrane.org/handbook/current/chapter-06 (accessed on 10 February 2022).
  28. Viechtbauer, W. Bias and Efficiency of Meta-Analytic Variance Estimators in the Random-Effects Model. J. Educ. Behav. Stat. 2005, 30, 261–293. [Google Scholar] [CrossRef]
  29. Veroniki, A.A.; Jackson, D.; Viechtbauer, W.; Bender, R.; Bowden, J.; Knapp, G.; Kuss, O.; Higgins, J.P.T.; Langan, D.; Salanti, G. Methods to estimate the between-study variance and its uncertainty in meta-analysis. Res. Synth. Methods 2016, 7, 55–79. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  30. Knapp, G.; Hartung, J. Improved tests for a random effects meta-regression with a single covariate. Stat. Med. 2003, 22, 2693–2710. [Google Scholar] [CrossRef]
  31. Sidik, K.; Jonkman, J.N. A simple confidence interval for meta-analysis. Stat. Med. 2002, 21, 3153–3159. [Google Scholar] [CrossRef]
  32. Hoaglin, D. Misunderstandings about Q and “Cochran’s Q test” in meta-analysis. Stat. Med. 2016, 35, 485–495. [Google Scholar] [CrossRef]
  33. Borenstein, M.; Higgins, J.P.T.; Hedges, L.V.; Rothstein, H.R. Basics of meta-analysis: I(2) is not an absolute measure of heterogeneity. Res. Synth. Methods 2017, 8, 5–18. [Google Scholar] [CrossRef] [Green Version]
  34. IntHout, J.; Ioannidis, J.P.A.; Rovers, M.M.; Goeman, J.J. Plea for routinely presenting prediction intervals in meta-analysis. BMJ Open 2016, 6, e010247. [Google Scholar] [CrossRef] [Green Version]
  35. Viechtbauer, W.; Cheung, M.W.-L. Outlier and influence diagnostics for meta-analysis. Res. Synth. Methods 2010, 1, 112–125. [Google Scholar] [CrossRef] [PubMed]
  36. Rücker, G.; Schwarzer, G. Beyond the forest plot: The drapery plot. Res. Synth. Methods 2021, 12, 13–19. [Google Scholar] [CrossRef] [PubMed]
  37. Doi, S.A. Rendering the Doi plot properly in meta-analysis. Int. J. Evid. Based. Healthc. 2018, 16, 242–243. [Google Scholar] [CrossRef] [PubMed]
  38. Furuya-Kanamori, L.; Barendregt, J.J.; Doi, S.A.R. A new improved graphical and quantitative method for detecting bias in meta-analysis. Int. J. Evid. Based. Healthc. 2018, 16, 195–203. [Google Scholar] [CrossRef]
  39. Duval, S.; Tweedie, R. Trim and fill: A simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics 2000, 56, 455–463. [Google Scholar] [CrossRef]
  40. Harrer, M.; Cuijpers, P.; Furukawa, T.A.; Ebert, D.D. Doing Meta-Analysis With R: A Hands-On Guide, 1st ed.; Chapman & Hall: Boca Raton, FL, USA; CRC Press: London, UK, 2021; ISBN 978-0-367-61007-4. [Google Scholar]
  41. Amorim, A.B.; Pappas, E.; Simic, M.; Ferreira, M.L.; Jennings, M.; Tiedemann, A.; Carvalho-E-Silva, A.P.; Caputo, E.; Kongsted, A.; Ferreira, P.H. Integrating Mobile-health, health coaching, and physical activity to reduce the burden of chronic low back pain trial (IMPACT): A pilot randomised controlled trial. BMC Musculoskelet. Disord. 2019, 20, 1–14. [Google Scholar] [CrossRef] [Green Version]
  42. Ang, D.C.; Chakr, R.; Mazzuca, S.; France, C.R.; Steiner, J.; Stump, T. Cognitive-behavioral therapy attenuates nociceptive responding in patients with fibromyalgia: A pilot study. Arthritis Care Res. 2010, 62, 618–623. [Google Scholar] [CrossRef]
  43. Dear, B.F.; Gandy, M.; Karin, E.; Staples, L.G.; Johnston, L.; Fogliati, V.J.; Wootton, B.M.; Terides, M.D.; Kayrouz, R.; Perry, K.N.; et al. The Pain Course: A randomised controlled trial examining an internet-delivered pain management program when provided with different levels of clinician support. Pain 2015, 156, 1920–1935. [Google Scholar] [CrossRef]
  44. Devineni, T.; Blanchard, E.B. A randomized controlled trial of an internet-based treatment for chronic headache. Behav. Res. Ther. 2005, 43, 277–292. [Google Scholar] [CrossRef]
  45. Ferwerda, M.; Van Beugen, S.; Van Middendorp, H.; Spillekom-Van Koulil, S.; Donders, A.R.T.; Visser, H.; Taal, E.; Creemers, M.C.W.; Van Riel, P.C.L.M.; Evers, A.W.M. A tailored-guided internet-based cognitive-behavioral intervention for patients with rheumatoid arthritis as an adjunct to standard rheumatological care: Results of a randomized controlled trial. Pain 2017, 158, 868–878. [Google Scholar] [CrossRef]
  46. Friesen, L.N.; Hadjistavropoulos, H.D.; Schneider, L.H.; Alberts, N.M.; Titov, N.; Dear, B.F. Examination of an internet-delivered cognitive behavioural pain management course for adults with fibromyalgia: A randomized controlled trial. Pain 2017, 158, 593–604. [Google Scholar] [CrossRef] [PubMed]
  47. Heapy, A.A.; Higgins, D.M.; Goulet, J.L.; La Chappelle, K.M.; Driscoll, M.A.; Czlapinski, R.A.; Buta, E.; Piette, J.D.; Krein, S.L.; Kerns, R.D. Interactive voice response-based self-management for chronic back Pain: The Copes noninferiority randomized trial. JAMA Intern. Med. 2017, 177, 765–773. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  48. Hedman-Lagerlöf, M.; Hedman-Lagerlöf, E.; Axelsson, E.; Ljotsson, B.; Engelbrektsson, J.; Hultkrantz, S.; Lundbäck, K.; Björkander, D.; Wicksell, R.K.; Flink, I.; et al. Internet-Delivered Exposure Therapy for Fibromyalgia A Randomized Controlled Trial. Clin. J. Pain 2018, 34, 532–542. [Google Scholar] [CrossRef] [PubMed]
  49. Hernando-Garijo, I.; Ceballos-Laita, L.; Mingo-Gómez, M.T.; Medrano-De-la-fuente, R.; Estébanez-De-miguel, E.; Martínez-Pérez, M.N.; Jiménez-Del-barrio, S. Immediate effects of a telerehabilitation program based on aerobic exercise in women with fibromyalgia. Int. J. Environ. Res. Public Health 2021, 18, 2075. [Google Scholar]
  50. Juhlin, S.; Bergenheim, A.; Gjertsson, I.; Larsson, A.; Mannerkorpi, K. Physical activity with person-centred guidance supported by a digital platform for persons with chronic widespread pain: A randomized controlled trial. J. Rehabil. Med. 2021, 53, jrm00175. [Google Scholar] [CrossRef] [PubMed]
  51. Lin, J.; Paganini, S.; Sander, L.; Lüking, M.; Daniel Ebert, D.; Buhrman, M.; Andersson, G.; Baumeister, H. An Internet-based intervention for chronic pain—A three-arm randomized controlled study of the effectiveness of guided and unguided acceptance and commitment therapy. Dtsch. Arztebl. Int. 2017, 114, 681–688. [Google Scholar] [PubMed] [Green Version]
  52. Moessner, M.; Schiltenwolf, M.; Neubauer, E. Internet-based aftercare for patients with back pain-A pilot study. Telemed. e-Health 2012, 18, 413–419. [Google Scholar] [CrossRef]
  53. Berman, R.L.H.; Iris, M.A.; Bode, R.; Drengenberg, C. The Effectiveness of an Online Mind-Body Intervention for Older Adults with Chronic Pain. J. Pain 2009, 10, 68–79. [Google Scholar] [CrossRef]
  54. Peters, M.L.; Smeets, E.; Feijge, M.; Van Breukelen, G.; Andersson, G.; Buhrman, M.; Linton, S.J. Happy Despite Pain: A Randomized Controlled Trial of an 8-Week Internet-delivered Positive Psychology Intervention for Enhancing Well-being in Patients with Chronic Pain. Clin. J. Pain 2017, 33, 962–975. [Google Scholar] [CrossRef] [Green Version]
  55. Petrozzi, M.J.; Leaver, A.; Ferreira, P.H.; Rubinstein, S.M.; Jones, M.K.; Mackey, M.G. Addition of MoodGYM to physical treatments for chronic low back pain: A randomized controlled trial. Chiropr. Man. Ther. 2019, 27, 1–12. [Google Scholar] [CrossRef] [Green Version]
  56. Rickardsson, J.; Gentili, C.; Holmström, L.; Zetterqvist, V.; Andersson, E.; Persson, J.; Lekander, M.; Ljótsson, B.; Wicksell, R.K. Internet-delivered acceptance and commitment therapy as microlearning for chronic pain: A randomized controlled trial with 1-year follow-up. Eur. J. Pain 2021, 25, 1012–1030. [Google Scholar] [CrossRef] [PubMed]
  57. Shigaki, C.L.; Smarr, K.L.; Siva, C.; Ge, B.; Musser, D.; Johnson, R. RAHelp: An online intervention for individuals with rheumatoid arthritis. Arthritis Care Res. 2013, 65, 1573–1581. [Google Scholar] [CrossRef] [PubMed]
  58. Simister, H.D.; Tkachuk, G.A.; Shay, B.L.; Vincent, N.; Pear, J.J.; Skrabek, R.Q. Randomized Controlled Trial of Online Acceptance and Commitment Therapy for Fibromyalgia. J. Pain 2018, 19, 741–753. [Google Scholar] [CrossRef] [PubMed]
  59. Smith, J.; Faux, S.G.; Gardner, T.; Hobbs, M.J.; James, M.A.; Joubert, A.E.; Kladnitski, N.; Newby, J.M.; Schultz, R.; Shiner, C.T.; et al. Reboot Online: A Randomized Controlled Trial Comparing an Online Multidisciplinary Pain Management Program with Usual Care for Chronic Pain. Pain Med. 2019, 20, 2385–2396. [Google Scholar] [CrossRef] [PubMed]
  60. Ström, L.; Pettersson, R.; Andersson, G. A controlled trial of self-help treatment of recurrent headache conducted via the Internet. J. Consult. Clin. Psychol. 2000, 68, 722–727. [Google Scholar] [CrossRef] [PubMed]
  61. Tavallaei, V.; Rezapour-Mirsaleh, Y.; Rezaiemaram, P.; Saadat, S.H. Mindfulness for female outpatients with chronic primary headaches: An internet-based bibliotherapy. Eur. J. Transl. Myol. 2018, 28, 175–184. [Google Scholar] [CrossRef] [PubMed]
  62. Trudeau, K.J.; Pujol, L.A.; DasMahapatra, P.; Wall, R.; Black, R.A.; Zacharoff, K. A randomized controlled trial of an online self-management program for adults with arthritis pain. J. Behav. Med. 2015, 38, 483–496. [Google Scholar] [CrossRef] [Green Version]
  63. Vallejo, M.A.; Ortega, J.; Rivera, J.; Comeche, M.I.; Vallejo-Slocker, L. Internet versus face-to-face group cognitive-behavioral therapy for fibromyalgia: A randomized control trial. J. Psychiatr. Res. 2015, 68, 106–113. [Google Scholar] [CrossRef]
  64. Bossen, D.; Veenhof, C.; van Beek, K.E.; Spreeuwenberg, P.M.; Dekker, J.; de Bakker, D.H. Effectiveness of a web-based physical activity intervention in patients with knee and/or hip osteoarthritis: Randomized controlled trial. J. Med. Internet Res. 2013, 15, e257. [Google Scholar] [CrossRef]
  65. Westenberg, R.F.; Zale, E.L.; Heinhuis, T.J.; Ozkan, S.; Nazzal, A.; Lee, S.G.; Chen, N.C.; Vranceanu, A.M. Does a brief mindfulness exercise improve outcomes in upper extremity patients? A randomized controlled trial. Clin. Orthop. Relat. Res. 2018, 476, 790–798. [Google Scholar] [CrossRef]
  66. Williams, D.A.; Kuper, D.; Segar, M.; Mohan, N.; Sheth, M.; Clauw, D.J. Internet-enhanced management of fibromyalgia: A randomized controlled trial. Pain 2010, 151, 694–702. [Google Scholar] [CrossRef] [PubMed]
  67. Wilson, M.; Roll, J.M.; Corbett, C.; Barbosa-Leiker, C. Empowering Patients with Persistent Pain Using an Internet-based Self-Management Program. Pain Manag. Nurs. 2015, 16, 503–514. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  68. Wilson, M.; Finlay, M.; Orr, M.; Barbosa-Leiker, C.; Sherazi, N.; Roberts, M.L.A.; Layton, M.; Roll, J.M. Engagement in online pain self-management improves pain in adults on medication-assisted behavioral treatment for opioid use disorders. Addict. Behav. 2018, 86, 130–137. [Google Scholar] [CrossRef] [PubMed]
  69. Ruehlman, L.S.; Karoly, P.; Enders, C. A randomized controlled evaluation of an online chronic pain self management program. Pain 2012, 153, 319–330. [Google Scholar] [CrossRef] [Green Version]
  70. Sander, L.B.; Paganini, S.; Terhorst, Y.; Schlicker, S.; Lin, J.; Spanhel, K.; Buntrock, C.; Ebert, D.D.; Baumeister, H. Effectiveness of a Guided Web-Based Self-help Intervention to Prevent Depression in Patients with Persistent Back Pain: The PROD-BP Randomized Clinical Trial. JAMA Psychiatry 2020, 77, 1001–1011. [Google Scholar] [CrossRef]
  71. Trompetter, H.R.; Bohlmeijer, E.T.; Veehof, M.M.; Schreurs, K.M.G. Internet-based guided self-help intervention for chronic pain based on Acceptance and Commitment Therapy: A randomized controlled trial. J. Behav. Med. 2015, 38, 66–80. [Google Scholar] [CrossRef]
  72. Schlicker, S.; Baumeister, H.; Buntrock, C.; Sander, L.; Paganini, S.; Lin, J.; Berking, M.; Lehr, D.; Ebert, D.D. A web- and mobile-based intervention for comorbid, recurrent depression in patients with chronic back pain on sick leave (get.back): Pilot randomized controlled trial on feasibility, user satisfaction, and effectiveness. JMIR Ment. Health 2020, 7, e16398. [Google Scholar] [CrossRef] [Green Version]
  73. Scott, W.; Chilcot, J.; Guildford, B.; Daly-Eichenhardt, A.; McCracken, L.M. Feasibility randomized-controlled trial of online Acceptance and Commitment Therapy for patients with complex chronic pain in the United Kingdom. Eur. J. Pain 2018, 22, 1473–1484. [Google Scholar] [CrossRef]
  74. Boselie, J.J.L.M.; Vancleef, L.M.G.; Peters, M.L. Filling the glass: Effects of a positive psychology intervention on executive task performance in chronic pain patients. Eur. J. Pain 2018, 22, 1268–1280. [Google Scholar] [CrossRef] [Green Version]
  75. Brattberg, G. Internet-based rehabilitation for individuals with chronic pain and burnout II: A long-term follow-up. Int. J. Rehabil. Res. 2007, 30, 231–234. [Google Scholar] [CrossRef]
  76. Herbert, M.S.; Afari, N.; Liu, L.; Heppner, P.; Rutledge, T.; Williams, K.; Eraly, S.; VanBuskirk, K.; Nguyen, C.; Bondi, M.; et al. Telehealth Versus In-Person Acceptance and Commitment Therapy for Chronic Pain: A Randomized Noninferiority Trial. J. Pain 2017, 18, 200–211. [Google Scholar] [CrossRef] [PubMed]
  77. Brattberg, G. Self-administered EFT (Emotional Freedom Techniques) in individuals with fibromyalgia: A randomized trial. Integr. Med. 2008, 7, 30–35. [Google Scholar]
  78. Bromberg, J.; Wood, M.E.; Black, R.A.; Surette, D.A.; Zacharoff, K.L.; Chiauzzi, E.J. A randomized trial of a web-based intervention to improve migraine self-management and coping. Headache 2012, 52, 244–261. [Google Scholar] [CrossRef] [PubMed]
  79. Buhrman, M.; Fältenhag, S.; Ström, L.; Andersson, G. Controlled trial of Internet-based treatment with telephone support for chronic back pain. Pain 2004, 111, 368–377. [Google Scholar] [CrossRef] [PubMed]
  80. Buhrman, M.; Nilsson-Ihrfelt, E.; Jannert, M.; Ström, L.; Andersson, G. Guided internet-based cognitive behavioural treatment for chronic back pain reduces pain catastrophizing: A randomized controlled trial. J. Rehabil. Med. 2011, 43, 500–505. [Google Scholar] [PubMed] [Green Version]
  81. Dear, B.F.; Titov, N.; Perry, K.N.; Johnston, L.; Wootton, B.M.; Terides, M.D.; Rapee, R.M.; Hudson, J.L. The Pain Course: A randomised controlled trial of a clinician-guided Internet-delivered cognitive behaviour therapy program for managing chronic pain and emotional well-being. Pain 2013, 154, 942–950. [Google Scholar] [CrossRef] [PubMed]
  82. Michie, S.; Richardson, M.; Johnston, M.; Abraham, C.; Francis, J.; Hardeman, W.; Eccles, M.P.; Cane, J.; Wood, C.E. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: Building an international consensus for the reporting of behavior change interventions. Ann. Behav. Med. 2013, 46, 81–95. [Google Scholar] [CrossRef]
  83. Varker, T.; Brand, R.; Ward, J.; Terhaag, S.; Phelps, A. Efficacy of synchronous telepsychology interventions for people with anxiety, depression, posttraumatic stress disorder, and adjustment disorder: A rapid evidence assessment. Psychol. Serv. 2019, 16, 621–635. [Google Scholar] [CrossRef]
  84. McCall, T.; Bolton, C.S., III; Carlson, R.; Khairat, S. A systematic review of telehealth interventions for managing anxiety and depression in African American adults. mHealth 2021, 7, 31. [Google Scholar] [CrossRef]
  85. De Boer, M.J.; Versteegen, G.J.; Vermeulen, K.M.; Sanderman, R.; Struys, M.M.R.F. A randomized controlled trial of an Internet-based cognitive-behavioural intervention for non-specific chronic pain: An effectiveness and cost-effectiveness study. Eur. J. Pain 2014, 18, 1440–1451. [Google Scholar] [CrossRef] [Green Version]
  86. Aspvall, K.; Sampaio, F.; Lenhard, F.; Melin, K.; Norlin, L.; Serlachius, E.; Mataix-Cols, D.; Andersson, E. Cost-effectiveness of Internet-Delivered vs In-Person Cognitive Behavioral Therapy for Children and Adolescents with Obsessive-Compulsive Disorder. JAMA Netw. Open 2021, 4, 1–13. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Risk of bias graph according to the Risk of Bias 2 tool.
Figure 1. Risk of bias graph according to the Risk of Bias 2 tool.
Ijerph 19 03231 g001
Figure 2. Sensitivity analysis of the depressive symptoms variable for telematic behavioral modification techniques against usual care or waiting list. Negative results favor the intervention group. The small boxes with the squares represent the point estimate of the effect size and sample size. The lines on either side of the box represent a 95% confidence interval (CI). e-BMT: Telematic Behavioral Modification Techniques.
Figure 2. Sensitivity analysis of the depressive symptoms variable for telematic behavioral modification techniques against usual care or waiting list. Negative results favor the intervention group. The small boxes with the squares represent the point estimate of the effect size and sample size. The lines on either side of the box represent a 95% confidence interval (CI). e-BMT: Telematic Behavioral Modification Techniques.
Ijerph 19 03231 g002
Figure 3. Sensitivity analysis of the anxiety variable for telematic behavioral modification techniques against usual care or waiting list. Negative results favor the intervention group. The small boxes with the squares represent the point estimate of the effect size and sample size. The lines on either side of the box represent a 95% confidence interval (CI). e-BMT: Telematic Behavioral Modification Techniques.
Figure 3. Sensitivity analysis of the anxiety variable for telematic behavioral modification techniques against usual care or waiting list. Negative results favor the intervention group. The small boxes with the squares represent the point estimate of the effect size and sample size. The lines on either side of the box represent a 95% confidence interval (CI). e-BMT: Telematic Behavioral Modification Techniques.
Ijerph 19 03231 g003
Figure 4. Statistical analysis of the stress variable for telematic behavioral modification techniques against usual care or waiting list. Negative results favor intervention group. The small boxes with the squares represent the point estimate of the effect size and sample size. The lines on either side of the box represent a 95% confidence interval (CI). e-BMT: Telematic Behavioral Modification Techniques.
Figure 4. Statistical analysis of the stress variable for telematic behavioral modification techniques against usual care or waiting list. Negative results favor intervention group. The small boxes with the squares represent the point estimate of the effect size and sample size. The lines on either side of the box represent a 95% confidence interval (CI). e-BMT: Telematic Behavioral Modification Techniques.
Ijerph 19 03231 g004
Table 1. Subgroup analysis.
Table 1. Subgroup analysis.
Outcomes Sub = AnalysisN StudiesSMDLower Limit 95%CIUpper Limit
95% CI
QI2
(a) Depressive Symptoms—Treatment
ACT5−0.39−0.71−0.076.3837%
CBT11−0.46−0.73−0.1929.2166%
Positive Psychology2−0.61−1.770.550.450%
Self-management8−0.12−0.260.036.300%
Other types of treatment7−0.30−0.58−0.0311.1946%
Depressive Symptoms—Chronic Musculoskeletal disorder
Back pain5−0.24−0.530.055.5828%
Fibromyalgia7−0.66−1.01−0.3114.1658%
Headache3−0.14−0.19−0.090.020%
Rheumatic disorders4−0.28−0.680.125.8549%
Unspecified chronic pain 13−0.33−0.51−0.1536.6165%
Depressive Symptoms—Added to usual care treatment? (Y/N)
Only e-BMT24−0.34−0.46−0.2252.2654%
e-BMT added to usual care 8−0.41−0.80−0.0321.7968%
Depressive Symptoms—Intervention duration
Between 1 and 6 weeks6−0.02−0.170.122.440%
Between 7 and 11 weeks18−0.46−0.61−0.3136.7051%
12 weeks and more8−0.26−0.50−0.0312.5444%
Depressive Symptoms—Methodological Quality according to the PEDro scale
Fair methodological quality7−0.18−0.430.0710.8645%
Good methodological quality25−0.39−0.52−0.2654.0854%
(b) Anxiety—Treatment
ACT3−0.31−0.930.314.7558%
CBT10−0.31−0.50−0.1214.7139%
Positive psychology2−0.37-1.280.530.280%
Self-Management3−0.20−0.700.302.3415%
Other types of treatment4−0.41−0.970.148.4364%
Anxiety—Chronic Musculoskeletal disorder
Unspecific back pain3−0.09−0.750.582.4318%
Fibromyalgia5−0.45−0.85−0.058.1751%
Headache1−0.14−0.850.18N/AN/A
Rheumatic disorders2−0.35-2.471.771.6740%
Unspecified chronic pain10−0.33−0.47−0.1916.1238%
Anxiety—Intervention duration
1 to 6 weeks20.02-1.962.011.4129%
7 to 11 weeks13−0.41−0.50−0.3110.340%
12 weeks and more6−0.25−0.560.069.1345%
Anxiety—Added to usual care treatment? (Y/N)
Only e-BMT17−0.34−0.45−0.2226.8537%
e-BMT added to usual care 4−0.19−0.590.224.9539%
Anxiety—Methodological Quality according to the PEDro scale
Fair methodological quality5−0.18−0.400.046.6124%
Good methodological quality16−0.37−0.49−0.2422.2833%
Abbreviatures: ACT: Acceptance and Commitment therapy; CBT: Cognitive-behavioral therapy; CI: Confidence interval; e-BMT: Telematic behavioral techniques; N/A: Not Applicable; SMD: Standardized mean difference; Y/N: Yes.
Table 2. GRADE’s overall strength of the evidence.
Table 2. GRADE’s overall strength of the evidence.
Certainty Assessment No. of
Participants
EffectCertainty
Outcome
(No. of Studies)
Study
Design
Risk of BiasInconsistencyIndirectnessImprecisionPublication Biase-BMTControlAbsolute
(95% CI)
Depressive symptoms (n = 32)RCTSeriousSeriousNot seriousNot seriousNot serious18431688−0.35
(−0.46; −0.24)
Low
⊕⊕
Anxiety
(n = 21)
RCTSeriousNot SeriousNot seriousNot seriousNot serious14121166−0.32
(−0.42; −0.21)
Moderate
⊕⊕⊕
Stress
(n = 4)
RCTSeriousNot seriousNot seriousNot seriousNot serious399390−0.13
(−0.28; 0.02)
Moderate
⊕⊕⊕
CI: Confidence interval, e-BMT: Telematic Behavioral Modification Techniques, RCT: Randomized controlled trial.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Cuenca-Martínez, F.; Suso-Martí, L.; Herranz-Gómez, A.; Varangot-Reille, C.; Calatayud, J.; Romero-Palau, M.; Blanco-Díaz, M.; Salar-Andreu, C.; Casaña, J. Effectiveness of Telematic Behavioral Techniques to Manage Anxiety, Stress and Depressive Symptoms in Patients with Chronic Musculoskeletal Pain: A Systematic Review and Meta-Analysis. Int. J. Environ. Res. Public Health 2022, 19, 3231. https://doi.org/10.3390/ijerph19063231

AMA Style

Cuenca-Martínez F, Suso-Martí L, Herranz-Gómez A, Varangot-Reille C, Calatayud J, Romero-Palau M, Blanco-Díaz M, Salar-Andreu C, Casaña J. Effectiveness of Telematic Behavioral Techniques to Manage Anxiety, Stress and Depressive Symptoms in Patients with Chronic Musculoskeletal Pain: A Systematic Review and Meta-Analysis. International Journal of Environmental Research and Public Health. 2022; 19(6):3231. https://doi.org/10.3390/ijerph19063231

Chicago/Turabian Style

Cuenca-Martínez, Ferran, Luis Suso-Martí, Aida Herranz-Gómez, Clovis Varangot-Reille, Joaquín Calatayud, Mario Romero-Palau, María Blanco-Díaz, Cristina Salar-Andreu, and Jose Casaña. 2022. "Effectiveness of Telematic Behavioral Techniques to Manage Anxiety, Stress and Depressive Symptoms in Patients with Chronic Musculoskeletal Pain: A Systematic Review and Meta-Analysis" International Journal of Environmental Research and Public Health 19, no. 6: 3231. https://doi.org/10.3390/ijerph19063231

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop