Next Article in Journal
Chinese Translation and Cross-Cultural Adaptation of the Return-to-Work Self-Efficacy Scale among Chinese Female Breast Cancer Survivors
Previous Article in Journal
The Importance of Emotional Intelligence in University Athletes: Analysis of Its Relationship with Anxiety
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Text4PTSI: A Promising Supportive Text Messaging Program to Mitigate Psychological Symptoms in Public Safety Personnel

1
Department of Psychiatry, Dalhousie University, Halifax, NS B3H 4R2, Canada
2
Department of Psychiatry, University of Alberta, Edmonton, AB T6G 2R3, Canada
3
Operational Stress Injury Clinic, Alberta Health Services, Edmonton, AB T5J 3E4, Canada
4
Department of Child and Youth Care, Faculty of Health and Community Studies, MacEwan University, Edmonton, AB T5J 4S2, Canada
5
School of Nursing, Faculty of Health and Social Development, The University of British Columbia, Kelowna, BC V1V 1V7, Canada
6
Department of Occupational Therapy, Faculty of Rehabilitation Medicine, University of Alberta, Edmonton, AB T6G 2R3, Canada
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2023, 20(5), 4215; https://doi.org/10.3390/ijerph20054215
Submission received: 26 January 2023 / Revised: 22 February 2023 / Accepted: 23 February 2023 / Published: 27 February 2023

Abstract

:
Background: Public safety personnel experience various mental health conditions due to their work’s complex and demanding nature. There are barriers to seeking support and treatment; hence, providing innovative and cost-effective interventions can help improve mental health symptoms in public safety personnel. Objective: The study aimed to evaluate the impact of Text4PTSI on depression, anxiety, trauma, and stress-related symptoms, and the resilience of public safety personnel after six months of providing supportive text message intervention. Methods: Public safety personnel subscribed to Text4PTSI and received daily supportive and psychoeducational SMS text messages for six months. Participants were invited to complete standardized self-rated web-based questionnaires to assess depression, anxiety, posttraumatic stress disorder (PTSD), and resilience symptoms measured on the Patient Health Questionnaire-9 (PHQ-9), Generalized Anxiety Disorder-7 scale (GAD-7), Posttraumatic Stress Disorder Checklist-Civilian Version (PCL-C), and the Brief Resilience Scale (BRS), respectively. The assessment of mental health conditions was conducted at baseline (enrolment) and six weeks, three months, and six months after enrollment. Results: One hundred and thirty-one subscribers participated in the Text4PTSI program, and eighteen completed both the baseline and any follow-up survey. A total of 31 participants completed the baseline survey and 107 total surveys were recorded at all follow-up time points. The baseline prevalence of psychological problems among public safety personnel were as follows: likely major depressive disorder (MDD) was 47.1%, likely generalized anxiety disorder (GAD) was 37.5%, low resilience was 22.2%, and likely PTSD was 13.3%. At six months post-intervention, the prevalence of likely MDD, likely GAD, and likely PTSD among respondents reduced; however, a statistically significant reduction was reported only for likely MDD (−35.3%, X2 (1) = 2.55, p = 0.03). There was no significant change in the prevalence of low resilience between baseline and post-intervention. There was a decrease in the mean scores on the PHQ-9, GAD-7, PCL-C, and the BRS from baseline to post-intervention by 25.8%, 24.7%, 9.5%, and 0.3%, respectively. However, the decrease was only statistically significant for the mean change in GAD-7 scores with a low effect size (t (15) = 2.73, p = 0.02). Conclusions: The results of this study suggest a significant reduction in the prevalence of likely MDD as well as the severity of anxiety symptoms from baseline to post-intervention for subscribers of the Text4PTSI program. Text4PTSI is a cost-effective, convenient, and easily scalable program that can augment other services for managing the mental health burdens of public safety personnel.

1. Introduction

First responders comprise police, paramedics, firefighters, ambulance personnel, and emergency medical personnel who have acquired the skills and training and are the first contact to assist individuals during emergencies such as accidents and fire outbreaks [1,2]. Public safety personnel, on the other hand, ensure safety. Public safety personnel include but are not limited to first responders, military personnel, and law enforcement agents, among others [3,4]. All these personnel are included in the definition of public safety personnel and have been extensively studied [1,3,4]. Due to the scope of their work, they are exposed to distressing experiences and are predisposed to physical and mental health risk factors [5]. It is unsurprising that most of the literature consistently reports increased stress-related psychopathology among first responders [3,6,7]. Although mental health disorders among public safety personnel range from 10% to 35% internationally, these values vary based on specific occupations and the type of mental health condition [8].
Recent literature has studied public safety personnel, especially emergency health workers, military personnel, firefighters, and law enforcement. Published literature has recorded a prevalence of any mental health condition from 6.4% to 57% for firefighters [9,10], 3.72% to 37.8% for military personnel [10,11,12], and 5.8% to 19.6% for police officers [9,13,14]. Prevalence is dynamic and these range of prevalence could be attributed to sample size, population, methodology, or time [10]. Some reports may study one group of personnel while other studies research public safety personnel in general, which may cause the variation in the prevalence.
Researchers have also reported higher rates of psychological distress, such as posttraumatic stress, depression, anxiety, sleep disorders, and mild traumatic brain injury among these groups [10]. For example, among police officers, depression and anxiety rates are 14.6% and 9.6%, respectively [14]. The point prevalence of depression (16–26%) is higher than the general population, with a rate of 7% [4,15,16]. A systematic review and meta-analysis estimated the prevalence rates of depression and anxiety at 15% among ambulance personnel [17]. A study conducted among rescue workers demonstrated that trauma-exposed disaster personnel have a 16% prevalence of depression between 7 and 13 months post-disaster [18]. Similarly, 5–32.8% of firefighters reported depressive symptoms, and 3.8–30.5% reported anxiety symptoms in China [19].
Posttraumatic stress disorder (PTSD) is one of the most common mental health conditions experienced following traumatic events and is widely studied among public safety personnel [10,13,20]. The Diagnostic and Statistical Manual of Mental Disorders-5 (DSM-5) identifies that PTSD is higher among veterans and other public safety personnel such as the police, firefighters, and emergency medical personnel [21]. Moreover, individuals may be symptomatic of PTSD even if they do not meet all the diagnostic criteria [22]. A study in Canada reported that 7.6% of police officers experience full PTSD, while 6.8% experience partial PTSD after exposure to traumatic experiences at work [23]. Research literature estimates the prevalence of PTSD at 10% in public safety personnel, which is higher than the general population, estimated between 1.3% and 3.5% [24,25,26]. Low resilience to psychopathology is another challenge for most public safety personnel [27]. The ability to continue functioning after a traumatic event is usually a characteristic of successful adaptation and coping [27,28].
The increasing prevalence of mental health symptoms among public safety personnel is alarming. Additionally, the ongoing exposure to traumatic events throughout public safety personnel careers warrants interventions that can be easily accessed. Evidence suggests that public safety personnel are hesitant to access mental health services due to cost and stigma; hence, outreach programs are recommended [26]. E-mental health initiatives have proven promising in improving the utilization of mental health services in Canada [29]. Interventions that are cost-effective and helpful are highly recommended, given that most individuals with mental health conditions do not access services due to stigma or geographical barriers [30]. Cognitive behavioral therapy (CBT), which is a form of psychological treatment that helps to change the negative thought patterns of an individual [31], when delivered through text messaging has been proven to bridge the gap in mental health interventions and reduce anxiety and depression symptoms [32,33,34]. Text message systems, invented in the 1990s, are an affordable communication method that is a normal part of most people’s lives today and can be used to deliver innovative healthcare [35].
Most studies have reported a reduction in psychopathology when delivering supportive care through text message intervention. For example, a study of text messaging used as part of a clinical intervention reported a significant improvement in psychological symptoms compared to the usual care in ten out of sixteen randomized controlled trials [36]. Similarly, a systematic review and meta-analysis utilizing randomized control trials showed that text messaging reduces depression symptoms among people living with clinical depression [37]. Another study found that text messaging has the potential to reduce depression symptoms among adults with predominant depression [38]. Similar text messaging programs, Text4Hope and Text4Mood, achieved significant reductions in anxiety and depression symptoms among subscribers [32,39,40].
Supportive text message therapy has also been effective in mood disorders [40].
Text4PTSI is a supportive daily text messaging program based on CBT and trauma therapy principles and aims to provide mental health support for public safety personnel [2]. The program was initiated to prevent, manage, and reduce psychopathology in this cohort. This paper evaluates the impact of Text4PTSI on depression, anxiety, posttraumatic stress symptoms, and low resilience six months post-intervention.
We hypothesize that participants who enroll in the program will have improved depression, posttraumatic stress symptoms, and anxiety symptoms, and improved resilience in comparison to their baseline parameters.

2. Methodology

2.1. Study Design/Ethical Considerations

This longitudinal study assessed the effectiveness of a supportive text message intervention program (Text4PTSI) after participants received six months of daily supportive text messages. The Health Research Ethics Board (HREB) of the University of Alberta approved the study (Pro00108966). Informed consent was implied if respondents reviewed the associated information leaflet and completed and submitted the voluntary online surveys. Confidentiality and data security measures were adhered to as approved by the HREB.

2.2. Data Collection

Data were collected through online self-administered questionnaires with the REDCap software program [41]. The procedure for data collection is fully described in the study protocol [2]. The targeted population was public safety personnel, including emergency department health workers, paramedics, firefighters, and police/law enforcement agents. Participants subscribed to the program by texting “PTSI” to a designated phone number and were enrolled in the program. Participants received daily unidirectional supportive text messages for a period of six months. An example of a message is:
Letting go of resentment is a gift you give yourself, and it will ease your journey immeasurably. Make peace with everyone, and happiness will be yours. Trauma can feel like a gloomy cloud over all areas of your life. The first step in treatment is to understand what trauma is, the symptoms, and how and why it is treated.
Participation in the program was voluntary, and supportive text messages were received irrespective of survey completion. A maximum of ten minutes was required to complete the survey. Participants could opt out of the program anytime by texting the word “STOP” to the same number that sends the supportive messages. No incentives were offered for survey participation.
At enrollment, the baseline survey captured subscribers’ demographic and clinical information. Follow-up survey links were sent via text message to the participants’ mobile phones six weeks, three months, and six months after enrollment. Figure 1 illustrates the participants’ flowchart and the number of surveys collected at each time point.

2.3. Outcome Measures

The primary outcome measure was the mean difference in scores on the Patient Health Questionnaire-9 (PHQ-9) scale, the Generalized Anxiety Disorder-7 scale (GAD-7), the Brief Resilience Scale (BRS), and the Posttraumatic Stress Disorder Checklist-Civilian Version (PCL-C) at baseline and follow-up (six weeks, three months, and six months) and the changes in the prevalence of self-reported posttraumatic stress, depression, anxiety, and low resilience symptoms at the various follow-up time points from baseline. The prevalence was calculated by dividing the total number of participants who reported the likelihood of the clinical condition by the total eligible number of participants. The PHQ-9, GAD-7, BRS, and PCL-C scales assessed depression, anxiety, low resilience, and posttraumatic stress symptoms, respectively.
The PHQ-9 is a self-report instrument used to inform screening, diagnosing, monitoring, and measuring the severity of depression. It is a nine-item questionnaire measured on a four-point Likert scale from “0” (not at all) to “3” (nearly every day) [42]. The PHQ-9 scale categorizes depression scores into none to minimal (0–4 points), mild (5–9 points), moderate (10–14 points), moderately severe (15–19 points), and severe (20–27 points) [42]. The PHQ-9 reliability and validity have demonstrated good psychometric qualities. The PHQ-9 has a high internal consistency: Cronbach alphas of 0.86 and 0.89 were reported in two distinct studies [42]. For analysis purposes, they were recategorized into two variables: none to mild depression (a score ≤ 9) and moderate to severe depression (a score ≥ 10).
The GAD-7 is a self-report instrument used to inform screening, diagnosing, monitoring, and measuring the severity of anxiety symptoms. The scale is a 4-point Likert-type scale (0—not at all, 1—several days, 2—more than half the days, and 3—nearly every day). Scores range from 0 to 21. The scale categorizes depression scores as minimal (0–4), mild (5–9), moderate (10–14), and severe anxiety (15–21) [43]. The GAD-7 scale demonstrates consistency and a one-factor structure in its usage globally, and all its items represent one construct [44,45]. The tool has acceptable test–retest reliability and is a validated tool for assessing the severity of GAD symptoms in research and clinical practice [42,45]. The scores were recategorized into low anxiety (score < 10) and moderate to high anxiety (score ≥ 10).
The BRS assesses resilience as one’s ability to bounce back or recover from stressful moments [46]. The BRS is a 6-item questionnaire measured on a five-point Likert scale, and a total score can range from 6 to 30. An average score < 3 indicates low resilience, while an average score > 3 denotes normal to high resilience. The literature has demonstrated adequate internal consistency of the BRS, with Cronbach alphas ranging from 0.80 to 0.90 and a fair test–retest reliability coefficient [46].
The PCL-C was used to assess the likely PTSD symptoms of participants [47]. This scale is a 17-item checklist measured on a 5-point Likert scale; each symptom is rated from 1 (not at all) to 5 (extremely). A total score ranges from 17 to 85, with a higher score indicating a severe form of PTSD. A score ≥ 44 denotes likely PTSD, while ≤44 shows unlikely PTSD. The PCL-C demonstrates high internal consistency (Cronbach’s = 0.94) and acceptable reliability and convergent validity [48].

Sample Size Considerations

With a projection that the effect size for the reduction in mean PCL-C, GAD-7, and PHQ-9 scores at six months from baseline would be 0.1, a population variance of 1.0 for each scale mean score, a two-sided significance level α = 0.05, and a power of 90% (β = 0.1), using an online script [49], we estimated that the sample size needed to assess the effects of the daily supportive text messages on the outcome variables would be 48.

2.4. Statistical Analysis

Data were analyzed utilizing SPSS Version 26 [50] using descriptive and inferential statistics. Demographic characteristics were compared using chi-square or Fisher’s exact tests between two samples of study participants who responded to the baseline survey and at least one follow-up survey (sample A, n = 18) and participants who responded only to one survey, i.e., only the baseline, six weeks, three months, or six months survey (sample B, n = 69). This was to determine how similar or dissimilar the sociodemographic characteristics of the two samples were.
In order to evaluate the generalizability of the data, the baseline prevalence of the four mental health conditions under study was appraised among the participants who completed both the baseline survey and follow-up (n = 18) and participants who completed only the baseline surveys (n = 11) (two responses did not provide data related to the clinical conditions under study).
With the same concept, the follow-up prevalence was assessed between the responses of those who completed the baseline and follow-up surveys (n = 18) and the responses of those who responded only to the follow-up surveys (107).
Regarding the outcome assessment, the ongoing analysis was run on sample A (the participants who completed both baseline and follow-up surveys) to examine the outcome scales under study. The last observation carried forward (LOCF) method was applied, i.e., the latest response was recorded (six months). The last observation (six weeks or three months) was carried forward (imputed) when the latest response was missing [51]. In order to appraise the outcome measures, paired sample t-tests were used to assess differences between the mean PHQ-9, GAD-7 BRS, and PCL-C scores at baseline and follow-up for participants who completed the online scales at baseline and any follow-up time points. The chi-square test was employed to compare the prevalence of likely MDD, GAD, low resilience, and PTSD symptoms at baseline and follow-up.
Moderate to severe depression and GAD were assessed using a score of ≥10 on the PHQ-9 and GAD-7 scales. Low resilience and likely PTSD were assessed using the BRS score of <3 and PCL-C score of ≥44, respectively. The total number of responses was reported and represented for each variable.

3. Results

3.1. Demographic Characteristics

A total of 131 subscribers participated in Text4PTSI, providing 138 surveys over all the study time points, and 31 and 107 surveys were provided at baseline and total of the three follow-up surveys, respectively. Out of the 131 subscribers, 18 completed baseline and follow-up surveys.
Table 1 illustrates the distribution of demographic characteristics of all the study participants who responded to the baseline and at least one more survey and the participants who responded to only one survey. The bivariable analysis did not show a statistically significant association between the sociodemographic characteristic of sample A and sample B (p ≤ 0.05). This implies that the two samples were similar in terms of participants’ sociodemographic characteristics. The results presented in Table 1 also suggest that 37.2% of the sample were police/law enforcement agents, and most of the participants were between the ages of 31 and 60 (56/80, 70%). They were predominantly females (47/81, 58%), white (63/81, 77.7%), had attained postsecondary education (68/81, 83.9%), had employment (71/81, 87.7%), were in a relationship (58/81, 72.5%), and owned their homes (57/81, 70.4%).
In order to evaluate the generalizability of the data, based on likely MDD, GAD, low resilience, and likely PTSD at baseline (Table 2), we compared the clinical characteristics between participants who completed both the baseline survey and follow-up and participants who completed only the baseline surveys, as indicated in Table 2A. The data did not find any statistically significant difference between the groups (baseline and follow-up and only baseline) for likely MDD, GAD, and low resilience (p > 0.05). However, the likelihood of PTSD was significantly higher in participants who completed the baseline survey only compared to sample A. These results imply that at baseline, the likelihood of mental health conditions under study was similar between study participants and subscribers who did not complete the follow-up survey, except for likely PTSD. Likewise, participants who completed the baseline and follow-up surveys were examined against participants who completed only the follow-up survey (Table 2B). There was no statistically significant difference between the two groups for all outcome scales. These results suggest that after receiving the intervention, the mental health symptoms were, for the most part, similar for participants who completed only the follow-up and those who completed both the baseline and the follow-up.

3.2. Analysis of Study Outcomes

The ongoing analysis was run on sample A (the participants who completed both surveys, baseline and any follow-up survey). Table 3 describes the change in prevalence of the four mental health conditions under study after introducing Text4PTSI for six months. As illustrated in Table 3, likely MDD recorded a 35.3% significant decrease in prevalence from baseline to six months (p = 0.03). There were reductions in the prevalence of likely GAD and likely PTSD (18.7% and 6%, respectively), but these did not achieve statistical significance. Similarly, the prevalence of low resilience did not show any significant difference between the baseline and follow-up prevalence.
Table 4 shows the changes in the mean scores of the primary outcome measures after six months from baseline for participants who completed both the baseline and other follow-up surveys (sample A). As indicated in Table 4, the participants recorded lower mean scores on the PHQ-9, GAD-7, PCL-C, and BRS scales at follow-up compared to the mean scores at baseline, suggesting improvement in depression, anxiety, resilience, and PTSD symptoms. However, only the GAD-7 change in mean scores from baseline was statistically significant (t (15) = 2.73, p = 0.02), with a low effect size (Cohen’s d = 0.38).

4. Discussion

Public safety personnel may experience psychological distress due to their work’s challenging and complex nature. The Text4PTSI program is a structured cognitive behavioral therapy-based text messaging program designed to prevent and reduce the occurrence of MDD, GAD, PTSD, and low resilience among Canada’s public safety personnel. These cohorts received daily supportive text messages for six months. Our results showed a significant reduction in mean scores of only the GAD symptoms. However, there was an observed reduction noted in other mean scores, including for scales used to measure depression, resilience, and posttraumatic stress symptoms, even though they did not reach statistical significance. Additionally, the results showed a reduction in the prevalence of mental health conditions from the initial baseline survey results. Again, it was only the change in prevalence of likely MDD which was statistically significant, representing a 35.3% reduction from the established baseline. The changes in prevalence of likely GAD and PTSD were 18.7% and 6.6%, respectively, albeit not significant, and there was no significant reduction in the prevalence of low resilience at the six-month follow-up for participants. The results of this study also indicate that there was no substantial difference in the prevalence of the mental health burden of participants who completed baseline and follow-up and those who completed follow-up or baseline only, suggesting the potential generalizability of the results over the whole study sample.
The baseline prevalence of self-reported depression, anxiety, and posttraumatic stress symptoms in our study was recorded at 47.1%, 37.5%, and 13.3%, respectively, which is higher than what has been reported in other studies among public safety personnel [1,18,52]. A recent meta-analysis among first responders reported a pooled prevalence of depression of 31% [1] and 15% among ambulance personnel [17]. Similarly, a case–control analysis of emergency medical technicians recorded a 6.8% prevalence of depression [53]. Likewise, the prevalence of PTSD ranged from 3.7% to 12.6% among military personnel [12,54]. Anxiety symptoms recorded in other studies have also been lower than reported in this study [55,56]. The prevalence of anxiety among firefighters, EMTs, and paramedics ranged from 4.2% to 26% [55,56]. The variation in prevalence may be attributed to the type of public safety personnel group, scales used, and location [8,57]. While other studies focus on a particular public safety personnel group, our study focused on different personnel, hence the variation in prevalence. A study in Canada among public safety personnel reported elevated symptoms of various mental disorders despite prior treatments, and the public safety personnel experienced reductions in their symptoms following internet-delivered cognitive behavioral therapy (iCBT) [58].
After six months of receiving the supportive text message intervention, the prevalence of mental health burden was reduced in subscribers of Text4PTSI. Although not all subscribers may have read the supportive text messages they received, it is possible that most people who read the text benefited from the program. The most significant reduction was for MDD symptoms, with a prevalence reduction of 35.3%, and a 25% reduction in mean scores on the GAD-7 scale from baseline. This study’s findings are consistent with previous research, which demonstrated that novel interventions, including supportive text messaging and internet-based CBT approaches, can be effective and have greater efficacy in preventing and managing mental health conditions among public safety personnel [59,60,61]. Although the effect sizes (Cohen’s d) recorded in this study were small, the literature reveals that interventions without a therapist directly involved record a smaller effect size than an intervention with a therapist involved [39,62]. Since there was no control group, the improvement and related effect sizes could also be attributed to other factors such as the possibility of spontaneous remission over the 6-month period.
The findings from this study indicate that the prevalence of anxiety and depression symptoms significantly reduced after receiving the intervention. The reduction in anxiety symptoms recorded an effect size of 0.38, with a change in the mean score of −2.07. This finding agrees with outcomes reported from the Text4Hope program, which delivered supportive text messages to individuals during the COVID-19 pandemic and showed that anxiety symptoms reduced after the intervention [32]. A meta-analysis of randomized controlled trials reported an effect size of 0.35 for anxiety symptom reduction for a sample that received iCBT [63]. Furthermore, a systematic review to assess the efficacy of text message interventions reported that the intervention improves anxiety symptoms with a fair effect size [64].
Although there was no statistically significant improvement in depression symptom severity as measured by the PHQ-9 scale from baseline to post-intervention in this study, there was a significant reduction in the prevalence of likely MDD post-intervention. The later finding is consistent with other psychological interventions targeting the general population and public safety personnel [65,66], and several studies involving the delivery of support via text messages or internet-delivered CBT have recorded improved depression symptoms after the intervention [39,67,68,69]. For example, a study among Canadian public safety personnel reported that participants experienced decreased depression symptoms, anxiety, and posttraumatic stress symptoms after introducing an iCBT program tailored for public safety personnel [69].
This study did not find a significant change in the prevalence of low resilience from baseline to post-intervention. Resilience has been described as the ability to “bounce back” from adversity impacting mental health [70]. In contrast, improved resilience may improve health symptoms [71]. Hence, participants may have developed resilience to mental health symptoms, which may explain why there was no statistically significant change in the BRS scores. Moreover, the study cohort showed mostly normal to high resilience before the intervention (BRS > 3), which did not deteriorate after the intervention. Perhaps the Text4PTSI program was not effective enough in addressing low resilience symptoms in the 22% of the study population.
Our study also did not record a significant change in either the severity or prevalence of likely PTSD symptoms in respondents from baseline to post-intervention. It is possible that the duration of the intervention could have resulted in this non-significant change in comparison to iCBT treatments delivered for a more extended period which have been reported to be effective in reducing PTSD symptoms [72]. However, our findings showed a statistically significant difference in the prevalence of PTSD, where the participants who completed both baseline and follow-up surveys were less likely to report PTSD symptoms compared to those who completed only the baseline survey. There is a possibility that participants who were experiencing more PTSD symptoms were not encouraged enough to respond to the follow-up survey, irrespective of the intervention they received. They probably found intervention either unhelpful or that it exacerbated their symptoms.
Moreover, 70% of our participants were between 31 and 60 years old, which may have affected the utilization of the service. Individuals born after the 1980s (often referred to as digital natives) may have more exposure to digital technologies than older people, which may be a barrier to completing online surveys and navigating digital media and other digital technologies [73,74,75].

5. Limitations

There are limitations to this study which need to be considered when interpreting the findings. First, although validated and standardized scales were used in this study, the self-reported questionnaires are nonetheless non-diagnostic. Second, the relatively small sample size of participants who completed both the baseline and follow-up surveys (18/131) makes it likely that this study was underpowered to detect significant differences from baseline to post-intervention. In addition, the low response rate, which is potentially a result of the online nature of the surveys, could impact the generalizability of our findings to all subscribers of Text4PTSI. Surveys delivered via text messages are nearly 15% less likely to retain participants for follow-up assessment compared to other mediums such as paper surveys [76,77]. However, the comparative analysis for the total cohort at baseline and follow-up revealed mostly non-significant differences, suggesting the potential generalizability of the results to all subscribers. Considering all the follow-up surveys (6 weeks, three months, and six months) together instead of analyzing them differently may have led to a loss of precision in the results and the interpretations. Additionally, the absence of a control group who did not receive the intervention led to uncertainty in concluding whether the effects found are due to the intervention or other factors such as time progression (regression to the mean).
Again, the effect sizes for significant results in this study were small, which may minimize the strength of our findings. Nevertheless, the literature records small effect sizes for self-help interventions that do not directly involve a therapist [39,61,68]. Future studies adopting text message intervention can encourage public safety personnel to subscribe and complete follow-up assessments through an incentive package since the literature reports that even small monetary value incentives promote response rates in research [78].

6. Conclusions

The current Text4PTSI study shows a substantially higher prevalence of depression, anxiety, posttraumatic stress symptoms, and low resilience among public safety personnel compared with the general public. The results from our program showed a reduction in the mean score for the GAD scale and a statistically significant reduction in the prevalence only of MDD at six months from baseline. The statistically significant improvements in depression symptoms six months after the program suggest that there is a potential utility for Text4PTSI to be adopted as an innovative and cost-effective intervention for public safety personnel. Most public safety personnel are hesitant to access mental health services, and some have experienced barriers to adequately meeting their mental health needs [26]. The former may be due to cost, stigma, geographical constraints, or long wait times [29,30]. Considering these factors, proven technology-enabled CBT-based services such as Text4PTSI can address public safety personnel’s psychological and wellness needs. Future randomized control studies are recommended to comprehensively assess the impact of Text4PTSI on anxiety, depression, resilience, and PTSD symptoms in public safety personnel. It is also recommended that demographic differences be analyzed in future studies based on sex, gender identity, sexual orientation, race/ethnicity, and other similar factors. This may help target tailored text message interventions particularly to marginalized and vulnerable respondents.

Author Contributions

V.I.O.A. conceived, designed, and supervised the study. Data analysis was performed by R.S., G.O.-D. and V.I.O.A. G.O.-D. wrote the initial draft of the manuscript. V.I.O.A., G.O.-D., R.S., E.E., B.A., N.P., S.E., K.W., C.H., R.d.L.D., C.J., S.B.-P., Y.Z. and A.J.G. edited and revised the manuscript. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Alberta Labour and Immigration Department, Government of Alberta from the “Supporting Psychological Health in First Responders Grant”.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki and approved by the Institutional Review Board of the University of Alberta (Pro00108966).

Informed Consent Statement

Informed consent was implied if participants reviewed the associated information leaflet, completed, and submitted the voluntary online surveys.

Data Availability Statement

Data associated with this study will be made freely available upon reasonable request to the corresponding author.

Acknowledgments

We are grateful for patients attending the Operational Stress Injury Clinic in Edmonton for contributing to the bank of supportive messages used in this program.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Huang, G.; Chu, H.; Chen, R.; Liu, D.; Banda, K.J.; O’Brien, A.P.; Jen, H.J.; Chiang, K.J.; Chiou, J.F.; Chou, K.R. Prevalence of depression, anxiety, and stress among first responders for medical emergencies during COVID-19 pandemic: A meta-analysis. J. Glob. Health 2022, 12, 05028. [Google Scholar] [CrossRef] [PubMed]
  2. Obuobi-Donkor, G.; Eboreime, E.; Bond, J.; Phung, N.; Eyben, S.; Hayward, J.; Zhang, Y.; MacMaster, F.; Clelland, S.; Greiner, R.; et al. An E-Mental Health Solution to Prevent and Manage Posttraumatic Stress Injuries Among First Responders in Alberta: Protocol for the Implementation and Evaluation of Text Messaging Services (Text4PTSI and Text4Wellbeing). JMIR Res. Protoc. 2022, 11, e30680. [Google Scholar] [CrossRef] [PubMed]
  3. Benedek, D.M.; Fullerton, C.; Ursano, R.J. First responders: Mental health consequences of natural and human-made disasters for public health and public safety workers. Annu. Rev. Public Health 2007, 28, 55–68. [Google Scholar] [CrossRef] [PubMed]
  4. Kleim, B.; Westphal, M. Mental health in first responders: A review and recommendation for prevention and intervention strategies. Traumatology 2011, 17, 17–24. [Google Scholar] [CrossRef]
  5. Haugen, P.T.; Evces, M.; Weiss, D.S. Treating posttraumatic stress disorder in first responders: A systematic review. Clin. Psychol. Rev. 2012, 32, 370–380. [Google Scholar] [CrossRef]
  6. Behnke, A.; Conrad, D.; Kolassa, I.T.; Rojas, R. Higher sense of coherence is associated with better mental and physical health in emergency medical services: Results from investigations on the revised sense of coherence scale (SOC-R) in rescue workers. Eur. J. Psychotraumatol. 2019, 10, 1606628. [Google Scholar] [CrossRef] [Green Version]
  7. Zvolensky, M.J.; Kotov, R.; Schechter, C.B.; Gonzalez, A.; Vujanovic, A.; Pietrzak, R.H.; Crane, M.; Kaplan, J.; Moline, J.; Southwick, S.M.; et al. Post-disaster stressful life events and WTC-related posttraumatic stress, depressive symptoms, and overall functioning among responders to the World Trade Center disaster. J. Psychiatr. Res. 2015, 61, 97–105. [Google Scholar] [CrossRef]
  8. Carleton, R.N.; Afifi, T.O.; Turner, S.; Taillieu, T.; Duranceau, S.; LeBouthillier, D.M.; Sareen, J.; Ricciardelli, R.; MacPhee, R.S.; Groll, D.; et al. Mental Disorder Symptoms among Public Safety Personnel in Canada. Can. J. Psychiatry Rev. Can. Psychiatr. 2018, 63, 54–64. [Google Scholar] [CrossRef] [Green Version]
  9. Alshahrani, K.M.; Johnson, J.; Prudenzi, A.; O’Connor, D.B. The effectiveness of psychological interventions for reducing PTSD and psychological distress in first responders: A systematic review and meta-analysis. PLoS ONE 2022, 17, e0272732. [Google Scholar] [CrossRef]
  10. Obuobi-Donkor, G.; Oluwasina, F.; Nkire, N.; Agyapong, V.I.O. A Scoping Review on the Prevalence and Determinants of Post-Traumatic Stress Disorder among Military Personnel and Firefighters: Implications for Public Policy and Practice. Int. J. Environ. Res. Public Health 2022, 19, 1565. [Google Scholar] [CrossRef]
  11. Jakupcak, M.; Luterek, J.; Hunt, S.; Conybeare, D.; McFall, M. posttraumatic stress and its relationship to physical health functioning in a sample of Iraq and Afghanistan War veterans seeking postdeployment VA health care. J. Nerv. Ment. Dis. 2008, 196, 425–428. [Google Scholar] [CrossRef] [PubMed]
  12. Iversen, A.C.; Fear, N.T.; Ehlers, A.; Hacker Hughes, J.; Hull, L.; Earnshaw, M.; Greenberg, N.; Rona, R.; Wessely, S.; Hotopf, M. Risk factors for post-traumatic stress disorder among UK Armed Forces personnel. Psychol. Med. 2008, 38, 511–522. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  13. Wagner, S.L.; White, N.; Fyfe, T.; Matthews, L.R.; Randall, C.; Regehr, C.; White, M.; Alden, L.E.; Buys, N.; Carey, M.G.; et al. Systematic review of posttraumatic stress disorder in police officers following routine work-related critical incident exposure. Am. J. Ind. Med. 2020, 63, 600–615. [Google Scholar] [CrossRef] [PubMed]
  14. Syed, S.; Ashwick, R.; Schlosser, M.; Jones, R.; Rowe, S.; Billings, J. Global prevalence and risk factors for mental health problems in police personnel: A systematic review and meta-analysis. Occup. Environ. Med. 2020, 77, 737–747. [Google Scholar] [CrossRef] [PubMed]
  15. Kessler, R.C.; Berglund, P.; Demler, O.; Jin, R.; Koretz, D.; Merikangas, K.R.; Rush, A.J.; Walters, E.E.; Wang, P.S. The epidemiology of major depressive disorder: Results from the National Comorbidity Survey Replication (NCS-R). JAMA 2003, 289, 3095–3105. [Google Scholar] [CrossRef] [PubMed]
  16. Kessler, R.C.; Chiu, W.T.; Demler, O.; Merikangas, K.R.; Walters, E.E. Prevalence, severity, and comorbidity of 12-month DSM-IV disorders in the National Comorbidity Survey Replication. Arch. Gen. Psychiatry 2005, 62, 617–627. [Google Scholar] [CrossRef] [Green Version]
  17. Petrie, K.; Milligan-Saville, J.; Gayed, A.; Deady, M.; Phelps, A.; Dell, L.; Forbes, D.; Bryant, R.A.; Calvo, R.A.; Glozier, N.; et al. Prevalence of PTSD and common mental disorders amongst ambulance personnel: A systematic review and meta-analysis. Soc. Psychiatry Psychiatr. Epidemiol. 2018, 53, 897–909. [Google Scholar] [CrossRef]
  18. Fullerton, C.S.; Ursano, R.J.; Wang, L. Acute stress disorder, posttraumatic stress disorder, and depression in disaster or rescue workers. Am. J. Psychiatry 2004, 161, 1370–1376. [Google Scholar] [CrossRef] [Green Version]
  19. Sun, X.; Li, X.; Huang, J.; An, Y. Prevalence and predictors of PTSD, depression and posttraumatic growth among Chinese firefighters. Arch. Psychiatr. Nurs. 2020, 34, 14–18. [Google Scholar] [CrossRef]
  20. Smith, E.C.; Holmes, L.; Burkle, F.M. The Physical and Mental Health Challenges Experienced by 9/11 First Responders and Recovery Workers: A Review of the Literature. Prehosp. Disaster Med. 2019, 34, 625–631. [Google Scholar] [CrossRef]
  21. Edition, F. Diagnostic and statistical manual of mental disorders. Am. Psychiatr. Assoc. 2013, 21, 591–643. [Google Scholar]
  22. Motreff, Y.; Baubet, T.; Pirard, P.; Rabet, G.; Petitclerc, M.; Stene, L.E.; Vuillermoz, C.; Chauvin, P.; Vandentorren, S. Factors associated with PTSD and partial PTSD among first responders following the Paris terror attacks in November 2015. J. Psychiatr. Res. 2020, 121, 143–150. [Google Scholar] [CrossRef] [PubMed]
  23. Martin, M.; Marchand, A.; Boyer, R.; Martin, N. Predictors of the development of posttraumatic stress disorder among police officers. J. Trauma Dissociation Off. J. Int. Soc. Study Dissociation ISSD 2009, 10, 451–468. [Google Scholar] [CrossRef] [PubMed]
  24. Berger, W.; Coutinho, E.S.F.; Figueira, I.; Marques-Portella, C.; Luz, M.P.; Neylan, T.C.; Marmar, C.R.; Mendlowicz, M.V. Rescuers at risk: A systematic review and meta-regression analysis of the worldwide current prevalence and correlates of PTSD in rescue workers. Soc. Psychiatry Psychiatr. Epidemiol. 2012, 47, 1001–1011. [Google Scholar] [CrossRef] [Green Version]
  25. Creamer, M.; Burgess, P.; McFarlane, A.C. Post-traumatic stress disorder: Findings from the Australian National Survey of Mental Health and Well-being. Psychol. Med. 2001, 31, 1237–1247. [Google Scholar] [CrossRef] [Green Version]
  26. Joyce, S.; Tan, L.; Shand, F.; Bryant, R.A.; Harvey, S.B. Can Resilience be Measured and Used to Predict Mental Health Symptomology Among First Responders Exposed to Repeated Trauma? J. Occup. Environ. Med. 2019, 61, 285–292. [Google Scholar] [CrossRef]
  27. Bonanno, G.A. Loss, trauma, and human resilience: Have we underestimated the human capacity to thrive after extremely aversive events? Am. Psychol. 2004, 59, 20–28. [Google Scholar] [CrossRef] [Green Version]
  28. Goldmann, E.; Galea, S. Mental health consequences of disasters. Annu. Rev. Public Health 2014, 35, 169–183. [Google Scholar] [CrossRef]
  29. Moroz, N.; Moroz, I.; D’Angelo, M.S. Mental health services in Canada: Barriers and cost-effective solutions to increase access. Healthc. Manag. Forum 2020, 33, 282–287. [Google Scholar] [CrossRef]
  30. Saxena, S.; Thornicroft, G.; Knapp, M.; Whiteford, H. Resources for mental health: Scarcity, inequity, and inefficiency. Lancet 2007, 370, 878–889. [Google Scholar] [CrossRef]
  31. Beck, J.S. Cognitive-behavioral therapy. Clin. Textb. Addict. Disord. 2011, 491, 474–501. [Google Scholar]
  32. Agyapong, V.I.O.; Hrabok, M.; Shalaby, R.; Vuong, W.; Noble, J.M.; Gusnowski, A.; Mrklas, K.; Li, D.; Urichuck, L.; Snaterse, M.; et al. Text4Hope: Receiving Daily Supportive Text Messages for 3 Months During the COVID-19 Pandemic Reduces Stress, Anxiety, and Depression. Disaster Med. Public Health Prep. 2021, 16, 1326–1330. [Google Scholar] [CrossRef] [PubMed]
  33. Agyapong, V.I.; McLoughlin, D.M.; Farren, C.K. Six-months outcomes of a randomised trial of supportive text messaging for depression and comorbid alcohol use disorder. J. Affect. Disord. 2013, 151, 100–104. [Google Scholar] [CrossRef] [PubMed]
  34. Agyapong, V.I.O.; Juhás, M.; Ohinmaa, A.; Omeje, J.; Mrklas, K.; Suen, V.Y.M.; Dursun, S.M.; Greenshaw, A.J. Randomized controlled pilot trial of supportive text messages for patients with depression. BMC Psychiatry 2017, 17, 286. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  35. Willcox, J.C.; Dobson, R.; Whittaker, R. Old-Fashioned Technology in the Era of “Bling”: Is There a Future for Text Messaging in Health Care? J. Med. Internet Res. 2019, 21, e16630. [Google Scholar] [CrossRef] [PubMed]
  36. Wei, J.; Hollin, I.; Kachnowski, S. A review of the use of mobile phone text messaging in clinical and healthy behaviour interventions. J. Telemed. Telecare 2011, 17, 41–48. [Google Scholar] [CrossRef] [PubMed]
  37. Senanayake, B.; Wickramasinghe, S.I.; Chatfield, M.D.; Hansen, J.; Edirippulige, S.; Smith, A.C. Effectiveness of text messaging interventions for the management of depression: A systematic review and meta-analysis. J. Telemed. Telecare 2019, 25, 513–523. [Google Scholar] [CrossRef] [PubMed]
  38. Cox, K.L.; Allida, S.M.; Hackett, M.L. Text messages to reduce depressive symptoms: Do they work and what makes them effective? A systematic review. Health Educ. J. 2021, 80, 253–271. [Google Scholar] [CrossRef]
  39. Agyapong, V.I.O.; Hrabok, M.; Vuong, W.; Shalaby, R.; Noble, J.M.; Gusnowski, A.; Mrklas, K.J.; Li, D.; Urichuk, L.; Snaterse, M.; et al. Changes in Stress, Anxiety, and Depression Levels of Subscribers to a Daily Supportive Text Message Program (Text4Hope) During the COVID-19 Pandemic: Cross-Sectional Survey Study. JMIR Ment. Health 2020, 7, e22423. [Google Scholar] [CrossRef]
  40. Agyapong, V.I.; Mrklas, K.; Juhás, M.; Omeje, J.; Ohinmaa, A.; Dursun, S.M.; Greenshaw, A.J. Cross-sectional survey evaluating Text4Mood: Mobile health program to reduce psychological treatment gap in mental healthcare in Alberta through daily supportive text messages. BMC Psychiatry 2016, 16, 378. [Google Scholar] [CrossRef] [Green Version]
  41. Harris, P.A.; Taylor, R.; Thielke, R.; Payne, J.; Gonzalez, N.; Conde, J.G. Research electronic data capture (REDCap)—A metadata-driven methodology and workflow process for providing translational research informatics support. J. Biomed. Inform. 2009, 42, 377–381. [Google Scholar] [CrossRef] [Green Version]
  42. Kroenke, K.; Spitzer, R.L.; Williams, J.B. The PHQ-9: Validity of a brief depression severity measure. J. Gen. Intern. Med. 2001, 16, 606–613. [Google Scholar] [CrossRef] [PubMed]
  43. Spitzer, R.L.; Kroenke, K.; Williams, J.B.W.; Löwe, B. A Brief Measure for Assessing Generalized Anxiety Disorder: The GAD-7. Arch. Intern. Med. 2006, 166, 1092–1097. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  44. Beard, C.; Björgvinsson, T. Beyond generalized anxiety disorder: Psychometric properties of the GAD-7 in a heterogeneous psychiatric sample. J. Anxiety Disord. 2014, 28, 547–552. [Google Scholar] [CrossRef] [PubMed]
  45. Owusu, E.; Shalaby, R.; Eboreime, E.; Nkire, N.; Lawal, M.A.; Agyapong, B.; Pazderka, H.; Obuobi-Donkor, G.; Adu, M.K.; Mao, W.; et al. Prevalence and Determinants of Generalized Anxiety Disorder Symptoms in Residents of Fort McMurray 12 Months Following the 2020 Flooding. Front. Psychiatry 2022, 13, 844907. [Google Scholar] [CrossRef] [PubMed]
  46. Smith, B.W.; Dalen, J.; Wiggins, K.; Tooley, E.; Christopher, P.; Bernard, J. The brief resilience scale: Assessing the ability to bounce back. Int. J. Behav. Med. 2008, 15, 194–200. [Google Scholar] [CrossRef] [PubMed]
  47. Weathers, F.W.; Litz, B.T.; Herman, D.S.; Huska, J.A.; Keane, T.M. The PTSD Checklist (PCL): Reliability, validity, and diagnostic utility. In Proceedings of the Annual Convention of the International Society for Traumatic Stress Studies, San Antonio, TX, USA, 24 October 1993. [Google Scholar]
  48. Mao, W.; Adu, M.; Eboreime, E.; Shalaby, R.; Nkire, N.; Agyapong, B.; Pazderka, H.; Obuobi-Donkor, G.; Owusu, E.; Oluwasina, F.; et al. Post-Traumatic Stress Disorder, Major Depressive Disorder, and Wildfires: A Fifth-Year Postdisaster Evaluation among Residents of Fort McMurray. Int. J. Environ. Res. Public Health 2022, 19, 9759. [Google Scholar] [CrossRef]
  49. Kohn, M.A.; Senyak, J. Sample Size Calculators 2021. Available online: https://sample-size.net/sample-size-study-paired-t-test/ (accessed on 21 February 2023).
  50. International Business Machines (IBM) Corp. Statistics for Windows; Version 26.0; IBM Corp: Armonk, NY, USA, 2019. [Google Scholar]
  51. Everitt, B.S.; Wessely, S. Clinical Trials in Psychiatry; John Wiley & Sons: Hoboken, NJ, USA, 2008. [Google Scholar]
  52. Chen, Y.S.; Chen, M.C.; Chou, F.H.; Sun, F.C.; Chen, P.C.; Tsai, K.Y.; Chao, S.S. The relationship between quality of life and posttraumatic stress disorder or major depression for firefighters in Kaohsiung, Taiwan. Qual. Life Res. 2007, 16, 1289–1297. [Google Scholar] [CrossRef]
  53. Bentley, M.A.; Crawford, J.M.; Wilkins, J.R.; Fernandez, A.R.; Studnek, J.R. An assessment of depression, anxiety, and stress among nationally certified EMS professionals. Prehosp. Emerg. Care 2013, 17, 330–338. [Google Scholar] [CrossRef]
  54. Tracie Shea, M.; Reddy, M.K.; Tyrka, A.R.; Sevin, E. Risk factors for post-deployment posttraumatic stress disorder in national guard/reserve service members. Psychiatry Res. 2013, 210, 1042–1048. [Google Scholar] [CrossRef]
  55. Courtney, J.A.; Francis, A.J.; Paxton, S.J. Caring for the country: Fatigue, sleep and mental health in Australian rural paramedic shiftworkers. J. Community Health 2013, 38, 178–186. [Google Scholar] [CrossRef]
  56. Meyer, E.C.; Zimering, R.; Daly, E.; Knight, J.; Kamholz, B.W.; Gulliver, S.B. Predictors of posttraumatic stress disorder and other psychological symptoms in trauma-exposed firefighters. Psychol. Serv. 2012, 9, 79–94. [Google Scholar] [CrossRef]
  57. Gradus, J.L. Epidemiology of PTSD; National Center for PTSD (United States Department of Veterans Affairs): White River Junction, VT, USA, 2007. [Google Scholar]
  58. McCall, H.C.; Landry, C.A.; Ogunade, A.; Carleton, R.N.; Hadjistavropoulos, H.D. Why Do Public Safety Personnel Seek Tailored Internet-Delivered Cognitive Behavioural Therapy? An Observational Study of Treatment-Seekers. Int. J. Environ. Res. Public Health 2021, 18, 11972. [Google Scholar] [CrossRef]
  59. Alden, L.; Matthews, L.; Wagner, S.; Fyfe, T.; Randall, C.; Regehr, C.; White, M.; Buys, N.; Carey, M.; Corneil, W. Systematic literature review of psychological interventions for first responders. Work Stress 2021, 35, 193–215. [Google Scholar] [CrossRef]
  60. Anderson, G.S.; Di Nota, P.M.; Groll, D.; Carleton, R.N. Peer Support and Crisis-Focused Psychological Interventions Designed to Mitigate Post-Traumatic Stress Injuries among Public Safety and Frontline Healthcare Personnel: A Systematic Review. Int. J. Environ. Res. Public Health 2020, 17, 7645. [Google Scholar] [CrossRef] [PubMed]
  61. Winders, W.T.; Bustamante, N.D.; Garbern, S.C.; Bills, C.; Coker, A.; Trehan, I.; Osei-Ampofo, M.; Levine, A.C. Establishing the Effectiveness of Interventions Provided to First Responders to Prevent and/or Treat Mental Health Effects of Response to a Disaster: A Systematic Review. Disaster Med. Public Health Prep. 2021, 15, 115–126. [Google Scholar] [CrossRef] [PubMed]
  62. Spek, V.; Cuijpers, P.; Nyklícek, I.; Riper, H.; Keyzer, J.; Pop, V. Internet-based cognitive behaviour therapy for symptoms of depression and anxiety: A meta-analysis. Psychol. Med. 2007, 37, 319–328. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  63. Ye, Y.Y.; Zhang, Y.F.; Chen, J.; Liu, J.; Li, X.J.; Liu, Y.Z.; Lang, Y.; Lin, L.; Yang, X.J.; Jiang, X.J. Internet-Based Cognitive Behavioral Therapy for Insomnia (ICBT-i) Improves Comorbid Anxiety and Depression-A Meta-Analysis of Randomized Controlled Trials. PLoS ONE 2015, 10, e0142258. [Google Scholar] [CrossRef]
  64. Rathbone, A.L.; Prescott, J. The Use of Mobile Apps and SMS Messaging as Physical and Mental Health Interventions: Systematic Review. J. Med. Internet Res. 2017, 19, e295. [Google Scholar] [CrossRef] [Green Version]
  65. Jones, C.; Miguel-Cruz, A.; Smith-MacDonald, L.; Cruikshank, E.; Baghoori, D.; Kaur Chohan, A.; Laidlaw, A.; White, A.; Cao, B.; Agyapong, V.; et al. Virtual Trauma-Focused Therapy for Military Members, Veterans, and Public Safety Personnel With Posttraumatic Stress Injury: Systematic Scoping Review. JMIR mHealth uHealth 2020, 8, e22079. [Google Scholar] [CrossRef]
  66. Agyapong, V.I.; Ahern, S.; McLoughlin, D.M.; Farren, C.K. Supportive text messaging for depression and comorbid alcohol use disorder: Single-blind randomised trial. J. Affect. Disord. 2012, 141, 168–176. [Google Scholar] [CrossRef] [PubMed]
  67. Agyapong, V.; Mrklas, K.; Juhas, M.; Omeje, J.; Ohinmaa, A.; Dursun, S.; Greenshaw, A. Mobile health program to reduce psychological treatment gap in mental healthcare in Alberta through daily supportive text messages–Cross-sectional survey evaluating Text4Mood. Eur. Psychiatry 2017, 41, S139. [Google Scholar] [CrossRef]
  68. Brabyn, S.; Araya, R.; Barkham, M.; Bower, P.; Cooper, C.; Duarte, A.; Kessler, D.; Knowles, S.; Lovell, K.; Littlewood, E.; et al. The second Randomised Evaluation of the Effectiveness, cost-effectiveness and Acceptability of Computerised Therapy (REEACT-2) trial: Does the provision of telephone support enhance the effectiveness of computer-delivered cognitive behaviour therapy? A randomised controlled trial. Health Technol. Assess. 2016, 20, 1–64. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  69. Hadjistavropoulos, H.D.; McCall, H.C.; Thiessen, D.L.; Huang, Z.; Carleton, R.N.; Dear, B.F.; Titov, N. Initial Outcomes of Transdiagnostic Internet-Delivered Cognitive Behavioral Therapy Tailored to Public Safety Personnel: Longitudinal Observational Study. J. Med. Internet Res. 2021, 23, e27610. [Google Scholar] [CrossRef]
  70. Association, A.P. Building Your Resilience. What Is Resilience? 2012. Available online: https://www.apa.org/topics/resilience (accessed on 3 September 2021).
  71. Wu, Y.; Sang, Z.Q.; Zhang, X.C.; Margraf, J. The Relationship Between Resilience and Mental Health in Chinese College Students: A Longitudinal Cross-Lagged Analysis. Front. Psychol. 2020, 11, 108. [Google Scholar] [CrossRef]
  72. Sijbrandij, M.; Kunovski, I.; Cuijpers, P. Effectiveness of internet-delivered cognitive behavioral therapy for posttraumatic stress disorder: A systematic review and meta-analysis. Depress. Anxiety 2016, 33, 783–791. [Google Scholar] [CrossRef] [Green Version]
  73. Noble, J.M.; Vuong, W.; Surood, S.; Urichuk, L.; Greenshaw, A.J.; Agyapong, V.I.O. Text4Support Mobile-Based Programming for Individuals Accessing Addictions and Mental Health Services-Retroactive Program Analysis at Baseline, 12 Weeks, and 6 Months. Front. Psychiatry 2021, 12, 640795. [Google Scholar] [CrossRef]
  74. Prensky, M. Digital natives, digital immigrants part 2: Do they really think differently? Horizon 2001, 9, 1–6. [Google Scholar] [CrossRef]
  75. Dingli, A.; Seychell, D. The New Digital Natives. In Cutting the Chord; Springer: Berlin/Heidelberg, Germany, 2015. [Google Scholar]
  76. Bendtsen, M.; Bendtsen, P. Feasibility and user perception of a fully automated push-based multiple-session alcohol intervention for university students: Randomized controlled trial. JMIR mHealth uHealth 2014, 2, e30. [Google Scholar] [CrossRef]
  77. Daikeler, J.; Bošnjak, M.; Lozar Manfreda, K. Web versus other survey modes: An updated and extended meta-analysis comparing response rates. J. Surv. Stat. Methodol. 2020, 8, 513–539. [Google Scholar] [CrossRef]
  78. Abdelazeem, B.; Abbas, K.S.; Amin, M.A.; El-Shahat, N.A.; Malik, B.; Kalantary, A.; Eltobgy, M. The effectiveness of incentives for research participation: A systematic review and meta-analysis of randomized controlled trials. PLoS ONE 2022, 17, e0267534. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Study flow chart.
Figure 1. Study flow chart.
Ijerph 20 04215 g001
Table 1. Distribution of demographic characteristics of all the study participants among the participants who responded to baseline and at least one more survey (sample A) and the participants who responded to only one survey (sample B).
Table 1. Distribution of demographic characteristics of all the study participants among the participants who responded to baseline and at least one more survey (sample A) and the participants who responded to only one survey (sample B).
Variable Sample A
N = 18 (%)
Sample B
N = 69 (%)
Total a
N (%)
Chi-Squared /Fisher’s Exact bp Value
Public Safety Personnel
Emergency department health workers4 (22.2)4 (6.7)8 (10.3)6.97 b0.11
Paramedics4 (22.2)11 (18.3)15 (19.2)
Firefighters0 (0.0)2 (3.3)2 (2.6)
Police/Law enforcement agents8 (44.4)21 (35.0)29 (37.2)
Other2 (11.1)22 (36.7)24 (30.8)
Age
≤30 y5 (29.4)9 (14.3)14 (17.5)2.600.46
31–45 y6 (35.3)25 (39.7)31 (38.8)
46–60 y5 (29.4)20 (31.7)25 (31.3)
>60 y1 (5.9)9 (14.3)10 (12.5)
Gender
Female12 (66.7)35 (55.6)47 (58.0)0.80 b0.72
Male 6 (33.3)25 (39.7)31 (38.3)
Other 0 (0.0)3 (4.8)3 (3.7)
Ethnicity
White12 (70.6)51 (79.7)63 (77.8)7.79 b0.07
Indigenous 0 (0.0)4 (6.3)4 (4.9)
Asian1 (5.9)7 (10.9)8 (9.9)
African descent 1 (5.9)1 (1.6)2 (2.5)
Other 3 (17.6)1 (1.6)4 (4.9)
Education Level
High school diploma2 (11.8)10 (15.6)12 (14.8)0.57 b0.99
Postsecondary education15 (88.2)53 (82.8)68 (84.0)
Other 0 (0.0)1 (1.6)1 (1.2)
Employment Status
Employed 15 (88.2)56 (87.5)71 (87.7)0.010.94
Unemployed 2 (11.8)8 (12.5)10 (12.3)
Relationship Status
In a relationship11 (64.7)47 (74.6)58 (72.5)6.32 b0.08
Single 3 (17.6)14 (22.2)17 (21.3)
Separated or divorced1 (5.9)2 (3.2)3 (3.8)
Widowed 2 (11.8)0 (0.0)2 (2.5)
Housing Status
Own a home 12 (70.6)45 (70.3)57 (70.4)0.580.82
Renting 3 (17.6)14 (21.9)17 (21.0)
Living with family 2 (11.8)5 (7.8)7 (8.6)
a Total number represents the completed responses. b Fisher’s exact test.
Table 2. Distribution of prevalence of mental health conditions.
Table 2. Distribution of prevalence of mental health conditions.
A. Distribution of baseline prevalence of mental health conditions between participants who completed only the baseline survey and participants who completed the baseline and any follow-up survey (sample A)
Variables, n (%)Baseline and Follow-Up
N (%)
Baseline Only
N (%)
Total
N (%)
Chi-Squarep-Value
Likely MDD aN = 17N = 11N = 280.150.70
At most mild depression9 (52.9)5 (45.5)14 (50.0)
Moderate to severe depression8 (47.1)6 (54.5)14 (50.0)
Likely GAD bN = 16N = 11N = 270.170.68
At most mild GAD10 (62.5)6 (54.5)16 (59.3)
Moderate to severe GAD6 (37.5)5 (45.5)11 (40.7)
Low resilience cN = 18 N = 11N = 293.160.08
Normal to high resilience 14 (77.8)5 (45.5)19 (65.5)
Low resilience4 (22.2)6 (54.5)10 (34.5)
Likely PTSD dN = 15N = 10N = 25*0.03
Unlikely PTSD13 (86.7)4 (40.0)17 (68.0)
Likely PTSD2 (13.3)6 (60.0)8 (32.0)
B. Distribution of follow-up prevalence of mental health conditions between participants who completed only follow-up and participants who completed the baseline and any follow-up survey (sample A)
Variables, n (%) **Baseline and Follow-Up, N = 18 (%)Follow-Up Only,
N = 56 (%)
Total
N = 74 (%)
Chi-Squarep-Value
Likely MDD aN = 17N = 54 N = 712.970.09
At most mild depression15 (88.2)36 (66.7)51 (71.8)
Moderate to severe depression2 (11.8)18 (33.3)20 (28.2)
Likely GAD bN = 16N = 53N = 690.580.45
At most mild GAD13 (81.3)38 (71.7)51 (73.9)
Moderate to severe GAD3 (18.8)15 (28.3)18 (26.1)
Low resilience cN = 18N = 56N = 741.420.23
Normal to high resilience 14 (77.8)35 (62.5)49 (66.2)
Low resilience4 (22.2)21 (37.5)25 (33.8)
Likely PTSD dN = 16N = 51N = 670.390.53
Unlikely PTSD12 (75.0)34 (66.7)46 (68.7)
Likely PTSD4 (25.0)17 (33.3)21 (31.3)
* Fisher’s exact test was applied. ** Total numbers represent competed responses. a A cutoff score of ≥10 on the Patient Health Questionnaire-9 scale. b A cutoff score of ≥10 on the Generalized Anxiety Disorder-7 scale. c An average score < 3 on the Brief Resilience Scale. d A cutoff score of ≥44 on the PTSD Checklist-Civilian Version.
Table 3. Change in prevalence of likely GAD, and likely MDD, low resilience, and likely PTSD from baseline to follow-up.
Table 3. Change in prevalence of likely GAD, and likely MDD, low resilience, and likely PTSD from baseline to follow-up.
Clinical Condition Prevalence n (%)Change from Baseline, %X2 (df)p Value
N BaselineFollow-Up
Likely MDD a178 (47.1)2 (11.8)−35.32.55 (1)0.03
Likely GAD b166 (37.5)3 (18.8)−18.76.15 (1)0.25
Low resilience c184 (22.2)4 (22.2)018.0 (1)0.99
Likely PTSD d152 (13.3)1 (6.7)−6.61.29 (1)0.99
a A cutoff score of ≥10 on the Patient Health Questionnaire-9 scale. b A cutoff score of ≥10 on the Generalized Anxiety Disorder-7 scale. c An average score < 3 on the Brief Resilience Scale. d A cutoff score of ≥44 on the PTSD Checklist-Civilian Version.
Table 4. Changes in the mean scores of PHQ-9 and GAD-7 after the introduction of Text4PTSI.
Table 4. Changes in the mean scores of PHQ-9 and GAD-7 after the introduction of Text4PTSI.
MeasureScoresChange from Baseline, %Mean Difference (95% CI)p Valuet Value (df)Effect Size (Cohen’s d)
nBaseline Score, Mean (SD)Follow-Up, Mean (SD)
PHQ-9 a178.41 (5.46)6.24 (4.98)25.8−2.17 (−0.45–4.81)0.0981.76 (16)0.42
GAD-7 b168.38 (5.83)6.31 (5.11)24.7−2.07 (−0.45–3.67)0.022.73 (15)0.38
BRS c183.29 (0.85)3.28 (0.72)0.3−0.01 (−0.25–0.27)0.940.08 (17)0.01
PCL-C d1532.13 (11.69)29.07 (10.56)9.5−3.07 (−2.76–8.89)0.281.13 (14)0.28
a PHQ-9: Patient Health Questionnaire-9. b GAD-7: Generalized Anxiety Disorder-7. c BRS: Brief Resilience Scale; d PCL-C: PTSD Checklist-Civilian Version.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Obuobi-Donkor, G.; Shalaby, R.; Eboreime, E.; Agyapong, B.; Phung, N.; Eyben, S.; Wells, K.; Hilario, C.; Dias, R.d.L.; Jones, C.; et al. Text4PTSI: A Promising Supportive Text Messaging Program to Mitigate Psychological Symptoms in Public Safety Personnel. Int. J. Environ. Res. Public Health 2023, 20, 4215. https://doi.org/10.3390/ijerph20054215

AMA Style

Obuobi-Donkor G, Shalaby R, Eboreime E, Agyapong B, Phung N, Eyben S, Wells K, Hilario C, Dias RdL, Jones C, et al. Text4PTSI: A Promising Supportive Text Messaging Program to Mitigate Psychological Symptoms in Public Safety Personnel. International Journal of Environmental Research and Public Health. 2023; 20(5):4215. https://doi.org/10.3390/ijerph20054215

Chicago/Turabian Style

Obuobi-Donkor, Gloria, Reham Shalaby, Ejemai Eboreime, Belinda Agyapong, Natalie Phung, Scarlett Eyben, Kristopher Wells, Carla Hilario, Raquel da Luz Dias, Chelsea Jones, and et al. 2023. "Text4PTSI: A Promising Supportive Text Messaging Program to Mitigate Psychological Symptoms in Public Safety Personnel" International Journal of Environmental Research and Public Health 20, no. 5: 4215. https://doi.org/10.3390/ijerph20054215

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop