Next Article in Journal
Toward Innovation in Healthcare: An Analysis of the Digital Behavior of Older People in Europe and Japan for the Introduction of a Technological Coaching System
Previous Article in Journal
Stakeholders’ Voices of Lung Cancer Screening in Hong Kong: Study Protocol for a Mixed Methods Study
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Digital Care Program for Urinary Incontinence in Females: A Large-Scale, Prospective, Cohort Study

1
Clinical Research, Sword Health Inc., Draper, UT 84020, USA
2
Institute for Cognitive Science, University of Colorado, Boulder, CO 80309, USA
3
Bloom, Sword Health Inc., Draper, UT 84020, USA
4
Department of Surgery, Frank H. Netter School of Medicine, Quinnipiac University, Hamden, CT 06473, USA
5
Department of Neurosurgery, Hartford Healthcare Medical Group, Westport, CT 06103, USA
6
Neurology Department, Centro Hospitalar e Universitário do Porto, 4099-001 Porto, Portugal
*
Author to whom correspondence should be addressed.
Healthcare 2024, 12(2), 141; https://doi.org/10.3390/healthcare12020141
Submission received: 1 December 2023 / Revised: 21 December 2023 / Accepted: 23 December 2023 / Published: 8 January 2024
(This article belongs to the Section TeleHealth and Digital Healthcare)

Abstract

:
Female urinary incontinence (UI) is highly prevalent in the US (>60%). Pelvic floor muscle training (PFMT) represents first-line care for UI; however, access and adherence challenges urge new care delivery models. This prospective cohort study investigates the feasibility and safety of a remote digital care program (DCP) combining education and PFMT with real-time biofeedback with an average duration of 10 weeks. The primary outcome was the change in the Urinary Impact Questionnaire—short form (UIQ-7) from baseline to program-end, calculated through latent growth curve analysis (LGCA). Secondary outcomes included the impact of pelvic conditions (PFIQ-7), depression (PHQ-9), anxiety (GAD-7), productivity impairment (WPAI), intention to seek additional healthcare, engagement, and satisfaction. Of the 326 participants who started the program, 264 (81.0%) completed the intervention. Significant improvement on UIQ-7 (8.8, 95%CI 4.7; 12.9, p < 0.001) was observed, corresponding to a response rate of 57.3%, together with improvements in all other outcomes and high satisfaction (8.9/10, SD 1.8). This study shows the feasibility and safety of a completely remote DCP with biofeedback managed asynchronously by a physical therapist to reduce UI-related symptoms in a real-world setting. Together, these findings may advocate for the exploration of this care delivery option to escalate access to proper and timely UI care.

1. Introduction

Urinary incontinence (UI) is experienced by more than 60% of women in the United States (US), with increasing prevalence and symptom severity per each decade of life [1]. UI impacts all aspects of patients’ daily lives—from mental health to sexuality to social and work life [2]. Productivity is extensively affected, frequently demanding job changes or leading to job resignations [3]. The socioeconomic impact of UI is undeniable, with annual overall costs in 2007 reaching USD 65.9 billion for overactive bladder with UI alone [4].
Pelvic floor muscle training (PFMT) represents first-line care for UI [5,6], being widely established as a treatment for stress UI and mixed UI and less studied for urgency UI [7]. Clinical guidelines recommend PFMT combined with education and lifestyle modification advice [5,6]. Despite these recommendations, access to PFMT is blocked by multiple healthcare and individual barriers [8,9,10,11]. Challenges in surpassing geographical and time constraints to access healthcare facilities are aggravated by the scarcity of trained healthcare providers to adequately supervise and guide PFMT [11]. Moreover, unsupervised home therapy has been frequently reported as an ineffective solution due to low adherence levels and poor knowledge about proper technique, frequency, and duration of training [12,13]. Adding to the aforementioned barriers, the growing prevalence of UI and the taboo, embarrassment, and stigma surrounding these conditions have increased the number of patients without proper and timely treatment [8].
Different digital care delivery strategies have been explored to improve access to and adherence to treatment [14]. Findings from several systematic reviews suggest the benefit of digital interventions in improving UI symptoms [14,15,16,17].
Initial mobile apps for UI were designed to provide instructions to patients through digital, dynamic representations. However, they lacked biofeedback features or healthcare professional involvement [18,19]. The introduction of urotherapists for remote support was attempted by Sjöström et al. [20]. More recently, the incorporation of biofeedback has been reported to promote greater PFMT self-efficacy [21], as well as better adherence and PFMT outcomes [22,23,24,25]. The increasing prevalence of patients reporting UI warrants further exploration of new delivery solutions.
Herein, we report about a completely remote pelvic digital care program (DCP)—the Bloom program—combining education with PFMT using real-time biofeedback—asynchronously managed by a physical therapist. This study aims to explore the feasibility and safety of such a program while comprehensively evaluating the potential of this pelvic DCP in reducing the impact of urinary symptoms on daily living. As a secondary aim, we will evaluate the impact in terms of mental health, work productivity, and the intent to seek additional healthcare. We hypothesized that participants would report improvement in all outcomes after the program.

2. Materials and Methods

2.1. Study Design

This is a decentralized, prospective single-arm observational cohort study, which was approved by the Advarra Institutional Review Board (Pro00064510) and registered on ClinicalTrials.gov (NCT05513417) on 24 August 2022. The recruitment period was from 9 August 2022 until 18 January 2023, and the home-based DCP was conducted between 27 August 2022 and 22 May 2023.

2.2. Participants

Females (>18 years old) who are beneficiaries of employers or health plans covered by the Bloom program from 45 states in the US and the District of Columbia were invited to apply to the study through a dedicated website. Those with self-reporting UI, defined as the complaint of any involuntary loss of urine according to the International Consultation on Incontinence (ICI) [5], were considered. Patients that did not have a previous diagnosis were characterized on the specific UI (i.e., stress, urgency, and mixed) according to the trigger of the leakage: stress when on effort or exertion, on sneezing, or coughing; urgency when accompanied by or immediately preceded by urgency; mixed for the coexistence of both types [5].
Exclusion criteria comprised: (1) inability to perform 20 min of light–moderate exercise; (2) active cancer or under treatment for cancer; (3) surgery, significant trauma, or other conditions where mobilization is contra-indicated; (4) uncleared clinical red flags suggestive of serious underlying conditions; (5) signs of acute, serious neurologic compromise; (6) pelvic infection or suspicion of inflammatory bowel disease; (7) complicated or high-risk pregnancy; (8) contra-indication for vaginal penetration; (9) clinical conditions (e.g., dementia) precluding compliance with autonomous home-based exercise; (10) silicone allergy. When considering an exclusion, the individual presentation and medical clearance (if applicable) were critical to the physical therapist’s eligibility decision.
Informed consent was obtained from all participants. To be considered in the study, the participant had to complete at least three sessions. Participants were considered dropouts in the absence of exercise sessions for 30 consecutive days. Those who did not complete reassessment surveys but were compliant with the intervention were included.

2.3. Intervention

The intervention consisted of biofeedback-mediated pelvic floor muscle training (PFMT), functional exercises, and education with an average duration of 10 weeks (Supplementary Table S1).
After enrollment, each participant filled out an onboarding form with demographic and clinical questions (see outcomes below) and chose a physical therapist specializing in pelvic health (PT) responsible for managing and continuously tailoring the intervention. The initial clinical assessment was performed by the PT during the onboarding video call, leveraging the information provided by the patient upon enrollment and the clinical presentation (e.g., the presence of comorbid pelvic floor conditions). Intervention goals were established collaboratively between the PT and the patient. An FDA-listed medical device composed of an intravaginal sensor, a dedicated mobile app (to be downloaded to the patient’s smartphone), and a cloud-based platform was used for remote care (Figure 1). A kit containing the sensor and water-based lubricant was sent to each patient. The intravaginal sensor includes a force transducer to measure PFM activity (both contraction and relaxation) and an accelerometer to measure PFM motion, where a cranial lift was identified during contraction and a caudal descent during relaxation, providing real-time biofeedback to participants. These sensors, located in the pebble-shaped section of the device, connect with the mobile app wirelessly using Bluetooth, located in the tail of the device, which remains outside the patient’s body.
Patients were first educated on the UI condition by the assigned PT during an onboarding video call about PFMT appropriateness, treatment goals, diaphragmatic breathing training (to be performed during exercise sessions), behavioral modifications, how to insert, use, and sanitize the intravaginal sensor, and how to perform the contraction and relaxation of the PFM.
Gamified exercise sessions, along with written instructions, were displayed in the app. The intravaginal sensor provided real-time biofeedback according to the specific contraction and relaxation target defined on the prescription (as a default, three sessions per week were recommended; further details on exercise parameters are in Supplementary Table S1).
Education was delivered through the mobile app throughout the program in the form of written articles following clinical guidelines and research [6] and accompanied by the dedicated PT.
The cloud-based portal stored data on each education content interaction and sensor-related exercise session performance, enabling continuous asynchronous monitoring and tailoring protocol progress by the PT.

2.4. Outcomes

Participants completed assessment surveys at baseline, session 9, and session 15. The primary outcome was the change in the Urinary Impact Questionnaire—short form (UIQ-7) from baseline to treatment end. UIQ-7 assesses the impact of urinary-related symptoms in activities of daily living (scored 0–100%, with higher scores indicating worse symptoms) [26], and its use is recommended by ICI [27]. UIQ-7 responsiveness was previously validated [28]. Secondary outcomes included engagement, satisfaction, and the validated questionnaires: Pelvic Floor Impact Questionnaire—short form 7 (PFIQ-7) [26] to assess the impact of bladder, bowel, or vaginal symptoms in daily activities; Work Productivity and Activity Impairment (WPAI) for general health [29]; Generalized Anxiety Disorder 7-item scale (GAD-7) [30]; Patient Health 9-item Questionnaire (PHQ-9) [31] and the question, “How likely are you to seek additional healthcare interventions for this condition?” (0—not at all likely to 10—extremely likely), as depicted in Table 1.

2.5. Safety and Adverse Events

Regular and on-demand communication between participants and PT was established through video calls and text messages (built-in secure chat in the mobile app) to provide support and feedback, enhance motivation, and ensure safety. Participants were instructed to report any adverse event by any channel to the dedicated PT. Self-reported symptom and fatigue levels (scores 0–10) were registered following each exercise session and continuously monitored by the PT.

2.6. Data Availability

All relevant data are included in the article or available as Supplementary Material Data. De-identified data and analysis codes may be provided upon reasonable request to the corresponding author.

2.7. Sample Size

A sample size calculation was performed to detect a small effect size of 0.2 [32] of the mean change in UIQ-7 from baseline to treatment end, considering a mean difference between two dependent means. Assuming an 80% power to detect this change and a two-sided 0.05 significance level, a total of 199 participants were estimated. Allowing for an attrition rate of 20% owing to the uncertainty introduced by the real-world context, a number of participants above 250 were targeted.

2.8. Statistical Analysis

Demographic and clinical data and engagement metrics were reported through descriptive statistics, with continuous variables described as mean (standard deviation) and categorical variables as frequencies (percentage). Baseline differences between completers and non-completers (i.e., those who dropped out or were excluded after the program started) were assessed through chi-squared tests for categorical variables and independent sample t-tests or one-way ANOVA for continuous variables. Baseline correlations were evaluated using the Pearson correlation.
A response bias analysis was conducted, confirming that the missing data were at random. This was performed by assessing whether no response to reassessments was related to baseline characteristics (including demographics and baseline clinical scores). Considering time as an important factor in the analysis, reassessment data were binned according to the respective time frame in which the reassessment was completed (i.e., 5 and 10 weeks).
Latent growth curve analysis (LGCA), based on a structural equation model, was applied to assess the longitudinal trajectory of clinical outcomes, considering time as a continuous variable. LGCA provides an estimate of the average trajectory and individual variation based on each individual data. This methodology has several benefits, including providing model fit measures and handling missing data through full information maximum likelihood (FIML). FIML uses all available data from all participants independently of missing a specific time point, outperforming other missing data handling methods [33]. A conditional analysis was conducted to assess the influence of age, body mass index (BMI) (continuous variables), and parity (discrete variable) as covariates, fitted as random effects to allow each to vary between individuals. All models were estimated with a robust sandwich estimator for standard errors.
To estimate the response rate to UIQ, the minimal clinically important change (MCIC) of 17 points reported for the UIQ long-form [34] was applied to overcome the lack of UIQ-7 MCIC for non-post-surgical conditions. To that end, UIQ-7 scores were converted to UIQ long-form scores as previously [24,35], followed by a binary logistic regression. Binary logistic regression was also used to estimate the response rate for PHQ-9, GAD-7, and WPAI overall, considering an MCIC of 3.8 [36], 5 [37], and 7 [38], respectively.
All analyses followed an intention-to-treat approach (considering all participants at the program start), and significance levels were set at p < 0.05. LGCA was coded through R (version 1.4.1717), and all other analyses were conducted through SPSS (version 17.0, SPSS Inc., Chicago, IL, USA).

3. Results

3.1. Participants

From the 424 participants screened for eligibility, 98 declined participation (Figure 2). The program started with 326 participants, of whom 264 completed it, for a completion rate of 81.0%.

3.2. Baseline Characteristics

Participant demographics are described in Table 2. The cohort had an average age of 44.8 years (SD 9.1), an average BMI of 29.7 (SD 7.0), a high proportion of participants with obesity (39.3%), and of parous participants (92%), and was diverse, with 21.7% of members from minority races/ethnicities. Most participants had higher education (65.9%) and were full-time employees (84.4%). Additionally, a majority of participants reported urinary symptoms persisting for >6 months (85.6%) and stress UI specifically (73.3%, 239/326). Comparing completers and non-completers (Supplementary Table S2), no significant differences were observed except for average age and BMI, where completers were older (45.3, SD 9.1 vs. 42.7, SD 9.1, p = 0.041), had lower BMI levels (29.2, SD 6.7 vs. 31.7, SD 7.9, p = 0.009), and had lower PHQ-9 scores among those with at least mild depression at baseline (10.0, SD 4.4 vs. 12.8, SD 5.7, p = 0.027).

3.3. Clinical Outcomes

The intention-to-treat approach model estimates and respective model fit are provided in Supplementary Table S3, while the effect of covariates on outcome estimates is presented in Supplementary Table S4.

3.3.1. Primary Outcome

At baseline, the mean score on the impact of bladder-related symptoms (UIQ-7) was 33.6 points (95%CI 30.9; 36.2), which improved significantly at the intervention end (mean change: 8.8, 95%CI 4.7; 12.9, p < 0.001; Table 3). The response rate to treatment was 57.3% (95%CI 54.8; 59.7) (p < 0.001), according to the MCIC reported by Barber et al. [34].
Older participants reported worse UIQ-7 scores at baseline, with an increase of 0.5 points (95%CI 0.2; 0.9) per extra year above the mean cohort age (p = 0.001). BMI and parity did not significantly influence baseline scores, and no covariate impacted the recovery trajectory (Supplementary Table S4).

3.3.2. Secondary Outcomes

The impact of overall pelvic floor symptoms (including bladder, bowel, or vaginal symptoms) on daily activities was reduced by treatment end (PFIQ-7: 17.9, 95%CI 5.9; 29.9; Table 3). Older participants reported a higher impact at baseline but recovered similarly to their younger counterparts (Supplementary Table S4). Neither BMI nor parity significantly influenced baseline or recovery trajectories (Supplementary Table S4).
Regarding mental health, 42% of participants (137/326) reported relevant anxiety symptoms [30] (GAD-7 ≥ 5: 9.0, 95%CI 8.3; 9.7), while 26.4% of participants (86/326) reported depression scores above the threshold [31] (PHQ-9 ≥ 5: 10.6, 95%CI 9.6; 11.6) at baseline. A significant correlation was observed between higher baseline anxiety or depression and higher UIQ-7 (correlation coefficient r(326) = 0.241 and 0.233, respectively; both p < 0.001). Significant reduction in mental symptoms was reported by those participants at program-end, with 59.7% (95%CI 55.6; 63.7, p < 0.001) reaching the MCIC for anxiety (GAD-7) [36] and 57.1% (95%CI 52.2; 61.9, p = 0.01) reaching the MCIC for depression (PHQ-9) [37]. None of the covariates influenced recovery trajectories (Supplementary Table S4).
Among all employed participants, 41.7% (113/271) reported impairment in overall productivity, of whom only 24 experienced absenteeism (8.9% of the total employed population). Overall, productivity losses were significantly reduced at the program end, with 64.2% (95%CI 60.0; 68.3; p = 0.01) of participants reaching the MCIC for overall productivity impairment (WPAI overall) [38]. Productivity recovery was not influenced by age, BMI, or parity (Supplementary Table S4).
A total of 84% of participants (n = 274/326) reported intention to seek additional healthcare to address their condition at baseline, which was reduced by 55.9% from 4.9/10 (95%CI 4.5; 5.2) to 2.1 (95%CI 1.5; 2.8) at study end (p < 0.001). Older participants reported greater intent to seek additional healthcare at baseline, at a mean of 0.04 extra points (95%CI 0.0; 0.1) per extra year above the cohort mean age (p = 0.024), but reported a reduction in their intent similar to younger counterparts (Supplementary Table S4). No other covariate influenced the recovery trajectory (Supplementary Table S4).

3.4. Adverse Events

Across the intervention, no serious adverse events were reported. Adverse events potentially related to the intervention (e.g., pelvic pain and pressure, urinary infection, ache, and cramping, etc.) were reported by 2.1% (7/326) of the cohort, while adverse events non-related to the intervention (e.g., unrelated sickness) were reported by 2.8% (9/326) (Supplementary Table S5).

3.5. Engagement Outcomes

Treatment ran over an average of 10.3 (SD 5.0) weeks, with participants doing an average of 18.0 (SD 11.4) pod-associated sessions. The majority of participants engaged with the educational content (95.7%, 312/326) by reading, on average, 21.0 (SD 12.9) educational articles. Bi-directional communication was high across the program, with an average of 38.8 (SD 36.1) mean total number of touchpoints. Participants reported high satisfaction with the program (8.9/10, SD 1.8).

4. Discussion

4.1. Main Findings

This study provides real-world evidence to support the feasibility and safety of this pelvic DCP to provide care to participants with UI. Significant improvement was observed in the impact of stress, urgency, and mixed UI on the participants’ daily living (UIQ-7), with an overall response rate of 57.3% (95%CI 54.8–59.7). This improvement was accompanied by a reduction in the impact of other pelvic conditions (PFIQ-7 reduction: 17.9, 95%CI 5.9; 29.9). Alongside the pelvic health improvement, mental health distress was significantly reduced, with 59.7% and 57.1% of responders (i.e., reaching MCID) for anxiety and depression, respectively. Additional benefits were observed in the productivity domain, where 64.2% (95%CI 60.0; 68.3) attained significant recovery after the intervention. The success of this pelvic DCP was further reinforced by the 55.9% reduction in the intention to seek additional healthcare services as well as high satisfaction levels (8.9/10, SD 1.8).

4.2. Comparison with the Literature

The intervention attained a very high completion rate (81.0%), higher than those reported in previous in-person [39] and digital studies [19,22] and within the range of another digital study [20].
This study cohort had a mean age of 44.8, similar to the reported by previous digital studies [18], and younger than the reported for other UI studies [19,23,24]. The distribution of the UI types followed the description for the US population [1,40], although with a larger concentration of stress UI (73.3%, 239/326), possibly associated with the younger portion of the study cohort (37.1%) [41]. Significant risk factors associated with UI development were reported by this study cohort at baseline: older age (62.9% of participants above 40 years), higher BMI (39.3% obese or morbidly obese), being parous (92%), and reporting the condition for more than 6 months (85.6%) [9,41]. Non-completers were younger and had higher BMI levels than those completing the program, which is consistent with previous observations [19,23]. The assessment of adherence to PFMT interventions is not standardized across the literature, nor are the frequency and length of such interventions for UI, which results in high heterogeneity between reports, hampering direct comparisons [21,22,23]. Herein, we report an average of 18.0 (SD 11.4) pod-associated sessions during 10.3 (SD 5.0) weeks, which, although slightly below the default recommendation, is on par with that reported by other digital interventions [23]. Nevertheless, this observation seemed to not compromise clinical improvements, in line with previously reported nonlinearity between outcome improvement and adherence [25]. In fact, Keyser et al. [23] have suggested that fewer exercise sessions engagement might provide adequate neuromuscular re-education to positively affect functional PFM performance. Moreover, very high adherence to the educational component (articles read: 21.0, SD 12.9) was observed herein. High engagement with education is critical, considering the empowering effect on patient self-management and the lack of pelvic health literacy within the general population [10].
At baseline, the impact of the condition on activities of daily living (UIQ-7) was 33.6/100 points (95%CI 30.9; 36.2). By the end of the intervention, the mean improvement was 8.8 points (95%CI 4.7; 12.9) (p < 0.001), with a response rate of 57.3% (95%CI 54.8; 59.7) (p < 0.001). These improvements are within the range of those observed in previous studies [20,23,42], with a similar response rate to the reported in-person [21] and digital intervention studies [23]. Older participants reported worse baseline scores, which is consistent with previous reports [43]. Interestingly, despite being frequently associated with a poorer prognosis, neither age, BMI, nor parity significantly influenced UIQ-7 reduction. A similar trend was observed with the concomitant recovery on the impact of overall pelvic floor symptoms (including bladder, bowel, or vaginal symptoms) on daily activities (mean change: 17.9, 95%CI 5.9; 29.9), where older participants reported a worse baseline, but recovery trends were not influenced by any covariates. These findings are in line with a previous trial that compared telerehabilitation with usual care [19].
Importantly, the adverse event rate was very low across the intervention, and all the reported events were minor. The nature of the reported adverse events and the incidence rates were similar to the previously reported in-person pelvic rehabilitation [7,21] and lower compared to other digital interventions [23]. This result suggests the safety of our intervention, a crucial aspect to ensure, particularly in remote rehabilitation settings as described herein.
Improvements in pelvic health might have supported the recovery reported within the mental health domain. It is known that mental distress can impact the odds of UI recovery [44], despite most studies focusing solely on urinary-related outcomes [7]. Herein, 42% and 26% of participants reported at baseline relevant anxiety and depression symptoms [31], respectively. These followed the trend reported by Felde et al., who reported a two-fold increased risk of depression or anxiety among patients with mixed urinary incontinence [45]. Importantly, despite the correlation between mental distress and worse UIQ-7 scores at baseline (p < 0.001), 59.7% of patients (95%CI 55.6; 63.7, p < 0.001) reached the MCIC for anxiety (GAD-7) [36] and 57.1% of patients (95%CI 52.2; 61.9, p = 0.01) reached the MCIC for depression (PHQ-9) [37]. These reductions were observed regardless of age, BMI, or parity.
Work productivity impairment is frequently associated with UI conditions, translated more frequently into presenteeism than absenteeism [46], in some cases demanding a complete revamp of patients’ professional lives to best cope with the limitations imposed by the condition [2]. Herein, this same trend was observed at baseline, with 42% of the cohort reporting presenteeism. Significant improvements were observed in overall productivity impairment with 64.2% (95%CI 60.0; 68.3; p = 0.01) of patients responding to the intervention considering an MCIC of 7 [38,46], suggesting a positive impact on productivity and associated financial burden.
All the aforementioned outcomes explain the significant reduction in the intent to seek additional healthcare (55.9%), which, alongside the high satisfaction levels (8.9/10, SD 1.8), reinforces the potential of this DCP as a viable care delivery option to provide timely access to care, mitigating the shortages of healthcare providers, while empowering patients with urinary conditions to improve their pelvic health and overall quality of life.

4.3. Strengths and Limitations

The major strength of this study is the novelty of the approach—a completely remote, multimodal DCP combining PFMT with real-time biofeedback and condition-specific education based on a biopsychosocial framework. Biofeedback data and PT management (including on-demand communication) fostered individualized care and safety. While it is conceivable for individuals to perform a PFMT program independently, the involvement of a qualified health professional is a major strength for continuous correct training, providing clinical assessment, ongoing monitoring, and the delivery of personalized, evidence-based programs. The expertise of PTs is crucial to navigating the intricacies of the diverse clinical presentations and individual needs, addressing not only the symptoms but also the underlying factors contributing to the condition through effective interventions, as previously reported [7,47]. The inclusion of diverse UI types enhances generalizability since most studies focus solely on stress UI [18,20,22]. Other strengths encompass the large sample size, multiple domain outcomes, and objective measures to assess engagement (instead of self-registration [20]). Limitations include (a) study design, which is observational and lacks a control group; (b) lack of physical examination, which, although recommended by guidelines, might not be attained in an in-person context but can be facultative as per COVID pandemic lessons [48]; and (c) lack of objective measures of PFM function at baseline and follow-up. Considering the real-world context of the study, (d) we cannot rule out the possibility that medications (e.g., anticholinergics, hormonal therapies) or pessaries might have been used by some patients and influenced outcomes. Future studies should assess the long-term maintenance of the observed improvements. Nevertheless, we believe this study adds to the body of evidence with insights into the feasibility, safety, and outcomes of digital intervention in UI management. This knowledge advocates for the further planning and conduct of future randomized controlled trials.

5. Conclusions

This study shows the feasibility and safety of a completely remote DCP with biofeedback managed asynchronously by a physical therapist to reduce UI-related symptoms in a real-world setting. Significant improvements were observed in the UI burden across all outcome domains (daily activities, mental health, productivity impairment, and intention to seek additional care). Together, these findings advocate for the exploration of this care delivery option to escalate access to proper and timely UI care, empowering patients with urinary conditions to improve their pelvic health and overall quality of life.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/healthcare12020141/s1, Table S1: Details of the intervention protocol; Table S2: Baseline characteristics between study completers (n = 264) and non-completers (n = 62); Table S3: Unconditional model estimations and model fit: intention-to-treat approach; Table S4: Conditional model with age, body mass index, and parity as covariates; Table S5: Adverse events reported across the intervention, classified by condition and non-condition-related.

Author Contributions

Conceptualization: J.A., F.D.C. and F.C.; data curation: M.M.; formal analysis: R.G.M.; interpretation of data: D.J., A.C.A., M.M., J.A., I.M. and F.C.; resources: M.C. and V.B.; writing—original draft preparation: D.J., A.C.A. and F.C.; writing—reviewing and editing: all. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by Sword Health Inc. and also developed within the scope of project nº 62—“Responsible AI”, financed by European Funds, namely the Recovery and Resilience Plan—“Componente 5: Agendas Mobilizadoras para a Inovação Empresarial”, included in the NextGenerationEU funding program.

Institutional Review Board Statement

This study was conducted in accordance with the Declaration of Helsinki, and the protocol was approved by the Advarra IRB (protocol number Pro00064510) and prospectively registered in ClinicalTrials.gov, NCT05513417 on 24 August 2022.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are available on request from the corresponding author. The data are not publicly available due to privacy restrictions.

Acknowledgments

The authors express their appreciation for the deep commitment of the Bloom technical care and support team to guarantee the successful delivery of care. The authors also acknowledge the contributions of João Tiago Silva, Margarida Morais, and Guilherme Freches in data validation (all employees of Sword Health).

Conflicts of Interest

Authors Dora Janela, Anabela C. Areias, Maria Molinos, Robert G. Moulder, Ivo Magalhães, Marta Cardeano, Vijay Yanamadala, Fernando Dias Correia, Jennesa Atherton and Fabíola Costa were employed by the company Sword Health Inc., the sponsor of this study. Authors Virgílio Bento, Vijay Yanamadala, Marta Cardeano and Fernando Dias Correia also hold equity in Sword Health, and Virgílio Bento is the CEO of the same company. The study sponsor, Sword Health, was involved in the study design, data collection and interpretation, and writing of the manuscript.

References

  1. Patel, U.J.; Godecker, A.L.; Giles, D.L.; Brown, H.W. Updated Prevalence of Urinary Incontinence in Women: 2015-2018 National Population-Based Survey Data. Female Pelvic Med. Reconstr. Surg. 2022, 28, 181–187. [Google Scholar] [CrossRef] [PubMed]
  2. Coyne, K.S.; Wein, A.; Nicholson, S.; Kvasz, M.; Chen, C.I.; Milsom, I. Comorbidities and personal burden of urgency urinary incontinence: A systematic review. Int. J. Clin. Pract. 2013, 67, 1015–1033. [Google Scholar] [CrossRef] [PubMed]
  3. Pierce, H.; Perry, L.; Gallagher, R.; Chiarelli, P. Urinary incontinence, work, and intention to leave current job: A cross sectional survey of the Australian nursing and midwifery workforce. Neurourol. Urodyn. 2017, 36, 1876–1883. [Google Scholar] [CrossRef] [PubMed]
  4. Coyne, K.S.; Wein, A.; Nicholson, S.; Kvasz, M.; Chen, C.-I.; Milsom, I. Economic Burden of Urgency Urinary Incontinence in the United States: A Systematic Review. J. Manag. Care Pharm. 2014, 20, 130–140. [Google Scholar] [CrossRef]
  5. Abrams, P.; Andersson, K.-E.; Apostolidis, A.; Birder, L.; Bliss, D.; Brubaker, L.; Cardozo, L.; Castro-Diaz, D.; O’Connell, P.R.; Cottenden, A.; et al. 6th International Consultation on Incontinence. Recommendations of the International Scientific Committee: Evaluation and Treatment of Urinary Incontinence, Pelvic Organ Prolapse and Faecal Incontinence. Neurourol. Urodyn. 2018, 37, 2271–2272. [Google Scholar] [CrossRef] [PubMed]
  6. National Guideline Centre (UK). Urinary Incontinence and Pelvic Organ Prolapse in Women: Management; National Institute for Health and Care Excellence (NICE): London, UK, 2019. [Google Scholar]
  7. Dumoulin, C.; Cacciari, L.P.; Hay-Smith, E.J.C. Pelvic floor muscle training versus no treatment, or inactive control treatments, for urinary incontinence in women. Cochrane Database Syst. Rev. 2018, 10, Cd005654. [Google Scholar] [CrossRef] [PubMed]
  8. Lamin, E.; Parrillo, L.M.; Newman, D.K.; Smith, A.L. Pelvic Floor Muscle Training: Underutilization in the USA. Curr. Urol. Rep. 2016, 17, 10. [Google Scholar] [CrossRef]
  9. Dieter, A.A.; Wilkins, M.F.; Wu, J.M. Epidemiological trends and future care needs for pelvic floor disorders. Curr. Opin. Obstet. Gynecol. 2015, 27, 380–384. [Google Scholar] [CrossRef]
  10. Toye, F.; Barker, K.L. A meta-ethnography to understand the experience of living with urinary incontinence: ‘is it just part and parcel of life?’. BMC Urol. 2020, 20, 1. [Google Scholar] [CrossRef]
  11. American Physical Therapy Association (APTA). A Physical Therapy Profile: Wages Earned in the Profession, 2021–2022; APTA: Alexandria, VA, USA, 2023. [Google Scholar]
  12. Fitz, F.F.; Paladini, L.M.; Ferreira, L.A.; Gimenez, M.M.; Bortolini, M.A.T.; Castro, R.A. Ability to contract the pelvic floor muscles and association with muscle function in incontinent women. Int. Urogynecol. J. 2020, 31, 2337–2344. [Google Scholar] [CrossRef]
  13. Hay-Smith, J.; Dean, S.; Burgio, K.; McClurg, D.; Frawley, H.; Dumoulin, C. Pelvic-floor-muscle-training adherence “modifiers”: A review of primary qualitative studies-2011 ICS State-of-the-Science Seminar research paper III of IV. Neurourol. Urodyn. 2015, 34, 622–631. [Google Scholar] [CrossRef] [PubMed]
  14. da Mata, K.; Costa, R.; Carbone, É.; Gimenez, M.; Bortolini, M.; Castro, R.; Fitz, F. Telehealth in the rehabilitation of female pelvic floor dysfunction: A systematic literature review. Int. Urogynecol. J. 2021, 32, 249–259. [Google Scholar] [CrossRef] [PubMed]
  15. Bernard, S.; Boucher, S.; McLean, L.; Moffet, H. Mobile technologies for the conservative self-management of urinary incontinence: A systematic scoping review. Int. Urogynecol. J. 2020, 31, 1163–1174. [Google Scholar] [CrossRef] [PubMed]
  16. Hou, Y.; Feng, S.; Tong, B.; Lu, S.; Jin, Y. Effect of pelvic floor muscle training using mobile health applications for stress urinary incontinence in women: A systematic review. BMC Womens Health 2022, 22, 400. [Google Scholar] [CrossRef] [PubMed]
  17. Woodley, S.J.; Moller, B.; Clark, A.R.; Bussey, M.D.; Sangelaji, B.; Perry, M.; Kruger, J. Digital Technologies for Women’s Pelvic Floor Muscle Training to Manage Urinary Incontinence Across Their Life Course: Scoping Review. JMIR Mhealth Uhealth 2023, 11, e44929. [Google Scholar] [CrossRef] [PubMed]
  18. Asklund, I.; Nyström, E.; Sjöström, M.; Umefjord, G.; Stenlund, H.; Samuelsson, E. Mobile app for treatment of stress urinary incontinence: A randomized controlled trial. Neurourol. Urodyn. 2017, 36, 1369–1376. [Google Scholar] [CrossRef]
  19. Loohuis, A.M.M.; Wessels, N.J.; Dekker, J.H.; van Merode, N.A.M.; Slieker-Ten Hove, M.C.P.; Kollen, B.J.; Berger, M.Y.; van der Worp, H.; Blanker, M.H. App-Based Treatment in Primary Care for Urinary Incontinence: A Pragmatic, Randomized Controlled Trial. Ann. Fam. Med. 2021, 19, 102–109. [Google Scholar] [CrossRef]
  20. Sjöström, M.; Stenlund, H.; Johansson, S.; Umefjord, G.; Samuelsson, E. Stress urinary incontinence and quality of life: A reliability study of a condition-specific instrument in paper and web-based versions. Neurourol. Urodyn. 2012, 31, 1242–1246. [Google Scholar] [CrossRef]
  21. Hagen, S.; Elders, A.; Stratton, S.; Sergenson, N.; Bugge, C.; Dean, S.; Hay-Smith, J.; Kilonzo, M.; Dimitrova, M.; Abdel-Fattah, M.; et al. Effectiveness of pelvic floor muscle training with and without electromyographic biofeedback for urinary incontinence in women: Multicentre randomised controlled trial. BMJ 2020, 371, m3719. [Google Scholar] [CrossRef]
  22. Jochum, F.; Garbin, O.; Godet, J.; Ragueneau, M.; Meyer, C.; Billecocq, S.; Lecointre, L.; Akladios, C.; Host, A. Prospective evaluation of the connected biofeedback EMY Kegel trainer in the management of stress urinary incontinence. J. Gynecol. Obstet. Hum. Reprod. 2022, 51, 102280. [Google Scholar] [CrossRef]
  23. Keyser, L.E.; McKinney, J.L.; Pulliam, S.J.; Weinstein, M.M. A digital health program for treatment of urinary incontinence: Retrospective review of real-world user data. Int. Urogynecol. J. 2023, 34, 1083–1089. [Google Scholar] [CrossRef] [PubMed]
  24. Weinstein, M.M.; Dunivan, G.; Guaderrama, N.M.; Richter, H.E. Digital Therapeutic Device for Urinary Incontinence: A Randomized Controlled Trial. Obstet. Gynecol. 2022, 139, 606–615. [Google Scholar] [CrossRef] [PubMed]
  25. Weinstein, M.M.; Dunivan, G.C.; Guaderrama, N.M.; Richter, H.E. Digital Therapeutic Device for Urinary Incontinence: A Longitudinal Analysis at 6 and 12 Months. Obstet. Gynecol. 2023, 141, 199–206. [Google Scholar] [CrossRef] [PubMed]
  26. Barber, M.D.; Walters, M.D.; Bump, R.C. Short forms of two condition-specific quality-of-life questionnaires for women with pelvic floor disorders (PFDI-20 and PFIQ-7). Am. J. Obstet. Gynecol. 2005, 193, 103–113. [Google Scholar] [CrossRef] [PubMed]
  27. Abrams, P.; Cardozo, L.; Wagg, A.; Wein, A. (Eds.) Patient-Reported Outcome (PRO) Questionnaires to Assess the Impact of Urinary Incontinence, OAB and Lower. In Incontinence, 6th ed.; ICI-ICS International Continence Society: Bristol, UK, 2017; pp. 560–561. [Google Scholar]
  28. de Figueiredo, V.B.; Ferreira, C.H.J.; da Silva, J.B.; de Oliveira Esmeraldo, G.N.D.; Brito, L.G.O.; do Nascimento, S.L.; Driusso, P. Responsiveness of Pelvic Floor Distress Inventory (PFDI-20) and Pelvic Floor Impact Questionnaire (PFIQ-7) after pelvic floor muscle training in women with stress and mixed urinary incontinence. Eur. J. Obstet. Gynecol. Reprod. Biol. 2020, 255, 129–133. [Google Scholar] [CrossRef] [PubMed]
  29. Ospina, M.; Dennett, L.; Wayne, A.; Jacob, P.; Thompson, A. A systematic review of measurement properties of instruments assessing presenteeism. Am. J. Manag. Care 2015, 21, e171–e185. [Google Scholar] [PubMed]
  30. Spitzer, R.L.; Kroenke, K.; Williams, J.B.; Löwe, B. A brief measure for assessing generalized anxiety disorder: The GAD-7. Arch. Intern. Med. 2006, 166, 1092–1097. [Google Scholar] [CrossRef]
  31. Kroenke, K.; Spitzer, R.L.; Williams, J.B. The PHQ-9: Validity of a brief depression severity measure. J. Gen. Intern. Med. 2001, 16, 606–613. [Google Scholar] [CrossRef]
  32. Serdar, C.C.; Cihan, M.; Yücel, D.; Serdar, M.A. Sample size, power and effect size revisited: Simplified and practical approaches in pre-clinical, clinical and laboratory studies. Biochem. Med. 2021, 31, 010502. [Google Scholar] [CrossRef]
  33. Xiao, J.; Bulut, O. Evaluating the Performances of Missing Data Handling Methods in Ability Estimation From Sparse Data. Educ. Psychol. Meas. 2020, 80, 932–954. [Google Scholar] [CrossRef]
  34. Barber, M.D.; Spino, C.; Janz, N.K.; Brubaker, L.; Nygaard, I.; Nager, C.W.; Wheeler, T.L. The minimum important differences for the urinary scales of the Pelvic Floor Distress Inventory and Pelvic Floor Impact Questionnaire. Am. J. Obstet. Gynecol. 2009, 200, 580.e1–580.e7. [Google Scholar] [CrossRef]
  35. Barber, M.D.; Chen, Z.; Lukacz, E.; Markland, A.; Wai, C.; Brubaker, L.; Nygaard, I.; Weidner, A.; Janz, N.K.; Spino, C. Further validation of the short form versions of the Pelvic Floor Distress Inventory (PFDI) and Pelvic Floor Impact Questionnaire (PFIQ). Neurourol. Urodyn. 2011, 30, 541–546. [Google Scholar] [CrossRef] [PubMed]
  36. Toussaint, A.; Hüsing, P.; Gumz, A.; Wingenfeld, K.; Härter, M.; Schramm, E.; Löwe, B. Sensitivity to change and minimal clinically important difference of the 7-item Generalized Anxiety Disorder Questionnaire (GAD-7). J. Affect. Disord. 2020, 265, 395–401. [Google Scholar] [CrossRef] [PubMed]
  37. Löwe, B.; Unützer, J.; Callahan, C.M.; Perkins, A.J.; Kroenke, K. Monitoring depression treatment outcomes with the patient health questionnaire-9. Med. Care 2004, 42, 1194–1201. [Google Scholar] [CrossRef] [PubMed]
  38. Sandborn, W.J.; Reilly, M.C.; Brown, M.C.J.; Brabant, Y.; Gerlier, L.C. Minimally Important Difference for WPAI:CD Scores: Defining Relevant Impact on Work Productivity in Active Crohn’s Disease: 962. Off. J. Am. Coll. Gastroenterol. ACG 2007, 102, S472. [Google Scholar] [CrossRef]
  39. Aguirre, F.; Heft, J.; Yunker, A. Factors Associated With Nonadherence to Pelvic Floor Physical Therapy Referral for the Treatment of Pelvic Pain in Women. Phys. Ther. 2019, 99, 946–952. [Google Scholar] [CrossRef]
  40. Lee, U.J.; Feinstein, L.; Ward, J.B.; Kirkali, Z.; Martinez-Miller, E.E.; Matlaga, B.R.; Kobashi, K.C. Prevalence of Urinary Incontinence among a Nationally Representative Sample of Women, 2005–2016: Findings from the Urologic Diseases in America Project. J. Urol. 2021, 205, 1718–1724. [Google Scholar] [CrossRef]
  41. Milsom, I.; Gyhagen, M. The prevalence of urinary incontinence. Climacteric 2019, 22, 217–222. [Google Scholar] [CrossRef]
  42. Asklund, I.; Samuelsson, E.; Hamberg, K.; Umefjord, G.; Sjöström, M. User Experience of an App-Based Treatment for Stress Urinary Incontinence: Qualitative Interview Study. J. Med. Internet Res. 2019, 21, e11296. [Google Scholar] [CrossRef]
  43. Minassian, V.A.; Devore, E.; Hagan, K.; Grodstein, F. Severity of urinary incontinence and effect on quality of life in women by incontinence type. Obstet. Gynecol. 2013, 121, 1083–1090. [Google Scholar] [CrossRef]
  44. Osborne, L.A.; Mair Whittall, C.; Emery, S.; Reed, P. Change in depression predicts change in bladder symptoms for women with urinary incontinence undergoing pelvic-floor muscle training. Eur. J. Obstet. Gynecol. Reprod. Biol. 2023, 280, 54–59. [Google Scholar] [CrossRef] [PubMed]
  45. Felde, G.; Engeland, A.; Hunskaar, S. Urinary incontinence associated with anxiety and depression: The impact of psychotropic drugs in a cross-sectional study from the Norwegian HUNT study. BMC Psychiatry 2020, 20, 521. [Google Scholar] [CrossRef] [PubMed]
  46. Lin, K.Y.; Siu, K.C.; Lin, K.H. Impact of lower urinary tract symptoms on work productivity in female workers: A systematic review and meta-analysis. Neurourol. Urodyn. 2018, 37, 2323–2334. [Google Scholar] [CrossRef] [PubMed]
  47. Hay-Smith, E.J.; Herderschee, R.; Dumoulin, C.; Herbison, G.P. Comparisons of approaches to pelvic floor muscle training for urinary incontinence in women. Cochrane Database Syst. Rev. 2011, Cd009508. [Google Scholar] [CrossRef]
  48. Ferreira, C.H.J.; Driusso, P.; Haddad, J.M.; Pereira, S.B.; Fernandes, A.C.N.L.; Porto, D.; Reis, B.M.; Mascarenhas, L.R.; Brito, L.G.O.; Ferreira, E.A.G. A guide to physiotherapy in urogynecology for patient care during the COVID-19 pandemic. Int. Urogynecol. J. 2021, 32, 203–210. [Google Scholar] [CrossRef]
Figure 1. Components of the patient’s medical device: wireless intravaginal sensor, mobile app, and cloud platform.
Figure 1. Components of the patient’s medical device: wireless intravaginal sensor, mobile app, and cloud platform.
Healthcare 12 00141 g001
Figure 2. Study flow chart.
Figure 2. Study flow chart.
Healthcare 12 00141 g002
Table 1. Study secondary outcomes.
Table 1. Study secondary outcomes.
OutcomeMeasure
Engagement metrics
Program completion rate% of individuals completing the program
Exercises engagementTotal number of exercise sessions performed with the sensor. Note: Sessions performed without the intravaginal sensor were not accounted for.
Education engagementNumber of educational pieces read
Touchpoints between the patient and the PTNumber of touchpoints, either by video, phone calls, or text messages, initiated by either the patient or PT
Satisfaction“On a scale from 0 to 10, how likely are you to recommend Bloom’s programs to a friend or family member?”
Clinical outcomes
Pelvic floor symptoms impact on daily livingPelvic Floor Impact Questionnaire—short form 7 (PFIQ-7); (scores 0–300). Higher scores denote worse outcomes.
Mental healthAnxiety: Generalized Anxiety Disorder 7-item scale (GAD-7) (scores 0–21) [30], in the past 2 weeks.
Depression: Patient Health 9-item Questionnaire (PHQ-9) (scores 0–27) [31], in the past 2 weeks.
A cut-off threshold ≥ 5 indicates at least mild anxiety and depression, respectively.
Work productivity and activity impairmentCollected within the employed population: Work Productivity and Activity Impairment (WPAI) for general health to assess overall work impairment (WPAI overall), presenteeism (WPAI work), and absenteeism (WPAI time) [29]. Scores range from 0 to 100%, with higher scores indicating higher impairment.
Intent to seek additional healthcare“How likely are you to seek additional healthcare interventions for this condition?” (0—not at all likely to 10—extremely likely).
Table 2. Baseline characteristics of study participants: entire cohort (n = 326).
Table 2. Baseline characteristics of study participants: entire cohort (n = 326).
CharacteristicEntire Cohort
(n = 326)
Age (years), mean (SD)44.8 (9.1)
Age categories (years), n (%):
<251 (0.3)
25–40120 (36.8)
41–54149 (45.7)
≥5556 (17.2)
Gender, n (%)
Female325 (99.7)
Prefer not to specify1 (0.3)
BMI (kg/m2), mean (SD)29.7 (7.0)
BMI categories (kg/m2), n (%):
Underweight (<18.5)3 (0.9)
Normal (18.5–25)90 (27.6)
Overweight (≥25–30)105 (32.2)
Obese (≥30–40)100 (30.7)
Morbidly obese (>40)28 (8.6)
Employment status, n (%):
Employed full-time275 (84.4)
Employed part-time27 (8.3)
Unemployed (not working or retired)21 (6.4)
Prefer not to specify3 (0.9)
Education level, n (%):
High school diploma or less than high school22 (6.7)
Some college85 (25.1)
Bachelor’s degree149 (45.7)
Graduate degree66 (20.2)
Prefer not to specify4 (1.2)
Race/ethnicity, n (%):
Asian or Pacific Islander15 (4.6)
Black or African American13 (4.0)
Hispanic or Latino31 (9.5)
White or Caucasian249 (76.4)
American Indian or Alaska Native5 (1.5)
Multi-racial or bi-racial7 (2.1)
Prefer not to specify5 (1.5)
Not listed1 (0.3)
Urinary Incontinence Type
Mixed urinary incontinence64 (19.6)
Stress urinary incontinence239 (73.3)
Urgency urinary incontinence23 (7.1)
Acuity, n (%):
Less than 6 months29 (8.9)
More than 6 months280 (85.6)
Not available17 (5.2)
Parity a, mean (SD)2.0 (1.2)
Parity a, n (%):
Nulliparous22 (8.0)
1–2178 (64.5)
3–575 (27.2)
>51 (0.4)
Abbreviations: BMI, body mass index. Notes: a: n = 276.
Table 3. Model estimates of clinical outcome measures following an intent-to-treat approach.
Table 3. Model estimates of clinical outcome measures following an intent-to-treat approach.
Outcome,
Mean (95%CI)
nBaselineEnd-of-ProgramMean Change
UIQ-731133.6 (30.9;36.2)24.8 (21.0;28.5)8.8 (4.7;12.9)
PFIQ-731360.1 (52.8;67.5)42.3 (32.0;52.6)17.9 (5.9; 29.9)
Abbreviations: PFIQ-7, Pelvic Floor Impact Questionnaire—short form 7; UIQ-7, Urinary Impact Questionnaire—short form 7.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Janela, D.; Areias, A.C.; Molinos, M.; Moulder, R.G.; Magalhães, I.; Bento, V.; Cardeano, M.; Yanamadala, V.; Correia, F.D.; Atherton, J.; et al. Digital Care Program for Urinary Incontinence in Females: A Large-Scale, Prospective, Cohort Study. Healthcare 2024, 12, 141. https://doi.org/10.3390/healthcare12020141

AMA Style

Janela D, Areias AC, Molinos M, Moulder RG, Magalhães I, Bento V, Cardeano M, Yanamadala V, Correia FD, Atherton J, et al. Digital Care Program for Urinary Incontinence in Females: A Large-Scale, Prospective, Cohort Study. Healthcare. 2024; 12(2):141. https://doi.org/10.3390/healthcare12020141

Chicago/Turabian Style

Janela, Dora, Anabela C. Areias, Maria Molinos, Robert G. Moulder, Ivo Magalhães, Virgílio Bento, Marta Cardeano, Vijay Yanamadala, Fernando Dias Correia, Jennesa Atherton, and et al. 2024. "Digital Care Program for Urinary Incontinence in Females: A Large-Scale, Prospective, Cohort Study" Healthcare 12, no. 2: 141. https://doi.org/10.3390/healthcare12020141

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop