Prediction of Adherence to an Online Wellness Program for People with Mobility Limitations: A Machine Learning Approach
Abstract
1. Introduction
2. Methods
2.1. Data Source and Participants
2.2. Study Variables
2.3. Statistical Analysis
2.4. Data Preprocessing
2.5. Feature Selection and Dimensionality Reduction
2.6. Regression Models
2.7. Model Validation
2.8. Evaluation Criteria
2.9. Feature Importance Stability
2.10. Model Interpretation
2.11. Synergy (Pairwise Interaction) Analysis
2.12. Code Availability
3. Results
4. Discussion
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Rasch, E.K.; Hochberg, M.C.; Magder, L.; Magaziner, J.; Altman, B.M. Health of community-dwelling adults with mobility limitations in the United States: Prevalent health conditions. Part I. Arch. Phys. Med. Rehabil. 2008, 89, 210–218. [Google Scholar] [CrossRef]
- Mintz, M.; Oster, R.A.; Wilroy, J.; Rimmer, J.H. Factors Affecting Online Health Promotion Program Adherence Among People with Disabilities. Disabilities 2025, 5, 16. [Google Scholar] [CrossRef]
- Pedersen, D.H.; Mansourvar, M.; Sortsø, C.; Schmidt, T. Predicting dropouts from an electronic health platform for lifestyle interventions: Analysis of methods and predictors. J. Med. Internet Res. 2019, 21, e13617. [Google Scholar] [CrossRef] [PubMed]
- Eysenbach, G. The law of attrition. J. Med. Internet Res. 2005, 7, e402. [Google Scholar] [CrossRef] [PubMed]
- Carty, C.; Van Der Ploeg, H.P.; Biddle, S.J.; Bull, F.; Willumsen, J.; Lee, L.; Kamenov, K.; Milton, K. The first global physical activity and sedentary behavior guidelines for people living with disability. J. Phys. Act. Health 2021, 18, 86–93. [Google Scholar] [CrossRef]
- de Hollander, E.L.; Proper, K.I. Physical activity levels of adults with various physical disabilities. Prev. Med. Rep. 2018, 10, 370–376. [Google Scholar] [CrossRef]
- Ware, M.E.; deMarrais, K.B.; McCully, K.K. Adherence and continued participation in a wellness class for individuals with disabilities. Rehabil. Process Outcome 2019, 8, 1179572719843257. [Google Scholar] [CrossRef]
- Giebel, G.D.; Speckemeier, C.; Abels, C.; Plescher, F.; Börchers, K.; Wasem, J.; Blase, N.; Neusser, S. Problems and barriers related to the use of digital health applications: Scoping review. J. Med. Internet Res. 2023, 25, e43808. [Google Scholar] [CrossRef]
- Pharr, J.R.; Bungum, T. Health disparities experienced by people with disabilities in the United States: A Behavioral Risk Factor Surveillance System study. Glob. J. Health Sci. 2012, 4, 99. [Google Scholar] [CrossRef]
- Kim, E.J.; Yuan, Y.; Liebschutz, J.; Cabral, H.; Kazis, L. Understanding the digital gap among us adults with disability: Cross-sectional analysis of the health information national trends survey 2013. JMIR Rehabil. Assist. Technol. 2018, 5, e8783. [Google Scholar] [CrossRef]
- Pettersson, L.; Johansson, S.; Demmelmaier, I.; Gustavsson, C. Disability digital divide: Survey of accessibility of eHealth services as perceived by people with and without impairment. BMC Public Health 2023, 23, 181. [Google Scholar] [CrossRef]
- Golovaty, I.; Wadhwa, S.; Fisher, L.; Lobach, I.; Crowe, B.; Levi, R.; Seligman, H. Reach, engagement and effectiveness of in-person and online lifestyle change programs to prevent diabetes. BMC Public Health 2021, 21, 1314. [Google Scholar] [CrossRef]
- Bevens, W.; Weiland, T.; Gray, K.; Jelinek, G.; Neate, S.; Simpson-Yap, S. Attrition within digital health interventions for people with multiple sclerosis: Systematic review and meta-analysis. J. Med. Internet Res. 2022, 24, e27735. [Google Scholar] [CrossRef]
- Maenhout, L.; Peuters, C.; Cardon, G.; Crombez, G.; DeSmet, A.; Compernolle, S. Nonusage attrition of adolescents in an mHealth promotion intervention and the role of socioeconomic status: Secondary analysis of a 2-arm cluster-controlled trial. JMIR Mhealth Uhealth 2022, 10, e36404. [Google Scholar] [CrossRef]
- Ekpezu, A.O.; Wiafe, I.; Oinas-Kukkonen, H. Predicting adherence to behavior change support systems using machine learning: Systematic review. JMIR AI 2023, 2, e46779. [Google Scholar] [CrossRef] [PubMed]
- Rimmer, J.H.; Young, H.-J.; Bachiashvili, V.; Baidwan, N.K.; Mehta, T. Enhancements to a telewellness program for people with physical disabilities: Mindfulness, exercise, and nutrition to optimize resilience (MENTOR 2.0). Prev. Chronic Dis. 2024, 21, E02. [Google Scholar] [CrossRef] [PubMed]
- Singh, G.K. Area deprivation and widening inequalities in US mortality, 1969–1998. Am. J. Public Health 2003, 93, 1137–1143. [Google Scholar] [CrossRef] [PubMed]
- Turk, M.A.; Logan, L.R.; Ansoanuur, F. Adults with childhood onset disabilities: A focused review of three conditions. Curr. Phys. Med. Rehabil. Rep. 2013, 1, 72–87. [Google Scholar] [CrossRef]
- Verbrugge, L.M.; Yang, L.-S. Aging with disability and disability with aging. J. Disabil. Policy Stud. 2002, 12, 253–267. [Google Scholar] [CrossRef]
- Patient-Reported Outcomes Measurement Information System (PROMIS). PROMIS Life Satisfaction Scoring Manual. HealthMeasures. Available online: https://www.healthmeasures.net/images/PROMIS/manuals/PROMIS_Life_Satisfaction_Scoring_Manual.pdf (accessed on 15 August 2025).
- Patient-Reported Outcomes Measurement Information System (PROMIS). PROMIS Emotional Support Scoring Manual. HealthMeasures. Available online: https://www.healthmeasures.net/images/PROMIS/manuals/PROMIS_Emotional_Support_Scoring_Manual.pdf (accessed on 15 August 2025).
- Bagereka, P.; Ameli, R.; Sinaii, N.; Vocci, M.C.; Berger, A. Psychosocial-spiritual well-being is related to resilience and mindfulness in patients with severe and/or life-limiting medical illness. BMC Palliat. Care 2023, 22, 133. [Google Scholar] [CrossRef]
- Sikes, E.M.; Richardson, E.V.; Cederberg, K.J.; Sasaki, J.E.; Sandroff, B.M.; Motl, R.W. Use of the Godin leisure-time exercise questionnaire in multiple sclerosis research: A comprehensive narrative review. Disabil. Rehabil. 2019, 41, 1243–1267. [Google Scholar] [CrossRef]
- Pellicciari, L.; Chiarotto, A.; Giusti, E.; Crins, M.H.; Roorda, L.D.; Terwee, C.B. Psychometric properties of the patient-reported outcomes measurement information system scale v1. 2: Global health (PROMIS-GH) in a Dutch general population. Health Qual. Life Outcomes 2021, 19, 226. [Google Scholar] [CrossRef] [PubMed]
- Rimmer, J.H.; Wilroy, J.; Galea, P.; Jeter, A.; Lai, B.W. Retrospective evaluation of a pilot eHealth/mHealth telewellness program for people with disabilities: Mindfulness, Exercise, and Nutrition To Optimize Resilience (MENTOR). Mhealth 2022, 8, 15. [Google Scholar] [CrossRef] [PubMed]
- R Core Team. R: A Language and Environment for Statistical Computing [Internet]; R Foundation for Statistical Computing: Vienna, Austria, 2024; Available online: https://www.R-project.org/ (accessed on 20 October 2025).
- Jerez, J.M.; Molina, I.; García-Laencina, P.J.; Alba, E.; Ribelles, N.; Martín, M.; Franco, L. Missing data imputation using statistical and machine learning methods in a real breast cancer problem. Artif. Intell. Med. 2010, 50, 105–115. [Google Scholar] [CrossRef] [PubMed]
- Hodson, T.O. Root mean square error (RMSE) or mean absolute error (MAE): When to use them or not. Geosci. Model Dev. Discuss. 2022, 15, 5481–5487. [Google Scholar] [CrossRef]
- Escanilla, N.S.; Hellerstein, L.; Kleiman, R.; Kuang, Z.; Shull, J.; Page, D. Recursive feature elimination by sensitivity testing. In Proceedings of the 2018 17th IEEE International Conference on Machine Learning and Applications (ICMLA), Orlando, FL, USA, 17–20 December 2018; pp. 40–47. [Google Scholar]
- Khan, M.H.R.; Bhadra, A.; Howlader, T. Stability selection for lasso, ridge and elastic net implemented with AFT models. Stat. Appl. Genet. Mol. Biol. 2019, 18, 20170001. [Google Scholar] [CrossRef]
- Inden, M. Short Introduction to Python 3.10. In Python Challenges; Springer: Berlin/Heidelberg, Germany, 2022; pp. 635–643. [Google Scholar]
- Berrar, D. Cross-Validation. In Encyclopedia of Bioinformatics and Computational Biology; Elsevier: Amsterdam, The Netherlands, 2019; Volume 1, pp. 542–545. [Google Scholar] [CrossRef]
- Willmott, C.J.; Matsuura, K. Advantages of the mean absolute error (MAE) over the root mean square error (RMSE) in assessing average model performance. Clim. Res. 2005, 30, 79–82. [Google Scholar] [CrossRef]
- Jiang, L.; Haiminen, N.; Carrieri, A.-P.; Huang, S.; Vázquez-Baeza, Y.; Parida, L.; Kim, H.-C.; Swafford, A.D.; Knight, R.; Natarajan, L. Utilizing stability criteria in choosing feature selection methods yields reproducible results in microbiome data. Biometrics 2022, 78, 1155–1167. [Google Scholar] [CrossRef]
- Salman, R.; Alzaatreh, A.; Sulieman, H. The stability of different aggregation techniques in ensemble feature selection: R. Salman et al. J. Big Data 2022, 9, 51. [Google Scholar] [CrossRef]
- Štrumbelj, E.; Kononenko, I. Explaining prediction models and individual predictions with feature contributions. Knowl. Inf. Syst. 2014, 41, 647–665. [Google Scholar] [CrossRef]
- Oh, S. Feature interaction in terms of prediction performance. Appl. Sci. 2019, 9, 5191. [Google Scholar] [CrossRef]
- Fedkov, D.; Peine, C.; Lang, F.; Khalil, A.; Knitza, J.; Leipe, J. Predictors of adherence to a digital health application in patients with inflammatory arthritis: Retrospective analysis. Rheumatol. Int. 2025, 46, 16. [Google Scholar] [CrossRef] [PubMed]
- Figueiredo, T.; Alcântara, L.; Carrilho, J.; Paúl, C.; Costa, E. Understanding Adherence to Digital Health Technologies: Systematic Review of Predictive Factors. J. Med. Internet Res. 2025, 27, e77362. [Google Scholar] [CrossRef] [PubMed]
- He, Z.; Tian, S.; Singh, A.; Chakraborty, S.; Zhang, S.; Lustria, M.L.A.; Charness, N.; Roque, N.A.; Harrell, E.R.; Boot, W.R. A machine-learning based approach for predicting older adults’ adherence to technology-based cognitive training. Inf. Process. Manag. 2022, 59, 103034. [Google Scholar] [CrossRef] [PubMed]
- Montalescot, L.; Baussard, L.; Charbonnier, E. Factors associated with digital intervention engagement and adherence in patients with cancer: Systematic review. J. Med. Internet Res. 2024, 26, e52542. [Google Scholar] [CrossRef]
- Wenger, F.; Allenhof, C.; Schreynemackers, S.; Hegerl, U.; Reich, H. Use of Random Forest to Predict Adherence in an Online Intervention for Depression Using Baseline and Early Usage Data: Model Development and Validation on Retrospective Routine Care Log Data. JMIR Form. Res. 2024, 8, e53768. [Google Scholar] [CrossRef]
- Lundberg, S.M.; Lee, S.-I. A unified approach to interpreting model predictions. Adv. Neural Inf. Process. Syst. 2017, 30, 4765–4774. [Google Scholar]
- Nauta, M.; Trienes, J.; Pathak, S.; Nguyen, E.; Peters, M.; Schmitt, Y.; Schlötterer, J.; Van Keulen, M.; Seifert, C. From anecdotal evidence to quantitative evaluation methods: A systematic review on evaluating explainable ai. ACM Comput. Surv. 2023, 55, 1–42. [Google Scholar] [CrossRef]
- Ponce-Bobadilla, A.V.; Schmitt, V.; Maier, C.S.; Mensing, S.; Stodtmann, S. Practical guide to SHAP analysis: Explaining supervised machine learning model predictions in drug development. Clin. Transl. Sci. 2024, 17, e70056. [Google Scholar] [CrossRef]
- Alkhuzaimi, F.; Rainey, D.; Brown Wilson, C.; Bloomfield, J. The impact of mobile health interventions on service users’ health outcomes and the role of health professions: A systematic review of systematic reviews. BMC Digit. Health 2025, 3, 3. [Google Scholar] [CrossRef]
- Canby, N.K.; Eichel, K.; Peters, S.I.; Rahrig, H.; Britton, W.B. Predictors of out-of-class mindfulness practice adherence during and after a mindfulness-based intervention. Biopsychosoc. Sci. Med. 2021, 83, 655–664. [Google Scholar] [CrossRef] [PubMed]
- Nikkhah, J.; Campione, A.; Steinbeck, V.; Wittich, L.; Pross, C.; Busse, R. Demographic and socioeconomic determinants of adherence in digital patient-reported outcomes among patients with chronic diseases. Npj Digit. Med. 2025, 8, 492. [Google Scholar] [CrossRef] [PubMed]
- Sandberg, A.; Ravn-Fischer, A.; Johnsson, A.; Lachonius, M.; Bäck, M. Evaluation of a digital patient education programme in patients with coronary artery disease, a survey-based study. BMC Health Serv. Res. 2024, 24, 1012. [Google Scholar] [CrossRef]
- Norori, N.; Hu, Q.; Aellen, F.M.; Faraci, F.D.; Tzovara, A. Addressing bias in big data and AI for health care: A call for open science. Patterns 2021, 2, 100347. [Google Scholar] [CrossRef] [PubMed]
- Ueda, D.; Kakinuma, T.; Fujita, S.; Kamagata, K.; Fushimi, Y.; Ito, R.; Matsui, Y.; Nozaki, T.; Nakaura, T.; Fujima, N. Fairness of artificial intelligence in healthcare: Review and recommendations. Jpn. J. Radiol. 2024, 42, 3–15. [Google Scholar] [CrossRef]
- Obermeyer, Z.; Powers, B.; Vogeli, C.; Mullainathan, S. Dissecting racial bias in an algorithm used to manage the health of populations. Science 2019, 366, 447–453. [Google Scholar] [CrossRef]
- Ramalho, A.; Paulo, R.; Duarte-Mendes, P.; Serrano, J.; Petrica, J. Age Unplugged: A Brief Narrative Review on the Intersection of Digital Tools, Sedentary and Physical Activity Behaviors in Community-Dwelling Older Adults. Healthcare 2024, 15, 935. [Google Scholar] [CrossRef]



| Variables | Tools |
|---|---|
| Psychosocial measures | |
| Resilience |
|
| Mindfulness |
|
| Physical activity behavior |
|
| General health status |
|
| Wellness |
|
| Variables | ||
|---|---|---|
| Socio-demographic variables | ||
| Age | ||
| Gender | ||
| Race and ethnicity | ||
| Marital status | Living with partner | |
| Living without partner | ||
| Rural residence (Micropolitan) | ||
| Annual income | ||
| Number of households | ||
| Age at time of injury | ||
| Employment | ||
| Education | High school or less | |
| Associate or Bachelor | ||
| Postgraduate | ||
| Area Deprivation Index national score | ||
| Clinical diagnosis and access to care | ||
| Onset of physical disability (Late vs. Early onset) ** | ||
| Presence of comorbidity | ||
| Having healthcare screening through a primary care doctor within the past 12 months | ||
| Number of vaccinations received | ||
| Receiving supplemental healthcare benefits | ||
| Having routine health checkups | ||
| Dental examination | ||
| Ophthalmologic examination | ||
| Psychosocial scores | ||
| PROMIS General Life Satisfaction score | ||
| PROMIS Emotional Support score | ||
| Connor-Davidson Resilience Scale | ||
| Mindfulness Attention Awareness Scale | ||
| PROMIS Global Health score | Physical | |
| Mental | ||
| NCHPAD Wellness Assessment scores | Physical | |
| Mental | ||
| Emotional | ||
| Level of physical activity measured by Godin Leisure-Time Exercise Questionnaire | ||
| Characteristics | (n = 1218) |
|---|---|
| Age, mean (SD) years | 55.5 (14.3) |
| Gender (female), n (%) | 798 (65.5%) |
| Marital status | |
| Living without partner, n (%) | 695 (57.1%) |
| Living with partner, n (%) | 479 (39.3%) |
| Unknown, n (%) | 44 (3.6%) |
| Race | |
| White, n (%) | 658 (54.0%) |
| Black, n (%) | 394 (32.3%) |
| Other, n (%) | 81 (6.7%) |
| Unknown, n (%) | 85 (7.0%) |
| Ethnicity (non-Hispanic), n (%) | 1130 (92.8%) |
| Residence (Urban), n (%) | 1081 (88.8%) |
| Area Deprivation Index, mean (SD) | 49.4 (29.3) |
| Educational level | |
| High school or less, n (%) | 291 (23.9%) |
| Bachelor’s degree or similar, n (%) | 675 (55.4%) |
| Postgraduate, n (%) | 241 (19.8%) |
| Unknown, n (%) | 11 (0.9%) |
| Employment (yes), n (%) | 204 (16.7%) |
| Annual income | |
| Less than $50,000, n (%) | 655 (53.8%) |
| $50,000–$100,000, n (%) | 192 (15.8%) |
| More than $100,000, n (%) | 113 (9.3%) |
| Unknown, n (%) | 258 (21.2%) |
| Percentage of sessions attended, median (IQR) | 30% (5%, 55%) |
| Regression Model | MAE (95% CI) | RMSE (95% CI) | R2 (95% CI) |
|---|---|---|---|
| Decision Tree | 28.53 (27.72, 29.35) | 36.35 (35.39, 37.31) | −0.70 (−0.77, −0.63) |
| KNN | 25.95 (25.04, 26.86) | 30.77 (29.67, 31.88) | −0.22 (−0.28, −0.15) |
| SVM | 24.64 (23.40, 25.88) | 28.19 (26.99, 29.39) | −0.02 (−0.09, 0.04) |
| XGBoost | 24.08 (23.44, 24.72) | 28.97 (28.07, 29.87) | −0.08 (−0.14, −0.02) |
| AdaBoost | 23.95 (22.95, 24.95) | 27.45 (26.56, 28.34) | 0.03 (−0.01, 0.07) |
| Extra Trees | 23.67 (22.35, 25.00) | 28.30 (26.91, 29.70) | −0.03 (−0.13, 0.07) |
| Huber | 22.89 (22.00, 23.78) | 27.49 (26.32, 28.65) | 0.02 (−0.08, 0.13) |
| LightGBM | 22.80 (21.70, 23.90) | 27.47 (26.57, 28.36) | 0.03 (−0.02, 0.07) |
| Random Forest | 22.65 (21.55, 23.75) | 26.83 (25.79, 27.86) | 0.07 (0.03, 0.12) |
| Gradient Boosting | 22.62 (21.68, 23.56) | 26.83 (26.00, 27.67) | 0.07 (0.04, 0.10) |
| Linear Regression | 22.24 (20.77, 23.70) | 26.45 (25.08, 27.83) | 0.11 (0.03, 0.17) |
| CatBoost | 21.27 (20.30, 22.25) | 26.74 (25.86, 27.62) | 0.08 (0.03, 0.13) |
| Bayesian Ridge ** | 20.68 (19.58, 22.78) | 25.54 (24.47, 26.60) | 0.12 (0.07, 0.14) |
| Feature | Mean Coefficient | SD |
|---|---|---|
| Education: High school or less | −3.12 | 0.43 |
| Number of households | −2.16 | 0.10 |
| Baseline PROMIS Emotional Support score | 2.12 | 0.31 |
| Early-onset disability | 1.95 | 0.35 |
| Supplemental healthcare benefits | −1.86 | 0.12 |
| White race | 1.73 | 0.22 |
| Age in years | −1.72 | 0.40 |
| Baseline PROMIS Life Satisfaction score | 1.47 | 0.11 |
| Late-onset disability | −1.35 | 0.19 |
| Number of vaccines received in primary care | 1.22 | 0.15 |
| ADI national score | −1.15 | 0.31 |
| Baseline Global Physical Health PROMIS score | 1.09 | 0.37 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Aly, S.; Young, H.-J.; Rimmer, J.H.; Mehta, T. Prediction of Adherence to an Online Wellness Program for People with Mobility Limitations: A Machine Learning Approach. Healthcare 2026, 14, 781. https://doi.org/10.3390/healthcare14060781
Aly S, Young H-J, Rimmer JH, Mehta T. Prediction of Adherence to an Online Wellness Program for People with Mobility Limitations: A Machine Learning Approach. Healthcare. 2026; 14(6):781. https://doi.org/10.3390/healthcare14060781
Chicago/Turabian StyleAly, Salma, Hui-Ju Young, James H. Rimmer, and Tapan Mehta. 2026. "Prediction of Adherence to an Online Wellness Program for People with Mobility Limitations: A Machine Learning Approach" Healthcare 14, no. 6: 781. https://doi.org/10.3390/healthcare14060781
APA StyleAly, S., Young, H.-J., Rimmer, J. H., & Mehta, T. (2026). Prediction of Adherence to an Online Wellness Program for People with Mobility Limitations: A Machine Learning Approach. Healthcare, 14(6), 781. https://doi.org/10.3390/healthcare14060781

