Next Article in Journal
Examining the Exercise and Self-Esteem Model Revised with Self-Compassion among Hong Kong Secondary School Students Using Structural Equation Modeling
Previous Article in Journal
Sex-Related Disparities in the Incidence and Outcomes of Ischemic Stroke among Type 2 Diabetes Patients. A Matched-Pair Analysis Using the Spanish National Hospital Discharge Database for Years 2016–2018
Previous Article in Special Issue
Examining Public Concerns and Attitudes toward Unfair Events Involving Elderly Travelers during the COVID-19 Pandemic Using Weibo Data
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Impact of Technology-Based Intervention for Improving Self-Management Behaviors in Black Adults with Poor Cardiovascular Health: A Randomized Control Trial

1
Cardiovascular Medicine, Boston University School of Medicine, Boston, MA 02118, USA
2
Department of Medicine, Morehouse School of Medicine, Atlanta, GA 30310, USA
3
Community Health and Preventive Medicine, Morehouse School of Medicine, Atlanta, GA 30310, USA
4
Department of Biostatistics and Bioinformatics, Rollings School of Public Health, Emory University, Atlanta, GA 30322, USA
5
Emory Clinical Cardiovascular Research Institute, Emory University, Atlanta, GA 30322, USA
6
Nell Hodgson Woodruff School of Nursing, Emory University, Atlanta, GA 30322, USA
7
Cardiovascular Research Institute, Morehouse School of Medicine, Atlanta, GA 30310, USA
8
Department of Medicine, Emory University School of Medicine, Atlanta, GA 30322, USA
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2021, 18(7), 3660; https://doi.org/10.3390/ijerph18073660
Submission received: 1 March 2021 / Revised: 21 March 2021 / Accepted: 23 March 2021 / Published: 1 April 2021

Abstract

:
Cardiovascular disease (CVD) is the number one killer of adults in the U.S., with marked ethnic/racial disparities in prevalence, risk factors, associated health behaviors, and death rates. In this study, we recruited and randomized Blacks with poor cardiovascular health in the Atlanta Metro area to receive an intervention comparing two approaches to engagement with a behavioral intervention technology for CVD. Generalized Linear Mixed Models results from a 6-month intervention indicate that 53% of all participants experienced a statistical improvement in Life’s Simple 7 (LS7), 54% in BMI, 61% in blood glucose, and 53% in systolic blood pressure. Females demonstrated a statistically significant improvement in BMI and diastolic blood pressure and a reduction in self-reported physical activity. We found no significant differences in changes in LS7 or their constituent parts but found strong evidence that health coaches can help improve overall LS7 in participants living in at-risk neighborhoods. In terms of clinical significance, our result indicates that improvements in LS7 correspond to a 7% lifetime reduction of incident CVD. Our findings suggest that technology-enabled self-management can be effective for managing selected CVD risk factors among Blacks.

1. Introduction

Cardiovascular disease (CVD) is the number one killer of men and women in the U.S., with marked ethnic/racial disparities in prevalence, risk factors, associated health behaviors, and death rates [1,2]. There are a multitude of factors that may predispose Blacks to increased CVD risk. Individual-level characteristics, including socio-economic status, education level, and health literacy contribute to the CVD disparities observed between Blacks and Whites and within the Black community [1,3,4]. So too does a higher prevalence of hypertension, diabetes, and obesity in Black communities, which is associated with ethnic disparities in health behaviors that contribute to CVD risk [1,5,6]. These factors include higher levels of physical inactivity, smoking, greater than moderate drinking, dietary factors, and psychological distress which are more common among Blacks compared to Whites [1,6,7]. Healthy behaviors as well as psychosocial well-being are modulated by neighborhood factors (e.g., availability of food choices, walkability, social cohesion, violence) [8,9,10,11]. In this way, environmental factors are also key to understanding differences in cardiovascular health with some geographies having higher than expected cardiovascular mortality, hospitalizations, and emergency department visits (at-risk) than others (resilient) [12].
The American Heart Association has defined ideal cardiovascular health based on the management of seven risk factors (Life’s Simple 7, LS7): smoking status, physical activity, weight, diet, blood glucose, cholesterol, and blood pressure [13]. Previous studies have demonstrated that behavioral interventions can contribute to the cessation of smoking [14,15], increased physical activity [16,17,18], enhanced nutrition [19,20], and reduced blood sugar, cholesterol, and blood pressure levels [20]. Patients with ideal health in five or more LS7 risk factors over a 4–7-year period enjoyed close to an 80% reduction in mortality and an almost 90% drop in mortality associated with CVD [21]. The efficacy of self-management interventions to improve health behaviors and address CVD risk factors for low income and minority populations can also be further enhanced by social support factors, including family and peer support [4,15,16]. In sum, while changing behavior can be difficult, self-management is critical for preventing and managing CVD. However, effective solutions like targeting and tailoring of lifestyle interventions are labor intensive and can be cost prohibitive.
Behavioral intervention technologies can provide scalable solutions to support patients in actively managing their health. Behavioral intervention technologies allow for the tailoring of tools to the individual, timely information delivery, standardized messaging, layered content for more motivated participants, and the potential for greater efficiency/cost savings. With the rise of e-health, behavioral intervention technologies have been shown to provide effective and sustainable self-management tools for patients with chronic diseases. Yet, these benefits have not extended to minority and other underserved patient populations and in turn may exacerbate health disparities [22]. The barriers to minority populations’ engagement with e-health solutions and interventions include lack of perceived value, such technologies creating more work, limited health and technology literacy, cognitive and physical disabilities, lack of cultural relevance, limited access to computers/hardware, privacy/trust concerns, technical problems, and unclear or confusing instructions on the use of e-health technologies [23].
The purpose of this study was to drive health behavior change among Blacks with poor cardiovascular health in the Atlanta Metro area, while addressing barriers to the effective use of behavioral intervention technologies for self-management of CVD. Specifically, we wanted to test whether a health coach trained to reinforce behavior change in addition to Health360x, a behavioral intervention technology developed at Morehouse School of Medicine for self-management of chronic conditions, improves cardiovascular health profiles (as defined by LS7) when compared to the use of Health360x alone. In previous work, we showed that coaching can help maintain engagement in technology-enabled behavioral interventions and improve self-efficacy for behavior change through a combination of goal setting, self-monitoring, and problem solving among other evidence-based behavior change strategies [24]. Our hypothesis is that an intervention combining Health360x with a health coach (high tech-high touch) will be more effective in improving cardiovascular health of patients with low LS7 scores as we believe it will help with patient engagement and attainment of self-management goals.

2. Methods

2.1. Participants and Recruitment

In order to investigate the impact of a technology-based intervention on behavior change among Blacks in Atlanta who have high cardiovascular risk, we recruited participants through the Morehouse-Emory Cardiovascular (MECA) Center for Health Equity study. The goal of the overall parent study was to explore individual and neighborhood factors that are protective against poor cardiovascular health among Blacks in greater Atlanta [25]. The Metro Atlanta is ideal for assessing the impact of technology-based intervention on improvements in CVD risk among Blacks for two reasons. First, there are several CVD risk factors in Georgia which exceed the national average: the prevalence of hypertension, diabetes, and physical inactivity are 30.4%, 10.1%, and 24.7% compared to the national prevalence of 27.8%, 8.0%, and 23.0%, respectively [26,27]. Second, there is rich diversity in ethnic origin and socioeconomic status within the Black community in Atlanta.
Participants from the baseline MECA clinical study completed patient visits at the Emory University Hospital, Emory Clinical Cardiovascular Research Institute (ECCRI), and Morehouse School of Medicine in order to measure risk factors and calculate Life’s Simple 7 (LS7) scores. The dietary intake of fruits and vegetables was assessed using the Block Fruit and Vegetable Screener [28] and the Delta NIRI Food Frequency Questionnaire for African Americans [29] and physical activity using the Paffenbarger Physical Activity Questionnaire [30]. Blood pressure readings were conducted three times with the volunteer at rest in the sitting position and categorized according to the Joint National Committee on BP recommendations [31]. To calculate Body Mass Index (BMI), weight (kg) was measured with the participant wearing street clothes without shoes and height (m) was assessed with the participant standing on a flat surface against a wall. Waist and hip circumferences were obtained using a non-elastic tape measure midway between the lowest rib margin and the iliac crest, 1 inch above the umbilicus following established guidelines. Blood specimens (120 mL) were also collected after overnight fasting for testing blood glucose/insulin and a full lipid panel (total, low density, high density cholesterol, and triglyceride levels) as well as an extended chemistry panel and complete blood count using standard methods. LDL-C was determined using Friedwald’s equation using results from lab testing.
The results from this data collection were used to calculate LS7 using a scoring algorithm adopted from the Goals and Metrics Committee of the Strategic Planning Task Force of the American Heart Association [32].
  • BMI: Poor = ≥ 30.0 kg/m2; Intermediate = 25.0–29.9 kg/m2; Ideal = <25.0 kg/m2;
  • Cholesterol: Poor = ≥ 240 mg/dL; Intermediate = 200–239 mg/dL (untreated) or treated to goal; Ideal = < 200 mg/dL (untreated);
  • BP: Poor = SBP ≥ 140 mmHg or DBP ≥ 90 mmHg; Intermediate = Systolic Blood Pressure (SBP) 120–139 mmHg, Diastolic Blood Pressure (DBP) 80–89 mmHg, or treated to goal; Ideal = SBP < 140 mmHg and DBP < 90 mmHg;
  • Fasting glucose: Poor = ≥ 126 mg/dL; Intermediate = 100–125 mg/dL (untreated) or treated to goal; Ideal = <100 mg/dL (untreated).
In addition, participants who were currently smoking were classified as Poor, those who were former smokers, but quit ≤ 12 months ago were classified as Intermediate, and those who had never smoked or quit >12 months ago fell into the Ideal LS7 category. Finally, a healthy diet score was assessed based on the 5 aspects of diet selected by the American Heart Association: fruits/vegetables (≥ 4.5 cups/day), fish (≥two 3.5-oz servings/week), fiber-rich whole grains (≥ 1.1 g of fiber per 10 g of carbohydrates, and sodium. Participants with 0 or 1 components were classified as Poor, 2–3 components Intermediate, and 4–5 components as Ideal. The LS 7 score ranges between 0–14, giving 2 points for Ideal, 1 point for Intermediate, and 0 points for Poor components [33].
All participants in the baseline clinical study with low LS7 scores who agreed to be contacted for this study were contacted by the research staff. To reach recruitment goals, participants were also recruited from databases where volunteers consented to be contacted for research studies (including ResearchMatch.org, accessed on 28 July 2021), through self-referral in response to advertising placed with community partners, as well as radio and television ads. At the time of recruitment, the following contact information was collected from participants: (i) a telephone number capable of receiving text messages, (ii) email address, (iii) home address, and (iv) email and street addresses of two personal contacts of the participant. An enrollment package was sent by email to the interested participants, including introductory study information and an online screening form. Non-responders received follow-up calls from study staff and live chat sessions were organized to answer questions about the project. Once participants completed the study forms, enrollment information, and directions on how to complete informed consent online were provided to those who met study inclusion criteria. Once the consent process was completed, training on the use of Health360x began. All protocols were approved by Emory University and Morehouse School of Medicine IRBs.

Inclusion and Exclusion Criteria

In order to be eligible for the study, participants needed an LS7 composite score of 8 or lower, access to the internet, a self-reported ability to participate in increased physical activity, and English fluency. The exclusion criteria included history of coronary artery disease (CAD) documented by CAD diagnosis or prior acute myocardial infarction, percutaneous coronary intervention, coronary artery bypass surgery, or chronic angina; aortic stenosis; history of chronic diseases that may alter brachial artery flow-mediated vasodilation measurements, such as peripheral vascular disease, HIV/AIDs, lupus, and cancer. Additionally, we excluded participants unwilling to use the internet and those with a history of alcohol or drug abuse or psychiatric diagnosis that would interfere with their ability to participate. Pregnant and/or breastfeeding women were also excluded as were participants with cognitive deficits severe enough to preclude meaningful participation.

2.2. H360x Intervention for Cardiovascular Disease Self-Management

This study provides a theory-based approach to engaging a vulnerable population in a technology-enabled behavioral intervention. The intervention is designed to compare two approaches to engagement (technology alone versus technology coupled with a health coach) and behavior change. The underlying construct of behavioral change (with Health360x) is a system that frames behavior as changeable and adaptable in a bidirectional manner, based on capability, opportunity, and motivation. Capability is the psychological and physical capacity to engage in the activity concerned, including the necessary knowledge and skills. Motivation is largely governed by the cognitive processes that energize and direct behavior, including goal-directed conscious decision-making, habitual processes, emotional response, as well as analytical decision-making. Opportunity refers to factors that lie outside the individual, that facilitate or prompt the behavior. Enhanced self-efficacy for behavior change in turn leads to improved cardiovascular health outcomes.
Health360x (Accuhealth, Atlanta, USA) is a patented behavioral intervention technology platform developed at the Morehouse School of Medicine to assist with chronic illness care [24,34]. It is available as a web-based or mobile application and supports behavior change by providing functionality for improving health literacy and self-efficacy through built-in coaching support for accountability and problem solving. The application also provides a social networking forum to promote motivation and community, as well as a curriculum and health tracker that can record blood pressure, BMI, physical activity, and self-management goals. The selected, consenting participants were trained on (a) how to create a user profile with brief demographic information, (b) how to participate in a forum, (c) how to search and browse, and (d) how to send private messages and post comments. All participants were trained to use the technology-based smart application to monitor the management of their CVD risk factors including blood sugar, hypertension, BMI, and total cholesterol, while improving their lifestyles in terms of diet, smoking, and physical activity.
After completing training, participants completed a brief test of their ability to navigate and use Health360x. Specifically, we tested a user’s ability to sign on, navigate to different parts of the application, upload and view data, set and track behavioral goals, find and complete study-related questionnaires, send emails to the study team, post to an online community forum, and access educational content. Once a participant successfully completed the test, they were randomized to the respective clinical intervention arm: Arm A (high tech only) or Arm B (high tech-high touch). Coaches met with participants in Arm B in person or by phone every week for the 1st month, then every two 2 weeks for 8 weeks, and finally monthly for 3 months. The purpose of each visit was to advance a patient’s self-efficacy for self-management behaviors. The coaches were trained to use appreciative inquiry techniques to identify barriers to behavior change and co-develop a plan to address barriers with their participants. All participants were provided 24/7 technical support, but participants in Arm B had access to coaches and the ability to ask questions using secure messaging within Health360x, including technical assistance.

Randomization

The underlying implementation study design was based on a parallel controlled permuted block randomization scheme. We used variable-block size randomization algorithm to eliminate selection bias and to ensure intermittent as well as overall balance in outcome predictor variables between those assigned to Arm A (Health360x alone) or Arm B (Health360x and health coach). The participants were stratified based on sex-at-birth and neighborhood-community (at-risk, resilient). Census tracts with higher (lower) than expected cardiovascular deaths, emergency department (ED) visits, and hospitalizations for black adults aged 35 to 64 from 2010 through 2014 were classified as at risk (resilient) [12]. The high tech-high touch group (Arm B) received Health360x and a health coach who helped them create personalized action plans (in Health360x). Figure 1 provides a flowchart including counts of participants who were screened, randomized.

2.3. Statistical Methods

2.3.1. Outcomes, Mediators and Effect-Modifier Variables

The primary outcome variables considered here are the 6 month-change in LS7 (e.g., smoking status, physical activity, weight, diet, blood glucose, cholesterol, and blood pressure). These health behaviors and metrics represent seven out of the top 10 most costly CVD risk factors [35]. The LS 7 score ranges between 0 and 14, giving 2 points for ideal, 1 point for intermediate, and 0 points for poor components [33]. Additional outcome measures were compiled from the 6-month changes in the underlying CVD risk variables. This included improvements in LS7 (Δ > 0), blood pressure (Δ mmHg < 0 in both SBP and DBP), Blood glucose (Δ < 0) and BMI (Δ < 0)
The baseline covariates employed in these analyses included age, sex at birth, highest level of education, and neighborhood classification (at risk, resilient, or neither) as well as the baseline measurements of the clinical variables and LS7. Multivariable analyses were further adjusted for an engagement variable to measure the use of Health360x. The engagement variable for using Health360x was captured through the following computed variables: number of successful logins, average interval between successful logins, median interval between successful logins, number of sessions as defined by app usage occurring after >= 5 min of no activity, average session duration, median session duration, average lapsed time between sessions, and median lapsed time between sessions.

2.3.2. Sample Size Calculation

The original power calculations of this study used preliminary data of the reported LS7 score [36] with a two-sided 0.05 significance level, 20% attrition rate, and a sample size of 120 (n = 60 per group), yielding 80% power to detect a 1.04 difference in the overall LS7 score at 6 months between the two randomization arms.

2.3.3. Statistical Analysis

The participants’ characteristics, including demographics, baseline, and 6-month changes in CVD risk variables were summarized and compared by the randomization groups (coaching vs. no coaching). Binary/categorical variables like sex at birth, education, and the presence of diabetes were summarized using frequencies and percentages. Continuous variables like age, BMI, and blood glucose were summarized by means and standard deviations. Baseline characteristics and outcome variables of CVD risk factors were compared between randomization groups using Chi-Square/Fisher exact tests for categorical variables and the t-test/Mann–Whitney test for continuous variables. For the evaluation of baseline balance, we also utilized a univariate logistics function with the likelihood of being on one of the randomization groups as an outcome vis-à-vis each of the potential predictors of the outcome measures, to determine any association with patient’s baseline characteristics Statistically insignificant p-values indicate that the patient characteristic (i.e., age) is not correlated with assignment to randomization group suggesting comparability between groups.
Generalized Linear Mixed Models (GLMM) techniques with several iterations were pursued for multivariable analyses due to their capabilities to accommodate (1) infusing a random effect component (census tract/neighborhood), (2) affording participants their own random intercept and (3) normally, non-normally- distributed, and binary outcomes using the identity or the logit link. The effect of the intervention (Health360x and a health coach) on study outcomes was examined using GLMM to adjust for demographics, potential confounding variables, and effect modifiers variables, as well as frequency and duration of use of the Health360x. The overall α-level was set at 0.05 while adjusting for multiple comparisons, if needed. SAS version 9.4 (SAS Institute, Cary, USA) was used for analyses.

3. Results

A total of 120 eligible participants (n = 58 vs. n = 62 in the coaching vs. no coaching groups) were included in these analyses. Table 1 provides an overview of the participants’ characteristics by study arm. In Table 2, we provide participants details on LS7 and its components at baseline and at 6 months to characterize CVD risk burden by study arm. To emphasize engagement with Health360x as well as CVD risk burden using visual description, we provide graphical representations of number of successful logins, LS7, diastolic and systolic BP, BMI and smoking status by randomization group in Figure 2, Figure 3, Figure 4, Figure 5, Figure 6 and Figure 7.
The randomized groups (coaching vs. no coaching) indicated 51.7% vs. 54.8% improvement in 6-month LS7, p-value = 0.73. Figure 8 provides a cumulative distribution function of 6-month change in LS7 between randomization groups. In addition, we found improvements by randomized groups 43.1% (coaching) vs. 29.0% (no coaching) in blood pressure (improvement in both SBP and DBP), p-value = 0.11; 51.7% (coaching) vs. 56.4% (no coaching) in BMI, p-value = 0.6038 and 63.8% (coaching) vs. 58.1% (no coaching) in Blood glucose, p-value = 0.5209. Additionally, smoking status comparison between baseline and 12 months did not change significantly.
The main effects GLMM indicated no statistically significant differences between the coaching and no coaching groups in changes (as continuous variables) in LS7, SBP, DBP, BMI, or time spent in physical activities (Table 1 and Table 3). However, females relative to males and independent of their randomization group assignment, demonstrated a statistically significant improvement in the 6-month change in BMI and DBP (an average improvement, respectively, of 1.16; p-value = 0.01 and 4.1 mmHg, p-value = 0.04). Additionally, females (versus males) also indicated a significant reduction in time spent in physical activities (see Table 3a–c).
Multiple comparisons-adjusted subgroup analyses using GLMM interaction models indicated that the coaching group (vs. the no coaching group) had a statistically significant advantage in improvement in LS7 for those who resided in the “at risk” neighborhoods (an average improvement of 1.13; p-value = 0.04). Additional main and interaction (randomization group with neighborhood type/gender) GLMM analyses using improvement (as a yes/no binary outcome) in LS7, blood pressure, blood glucose, and BMI indicated no statistically significant advantage for the coaching vs. the no coaching (see Table 4).

4. Discussion

4.1. Principal Findings

The study adopted a stratified permuted block randomization scheme to balance all baseline characteristics, including CVD risk factors. Though statistical significance between coaching and no coaching groups was not reached, results indicated that 53% of all participants using Health360x experienced improvement (of Δ ≥ 1) in LS7, 54% in BMI, 61% in blood glucose, and 53% in SBP, indicating that technology-enabled self-management can be effective for managing selected CVD risk factors among Blacks. It is worth noting that those who demonstrated improvement in their LS7 at 6 months (n = 64, mean Δ = 1.7) had a median reduction of 6mmHg in SBP, 8mg/dl in BG, 0.15 units in BMI, and a 30-minute increase per week in time spent in physical activity. It is also imperative to point out that the overall mean increase of 0.5 in LS7 at 6 months suggests an average reduction of 6.5% in the risk of CVD [37]. In our study and irrespective of the intervention effect, females at 6 months demonstrated a statistically significant improvement in BMI and diastolic blood pressure. Interestingly, however, females also showed significant reduction in self-reported time spent in physical activities, suggesting presence of individual differences in how self-management, like dieting and self-efficacy, can influence health. Finally, though the results suggest mixed evidence of health coaching (above and beyond technology) influencing cardiovascular health, we found no significant differences between randomized groups in changes expressed in continuous or binary (yes/no) units of LS7 composite scores or their constituent parts between baseline and 6 months. However, additional subgroup analyses indicated strong evidence that health coaches can help improve overall LS7 in at-risk neighborhoods.

4.2. Limitations

We identified a few limitations of our study. First, the technology infrastructure underlying Health360x went through some significant changes during the intervention. While the features and functionality of the platform remained the same, the backend was revamped which led to participants facing some technical issues during migration (e.g., unable to sign-in to profiles) and differences in how usage data was defined and collected. The latter issue around usage data limited our measurement of user engagement with Health360x to variables that captured when and how long participants used Health360x. We were unable to capture “how” (i.e., what features/functionality) participants were using the platform which was a second limitation of our study. There are many ways in which a participant can use Health360x after logging on (i.e., tracking health, setting goals, etc.). Understanding how participants are using the application and the factors that lead them to oscillate between usage and inactivity are essential to understanding the minimum necessary “dose” of engagement to gain benefit.
Another possible explanation for the inability to reach statistical significance between coaching and no coaching group is the presence of a relatively higher heterogeneity in the outcome measures that may have diminished the effect size. This issue could be addressed by having a larger sample size and/or longer follow up.
A final limitation comes from the recurring realization in the recruitment of coaches and implementation of the study: not all coaches are created equal. Coaches varied in terms of their motivation for participation in the study, their professional background, and lived experiences all of which influences interactions with participants. The coaches were trained on Health360x and completed modules on appreciative inquiry but would have benefited from more uniform training in cultural congruence and cognitive behavioral therapy or motivational interviewing.

5. Conclusions

In this study, we determined the impact of a technology-based intervention (Health360x) for improving self-management of Morehouse-Emory Cardiovascular (MECA) recruited participants in terms of CVD risk factors. The overall goal of MECA is to investigate the social and environmental factors that lead to risk and resilience among Blacks, with a geographic focus on the Atlanta Metro area. In this clinical intervention study, we explored the role of coaching on improving CVD risk factors and found evidence suggesting that health coaching can help promote engagement in and adherence to technology-enabled self-management interventions and in turn cardiovascular health. The findings also suggest the need for longer follow-on studies with a larger sample size, featured by closer monitoring of engagement and use of technology-based behavioral health intervention technologies like Health360x.

Author Contributions

Conceptualization of the project was led by S.D., A.A.Q., and P.P.; methodology was developed by S.D., A.A.Q., P.P., Y.-A.K., M.M., and M.Y.I.; formal analysis was conducted by M.M., investigation was led by A.A.Q., P.P., S.J.I., and T.W.-P.; writing and original draft preparation was completed by M.Y.I. and T.W.-P.; funding acquisition was completed by P.P., A.A.Q., S.D., and H.T. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by the American Heart Association Strategically Focused Research Network on Disparities grant number 0000031288.

Institutional Review Board Statement

The study was approved by the Institutional Review Board of Morehouse School of Medicine (protocol code 809392).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Data and code to generate results will be shared by authors upon request. Please contact the corresponding author.

Acknowledgments

We would like to acknowledge Ernest Alema-Mensah, Elizabeth Olorundare, Jan Morgan Billingslea, Kayellen Umeakunne, Pamela Cooper, Brenda Lank-ford, and all participants and volunteer research assistants for the technical assistance through the study.

Conflicts of Interest

Priscilla Pemu is one of the authors of the patent of Health360x.

References

  1. Virani, S.S.; Alonso, A.; Benjamin, E.J.; Bittencourt, M.S.; Callaway, C.W.; Carson, A.P.; Chamberlain, A.M.; Chang, A.R.; Cheng, S.; Delling, F.N.; et al. Heart Disease and Stroke Statistics—2020 Update: A Report From the American Heart Association. Circulation 2020, 141, e139–e596. [Google Scholar] [CrossRef] [PubMed]
  2. Daumit, G.L.; Hermann, J.A.; Coresh, J.; Powe, N.R. Use of cardiovascular procedures among black persons and white persons: A 7-year nationwide study in patients with renal disease. Ann. Intern. Med. 1999, 130, 173–182. [Google Scholar] [CrossRef] [PubMed]
  3. Bell, C.N.; Thorpe, R.J.; Bowie, J.V.; LaVeist, T.A. Race disparities in cardiovascular disease risk factors within socioeconomic status strata. Ann. Epidemiol. 2018, 28, 147–152. [Google Scholar] [CrossRef]
  4. Schultz, W.M.; Kelli, H.M.; Lisko, J.C.; Varghese, T.; Shen, J.; Sandesara, P.; Quyyumi, A.A.; Taylor, H.A.; Gulati, M.; Harold, J.G.; et al. Socioeconomic Status and Cardiovascular Outcomes. Circulation 2018, 137, 2166–2178. [Google Scholar] [CrossRef] [PubMed]
  5. Brothers, R.M.; Fadel, P.J.; Keller, D.M. Racial disparities in cardiovascular disease risk: Mechanisms of vascular dysfunction. Am. J. Physiol. Circ. Physiol. 2019, 317, H777–H789. [Google Scholar] [CrossRef]
  6. Dubbert, P.M.; Robinson, J.C.; Sung, J.H.; Ainsworth, B.E.; Wyatt, S.B.; Carithers, T.; Newton, R.; Rhudy, J.L.; Barbour, K.; Sternfeld, B.; et al. Physical Activity and Obesity in African Americans: The Jackson Heart Study. Ethn. Dis. 2010, 20, 383–389. [Google Scholar]
  7. Gillum, R. Frequency of attendance at religious services and cigarette smoking in American women and men: The Third National Health and Nutrition Examination Survey. Prev. Med. 2005, 41, 607–613. [Google Scholar] [CrossRef]
  8. Robinson, J.C.; Wyatt, S.B.; Dubbert, P.M.; May, W.; Sims, M. The impact of neighborhood on physical activity in the Jackson Heart Study. Prev. Med. 2016, 90, 216–222. [Google Scholar] [CrossRef] [Green Version]
  9. Islam, S.J.; Kim, J.H.; Baltrus, P.; Topel, M.L.; Liu, C.; Ko, Y.-A.; Mujahid, M.S.; Vaccarino, V.; Sims, M.; Mubasher, M.; et al. Neighborhood Characteristics and Ideal Cardiovascular Health Among Black Adults: Results From the Morehouse-Emory Cardiovascular (MECA) Center for Health Equity. Ann. Epidemiol. 2020. [Google Scholar] [CrossRef]
  10. Topel, M.L.; Kim, J.H.; Mujahid, M.S.; Ko, Y.; Vaccarino, V.; Mubasher, M.; Liu, C.; Dunbar, S.; Sims, M.; Taylor, H.A.; et al. Individual Characteristics of Resilience are Associated With Lower-Than-Expected Neighborhood Rates of Cardiovascular Disease in Blacks: Results From the Morehouse-Emory Cardiovascular (MECA) Center for Health Equity Study. J. Am. Heart Assoc. 2019, 8, e011633. [Google Scholar] [CrossRef] [PubMed]
  11. Clark, C.R.; Ommerborn, M.J.; Hickson, D.A.; Grooms, K.N.; Sims, M.; Taylor, H.A.; Albert, M.A. Neighborhood Disadvantage, Neighborhood Safety and Cardiometabolic Risk Factors in African Americans: Biosocial Associations in the Jackson Heart Study. PLoS ONE 2013, 8, e63254. [Google Scholar] [CrossRef] [Green Version]
  12. Kim, J.H.; Lewis, T.T.; Topel, M.L.; Mubasher, M.; Li, C.; Vaccarino, V.; Mujahid, M.S.; Sims, M.; Quyyumi, A.A.; Taylor, H.A.; et al. Identification of Resilient and At-Risk Neighborhoods for Cardiovascular Disease Among Black Residents: The Morehouse-Emory Cardiovascular (MECA) Center for Health Equity Study. Prev. Chronic Dis. 2019, 16, E57. [Google Scholar] [CrossRef]
  13. My Life Check: Life’s Simple 7. Available online: www.heart.org/en/healthy-living/healthy-lifestyle/my-life-check-lifes-simple-7 (accessed on 25 February 2021).
  14. Brown, J.; Michie, S.; Geraghty, A.W.A.; Yardley, L.; Gardner, B.; Shahab, L.; Stapleton, J.A.; West, R. Internet-based intervention for smoking cessation (StopAdvisor) in people with low and high socioeconomic status: A randomised controlled trial. Lancet Respir. Med. 2014, 2, 997–1006. [Google Scholar] [CrossRef] [Green Version]
  15. Thomas, R.E.; Lorenzetti, D.L.; Spragins, W. Systematic Review of Mentoring to Prevent or Reduce Tobacco Use by Adolescents. Acad. Pediatr. 2013, 13, 300–307. [Google Scholar] [CrossRef] [PubMed]
  16. Spencer, R.A.; Bower, J.; Kirk, S.F.L.; Friesen, C.H. Peer Mentoring Is Associated With Positive Change in Physical Activity and Aerobic Fitness of Grades 4, 5, and 6 Students in the Heart Healthy Kids Program. Health Promot. Pr. 2014, 15, 803–811. [Google Scholar] [CrossRef]
  17. Schulz, A.J.; Israel, B.A.; Mentz, G.B.; Bernal, C.; Caver, D.; Demajo, R.; Diaz, G.; Gamboa, C.; Gaines, C.; Hoston, B.; et al. Effectiveness of a Walking Group Intervention to Promote Physical Activity and Cardiovascular Health in Predominantly Non-Hispanic Black and Hispanic Urban Neighborhoods. Health Educ. Behav. 2015, 42, 380–392. [Google Scholar] [CrossRef] [Green Version]
  18. Jiang, L.; Huang, H.; Johnson, A.; Dill, E.J.; Beals, J.; Manson, S.M.; Roubideaux, Y.; Project, T.S.D.P.F.I.D.P.D. Socioeconomic Disparities in Weight and Behavioral Outcomes among American Indian and Alaska Native Participants of a Translational Lifestyle Intervention Project. Diabetes Care 2015, 38, 2090–2099. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  19. Siren, R.; Eriksson, J.G.; Peltonen, M.; Vanhanen, H. Impact of Health Counselling on Cardiovascular Disease Risk in Middle Aged Men: Influence of Socioeconomic Status. PLoS ONE 2014, 9, e88959. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  20. Lefevre, M.L. Behavioral Counseling to Promote a Healthful Diet and Physical Activity for Cardiovascular Disease Prevention in Adults with Cardiovascular Risk Factors: U.S. Preventive Services Task Force Recommendation Statement. Ann. Intern. Med. 2014, 161, 587–593. [Google Scholar] [CrossRef]
  21. Ford, E.S.; Greenlund, K.J.; Hong, Y. Ideal Cardiovascular Health and Mortality from All Causes and Diseases of the Circulatory System among Adults in the United States. Circulation 2012, 125, 987–995. [Google Scholar] [CrossRef] [PubMed]
  22. Fox, S. Health Topics. [online] Pew Research Center. 2011. Available online: https://web.archive.org/web/20111112000032; http://pewinternet.org/~/media/Files/Reports/2011/PIP_HealthTopics.pdf (accessed on 25 February 2021).
  23. Christopher Gibbons, M. Use of health information technology among racial and ethnic underserved communities. Perspect Health Inf. Manag. 2011, 8, 1f. [Google Scholar] [PubMed]
  24. Pemu, P.; Willock, R.J.; Alema-Mensa, E.; Rollins, L.; Brown, M.; Clair, B.S.; Olorundare, E.; McCaslin, A.; Akintobi, T.H.; Quarshie, A.; et al. Achieving Health Equity with e-Healthystrides©: Patient Perspectives of a Consumer Health Information Technology Application. Ethn. Dis. 2019, 29, 393–404. [Google Scholar] [CrossRef]
  25. Islam, S.J.; Kim, J.H.; Topel, M.; Liu, C.; Ko, Y.; Mujahid, M.S.; Sims, M.; Mubasher, M.; Ejaz, K.; Morgan-Billingslea, J.; et al. Cardiovascular Risk and Resilience Among Black Adults: Rationale and Design of the MECA Study. J. Am. Heart Assoc. 2020, 9, e015247. [Google Scholar] [CrossRef] [PubMed]
  26. Mensah, G.A.; Mokdad, A.H.; Ford, E.S.; Greenlund, K.J.; Croft, J.B. State of Disparities in Cardiovascular Health in the United States. Circ. 2005, 111, 1233–1241. [Google Scholar] [CrossRef] [PubMed]
  27. Obisesan, T.O.; Vargas, C.M.; Gillum, R.F. Geographic Variation in Stroke Risk in the United States. Stroke 2000, 31, 19–25. [Google Scholar] [CrossRef] [Green Version]
  28. Block, G.; Gillespie, C.; Rosenbaum, E.H.; Jenson, C. A rapid food screener to assess fat and fruit and vegetable intake. Am. J. Prev. Med. 2000, 18, 284–288. [Google Scholar] [CrossRef]
  29. Holmes, M.D.; Powell, I.J.; Campos, H.; Stampfer, M.J.; Giovannucci, E.L.; Willett, W.C. Validation of a food frequency questionnaire measurement of selected nutrients using biological markers in African-American men. Eur. J. Clin. Nutr. 2007, 61, 1328–1336. [Google Scholar] [CrossRef] [Green Version]
  30. Simpson, K.; Parker, B.A.; Capizzi, J.A.; Thompson, P.; Clarkson, P.M.; Freedson, P.S.; Pescatello, L.S. Validity and Reliability of Question 8 of the Paffenbarger Physical Activity Questionnaire Among Healthy Adults. J. Phys. Act. Health 2015, 12, 116–123. [Google Scholar] [CrossRef]
  31. Chobanian, A.V.; Bakris, G.L.; Black, H.R.; Cushman, W.C.; Green, L.A.; Izzo, J.J.L.; Jones, D.W.; Materson, B.J.; Oparil, S.; Wright, J.J.T.; et al. The Seventh Report of the Joint National Committee on Prevention, Detection, Evaluation, and Treatment of High Blood PressureThe JNC 7 Report. JAMA 2003, 289, 2560–2571. [Google Scholar] [CrossRef]
  32. Lloyd-Jones, D.M.; Hong, Y.; Labarthe, D.; Mozaffarian, D.; Appel, L.J.; Van Horn, L.; Greenlund, K.; Daniels, S.; Nichol, G.; Tomaselli, G.F.; et al. American heart association strategic planning task force and statistics committee defining and setting national goals for cardiovascular health promotion and disease reduction: The American heart association’s strategic impact goal through 2020 and beyond. Circulation 2010, 121, 586–613. [Google Scholar] [CrossRef] [Green Version]
  33. Folsom, A.R.; Shah, A.M.; Lutsey, P.L.; Roetker, N.S.; Alonso, A.; Avery, C.L.; Miedema, M.D.; Konety, S.; Chang, P.P.; Solomon, S.D. American Heart Association’s Life’s Simple 7: Avoiding Heart Failure and Preserving Cardiac Structure and Function. Am. J. Med. 2015, 128, 970–976.e2. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  34. Ofili, E.; Pemu, P.; Quarshie, A.; Johnson, P.; Linn, L.J.; Kaur, D.; Ali, J. System and Method for Chronic Illness Care. U.S. Patent US20100017229A1, 21 January 2010. [Google Scholar]
  35. Goetzel, R.Z.; Pei, X.; Tabrizi, M.J.; Henke, R.M.; Kowlessar, N.; Nelson, C.F.; Metz, R.D. Ten Modifiable Health Risk Factors Are Linked To More Than One-Fifth Of Employer-Employee Health Care Spending. Health Aff. 2012, 31, 2474–2484. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  36. Al Mheid, I.; Kelli, H.M.; Ko, Y.; Hammadah, M.; Ahmed, H.; Hayek, S.; Vaccarino, V.; Ziegler, T.R.; Gibson, G.; Lampl, M.; et al. Effects of a Health-Partner Intervention on Cardiovascular Risk. J. Am. Heart Assoc. 2016, 5, e004217. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  37. Xanthakis, V.; Enserro, D.M.; Murabito, J.M.; Polak, J.F.; Wollert, K.C.; Januzzi, J.L.; Wang, T.J.; Tofler, G.; Vasan, R.S. Ideal Cardiovascular Health. Circulation 2014, 130, 1676–1683. [Google Scholar] [CrossRef] [PubMed] [Green Version]
Figure 1. Flowchart of screening, randomization, and follow up.
Figure 1. Flowchart of screening, randomization, and follow up.
Ijerph 18 03660 g001
Figure 2. Number of successful logins by randomization group.
Figure 2. Number of successful logins by randomization group.
Ijerph 18 03660 g002
Figure 3. Life’s Simple 7 by study visit and randomization group.
Figure 3. Life’s Simple 7 by study visit and randomization group.
Ijerph 18 03660 g003
Figure 4. Systolic blood pressure by study visit and randomization group.
Figure 4. Systolic blood pressure by study visit and randomization group.
Ijerph 18 03660 g004
Figure 5. Diastolic blood pressure by study visit and randomization group.
Figure 5. Diastolic blood pressure by study visit and randomization group.
Ijerph 18 03660 g005
Figure 6. BMI by study visit and randomization group.
Figure 6. BMI by study visit and randomization group.
Ijerph 18 03660 g006
Figure 7. Baseline vs 12 months smoking status.
Figure 7. Baseline vs 12 months smoking status.
Ijerph 18 03660 g007
Figure 8. Cumulative distribution function of 6-month change in LS7 Fitted with a beta function.
Figure 8. Cumulative distribution function of 6-month change in LS7 Fitted with a beta function.
Ijerph 18 03660 g008
Table 1. Participants’ characteristics.
Table 1. Participants’ characteristics.
Baseline CharacteristicsTreatment Assignment Coach vs. No Coach
AllCoach (n = 58)No Coach (n = 62)p-Value
n (%)Mean (SD)n (%)Mean (SD)n (%)Mean (SD)
Age at Baseline120 (100)55.6 (8.87)58 (100)56.2 (8.32)62 (100)55.1 (9.09)0.5112
Sex at Birth
Females80 (66.67)-40 (68.97)-40 (64.52)-0.6056
Income -
Less than $25,00061 (50.83)-28 (48.28)-33 (53.23)-0.7993
$25,000 to <$50,00026 (21.67)-16 (27.59)-10 (16.13)-0.3803
$50,000 or higher28 (23.33)-12 (20.69)-16 (25.81)-Reference
Don’t Know/not sure5 (4.17)-2 (3.45)-3 (4.84)--
Occupation
Employed50 (41.67)-28 (48.28)-22 (35.48)-0.3572
Unemployed31 (25.83)-12 (20.69)-19 (30.65)-0.5323
Retired39 (32.50)-18 (31.03)-21 (33.87)-Reference
Relationship Status
Divorced/Widowed/Separated58 (48.33)-29 (50.00)-29 (46.77)-0.5348
Married/member of unmarried couple34 (28.33)-17 (29.31)-17 (27.42)-0.5752
Never Married28 (23.33)-12 (20.69)-16 (25.81)-Reference
Census Tract Type (At risk, Resilient or none)
At risk22 (18.33)-9 (19.52)-13 (20.97)-0.3638
Resilient19 (15.83)-8 (13.79)-11 (17.74)-0.4449
None79 (65.83)-41 (70.69)-38 (61.29)-Reference
Highest level of education
High School or less36 (30.00)-15 (25.86)-21 (33.87)-0.3398
Some college or higher84 (70.00)-43 (74.14)-41 (66.13)-Reference
Engagement with Health360x
Number of successful logins104 (86.67)6.9 (10.45)46 (79.31)7.5 (8.23)58 (93.54)6.4 (11.98)0.5013
Number of sessions (e.g., app usage occurring after >=5 min of no activity_104 (86.67)8.1 (11.55)46 (79.31)7.7 (5.23)58 (93.54)8.5 (14.80)0.7054
Median session duration104 (86.67)3.6 (4.09)46 (79.31)3.3 (3.40)58 (93.54)3.8 (4.57)0.5174
Table 2. Baseline and 6-month changes in Life’s Simple 7 (LS7).
Table 2. Baseline and 6-month changes in Life’s Simple 7 (LS7).
LS7 and Key Risk Factors at Baseline and 6 MonthsTreatment Assignment Coach vs. No Coach
AllCoach (n = 58)No Coach (n = 62)p-Value
n (%)Mean (SD)n (%)Mean (SD)n (%)Mean (SD)
LS7
LS7 at Baseline120 (100)6.2 (1.44)58 (100)6.3 (1.44)62 (100)6.1 (1.44)0.1475
LS7 at 6 months120 (100)6.7 (1.72)58 (100)6.8 (1.84)62 (100)6.7 (1.61)0.8323
Difference in LS7 at 6 months120 (100)0.5 (1.52)58 (100)0.4 (1.60)62 (100)0.6 (1.45)0.6331
Blood Pressure (mmHg)
Average Diastolic BP at Baseline120 (100)81.1 (9.81)58 (100)81.4 (9.75)62 (100)80.8 (9.93)0.7424
Average Diastolic BP at 6 months120 (100)81.16 (10.84)58 (100)81.4 (9.82)62 (100)81.7 (11.79)0.8723
Difference in Diastolic BP at 6 months120 (100)0.5 (10.78)58 (100)0.0 (10.48)62 (100)0.9 (11.13)0.6453
Average Systolic BP at Baseline120 (100)133.9 (16.27)58 (100)133 (16.88)62 (100)134.7 (15.77)0.5526
Average Systolic BP at 6 months120 (100)131.5 (18.67)58 (100)129.7 (17.31)62 (100)133.1 (19.86)0.3230
Difference in Systolic BP at 6 months120 (100)−2.4 (18.47)58 (100)20.13 (62)62 (100)−1.6 (16.91)0.6276
Cholesterol (mg/dL)
High cholesterol at Baseline79 (65.83)-42 (72.41)-37 (59.68)-0.1434
Blood Sugar (mg/dL)
Glucose at Baseline120 (100)124.9 (60.25)58 (100)127.4 (72.77)62 (100)122.5 (46.05)0.6503
Glucose at 6 months120 (100)122.8 (65.37)58 (100)113.8 (48.82)62 (100)131.2 (77.2)0.1575
Difference in Blood Glucose at 6 months120 (100)−2.0 (66.46)58 (100)−13.6 (61.31)62 (100)8.8 (69.71)0.0880
Physical Activity (min)
Time spent in moderate exercise at Baseline120 (100)140.4 (175.19)58 (100)142.8 (206.8)62 (100)138.1 (140.95)0.8818
Time spent in moderate exercise at 6 months120 (100)271.4 (685.57)58 (100)349.9 (930.47)62 (100)197.9 (310.72)0.2695
BMI (kg/m2)
BMI at Baseline120 (100)35.4 (7.64)58 (100)34.6 (7.73)62 (100)36.1 (7.56)0.2876
BMI at 6 months120 (100)35.2 (8.43)58 (100)34.0 (8.29)62 (100)36.3 (8.48)0.4497
Difference in BMI at 6 months120 (100)−0.2 (29.92)58 (100)−0.6 (2.31)62 (100)0.2 (3.37)0.1601
Table 3. Generalized Linear Mixed Models (GLMM) multivariate adjusted analyses of continuous variables.
Table 3. Generalized Linear Mixed Models (GLMM) multivariate adjusted analyses of continuous variables.
(a)
VariablesOutcome: LS7 as a Continuous Variable at 6 Months
Treatment Assignment Coach vs. No CoachSex Male (1) Female (0)Census Tract at Risk (1) Resilient (2) None of the Above (3)EstimateStandard Errorp-Value
Treatment AssignmentCoaching −0.52100.36310.1548
Sex Female −0.34980.29640.2411
Treatment × AreaCoaching At risk (1)1.12690.54980.0433
Median lapsed time between sessions −0.000028.599 × 10−60.0357
(b)
VariablesOutcome: BMI as a Continuous Variable at 6 Months
Treatment Assignment Coach (1) No Coach (0Sex Male (1) Female (0)Census Tract at Risk (1) Resilient (2) None of the Above (3)EstimateStandard Errorp-Value
Treatment AssignmentCoaching −0.18960.61240.7576
Sex Female −1.62340.62990.0116
LS7 0.13990.22280.5315
Median Lapsed Time Between Sessions 0.000340.0000190.0729
(c)
VariablesOutcome: DBP at 6 Months
Treatment Assignment Coach vs. No CoachSex Male (1) Female (0)Census Tract at Risk (1) Resilient (2) None of the Above (3)EstimateStandard Errorp-Value
Treatment AssignmentCoaching (1) 0.74441.8850.6944
Sex Female (0) −4.07211.96220.0409
Glucose −0.018250.015360.2379
Area Resilient (2) vs At Risk15.48638.43460.0697
None of the above vs At Risk26.619416.30220.1061
Median Lapsed Time Between Sessions 0.0001090.0000570.0603
Table 4. GLMM multivariate adjusted analyses of binary outcomes.
Table 4. GLMM multivariate adjusted analyses of binary outcomes.
Binary Primary Outcomes Odds Ratio95% Cisp-Value
Coach vs. No Coach groups comparison in Improvement (yes/no) in BP at 6 months1.8340.7014.7980.2135
Females vs. Males comparison of Improvement (yes/no) in BP at 6 months2.3940.8536.7160.0963
Coach vs. No Coach groups comparison in Improvement (yes/no) in LS7 at 6 months1.0470.4112.6670.9226
Females vs. Males comparison of Improvement (yes/no) in LS7 at 6 months0.5740.2141.5420.2676
Coach vs. No Coach groups comparison in Improvement (yes/no) in BG at 6 months1.0780.4172.7870.8754
Females vs. Males comparison of Improvement (yes/no) in BG at 6 months0.4570.1571.3300.1487
Coach vs. No Coach groups comparison in Improvement (yes/no) in BMI at 6 months0.4820.1951.1880.1113
Females vs. Males comparison of Improvement (yes/no) in BMI at 6 months2.1190.8225.4660.1187
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Washington-Plaskett, T.; Idris, M.Y.; Mubasher, M.; Ko, Y.-A.; Islam, S.J.; Dunbar, S.; Taylor, H.; Quyyumi, A.A.; Pemu, P. Impact of Technology-Based Intervention for Improving Self-Management Behaviors in Black Adults with Poor Cardiovascular Health: A Randomized Control Trial. Int. J. Environ. Res. Public Health 2021, 18, 3660. https://doi.org/10.3390/ijerph18073660

AMA Style

Washington-Plaskett T, Idris MY, Mubasher M, Ko Y-A, Islam SJ, Dunbar S, Taylor H, Quyyumi AA, Pemu P. Impact of Technology-Based Intervention for Improving Self-Management Behaviors in Black Adults with Poor Cardiovascular Health: A Randomized Control Trial. International Journal of Environmental Research and Public Health. 2021; 18(7):3660. https://doi.org/10.3390/ijerph18073660

Chicago/Turabian Style

Washington-Plaskett, Tulani, Muhammed Y. Idris, Mohamed Mubasher, Yi-An Ko, Shabatun Jamila Islam, Sandra Dunbar, Herman Taylor, Arshed Ali Quyyumi, and Priscilla Pemu. 2021. "Impact of Technology-Based Intervention for Improving Self-Management Behaviors in Black Adults with Poor Cardiovascular Health: A Randomized Control Trial" International Journal of Environmental Research and Public Health 18, no. 7: 3660. https://doi.org/10.3390/ijerph18073660

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop