Next Article in Journal
Restorative Effects of Biophilic Workplace and Nature Exposure during Working Time: A Systematic Review
Previous Article in Journal
Trends in Serum Per- and Polyfluoroalkyl Substance (PFAS) Concentrations in Teenagers and Adults, 1999–2018 NHANES
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Association of Social Vulnerability and COVID-19 Mortality Rates in Texas between 15 March 2020, and 21 July 2022: An Ecological Analysis

1
Epidemiology and Surveillance Unit, Texas Department of State Health Services, 201 W Howard Ln, Austin, TX 78753, USA
2
Department of Health Promotion and Behavioral Sciences, Center for Community Health Impact, The University of Texas Health Science Center at Houston School of Public Health, 5130 Gateway Boulevard East MCA 110, El Paso, TX 79905, USA
3
Department of Health Promotion and Behavioral Sciences, The University of Texas Health Science Center at Houston School of Public Health, 1616 Guadalupe, Austin, TX 78701, USA
4
Department of Epidemiology, Human Genetics & Environmental Sciences, The University of Texas Health Science Center at Houston School of Public Health, 1200 Pressler Street, Houston, TX 77030, USA
*
Authors to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2023, 20(21), 6985; https://doi.org/10.3390/ijerph20216985
Submission received: 30 August 2023 / Revised: 10 October 2023 / Accepted: 20 October 2023 / Published: 27 October 2023

Abstract

:
Background: Despite the key role of social vulnerability such as economic disadvantage in health outcomes, research is limited on the impact of social vulnerabilities on COVID-19-related deaths, especially at the state and county level in the USA. Methods: We conducted a cross-sectional ecologic analysis of COVID-19 mortality by the county-level Minority Health Social Vulnerability Index (MH SVI) and each of its components in Texas. Negative binomial regression (NBR) analyses were used to estimate the association between the composite MH SVI (and its components) and COVID-19 mortality. Results: A 0.1-unit increase in the overall MH SVI (IRR, 1.27; 95% CI, 1.04–1.55; p = 0.017) was associated with a 27% increase in the COVID-19 mortality rate. Among the MH SVI component measures, only low socioeconomic status (IRR, 1.55; 95% CI, 1.28–1.89; p = 0.001) and higher household composition (e.g., proportion of older population per county) and disability scores (IRR, 1.47; 95% CI, 1.29–1.68; p < 0.001) were positively associated with COVID-19 mortality rates. Conclusions: This study provides further evidence of disparities in COVID-19 mortality by social vulnerability and can inform decisions on the allocation of social resources and services as a strategy for reducing COVID-19 mortality rates and similar pandemics in the future.

1. Introduction

Coronavirus disease 2019 (COVID-19) remains a significant public health problem globally, including in the United States of America (USA) [1,2,3]. As of 10 March 2023, the USA recorded over 103 million cases and 1 million COVID-19-related deaths while Texas reported above 8.4 million cases and 93,000 COVID-19 deaths [4]. Despite heightened interventions such as COVID-19 vaccination campaigns, the USA and Texas were reporting close to 255 and 17 COVID-19-related deaths daily as of March 2023 [5]. Interestingly, there is a continued emergence of new Omicron subvariants that are more transmissible and can neutralize vaccine antibodies [6,7].
All populations are at risk of developing COVID-19 complications and death; however, people with underlying health conditions and the elderly are more likely to experience worse COVID-19 outcomes [2,8,9]. Several early reports indicated that the COVID-19 pandemic disproportionately impacted racial minority groups and people of low socioeconomic class [10,11,12,13,14]. Later in the pandemic, especially during the COVID-19 third wave (Winter of 2020), after the development of vaccines, whites experienced a higher proportion of deaths [15]. Further research on COVID-19 mortality by county-level social vulnerability holds promise to advance our understanding of the role of Social Determinants of Health (SDoH) and racial/ethnic differences in mitigating or exacerbating the health and quality of life effects of COVID-19 and similar pandemics.
As identifying vulnerable communities is vital to protect populations from the effects of a pandemic [16,17], measures such as the Social Vulnerability Index hold promise to advance our understanding of the effects of social factors such as socioeconomic status on COVID-19-related outcomes. The Social Vulnerability Index (SVI) is a percentile-based measure created by the Centers for Disease Control and Prevention (CDC) to help local officials identify populations at risk of adverse outcomes in the event of a disaster or disease outbreak [18]. Recent evidence has shown that SVI is associated with COVID-19 health and mortality-related outcomes [11,15,19,20,21]. The average death per capita was significantly higher in counties with greater SVI than those with lower SVI scores [15]. Similarly, high composite SVI scores as well as higher scores for each of the individual SVI components were significantly associated with higher mortality rates in USA counties [11].
While this body of research provides an important foundation for understanding the role of social vulnerabilities in relation to COVID-19 health and mortality-related outcomes, these studies used the “traditional” SVI, which is limited to four SVI components only: (1) socioeconomic status, (2) household composition and disability, (3) minority status and language, and (4) housing type and transportation. Furthermore, most of these past studies were conducted during the early months of the pandemic when COVID-19 deaths were still low, thus warranting additional exploration [15,20,21]. Additionally, medical vulnerabilities and healthcare infrastructure access components are among the essential social factors in pandemics and infectious disease outcomes requiring further investigation [17,19,22], yet these components were lacking from the “traditional” SVI.
In addressing limitations of the “traditional” SVI, the Office of Minority Health at the USA Department of Health and Human Services, in partnership with the CDC, recently modified the “traditional” SVI to create the Minority Health Social Vulnerability Index (MH SVI) to help researchers study and plan COVID-19 response programs [23,24]. This adapted index incorporates medical vulnerabilities, healthcare infrastructure access components, and the specific race and language categories that were essentially missing from the “traditional” SVI [23].
In addition to limitations with the use of the “traditional” SVI, research is limited on the impact of social vulnerabilities on COVID-19 mortality at the county level, especially in Texas, which ranks as the sixth most diverse state in terms of minority groups [25] and counts a third of its population (30%) living below 200% of the federal poverty level [26]. In addressing current gaps in the literature and with the aim of advancing our understanding of the role of social vulnerabilities in relation to COVID-19 mortality, this study used an ecological study design to examine the associations between the county-level MH SVI and its individual components and COVID-19 mortality rates in Texas from 15 March 2020 to 21 July 2022. Findings from this study hold promise to inform the design of public health programs, guide the allocation of resources, and formulate policies to reduce COVID-19 mortality rates in Texas and future pandemics.

2. Materials and Methods

2.1. Study Design and Study Population

This study used a cross-sectional ecological study design suitable for exploring population-level data and comparing mortality rates between counties [27]. We included all counties in Texas (n = 254) reporting cumulative COVID-19 deaths among all populations in the analysis. We chose counties as the unit of observation unit as (1) most COVID-19 policies and interventions are approved at the county level [28], (2) local health departments, state, or the CDC report COVID-19 mortality data (for all age populations) aggregated by county, and (3) the MH SVI scores are computed at the county level [23,24].

2.2. Study Variables and Data Sources

We used the COVID-19 mortality rate as the outcome of interest. We sourced COVID-19 mortality data between 15 March 2020 and 21 July 2022 from the Texas Department of State and Health Services (TDSHS) website, which are publicly available and de-identified. The TDSHS reports COVID-19-related mortality based on death certificates. Mortality rates (proportions) were calculated as deaths/100,000, i.e., we obtained the ratio of number of deaths (counts) reported per county to the county’s population and multiplied by 100,000 [29]. Table 1 provides details of the study variables and data sources.
We studied the county-level Minority Health Social Vulnerability Index (MH SVI) and its independent components (including their subcomponents) as our exposure variables. The CDC’s Geospatial Research, Analysis & Services Program (GRASP) in partnership with the USA Department of Health and Human Services Office Minority Health (OMH) created the county-level MH SVI using 2014–2018 census bureau data to help public health professionals and emergency responders plan, identify, and support communities in the event of a disaster or disease outbreak such as the COVID-19 response [24]. The index ranks USA counties based on 34 social factors (subcomponents), including unemployment, income levels, racial and ethnic minority status, household challenges (such as percentage of households with no vehicle available), medical health conditions (such as the county’s cardiovascular disease death rate), and access to health services (e.g., number of hospitals per 100,000 population) and further groups them into six related components: (1) socioeconomic status, (2) household composition and disability, (3) minority status and language, (4) housing type and transportation, (5) healthcare infrastructure and access, and (6) medical vulnerability. Each county is then ranked based on the six components and the overall MH SVI score, ranging from 0 to 1, with “0” indicating the least vulnerable and “1” the most vulnerable. The MH SVI calculation and design are documented in the CDC and OMH websites [24,30].
We included the following county-level covariates in the initial analysis based on the literature and a priori knowledge of possible confounding [31]: (1) urbanicity, (2) percentage of adult smokers, (3) population density per square mile, (4) mean life expectancy, (5) average particulate matter (PM)2.5, (6) gender, (7) political affiliations (based on 2020 presidential elections), (8) percentage of residents vaccinated against COVID-19 (i.e., received at least one dose of the vaccine), and (9) median age [11,15,21,32]. Table 1 provides details of the covariates and data sources. We did not include the number of primary physicians per 100,000 population in each county, the percentage of persons using public transportation, and the percentage of comorbidities per county [11] because they were incorporated in the MH SVI as specific indicator variables (MH SVI subcomponents).
Table 1. List of Study Variables and Data Sources.
Table 1. List of Study Variables and Data Sources.
DataYearSource
Outcomes
Mortality July 2021–July 2022COVID-19 Cases and Deaths by Vaccination Status Dashboard [33].
Exposures
Minority Health Social Vulnerability Index (MH SVI)2018 (Modified July 2021)Minority Health Social Vulnerability Index [24].
Covariates
Population Density2019County Population Totals: 2010–2019 [34].
Urbanicity2020Economic Research Service USA Department of Agriculture (ERS-USDA) [35].
Percentage of Adult Smokers in the County2019County Rankings. Smoking [36]
County Mean Life Expectancy2018–2020County Rankings. Life expectancy [36].
Percentage of Females per County (Gender)2018County Population [34].
Average Particulate Matter (PM)2.5 2020County ranking. Average particulate matter [36]
Percentage of Residents Fully Vaccinated Against COVID-192020–2022COVID-19 Cases and Deaths by Vaccination Status Dashboard [33].
Political Affiliations (2020 Presidential Voting Patterns per County) 2020MIT Election Data Lab [37].
County’s Median Age2019USA Census Bureau [34].

2.3. Statistical Analysis

We conducted a descriptive analysis of all study variables for Texas counties and created a bivariate map displaying mortality rates (deaths per 100,000 population) as of 21 July 2022, overlaid on the composite MH SVI for each county in Texas. For the main analyses (i.e., between MH SVI and COVID-19 mortality rates), we used the negative binomial regression (NBR) model because COVID-19 deaths are reported as count data, i.e., only non-negative integers, and it manages overdispersion. To convert COVID-19 death counts to rates, we controlled the population size as the offset variable [29]. Thus, our models examined the relationship between MH SVI (including each individual MH SVI component and its subcomponents) and COVID-19 death counts with a log of population size per county.
We first assessed the relationship between the proposed covariates and COVID-19 mortality, using NBR analysis. Following covariate assessment, we estimated models for the association of each MH SVI component, as well as the composite MH SVI, with mortality rates [10]. Both unadjusted and covariate-adjusted models were estimated, and since MH SVI components and their subcomponents are related to each other, we entered each into a separate NBR model to avoid potential collinearity issues [11]. To facilitate interpretation, we calculated the mortality rate ratio (interpreted as incidence rate ratio, IRR) by exponentiating the regression coefficient [29]. We analyzed data using STATA 17.0 (StataCorp LLC, College Station, TX, USA) and ArcGIS Pro 3.3 (Environmental Systems Research Institute, Inc., Redlands, CA, USA) software and assessed statistical significance at p < 0.05. This study was determined exempt by the University of Texas Health Science Center at Houston Committee for the Protection of Human Subjects as it uses publicly available and de-identified secondary data analysis.

3. Results

3.1. Descriptive Characteristics of Sample

All counties of the state of Texas, USA (n = 254 counties), were included in the analysis (Table 2). As of 21 July 2022, COVID-19 mortality per 100,000 population mean was 470.83 in Texas. About twenty percent (19.48%) of the population aged 25+ had no high school diploma, and 16% lived below the federal poverty level. In addition, most minority groups (34.83%) were Hispanic or Latinx, and about 18% of the counties’ population lacked health insurance.

3.2. Descriptive Bivariate Map of County-Level MH SVI and COVID-19 Mortality Rates in Texas

Figure 1 exhibits a bivariate choropleth map to visualize the composite MH SVI by COVID-19 mortality per 100,000 population among all populations in Texas, with darker brown colors representing counties with both a greater MH SVI score (most vulnerable, ≥0.75) and the highest COVID-19 mortality rates (≥468 per 100,000 population) mostly in the North, East, and South of Texas. Populous counties such as Dallas, Austin, San Antonio, and El Paso, despite having moderate to high MH SVI vulnerability scores (blue to dark blue colors), showed lower COVID-19 mortality rates.

3.3. Associations between the Covariates and COVID-19 Mortality Rates in Texas

In the covariate analyses, we found a significant association between adjusted population density and COVID-19 mortality (IRR, 0.99; 95% CI, 0.99–1.00; p < 0.001) (Table 3). Adjusted county mean life expectancy (IRR, 0.95; 95% CI, 0.93–0.96; p < 0.001), average particulate matter (IRR, 0.89; 95% CI, 0.86–0.92; p < 0.001), percentage of female population (IRR,1.02; 95% CI, 1.01–1.03; p = 0.005), and vaccination coverage (receiving at least one dose of COVID-19) (IRR,1.02; 95% CI, 1.02–1.03; p < 0.001) as well as political affiliations and urbanicity were associated with COVID-19 mortality rates. Based on these findings, we included all listed covariates in the model.

3.4. Associations between MH SVI and Components with COVID-19 Mortality in Texas

The adjusted composite MH SVI was significantly associated with COVID-19 mortality rates (Table 4). A 0.1-unit increase in the overall MH SVI was associated with a 27% increase in mortality rate (IRR, 1.27; 95% CI, 1.04–1.55; p = 0.017). Similarly, low socioeconomic status (IRR, 1.55; 95% CI, 1.28–1.89; p = 0.001) and greater household composition and disability scores (IRR, 1.47; 95% CI, 1.29–1.68; p < 0.001) were associated with an increase in COVID-19 mortality rates in the adjusted model. Adjusted medical vulnerabilities (IRR, 1.14; 95% CI, 0.95–1.38; p = 0.157) and housing type and transportation (IRR, 1.06; 95% CI, 0.91–1.23; p = 0.425) were not statistically significant at p < 0.05. Minority status/language (IRR, 0.94; 95% CI, 0.76–1.16; p = 0.572) and healthcare infrastructure and access (IRR, 0.97; 95% CI, 0.83–1.11; p = 0.654) were also not associated with COVID-19 mortality rates

3.5. Association of MH SVI Subcomponents and COVID-19 Mortality Rates in Texas

We also assessed county-level MH SVI subcomponents and COVID-19 Mortality Rates (Table 5). In the crude model, some of the subcomponents associated with increased COVID-19 mortality rates included the percentage of persons living below poverty levels (IRR, 1.02; 95% CI, 1.00–1.03; p < 0.001), unemployment rates (IRR, 1.02; 95% CI, 1.00–1.04; p = 0.013), persons aged 25 years and older with no high school diploma (IRR, 1.01; 95% CI, 1.00–1.02; p < 0.001), persons aged 65 and older (IRR, 1.02; 95% CI, 1.01–1.03; p < 0.001), population with a disability (IRR, 1.03; 95% CI, 1.02–1.05; p < 0.001), households with no vehicles (IRR, 1.04; 95% CI, 1.02–1.06; p < 0.001), persons without health insurance (IRR, 1.02; 95% CI, 1.01–1.03; p < 0.001), persons without internet access (IRR, 1.02; 95% CI, 1.01–1.03; p < 0.001), and the county’s cardiovascular disease rate (IRR, 1.01; 95% CI, 1.00–1.01; p < 0.001) and respiratory diseases rate (IRR, 1.01; 95% CI, 1.00–1.01; p < 0.001). Income per capita (IRR, 0.99; 95% CI 0.99–1.00; p < 0.001), percentage of multiple housing units (IRR, 0.96; 95% CI 0.95–0.97; p < 0.001), and primary care physicians per 100,000 population (IRR, 0.80; 95% CI 0.68–0.94; p = 0.006) were all associated with lower COVID-19 mortality rates.
In the adjusted model, the percentage of persons living below poverty levels (IRR, 1.01; 95% CI, 1.00–1.02; p = 0.006), persons aged 25 years and older with no high school diploma (IRR, 1.01; 95% CI, 1.00–1.02; p < 0.001), the population aged 65 and older (IRR, 1.04; 95% CI 1.03–1.05; p < 0.001), people with a disability (IRR, 1.01; 95% CI 1.00–1.02; p = 0.008), households with no vehicles (IRR, 1.03; 95% CI, 1.01–1.05; p = 0.002), persons without health insurance (IRR, 1.01; 95% CI, 1.00–1.02; p = 0.033), and persons without internet access (IRR, 1.01; 95% CI, 1.01 –1.02; p < 0.001) exhibited a persistent positive significant association with COVID-19 mortality rates. The proportion of multiple housing units (IRR, 0.98; 95% CI 0.97–0.98; p < 0.001) and income per capita per county (IRR, 0.99; 95% CI 0.99–1.00; p < 0.001) were negatively associated with COVID-19 mortality rates.
In the association between minority status (racial/ethnic and language) and COVID-19 mortality rates, a 0.1-unit increase in the percentage of Hispanic or Latinx (IRR, 1.01; 95% CI 1.00–1.01; p < 0.001) and Spanish speakers (IRR, 1.01; 95% CI 1.00–1.01; p = 0.046) was associated with a 1% increase in COVID-19 mortality rates after controlling for the covariates. Conversely, the percentage of Asian population, Chinese, and Russian speakers were associated with decreased COVID-19 mortality, after adjusting for the covariates.

4. Discussion

We examined the association of the composite and components of MH SVI and COVID-19 mortality rates in Texas between 15 March 2020 and 21 July 2022. The adjusted composite MH SVI was significantly associated with increased COVID-19 mortality rates. Several previously published studies using the “traditional” SVI have also reported similar higher mortality rates in counties with greater composite SVI [11,20]. This finding highlights the contribution of the overall vulnerability to increased COVID-19 mortality in Texas counties.
In the individual component analyses, the household composition and disability component was positively associated with COVID-19 mortality rates, which supports previous research [11,15,20]. Further analysis revealed that counties with a higher percentage of a population aged 65 or older and those with a higher proportion of persons with disabilities were also associated with increased COVID-19 mortality rates. These findings underscore COVID-19 mortality disparities experienced among people with disabilities and those counties with a higher percentage of the older population [15,19].
The socioeconomic status component was also positively associated with COVID-19 mortality rates in the crude and adjusted model. Multiple studies have demonstrated similar findings [11,15,21]. Additionally, several socioeconomic status indicators (subcomponents) were also associated with increased COVID-19 mortality rates such as the percentage of persons living below poverty levels, unemployment rates, and individuals with no high school diploma per county. Low socioeconomic status related to COVID-19 including its specific indicators has been reported widely in the literature [16,17].
Although medical vulnerability and healthcare infrastructure and access components were insignificant, several studies have indicated the role of comorbidities and limited access to health in increasing COVID-19 mortality rates [11,21]. However, in the further analysis of the subcomponents, we found a significant increase in COVID-19 mortality rates among counties with a higher proportion of cardiovascular disease deaths and chronic respiratory diseases (unadjusted), individuals without access to the internet (both adjusted and unadjusted), and persons without health insurance (adjusted). These results reaffirm the role of comorbidities, lack of health insurance, and limited access to health information on COVID-19 mortality rates in Texas and across the USA [1,3].
Additionally, while no significant association was found between the minority status and language component with COVID-19, this study found counties with a higher proportion of Hispanic or Latinx population and Spanish speakers were associated with increased COVID-19 mortality rates. This finding concurs with other multiple researchers indicating that Hispanic populations were adversely affected by COVID-19 deaths [12,13,14]. Not all minorities were adversely impacted, however. Inverse associations were seen between the percentage of the Asian population, Chinese, and Russian speakers per county and COVID-19 mortality rates. These findings differ from most past studies showing racial minorities experienced worse COVID-19 outcomes including death [10,11,20]. A possible explanation for these discrepancies would be the recent heightened efforts to mitigate COVID-19 effects such as vaccination efforts and health messaging targeting historically minority groups [38,39]. It is equally likely that some of these groups represent “model minorities”, and may, in fact, have better resources than even the majority white group where they stay. To the authors’ knowledge, this was the first study to examine the association of the specific racial/language minority status within the MH SVI variable and COVID-19 mortality rates. Additionally, association does not imply causality [40]. Thus, further research should be undertaken to explore ethnic-group-specific factors that protect against or exacerbate the risks of mortality from COVID-19.
Specific strengths and limitations of this study merit mention. Among the key strengths, this study is the first to examine the association between the new MH SVI (and its components and subcomponents) and COVID-19 mortality rates in the USA, and is the first, to the authors’ knowledge, to examine the association for the state of Texas. Second, this study adds to the literature by providing a deeper exploration of the specific components and subcomponents of the MH SVI to better understand the existence of various disparities in COVID-19 mortality rates and advance public health interventions aiming to address social environmental indicators of a pandemic. Despite these strengths, we point out specific limitations: First, we did not adjust the COVID-19 mortality rates by age groups as data sourced were aggregated for all populations by county. However, we included each county’s median age as a covariate in the model and the composite MH SVI incorporates the percentage of the population equal to or older than 65 years and younger than 17 years old per county [24]. Second, we cannot rule out the ecological fallacy bias. Thus, findings from this study may not infer to finer levels, such as census tracts, zip codes, or individuals within the counties. With data availability, future studies should focus on smaller observation units. Third, we used datasets collected at different time points and contexts (e.g., most MH SVI and covariates datasets were collected before the pandemic). However, we chose the most recent available data as of the time of the analysis. Fourth, although we included multiple covariates, we acknowledge the impossibility of controlling for all confounders, and thus our study may contain residual confounding. Finally, this study used a cross-sectional ecologic design, and therefore the associations between MH SVI and COVID-19 mortality rates cannot infer causality.

5. Conclusions

The adjusted composite MH SVI was significantly and positively associated with COVID-19 mortality rates. Similarly, adjusted socioeconomic status, household composition, and disability components were associated with increased COVID-19 mortality rates between 17 March 2020 and 21 July 2022. Although minority group status and language, housing type and transportation, healthcare infrastructure and access, and medical vulnerability components were insignificant, we found an association between multiple specific subcomponents within the components and COVID-19 mortality rates. These findings underscore the persistence of disparities, especially in the most vulnerable counties, based on the MH SVI scores and the need to explore the specific MH SVI subcomponents (also referred to as SDoH indicators). In addition, this study holds promise to inform decisions related to the allocation of resources aimed at addressing future pandemics similar to COVID-19. Since this was the first study to examine COVID-19 mortality and its association with the MH SVI, future studies should focus on assessing the temporal and spatial association of the MH SVI and COVID-19.

Author Contributions

Conceptualization, D.O.N.; methodology, D.O.N., N.R. and R.R.; software, D.O.N. and R.R.; validation, D.O.N. and N.R.; formal analysis, D.O.N.; data curation, D.O.N.; writing—original draft preparation, D.O.N.; writing—review and editing, D.O.N., A.E.S., N.R., R.R. and L.D.W.; visualization, D.O.N., R.R., A.E.S., Geographic Information Systems, D.O.N. and R.R., supervision, A.E.S. and L.D.W. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The datasets supporting the conclusions of this article are available de-identified and publicly available. The outcome (COVID-19 Mortality) data are available from the Texas Department of State Health Services website: https://www.dshs.texas.gov/covid-19-coronavirus-disease-2019/covid-19-vaccine-information/covid-19-cases-deaths (accessed on 25 January 2023) and the dependent variable (Minority Health Social Vulnerability Index) is available from the Health and Human Services Minority Health website: https://www.minorityhealth.hhs.gov/minority-mental-health (accessed on 25 January 2023).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Ahn, D.-G.; Shin, H.-J.; Kim, M.-H.; Lee, S.; Kim, H.-S.; Myoung, J.; Kim, B.-T.; Kim, S.-J. Current Status of Epidemiology, Diagnosis, Therapeutics, and Vaccines for Novel Coronavirus Disease 2019 (COVID-19). J. Microbiol. Biotechnol. 2020, 30, 313–324. [Google Scholar] [CrossRef] [PubMed]
  2. Cabrera Martimbianco, A.L.; Pacheco, R.L.; Bagattini, Â.M.; Riera, R. Frequency, signs and symptoms, and criteria adopted for long COVID-19: A systematic review. Int. J. Clin. Pract. 2021, 75, e14357. [Google Scholar] [CrossRef] [PubMed]
  3. Rahman, S.; Montero, M.T.V.; Rowe, K.; Kirton, R.; Kunik, F. Epidemiology, pathogenesis, clinical presentations, diagnosis and treatment of COVID-19: A review of current evidence. Expert Rev. Clin. Pharmacol. 2021, 14, 601–621. [Google Scholar] [CrossRef]
  4. Johns Hopkins Coronavirus Resource Center. Available online: https://coronavirus.jhu.edu/map.html (accessed on 9 September 2023).
  5. The New York Times. Coronavirus in the U.S.: Latest Map and Case Count. Available online: https://www.nytimes.com/interactive/2021/us/covid-cases.html (accessed on 15 July 2023).
  6. Gobeil, S.M.-C.; Henderson, R.; Stalls, V.; Janowska, K.; Huang, X.; May, A.; Speakman, M.; Beaudoin, E.; Manne, K.; Li, D.; et al. Structural diversity of the SARS-CoV-2 Omicron spike. Mol. Cell. 2022, 82, 2050–2068. [Google Scholar] [CrossRef] [PubMed]
  7. Gowrisankar, A.; Priyanka, T.M.C.; Banerjee, S. Omicron: A mysterious variant of concern. Eur. Phys. J. Plus 2022, 137, 100. [Google Scholar] [CrossRef]
  8. Daoust, J.-F. Elderly people and responses to COVID-19 in 27 Countries. PLoS ONE 2020, 15, e0235590. [Google Scholar] [CrossRef]
  9. Rossen, L.M.; Gold, J.A.W.; Ahmad, F.B.; Sutton, P.D.; Branum, A.M. Trends in the distribution of COVID-19 deaths by age and race/ethnicity—United States, April 4–December 26, 2020. Ann. Epidemiol. 2021, 62, 66–68. [Google Scholar] [CrossRef]
  10. Dalsania, A.K.; Fastiggi, M.J.; Kahlam, A.; Shah, R.; Patel, K.; Shiau, S.; Rokicki, S.; DallaPiazza, M. The Relationship Between Social Determinants of Health and Racial Disparities in COVID-19 Mortality. J. Racial Ethn. Health Disparities 2021, 9, 288–295. [Google Scholar] [CrossRef]
  11. Karmakar, M.; Lantz, P.M.; Tipirneni, R. Association of Social and Demographic Factors With COVID-19 Incidence and Death Rates in the US. JAMA Netw. Open 2021, 4, e2036462. [Google Scholar] [CrossRef]
  12. Liao, T.F. Social and economic inequality in coronavirus disease 2019 vaccination coverage across Illinois counties. Sci. Rep. 2021, 11, 18443. [Google Scholar] [CrossRef]
  13. Raine, S.; Liu, A.; Mintz, J.; Wahood, W.; Huntley, K.; Haffizulla, F. Racial and Ethnic Disparities in COVID-19 Outcomes: Social Determination of Health. Int. J. Environ. Res. Public Health 2020, 17, 8115. [Google Scholar] [CrossRef] [PubMed]
  14. Robertson, M.M.; Shamsunder, M.G.; Brazier, E.; Mantravadi, M.; Zimba, R.; Rane, M.S.; Westmoreland, D.A.; Parcesepe, A.M.; Maroko, A.R.; Kulkarni, S.G.; et al. Racial/Ethnic Disparities in Exposure, Disease Susceptibility, and Clinical Outcomes during COVID-19 Pandemic in National Cohort of Adults, United States. Emerg. Infect. Dis. 2022, 28, 2171–2180. [Google Scholar] [CrossRef] [PubMed]
  15. Islam, S.J.; Nayak, A.; Hu, Y.; Mehta, A.; Dieppa, K.; Almuwaqqat, Z.; Ko, Y.-A.; Patel, S.A.; Goyal, A.; Sullivan, S.; et al. Temporal trends in the association of social vulnerability and race/ethnicity with county-level COVID-19 incidence and outcomes in the USA: An ecological analysis. BMJ Open 2021, 11, e048086. [Google Scholar] [CrossRef] [PubMed]
  16. Hawkins, R.B.; Charles, E.J.; Mehaffey, J.H. Socio-economic status and COVID-19–related cases and fatalities. Public Health 2020, 189, 129–134. [Google Scholar] [CrossRef]
  17. Singu, S.; Acharya, A.; Challagundla, K.; Byrareddy, S.N. Impact of Social Determinants of Health on the Emerging COVID-19 Pandemic in the United States. Front. Public Health 2020, 8, 406. [Google Scholar] [CrossRef] [PubMed]
  18. Centers for Disease Control and Prevention (CDC); Agency for Toxic Substances and Disease Registry (ATSDR). CDC/ATSDR SVI Fact Sheet|Place and Health|ATSDR. Available online: https://www.atsdr.cdc.gov/placeandhealth/svi/fact_sheet/fact_sheet.html (accessed on 5 October 2022).
  19. Fallah-Aliabadi, S.; Fatemi, F.; Heydari, A.; Khajehaminian, M.R.; Lotfi, M.H.; Mirzaei, M.; Sarsangi, A. Social vulnerability indicators in pandemics focusing on COVID-19: A systematic literature review. Public Health Nurs. 2022, 39, 1142–1155. [Google Scholar] [CrossRef]
  20. Khazanchi, R.; Beiter, E.R.; Gondi, S.; Beckman, A.L.; Bilinski, A.; Ganguli, I. County-Level Association of Social Vulnerability with COVID-19 Cases and Deaths in the USA. J. Gen. Intern. Med. 2020, 35, 2784–2787. [Google Scholar] [CrossRef]
  21. Neelon, B.; Mutiso, F.; Mueller, N.T.; Pearce, J.L.; Benjamin-Neelon, S.E. Spatial and temporal trends in social vulnerability and COVID-19 incidence and death rates in the United States. PLoS ONE 2021, 16, e0248702. [Google Scholar] [CrossRef]
  22. Czeisler, M.É.; Barrett, C.E.; Siegel, K.R.; Weaver, M.D.; Czeisler, C.A.; Rajaratnam, S.M.W.; Howard, M.E.; Bullard, K.M. Health Care Access and Use Among Adults with Diabetes During the COVID-19 Pandemic—United States, February–March 2021. MMWR Morb. Mortal. Wkly. Rep. 2021, 70, 1597–1602. [Google Scholar] [CrossRef]
  23. Drupal, J. HHS Releases Minority Health Social Vulnerability Index|AHA News. Available online: https://www.aha.org/news/headline/2021-08-06-hhs-releases-minority-health-social-vulnerability-index (accessed on 5 October 2022).
  24. Rickless, D.; Wendt, M.; Bui, J. Minority Health Social Vulnerability Index Overview. CDC and MOH Minority Health Social Vulnerability Index. Available online: https://www.minorityhealth.hhs.gov/minority-mental-health (accessed on 5 October 2022).
  25. U.S Census Bureau. Racial and Ethnic Diversity in the United States: 2010 Census and 2020 Census. Census.Gov. Available online: https://www.census.gov/library/visualizations/interactive/racial-and-ethnic-diversity-in-the-united-states-2010-and-2020-census.html (accessed on 13 October 2022).
  26. Radley, D.C.; Collins, S.R.; Baumgartner, J.C. The Commonwealth Fund—2020 Scorecard on State Health System Performance. Available online: https://2020scorecard.commonwealthfund.org (accessed on 13 October 2022).
  27. Sedgwick, P. Ecological studies: Advantages and disadvantages. BMJ 2014, 348, g2979. [Google Scholar] [CrossRef]
  28. Amuedo-Dorantes, C.; Kaushal, N.; Muchow, A.N. Timing of social distancing policies and COVID-19 mortality: County-level evidence from the US. J. Popul. Econ. 2021, 34, 1445–1472. [Google Scholar] [CrossRef] [PubMed]
  29. Tortolero, G.A.; de Oliveira Otto, M.; Ramphul, R.; Yamal, J.-M.; Rector, A.; Brown, M.; Peskin, M.F.; Mofleh, D.; Boerwinkle, E. Examining Social Vulnerability and the Association With COVID-19 Incidence in Harris County, Texas. Front. Public Health 2022, 9, 798085. [Google Scholar] [CrossRef]
  30. Centers for Disease Control and Prevention; Agency for Toxic Substances and Disease Registry; Geospatial Research, Analysis, and Services Program. CDC/ATSDR Social Vulnerability Index Documentation 2018. Available online: https://www.atsdr.cdc.gov/placeandhealth/svi/documentation/SVI_documentation_2018.html (accessed on 30 September 2023).
  31. Szklo, M.; Nieto, F.J. Epidemiology: Beyond the Basics, 4th ed.; Jones & Bartlett Publishers: Burlington, MA, USA, 2019; pp. 175–205. [Google Scholar]
  32. Backer, S.; Rezene, A.; Kahar, P.; Khanna, D. Socioeconomic Determinants of COVID-19 Incidence and Mortality in Florida. Cureus 2022, 14, e22491. [Google Scholar] [CrossRef]
  33. COVID-19 Cases and Deaths by Vaccination Status Dashboard|Texas DSHS. Available online: https://www.dshs.texas.gov/covid-19-coronavirus-disease-2019/covid-19-vaccine-information/covid-19-cases-deaths (accessed on 25 January 2023).
  34. U.S. Census Bureau. County Population Totals: 2010–2019. Census.Gov. Available online: https://www.census.gov/data/tables/time-series/demo/popest/2010s-counties-total.html (accessed on 25 January 2023).
  35. Economic Research Service United States Department of Agriculture (ERS-USDA). Rural-Urban Continuum Codes. Available online: https://www.ers.usda.gov/data-products/rural-urban-continuum-codes/ (accessed on 25 January 2023).
  36. County Health Rankings. County Health Rankings & Roadmaps. Available online: https://www.countyhealthrankings.org/county-health-rankings-roadmaps (accessed on 25 January 2023).
  37. MIT Election Lab. Available online: https://electionlab.mit.edu/about (accessed on 25 January 2023).
  38. Padamsee, T.J.; Bond, R.M.; Dixon, G.N.; Hovick, S.R.; Na, K.; Nisbet, E.C.; Wegener, D.T.; Garrett, R.K. Changes in COVID-19 Vaccine Hesitancy Among Black and White Individuals in the US. JAMA Netw. Open 2022, 5, e2144470. [Google Scholar] [CrossRef]
  39. Wong, J.A.; Yi, S.S.; Kwon, S.C.; Islam, N.S.; Trinh-Shevrin, C.; Đoàn, L.N. COVID-19 and Asian Americans: Reinforcing the Role of Community-Based Organizations in Providing Culturally and Linguistically Centered Care. Health Equity 2022, 6, 278–290. [Google Scholar] [CrossRef] [PubMed]
  40. Altman, N.; Krzywinski, M. Points of Significance: Association, correlation and causation. Nat. Methods 2015, 12, 899–900. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Bivariate map showing the composite county-level MH SVI overlaid on mortality rate per 100,000 population for each county in Texas, March 2020–July 2022.
Figure 1. Bivariate map showing the composite county-level MH SVI overlaid on mortality rate per 100,000 population for each county in Texas, March 2020–July 2022.
Ijerph 20 06985 g001
Table 2. County-level characteristics in Texas between 15 March 2020 and 21 July 2022.
Table 2. County-level characteristics in Texas between 15 March 2020 and 21 July 2022.
Variable (n = 254)MeanStandard Deviation (±)MedianRange
COVID-19 Mortality per 100,000 Population470.83170.35463.140.00–1211.31
Composite/Overall MH SVI
Socioeconomic Status
% of Persons Living Below Poverty16.056.0715.202.60–39.50
% of Civilians Aged 16+ Unemployed5.622.815.400.00–17.90
Income Per Capita25,497.255292.6325,128.5 013,350.00–43,439.00
% of Persons Aged 25+ with No High School Diploma19.488.2717.86.30–66.3
Household Composition/
Disability
% of Persons Aged 65 and Older17.535.3116.808.60–35.9
% of Persons Aged 17 and Younger24.353.9624.1012.80–36.60
% of Civilian Noninstitutionalized Population with a Disability16.084.5415.755.3–31.00
% of Single Parent Household with Children Under 188.073.088.50–22.70
Minority Status/Language
% of American Indian/Alaska Native0.570.560.400.00–3.40
% of Asian1.092.010.550.00–19.90
% of African American6.346.604.150.00–33.80
% of Native Hawaiian/Pacific Islander0.060.140.000.00–1.10
% of Hispanic or Latinx34.8323.2726.553.50–99.1
% of Some Other Race5.777.993.220.00–57.01
% of Spanish Speakers *9.218.336.760.00–51.36
% of Chinese Speakers *0.070.200.000.00–1.79
% of Vietnamese Speakers *0.090.210.000.00–1.32
% of Korean Speakers *0.030.090.000.00–0.77
% of Russian Speakers *0.010.030.000.00–0.37
Housing Type/Transportation
% of Housing Structures with 10 or More Units3.504.611.900.00–28.10
% of Mobile Homes15.467.9214.451.50–51.40
% of Housing Units with More People than Rooms4.272.693.650.00–21.20
% of Households with No Vehicle Available5.052.215.050.00–14.40
% of Persons in Living in Institutionalized Group Quarters4.256.171.600.00–36.50
Healthcare Infrastructure and Access
Hospitals per 100,000 Persons6.6810.73.490.00–82.55
Urgent Care Clinics per 100,000 Persons0.612.270.000.00–27.52
Pharmacies per 100,000 Persons18.5511.8317.530.00–72.20
Primary Care Physicians per 100,000 Persons0.380.280.330.00–1.39
% of Persons Without Health Insurance17.384.6017.104.70–33.40
Medical Vulnerability
Total Cardiovascular Disease Death Rate per 100,000496.5697.89485.80314.70–834.80
Chronic Respiratory Diseases Rate per 100,00063.8617.5663.6426.91–113.39
Total Persons with Obesity **31,087.015547.0530,300.0020,500.00–47,700.00
Total Persons Diagnosed with Diabetes **10,042.914318.409400.002300.00–26,800.00
% of persons with No Internet access25.138.3724.956.54–55.02
Covariates
Population Density44.81132.398.360.06–1145.19
Political Affiliations
Trump Voters n =232, 91.34%----
Biden Voters n = 22, 8.66%----
% Female49.063.1050.1529.37–53.27
Urbanicity
Suburban n = 82, 32.28%----
Suburban n = 84, 33.07%----
Rural n = 88, 34.65%----
% of Adult Smokers in the County14.941.5614.8910.64–19.87
% of Residents Received At Least One Dose of the COVID-19 Vaccine53.1614.0750.850.62–78.00
County Mean Life Expectancy77.462.3377.4571.86–89.65
Average Particulate Matter (PM)2.58.681.348.755.60–12.00
County Median Age39.565.7439.1527.90–60.00
* Those who speak English less than “very well”; ** age-adjusted (adults aged 20+ years); % = percentage; - = not applicable as the variable is categorical; data sources/dates (described in Table 1): COVID-mortality data (as of 21 July 2022); MH SVI (2014–2018 Census data).
Table 3. Association between Covariates and COVID-19 Mortality Rates, Texas, 15 March 2020–21 July 2022.
Table 3. Association between Covariates and COVID-19 Mortality Rates, Texas, 15 March 2020–21 July 2022.
Unadjusted COVID-19 Mortality Rate a,cAdjusted COVID-19 Mortality Rate b,c
IRR95% CIp-Value IRR95% CIp-Value
Covariates d (n = 254)
Population Density0.990.99–1.00<0.0010.990.99–1.000.001
Political Affiliations
Trump VotersREF REF
Biden Voters0.890.76–1.040.1361.271.10–1.450.001
% Female 1.010.99–1.020.7631.021.01–1.030.005
Urbanicity
UrbanREF REF
Suburban1.351.22–1.48<0.0011.121.03–1.210.005
Rural1.361.23–1.51<0.0011.030.94–1.140.483
Percentage of Adult Smokers in the County1.071.04–1.10<0.0011.041.01–1.060.005
Vaccination Coverage (receiving at least one dose of the COVID-19 vaccine)0.990.98–0.99<0.0010.990.99–1.000.013
County Mean Life Expectancy0.940.92–0.95<0.0010.950.93–0.96<0.001
Average Particulate Matter (PM)2.50.890.86–0.92<0.0010.890.86–0.92<0.001
County Median Age1.011.00–1.020.0281.011.00–1.010.018
Abbreviations: IRR = incidence rate ratio; CI = confidence interval; REF = reference. Symbols: p < 0.05; % = percent. a Crude model (unadjusted). b Adjusted model (controlled for each other). c Mortality rates were estimated using negative binomial regression (NBR). d Each variable was entered into a separate NBR model to assess association with COVID-19 mortality [11]. Notes: All regression models included an offset for the total number of people residing in the county. Bold: Statistically significant at p < 0.05.
Table 4. Association between the composite county-level MH SVI, its components, and COVID-19 Mortality Rates, Texas, 15 March 2020–21 July 2022.
Table 4. Association between the composite county-level MH SVI, its components, and COVID-19 Mortality Rates, Texas, 15 March 2020–21 July 2022.
Variable dUnadjusted COVID-19 Mortality Rate a,cAdjusted COVID-19 Mortality Rate b,c
IRR95% CIp-ValueIRR95% CIp-Value
Composite/Overall MH SVI1.100.91–1.330.3281.271.04–1.550.017
Socioeconomic Status 1.951.62–2.35<0.0011.551.28–1.890.001
Household Composition/
Disability
1.861.62–2.15<0.0011.471.29–1.68<0.001
Minority Status/Language0.520.42–0.63<0.0010.940.76–1.160.572
Housing Type/Transportation0.950.81–1.120.5541.060.91–1.230.425
Healthcare Infrastructure and Access1.231.01–1.510.0380.970.83–1.110.654
Medical Vulnerabilities1.721.44–2.06<0.0011.140.95–1.380.157
Abbreviations: IRR = incidence rate ratio; CI = confidence interval. Symbols: p < 0.05; % = percent; a Crude model (unadjusted). b Adjusted model (controlled for population density, vaccination coverage, estimated percentage of female population, mean life expectancy, average particulate matter per county, percentage of adult smokers in the county, urbanicity, political affiliations, and median age). c Mortality rates were estimated using negative binomial regression (NBR). d Each variable was entered into a separate NBR model to assess association with COVID-19 mortality [11]. Notes: All regression models included an offset for the total number of people residing in the county. Bold: Statistically significant at p < 0.05.
Table 5. Association between the county-level MH SVI subcomponents and COVID-19 Mortality Rates, Texas, 15 March 2020–21 July 2022.
Table 5. Association between the county-level MH SVI subcomponents and COVID-19 Mortality Rates, Texas, 15 March 2020–21 July 2022.
Variable dUnadjusted COVID-19 Mortality Rate a,cAdjusted COVID-19 Mortality Rate b,c
IRR95% CIp-Value IRR95% CIp-Value
Socioeconomic Status
% of Persons Living Below Poverty1.021.00–1.03<0.0011.011.00–1.020.006
% of Civilians Aged 16+ Unemployed1.021.00–1.040.0131.011.00–1.030.093
Income Per Capita0.990.99–1.00<0.0010.990.99–1.00<0.001
% of Persons Aged 25+ with No High School Diploma1.011.01–1.02<0.0011.011.00–1.02<0.001
Household Composition/
Disability
% of Persons Aged 65 and Older1.021.01–1.03<0.0011.041.03–1.05<0.001
% of Persons Aged 17 and Younger1.010.99–1.010.9401.010.99–1.020.459
% of Civilian Noninstitutionalized Population with a Disability1.031.03–1.05<0.0011.011.00–1.020.008
% of Single Parent Household with Children Under 181.011.00–1.030.0641.021.01–1.030.005
Minority Status/Language
% of American Indian/Alaska Native1.060.97–1.150.2060.980.92–1.040.592
% of Asian0.920.90–0.93<0.0010.970.95–0.98<0.001
% of African American0.990.98–1.000.0030.990.98–1.010.096
% of Native Hawaiian/Pacific Islander0.900.66–1.210.4890.970.78–1.200.816
% of Hispanic or Latinx1.010.99–1.000.1381.011.00–1.01<0.001
% of Some Other Race0.990.99–1.000.5850.990.99–1.000.601
% of Spanish Speakers *1.011.00–1.010.5541.011.00–1.010.046
% of Chinese Speakers *0.560.47–0.69<0.0010.760.65–0.890.001
% of Vietnamese Speakers *0.580.46–0.72<0.0010.870.73–1.030.114
% of Korean Speakers *0.420.27–0.66<0.0010.790.55–1.120.185
% of Russian Speakers *0.050.01–0.18<0.0010.190.07–0.510.001
Housing Type/Transportation
% of Housing Structures with 10 or More Units0.960.95–0.97<0.0010.980.97–0.98<0.001
% of Mobile Homes1.010.99–1.010.8020.991.00–1.000.509
% of Housing Units with More People than Rooms1.010.98–1.020.7471.010.99–1.030.120
% of Households with No Vehicle Available1.041.02–1.06<0.0011.031.01–1.050.002
% of Persons in Living in Institutionalized Group Quarters0.990.99–1.000.4790.990.99–1.010.428
Healthcare Infrastructure and Access
Hospitals per 100,000 Persons1.011.00–1.010.0140.990.99–1.000.571
Urgent Care Clinics per 100,000 Persons0.990.98–1.010.5901.010.99–1.020.582
Pharmacies per 100,000 Persons1.011.00–1.010.0151.011.00–1.010.224
Primary Care Physicians per 100,000 Persons0.800.68–0.940.0061.010.88–1.130.978
% of Persons Without Health Insurance1.021.01–1.03<0.0011.011.00–1.020.033
Medical Vulnerability
Total Cardiovascular Disease Death Rate per 100,0001.011.00–1.01<0.0011.000.99–1.010.970
Chronic Respiratory Diseases Rate per 100,000 1.011.00–1.01<0.0010.990.99–1.000.027
Total Persons with Obesity ** 1.010.99–1.010.7251.000.99–1.000.947
Total Persons Diagnosed with Diabetes **1.010.99–1.000.6201.000.99–1.010.653
% of Persons with No Internet Access1.021.02–1.03<0.0011.011.01–1.02<0.001
Abbreviations: IRR = incidence rate ratio; CI = confidence interval; p < 0.05; % = percent; a Crude model (unadjusted). b Adjusted model (controlled for population density, vaccination coverage, estimated percentage of female population, mean life expectancy, average particulate matter per county, percentage of adult smokers in the county, urbanicity, political affiliations, and median age). c Mortality rates were estimated using negative binomial regression (NBR). d Each variable was entered into a separate NBR model to assess association with COVID-19 mortality [11]. Notes: All regression models included an offset for the total number of people residing in the county. Bold: Statistically significant at p < 0.05; * Those who speak English less than “very well”. ** Adults aged 20+; Age-adjusted.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Nyachoti, D.O.; Ranjit, N.; Ramphul, R.; Whigham, L.D.; Springer, A.E. Association of Social Vulnerability and COVID-19 Mortality Rates in Texas between 15 March 2020, and 21 July 2022: An Ecological Analysis. Int. J. Environ. Res. Public Health 2023, 20, 6985. https://doi.org/10.3390/ijerph20216985

AMA Style

Nyachoti DO, Ranjit N, Ramphul R, Whigham LD, Springer AE. Association of Social Vulnerability and COVID-19 Mortality Rates in Texas between 15 March 2020, and 21 July 2022: An Ecological Analysis. International Journal of Environmental Research and Public Health. 2023; 20(21):6985. https://doi.org/10.3390/ijerph20216985

Chicago/Turabian Style

Nyachoti, Dennis Ogeto, Nalini Ranjit, Ryan Ramphul, Leah D. Whigham, and Andrew E. Springer. 2023. "Association of Social Vulnerability and COVID-19 Mortality Rates in Texas between 15 March 2020, and 21 July 2022: An Ecological Analysis" International Journal of Environmental Research and Public Health 20, no. 21: 6985. https://doi.org/10.3390/ijerph20216985

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop