Next Article in Journal
Does Environmental Credit Rating Promote Green Innovation in Enterprises? Evidence from Heavy Polluting Listed Companies in China
Next Article in Special Issue
Effects of Aging and Fitness on Hopping Biomechanics
Previous Article in Journal
Perspective: Might Maternal Dietary Monosodium Glutamate (MSG) Consumption Impact Pre- and Peri-Implantation Embryos and Their Subsequent Development?
Previous Article in Special Issue
Associations between Physical Fitness Index and Body Mass Index in Tibetan Children and Adolescents in Different High-Altitude Areas: Based on a Study in Tibet, China
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Association between Handgrip Strength and the Systemic Immune-Inflammation Index: A Nationwide Study, NHANES 2011–2014

1
Sports Rehabilitation Center, China Institute of Sport Science, Beijing 100061, China
2
Department of Physical Education and Art, China Agricultural University, Beijing 100083, China
3
Human Health Science Research Department, Tokyo Metropolitan University, Tokyo 116-8551, Japan
4
Human and Social Sciences, Chemnitz University of Technology, 09126 Chemnitz, Germany
*
Authors to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2022, 19(20), 13616; https://doi.org/10.3390/ijerph192013616
Submission received: 8 September 2022 / Revised: 9 October 2022 / Accepted: 17 October 2022 / Published: 20 October 2022
(This article belongs to the Special Issue Effect of Physical Activity on Human Fitness)

Abstract

:
(1) Background: The Systemic immune-inflammatory index (SII) has been proven to be an effective biomarker of human immune and inflammatory levels and has prognostic significance for most diseases. Handgrip strength (HGS) is a simple and low-cost strength measurement method, which is not only highly correlated with overall muscle strength but also accurately and reliably predicts the risk of multiple chronic diseases and mortality; (2) Purpose: Association between HGS and the SII is unclear. The purpose of this study was to investigate the association between HGS and the SII in American adults; (3) Methods: We used the data from the 2011–2012 and 2013–2014 cycles of the National Health and Nutrition Examination Survey (NHANES), involving a total of 8232 American adults (aged 18–80 years). The SII was calculated as the Platelet count × Neutrophil count/Lymphocyte count; HGS was recorded as the ratio of the sum of the highest grip-strength values of each hand to body mass index taken as the relative grip strength. A weighted generalized linear regression model and analysis of restricted cubic spline regression, adjusted for confounding factors, were used in this study to assess associations between HGS and the SII in American adults; (4) Results: There was a negative correlation between the HGS and the SII of different sexes (p < 0.05), and there was a significant negative nonlinear relationship between the HGS and the SII in males (p for nonlinear = 0.0035), and the SII showed a downward trend with the increase in the HGS in males (Q2: β = −61.03, p = 0.01; Q3: β = −61.28, p = 0.04, Q4: β = −64.36, p = 0.03, p for trend = 0.04), when the HGS exceeds 3.16, with the HGS increasing, the downward trend of increasing the SII slowed down. The nonlinear relationship between the HGS and the SII in females was not significant (p for nonlinear = 0.1011), and the SII showed a linear downward trend with the increase in the HGS (Q2: β = −24.91, p = 0.25; Q3: β = −62.01, p = 0.03, Q4: β = −74.94, p = 0.03, p for trend = 0.01); (5) Conclusions: HGS is inversely and independently associated with SII levels, and although the limited cubic spline regression analysis showed gender differences, the overall trend of the HGS and the SII in different genders was consistent, with both showing that the SII decreased with increasing the HGS. In addition, HGS has high general applicability based on its ease of measurement; it is possible to understand one’s own grip-strength level through routine grip-strength tests, and to make preliminary predictions on the current level of immunity and inflammation in the body.

1. Introduction

Many studies have confirmed that the level of inflammation and immune function can directly affect the health of the human body, and chronic inflammation and decreased immune function directly or indirectly induce most chronic diseases (such as cancer, diabetes, Parkinson’s disease, and osteoporosis) [1,2,3,4,5,6,7,8]. Therefore, the regulation of inflammation levels and immune function may be of great significance for the prevention and treatment of chronic diseases and improvement of national health.
The systemic immune-inflammatory index (SII) is considered a stable and accurate indicator of the overall or local immune response and inflammation level of the human body [9,10,11,12,13]. This indicator is calculated using three inflammatory factors: platelets, neutrophils, and lymphocytes. Relevant studies have confirmed that the SII exhibits strong prognostic value for tumors and chronic diseases induced by chronic inflammation or immune dysfunction [9,10,11,12]. In addition, previous studies have found that the SII has a higher prognostic accuracy than other traditional inflammatory factors (such as C-reactive protein (CRP), serum albumin, and triglyceride levels) in patients with severe pancreatitis [13].
Skeletal muscle is the most abundant tissue in the human body and plays an important role in maintaining a healthy environment owing to its high degree of remodeling. Muscle mass changes dynamically in real-time with factors such as physical activity, disease, and aging [14]. According to the latest epidemiological surveys, the prevalence of sarcopenia caused by population aging is increasing every year, and the decline in muscle mass leads to serious disability and mortality [15,16]. Handgrip strength (HGS) is a simple and low-cost strength measurement method, which is not only highly correlated with overall muscle strength but also accurately and reliably predicts the risk of multiple chronic diseases and mortality [7,17,18,19,20,21,22]. A cross-sectional study of the Korean National Health and Nutrition Examination Survey (KNHANES VI) confirmed that lower HGS was associated with an increased risk of depression in Korean adults (young, middle-aged, and older), suggesting that increasing muscle strength could prevent depression in Korean adults [23]. A recent cross-sectional study of the NHANES confirmed that HGS in older adults was significantly associated with better cognitive performance, both globally and in a variety of domains, such as memory, language, attention, and subjective cognition [24]. A large population study by Soto et al. found that HGS was associated with morbidity and mortality in endometrial, gallbladder, colorectal, liver, all-cause, and breast and kidney cancers, independent of major confounders (comorbidities, diet, and physical activity), highlighting HGS as an independent risk predictor for several cancer sites [25]. An Urban Rural Epidemiology China Study by Liu et al. found that low HGS in hypertensive patients is associated with the risk of major CVD incidence, CVD mortality, and all-cause mortality, and high HGS levels appear to reduce the long-term risk of death in hypertensive patients [26]. Christina et al. concluded that physical fitness, especially muscle strength (grip strength), may increase health-related quality of life and is an important source of health in older age, suggesting that grip strength can be used as an indicator of health-related quality of life [27]. Recently, an up-to-date and comprehensive review of “Handgrip strength and Health” suggested HGS as a prognostic “biomarker” for specific outcomes across the lifespan of human beings, among both current and future populations [28].
The SII and HGS are both known to provide additional valuable information for risk prediction for many chronic diseases and mortality, but the relationship between the SII and HGS is currently unclear. This study aimed to determine the association between HGS and the SII among American adults. Based on previous studies, we propose there is an association between HGS and the SII, and that the SII may decrease with the increase in HGS.

2. Materials and Methods

2.1. Study Design

The subjects of this study were drawn primarily from the National Health and Nutrition Examination Survey (NHANES), a nationally representative survey led by the Centers for Disease Control and Prevention, to assess the health and nutritional status of American adults and children. The Centers for Disease Control and Prevention conducted surveys and published data on a 2-year cycle. The survey utilized a multistage probability sampling design to examine a nationally representative sample of approximately 10,000 non-institutionalized individuals across the United States.
During home interviews, participants were asked questions about demographic, socioeconomic, diet, and health-related parameters, and underwent a physical examination that included medical, dental, and physiological measurements, among others. A total of 19,931 individuals were sampled by the NHANES between 2011 and 2014. Our study inclusion criteria were as follows: (i) adults over 18 years old; (ii) fully participated in the handgrip-strength test; (iii) participated in the blood test. After excluding those who did not meet the criteria or had missing data (11,699 people), 8232 people were included as the participants in the present study. The study was approved by the Research Ethics Review Board of the National Center for Health Statistics, and participants signed an informed consent form.

2.2. Procedures

2.2.1. Blood Extraction

Blood tests (complete blood count, CBC) of the NHANES 2011–2014 were analyzed on a Coulter HMX (Coulter Electronics Ltd., Bedfordshire, UK) in 2011–2012 and the Beckman Coulter DXH 800 (Beckman Coulter, Brea, CA, USA) in 2013–2014 using mixed EDTA blood samples from participants.
Neutrophil, lymphocyte, and platelet counts were collected for analysis. The systemic immune-inflammation index (SII) was calculated from the CBC values using the following formula: platelet count × neutrophil count ÷ lymphocyte count [11].

2.2.2. Handgrip Strength

Handgrip strength (HGS) was measured by Takei dynamometer (TKK 5401; Takei Scientific Instruments, Tokyo, Japan). The participants were asked to maintain an upright posture, with their arms vertically downward, and hold the dynamometer for strength testing. The test was repeated three times for both hands (dominant hand and non-dominant hand), with a 60-s interval between each measurement, and the highest grip-strength value of each hand was taken. The ratio of the sum of the highest grip-strength values of each hand to BMI was taken as the relative grip strength [29,30,31,32].

2.2.3. Covariates

Covariates that may have influenced the results were included in this study: sex (male, female), age (<20, 20–29, 30–39, 40–49, 50–59, ≥60), education level (below high school level, high school, above high school), race (black, white, Mexican, other races), poverty-to-income ratio (PIR, calculated by dividing family (or individual) income by the poverty guidelines specific to the survey year; <1.3, 1.3–3.49, ≥3.5), BMI (<25, 25–29.9, ≥30), smoking status (never smoked, former smoker, current smoker), alcohol status (never, former, mild, moderate, heavy), hypertension (yes, no), diabetes (yes, no), hyperlipidemia (yes, no).

2.3. Statistical Analysis

R Studio (4.2.0, US) was used for statistical analysis. During the data analysis process, the sampling weight was used to consider the complex survey design (for example, the selection probability was not equal), and comprehensive weight analysis and weighting processing were performed on the final valid data.
Continuous variables were presented as weighted means and standard errors, and categorical variables were presented as weighted percentages. The chi-square and t-tests were used for categorical variables and continuous variables, respectively, to compare the distribution and mean differences of correlated variables among individuals of different sexes. A weighted generalized linear regression model was used to analyze the association between HGS and the SII for complex survey samples, and covariates were controlled to explore the linear relationship between HGS and the SII. Weighted generalized linear models were adjusted for covariates and further stratified by sex. A restricted cubic spline plot (RCS) was used to detect potential nonlinear relationships between HGS and the SII, and the RCS models were adjusted for covariates and further stratified by sex. All statistical tests were two-sided, and a p-value < 0.05 was statistically significant.

3. Results

3.1. Baseline Characteristics of Participants

A total of 8232 participants were included in this study, including 4100 women (49.8%) and 4132 men (50.2%). Table 1 shows the distribution of participant characteristics for each quartile of the SII. HGS, sex, age, race, BMI, education, smoking status, alcohol status, diabetes, hypertension, and hyperlipidemia were all significantly different between the SII quartile groups (p < 0.05).
In contrast, people over 60 years of age, women, white ethnicity, higher BMI, and highly educated people were associated with higher SII levels. Non-drinkers had lower SII levels, but this trend was not significant in non-smokers. In the population with comorbidities, higher SII levels were seen in patients with hyperlipidemia, but not in those with diabetes and hypertension. We observed that HGS was highest in the lowest SII quantile and showed a downward trend with increasing the SII.

3.2. The Association between the SII and Handgrip Strength

Table 2 shows the relationship between HGS and the SII in the three weighted generalized linear regression models. In the fully adjusted model (Model III), the highest quartile of HGS was more negatively associated with the SII than the lowest quartile of HGS (β = −77.31, −129.58~−25.04, p = 0.01), and remained relatively stable in different models. Compared with the lowest quartile of HGS, the second and third quartiles of HGS were significantly negatively correlated with the SII, and the above correlations were all statistically significant (Q2: β = −35.75, −66.93~−4.56, p = 0.03; Q3 = −79.49, −115.44~−43.55, p < 0.001). The same trend was observed in the sensitivity analysis (p for trend < 0.01).
In the subgroup analysis stratified by sex, male HGS and the SII remained relatively stable across different models and, in the fully adjusted model (Model III), HGS and the SII were associated (Q2: β = −61.03, −101.14~−20.92, p = 0.01; Q3: β = −61.28, −116.71~−5.86, p < 0.05; Q4: β = −64.36, −118.25~−10.46, p < 0.05). Sensitivity analysis showed the same trend (p for trend < 0.01).
Compared with the lowest quantile of female HGS, females’ HGS third and fourth quartiles and the SII remained relatively stable across the different models. In the fully adjusted model (Model III), the correlation between HGS and the SII was significant (Q2: β = −24.91, −101.14~−20.92, p = 0.25; Q3: β = −62.01, −117.07~−6.94, p < 0.05; Q3: β = −74.94, −137.21~−12.66, p < 0.05). Sensitivity analysis showed the same trend (p for trend < 0.05).

3.3. Analysis of Restricted Cubic Spline Regression

In restricted cubic spline regression, adjusting for different covariates, we found a significant nonlinear relationship between HGS and the SII (p = 0.0006, Figure 1a). Figure 1a shows a decreasing trend of the SII with increasing the HGS. When the HGS exceeds 2.48, the decreasing trend of the SII becomes slower with increasing the HGS. In the subgroup analysis of different sexes, it was found that there was a significant nonlinear relationship between male HGS and the SII (p = 0.0035, Figure 1b), while female HGS had no significant nonlinear relationship with the SII (p = 0.1011, Figure 1c). Figure 1b shows that the SII decreased with increasing the HGS in males. When the HGS exceeded 3.16, the decreasing trend of the SII slowed down with increasing the HGS. Although the nonlinear analysis results of the three restricted cubic splines were slightly different, the overall changing trends of the dependent and independent variables in each graph were relatively consistent.

4. Discussion

In this cross-sectional study of 8232 participants, we investigated the association between HGS and the SII in American adults. The main purpose of this study was to explore the potential relationship between HGS and the SII, and a negative correlation between HGS and the SII was confirmed in this study. Our findings reinforce current public health physical activity guidelines (emphasizing the importance of engaging in muscle-strengthening activities) [33], suggesting that higher levels of HGS may be associated with immune function and levels of inflammation in human beings.
Absolute values of HGS are closely related to body weight, and the use of it as an indicator of muscle strength, without correcting for body weight, may be an important reason for the contradictory results of many studies [29,30,32,34]. Several studies have shown that relative values of HGS are better than absolute grip strength in predicting some chronic diseases [18,29,30], so this study chose relative grip strength as the main independent variable to explore its potential association with the SII. A study by Jun Kim et al. confirmed that higher serum hypersensitive C-reactive protein (hs-CRP) in older men was associated with lower HGS [31], further suggesting that chronic low-grade systemic inflammation may, alongside aging, be a common risk factor for simultaneous deterioration of muscle and bone. The association analysis of HGS and hs-CRP in postmenopausal women conducted by Son et al. supplemented the above studies, which found that serum hs-CRP in postmenopausal women was negatively correlated with HGS [29]. A study on the association analysis of HGS and inflammatory biomarker profiles in the elderly confirmed that inflammatory signatures such as hs-CRP and albumin were independently associated with baseline HGS, and future studies linking more inflammatory signatures to muscle strength are needed to confirm these findings in older adults [28]. Brinkley et al. found a high correlation between inflammatory biomarkers (CRP and IL-6) and HGS [35]. The study by Schaap et al. further confirmed that TNF-α and its soluble receptor (IL-6sR) exhibited the most consistent associations with decreases in muscle mass and strength, finding that HGS was highly inversely correlated with TNF-α and IL-6sR [36]. The above evidence provides further support for the development and implementation of this study. Obviously, the association between HGS and inflammation has been confirmed, but there are still few studies on the association analysis of HGS and immune function. Based on the effective application of the SII in epidemiological studies in the past, this study adopted the SII, and it is reasonable to assess the association of muscle strength with levels of inflammation and immune function.
The results of this study are consistent with those of previous related studies [15,29,31,36,37] and, while proving that higher HGS is highly correlated with lower SII, we analyzed the nonlinear relationship between HGS and the SII using restricted cubic spline regression analysis to further explain the association. The physiological mechanisms related to the association between HGS, immune function, and inflammation are relatively complex. This study attempted to explore these physiological mechanisms by logically sorting out the limited number of previous studies.
Immune dysfunction and chronic inflammation are combined risk factors for sarcopenia and decreased muscle strength [5,15,16,29,36,38,39,40,41]. It is known that HGS is an important diagnostic indicator of sarcopenia, and this indicator is highly correlated with overall muscle strength. Some studies have suggested that skeletal muscle can directly regulate immune function and the degree of inflammation in the human body [16,42]. Therefore, we believe that the relationship between muscle strength, chronic inflammation, and immune function is not unidirectional. The perception of skeletal muscle as a mere motor organ has changed over the past two decades, and muscle has become recognized as a specialized organ with immunomodulatory properties [7].
Interleukin-6 (IL-6) is a well-known myokine, has two-way pro-inflammatory/anti-inflammatory effects. After moderate exercise, muscles release a large amount of IL-6 into the circulating blood, where it acts as an anti-inflammatory factor by regulating satellite cell function and enhancing glucose metabolism, thereby contributing to the recovery of skeletal muscle and improvement of muscle strength [14,43,44,45,46]. However, long-term exposure to, and high concentrations of IL-6 are accompanied by a large degree of activation of pro-inflammatory factors such as TNF-α, thereby weakening the ability of muscle anabolism and energy homeostasis to induce muscle atrophy and muscle strength decline [29,40,43].
Muscle strength depends, to a certain extent, on the regenerative potential of skeletal muscle after exercise, and the regenerative potential of skeletal muscle is mainly affected by the interaction between skeletal muscle and immune cells [47,48]. In response to post-exercise muscle injury, immune cell infiltration of skeletal muscle promotes muscle recovery and strengthening by removing apoptotic and necrotic cells and secreting several growth factors required for satellite cell proliferation and differentiation.
The immune system plays an important role in the maintenance and support of skeletal muscle, and studies have suggested that levels of immune function may affect muscle growth [7,36,37,46,47,48,49,50]. Age-related immune dysregulation and aging may be important reasons for the worsening of sarcopenia, and grip strength, an important indicator for assessing muscle strength in sarcopenia, may be potentially associated with immune function to a certain extent [5,15,16,36,39,40,41,42,48]. As people age, the immune system undergoes immunosenescence. Aging leads to increased levels of pro-inflammatory factors (especially CRP, TNF-α, and IL-6) in the blood, thereby inducing long-term chronic inflammation and decreased immune function, which is also a major factor for the increased chronic disease risk in the elderly [38,39]. Relevant studies have shown that Interleukin-15 (IL-15) plays an important role in immune function during human aging. It not only acts on the proliferation, activation, and distribution of B-cells and natural killer cells but also affects the maintenance of T-cell activity [49,50,51,52]. The contraction of skeletal muscle during exercise releases a large amount of IL-15 into the circulating blood to quickly improve immune function [41]. Notably, however, skeletal muscle production and release of IL-15 are affected by adenosine 5′-monophosphate-activated protein kinase (AMPK) levels, and AMPK activity declines with increasing age [53,54]. Therefore, it is unclear whether muscle strength can counteract the negative effects of aging on IL-15 production and release. Recently, a study by Lopez et al. showed that high levels of HGS were associated with lower total white blood cell count, suggesting that healthy muscle levels could help boost immune system function in adolescents [33]. The above evidence provides valuable theoretical reference for the results of this study. Although there is less research to prove the relationship between HGS and immune function, based on the above limited evidence, HGS is an important indicator of human muscle strength. The decline of immune function induces acute and chronic inflammation in the whole body and mediates and affects the repair of skeletal muscle and regeneration, which in turn triggers a decline in HGS.
Our study had several advantages. This is the first study to explore the relationship between HGS, degree of inflammation, and immune function based on the SII indicators. This study used a large representative sample from the American NHANES. We abandoned the previous methods of using absolute one-handed (or dominant hand) HGS and instead used the relative HGS value, which is currently considered to be the most accurate, as the main research index of the study. While studying the linear relationship between the indicators, restricted cubic spline regression analysis, commonly used in epidemiology, was included to further explore the potential correlation between the indicators. However, our study had some limitations. Some classic inflammatory factors (TNF-α, IL-6, IL-10, etc.) have not been recorded by NHANES, so relevant indicators cannot be included in this study for analysis to obtain more comprehensive results. In addition, although HGS is a typical indicator for evaluating muscle strength, if experimental conditions allow, more muscle strength (lower limb muscle strength) and muscle mass evaluation indicators should be included as much as possible for joint explanation. Because this study is based on the NHANES large population survey, it cannot provide a more comprehensive assessment of muscle strength, so this is a limitation in our study. This study provides scientific data reference for future research. We will also include strength testing of different muscle groups and assessment of skeletal muscle mass in future research to further explore the relationship between muscle strength and immunity and inflammation.

5. Conclusions

In conclusion, data were collected from a nationally representative survey that HGS is inversely and independently associated with SII levels, and although the limited cubic spline regression analysis showed gender differences, the overall trend of HGS and the SII in different genders was consistent, with both showing that the SII decreased with increasing the HGS.
In addition, HGS has high general applicability based on its ease of measurement; it is possible to understand one’s own grip-strength level through routine grip-strength tests, and to make preliminary predictions on the current level of immunity and inflammation in the body. The association of HGS with the SII in this study has been preliminarily confirmed, and future studies should incorporate strength testing of different muscle groups and assessment of skeletal muscle mass to further explore the relationships among muscle strength, immunity, and inflammation.

Author Contributions

Conceptualization, D.W. and X.G.; methodology, D.W.; software, D.W.; validation, H.W. and W.W.; investigation, D.W.; data curation, D.W., Y.L. and Z.Z.; writing—original draft preparation, D.W.; writing—review and editing, X.G. and Y.S. All authors have read and agreed to the published version of the manuscript.

Funding

Project 20-02 supported by the Fundamental Research Funds for the China Institute of Sport Science.

Institutional Review Board Statement

The ethical standards of the institutional and/or national research committee [National Health and Nutrition Examination Survey, NCHS IRB/ERB Protocol Number: NHANES 2011–2012 (Protocol #2011-17); NHANES 2013–2014 (Continuation of Protocol #2011-17)] was followed for all the procedures with human beings. As the data did not include personal identifiers, no additional consent was required for this study.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Publicly available datasets were analyzed in this study. This data can be found here: https://wwwn.cdc.gov/nchs/nhanes/ (accessed on 1 May 2022).

Acknowledgments

We acknowledge the staff at the National Center for Health Statistics at the CDC, who design, collect, administer the NHANES data and release the data available for public use. We are thankful to all study participants for their cooperation.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Zhao, H.; Wu, L.; Yan, G.; Chen, Y.; Zhou, M.; Wu, Y.; Li, Y. Inflammation and tumor progression: Signaling pathways and targeted intervention. Signal Transduct. Target. Ther. 2021, 6, 263. [Google Scholar] [CrossRef] [PubMed]
  2. Vasan, N.; Baselga, J.; Hyman, D.M. A view on drug resistance in cancer. Nature 2019, 575, 299–309. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  3. Tang, W.; Chen, Z.; Zhang, W.; Cheng, Y.; Zhang, B.; Wu, F.; Wang, Q.; Wang, S.; Rong, D.; Reiter, F.P.; et al. The mechanisms of sorafenib resistance in hepatocellular carcinoma: Theoretical basis and therapeutic aspects. Signal Transduct. Target. Ther. 2020, 5, 87. [Google Scholar] [CrossRef] [PubMed]
  4. Gupta, S.C.; Kunnumakkara, A.B.; Aggarwal, S.; Aggarwal, B.B. Inflammation, a Double-Edge Sword for Cancer and Other Age-Related Diseases. Front. Immunol. 2018, 9, 2160. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  5. Suzuki, K. Chronic Inflammation as an Immunological Abnormality and Effectiveness of Exercise. Biomolecules 2019, 9, 223. [Google Scholar] [CrossRef] [Green Version]
  6. Zhong, J.; Shi, G. Editorial: Regulation of Inflammation in Chronic Disease. Front. Immunol. 2019, 10, 737. [Google Scholar] [CrossRef] [Green Version]
  7. Afzali, A.M.; Müntefering, T.; Wiendl, H.; Meuth, S.G.; Ruck, T. Skeletal muscle cells actively shape (auto)immune responses. Autoimmun. Rev. 2018, 17, 518–529. [Google Scholar] [CrossRef]
  8. Leuti, A.; Fazio, D.; Fava, M.; Piccoli, A.; Oddi, S.; Maccarrone, M. Bioactive lipids, inflammation and chronic diseases. Adv. Drug. Deliv. Rev. 2020, 159, 133–169. [Google Scholar] [CrossRef]
  9. Fu, H.; Zheng, J.; Cai, J.; Zeng, K.; Yao, J.; Chen, L.; Li, H.; Zhang, J.; Zhang, Y.; Zhao, H.; et al. Systemic Immune-Inflammation Index (SII) is Useful to Predict Survival Outcomes in Patients After Liver Transplantation for Hepatocellular Carcinoma within Hangzhou Criteria. Cell. Physiol. Biochem. 2018, 47, 293–301. [Google Scholar] [CrossRef]
  10. Chen, J.-H.; Zhai, E.-T.; Yuan, Y.J.; Wu, K.-M.; Xu, J.-B.; Peng, J.-J.; Chen, C.-Q.; He, Y.-L.; Cai, S.-R. Systemic immune-inflammation index for predicting prognosis of colorectal cancer. World J. Gastroenterol. 2017, 23, 6261–6272. [Google Scholar] [CrossRef]
  11. Hu, B.; Yang, X.-R.; Xu, Y.; Sun, Y.-F.; Sun, C.; Guo, W.; Zhang, X.; Wang, W.-M.; Qiu, S.-J.; Zhou, J.; et al. Systemic Immune-Inflammation Index Predicts Prognosis of Patients after Curative Resection for Hepatocellular Carcinoma. Clin. Cancer Res. 2014, 20, 6212–6222. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  12. Huang, H.; Liu, Q.; Zhu, L.; Zhang, Y.; Lu, X.; Wu, Y.; Liu, L. Prognostic Value of Preoperative Systemic Immune-Inflammation Index in Patients with Cervical Cancer. Sci. Rep. 2019, 9, 3284. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  13. Lu, L.; Feng, Y.; Liu, Y.-H.; Tan, H.-Y.; Dai, G.-H.; Liu, S.-Q.; Li, B.; Feng, H.-G. The Systemic Immune-Inflammation Index May Be a Novel and Strong Marker for the Accurate Early Prediction of Acute Kidney Injury in Severe Acute Pancreatitis Patients. J. Investig. Surg. 2022, 35, 962–966. [Google Scholar] [CrossRef] [PubMed]
  14. Haddad, F.; Zaldivar, F.; Cooper, D.M.; Adams, G.R. IL-6-induced skeletal muscle atrophy. J. Appl. Physiol. 2005, 98, 911–917. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  15. Zhao, W.-Y.; Zhang, Y.; Hou, L.-S.; Xia, X.; Ge, M.-L.; Liu, X.-L.; Yue, J.-R.; Dong, B.-R. The association between systemic inflammatory markers and sarcopenia: Results from the West China Health and Aging Trend Study (WCHAT). Arch. Gerontol. Geriatr. 2021, 92, 104262. [Google Scholar] [CrossRef]
  16. Ethgen, O.; Beaudart, C.; Buckinx, F.; Bruyere, O.; Reginster, J.Y. The Future Prevalence of Sarcopenia in Europe: A Claim for Public Health Action. Calcif. Tissue Res. 2017, 100, 229–234. [Google Scholar] [CrossRef] [Green Version]
  17. Forrest, K.Y.Z.; Williams, A.M.; Leeds, M.J.; Robare, J.F.; Bechard, T.J. Patterns and Correlates of Grip Strength in Older Americans. Curr. Aging Sci. 2018, 11, 63–70. [Google Scholar] [CrossRef]
  18. Iconaru, E.I.; Ciucurel, M.M.; Georgescu, L.; Ciucurel, C. Hand grip strength as a physical biomarker of aging from the perspective of a Fibonacci mathematical modeling. BMC Geriatr. 2018, 18, 296. [Google Scholar] [CrossRef]
  19. Nacul, L.C.; Mudie, K.; Kingdon, C.C.; Clark, T.G.; Lacerda, E.M. Hand Grip Strength as a Clinical Biomarker for ME/CFS and Disease Severity. Front. Neurol. 2018, 9, 992. [Google Scholar] [CrossRef]
  20. Bohannon, R.W. Muscle strength: Clinical and prognostic value of hand-grip dynamometry. Curr. Opin. Clin. Nutr. Metab. Care 2015, 18, 465–470. [Google Scholar] [CrossRef]
  21. Sayer, A.A.; Kirkwood, T.B. Grip strength and mortality: A biomarker of ageing? Lancet 2015, 386, 226–227. [Google Scholar] [CrossRef]
  22. Bohannon, R.W. Hand-Grip Dynamometry Predicts Future Outcomes in Aging Adults. J. Geriatr. Phys. Ther. 2008, 31, 3–10. [Google Scholar] [CrossRef] [PubMed]
  23. Lee, M.-R.; Jung, S.M.; Bang, H.; Kim, H.S.; Kim, Y.B. The association between muscular strength and depression in Korean adults: A cross-sectional analysis of the sixth Korea National Health and Nutrition Examination Survey (KNHANES VI) 2014. BMC Public Health 2018, 18, 1123. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  24. Yang, J.; Deng, Y.; Yan, H.; Li, B.; Wang, Z.; Liao, J.; Cai, X.; Zhou, L.; Tan, W.; Rong, S. Association Between Grip Strength and Cognitive Function in US Older Adults of NHANES 2011–2014. J. Alzheimer’s Dis. 2022, 89, 427–436. [Google Scholar] [CrossRef] [PubMed]
  25. Parra-Soto, S.; Pell, J.P.; Celis-Morales, C.; Ho, F.K. Absolute and relative grip strength as predictors of cancer: Prospective cohort study of 445 552 participants in UK Biobank. J. Cachexia Sarcopenia Muscle 2022, 13, 325–332. [Google Scholar] [CrossRef] [PubMed]
  26. Liu, W.; Leong, D.P.; Hu, B.; AhTse, L.; Rangarajan, S.; Wang, Y.; Wang, C.; Lu, F.; Li, Y.; Yusuf, S.; et al. The association of grip strength with cardiovascular diseases and all-cause mortality in people with hypertension: Findings from the Prospective Urban Rural Epidemiology China Study. J. Sport Health Sci. 2021, 10, 629–636. [Google Scholar] [CrossRef] [PubMed]
  27. Musalek, C.; Kirchengast, S. Grip Strength as an Indicator of Health-Related Quality of Life in Old Age-A Pilot Study. Int. J. Environ. Res. Public Health 2017, 14, 1447. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  28. Bohannon, R.W. Grip Strength: An Indispensable Biomarker For Older Adults. Clin. Interv. Aging 2019, 14, 1681–1691. [Google Scholar] [CrossRef] [Green Version]
  29. Son, D.-H.; Song, S.-A.; Lee, Y.-J. Association Between C-Reactive Protein and Relative Handgrip Strength in Postmenopausal Korean Women Aged 45–80 Years: A Cross-Sectional Study. Clin. Interv. Aging 2022, 17, 971–978. [Google Scholar] [CrossRef]
  30. Yi, D.W.; Khang, A.R.; Lee, H.W.; Son, S.M.; Kang, Y.H. Relative handgrip strength as a marker of metabolic syndrome: The Korea National Health and Nutrition Examination Survey (KNHANES) VI (2014–2015). Diabetes Metab. Syndr. Obes. 2018, 11, 227–240. [Google Scholar] [CrossRef]
  31. Kim, B.-J.; Lee, S.H.; Kwak, M.K.; Isales, C.M.; Koh, J.-M.; Hamrick, M.W. Inverse relationship between serum hsCRP concentration and hand grip strength in older adults: A nationwide population-based study. Aging 2018, 10, 2051–2061. [Google Scholar] [CrossRef] [PubMed]
  32. Li, D.; Guo, G.; Xia, L.; Yang, X.; Zhang, B.; Liu, F.; Ma, J.; Hu, Z.; Li, Y.; Li, W.; et al. Relative Handgrip Strength Is Inversely Associated with Metabolic Profile and Metabolic Disease in the General Population in China. Front. Physiol. 2018, 9, 59. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  33. López-Gil, J.F.; Ramírez-Vélez, R.; Izquierdo, M.; García-Hermoso, A. Handgrip Strength and Its Relationship with White Blood Cell Count in U.S. Adolescents. Biology 2021, 10, 884. [Google Scholar] [CrossRef] [PubMed]
  34. Lee, W.-J.; Peng, L.-N.; Chiou, S.-T.; Chen, L.-K. Relative Handgrip Strength Is a Simple Indicator of Cardiometabolic Risk among Middle-Aged and Older People: A Nationwide Population-Based Study in Taiwan. PLoS ONE 2016, 11, e0160876. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  35. Brinkley, T.E.; Leng, X.; Miller, M.E.; Kitzman, D.W.; Pahor, M.; Berry, M.J.; Marsh, A.P.; Kritchevsky, S.B.; Nicklas, B.J. Chronic Inflammation Is Associated with Low Physical Function in Older Adults across Multiple Comorbidities. J. Gerontol. A Biol. Sci. Med. Sci. 2009, 64, 455–461. [Google Scholar] [CrossRef] [Green Version]
  36. Schaap, L.A.; Pluijm, S.M.; Deeg, D.J.; Visser, M. Inflammatory Markers and Loss of Muscle Mass (Sarcopenia) and Strength. Am. J. Med. 2006, 119, 526.e9-17. [Google Scholar] [CrossRef]
  37. Alemán, H.; Esparza, J.; Ramirez, F.A.; Astiazaran, H.; Payette, H. Longitudinal evidence on the association between interleukin-6 and C-reactive protein with the loss of total appendicular skeletal muscle in free-living older men and women. Age Ageing 2011, 40, 469–475. [Google Scholar] [CrossRef] [Green Version]
  38. Bano, G.; Trevisan, C.; Carraro, S.; Solmi, M.; Luchini, C.; Stubbs, B.; Manzato, E.; Sergi, G.; Veronese, N. Inflammation and sarcopenia: A systematic review and meta-analysis. Maturitas 2017, 96, 10–15. [Google Scholar] [CrossRef]
  39. Dalle, S.; Rossmeislova, L.; Koppo, K. The Role of Inflammation in Age-Related Sarcopenia. Front. Physiol. 2017, 8, 1045. [Google Scholar] [CrossRef] [Green Version]
  40. Jin, H.; Xie, W.; Hu, P.; Tang, K.; Wang, X.; Wu, Y.; He, M.; Yu, D.; Li, Y. The role of melatonin in sarcopenia: Advances and application prospects. Exp. Gerontol. 2021, 149, 111319. [Google Scholar] [CrossRef]
  41. Nelke, C.; Dziewas, R.; Minnerup, J.; Meuth, S.G.; Ruck, T. Skeletal muscle as potential central link between sarcopenia and immune senescence. EBioMedicine 2019, 49, 381–388. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  42. Cruz-Jentoft, A.J.; Bahat, G.; Bauer, J.; Boirie, Y.; Bruyere, O.; Cederholm, T.; Cooper, C.; Landi, F.; Rolland, Y.; Sayer, A.A.; et al. Sarcopenia: Revised European consensus on definition and diagnosis. Age Ageing 2019, 48, 16–31. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  43. Schaper, F.; Rose-John, S. Interleukin-6: Biology, signaling and strategies of blockade. Cytokine Growth Factor Rev. 2015, 26, 475–487. [Google Scholar] [CrossRef] [PubMed]
  44. Munoz-Canoves, P.; Scheele, C.; Pedersen, B.K.; Serrano, A.L. Interleukin-6 myokine signaling in skeletal muscle: A double-edged sword? FEBS J. 2013, 280, 4131–4148. [Google Scholar] [CrossRef] [PubMed]
  45. Keller, C.; Hellsten, Y.; Steensberg, A.; Pedersen, B.K. Differential regulation of IL-6 and TNF-α via calcineurin in human skeletal muscle cells. Cytokine 2006, 36, 141–147. [Google Scholar] [CrossRef]
  46. Serrano, A.L.; Baeza-Raja, B.; Perdiguero, E.; Jardí, M.; Muñoz-Cánoves, P. Interleukin-6 Is an Essential Regulator of Satellite Cell-Mediated Skeletal Muscle Hypertrophy. Cell Metab. 2008, 7, 33–44. [Google Scholar] [CrossRef] [Green Version]
  47. Domingues-Faria, C.; Vasson, M.-P.; Goncalves-Mendes, N.; Boirie, Y.; Walrand, S. Skeletal muscle regeneration and impact of aging and nutrition. Ageing Res. Rev. 2016, 26, 22–36. [Google Scholar] [CrossRef]
  48. Saini, J.; McPhee, J.S.; Al-Dabbagh, S.; Stewart, C.E.; Al-Shanti, N. Regenerative function of immune system: Modulation of muscle stem cells. Ageing Res. Rev. 2016, 27, 67–76. [Google Scholar] [CrossRef]
  49. Nielsen, A.R.; Mounier, R.; Plomgaard, P.; Mortensen, O.H.; Penkowa, M.; Speerschneider, T.; Pilegaard, H.; Pedersen, B.K. Expression of interleukin-15 in human skeletal muscle—Effect of exercise and muscle fibre type composition. J. Physiol. 2007, 584, 305–312. [Google Scholar] [CrossRef]
  50. Yang, H.; Chang, J.; Chen, W.; Zhao, L.; Qu, B.; Tang, C.; Qi, Y.; Zhang, J. Treadmill exercise promotes interleukin 15 expression in skeletal muscle and interleukin 15 receptor alpha expression in adipose tissue of high-fat diet rats. Endocrine 2013, 43, 579–585. [Google Scholar] [CrossRef]
  51. Conlon, K.C.; Lugli, E.; Welles, H.C.; Rosenberg, S.A.; Fojo, A.T.; Morris, J.C.; Fleisher, T.A.; Dubois, S.P.; Perera, L.P.; Stewart, D.M.; et al. Redistribution, Hyperproliferation, Activation of Natural Killer Cells and CD8 T Cells, and Cytokine Production During First-in-Human Clinical Trial of Recombinant Human Interleukin-15 in Patients with Cancer. J. Clin. Oncol. 2015, 33, 74–82. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  52. Tamura, Y.; Watanabe, K.; Kantani, T.; Hayashi, J.; Ishida, N.; Kaneki, M. Upregulation of circulating IL-15 by treadmill running in healthy individuals: Is IL-15 an endocrine mediator of the beneficial effects of endurance exercise? Endocr. J. 2011, 58, 211–215. [Google Scholar] [CrossRef] [Green Version]
  53. Kjøbsted, R.; Hingst, J.R.; Fentz, J.; Foretz, M.; Sanz, M.-N.; Pehmøller, C.; Shum, M.; Marette, A.; Mounier, R.; Treebak, J.T.; et al. AMPK in skeletal muscle function and metabolism. FASEB J. 2018, 32, 1741–1777. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  54. Salminen, A.; Kaarniranta, K.; Kauppinen, A. Age-related changes in AMPK activation: Role for AMPK phosphatases and inhibitory phosphorylation by upstream signaling pathways. Ageing Res. Rev. 2016, 28, 15–26. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Analysis of Restricted Cubic Spline Regression. Legend: Adjusted restricted cubic spline models ((a): overall, (b): male, (c): female) showed the association between HGS and SII in all participants. Model adjusted for sex, age, race, BMI, education, PIR, smoking, alcohol, diabetes, hypertension, and hyperlipidemia. Solid and long dashed lines represent the estimated regression coefficient Beta and its 95% confidence interval.
Figure 1. Analysis of Restricted Cubic Spline Regression. Legend: Adjusted restricted cubic spline models ((a): overall, (b): male, (c): female) showed the association between HGS and SII in all participants. Model adjusted for sex, age, race, BMI, education, PIR, smoking, alcohol, diabetes, hypertension, and hyperlipidemia. Solid and long dashed lines represent the estimated regression coefficient Beta and its 95% confidence interval.
Ijerph 19 13616 g001
Table 1. Demographic characteristics stratified by Quartile of SII (N = 8232).
Table 1. Demographic characteristics stratified by Quartile of SII (N = 8232).
CharacteristicOverallQuartile 1Quartile 2Quartile 3Quartile 4p-Value
N82322058205820582058
HGS, mean (SE)2.64 (0.02)2.80 (0.03)2.71 (0.02)2.64 (0.03)2.43 (0.03)<0.0001
SII, mean (SE)528.93 (7.29)243.93 (1.48)382.67 (0.81)529.65 (1.16)915.28 (8.39)<0.0001
Sex(%) <0.0001
Female4100896 (44.72)1011 (49.49)1061 (49.29)1132 (56.04)
Male41321162 (55.28)1047 (50.51)997 (50.71)926 (43.96)
Age (%) 0.02
<2025059 (1.70)75 (2.18)56 (1.47)60 (1.89)
20–291409380 (21.31)357 (18.21)351 (18.67)321 (15.85)
30–391388345 (17.65)365 (18.16)356 (15.26)322 (15.00)
40–491350299 (16.03)345 (17.41)363 (20.38)343 (18.79)
50–591320341 (18.99)316 (18.24)336 (20.11)327 (18.42)
≥602515634 (24.32)600 (25.80)596 (24.11)685 (30.04)
Race (%) <0.0001
mexican921203 (7.89)223 (7.25)258 (8.04)237 (7.62)
white3563675 (61.38)885 (69.97)965 (71.46)1038 (73.34)
black1825723 (18.42)425 (9.45)347 (7.71)330 (7.17)
other1923457 (12.31)525 (13.33)488 (12.78)453 (11.88)
BMI (%) <0.0001
<252560705 (33.75)674 (32.28)609 (27.43)572 (27.41)
25–29.92627679 (34.18)690 (35.25)651 (33.88)607 (29.42)
≥303045674 (32.07)694 (32.47)798 (38.69)879 (43.17)
Edu (%) 0.03
Below1661439 (15.94)418 (13.47)390 (13.00)414 (14.86)
High school1838483 (22.39)433 (18.87)451 (21.29)471 (21.97)
Above47331136 (61.67)1207 (67.67)1217 (65.71)1173 (63.17)
PIR (%) 0.92
<1.32765673 (22.45)696 (23.21)684 (22.33)712 (23.64)
1.3–3.492858733 (36.13)710 (34.45)719 (34.49)696 (34.72)
≥3.52609652 (41.42)652 (42.35)655 (43.17)650 (41.64)
Smoke status (%) 0.03
former1891459 (23.03)453 (22.98)470 (24.42)509 (25.89)
never46811199 (58.40)1213 (58.41)1185 (57.11)1084 (51.93)
current1660400 (18.57)392 (18.61)403 (18.47)465 (22.18)
Alcohol status (%) 0.03
former1348343 (13.27)314 (11.61)309 (13.57)382 (16.49)
never1218339 (12.66)306 (11.09)283 (10.15)290 (11.21)
mild2765691 (35.56)714 (39.59)683 (35.29)677 (33.92)
moderate1277291 (17.42)328 (17.25)352 (19.44)306 (16.78)
heavy1624394 (21.10)396 (20.46)431 (21.55)403 (21.60)
Diabetes (%) < 0.001
no67831721 (89.03)1720 (87.40)1720 (86.36)1622 (83.02)
yes1449337 (10.97)338 (12.60)338 (13.64)436 (16.98)
Hypertension (%) < 0.001
no48371236 (65.97)1280 (64.82)1223 (61.64)1098 (55.55)
yes3395822 (34.03)778 (35.18)835 (38.36)960 (44.45)
Hyperlipidemia (%) 0.03
no2575720 (33.58)649 (31.43)629 (29.86)577 (28.13)
yes56571338 (66.42)1409 (68.57)1429 (70.14)1481 (71.87)
Continuous variables are expressed as weighted means (standard error), and categorical variables are expressed as weighted population (percentage), unless otherwise indicated. Differences between groups by sex were compared by t-test and chi-square test. HGS, handgrip strength; SII, systemic immune-inflammatory index; PIR, poverty-to-income ratio; Edu, educational level; BMI, body mass index; Systemic immune-inflammatory index quartile ranges: quartile 1: 1.53–317.74; quartile 2: 317.75–445.51; quartile 3: 445.52–632.56; quartile 4: 632.57–8464.
Table 2. Weighted generalized linear regression analysis of the relationship between grip strength and SII.
Table 2. Weighted generalized linear regression analysis of the relationship between grip strength and SII.
Model IModel IIModel III
β (95%CI)
p-Value
β (95%CI)
p-Value
β (95%CI)
p-Value
Grip Strength (Quartile)
Quartile 1RefRefRef
Quartile 2−49.36 (−71.89, −26.84)
<0.0010
−38.96 (−65.17, −12.76)
0.0100
−35.75 (−66.93, −4.56)
0.0300
Quartile 3−94.28 (−120.53, −68.03)
<0.0001
−83.86 (−114.97, −52.76)
<0.0001
−79.49 (−115.44, −43.55)
<0.0010
Quartile 4−103.61 (−126.53, −80.68)
<0.0001
−85.88 (−130.09, −41.67)
<0.0010
−77.31 (−129.58, −25.04)
0.0100
p for trend<0.0001<0.0010<0.0100
Stratified by sex
Male
Quartile 1RefRefRef
Quartile 2−75.83 (−112.64, −39.02)
<0.0010
−61.09 (−95.12, −27.06)
<0.0100
−61.03 (−101.14, −20.92)
0.0100
Quartile 3−81.01 (−121.86, −40.16)
<0.0010
−64.36 (−112.23, −16.49)
0.0100
−61.28 (−116.71, −5.86)
0.0400
Quartile 4−96.36 (−137.41, −55.31)
<0.0001
−65.42 (−111.47, −19.36)
0.0100
−64.36 (−118.25, −10.46)
0.0300
p for trend<0.00100.02000.0400
Female
Quartile 1RefRefRef
Quartile 2−39.41 (−76.26, −2.56)
0.0400
−33.2 (−77.23, 10.82)
0.1300
−24.91 (−73.03, 23.20)
0.2500
Quartile 3−86.3 (−119.82, −52.79)
<0.0001
−72.68 (−121.73, −23.63)
0.0100
−62.01 (−117.07, −6.94)
0.0300
Quartile 4−95.1 (−131.09, −59.11)
<0.0001
−86.56 (−143.18, −29.95)
0.0100
−74.94 (−137.21, −12.66)
0.0300
p for trend<0.0001<0.01000.0100
Model I: No covariates were adjusted; Model II: Adjusted for sex, age, race, BMI, education, and PIR; Model III: Adjusted for sex, age, race, BMI, education, PIR, smoking, alcohol, diabetes, hypertension, and hyperlipidemia. Handgrip strength quartile ranges: quartile 1: 0.41–1.87; quartile 2: 1.88–2.48; quartile 3: 2.49–3.20; quartile 4: 3.21–7.02.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Wu, D.; Gao, X.; Shi, Y.; Wang, H.; Wang, W.; Li, Y.; Zheng, Z. Association between Handgrip Strength and the Systemic Immune-Inflammation Index: A Nationwide Study, NHANES 2011–2014. Int. J. Environ. Res. Public Health 2022, 19, 13616. https://doi.org/10.3390/ijerph192013616

AMA Style

Wu D, Gao X, Shi Y, Wang H, Wang W, Li Y, Zheng Z. Association between Handgrip Strength and the Systemic Immune-Inflammation Index: A Nationwide Study, NHANES 2011–2014. International Journal of Environmental Research and Public Health. 2022; 19(20):13616. https://doi.org/10.3390/ijerph192013616

Chicago/Turabian Style

Wu, Dongzhe, Xiaolin Gao, Yongjin Shi, Hao Wang, Wendi Wang, Yanbin Li, and Zicheng Zheng. 2022. "Association between Handgrip Strength and the Systemic Immune-Inflammation Index: A Nationwide Study, NHANES 2011–2014" International Journal of Environmental Research and Public Health 19, no. 20: 13616. https://doi.org/10.3390/ijerph192013616

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop