Next Article in Journal
Landslide Displacement Prediction Based on Multivariate LSTM Model
Next Article in Special Issue
Designing an App to Promote Physical Exercise in Sedentary People Using a Day-to-Day Algorithm to Ensure a Healthy Self-Programmed Exercise Training
Previous Article in Journal
Nurse, Give Me the News! Understanding Support for and Opposition to a COVID-19 Health Screening System
Previous Article in Special Issue
A Recreational Swimming Intervention during the Whole School Year Improves Fitness and Cardiometabolic Risk in Children and Adolescents with Overweight and Obesity
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Effect of Resistance Exercise Order on Cardiovascular Disease Risk Factors in Older Women: A Randomized Controlled Trial

by
Crisieli M. Tomeleri
1,
Paolo M. Cunha
1,
Márcia M. Dib
1,
Durcelina Schiavoni
1,
Witalo Kassiano
1,*,
Bruna Costa
1,
Denilson C. Teixeira
1,
Rafael Deminice
1,
Ricardo José Rodrigues
1,2,
Danielle Venturini
2,
Décio S. Barbosa
2,
Cláudia R. Cavaglieri
3,
Luís B. Sardinha
4 and
Edilson S. Cyrino
1
1
Metabolism, Nutrition, and Exercise Laboratory, State University of Londrina, Londrina 86057-970, PR, Brazil
2
Department of Pathology, Clinical and Toxicological Analysis, State University of Londrina, Londrina 86057-970, PR, Brazil
3
Faculty of Physical Education, University of Campinas, Campinas 13083-970, SP, Brazil
4
Exercise and Health Laboratory, CIPER, Faculdade de Motricidade Humana, Universidade de Lisboa, 1649-004 Lisboa, Portugal
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2023, 20(2), 1165; https://doi.org/10.3390/ijerph20021165
Submission received: 22 November 2022 / Revised: 31 December 2022 / Accepted: 6 January 2023 / Published: 9 January 2023

Abstract

:
We compared the effects of two specific resistance training (RT) exercise orders on cardiovascular risk factors. Forty-four untrained older women (>60 years) were randomly assigned to three groups: control (CON, n = 15), multi-joint to single-joint (MJ-SJ, n = 14), and single-joint to multi-joint (SJ-MJ, n = 15) exercise orders. Training groups performed a whole-body RT program (eight exercises, 3 × 10–15 repetitions for each exercise) over 12 weeks in 3 days/week. Body fat, triglycerides, total cholesterol, HDL-c, LDL-c, VLDL-c, glucose, IL-6, IL-10, TNF-α, C-reactive protein, total radical-trapping antioxidant (TRAP), advanced oxidation protein products (AOPP), ferrous oxidation-xylenol (FOX), and nitric oxide concentrations (NOx) were determined pre- and post-intervention. Significant interaction group × time (p < 0.05) revealed reducing fat mass and trunk fat and improvements in glucose, LDL-c, IL-10, TNF-α, C-reactive protein, FOX, and AOPP concentrations in both training groups, without differences between them (p > 0.05). The results suggest that 12 weeks of RT, regardless of exercise order, elicit positive adaptations on body fat and metabolic biomarkers similarly in older women.

1. Introduction

Cardiovascular diseases are the main cause of worldwide mortality, affecting a large part of the older population, with high prevalence in women [1] since the cardiovascular disease risk factors (e.g., C-reactive protein, triglycerides, LDL-c) appear to be exacerbated by the menopause [2,3,4]. In contrast, a positive effect of resistance exercises on cardiovascular disease risk factors in older adults was reported recently in some studies [5,6]. In this regard, resistance training (RT) has been recommended as an essential non-pharmacological strategy to attenuate these age-related impairments in health status [7]. The main benefits of RT practice in older women include an increase in muscle mass and muscular strength, a reduction of body fat, improvement in the lipid profile, oxidative stress, and inflammatory biomarkers [8].
However, RT-related changes magnitude may be affected by the manipulation of the variables that compose training programs, which are related to intensity (e.g., perceived effort, external load, the velocity of muscle action, and rest intervals), volume (e.g., number of exercises, sets, repetitions, and frequency) and structure (e.g., exercise selection and exercise order). Considering that the exercise order may affect the intensity and volume of a training session, this variable may play a crucial role in the RT-induced adaptative responses [9,10,11]. Current guidelines suggest performing a training session with an exercise order that initiates with the multiple-joint (MJ) exercises—i.e., involving the dynamic participation of two or more joints—before single-joint (SJ)—i.e., involving the dynamic participation of one specific joint [7]. Some researchers believe that this sequence may induce better adaptations than opposite exercise orders because it allows the application of higher training loads [7,11,12].
Nevertheless, current recommendations were mainly based on data from acute investigations [7]. In addition, the few chronic studies on exercise order usually focus on body composition, muscular strength, and functional fitness [11,13,14,15]. Therefore, less is known regarding the potential influence of exercise order on other outcomes, such as cardiovascular disease risk factors. Only one study investigated the impact of RT performed in exercise orders different on health parameters in the older population [16]. Although the study has found exciting results, regardless of exercise order, the sample was composed of trained women and did not include a control group.
Recent studies revealed that the exercise order might also affect the volume load (repetitions × load) [9,11], a variable that seems to be an important mediating factor of the adaptations elicited by RT [17,18]. Furthermore, given that muscle contraction acts as an endocrine organ [19], if a given exercise order allows training with higher loads in exercises that involve a greater amount of muscle mass (i.e., MJ), theoretically, it is plausible to believe that the acute and chronic effects on inflammatory markers could be optimized. As a consequence of reducing inflammatory biomarkers, such as C-reactive protein, the chance of lowering possible cardiovascular complications increases [2]. However, studies are needed to test such a hypothesis.
Therefore, this study aimed to compare the effects of two specific exercise orders (MJ-to-SJ versus SJ-to-MJ) on cardiovascular disease risk factors. We hypothesized that the training protocol with the MJ-SJ exercise order would induce greater improvements in body fat, glucose, lipid profile, inflammatory, and oxidative stress biomarkers because of the potential higher volume load training achieved with this exercise order.

2. Materials and Methods

2.1. Experimental Design

This work is part of the “Active Aging Longitudinal Study”, a research project initiated in 2012 to investigate the effects of supervised, structured, and progressive RT programs on neuromuscular, morphological, physiological, metabolic, cognitive, and behavioral outcomes in older women. The sample in the present study consisted of the 2015 annual cohort of participants from this research project. A randomized controlled trial was carried out over 16 weeks, with 12 weeks dedicated to the RT program and four weeks to assessments. Anthropometric, muscular strength, body fat measurements, and venous blood collections for biochemical analysis were performed in weeks 1–2 and 15–16 pre- and post-intervention. The training groups performed a supervised progressive RT program between weeks 3–14. The control group did not perform any exercise during this period. This investigation is a secondary analysis of the previous work published [11].

2.2. Participants

Participant recruitment was carried out through newspaper and radio advertising. A preliminary sample was selected through an interview and clinical anamnesis. All participants completed health history and physical activity questionnaires and met the following inclusion criteria: female, >60 years, physically independent, free from cardiac or orthopedic dysfunction, not receiving hormonal replacement therapy, and not performing any regular physical exercise more than once a week over the six months preceding the onset of the current experiment. A diagnostic graded exercise test with a 12-lead electrocardiogram was conducted on the sample selected for this study. The exams were reviewed by a cardiologist, and they were released without restrictions to participate in this study. Participants of training groups who did not reach adherence ≥ 85% of training sessions were excluded from the analysis.
A priori sample analysis revealed that to achieve an effect size = 0.5 for muscular strength with a power of 0.8 and an alpha error = 5%, a total of 42 participants would be necessary (14 for each group). Considering a drop-out rate of approximately 25%, we recruited 54 older women who were randomly assigned to one of three conditions: a control group that did not perform any exercise (CON, n = 18) and two training groups that performed the RT program in a multi-joint to single-joint order (MJ-SJ, n = 18), or in a single-joint to multi-joint order (SJ-MJ, n = 18). Written informed consent was obtained from all participants after receiving a detailed description of the study procedures. This investigation was conducted according to the Declaration of Helsinki and was approved by the local University Ethics Committee.

2.3. Fat Mass and Trunk Fat

Dual-energy X-ray absorptiometry exams (DXA) were conducted in a Lunar Prodigy device, model NRL 41990 (GE Lunar, Madison, WI, USA), to determine the fat mass and trunk fat. Information on lean soft tissue was previously reported in another study [11]. Participants were submitted to the exams wearing light clothes, barefoot, and without any metallic object or other accessory items on their bodies. A laboratory technician with experience in this type of evaluation performed both calibration and analysis. Previous test-retest scans of 12 older women measured 24–48 h apart resulted in a standard error of measurement (SEM) of 0.10 kg for body fat and 0.67 kg for trunk fat, with an intraclass correlation coefficient (ICC) >0.99 for all variables.

2.4. Metabolic Biomarkers

Venous blood samples were collected into one tube between 7:00 am and 9:00 am after a 12 h fast and at least 48 h since the last RT session. Five milliliters were withdrawn from a prominent superficial vein in the antecubital space using a clean venous puncture with minimal stasis and placed in a tube containing a dipotassiumethylenediaminetetra-acetic acid (EDTA) as an anticoagulant and preservative. All samples were centrifuged at 3000 rpm for 15 min, and plasma or serum aliquots were stored at −80 °C until assayed. Inter- and intra-assays coefficients of variation were <10% as determined in human plasma. Glucose, total cholesterol (TC), high-density lipoprotein (HDL-c), triglycerides (TG), and high-sensitivity C-reactive protein concentrations were determined by standard methods in a specialized laboratory at University Hospital. The LDL-c was calculated using the following equation: LDL-c = TC − (HDL-c) − (TG/5), with TG/5 = VLDL-c. The analyses were performed using a biochemical auto-analyzer system Dimension RxL Max (Siemens Healthcare Diagnostics, Malvern, PA, USA) according to established methods in the literature consistent with the manufacturer’s protocol. Interleukin-10 (IL-10), Interleukin-6 (IL-6), and TNF-α were determined by enzyme-linked immunosorbent assay (ELISA), according to the specifications of the manufacturer (R&D Systems, Minneapolis, MN, USA). Advanced oxidation protein products (AOPP) were determined in the plasma using a semiautomatic method described by Witko-Sarsat et al. [20]. The total radical-trapping antioxidant parameter (TRAP) was determined according to Repetto et al. [21]. This method detects hydrosoluble and/or liposoluble plasma antioxidants by measuring the chemiluminescence inhibition time induced by 2,2-azobis (2-amidinopropane). The system was calibrated with the vitamin E analog Trolox®. Plasma lipid-hydroperoxides levels were determined by ferrous oxidation-xylenol orange (FOX) assay [22]. Serum nitric oxide metabolites (NOx) concentrations were assessed by nitrite (NO2-) and nitrate (NO3-) concentration according to the Griess reaction, supplemented by the reduction of nitrate to nitrite with cadmium [22].

2.5. Dietary Intake

Food intake was assessed by the 24 h dietary recall method applied on two non-consecutive days of the week, with a photographic record taken during an interview. Dietary intake was monitored in the first two and the last two weeks of the intervention period. The homemade measurements of the nutritional values of food were converted into grams and milliliters by the online software Virtual Nutri Plus (Keeple®, Rio de Janeiro, RJ, Brazil) for diet analysis. Some foods were not found in the program database. Therefore, these items were added from food tables.

2.6. Muscular Strength

Maximal dynamic strength was evaluated through the one-repetition maximum (1RM) test on the chest press, leg extension, and preacher curl exercises. The participants completed three attempts in each exercise for three testing sessions [23]. The three 1RM testing sessions were conducted in the morning, each one separated by 48 h of recovery. The rest period was 3–5 min between each attempt and five minutes between exercises. The 1RM was recorded as the higher resistance lifted in which the participant could complete only one single maximal repetition. Muscular strength was determined by the sum of each 1RM in the three exercises. The ICC from our lab for these tests is ≥0.96 with an SEM ≤2.0 kg.

2.7. Resistance Training Program

Participants from both training groups (MJ-SJ and SJ-MJ) performed the same 12-week RT program with eight exercises. All participants were personally supervised by physical education professionals with substantial RT experience to help ensure consistent and safe exercise performance, carried out differing only in the exercise order. The RT sessions were performed three times per week on Mondays, Wednesdays, and Fridays during the morning hours. Participants of the MJ-SJ group performed exercises in the following order: chest press, seated row, triceps pushdown, preacher curl, horizontal leg press, leg extension, leg curl, and seated calf raise. On the other hand, participants of the SJ-MJ group performed exercises in the following order: preacher curl, triceps pushdown, seated row, chest press, seated calf raise, leg curl, leg extension, and horizontal leg press. The RT sessions consisted of 3 sets of 10–15 repetitions per exercise; if the participant reached momentary muscle failure—i.e., attempted to perform another repetition with proper technique but was unsuccessful—before the upper limit of repetitions, the load was kept the same for the next session. On the other hand, when 15 repetitions were completed in the three sets for a determined exercise, the load was adjusted by 2–10% [7]. Participants rested for 1 to 2 min between each set and for 2 to 3 min between each exercise. Instructors adjusted loads of each exercise according to the participant’s ability and improved exercise capacity throughout the study to ensure that they were exercising with as much resistance as possible while maintaining proper exercise technique. Training load (kg) and the number of sets and repetitions performed in all exercises were individually recorded. The volume load of each exercise during each session was calculated by the following equation: exercise volume load = load (kg) × sets (no.) × repetitions (no.). The volume load of each week was calculated by summing volume load of the eight exercises obtained in each training session.

2.8. Statistical Analyses

One-way analysis of variance (ANOVA) was used to compare general characteristics and weekly VL. A Chi-square test was used to compare clinical characteristics. Generalized Estimating Equations (GEE) were applied for pre- to post-intervention and inter-group comparisons. When the Wald χ2 was significant, a Fisher post hoc test was employed to identify the mean differences. The ES was calculated as the post-training mean minus pre-training mean divided by the pooled standard deviation [24]. An ES of 0.00–0.19 was considered trivial, 0.20–0.49 was considered small, 0.50–0.79 was moderate, and ≥0.80 was large. Significance was accepted at p <0.05. The data were stored and analyzed using IBM SPSS Statistics, v. 24.0 (IBM Corp., Armonk, NY, USA).

3. Results

Forty-four participants finalized the experimental protocol (MJ-SJ = 15, SJ-MJ = 14, and CON = 15). Withdrawals occurred due to personal reasons (MJ-SJ = 2; SJ-MJ = 2, CON = 2), and surgery (MJ-SJ = 1; SJ-MJ = 2, CON = 1). Training attendance did not differ between groups (MJ-SJ: 98.8% and SJ-MJ: 96.3%; p > 0.05). The participants’ general characteristics and medical history are presented in supplemental digital content 1. There was no significant difference between groups for general characteristics at baseline, medical history, and treatment (p > 0.05).

3.1. Volume Load

The volume load for each week and according to the group are presented in Figure 1. The MJ-SJ and SJ-MJ groups exhibited greater values of the volume load in weeks 4–7 and 9–11 compared to week 1, however, without differences between training groups (p < 0.05).

3.2. Dietary Intake and Main Outcomes

Table 1 presents pre- and post-training results for dietary intake, muscular strength, body fat, glucose, lipid profile, inflammatory, and oxidative stress markers. Daily energy and macronutrient intake were not different between groups and did not change over time (p > 0.05). Significant time × group interaction (p < 0.05) revealed RT effects in both training groups for fat mass, trunk fat, glucose, LDL-c, IL-10, TNF-α, C-reactive protein, FOX, and AOPP when compared to the control group. No significant differences were observed before to after intervention in any group for TC, HDL-c, VLDL-c, TG, IL-6, TRAP, and NOx (p > 0.05). A significant interaction time × group (p < 0.05) was found for muscular strength with higher values after the intervention for both training groups when compared to the control group (MJ-SJ, ES = +1.0; SJ-MJ, ES = +0.62; CON, ES = −0.51).
Table 2 presents the effect-size values for the variables analyzed. Changes in body fat and the lipid profile biomarkers were of trivial–small magnitude for training groups. In contrast, the glucose changes were large, whereas inflammatory and oxidative stress biomarkers were of moderate and small magnitude, respectively.

4. Discussion

The main findings of this study were that RT was effective for decreasing fat mass and trunk fat, as well as for improving glucose concentrations and inflammatory (IL-10, TNF-α, C-reactive protein) and oxidative stress biomarkers (AOPP and FOX), regardless of the exercise order. Our hypothesis that the MJ-SJ group would present superior responses was refuted. According to our knowledge, this is the first study comparing the effects of different exercise orders on cardiovascular disease risk factors in untrained older women. Because of this unique approach, comparisons with other studies are limited. It is worth highlighting that we found similar gains in muscular strength and muscle mass for MJ-SJ and SJ-MJ exercise orders in this same sample [11].
Given that the MJ-SJ order could favor the accumulation of a higher volume load, we hypothesized that this order could be more efficient in improving risk factors for cardiovascular diseases. The volume load is a determining variable for the RT adaptations [7]. However, we have found a similar volume load between MJ-SJ and SJ-MJ (see Figure 1), and we found a similar reduction in cardiovascular risk to MJ-SJ and SJ-MJ over 12 RT weeks. In this context, such similarities can be explained, at least in part, through the intensity of effort. In this regard, Ribeiro et al. [25] observed that older women experience a similar perception of effort when training MJ to SJ and SJ to MJ. There are indications that the RT adaptations can be determined by the intensity/perception of effort [26,27,28]. Therefore, it is possible that the similarities observed in the present study may be related to the similar intensity of effort, which was probably matched between the groups. Importantly, although plausible, we do not measure the perceived effort, so this assertion needs further investigation.
For IL-6, although the effect of RT was not significant for both training groups, effect size values indicated that the decrease was of moderate magnitude. In contrast, the control group had an increase in the IL-6 concentration. As it is a pro- and anti-inflammatory cytokine, the IL-6 responses, by itself, do not allow us to state that the increase or decrease was due to corresponding to a less inflamed environment [29]. In this regard, evaluating other pro- and anti-inflammatory cytokines is necessary to improve the interpretation of results. In our study, both training groups showed a moderate reduction in IL-6 and a decrease in TNF-α, CRP, and an IL-10 increase. In contrast, although it has not shown a significant increase in IL-6, the control group showed an increase in pro-inflammatory cytokines and a reduction in anti-inflammatory ones. These results indicate that RT improves the inflammatory profile, disregarding the exercise order used. These findings are important because they suggest RT’s reversal or deceleration effects of RT on the deleterious alterations associated with the aging process, i.e., the presence of a chronic low-grade inflammation increases the risk of developing age-associated diseases and is an independent risk factor for mortality [30,31].
We also observed a reduction in blood glucose and LDL-c in MJ-SJ and SJ-MJ contrasted to the control group. The lack of investigations that directly compare the effect of the exercise order on blood markers restricts us from comparing with previous findings; notwithstanding, our results are in accordance with previous studies that found favorable effects of RT on these outcomes in older women [6,32,33,34]. Some factors may explain these changes in blood glucose and LDL-c. Previous studies observed that reducing body fat could modify lipid profile and blood glucose [6,34]. The most significant reductions appear in the android region [35]. Thus, the changes in body fat found in our study, especially trunk fat, can help explain, at least in part, the modification in LDL-c and glucose. The relationship between body fat and lipid profiles may be associated with insulin resistance and increased free fatty acids, a condition leading to the formation of large TG-rich VLDL particles, which alters the expression of key enzymes in the plasma, such as decreased lipoprotein lipase [36]. Additionally, the changes mentioned above can be due to an increase in the ability of the skeletal muscle to use fat and glucose, and an improvement in insulin sensitivity, thereby reducing the levels of plasma lipids and blood glucose [8]. Although plausible, these findings are not universal, and some studies have not reported RT’s effect on lipoproteins [37] or blood glucose [38]. Discrepancies across results are not clear but may be related to factors such as initial lipid levels and glucose, gender, age, body fat, duration, and intensity of the training program. Besides, the responsiveness of the lipid profile induced by RT depends on genotype [8], raising the likelihood that genetic factors ultimately determine the magnitude to which RT affects the lipid profile.
Regarding oxidative stress, we did not observe any difference between the two exercise orders; both intervention groups improved oxidative stress biomarkers (i.e., AOPP and FOX). Few studies have investigated the RT effect—and consequently the exercise order—on oxidative stress biomarkers. From the available findings, it is possible to notice some divergences in the impact of RT on these biomarkers. For example, Ribeiro et al. [39] revealed that eight weeks of RT performed three times a week with three sets per exercise of 8–12 RM were sufficient to improve oxidative stress by maintaining the body’s antioxidant capacity (TRAP) while decreasing protein oxidation (AOPP). On the other hand, Padilha et al. [40] showed that 12 weeks of RT performed 2 or 3 days/week with 1 set per exercise of 10–15 RM improved oxidative stress by increasing TRAP while maintaining AOPP. Furthermore, our study revealed significant changes in FOX in both groups, whereas Ribeiro et al. [39] did not find any difference in FOX following RT. Although there is no definitive mechanism to support such divergences, it is feasible to speculate that differences between training protocols, such as training volumes, intensity, and duration of intervention, may have influenced adaptations. The physiological mechanisms by which RT improves oxidative stress may be attributed to some factors. Physical exercise can increase the synthesis of reactive oxygen and nitrogen species by activating the electron transport chain and the synthesis of lactic acid, catecholamines, and inflammatory factors that contribute to the production of reactive oxygen species in mitochondria [41]. Moreover, anaerobic exercise, such as RT, may increase the synthesis of xanthine oxidase and NADPH oxidase enzymes, and both influence oxidative stress modulation [41]. Thus, the antioxidant system adapts in response to this process, with adjustments favorable to the endogenous antioxidant system, improving the body’s defense capacity.
It is essential to feature the strengths of the present study. Professionals with RT experience supervised all training sessions to ensure participant safety and the proper exercise technique. The importance of supervised RT in older adults has been reported in some studies [42,43]. Moreover, the weight adjustments were continuous and based on the participant’s progress throughout the RT sessions, allowing the optimal stimulus to be maintained throughout the intervention. Also, monitoring the participants’ dietary intake allowed a more consistent analysis of RT effects. Despite the recognized limitations associated with using the 24 h dietary recall method to intake assessment, particularly a tendency for individuals to underestimate dietary intake, no difference was observed within- and between-group. Finally, the blood biomarkers analyzed in this study are essential for screening the health of older adults and can be modified with RT, independent of the exercise order. Conversely, it is worthwhile to note that this investigation has some limitations. First, 12 weeks of intervention can be considered a comparatively short time. Thus, it is necessary to determine whether results would differ over a longer training period. Although magnetic resonance imaging and computed tomography are the methods recommended for visceral fat evaluation, with the introduction of visceral fat assessment software for DXA scanners, DXA’s use for this purpose has become quite common due to its low cost, brief examination time, noninvasiveness, limited radiation exposure, and satisfactory level of precision [44]. However, caution should be observed when contrasting our results with other studies that used more consistent body fat measurements. Finally, the study is specific to untrained older women. Therefore, results should not be generalized to other populations, including participants of different age groups and initial fitness levels, as different adaptative responses to RT may be influenced by such factors.

5. Conclusions

Our results suggest that 12 weeks of RT in both MJ-SJ and SJ-MJ exercise orders seem effective for improving body fat and blood biomarkers in untrained older women. Therefore, professionals and researchers can choose exercise order of preference between MJ-SJ and SJ-MJ when prescribing RT exercises focused on inducing adaptations in body fat and blood biomarkers in physically independent older women.

Author Contributions

Conceptualization, C.M.T. and E.S.C.; methodology, C.M.T. and E.S.C.; formal analysis, C.M.T. and P.M.C.; investigation, C.M.T., P.M.C., M.M.D., D.S., W.K. and B.C.; resources, E.S.C.; data curation, C.M.T. and E.S.C.; writing—original draft preparation, C.M.T.; writing—review and editing, C.M.T., P.M.C., M.M.D., D.S., W.K., B.C., D.C.T., R.D., R.J.R., D.V., D.S.B., C.R.C., L.B.S. and E.S.C.; project administration, C.M.T., P.M.C. and E.S.C. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki and approved by the Institutional Review Board of the State University of Londrina.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The raw data supporting the conclusions of this article will be made available by the corresponding author, without undue reservation.

Acknowledgments

The authors express thanks to all the participants for their engagement in this study, the Coordination of Improvement of Higher Education Personnel (CAPES/Brazil) for the scholarship conferred to C.M.T., P.M.C., W.K., and B.C., and the National Council of Technological and Scientific Development (CNPq/Brazil) by grants conceded to R.D., C.R.C., and E.S.C. This study was partially supported by the Ministry of Education (MEC/Brazil) and CNPq/Brazil.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Appelman, Y.; van Rijn, B.B.; Ten Haaf, M.E.; Boersma, E.; Peters, S.A. Sex differences in cardiovascular risk factors and disease prevention. Atherosclerosis 2015, 241, 211–218. [Google Scholar] [CrossRef]
  2. Kengne, A.P.; Batty, G.D.; Hamer, M.; Stamatakis, E.; Czernichow, S. Association of C-reactive protein with cardiovascular disease mortality according to diabetes status: Pooled analyses of 25,979 participants from four U.K. prospective cohort studies. Diabetes Care 2012, 35, 396–403. [Google Scholar] [CrossRef] [Green Version]
  3. Maltais, M.L.; Desroches, J.; Dionne, I.J. Changes in muscle mass and strength after menopause. J. Musculoskelet Neuronal Interact. 2009, 9, 186–197. [Google Scholar]
  4. Pearson, T.A.; Mensah, G.A.; Alexander, R.W.; Anderson, J.L.; Cannon, R.O., 3rd; Criqui, M.; Fadl, Y.Y.; Fortmann, S.P.; Hong, Y.; Myers, G.L.; et al. Markers of inflammation and cardiovascular disease: Application to clinical and public health practice: A statement for healthcare professionals from the Centers for Disease Control and Prevention and the American Heart Association. Circulation 2003, 107, 499–511. [Google Scholar] [CrossRef]
  5. Ihalainen, J.K.; Inglis, A.; Mäkinen, T.; Newton, R.U.; Kainulainen, H.; Kyröläinen, H.; Walker, S. Strength training improves metabolic health markers in older individual regardless of training frequency. Front. Physiol. 2019, 10, 32. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  6. Cunha, P.M.; Tomeleri, C.M.; Nascimento, M.A.; Mayhew, J.L.; Fungari, E.; Cyrino, L.T.; Barbosa, D.S.; Venturini, D.; Cyrino, E.S. Comparision of low and high volume of resistance training on body fat and blood biomarkers in untrained older women: A randomized clinical trial. J. Strength Cond. Res. 2021, 35, 1–8. [Google Scholar] [CrossRef] [PubMed]
  7. ACSM American College of Sports Medicine Position Stand. Progression models in resistance training for healthy adults. Med. Sci. Sports Exerc. 2009, 41, 687–708. [Google Scholar] [CrossRef] [PubMed]
  8. Westcott, W.L. Resistance training is medicine: Effects of strength training on health. Curr. Sports Med. Rep. 2012, 11, 209–216. [Google Scholar] [CrossRef]
  9. Bezerra, E.S.; Schoenfeld, B.J.; Paz, G.; Farias, D.A.; Sakugawa, R.L.; Vieira, I.; Rossato, M.; Miranda, H. Effect of exercise order with barbell and machine modalities on upper body volume load and myoelectric activity. Sports Biomech. 2020, 19, 778–791. [Google Scholar] [CrossRef] [PubMed]
  10. Nunes, J.P.; Grgic, J.; Cunha, P.M.; Ribeiro, A.S.; Schoenfeld, B.J.; de Salles, B.F.; Cyrino, E.S. What influence does resistance exercise order have on muscular strength gains and muscle hypertrophy? A systematic review and meta-analysis. Eur. J. Sport Sci. 2021, 21, 149–157. [Google Scholar] [CrossRef] [Green Version]
  11. Tomeleri, C.M.; Ribeiro, A.S.; Nunes, J.P.; Schoenfeld, B.J.; Souza, M.F.; Schiavoni, D.; Junior, P.S.; Cavaglieri, C.R.; Cunha, P.M.; Venturini, D.; et al. Influence of resistance training exercise order on muscle strength, hypertrophy, and anabolic hormones in older women: A randomized controlled trial. J. Strength Cond. Res. 2020, 34, 3103–3109. [Google Scholar] [CrossRef] [PubMed]
  12. Sforzo, G.A.; Touey, P.R. Manipulating exercise order affects muscular performance during a resistance exercise training session. J. Strength Cond. Res. 1996, 10, 20–24. [Google Scholar]
  13. Avelar, A.; Ribeiro, A.S.; Nunes, J.P.; Schoenfeld, B.J.; Papst, R.R.; Trindade, M.C.C.; Bottaro, M.; Cyrino, E.S. Effects of order of resistance training exercises on muscle hypertrophy in young adult men. Appl. Physiol. Nutr. Metab. 2019, 44, 420–424. [Google Scholar] [CrossRef] [PubMed]
  14. Dias, I.; de Salles, B.F.; Novaes, J.; Costa, P.B.; Simão, R. Influence of exercise order on maximum strength in untrained young men. J. Sci. Med. Sport. 2010, 13, 65–69. [Google Scholar] [CrossRef] [PubMed]
  15. Dib, M.M.; Tomeleri, C.M.; Nunes, J.P.; Cunha, P.M.; Ribeiro, A.S.; Schiavoni, D.; Cavalcante, E.F.; Kunevaliki, G.; Teixeira, D.C.; de Oliveira, A.R.; et al. Effects of three resistance exercise orders on muscular function and body composition in older women. Int. J. Sports Med. 2020, 41, 1024–1031. [Google Scholar] [CrossRef] [PubMed]
  16. Cunha, P.M.; Nunes, J.P.; Werneck, A.O.; Ribeiro, A.S.; Machado, D.G.S.; Kassiano, W.; Costa, B.D.V.; Cyrino, L.T.; Antunes, M.; Kunevaliki, G.; et al. Effect of resistance exercise orders on health parameters in trained older women: A randomized crossover trial. Med. Sci. Sports Exerc. 2023, 55, 119–132. [Google Scholar] [CrossRef] [PubMed]
  17. Nunes, J.P.; Marcori, A.J.; Tomeleri, C.M.; Nascimento, M.A.; Mayhew, J.L.; Ribeiro, A.S.; Cyrino, E.S. Starting the resistance-training session with lower-body exercises provides lower session perceived exertion without altering the training volume in older women. Int. J. Exerc. Sci. 2019, 12, 1187–1197. [Google Scholar]
  18. Longo, A.R.; Silva-Batista, C.; Pedroso, K.; Painelli, V.D.S.; Lasevicius, T.; Schoenfeld, B.J.; Aihara, A.Y.; Peres, B.D.A.; Tricoli, V.; Teixeira, E.L. Volume load rather than resting interval influences muscle hypertrophy during high-intensity resistance training. J. Strength Cond. Res. 2022, 36, 1554–1559. [Google Scholar] [CrossRef]
  19. Pedersen, B.K. Muscles and their myokines. J. Exp. Biol. 2011, 214 Pt 2, 337–346. [Google Scholar] [CrossRef] [Green Version]
  20. Witko-Sarsat, V.; Friedlander, M.; Capeillere-Blandin, C.; Nguyen-Khoa, T.; Nguyen, A.T.; Zingraff, J.; Jungers, P.; Descamps-Latscha, B. Advanced ocidation protein products as a novel marker of oxidative stress in uremia. Kidney Int. 1996, 49, 1304–1313. [Google Scholar] [CrossRef] [Green Version]
  21. Repetto, M.; Reides, C.; Gomez Carretero, M.L.; Costa, M.; Griemberg, G.; Llesuy, S. Oxidative stress in blood of HIV infected patients. Clin. Chim. Acta 1996, 255, 107–117. [Google Scholar] [CrossRef] [PubMed]
  22. Guevara, I.; Iwanejko, J.; Dembińska-Kieć, A.; Pankiewicz, J.; Wanat, A.; Anna, P.; Gołąbek, I.; Bartuś, S.; Malczewska-Malec, M.; Szczudlik, A. Determination of nitrite/nitrate in human biological material by the simple Griess reaction. Clin. Chim. Acta 1998, 274, 177–188. [Google Scholar] [CrossRef] [PubMed]
  23. Nascimento, A.M.; Januario, R.S.; Gerage, A.M.; Mayhew, J.L.; Cheche, P.; Cyrino, E.S. Familiarization and reliability of one repetition maximum strength testing in older women. J. Strength Cond. Res. 2013, 27, 1136–1142. [Google Scholar]
  24. Cohen, J. A power primer. Psychol Bull. 1992, 112, 155–159. [Google Scholar] [CrossRef] [PubMed]
  25. Ribeiro, A.; Monteiro, N.; Nunes, J.; Cunha, P.; Andrade-Lima, A.; Aguiar, A.; Cyrino, E. Effects of four exercise orders on perceived exertion, feeling, and arousal in older women following 12 weeks of resistance training. Sci. Sports 2020, 36, 176–178. [Google Scholar] [CrossRef]
  26. Buskard, A.N.L.; Jacobs, K.A.; Eltoukhy, M.M.; Strand, K.L.; Villanueva, L.; Desai, P.P.; Signorile, J.F. Optimal approach to load progressions during strength training in older adults. Med. Sci. Sports Exerc. 2019, 51, 2224–2233. [Google Scholar] [CrossRef] [PubMed]
  27. Morishita, S.; Tsubaki, A.; Nakamura, M.; Nashimoto, S.; Fu, J.B.; Onishi, H. Rating of perceived exertion on resistance training in elderly subjects. Expert Rev. Cardiovasc. Ther. 2019, 17, 135–142. [Google Scholar] [CrossRef]
  28. Morton, R.W.; Colenso-Semple, L.; Phillips, S.M. Training for strength and hypertrophy: An evidence-based approach. Curr. Opin. Physiol. 2019, 11, 149–150. [Google Scholar] [CrossRef]
  29. Pedersen, B.K.; Febbraio, M.A. Muscle as an endocrine organ: Focus on muscle-derived interleukin-6. Physiol. Rev. 2008, 88, 1379–1406. [Google Scholar] [CrossRef] [Green Version]
  30. Bonaccio, M.; Di Castelnuovo, A.; Pounis, G.; De Curtis, A.; Costanzo, S.; Persichillo, M.; Cerletti, C.; Donati, M.B.; de Gaetano, G.; Iacoviello, L. A score of low-grade inflammation and risk of mortality: Prospective findings from the Moli-sani study. Haematologica 2016, 101, 1434–1441. [Google Scholar] [CrossRef] [Green Version]
  31. Zamboni, M.; Rossi, A.P.; Fantin, F.; Zamboni, G.; Chirumbolo, S.; Zoico, E.; Mazzali, G. Adipose tissue, diet and aging. Mech. Ageing Dev. 2014, 136–137, 129–137. [Google Scholar] [CrossRef] [PubMed]
  32. Azizbeigi, K.; Azarbayjani, M.A.; Atashak, S.; Stannard, S.R. Effect of moderate and high resistance training intensity on indices of inflammatory and oxidative stress. Res. Sports Med. 2015, 23, 73–87. [Google Scholar] [CrossRef] [PubMed]
  33. Cunha, P.M.; Ribeiro, A.S.; Nunes, J.P.; Tomeleri, C.M.; Nascimento, M.A.; Moraes, G.K.; Junior, P.S.; Barbosa, D.S.; Venturini, D.; Cyrino, E.S.; et al. Resistance training performed with single-set is sufficient to reduce cardiovascular risk factors in untrained older women: The randomized clinical trial. Active Aging Longitudinal Study. Arch. Gerontol. Geriatr. 2019, 81, 171–175. [Google Scholar] [CrossRef]
  34. Tomeleri, C.M.; Ribeiro, A.S.; Souza, M.F.; Schiavoni, D.; Schoenfeld, B.J.; Venturini, D.; Barbosa, D.S.; Landucci, K.; Sardinha, L.B.; Cyrino, E.S. Resistance training improves inflammatory level, lipid and glycemic profiles in obese older women: A randomized controlled trial. Exp. Gerontol. 2016, 84, 80–87. [Google Scholar] [CrossRef] [PubMed]
  35. Cavalcante, E.F.; Ribeiro, A.S.; Nascimento, M.A.D.; Silva, A.M.; Tomeleri, C.M.; Nabuco, H.C.; Pina, F.L.C.; Mayhew, J.L.; Da Silva-Grigoletto, M.E.; da Silva, D.R.P.; et al. Effects of different resistance training frequencies on fat in overweight/obese older women. Int. J. Sports Med. 2018, 39, 527–534. [Google Scholar] [CrossRef]
  36. Wang, H.; Eckel, R.H. Lipoprotein lipase: From gene to obesity. Am. J. Physiol. Endocrinol. Metab. 2009, 297, E271–E288. [Google Scholar] [CrossRef] [Green Version]
  37. Orsatti, F.; Nahas, E.; Maestá, N.; Neto, J.N.; Orsatti, C.; Portari, G.V.; Burini, R.C. Effects of resistance training frequency on body composition and metabolics and inflammatory markers in overweight postmenopausal women. J. Sports Med. Phys. Fit. 2014, 54, 317–325. [Google Scholar]
  38. Marques, E.; Carvalho, J.; Soares, J.M.; Marques, F.; Mota, J. Effects of resistance and multicomponent exercise on lipid profiles of older women. Maturitas 2009, 63, 84–88. [Google Scholar] [CrossRef]
  39. Ribeiro, A.S.; Deminice, R.; Schoenfeld, B.J.; Tomeleri, C.M.; Padilha, C.S.; Venturini, D.; Barbosa, D.S.; Sardinha, L.B.; Cyrino, E.S. Effect of resistance training systems on oxidative stress in older women. Int. J. Sport Nutr. Exerc. Metab. 2017, 27, 439–447. [Google Scholar] [CrossRef]
  40. Padilha, C.S.; Ribeiro, A.S.; Fleck, S.J.; Nascimento, M.A.; Pina, F.L.; Okino, A.M.; Venturini, D.; Barbosa, D.S.; Mayhew, J.L.; Cyrino, E.S. Effect of resistance training with different frequencies and detraining on muscular strength and oxidative stress biomarkers in older women. Age 2015, 37, 104. [Google Scholar] [CrossRef]
  41. McHugh, M.P.; Connolly, D.A.; Eston, R.G.; Gleim, G.W. Exercise-induced muscle damage and potential mechanisms for the repeated bout effect. Sports Med. 1999, 27, 157–170. [Google Scholar] [CrossRef] [PubMed]
  42. Lacroix, A.; Hortobágyi, T.; Beurskens, R.; Granacher, U. Effects of supervised vs. unsupervised training programs on balance and muscle strength in older adults: A systematic review and meta-analysis. Sports Med. 2017, 47, 2341–2361. [Google Scholar] [CrossRef] [PubMed]
  43. Ramírez-Campillo, R.; Martínez, C.; de La Fuente, C.I.; Cadore, E.L.; Marques, M.C.; Nakamura, F.Y.; Loturco, I.; Caniuqueo, A.; Cañas, R.; Izquierdo, M. High-speed resistance training in older women: The role of supervision. J. Aging Phys. Act. 2017, 25, 1–9. [Google Scholar] [CrossRef] [PubMed]
  44. Goldberg, E.K.; Fung, E.B. Precision of the hologic DXA in the assessment of visceral adipose tissue. J. Clin. Densitom. 2020, 23, 664–672. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Weekly volume load according to training groups (MJ-SJ = 15 and SJ-MJ = 14). * p < 0.05, significant difference when compared to week 1. MJ-SJ = group that performed RT in a multi-joint to single-joint order, SJ-MJ = group that performed RT in a single-joint to multi-joint order.
Figure 1. Weekly volume load according to training groups (MJ-SJ = 15 and SJ-MJ = 14). * p < 0.05, significant difference when compared to week 1. MJ-SJ = group that performed RT in a multi-joint to single-joint order, SJ-MJ = group that performed RT in a single-joint to multi-joint order.
Ijerph 20 01165 g001
Table 1. Dietary intake, total strength, body fat, and blood biomarkers after the 12-week period of intervention.
Table 1. Dietary intake, total strength, body fat, and blood biomarkers after the 12-week period of intervention.
MeasuresMJ-SJ (n = 15)SJ-MJ (n = 14)CON (n = 15)
PrePost PrePost PrePost
Dietary intake
Energy (kcal/kg)16.1 ± 3.416.2 ± 3.916.2 ± 3.916.7 ± 3.116.1 ± 3.216.4 ± 3.5
Carbohydrates (g/kg)2.3 ± 0.72.3 ± 0.62.6 ± 0.92.5 ± 0.72.5 ± 0.72.3 ± 0.9
Proteins (g/kg)0.8 ± 0.30.8 ± 0.30.8 ± 0.30.9 ± 0.20.8 ± 0.30.9 ± 0.4
Lipids (g/kg)0.5 ± 0.20.5 ± 0.20.5 ± 0.20.5 ± 0.20.5 ± 0.30.6 ± 0.3
Total strength (kg)114.1 ± 17.0132.9 ± 21.5 §118.4 ± 22.1130.9 ± 19.0 § 111.6 ± 14.2 104.4 ± 14.7
Body fat
Fat mass (kg)27.3 ± 8.625.9 ± 9.1 *§25.4 ± 7.224.0 ± 7.3 *§26.4 ± 8.726.9 ± 8.6
Relative body fat (%)41.8 ± 6.839.0 ± 7.4 *40.0 ± 5.537.7 ± 5.5 *§41.1 ± 7.441.7 ± 7.1
Trunk fat (kg)13.7 ± 4.213.1 ± 4.4 *§12.5 ± 3.611.6 ± 3.4 *§14.9 ± 4.815.0 ± 4.6
Relative trunk fat (%)42.6 ± 6.739.9 ± 7.6 *§39.9 ± 6.537.1 ± 5.9 *§42.9 ± 6.143.2 ± 5.4
Blood biomarkers
Glucose (mg/dL)112 ± 1991 ± 16 *§114 ± 1788 ± 12 *§100 ± 11102 ± 10
TC (mg/dL)189 ± 26190 ± 16193 ± 38183 ± 32203 ± 20214 ± 21
HDL-c (mg/dL)53 ± 1054 ± 1254 ± 1456 ± 1555 ± 1253 ± 11
LDL-c (mg/dL)115 ± 23112 ± 18 §118 ± 40105 ± 32 *§124 ± 24139 ± 21 *
VLDL-c (mg/dL)24 ± 1021 ± 922 ± 1022 ± 822 ± 723 ± 9
Triglycerides (mg/dL)107 ± 28119 ± 38108 ± 40109 ± 53117 ± 46110 ± 37
IL-6 (pg/mL)2.8 ± 0.82.4 ± 0.32.7 ± 0.92.3 ± 0.52.8 ± 0.63.1 ± 0.9
IL-10 (pg/mL)11.5 ± 8.918.7 ± 11.1 *§10.1 ± 3.815.0 ± 4.5 *§13.8 ± 6.55.6 ± 4.0 *
TNF-α (pg/mL)3.8 ± 1.72.9 ± 0.5 *§4.0 ± 2.32.9 ± 0.6 *§3.2 ± 1.73.3 ± 1.9
CRP (mL/dL)3.1 ± 1.62.3 ± 1.4 *§3.1 ± 1.22.2 ± 0.6 *§3.0 ± 2.14.4 ± 2.1 *
TRAPP (µmolTrolox)887 ± 187883 ± 154875 ± 134844 ± 199902 ± 163898 ± 89
AOPP (µmol/L)93.0 ± 30.477.5 ± 13.9 *§88.1 ± 13.975.0 ± 13.5 *§75.9 ± 17.886.3 ± 19.3
FOX (mmol/L)0.45 ± 0.230.27 ± 0.07 *§0.49 ± 0.290.30 ± 0.11 *§0.48 ± 0.310.57 ± 0.34
NOx (µmol/L)7.3 ± 2.67.4 ± 2.87.4 ± 2.17.0 ± 2.47.8 ± 4.18.3 ± 4.1
Note: MJ-SJ = group that performed RT in a multi-joint to single-joint order, SJ-MJ = group that performed RT in a single-joint to multi-joint order, CON = control group, TC = total cholesterol, HDL-c = high-density lipoprotein cholesterol, LDL-c = low-density lipoprotein cholesterol, VLDL-c = very low-density lipoprotein cholesterol, IL-6 = interleukin-6, IL-10 = interleukin-10, TNF-α = tumor necrosis factor alpha, CRP = C-reactive protein, TRAPP = transport protein particle, AOPP = advanced oxidation protein products, FOX = ferrous oxidation-xylenol orange, NOx = nitric oxide metabolites. * p < 0.05 vs. pre-training; § p < 0.05 vs. control group at post-training.
Table 2. Effect size values of the pre- to post-intervention changes for analyzed variables.
Table 2. Effect size values of the pre- to post-intervention changes for analyzed variables.
MJ-SJ (n = 15)SJ-MJ (n = 14)CON (n = 15)
Body composition
Body mass0.03(Trivial)−0.06(Trivial)0.02(Trivial)
Fat mass−0.17(Trivial)−0.17(Trivial)0.06(Trivial)
Relative fat mass−0.43(Small)−0.35(Small)0.09(Trivial)
Trunk fat−0.14(Trivial)−0.21(Small)0.02(Trivial)
Relative trunk fat−0.42(Small)−0.44(Small)0.05(Trivial)
Blood biomarkers
Glucose−1.34(Large)−1.66(Large)0.13(Trivial)
Total cholesterol0.04(Trivial)−0.36(Small)0.39(Small)
HDL-c0.08(Trivial)0.17(Trivial)−0.17(Trivial)
LDL-c−0.10(Trivial)−0.45(Small)0.52(Moderate)
VLDL-c−0.33(Small)0.00(Trivial)0.11(Trivial)
Triglycerides0.32(Small)0.03(Trivial)−0.18(Trivial)
IL-6−0.52(Moderate)−0.52(Moderate)0.39(small)
IL-101.13(Large)0.77(Moderate)−1.28(Large)
TNF-α−0.47(Small)−0.58(Moderate)0.05(Trivial)
CRP−0.49(Small)−0.55(Moderate)0.86(Large)
TRAPP−0.02(Trivial)−0.19(Trivial)−0.02(Trivial)
AOPP−0.75(Moderate)−0.63(Moderate)0.50(Moderate)
FOX−0.65(Moderate)−0.69(Moderate)0.33(Small)
NOx0.03(Trivial)−0.14(Trivial)0.17(Trivial)
Note: MJ-SJ = group that performed RT in a multi-joint to single-joint order, SJ-MJ = group that performed RT in a single-joint to multi-joint order, CON = control group, HDL-c = high-density lipoprotein cholesterol, LDL-c = low-density lipoprotein cholesterol, VLDL-c = very low-density lipoprotein cholesterol, IL-6 = interleukin-6, IL-10 = interleukin-10, TNF-α = tumor necrosis factor alpha, CRP = C-reactive protein, TRAPP = transport protein particle, AOPP = advanced oxidation protein products, FOX = ferrous oxidation−xylenol orange, NOx = nitric oxide metabolites.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Tomeleri, C.M.; Cunha, P.M.; Dib, M.M.; Schiavoni, D.; Kassiano, W.; Costa, B.; Teixeira, D.C.; Deminice, R.; Rodrigues, R.J.; Venturini, D.; et al. Effect of Resistance Exercise Order on Cardiovascular Disease Risk Factors in Older Women: A Randomized Controlled Trial. Int. J. Environ. Res. Public Health 2023, 20, 1165. https://doi.org/10.3390/ijerph20021165

AMA Style

Tomeleri CM, Cunha PM, Dib MM, Schiavoni D, Kassiano W, Costa B, Teixeira DC, Deminice R, Rodrigues RJ, Venturini D, et al. Effect of Resistance Exercise Order on Cardiovascular Disease Risk Factors in Older Women: A Randomized Controlled Trial. International Journal of Environmental Research and Public Health. 2023; 20(2):1165. https://doi.org/10.3390/ijerph20021165

Chicago/Turabian Style

Tomeleri, Crisieli M., Paolo M. Cunha, Márcia M. Dib, Durcelina Schiavoni, Witalo Kassiano, Bruna Costa, Denilson C. Teixeira, Rafael Deminice, Ricardo José Rodrigues, Danielle Venturini, and et al. 2023. "Effect of Resistance Exercise Order on Cardiovascular Disease Risk Factors in Older Women: A Randomized Controlled Trial" International Journal of Environmental Research and Public Health 20, no. 2: 1165. https://doi.org/10.3390/ijerph20021165

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop