Next Article in Journal
Assessment of the Emission of Pollutants from Public Transport Based on the Example of Diesel Buses and Trolleybuses in Gdynia and Sopot
Previous Article in Journal
Comparison of Missing Data Infilling Mechanisms for Recovering a Real-World Single Station Streamflow Observation
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
IJERPH
Volume 18
Issue 16
10.3390/ijerph18168378
ijerph-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Effects of Shift Work in a Sample of Italian Nurses: Analysis of Rest-Activity Circadian Rhythm

by
Letizia Galasso
1,*,†,
Antonino Mulè
1,†,
Lucia Castelli
1,
Emiliano Cè
1,2,
Vincenzo Condemi
1,
Giuseppe Banfi
2,
Eliana Roveda
1,2,
Angela Montaruli
1,2 and
Fabio Esposito
1,2
1
Department of Biomedical Sciences for Health, University of Milan, Via G. Colombo 71, 20133 Milan, Italy
2
IRCCS Istituto Ortopedico Galeazzi, Via R. Galeazzi 4, 20161 Milan, Italy
*
Author to whom correspondence should be addressed.
†
Authors with equal contribution as the first author.
Int. J. Environ. Res. Public Health 2021, 18(16), 8378; https://doi.org/10.3390/ijerph18168378
Submission received: 30 June 2021 / Revised: 26 July 2021 / Accepted: 3 August 2021 / Published: 8 August 2021
(This article belongs to the Section Nursing)
Browse Figures
Versions Notes

Abstract

:
Shift work can lead to circadian desynchronization due to temporary misalignment between working hours and physiological and behavioral functioning, resulting in compromised health, insomnia, worsening of sleep quality, reduced ability to work during waking hours, and increased cardiovascular risk. We evaluated the effects of shift work on the rest-activity circadian rhythm (RAR) and health status of Italian orthopaedic nurses. The study population was 59 nurses: 44 worked the night shift and 15 worked the day shift. All carried out continuous 5-day actigraphic monitoring to assess RAR, including both the working and the rest period. The rhythmometric analysis showed that, during the working period, the night shift nurses had a significantly lower amplitude than the day shift nurses (p < 0.001), and the acrophase was significantly different between the two groups (p < 0.01). When we stratified the two groups by median body mass index (<25 kg/m2 normal weight and ≥25 kg/m2 overweight), during the working period, we noted a significantly lower amplitude for both the normal weight and the overweight nurses who worked the night shift (p < 0.01 and p < 0.001, normal weight and overweight respectively). The current findings suggest the need for further study of the relationship between activity levels and shift work.

1. Introduction

Circadian rhythmicity regulates human physiology and behavior and is involved in hormone secretion [1] and sleep [2].
Shift work, and particularly night work, can disrupt the normal sleep-wake cycle and lead to chronic desynchronization between endogenous circadian rhythms and external stimuli such as social behavior, feeding, and exercise. Under normal conditions, the endogenous sleep-wake cycle is synchronized with the day-night cycle, the timing of meals, and social routine [3,4]. Shift work involves working irregular or unusual hours different from a daytime work schedule [5]. The working hours of shift workers, because they are outside the normal daily social program, lead to circadian desynchronization due to temporary misalignment between working time and physiological and behavioral functioning, somewhat like jet lag phenomena [6]. This impacts health in various ways, including: insomnia, worsening of sleep quality, reduction in the ability to work during waking hours, reduced alertness, and increased neuromuscular fatigue, work-related stress, and cardiovascular risk [3,7,8,9,10]. The impact of shift work and its effects on worker health have been investigated in relation to cardiovascular (coronary heart disease, hypertension), metabolic (diabetes, metabolic syndrome, obesity), immune functioning [5], and mood disturbances [11]. Shift workers are also noted to be at greater risk of gastrointestinal disorders [12], workplace injuries [13], disruption in family and social life [14], and cancer [15,16].
Rest-activity circadian rhythm (RAR) refers to the level of spontaneous activity over 24 h. Since it is involved in controlling the sleep-wake cycle and numerous other physiological functions, alteration in RAR can compromise health [17,18]. RAR is described by three rhythmometric parameters (MESOR, amplitude, acrophase); RAR changes with advancing age in which amplitude is reduced and acrophase is delayed [17], similar to conditions of illness (e.g., cancer and neurological disease), in which there is a reduction in amplitude and a delay in acrophase [19,20,21], increasing the risk for cardiovascular disease [22,23].
Shift work and the associated modifications in daily routines affect the nurses’ circadian rhythm, which can lead to physical and mental health problems, and a decline in work efficiency [24,25]. Specifically in relation to the rhythmometric parameters, a recent study reported that night shift nurses in particular had less regular rest-activity cycles, greater sleep fragmentation, poorer sleep quality, displayed lower amplitude, and lower daytime activity levels [26].
Shift workers may be less likely to engage in regular physical activity, achieve complete smoking cessation, and follow a healthy diet, all modifiable risk factors for adverse health outcomes [27], including overweight and obesity [28]. Rotating night shift workers are noted to have more sedentary lifestyles and more difficulty meeting physical activity guidelines than day shift workers [29,30]. In their questionnaire-based study, Peplonska and co-workers reported that because night shift workers often have more physically demanding jobs (i.e., when assisting patients with disabilities and repositioning patients in bed), they may report more job-related physical activity and less recreational activity because of limited free time and irregular shift schedules [31], along with motivational and organizational barriers to maintaining a sufficient level of physical activity [32].
On the other hand, in contrast with the previous studies, Loef’s study [33] reported similar physical activity levels between nurses following different shifts, underlying that the absence of night shift does not result in less sedentary behavior and more physical activity during leisure time.
To the best of our knowledge, few studies to date have investigated the relationship between altered RAR and health in shift workers. To fill this gap, we evaluated in a sample of orthopaedic nurses the effects of irregular or unusual work hours on RAR and health status.

2. Materials and Methods

2.1. Participants

The present study involved 120 orthopaedic nurses at the Galeazzi Orthopaedic Institute (Milan, Italy).
Inclusion criteria were:
-
At least one year experience of shift work (day/afternoon or night) to guarantee an adaptation and synchronization to the shift by the nurses;
-
Willingness to perform actigraphic monitoring for 5 consecutive days and to maintain a daily diary during the period.
Exclusion criteria were:
-
Cardiovascular, endocrine or neuromuscular diseases (self-reported);
-
Pharmacological therapy affecting sleep quality (self-reported);
-
Pregnancy (self-reported).
Forty-five of the 120 nurses did not meet the inclusion criteria; 16 of the remaining 75 nurses declined to participate (Figure 1).
After receiving an explanation of the purpose of the study, 59 participants gave their written, informed consent and were enrolled in the study (November 2018 February 2019). Participants were free to withdraw from the study at any time.
Based on their shift schedule, the participants were divided into two groups (Figure 2): night shift nurses (NS, n = 44; 35 women and 9 men; mean age 41.5 ± 10.1 years; mean body mass index (BMI, weight in kg divided by the height in meters squared) 25.1 ± 3.4 kg/m2) and day shift nurses (DS, n = 15; 13 women and 2 men; mean age 40.6 ± 10.7 years; mean BMI 25.1 ± 5 kg/m2). The night shift group changed work shift every day over a period of 5 days, including regular work hours from 07:00 a.m. to 02:00 p.m. (day 1), from 02:00 p.m. to 09:00 p.m. (day 2), and one night shift from 09:00 p.m. to 07:00 a.m. (day 3), followed by one night off (day 4), and one day of rest (day 5). The NS group was labelled as such since the nurses work at least one night duty [34]. In addition, the categorization NS group was used to differentiate it from the DS group that worked the day shift for 3 days, from 07:00 a.m. to 02:00 p.m. or from 02:00 p.m. to 09:00 p.m., followed by two days of rest, without night duty and without work the same shift for two consecutive days. This shift cycle was maintained by both groups.
Participants responded to a brief survey investigating demographic and anthropometric characteristics, health status, and current medications. To ensure accurate actigraphic monitoring, participants were instructed in how to work the actigraphy unit and compile the daily diary. After completing one entire work shift cycle, and before starting the next one, they returned the actigraph and the diary. To avoid bias in the actigraphic analysis, we recruited nurses with at least one year of regular shift work; they were asked to maintain their regular work cycle during actigraphic monitoring and not to change shifts.
The study was approved by the Ethical Committee of the San Raffaele Hospital (CE: 156/INT/2017), registered at ClinicalTrials.gov (registration number: NCT03453398, date 7 February 2018), and carried out in accordance with the Ethical Statements of the last Helsinki Declaration. Written, informed consent was obtained from all of the participants who were enrolled in the study.

2.2. Study Design

For this study, all 59 participants were evaluated for:
-
Demographic data, health status, ongoing pharmacological therapy;
-
Height and body mass to calculate body mass index (BMI, kg/m2) [35];
-
Actigraphic monitoring to record RAR. The actigraph (MotionWatch 8®, CamNtech, Cambridge, UK) was worn on the non-dominant wrist: the participants were instructed to remove it only when bathing, showering, washing dishes or when engaging in contact or combat sports. A daily diary was provided for entering the clock time when not wearing the actigraph and napping. Based on the data recorded in the diaries, the participants removed the actigraph once a day for about 30 min on average. The time during which the device was not worn (e.g., during personal hygiene) was deleted from the data analysis.
Actigraphic monitoring started immediately before the shift cycle began (from 07:00 a.m. to 02:00 p.m. for 5 consecutive days) and was removed before starting the next work cycle (Figure 2). During actigraphic monitoring, the participants performed their usual work and maintained their usual daily activity without following a structured protocol of physical activity.

2.3. Experimental Procedures

2.3.1. RAR Assessment

RAR was non-invasively monitored by means of actigraphic data. The actigraph contains a piezoelectric triaxial accelerometer that records and converts axial movements over time in electrical signals. Data are collected in 30-s epochs and transferred from the Actiwatch to a personal computer using Actiwatch Analysis Software (Motion Ware 1.2.28, CamNtech, Cambridge, UK) for further analysis. Actiwatch Software was used to obtain locomotor activity data, expressed in activity counts (a.c.) and recorded every 30 s for the duration of monitoring (5 days). In order to determine the RAR, the activity data recorded by the actigraph were analyzed using the single cosinor method [36,37]. This method describes the time course of activity by means of an oscillatory, harmonic function f(t) = M + A cos (ωt + φ). The function hinges on three parameters (MESOR (M)-Midline Estimating Statistic of Rhythm; A is the amplitude; φ is the acrophase) that provide a parametric portrait of the activity rhythm for a subject. Briefly, the MESOR is the rhythm adjusted mean that approximates the arithmetical mean of the data for a given period, e.g., in the case of a single cosine approximation, the value mid-way between the highest and lowest values of the function used to approximate a rhythm. The M is equal to the arithmetic mean for equidistant data covering an integral number of cycles. The units for M are original physiologic units [38].
The amplitude is the measure of one-half the extent of the rhythmic variation in a cycle estimated by the sinusoidal or other function used to approximate the rhythm, e.g., the difference between maximum and MESOR of a best-fitting cosine. The units for amplitude are original physiologic units [39,40].
The acrophase indicates the time interval within which the highest values of the activity are expected. The units of the acrophase could be angular measures, degrees, radians, time units (seconds, minutes, hours, days, months, years), or physiologic episodic units. Angular measures are directly applicable to any cycle length and, hence, are proposed for general use because of greater familiarity; degrees are preferred over radians [41,42].
The quantity ω is the angular frequency of oscillation and corresponds to the ratio 2π/T, where T is the period of oscillation. Confidence intervals also should be estimated for rhythm parameters (Figure 3).

2.3.2. Data Processing

For each day, the activity counts were calculated over several periods:
-
Entire working cycle: all 5 days of working time;
-
Working period: day 1 (morning shift 07:00 a.m.–02:00 p.m.), day 2 (afternoon shift 02:00 p.m.–09:00 p.m.), day 3 (night shift 09:00 p.m.–07:00 a.m.) for the NS group, and the 3 consecutive workdays (morning shift 07:00 a.m.–02:00 p.m. or afternoon shift 02:00 p.m.–09:00 p.m.) for the DS group;
-
Rest period: day 4 (night-off) and day 5 (rest) for the NS group and the 2 consecutive rest days for the DS group.
For all of the working periods, the rhythmometric parameters were assessed based on the two-shift work schedule as a whole, NS and DS group, and then stratified by BMI.

2.4. Statistical Analysis

The sample size and its statistical power were calculated in view of the main objective of the study. Calculation was performed using the analysis of variance (ANOVA) test as reference model. A number of 59 participants was expected to guarantee a statistical power > 0.80, a value of α < 0.05, and an effect size of 0.43 (G Power software, version 3.1.9.4, HHU–Düsseldorf, Düsseldorf, Germany).
Statistical analysis was carried out using R statistics software (Version 3.6.0, R Core Team. R Foundation for Statistical Computing, Vienna, Austria) [43]. Rhythmometric parameters are expressed as the mean with 95% confidence interval (CI) and the level of significance was set at α < 0.05. The Shapiro-Wilk and Kolmogorov-Smirnov tests were used to assess data normality and the Levene test was used to assess data homogeneity for all the variables analyzed.
In order to evaluate RAR, the activity data collected with the actigraph were analyzed using the single cosinor method to identify the three rhythmometric parameters (MESOR, amplitude, acrophase). The rhythmometric parameters were then processed using the population mean cosinor. In this way, we were able to evaluate the rhythmometric characteristics of activity levels in the population and define the rhythmometric parameters of the two groups. The rhythmometric parameters of the two groups were compared using the Hotelling T2 test, a generalization of the multivariate field of the Student’s t-test. Finally, Cohen’s d was used to measure effect sizes. Effect sizes were interpreted according to the criteria suggested by Cohen [44] (d = 0.2 small; d = 0.5 medium; d = 0.8 large). Data from the demographic and anthropometric survey and actigraphic monitoring were complete.
To determine the impact and the effect of shift work on health, because obesity can increase the risk of abnormalities in RAR and circadian disruption can interfere with the metabolic and nutritional balance of the body, we stratified the entire sample by median BMI (25 kg/m2) and formed two groups: a normal weight group (<25 kg/m2, 19 NS and 9 DS nurses) and an overweight group (≥25 kg/m2, 25 NS and 6 DS nurses).

3. Results

The assumptions for normality and homogeneity were confirmed for all of the variables analyzed in the study.

3.1. Rhythmometric Analysis in Night Shift and Day Shift Nurses during the Entire Working Cycle

Table 1 reports the single cosinor method that revealed a statistically significant RAR (p < 0.001) for all participants. The population mean cosinor showed a significant circadian rhythm in both groups (p < 0.001). The Hotelling T2 test revealed significant differences between the two groups; the amplitude was significantly lower in the NS compared to the DS nurses (p < 0.001, d = −1.4, large), while no significant difference in MESOR and acrophase was found between the two groups, though MESOR was slightly lower in the NS nurses.

3.2. Rhythmometric Analysis in Night Shift and Day Shift Nurses during the Working Period

The population mean cosinor (Table 1) showed a significant circadian rhythm in both groups (p < 0.001). The Hotelling T2 test revealed significant differences between the two groups during the working period; the amplitude was significantly lower in the NS compared to the DS nurses (p < 0.001, d = −1.4, large), and the acrophase was significantly different between the two groups (p < 0.01, d = 1.2, large), with approximately 1 h of delay in the NS group compared to their DS counterparts (Figure 4). No significant difference in MESOR was found between the two groups, though MESOR was slightly lower in the NS nurses.

3.3. Rhythmometric Analysis in Night Shift and Day Shift Nurses during the Rest Period

The population mean cosinor (Table 1) showed a significant circadian rhythm in both groups (p < 0.001). No significant differences were found by The Hotelling T2 test in any of the rhythmometric parameters between the NS and DS nurses during the rest period, though MESOR and amplitude were lower in the NS nurses (Figure 4).

3.4. Rhythmometric Analysis between the Working Period and the Rest Period in Night Shift and Day Shift Nurses

Table 1 shows the comparison between the working period and the rest period in NS and DS nurses. The Hotelling T2 test revealed that MESOR and amplitude were significantly higher in the working period compared to the rest period in NS nurses (p < 0.001 for both the parameters, MESOR d = 1.2, large, amplitude d = 0.4, small). Similarly to the DS group, MESOR and amplitude were significantly higher in the working period compared to the rest period (p < 0.001, d = 1.4, large and p < 0.01, d = 0.9, large, MESOR and amplitude respectively).

3.5. Rhythmometric Analysis in Normal Weight and Overweight Nurses in Relation to Work Shift during the Entire Working Cycle

Table 2 reports the results of rhythmometric analysis of the normal weight group (<25 kg/m2) and the overweight group (≥25 kg/m2) during the entire working cycle. The single cosinor method revealed a statistically significant RAR (p < 0.001) in all participants.
The population mean cosinor applied to the normal weight and the overweight NS and DS nurses revealed a significant circadian rhythm for both groups (p < 0.001). Comparison between normal weight NS and DS nurses showed a significantly lower amplitude for the NS nurses (p < 0.001, d = −1.2, large). Similarly, in the overweight group, the amplitude was significantly lower for the NS nurses (p < 0.001, d = −1.3, large). Acrophase and MESOR differed in groups: MESOR was slightly lower in the NS nurses. Table 2 also presents the data for the normal weight and the overweight NS and DS nurses. There were no statistically significant differences in MESOR, amplitude, and acrophase between the two groups. However, MESOR and amplitude were slightly higher for the normal weight NS nurses compared to the overweight NS nurses.

3.6. Rhythmometric Analysis in Normal Weight and Overweight Nurses in Relation to Work Shift during the Working Period

The population mean cosinor (Table 2) showed a significant circadian rhythm in both groups (p < 0.001). By the Hotelling T2 test, significant differences were found between normal weight NS and DS nurses during the working period, showing a significantly lower amplitude for the NS nurses (p < 0.01, d = −1.2, large). Similarly in the overweight group, the amplitude was significantly lower for the NS nurses during the working period compared to the overweight DS nurses (p < 0.001, d = −1.2, large), and the acrophase was significantly delayed in NS nurses compared to their DS counterparts in the working period (p < 0.001, d = 1.7, large).

3.7. Rhythmometric Analysis in Normal Weight and Overweight Nurses in Relation to Work Shift during the Rest Period

The population mean cosinor (Table 2) showed a significant circadian rhythm in both groups (p < 0.001). No significant difference was found with the Hotelling T2 test in any of the rhythmometric parameters between normal weight and the overweight NS and DS nurses during the rest period.

3.8. Rhythmometric Analysis between the Working Period and the Rest Period in Normal Weight and Overweight Nurses in Relation to Work Shift

Table 2 also presents the comparison between the working period and the rest period in normal weight and overweight nurses in relation to work shift. The Hotelling T2 test revealed that MESOR was significantly higher in the working period compared to the rest period; it was evident in normal weight NS nurses (p < 0.001, d = 1.4, large) and in overweight NS nurses (p < 0.001, d = 1.1, large). Amplitude was significantly higher in the working period compared to the rest period in overweight NS nurses (p < 0.05, d = 0.4, small).
Similarly in the DS group, MESOR was significantly higher in the working period compared to the rest period: it was evident in normal weight DS nurses (p < 0.01, d = 1.2, large) and in overweight DS nurses (p < 0.01, d = 1.6, large). The acrophase was significantly delayed in overweight DS nurses in the rest period compared to their DS counterparts in the working period (p < 0.01, d = 1.4, large).

4. Discussion

For the current study, we evaluated, in a sample of orthopaedic nurses, the effects of working irregular or unusual hours on the rest-activity circadian rhythm. This study suggests alterations in activity levels as monitored by actigraphy in NS and DS nurses. One of the main findings is the difference in RAR between the NS and the DS nurses, considering both the working and the rest period. During the working period, significantly lower amplitude and a delayed acrophase, of approximately 1 h, were observed for the NS compared to the DS counterparts. MESOR was similar for both groups, even if it was slightly lower in the NS compared to the DS nurses.
Since the two groups perform the same type of activities during the working period, the lower activity levels recorded for the NS nurses could be related to their leisure time activity. In fact, during the rest period, the rhythmometric parameters showed no significant differences between the two groups, while MESOR and amplitude were significantly lower compared to the working period in both groups.
Evidence suggests that shift workers are physically less active because of limited time to participate in organized sports activities [45]. In addition, night workers are reported to have more difficulty staying physically fit than other workers [46]. An important factor in the maintenance of physical activity is the psycho-physiological response to exercise. While a shift worker may have the opportunity to participate in some activities, the increased fatigue and negative training experiences caused by misalignment with their biological clock could be reasons why they discontinue recreational sports activity. Another question is whether exercise exacerbates or improves the difficulties that shift workers experience [47]. Workers who generally cope well with shift work may be more inclined to exercise than those who do not. There is evidence that regular physical activity can act as a “synchronizer” by advancing or delaying an individual’s circadian rhythms. Exercise performed at a convenient time of day may help to reduce fatigue, tiredness, sleepiness, and the other short-term effects of shift work [48]. Consistent with these observations, we speculate that the reduction of daytime activity during the rest period in both shift work typologies could be deleterious to health and increase the risk of diabetes and obesity [49], cancer [50], neurodegenerative diseases [21], and cardiovascular diseases [22,23].
Referring to the acrophase, despite the data showed a delay of approximately 1 h in NS compared to DS nurses during the working period, it does not seem that the circadian rhythm regularity was affected by the night shift work. Probably a single night planned on a 5-day shift schedule is not able to change the worker’s circadian rhythm.
Moreover, shift work can also interfere with metabolism. Our data showed that, independent of BMI, the amplitude was significantly lower in the NS compared to the DS nurses during the working period. BMI may influence RAR in night shift workers, who are noted to have a higher risk of illness, but this relationship was not completely clear due to the small sample size. Previous studies found a correlation between BMI and circadian disruption [51,52,53,54,55,56]; it seems that this relationship may be considered bidirectional. Obesity can increase the risk of abnormalities in RAR, and circadian disruption can interfere with the metabolic and nutritional balance of the body. Eating at an inappropriate time in the circadian rhythm (i.e., at night in humans), as shift workers commonly do, may increase the risk of obesity due to a misalignment between central and peripheral clocks [54]. In addition, changes in normal eating behaviors (e.g., eating energy-dense snacks) can also interfere with maintaining a correct energy balance [57]. Furthermore, disruption of circadian rhythm could result from the suppression of melatonin secretion caused by exposure to night light, which is one of the key factors in the development of obesity in night shift workers. Evidence suggests that melatonin plays a central role in synchronizing central and peripheral circadian rhythms and regulates the secretion of hormones (e.g., cortisol, insulin, leptin). Such misalignment may lead to a disturbance in body homeostasis and result in an abnormal metabolic profile [51,56].
The limitations of the present study include the small sample size. Additional information (e.g., marital status, number of children or care of elderly family member) could have provided greater detail about the sample and the activity levels associated with daily housework and family commitments. In addition, data collection around dietary habits or stress measurements could have supplied a better interpretation of how night shift work might affect nursing staff more generally.

5. Conclusions

Based on the data, the strength of the present study is the objective measurement of RAR by actigraphy in the comparison of nurses working night and day shifts. The findings underscore the importance of further investigations evaluating the relationship between activity levels and shift work.
In this perspective, future studies are needed to determine whether physical activity programs, scheduled in the nurses’ leisure time or conducted at the workplace, could improve circadian activity levels and prevent alterations in the sleep-wake cycle in shift workers.

Author Contributions

Conceptualization, L.G., E.C., G.B., E.R., A.M. (Angela Montaruli) and F.E.; methodology, L.G., E.C., G.B., E.R., A.M. (Angela Montaruli) and F.E.; formal analysis, L.G., A.M. (Antonino Mulè), L.C. and V.C.; investigation, L.G., A.M. (Antonino Mulè) and L.C.; resources, G.B.; data curation, L.G., A.M. (Antonino Mulè) and L.C.; writing-original draft preparation, L.G.; writing—review and editing, L.G., A.M. (Antonino Mulè), L.C., E.C., V.C., G.B., E.R., A.M. (Angela Montaruli) and F.E.; visualization, L.G.; supervision, E.C., G.B., E.R., A.M. (Angela Montaruli) and F.E.; project administration, G.B. and F.E. All authors have read and agreed to the published version of the manuscript.

Funding

This work was funded by the project “TURNISTI v.01” of the Italian Ministry of Health (Ministero della Salute -Ricerca Corrente).

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Ethics Committee of the San Raffaele Hospital (CE: 156/INT/2017), registered at ClinicalTrials.gov (registration number: NCT03453398, date 7 February 2018).

Informed Consent Statement

Written informed consent was obtained from all subjects involved in the study.

Data Availability Statement

All data generated or analyzed during this study are included in this article.

Acknowledgments

We would like to thank the nursing staff of the IRCCS Galeazzi Orthopaedic Institute for participating in the study. We also wish to thank Pasqualino D’Aloia and Loredana Prampolini for their assistance with logistics.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Boivin, D.B. Disturbances of hormonal circadian rhythms in shift workers. In Neuroendocrine Correlates of Sleep/Wakefulness; Cardinali, D.P., Pandi-Perumal, S.R., Eds.; Springer: Boston, MA, USA, 2006; pp. 325–354. [Google Scholar]
  2. Boudreau, P.; Yeh, W.H.; Dumont, G.A.; Boivin, D.B. Circadian variation of heart rate variability across sleep stages. Sleep 2013, 36, 1919–1928. [Google Scholar] [CrossRef] [Green Version]
  3. Sack, R.L.; Auckley, D.; Auger, R.R.; Carskadon, M.A.; Wright, K.P., Jr.; Vitiello, M.V.; Zhdanova, I.V.; American Academy of Sleep Medicine. Circadian rhythm sleep disorders: Part I, basic principles, shift work and jet lag disorders. Sleep 2007, 30, 1460–1483. [Google Scholar] [CrossRef] [Green Version]
  4. Sack, R.L.; Auckley, D.; Auger, R.R.; Carskadon, M.A.; Wright, K.P., Jr.; Vitiello, M.V.; Zhdanova, I.V.; American Academy of Sleep Medicine. Circadian rhythm sleep disorders: Part II, advanced sleep phase disorder, delayed sleep phase disorder, free-running disorder, and irregular sleep-wake rhythm. Sleep 2007, 30, 1484–1501. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  5. Wang, X.S.; Armstrong, M.E.G.; Cairns, B.J.; Key, T.J.; Travis, R.C. Shift work and chronic disease: The epidemiological evidence. Occup. Med. 2011, 61, 78–89. [Google Scholar] [CrossRef] [Green Version]
  6. Boivin, D.B.; Boudreau, P. Impacts of shift work on sleep and circadian rhythms. Pathol. Biol. 2014, 62, 292–301. [Google Scholar] [CrossRef]
  7. Saksvik, I.B.; Bjorvatn, B.; Hetland, H.; Sandal, G.M.; Pallesen, S. Individual differences in tolerance to shift work—A systematic review. Sleep Med. Rev. 2011, 15, 221–235. [Google Scholar] [CrossRef] [PubMed]
  8. Selvi, Y.; Özdemir, P.G.; Özdemir, O.; Aydin, A.; Beşiroğlu, L. Influence of night shift work on psychologic state and quality of life in health workers. J. Psychiatry Neurol. Sci. 2010, 23, 238–243. [Google Scholar] [CrossRef]
  9. Roveda, E.; Castelli, L.; Galasso, L.; Mulè, A.; Cè, E.; Condemi, V.; Banfi, G.; Montaruli, A.; Esposito, F. Differences in daytime activity levels and daytime sleep between night and day duty: An observational study in italian orthopedic nurses. Front. Physiol. 2021, 12, 628231. [Google Scholar] [CrossRef]
  10. Cè, E.; Doria, C.; Roveda, E.; Montaruli, A.; Galasso, L.; Castelli, L.; Mulè, A.; Longo, S.; Coratella, G.; D’Aloia, P.; et al. Reduced neuromuscular performance in night shift orthopedic nurses: New insights from a combined electromyographic and force signals approach. Front. Physiol. 2020, 11, 693. [Google Scholar] [CrossRef] [PubMed]
  11. Chellappa, S.L. Circadian misalignment: A biological basis for mood vulnerability in shift work. Eur. J. Neurosci. 2020, 52, 3846–3850. [Google Scholar] [CrossRef] [PubMed]
  12. Knutsson, A.; Bøggild, H. Gastrointestinal disorders among shift workers. Scand. J. Work Environ. Health 2010, 36, 85–95. [Google Scholar] [CrossRef] [Green Version]
  13. Wong, I.S.; McLeod, C.B.; Demers, P.A. Shift work trends and risk of work injury among canadian workers. Scand. J. Work Environ. Health 2011, 37, 54–61. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  14. Khaleque, A. Sleep deficiency and quality of life of shift workers. Soc. Indic. Res. 1999, 46, 181–189. [Google Scholar] [CrossRef]
  15. Rajaratnam, S.M.; Arendt, J. Health in a 24-h society. Lancet 2001, 358, 999–1005. [Google Scholar] [CrossRef]
  16. Schernhammer, E.S.; Laden, F.; Speizer, F.E.; Willett, W.C.; Hunter, D.J.; Kawachi, I.; Colditz, G.A. Rotating night shifts and risk of breast cancer in women participating in the nurses’ health study. J. Natl. Cancer Inst. 2001, 93, 1563–1568. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  17. Cornelissen, G.; Otsuka, K. Chronobiology of aging: A mini-review. Gerontology 2017, 63, 118–128. [Google Scholar] [CrossRef]
  18. Abbott, S.M.; Malkani, R.G.; Zee, P.C. Circadian disruption and human health: A bidirectional relationship. Eur. J. Neurosci. 2020, 51, 567–583. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  19. Gehrman, P.; Marler, M.; Martin, J.L.; Shochat, T.; Corey-Bloom, J.; Ancoli-Israel, S. The timing of activity rhythms in patients with dementia is related to survival. J. Gerontol. A Biol. Sci. Med. Sci. 2004, 59, 1050–1055. [Google Scholar] [CrossRef] [Green Version]
  20. Mormont, M.C.; Waterhouse, J.; Bleuzen, P.; Giacchetti, S.; Jami, A.; Bogdan, A.; Lellouch, J.; Misset, J.L.; Touitou, Y.; Lévi, F. Marked 24-h rest/activity rhythms are associated with better quality of life, better response, and longer survival in patients with metastatic colorectal cancer and good performance status. Clin. Cancer Res. 2000, 6, 3038–3045. [Google Scholar]
  21. Tranah, G.J.; Waterhouse, J.; Bleuzen, P.; Giacchetti, S.; Jami, A.; Bogdan, A.; Lellouch, J.; Misset, J.L.; Touitou, Y.; Lévi, F. Circadian activity rhythms and risk of incident dementia and mild cognitive impairment in older women. Ann. Neurol. 2011, 70, 722–732. [Google Scholar] [CrossRef] [Green Version]
  22. Paudel, M.L.; Taylor, B.C.; Ancoli-Israel, S.; Blackwell, T.; Stone, K.L.; Tranah, G.; Redline, S.; Cummings, S.R.; Ensrud, K.E.; Osteoporotic Fractures in Men (MrOS) Study. Rest/activity rhythms and mortality rates in older men: MrOS sleep study. Chronobiol. Int. 2010, 27, 363–377. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  23. Tranah, G.J.; Blackwell, T.; Ancoli-Israel, S.; Paudel, M.L.; Ensrud, K.E.; Cauley, J.A.; Redline, S.; Hillier, T.A.; Cummings, S.R.; Stone, K.L.; et al. Circadian activity rhythms and mortality: The study of osteoporotic fractures. J. Am. Geriatr. Soc. 2010, 58, 282–291. [Google Scholar] [CrossRef]
  24. Hosseinabadi, M.B.; Ebrahimi, M.H.; Khanjani, N.; Biganeh, J.; Mohammadi, S.; Abdolahfard, M. The effects of amplitude and stability of circadian rhythm and occupational stress on burnout syndrome and job dissatisfaction among irregular shift working nurses. J. Clin. Nurs. 2019, 28, 1868–1878. [Google Scholar] [CrossRef]
  25. Rosa, D.; Terzoni, S.; Dellafiore, F.; Destrebecq, A. Systematic review of shift work and nurses’ health. Occup. Med. 2019, 69, 237–243. [Google Scholar] [CrossRef] [PubMed]
  26. Chang, W.P.; Li, H.B. Differences in workday sleep fragmentation, rest-activity cycle, sleep quality, and activity level among nurses working different shifts. Chronobiol. Int. 2019, 36, 1761–1771. [Google Scholar] [CrossRef]
  27. Nabe-Nielsen, K.; Quist, H.G.; Garde, A.H.; Aust, B. Shift work and changes in health behaviors. J. Occup. Environ. Med. 2011, 53, 1413–1417. [Google Scholar] [CrossRef] [PubMed]
  28. Barbadoro, P.; Santarelli, L.; Croce, N.; Bracci, M.; Vincitorio, D.; Prospero, E.; Minelli, A. Rotating shift-work as an independent risk factor for overweight italian workers: A cross-sectional study. PLoS ONE 2013, 8, e63289. [Google Scholar]
  29. KivimÄki, M.; Kuisma, P.; Virtanen, M.; Elovainio, M. Does shift work lead to poorer health habits? A comparison between women who had always done shift work with those who had never done shift work. Work Stress 2001, 15, 3–13. [Google Scholar] [CrossRef]
  30. Neil-Sztramko, S.E.; Gotay, C.C.; Demers, P.A.; Campbell, K.L. Physical activity, physical fitness, and body composition of canadian shift workers: Data from the canadian health measures survey cycles 1 and 2. J. Occup. Environ. Med. 2016, 58, 94–100. [Google Scholar] [CrossRef] [PubMed]
  31. Peplonska, B.; Bukowska, A.; Sobala, W. Rotating night shift work and physical activity of nurses and midwives in the cross-sectional study in Łódź, Poland. Chronobiol. Int. 2014, 31, 1152–1159. [Google Scholar] [CrossRef] [PubMed]
  32. Alves, M.S.; Andrade, R.Z.; Silva, G.C.; Mota, M.C.; Resende, S.G.; Teixeira, K.R.; Gonçalves, B.F.; Crispim, C.A. Social jetlag among night workers is negatively associated with the frequency of moderate or vigorous physical activity and with energy expenditure related to physical activity. J. Biol. Rhythm. 2017, 32, 83–93. [Google Scholar] [CrossRef] [PubMed]
  33. Loef, B.; van der Beek, A.J.; Holtermann, A.; Hulsegge, G.; van Baarle, D.; Proper, K.I. Objectively measured physical activity of hospital shift workers. Scand. J. Work Environ. Health 2018, 44, 265–273. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  34. Costa, G. The problem: Shiftwork. Chronobiol. Int. 1997, 14, 89–98. [Google Scholar] [CrossRef] [PubMed]
  35. World Health Organization (WHO). Obesity: Preventing and Managing the Global Epidemic; Report of a WHO Consultation; WHO Technical Report Series 894; WHO: Geneva, Switzerland, 2000. [Google Scholar]
  36. Halberg, F.; Carandente, F.; Cornelissen, G.; Katinas, G.S. Glossary of chronobiology. Chronobiologia 1977, 4, 1–189. [Google Scholar] [PubMed]
  37. Nelson, W.; Tong, L.Y.; Lee, J.K.; Halberg, F. Methods of cosinor rhythmometry. Chronobiologia 1979, 6, 305–323. [Google Scholar] [PubMed]
  38. Bartter, F.C.; Delea, C.S.; Baker, W.; Halberg, F.; Lee, J.K. Chronobiology in the diagnosis and treatment of mesor-hypertension. Chronobiologia 1976, 3, 199–213. [Google Scholar] [PubMed]
  39. Koukkari, W.L.; Halberg, F.; Gordon, S.A. Quantifying Rhythmic Movements of Albizzia julibrissin Pinnules. Plant Physiol. 1973, 51, 1084–1088. [Google Scholar] [CrossRef] [Green Version]
  40. Koukkari, W.L.; Duke, S.H.; Halberg, F.; Lee, J.K. Circadian rhythmic leaflet movements: Student exercise in chronobiology. Chronobiologia 1974, 1, 281–302. [Google Scholar] [PubMed]
  41. Halberg, F.; Reinberg, A. Circadian rhythm and low frequency rhythms in human physiology. J. Physiol. 1967, 59, 117–200. [Google Scholar]
  42. De Prins, J.; Cornelissen, G.; Halberg, F. Harmonic interpolation on equispaced series covering integral period of anticipated circadian rhythm in adriamycin tolerance. Chronobiologia 1977, 4, 173. [Google Scholar]
  43. Blume, C.; Santhi, N.; Schabus, M. “nparACT” package for R: A free software tool for the non-parametric analysis of actigraphy data. MethodsX 2016, 3, 430–435. [Google Scholar] [CrossRef] [PubMed]
  44. Cohen, J. Statistical Power Analysis for the Behavioral Sciences, 2nd ed.; Academic Press: New York, NY, USA, 1977. [Google Scholar]
  45. Atkinson, G.; Davenne, D. Relationships between sleep, physical activity and human health. Physiol. Behav. 2007, 90, 229–235. [Google Scholar] [CrossRef] [Green Version]
  46. Kaliterna, L.L.; Prizmic, L.Z.; Zganec, N. Quality of life, life satisfaction and happiness in shift- and non-shiftworkers. Rev. Saude Publica 2004, 38, 3–10. [Google Scholar] [CrossRef] [PubMed]
  47. Atkinson, G.; Fullick, S.; Grindey, C.; Maclaren, D.; Waterhouse, J. Exercise, energy balance and the shift worker. Sports Med. 2008, 38, 671–685. [Google Scholar] [CrossRef] [PubMed]
  48. Atkinson, G.; Edwards, B.; Reilly, T.; Waterhouse, J. Exercise as a synchronizer of human circadian rhythms: An update and discussion of the methodological problems. Eur. J. Appl. Physiol. 2007, 99, 331–341. [Google Scholar] [CrossRef]
  49. Tevy, M.F.; Giebultowicz, J.; Pincus, Z.; Mazzoccoli, G.; Vinciguerra, M. Aging signaling pathways and circadian clock-dependent metabolic derangements. Trends Endocrinol. Metab. 2013, 24, 229–237. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  50. Mormont, M.C.; Waterhouse, J. Contribution of the rest-activity circadian rhythm to quality of life in cancer patients. Chronobiol. Int. 2002, 19, 313–323. [Google Scholar] [CrossRef]
  51. Antunes, L.C.; Levandovski, R.; Dantas, G.; Caumo, W.; Hidalgo, M.P. Obesity and shift work: Chronobiological aspects. Nutr. Res. Rev. 2010, 23, 155–168. [Google Scholar] [CrossRef] [Green Version]
  52. Depner, C.M.; Stothard, E.R.; Wright, K.P., Jr. Metabolic consequences of sleep and circadian disorders. Curr. Diabetes Rep. 2014, 14, 507. [Google Scholar] [CrossRef] [PubMed]
  53. Ekmekcioglu, C.; Touitou, Y. Chronobiological aspects of food intake and metabolism and their relevance on energy balance and weight regulation. Obes. Rev. 2011, 12, 14–25. [Google Scholar] [CrossRef]
  54. Garaulet, M.; Gomez-Abellan, P. Timing of food intake and obesity: A novel association. Physiol. Behav. 2014, 134, 44–50. [Google Scholar] [CrossRef] [PubMed]
  55. McHill, A.W.; Wright, K.P., Jr. Role of sleep and circadian disruption on energy expenditure and in metabolic predisposition to human obesity and metabolic disease. Obes. Rev. 2017, 18, 15–24. [Google Scholar] [CrossRef]
  56. Scheer, F.A.; Hilton, M.F.; Mantzoros, C.S.; Shea, S.A. Adverse metabolic and cardiovascular consequences of circadian misalignment. Proc. Natl. Acad. Sci. USA 2009, 106, 4453–4458. [Google Scholar] [CrossRef] [Green Version]
  57. Garaulet, M.; Ordovas, J.M.; Madrid, J.A. The chronobiology, etiology and pathophysiology of obesity. Int. J. Obes. 2010, 34, 1667–1683. [Google Scholar] [CrossRef] [Green Version]
Ijerph 18 08378 g001 550
Figure 1. Participant recruitment. Study design, participant adherence, and dropout.
Figure 1. Participant recruitment. Study design, participant adherence, and dropout.
Ijerph 18 08378 g001
Ijerph 18 08378 g002 550
Figure 2. Shift schedule for night shift (NS) and day shift (DS) nurses. The grey indicators denote the duration of actigraphic monitoring. O: night-off; R: rest; D: diurnal shift.
Figure 2. Shift schedule for night shift (NS) and day shift (DS) nurses. The grey indicators denote the duration of actigraphic monitoring. O: night-off; R: rest; D: diurnal shift.
Ijerph 18 08378 g002
Ijerph 18 08378 g003 550
Figure 3. Example of a biological rhythm and its parameters: Acrophase (φ), Amplitude (A) and MESOR (M) [36].
Figure 3. Example of a biological rhythm and its parameters: Acrophase (φ), Amplitude (A) and MESOR (M) [36].
Ijerph 18 08378 g003
Ijerph 18 08378 g004 550
Figure 4. Rest-activity circadian rhythms: data collected by actigraphy in night shift (NS) and day shift nurses (DS) during the working period and the rest period. The dashed black line denotes night shift nurses (NS) for the working and the rest period; the continued grey line denotes day shift nurses (DS) for the working and the rest period.
Figure 4. Rest-activity circadian rhythms: data collected by actigraphy in night shift (NS) and day shift nurses (DS) during the working period and the rest period. The dashed black line denotes night shift nurses (NS) for the working and the rest period; the continued grey line denotes day shift nurses (DS) for the working and the rest period.
Ijerph 18 08378 g004
Table
Table 1. Population mean cosinor analysis in night shift and day shift nurses during the entire working cycle, the working period and the rest period.
Table 1. Population mean cosinor analysis in night shift and day shift nurses during the entire working cycle, the working period and the rest period.
GroupPR (%)p-ValueMESOR (a.c.)Amplitude (a.c.)Acrophase (h:min)
NS (n = 44)
Entire working cycle28<0.001113.1 ± 7.5759.9 ± 6.2 a15:34 ± 00:48
Working period10<0.001122.7 ± 8.5 d67.5 ± 6.9 b,e14:32 ± 00:31 c
Rest period11<0.00187.9 ± 8.8 d51.5 ± 10.5 e14:52 ± 01:11
DS (n = 15)
Entire working cycle47<0.001120.9 ± 14.5390.6 ± 14.26 a15:09 ± 01:25
Working period21<0.001128.5 ± 15.5 f96 ± 14.5 b,g13:29 ± 02:31 c
Rest period14<0.00190.3 ± 17.1 f69.8 ± 20.8 g14:40 ± 01:22
Analysis of RAR in night shift and day shift nurses during the entire working cycle, the working period and the rest period. Data are expressed as mean ± 95% CI. NS: night shift nurses. DS: day shift nurses. PR: percentage of rhythm. MESOR (activity counts): Midline Estimating Statistic of Rhythm. Amplitude (activity counts): half the difference between the highest and the lowest points of the cosine function best fitting the data. Acrophase (h:min): time in which the highest value falls. Significances of Hotelling T2 test: a p < 0.001: difference in amplitude during the entire working cycle between NS and DS group. b p < 0.001: difference in amplitude during the working period between NS and DS group. c p < 0.01: difference in acrophase during the working period between NS and DS group. d p < 0.001: difference in MESOR in NS group between the working period and the rest period. e p < 0.001: difference in amplitude in NS group between the working period and the rest period. f p < 0.001: difference in MESOR in DS group between the working period and the rest period. g p < 0.01: difference in amplitude in DS group between the working period and the rest period.
Table
Table 2. Population mean cosinor analysis in normal weight and overweight nurses in relation to work shift during the entire working cycle, the working period and the rest period.
Table 2. Population mean cosinor analysis in normal weight and overweight nurses in relation to work shift during the entire working cycle, the working period and the rest period.
GroupPR (%)p-ValueMESOR (a.c.)Amplitude (a.c.)Acrophase (h:min)
BMI < 25 kg/m2
Entire working cycle
NS (n = 19)29<0.001117.3 ± 12.662 ± 11 a15:47 ± 01:21
DS (n = 9)51<0.001119.8 ± 14.6892 ± 16.89 a15:31 ± 02:07
Working period
NS (n = 19)11<0.001128.3 ± 13 f71 ± 10.7 c14:39 ± 01:04
DS (n = 9)21<0.001126.3 ± 21.4 i99 ± 24.7 c13:35 ± 02:32
Rest period
NS (n = 19)11<0.00188.1 ± 13.3 f52.9 ± 19.615:08 ± 01:03
DS (n = 9)17<0.001101.7 ± 18.3 i81 ± 26.814:49 ± 02:01
BMI ≥ 25 kg/m2
Entire working cycle
NS (n = 25)27<0.001109.8 ± 9.8958.4 ± 7.66 b15:47 ± 01:02
DS (n = 6)41<0.001122.5 ± 38.3990 ± 33.83 b15:39 ± 02:14
Working period
NS (n = 25)10<0.001118 ± 11.7 g64.7 ± 9.7 d,h14:25 ± 01:38 e
DS (n = 6)18<0.001131.4 ± 37.1 l97.7 ± 24.7 d12:26 ± 02:07 e,m
Rest period
NS (n = 25)10<0.00187.8 ± 12.6 g49.8 ± 12.1 h14:38 ± 01:59
DS (n = 6)11<0.00175.2 ± 35.2 l55 ± 41.314:21 ± 04:59 m
Actigraphy-based analysis of RAR in normal weight (BMI < 25 kg/m2) and overweight nurses (BMI ≥ 25 kg/m2) in relation to work shift during the entire working cycle, the working period, and the rest period. Data are expressed as mean ± 95% CI. NS: night shift nurses. DS: day shift nurses. PR: percentage of rhythm. MESOR (activity counts): midline estimating statistic of rhythm. Amplitude (activity counts): half the difference between the highest and the lowest points of the cosine function best fitting the data. Acrophase (h:min): time in which the highest value falls. Significances of Hotelling T2 test: a p < 0.001: difference in amplitude during the entire working cycle between normal weight NS and DS group. b p < 0.001: difference in amplitude during the entire working cycle between overweight NS and DS group. c p < 0.01: difference in amplitude during the working period between normal weight NS and DS group. d p < 0.001: difference in amplitude during the working period between overweight NS and DS group. e p < 0.001: difference in acrophase during the working period between overweight NS and DS group. f p < 0.001: difference in MESOR between the working and the rest period in normal weight NS group. g p < 0.001: difference in MESOR between the working and the rest period in overweight NS group. h p < 0.05: difference in amplitude between the working and the rest period in overweight NS group. i p < 0.01: difference in MESOR between the working and the rest period in normal weight DS group. l p < 0.01: difference in MESOR between the working and the rest period in overweight DS group. m p < 0.01: difference in acrophase between the working and the rest period in overweight DS group.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Galasso, L.; Mulè, A.; Castelli, L.; Cè, E.; Condemi, V.; Banfi, G.; Roveda, E.; Montaruli, A.; Esposito, F. Effects of Shift Work in a Sample of Italian Nurses: Analysis of Rest-Activity Circadian Rhythm. Int. J. Environ. Res. Public Health 2021, 18, 8378. https://doi.org/10.3390/ijerph18168378

AMA Style

Galasso L, Mulè A, Castelli L, Cè E, Condemi V, Banfi G, Roveda E, Montaruli A, Esposito F. Effects of Shift Work in a Sample of Italian Nurses: Analysis of Rest-Activity Circadian Rhythm. International Journal of Environmental Research and Public Health. 2021; 18(16):8378. https://doi.org/10.3390/ijerph18168378

Chicago/Turabian Style

Galasso, Letizia, Antonino Mulè, Lucia Castelli, Emiliano Cè, Vincenzo Condemi, Giuseppe Banfi, Eliana Roveda, Angela Montaruli, and Fabio Esposito. 2021. "Effects of Shift Work in a Sample of Italian Nurses: Analysis of Rest-Activity Circadian Rhythm" International Journal of Environmental Research and Public Health 18, no. 16: 8378. https://doi.org/10.3390/ijerph18168378

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop