Next Article in Journal
Hospital Admission Trends Due to Viral Infections Characterised by Skin and Mucous Membrane Lesions in the Past Two Decades in England and Wales: An Ecological Study
Next Article in Special Issue
Influence of Socio-Economic Factors and Region of Birth on the Risk of Preeclampsia in Sweden
Previous Article in Journal
Older Public Housing Tenants’ Capabilities for Physical Activity Described Using Walk-Along Interviews in Montreal, Canada
Previous Article in Special Issue
Conduct Disorder in Immigrant Children and Adolescents: A Nationwide Cohort Study in Sweden
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
IJERPH
Volume 18
Issue 21
10.3390/ijerph182111648
ijerph-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Association between Exposure to Particulate Matter during Pregnancy and Multidimensional Development in School-Age Children: A Cross-Sectional Study in Italy

by
Paolo Girardi
1,2,*,
Silvia Lanfranchi
1,
Libera Ylenia Mastromatteo
1,
Massimo Stafoggia
3 and
Sara Scrimin
1
1
Department of Developmental and Social Psychology, University of Padova, Via Venezia 8, 35131 Padova, Italy
2
Department of Statistical Sciences, University of Padova, Via Cesare Battisti 241, 35121 Padova, Italy
3
Department of Epidemiology, Lazio Regional Health Service, ASL Roma 1, Via Cristoforo Colombo, 112, 00147 Rome, Italy
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2021, 18(21), 11648; https://doi.org/10.3390/ijerph182111648
Submission received: 13 September 2021 / Revised: 19 October 2021 / Accepted: 29 October 2021 / Published: 5 November 2021
(This article belongs to the Special Issue Real World Data for Population-Based Pediatric Studies)
Browse Figures
Review Reports Versions Notes

Abstract

:
Air pollutants can potentially affect the development of children. However, data on the effect of exposure to air pollution during pregnancy and developmental outcomes in school children are rare. We investigated the link between prenatal exposure to particulate matters smaller than 10 microns (PM10) and the development of school-age children in multiple domains. Cross-sectional data were collected in Italy between 2013 and 2014. Children aged between 5 and 8 years (n = 1187) were assessed on cognitive, communication, socio-emotional, adaptive, and motor developmental domains using the Developmental Profile 3 questionnaire. The monthly average concentration of PM10 during the entire fetal period was linked to the municipality of residence of the children. The increase in the prenatal PM10 was associated with a decrease in the cognitive score during the second (+13.2 µg/m3 PM10 increase: −0.30 points; 95%CI: −0.12–−0.48) and third trimesters of pregnancy (−0.31 points; 95%CI: −0.11–−0.50). The communicative domain was also negatively influenced by PM10 increases in the second trimester. The development of cognitive and communicative abilities of children was negatively associated with the exposure to PM10 during the period of fetal development, confirming that exposure to air pollution during pregnancy can potentially hinder the development of the brain.

1. Introduction

The combustion of fossil fuels in the last century has resulted in a progressive air pollution increase, which affects human health [1]. Epidemiological studies provide a clear link between air pollutant exposure and health status [2]. Exposure to air pollution during the early stages of life, from conception to the first two years, can have significant effects on children’s health. The growth of children’s bodies and organs occurs through complex developmental processes that can be easily disrupted, or even altered, when exposed to pollutants. Studies linking exposure to air pollutants to neurobehavioral, neuropsychiatric, and cognitive functioning in children reported mixed results [3], mainly due to the limited number of studies, their small sample size, and methodological constraints [4,5,6]. Nevertheless, the biological link between air pollution and development is supported by the fact that the central nervous system is extremely vulnerable due to the long time needed for its complete development [7]; the child is more susceptible to pollutants and has a reduced clearance of toxicants compared to adults [8].
Exposure to air pollutants is particularly detrimental during pregnancy for brain development [9,10,11,12,13], however it is also associated with immediate severe adverse health outcomes, such as fetal and infant mortality, low birth weight, preterm birth, intrauterine growth retardation, and birth defects [14]. Studies assessing the influence of prenatal exposure to air pollution on child development are limited and focused only on a specific domain. In a sample of children aged 6–11 years (n = 1105; the United States), increases in nitrogen dioxide (NO2) and fine particulate (PM2.5) exposure during the third trimester were associated with a decrease in nonverbal IQ and visual-motor abilities [15]. A large study among six European countries (9482 children aged 1–6 years) found an association between NO2 exposures during pregnancy and reduced psychomotor development [3]. Studies involving homogeneous populations [16,17,18,19] or longitudinal evaluations [20,21,22] confirmed the significant impact of prenatal exposure to air pollution on behavioral and cognitive functioning in children. In particular, studies comparing results between prenatal and postnatal exposure confirmed that pregnancy is a target temporal window [22,23]. In addition, direct childhood exposure to air pollution (PM2.5) can be associated with a reduction in cognitive abilities [24] and psychomotor development [3,21], as well as behavioral and mental health problems [5,25,26]. In general, studies on exposure to particulate matter, in particular those considering particles smaller than 10 microns (PM10), can be of crucial importance; in fact, PM10 originated from multiple sources, such as vehicle traffic, industrial settings, and natural sources (i.e., dust, forest, and plants) [27], and it represents a shared indicator of environmental pressure [28].
A further and major lack in the literature is related to the fact that most studies focused only on some specific developmental domain; this does not allow to assess the effect of pollution on the whole child. We adopted a multidimensional approach assessing the development across five key areas: motor, adaptive behavior, social-emotional, cognitive, and communication. These domains are of paramount importance to picture a child’s general functioning and generate a developmental profile. The present exploratory study aims to assess the effects of exposure to PM10 during pregnancy on each developmental domain among a representative sample of school-age children living in a wide geographical area of Italy with different levels of air pollution. Importantly, with the aim of creating a picture as much complete as possible, a series of elements that play an important role in determining development (e.g., family socioeconomic status, composition, and parental characteristics) were also considered.

2. Materials and Methods

2.1. Study Population and Assessment of Development

In total, 1519 school-age children (5 to 8 years) residing in a large set of municipalities in Italy between 2013 and 2014 voluntarily took part in the study. Data were collected through an ad hoc questionnaire administered to the children’s mothers by trained interviewers. Selection criteria were applied which excluded from the study mothers whose children had genetic disorders, clinically diagnosed neurodevelopmental disorders, or severe health problems, and who were born very premature. The first part of the questionnaire was designed to collect socio-demographic information about the child (such as birth date, gender, nationality, and municipality of residence), family (such as the number and the age of siblings), and parents (type of job, grade of education, and nationality). The education level of the parents was coded in low (middle school or less), medium (high school), and high (degree or higher). To complete this first part of the questionnaire participants took approximately 5 min. To assess the developmental domains, the Developmental Profile 3 (DP-3) [29] was used. DP-3 assesses child development exploring cognitive, communication, socio-emotional, adaptive, and motor domains through parent reports of everyday behaviors. It consists of 180 items, divided in five scales, that describe a child’s normal behavior that is considered a developmental milestone in a particular developmental domain. The parents must state whether their child shows that particular behavior at a certain frequency. DP-3 can be administered as a semi-structured interview or as a questionnaire that is to be completed by parents with an active support of the interviewer. The type of compilation was chosen by the interviewer to increase the data quality based on the mother’s availability and the understanding of the Italian language. Participants took about 20–30 min to complete the DP-3, both when administered as an interview or as a questionnaire. Out of 1519 children, 1157 children were successfully linked with the temporal window of the available air pollution data (for further details, see the next section). The geographical distribution of the 1157 children at their residential municipality has been reported in the Supplementary Material (Figure S1). In our sample, 54.3% of parents were interviewed by a trained interviewer, and 45.7% self-filled the questionnaire. In the latter case, an interviewer was available in case clarifications on the questions were required. During the years 2013 and 2014, 33 interviewers performed a face-to-face interview or administered the questionnaire with a mean of 44.7 questionnaires per interviewer. DP-3 has shown good psychometric properties, both in its original version and in the Italian version [30] that has been used in this study. The test’s manual reports retain good internal consistency (with most of the values higher than 0.90), test–retest reliability (with values ranging from 0.87 and 0.99), and good inter-rater reliability (with values higher than 0.95).

2.2. Exposure to Air Pollution

The data on air pollution were collected using a spatiotemporal model, which combined data of air pollution monitoring stations with satellite retrievals and GIS-based spatial predictors [31,32]. Briefly, we adopted a three-stage approach where we calibrated the monitor-based data to satellite aerosol optical depth retrievals and other spatial parameters in the first stage. We filled gaps in the satellite parameters using atmospheric dispersion models in the second stage and predicted the daily mean PM10 concentrations for each km2 of Italy (2006–2015) in the third stage. The monthly average of PM10 between 2006 and 2009 was linked to each participant’s residential municipality during the month of birth and the 9 months prior to birth. For each child, we calculated the average PM10 concentrations during each trimester of pregnancy and overall.

2.3. Statistical Methods

Descriptive statistics of the characteristics of the children, parents, extent of exposure, and developmental scores have been summarized in tables employing position and variability statistics. Robust multiple linear Mixed-Effects (ME) regression models were used to study the relationship between the levels of PM10 concentration and the developmental level in the domains previously described (motor, adaptive behavior, socio-emotional, cognitive, and communication). Analyses were performed separately for each domain. The models were adjusted for a list of variables, gender, child’s age in months at the DP-3 test date, educational level of the mother/father, type of job of mother/father, number of siblings, and presence of older siblings, that were potentially associated with development. Through a record linkage on the municipality of residence, we considered in the analysis the deprivation index (year of reference: 2001) [33], which combines information at the residential level about low level of education, unemployment rate, lack of home ownership, single-parent family, and high population density. The deprivation index was categorized according to the quintiles of the Italian municipalities. Other indices derived from the 2011 Italian census, specifically the aging index (population >65 years/<14 years) and the residential mobility index (% population changed habitual residence in the last year/resident population), were also considered. The aging index was categorized in tertiles, while the residential mobility index was binary-transformed based on the median value. We employed cubic b-splines to model the age effect to consider the nonlinear contribution of age on the considered developmental domains. A number of basis equal to 7 (six knots equally spaced according to the age distribution at 60, 68.7, 75.0, 78.9, 83.8, and 93.1 months) was chosen as optimal as it minimized the BIC (Bayesian Informative Criterion) index in the General Developmental score. Finally, we evaluated the effect of PM10 concentration (the average recorded during the 9 months before birth and each trimester of pregnancy) on the development of children. The effects of the continuous PM10 changes on the outcomes were estimated for every 13.2 µg/m3 increase in the average of the PM10 concentration, which corresponds to the IQR calculated for the overall PM10 during the pregnancy period. We adopted a robust regression model to account for the presence of heavy tails, outliers, and/or influential observations and the non-bell-shaped marginal distribution of some outcome of interest (Figure 1). The robustness of the estimates was guaranteed by means of the Huber smooth M-estimator (default parameter k = 1.345, s = 10) that yields 95% efficiency for the mean. The model incorporated the presence of two random effects as random intercepts to consider the hierarchical structure of the data collection flow: the type of data collection (questionnaire or interview) and the interviewer’s name.
The influence of the population mobility on the results was tested by a sensitivity analysis, estimating a model that included an interaction term between the residential mobility index and the average prenatal PM10 concentration. The regression models were estimated by means of the R program (version 4.0) and robustlmm packages [34].

3. Results

Table 1 presented a description of the characteristics of the children participating in the study. We included a total of 1157 participants, predominantly male (52.8%) (average age: 76.4 months; standard deviation (SD) = 7.9 months). Almost half of them had an older sibling (43.1%). Only 37.8% of mothers were full-time employees, while 91.2% of the fathers were full-time employees. The educational level of the mothers was slightly higher than that of the fathers (level: 27.2% vs. 18.8%). The children and their parents were mostly Italian (96.7% children; 94.2% and 95.9% mother and father, respectively). Children were predominantly residents of northern Italy (71.5%). Data collection was performed mainly during the year 2014 (62.2%).
Analysis of the Italian deprivation index revealed that children living in areas governed by municipalities were served by good access to services and overall quality of life (deprivation index low or very low: 75.9%). The aging index was high with a median of 145.2% (IQR: 118.7–195.8), and a general low residential mobility was reported (median: 6.26%; IQR: 5.32–6.30).
Among the children under study, the median PM10 concentration was 20.2 µg/m3 (range min-max, 8.5–53.6 µg/m3, Inter Quartile Range (IQR): 13.2 µg/m3) during the 9 months of pregnancy. The PM10 concentration was higher in the Northern Italian municipalities in all the mentioned sub-periods (at birth, during the pregnancy, and in all the trimesters) when compared to the other areas of Italy (p < 0.001, Table 2).
The pairwise correlation between prenatal PM10 concentration and motor and adaptive behavior score was weak (Spearman’s rho: 0.138 and 0.150, respectively), but positive and statistically significant. Prenatal air pollution exposure and other developmental domains were marginally uncorrelated (Figure 2). Among domains, the Cognitive and Communication Scores reported the highest correlation (Spearman’s rho: 0.791).
In the ME regression models, the General Developmental Score reported a decrease of 1.03 points for each IQR increase in PM10 (13.2 µg/m3) during the period of pregnancy, considering several confounding variables (Table 3). The adjusted effect was mainly concentrated during the second trimester (β = −0.72 (95% CI: −1.38, −0.06). The observed decrease in the General Developmental Score was explained by the negative effects of PM10 in the Cognitive (β = −0.73 (95% CI: −1.06, −0.41) and the Communication Score (β = −0.37 (95% CI: −0.66, −0.07).
As for the General Developmental Score, the effect related to the Cognitive and Communication Score was mainly attributed to the increase in PM10 in the second trimester (p = 0.001 and p = 0.018 for the cognitive and communicative domains, respectively). The Cognitive Score was also affected by a strong negative association with the PM10 concentration during the third trimester (β = −0.31 points per 1-IQR PM10 increase (95% CI: −0.50, −0.11)). Scores concerning the Motor, Adaptive Behavior, and Socio-emotional domains did not appear to be influenced by PM10 concentrations during the period of pregnancy. The model related to the Cognitive and Communication Score reported a satisfactory amount of variance explained (~50–60%) as well as that reported for the General Developmental Score.
The effect of PM10 concentrations on the considered developmental domains was adjusted for several covariates (Supplementary Table S1a,b). In addition to the age, other important predictive characteristics considered to determine the overall development were the employment status of the father, the educational level of the mother, and the aging index at the municipality level. Foreign children reported a lower Motor Score with respect to Italian children. A decrease in the Adaptive Score was reported for the children living in low-deprived municipalities compared to those living in a medium deprived municipality.
Results from the sensitivity analyses validated the previously reported relationships between the General Development, Cognitive, and Communication Score. The results highlighted the presence of an inverse relationship between the Motor and Adaptive Scores and the municipalities at different residential mobility (Figure 3). The interaction between Residential Mobility (RM) and prenatal PM10 concentration included in a regression model was significant only for the Motor Score (p = 0.018), indicating that prenatal exposure to PM10 concentration may also influence the motor domain.

4. Discussion

The present study reports a significant negative association between PM10 exposure during pregnancy and overall development in school-age children living in different regions of Italy. PM10 exposure negatively correlated with cognitive and communication developmental domains. Interestingly, significant correlations were observed in children who were exposed to PM10 during the second trimester of gestation. No significant associations were found between the increase in the prenatal air pollution levels and variation in the Motor, Adaptive Behavior, and Socio-Emotional Scores in school-age children, indicating that the effects of PM10 may be limited only to certain developmental domains. However, results from sensitivity analyses revealed a potentially negative effect of exposure on motor development when residential mobility was considered.
The present results are in line with those of previous studies showing a negative correlation between the exposure to air pollutants during the third trimester of pregnancy (particularly PM10, PM2.5, and NO2), and cognitive development during infancy [35,36] and childhood [15,37,38].
The present study, which provided a global approach that considers all the most important developmental domains, extends the knowledge on the effects of prenatal exposure to pollution on the development of children in later stages, indicating a correlation between cognitive and communication development.
The results did not confirm previously reported results, which find a developmental delay in fine motor abilities [18] and behavioral functioning [19]. Hence, further studies are needed to assess the multiple developmental domains to better understand the relationship between exposure to air pollution and different developmental domains. However, results from sensitivity analysis suggest that further links may be discovered by setting up studies that consider other crucial variables such as residential history and daily mobility.
Researchers have also considered the time of the exposure (prenatal, postnatal, or childhood) reporting a growing body of evidence of adverse neurodevelopmental effects of combustion-related pollution during the prenatal window [39]. Our findings confirmed how the second trimester of pregnancy is particularly critical for future cognitive, communicative, and general development. The results reveal by what means exposure to air pollution during this time window can hinder development. In utero, the brain conformation and maturation begin as early as 6 weeks of pregnancy. In the second and third trimesters, the brain undergoes maximum development as a rapid increase in functional connectivity is observed [40] and the adult neuronal cell number is reached [41]. Different regions of the brain form at different times. Thus, the timing of gestational exposure to pollution and their severity may have a different long term impact on brain functioning after birth and the expression of particular developmental delays. The effect of PM10 levels on the cognitive domain was observed in both the second and third trimester of pregnancy. Thus, indicating that this period of rapid maturation the brain might particularly suffer from exposure to PM10. Few researchers examined the effect of trimester-specific windows of susceptibility. Recent literature supports the plausibility of an association between air pollution exposure (during the second and the third trimesters) on the cognitive and attentional domains [42]. Other studies suggested causal models consistent with a third-trimester association with the behavioral domain, in particular, the autism spectrum disorder [43,44]. These associations were explained by the toxicological effects of air pollution on brain development [45].
However, it is important to note that child development is determined by the continuous transactions between both individual and environmental factors. The effects of the combination of these multitude of factors is unique for each child. For example, brain development is a spatial and temporal continuous process that can be affected by specific vulnerability factors such as maternal nutrition, infection, and stress during pregnancy [46]. However, the presence of a family-supportive environment, breastfeeding duration, and the number of older siblings, can work as significant protective factors that help to mitigate the reported detrimental effects on children’s development [47].
In the present study, several possible confounding factors that might have an impact on child development were considered. Our results revealed a significant role of socioeconomic status on child development. Child development was specifically influenced by the maternal level of education, the job status of the father, and the aging index at the municipality level. There is a shared agreement that all these aspects play a significant role in determining children’s performance in all developmental domains [48]. However, even when these effects were controlled, exposure to PM10 significantly impacted the children’s cognitive and communicative functioning. This is of great importance as people living in heavily polluted areas often report greater social and economic deprivation than people living in less polluted areas. For these reasons, the air quality in poor neighborhoods should be controlled to protect children from a potential cumulative effect [49,50].
Our results support previous data that link exposure to air pollutants with low developmental levels in children under conditions of controlled variables such as socioeconomic status. We also report that exposure to PM10 during pregnancy does not affect all developmental domains equally. We conducted a standardized test that assessed child-functioning in a multitude of different domains by means of the same measure to present a complete developmental profile of the affected areas. This is particularly important when considering preventive and supportive measures directed to foster the developmental profile of children exposed to pollution during pregnancy.
Herein, we show that other developmental domains, for example, adaptive behavior, motor development, and socio-emotional functioning, do not seem to be equally affected. It is possible to hypothesize that although exposure to pollution might influence brain development, the development in these areas is significantly influenced by the experiences that the child gains during his early life. Of course, further studies need to be conducted to explore this hypothesis.
There are certain limitations of this study. Air pollution exposure was based on averaged PM10 concentrations at the municipality level. The lack of assessments that consider other pollutants as the NO2 and PM2.5 did not permit the attribution of the estimated effects to a specific source such as vehicle combustion, home heating, and industrial settings [27]. However, PM2.5 represents a significant proportion of PM10, and these two indicators are commonly correlated [27,28]. The attribution of the pollution at municipal level did not permit a consideration of the low-scale variability as well as the presence of important roads, highways, or industrial settings near the house or children’s school. As we considered in the analysis the long-term effects of air pollution, the use of monthly averaged PM10 concentration over a territory appears appropriate and justifiable. As the extent of air pollution was, on average, high in low-income areas and racial/ethnic minority areas, confounding socioeconomic status would tend to produce a bias away from the null. However, we adjusted all the parameters of analyses (parental education, employment status, race/ethnicity of the child, and deprivation index) as a proxy for wealth. The deviations in the results’ PM10 can be attributed to the categories not fully capturing the variation in the socioeconomic status or other related factors such as nutrition or quality of parent-child interactions. One of the limitations of the study includes the limited geographic coverage of the population that may affect the generalizability of results. In addition, we did not collect information about a series of individual characteristics such as the maternal and/or household smoking habit, stress events during pregnancy and at the birth, time spent outside by the mother, and the mother’s job with a risk for occupational exposure during pregnancy. In particular, the lack of information on the residential history may produce a bias in relation to the attributed air pollution. However, the potential bias might have been non-differential with respect to the outcomes, leading to the underestimation of the strength of observed associations [51]. As a support of that, this effect was confirmed by the results obtained from the proposed sensitivity analysis aimed to study the effect of the residential mobility index. A further indication of the goodness of our results was corroborated by the presence of developmental domains that were not associated with air pollution (i.e., adaptive and socio-emotional domains) as reported in the literature [52], constituting a negative control [53]. In the end, the plausibility of having omitted one reported confounder strong enough to drive the estimates related to air pollution exposure to zero was poor [54]. Furthermore, the analysis was enriched by a verification strategy that encompassed a sensitivity analysis and the use of robust regression models including the specification of random effects that helps to keep account of the sampling strategy.

5. Conclusions

Herein, we report the detrimental effect of exposure to PM10 during pregnancy on the cognitive and communicative functioning of school-age children. We assessed child development (using a standardized test) in a number of different domains that, when interconnected, are independent of one another. This multidimensional assessment allows us to better understand which specific developmental domains are more affected by air pollution. It should be noted that the present data do not allow us to conclude that the entire observed effect on children’s cognitive and communicative functioning is solely attributable to PM10 exposure in the second and third trimesters. As a matter of fact, it is more plausible that a mix of pollutants, for which PM10 is a marker, is indeed truly responsible for inducing systemic effects which affect the developing brain. More data should be recorded to better understand the effect of specific pollutants [55]. The PM10 concentration varied from region to region. The effects of PM10 concentration and the dose of exposure on child development on multiple domains were studied. Research should be conducted to assess the grade and the type of impact of pollution on cognitive functioning to identify ways to reduce health and developmental risks that this vulnerable and susceptible fraction of the population is subjected to.

Supplementary Materials

The following are available online at https://www.mdpi.com/article/10.3390/ijerph182111648/s1, Figure S1: Geographical distribution of the children included in the study. Table S1a: Full coefficients estimated by ME model, relative 95% CI, and p-value for Motor, Adaptive, and Socio-emotional Score. Table S1b: Full coefficients estimated by ME model, relative 95% CI, and p-value for Cognitive, Communicative, and General Score.

Author Contributions

Conceptualization, P.G. and S.S.; methodology, P.G., M.S. and S.S.; validation, P.G., S.L. and S.S.; formal analysis, P.G. and S.S.; investigation, P.G., L.Y.M. and S.S.; resources, P.G., S.L. and S.S.; data curation, S.L. and M.S.; writing—original draft preparation, P.G. and S.S.; writing—review and editing, P.G., S.L., L.Y.M., M.S. and S.S.; supervision, P.G. and S.S. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by an unrestricted grant of the Department of Developmental and Social Psychology, University of Padova, grant number BIRD205128 (PI: Paolo Girardi). The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript; or in the decision to publish the results.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Ethics Committee of Department of Developmental and Social Psychology, University of Padova (original protocol code 1359, 2 April 2014; amendment protocol code 4357, 1 October 2021).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The dataset generated during and/or analyzed during the current study is available from the corresponding author upon reasonable request.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Kampa, M.; Castanas, E. Human health effects of air pollution. Environ. Pollut. 2008, 151, 362–367. [Google Scholar] [CrossRef] [PubMed]
  2. Sun, Z.; Zhu, D. Exposure to outdoor air pollution and its human health outcomes: A scoping review. PLoS ONE 2019, 14, e0216550. [Google Scholar] [CrossRef] [PubMed]
  3. Guxens, M.; Garcia-Esteban, R.; Giorgis-Allemand, L.; Forns, J.; Badaloni, C.; Ballester, F.; Beelen, R.; Cesaroni, G.; Chatzi, L.; de Agostini, M.; et al. Air pollution during pregnancy and childhood cognitive and psychomotor development: Six European birth cohorts. Epidemiology 2014, 147, 636–647. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Guxens, M.; Sunyer, J. A review of epidemiological studies on neuropsychological effects of air pollution. Swiss Med. Wkly. 2012, 141, 13322. [Google Scholar]
  5. Suades-González, E.; Gascon, M.; Guxens, M.; Sunyer, J. Air Pollution and Neuropsychological Development: A Review of the Latest Evidence. Epidemiology 2015, 156, 3473–3482. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  6. Clifford, A.; Lang, L.; Chen, R.; Anstey, K.J.; Seaton, A. Exposure to air pollution and cognitive functioning across the life course—A systematic literature review. Environ. Res. 2016, 147, 383–398. [Google Scholar] [CrossRef] [PubMed]
  7. Landrigan, P.J.; Fuller, R.; Acosta, N.J.R.; Adeyi, O.; Arnold, R.; Basu, N.N.; Baldé, A.B.; Bertollini, R.; Bose-O’Reilly, S.; Boufford, J.I.; et al. The Lancet Commission on pollution and health. Lancet 2018, 391, 462–512. [Google Scholar] [CrossRef] [Green Version]
  8. Heyer, D.B.; Meredith, R.M. Environmental toxicology: Sensitive periods of development and neurodevelopmental disorders. NeuroToxicology 2017, 58, 23–41. [Google Scholar] [CrossRef]
  9. Perera, F.P.; Chang, H.W.; Tang, D.; Roen, E.L.; Herbstman, J.; Margolis, A.; Huang, T.J.; Miller, R.L.; Wang, S.; Rauh, V. Early-life exposure to polycyclic aromatic hydrocarbons and ADHD behavior problems. PLoS ONE 2014, 9, e111670. [Google Scholar] [CrossRef] [Green Version]
  10. Peterson, B.S.; Rauh, V.A.; Bansal, R.; Hao, X.; Toth, Z.; Nati, G.; Walsh, K.; Miller, R.L.; Arias, F.; Semanek, D.; et al. Effects of Prenatal Exposure to Air Pollutants (Polycyclic Aromatic Hydrocarbons) on the Development of Brain White Matter, Cognition, and Behavior in Later Childhood. JAMA Psychiatry 2015, 72, 531–540. [Google Scholar] [CrossRef]
  11. Xu, X.; Ha, S.U.; Basnet, R. A Review of Epidemiological Research on Adverse Neurological Effects of Exposure to Ambient Air Pollution. Front. Public Health 2016, 4, 157. [Google Scholar] [CrossRef] [Green Version]
  12. Payne-Sturges, D.C.; Marty, M.A.; Perera, F.; Miller, M.; Swanson, M.; Ellickson, K.; Cory-Slechta, D.A.; Ritz, B.; Balmes, J.; Anderko, L.; et al. Healthy Air, Healthy Brains: Advancing Air Pollution Policy to Protect Children’s Health. Am. J. Public Health 2019, 109, 550–554. [Google Scholar] [CrossRef]
  13. Bateson, T.F.; Schwartz, J. Children’s response to air pollutants. J. Toxicol. Environ. Health Part A 2007, 71, 238–243. [Google Scholar] [CrossRef]
  14. World Health Organization. Effects of Air Pollution on Children’s Health and Development: A Review of the Evidence; WHO: Geneva, Switzerland, 2005. [Google Scholar]
  15. Harris, M.H.; Gold, D.R.; Rifas-Shiman, S.L.; Melly, S.J.; Zanobetti, A.; Coull, B.A.; Schwartz, J.D.; Gryparis, A.; Kloog, I.; Koutrakis, P.; et al. Prenatal and Childhood Traffic-Related Pollution Exposure and Childhood Cognition in the Project Viva Cohort (Massachusetts, USA). Environ. Health Perspect. 2015, 123, 1072–1078. [Google Scholar] [CrossRef] [Green Version]
  16. Sunyer, J.; Esnaola, M.; Alvarez-Pedrerol, M.; Forns, J.; Rivas, I.; López-Vicente, M.; Suades-González, E.; Foraster, M.; Garcia-Esteban, R.; Basagaña, X.; et al. Association between Traffic-Related Air Pollution in Schools and Cognitive Development in Primary School Children: A Prospective Cohort Study. PLoS Med. 2015, 12, e1001792. [Google Scholar] [CrossRef]
  17. Porta, D.; Narduzzi, S.; Badaloni, C.; Bucci, S.; Cesaroni, G.; Colelli, V.; Davoli, M.; Sunyer, J.; Zirro, E.; Schwartz, J.; et al. Air pollution and cognitive development at age seven in a prospective Italian birth cohort. Epidemiology 2015, 27, 228–236. [Google Scholar] [CrossRef]
  18. Lertxundi, A.; Andiarena, A.; Martínez, M.D.; Ayerdi, M.; Murcia, M.; Estarlich, M.; Guxens, M.; Sunyer, J.; Julvez, J.; Ibarluzea, J. Prenatal exposure to PM2.5 and NO2 and sex-dependent infant cognitive and motor development. Environ. Res. 2019, 174, 114–121. [Google Scholar] [CrossRef]
  19. McGuinn, L.A.; Bellinger, D.C.; Colicino, E.; Coull, B.A.; Just, A.C.; Kloog, I.; Osorio-Valencia, E.; Schnaas, L.; Wright, R.J.; Téllez-Rojo, M.M.; et al. Prenatal PM2.5 exposure and behavioral development in children from Mexico City. NeuroToxicology 2020, 81, 109–115. [Google Scholar] [CrossRef]
  20. Kim, E.; Park, H.; Hong, Y.C.; Ha, M.; Kim, Y.; Kim, B.N.; Kim, Y.; Roh, Y.M.; Lee, B.E.; Ryu, J.M.; et al. Prenatal exposure to PM10 and NO2 and children’s neurodevelopment from birth to 24 months of age: Mothers and Children’s Environmental Health (MOCEH) study. Sci. Total Environ. 2014, 481, 439–445. [Google Scholar] [CrossRef]
  21. Forns, J.; Dadvand, P.; Esnaola, M.; Alvarez-Pedrerol, M.; López-Vicente, M.; Garcia-Esteban, R.; Cirach, M.; Basagaña, X.; Guxens, M.; Sunyer, J. Longitudinal association between air pollution exposure at school and cognitive development in school children over a period of 3.5 years. Environ. Res. 2017, 159, 416–421. [Google Scholar] [CrossRef]
  22. Ha, S.; Yeung, E.; Bell, E.; Insaf, T.; Ghassabian, A.; Bell, G.; Muscatiello, N.; Mendola, P. Prenatal and early life exposures to ambient air pollution and development. Environ. Res. 2019, 174, 170–175. [Google Scholar] [CrossRef] [PubMed]
  23. Sentís, A.; Sunyer, J.; Dalmau-Bueno, A.; Andiarena, A.; Ballester, F.; Cirach, M.; Estarlich, M.; Fernández-Somoano, A.; Ibarluzea, J.; Íñiguez, C.; et al. Prenatal and postnatal exposure to NO2 and child attentional function at 4–5 years of age. Environ. Int. 2017, 106, 170–177. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  24. Rivas, I.; Basagaña, X.; Cirach, M.; López-Vicente, M.; Suades-González, E.; Garcia-Esteban, R.; Álvarez-Pedrerol, M.; Dadvand, P.; Sunyer, J. Association between Early Life Exposure to Air Pollution and Working Memory and Attention. Environ. Health Perspect. 2019, 127, 057002. [Google Scholar] [CrossRef] [PubMed]
  25. Fonken, L.K.; Xu, X.; Weil, Z.; Chen, G.; Sun, Q.; Rajagopalan, S.; Nelson, R.J. Air pollution impairs cognition, provokes depressive-like behaviors and alters hippocampal cytokine expression and morphology. Mol. Psychiatry 2011, 16, 987–995. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  26. Volk, H.E.; Lurmann, F.; Penfold, B.; Hertz-Picciotto, I.; McConnell, R. Traffic-Related Air Pollution, Particulate Matter, and Autism. JAMA Psychiatry 2013, 70, 71–77. [Google Scholar] [CrossRef] [PubMed]
  27. Lenschow, P.; Abraham, H.J.; Kutzner, K.; Lutz, M.; Preuß, J.D.; Reichenbächer, W. Some ideas about the sources of PM10. Atmos. Environ. 2001, 35, S23–S33. [Google Scholar] [CrossRef]
  28. Marcazzan, G.M.; Vaccaro, S.; Valli, G.; Vecchi, R. Characterisation of PM10 and PM2.5 particulate matter in the ambient air of Milan (Italy). Atmos. Environ. 2001, 35, 4639–4650. [Google Scholar] [CrossRef]
  29. Alpern, G.D. Developmental Profile 3 (DP-3); Western Psychological Services: Torrance, CA, USA, 2014. [Google Scholar]
  30. Lanfranchi, S.; Vianello, R. DP-3 Developmental Profile 3, Adattamento Italiano; Hogrefe Editore: Firenze, Italy, 2015. [Google Scholar]
  31. Stafoggia, M.; Schwartz, J.; Badaloni, C.; Bellander, T.; Alessandrini, E.; Cattani, G.; Donato, F.D.; Gaeta, A.; Leone, G.; Lyapustin, A.; et al. Estimation of daily PM10 concentrations in Italy (2006–2012) using finely resolved satellite data, land use variables and meteorology. Environ. Int. 2017, 99, 234–244. [Google Scholar] [CrossRef]
  32. Stafoggia, M.; Bellander, T.; Bucci, S.; Davoli, M.; De Hoogh, K.; De’Donato, F.; Gariazzo, C.; Lyapustin, A.; Michelozzi, P.; Renzi, M.; et al. Estimation of daily PM10 and PM2.5 concentrations in Italy, 2013–2015, using a spatiotemporal land-use random-forest model. Environ. Int. 2019, 124, 170–179. [Google Scholar] [CrossRef]
  33. Caranci, N.; Biggeri, A.; Grisotto, L.; Pacelli, B.; Spadea, T.; Costa, G. The Italian deprivation index at census block level: Definition, description and association with general mortality. Epidemiol. Prev. 2011, 34, 167–176. [Google Scholar]
  34. Koller, M. Robustlmm: An R Package for Robust Estimation of Linear Mixed-Effects Models. J. Stat. Softw. 2016, 75, 1–24. [Google Scholar] [CrossRef] [Green Version]
  35. Morales, E.; Julvez, J.; Torrent, M.; de Cid, R.; Guxens, M.; Bustamante, M.; Künzli, N.; Sunyer, J. Association of Early-life Exposure to Household Gas Appliances and Indoor Nitrogen Dioxide With Cognition and Attention Behavior in Preschoolers. Am. J. Epidemiol. 2009, 169, 1327–1336. [Google Scholar] [CrossRef] [Green Version]
  36. Yorifuji, T.; Kashima, S.; Diez, M.H.; Kado, Y.; Sanada, S.; Doi, H. Prenatal Exposure to Traffic-related Air Pollution and Child Behavioral Development Milestone Delays in Japan. Epidemiology 2016, 27, 57–65. [Google Scholar] [CrossRef]
  37. Wang, S.; Zhang, J.; Zeng, X.; Zeng, Y.; Wang, S.; Chen, S. Association of Traffic-Related Air Pollution with Children’s Neurobehavioral Functions in Quanzhou, China. Environ. Health Perspect. 2009, 117, 1612–1618. [Google Scholar] [CrossRef] [Green Version]
  38. Perera, F.P.; Wang, S.; Rauh, V.; Zhou, H.; Stigter, L.; Camann, D.; Jedrychowski, W.; Mroz, E.; Majewska, R. Prenatal Exposure to Air Pollution, Maternal Psychological Distress, and Child Behavior. Pediatrics 2013, 132, e1284–e1294. [Google Scholar] [CrossRef] [Green Version]
  39. Gourley, P. What are the Long-Term Effects of Prenatal Air Pollution Exposure? Evidence from the BHPS. East. Econ. J. 2020, 46, 603–635. [Google Scholar] [CrossRef]
  40. Thomason, M.E.; Dassanayake, M.T.; Shen, S.; Katkuri, Y.; Alexis, M.; Anderson, A.L.; Yeo, L.; Mody, S.; Hernandez-Andrade, E.; Hassan, S.S.; et al. Cross-Hemispheric Functional Connectivity in the Human Fetal Brain. Sci. Transl. Med. 2013, 5, 173ra24. [Google Scholar] [CrossRef] [Green Version]
  41. Dobbing, J.; Sands, J. Quantitative growth and development of human brain. Arch. Dis. Child. 1973, 48, 757–767. [Google Scholar] [CrossRef] [Green Version]
  42. Bansal, E.; Hsu, H.-H.; de Water, E.; Martínez-Medina, S.; Schnaas, L.; Just, A.C.; Horton, M.; Bellinger, D.C.; Téllez-Rojo, M.M.; Wright, R.O. Prenatal PM2.5 exposure in the second and third trimesters predicts neurocognitive performance at age 9–10 years: A cohort study of Mexico City children. Environ. Res. 2021, 202, 111651. [Google Scholar] [CrossRef]
  43. Raz, R.; Roberts, A.; Lyall, K.; Hart, J.E.; Just, A.; Laden, F.; Weisskopf, M.G. Autism Spectrum Disorder and Particulate Matter Air Pollution before, during, and after Pregnancy: A Nested Case–Control Analysis within the Nurses’ Health Study II Cohort. Environ. Health Perspect. 2015, 123, 264–270. [Google Scholar] [CrossRef]
  44. Weisskopf, M.G.; Kioumourtzoglou, M.A.; Roberts, A.L. Air pollution and autism spectrum disorders: Causal or confounded? Curr. Environ. Health Rep. 2015, 2, 430–439. [Google Scholar] [CrossRef]
  45. Costa, L.G.; Cole, T.B.; Coburn, J.; Chang, Y.-C.; Dao, K.; Roque, P. Neurotoxicants Are in the Air: Convergence of Human, Animal, andIn VitroStudies on the Effects of Air Pollution on the Brain. BioMed. Res. Int. 2014, 2014, 736385. [Google Scholar] [CrossRef] [Green Version]
  46. Fitzgerald, E.; Hor, K.; Drake, A.J. Maternal influences on fetal brain development: The role of nutrition, infection and stress, and the potential for intergenerational consequences. Early Hum. Dev. 2020, 150, 105190. [Google Scholar] [CrossRef]
  47. Peyre, H.; Bernard, J.; Hoertel, N.; Forhan, A.; Charles, M.-A.; De Agostini, M.; Heude, B.; Ramus, F. Differential effects of factors influencing cognitive development at the age of 5-to-6 years. Cogn. Dev. 2016, 40, 152–162. [Google Scholar] [CrossRef]
  48. Bradley, R.H.; Corwyn, R.F. Socioeconomic Status and Child Development. Annu. Rev. Psychol. 2002, 53, 371–399. [Google Scholar] [CrossRef] [Green Version]
  49. Forastiere, F.; Stafoggia, M.; Tasco, C.; Picciotto, S.; Agabiti, N.; Cesaroni, G.; Perucci, C.A. Socioeconomic status, particulate air pollution, and daily mortality: Differential exposure or differential susceptibility. Am. J. Ind. Med. 2007, 50, 208–216. [Google Scholar] [CrossRef]
  50. Namdeo, A.; Stringer, C. Investigating the relationship between air pollution, health and social deprivation in Leeds, UK. Environ. Int. 2008, 34, 585–591. [Google Scholar] [CrossRef]
  51. Dominici, F.; Zeger, S.L.; Samet, J.M. A measurement error model for time-series studies of air pollution and mortality. Biostatistics 2000, 1, 157–175. [Google Scholar] [CrossRef] [Green Version]
  52. Kerin, T.; Volk, H.; Li, W.; Lurmann, F.; Eckel, S.; McConnell, R.; Hertz-Picciotto, I. Association Between Air Pollution Exposure, Cognitive and Adaptive Function, and ASD Severity Among Children with Autism Spectrum Disorder. J. Autism Dev. Disord. 2017, 48, 137–150. [Google Scholar] [CrossRef]
  53. Lipsitch, M.; Tchetgen, E.T.; Cohen, T. Negative controls: A tool for detecting confounding and bias in observational studies. Epidemiology 2010, 21, 383. [Google Scholar] [CrossRef]
  54. Tozzi, V.; Lertxundi, A.; Ibarluzea, J.M.; Baccini, M. Causal Effects of Prenatal Exposure to PM2.5 on Child Development and the Role of Unobserved Confounding. Int. J. Environ. Res. Public Health 2019, 16, 4381. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  55. Trentacosta, C.J.; Mulligan, D.J. New directions in understanding the role of environmental contaminants in child development: Four themes. New Dir. Child Adolesc. Dev. 2020, 172, 39–51. [Google Scholar] [CrossRef] [PubMed]
Ijerph 18 11648 g001 550
Figure 1. Distribution of the developmental score by domain of interest.
Figure 1. Distribution of the developmental score by domain of interest.
Ijerph 18 11648 g001
Ijerph 18 11648 g002 550
Figure 2. Pairwise marginal distribution and Spearman’s correlation between average prenatal PM10 concentration and developmental domains (non-parametric correlation test: * p < 0.05).
Figure 2. Pairwise marginal distribution and Spearman’s correlation between average prenatal PM10 concentration and developmental domains (non-parametric correlation test: * p < 0.05).
Ijerph 18 11648 g002
Ijerph 18 11648 g003 550
Figure 3. Predicted developmental scores by average prenatal PM10 concentration for different categories of Residential Mobility (RM) index.
Figure 3. Predicted developmental scores by average prenatal PM10 concentration for different categories of Residential Mobility (RM) index.
Ijerph 18 11648 g003
Table
Table 1. Main characteristics of the children included in the study.
Table 1. Main characteristics of the children included in the study.
CharacteristicsN = 1157
Gender [Male], n (%)611 (52.8)
Age (months), Mean (SD)76.4 (7.9)
Number of Siblings, Median (IQR)1 (0)
Presence of older siblings, n (%)499 (43.1)
Mother employment, n (%)
 Full time437 (37.8)
 Part-time370 (32.0)
 Housewife300 (25.9)
 unemployed/student50 (4.3)
Father employment, n (%)
 Full time1055 (91.2)
 Part-time102 (8.8)
Mother educational level, n (%)
 Low267 (23.1)
 Medium575 (49.7)
 High315 (27.2)
Father educational level, n (%)
 Low374 (32.3)
 Medium566 (48.9)
 High217 (18.8)
Children nationality, n (%)
 Italian1119 (96.7)
 Non-Italian38 (3.3)
Mother nationality, n (%)
 Non-Italian67 (5.8)
 Italian1090 (94.2)
Father nationality, n (%)
 Non-Italian48 (4.1)
 Italian1109 (95.9)
Zone of residence, n (%)
 North827 (71.5)
 Center138 (11.9)
 South and Islands192 (16.6)
Year at the interview, n (%)
 2013437 (37.8)
 2014720 (62.2)
Deprivation Score Index category, n (%)
 Very-low466 (40.3)
 Low412 (35.6)
 Medium118 (10.2)
 High14 (1.2)
 Very-high147 (12.7)
Aging index category, n (%)
 Low [57.1–123]388 (33.5)
 Medium (123–188]383 (33.1)
 High (188–294]386 (33.4)
Residential mobility index category, n (%)
 Low-Medium [3.27–6.26]594 (51.3)
 Medium-High (6.26–9.30]563 (48.7)
Table
Table 2. PM10 concentration at birth and during different periods of pregnancy by zone of residence.
Table 2. PM10 concentration at birth and during different periods of pregnancy by zone of residence.
PM10 Concentration (μg/m3)North
(n = 827)		Center
(n = 138)		South and Islands
(n = 192)		p-Value *
At Birth, Median (SD)36.1 (22.8)27.1 (11.1)23.9 (7.6)<0.001
Prenatal average, Median (SD)36.9 (11.8)29.7 (9.8)25.8 (5.0)<0.001
1st trimester, Median (SD)33.3 (19.6)29.6 (9.1)25.9 (8.4)<0.001
2nd trimester, Median (SD)31.6 (18.4)28.0 (9.7)26.7 (8.3)<0.001
3rd trimester, Median (SD)34.7 (21.2)28.4 (10.3)24.6 (7.7)<0.001
* Kruskal-Wallis test.
Table
Table 3. Adjusted * estimates of the coefficients for PM10 concentration, overall and for each trimester of pregnancy, for each domain of interest by robust ME models. Bold values denote statistical significance at the p < 0.05 level.
Table 3. Adjusted * estimates of the coefficients for PM10 concentration, overall and for each trimester of pregnancy, for each domain of interest by robust ME models. Bold values denote statistical significance at the p < 0.05 level.
Motor ScoreAdaptive ScoreSocio-Emotional Score
PM10
(+13.2 μg/m3)		 β ^ 95% CIp-Value β ^ 95% CIp-Value β ^ 95% CIp-Value
Prenatal average−0.00−0.28–0.270.9840.14−0.25–0.520.494−0.16−0.50–0.190.373
Marginal R2/
Conditional R2		0.202/0.2930.255/0.3050.169/0.227
1st trimester0.04−0.14–0.220.6550.19−0.05–0.420.117−0.04−0.25–0.180.744
2nd trimester−0.03−0.20–0.140.728−0.08−0.30–0.140.465−0.09−0.28–0.100.371
3rd trimester0.01−0.16–0.190.9020.16−0.07–0.390.177−0.00−0.21–0.210.983
Marginal R2/
Conditional R2		0.203/0.2920.261/0.3010.168/0.225
Cognitive ScoreCommunicative ScoreGeneral Score
PM10
(+13.2 μg/m3)		 β ^ 95% CIp-Value β ^ 95% CIp-Value β ^ 95% CIp-Value
Prenatal average−0.73−1.06–−0.41<0.001−0.37−0.66–−0.070.015−1.03−2.19–0.120.080
Marginal R2/
Conditional R2		0.562/0.5970.474/0.5080.485/0.514
1st trimester−0.02−0.22–0.170.8200.02−0.16–0.200.8360.27−0.45–0.990.468
2nd trimester−0.30−0.48–−0.120.001−0.20−0.36–−0.030.018−0.72−1.38–−0.060.032
3rd trimester−0.31−0.50–−0.110.002−0.11−0.29–0.070.228−0.27−0.98–0.450.464
Marginal R2/
Conditional R2		0.567/0.6000.475/0.5090.486/0.516
* Adjusted by age (7 basis of splines), gender, employment status of the mother, employment status of the father, educational level of the mother, educational level of the father, nationality of the children, number of siblings, presence of older siblings, quintile of deprivation index score, tertiles of old-age index.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Girardi, P.; Lanfranchi, S.; Mastromatteo, L.Y.; Stafoggia, M.; Scrimin, S. Association between Exposure to Particulate Matter during Pregnancy and Multidimensional Development in School-Age Children: A Cross-Sectional Study in Italy. Int. J. Environ. Res. Public Health 2021, 18, 11648. https://doi.org/10.3390/ijerph182111648

AMA Style

Girardi P, Lanfranchi S, Mastromatteo LY, Stafoggia M, Scrimin S. Association between Exposure to Particulate Matter during Pregnancy and Multidimensional Development in School-Age Children: A Cross-Sectional Study in Italy. International Journal of Environmental Research and Public Health. 2021; 18(21):11648. https://doi.org/10.3390/ijerph182111648

Chicago/Turabian Style

Girardi, Paolo, Silvia Lanfranchi, Libera Ylenia Mastromatteo, Massimo Stafoggia, and Sara Scrimin. 2021. "Association between Exposure to Particulate Matter during Pregnancy and Multidimensional Development in School-Age Children: A Cross-Sectional Study in Italy" International Journal of Environmental Research and Public Health 18, no. 21: 11648. https://doi.org/10.3390/ijerph182111648

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop