Skip to Content
ChildrenChildren
  • Article
  • Open Access

1 August 2026

18 Pages

Association Between Neonatal Pain Exposure and Neurodevelopmental Outcomes in Very Preterm Infants During the COVID-19 Pandemic: A Retrospective Observational Study

,
,
,
,
and
1
Department of Nursing, Faculty of Life Sciences, Kumamoto University, Kumamoto 862-0976, Japan
2
Division of Neonatology, Perinatal Center, Kumamoto University Hospital, Kumamoto 860-8556, Japan
3
Department of Nursing Science, Graduate School of Biomedical and Health Sciences, Hiroshima University, Hiroshima 734-8553, Japan
4
Department of Diagnostic Imaging Technology, Faculty of Life Sciences, Kumamoto University, Kumamoto 862-0976, Japan
This article belongs to the Section Pediatric Neonatology

Highlights

What are the main findings?
  • COVID-19-related restrictions on parental visits were not associated with neurodevelopment at corrected 18 months and 36 months.
  • Pain exposure during the neonatal period was significantly associated with cognitive development at 36 months.
What is the implication of the main findings?
  • COVID-19-related parental visitation restrictions may not significantly influence early childhood development, but high exposure to pain during the NICU stay may influence developmental delays.
  • Even under pandemic conditions, pain management may remain important for the neurodevelopment of very preterm infants.

Abstract

Background: Research on preterm infant development during the coronavirus disease 2019 (COVID-19) pandemic has yielded inconsistent results and has not considered the impact of exposure to pain. This study aimed to investigate the association between neurodevelopment in very preterm infants and pain exposure during the COVID-19 pandemic. Methods: This retrospective study included very preterm infants born before 33 weeks’ gestation between 2017 and 2022. Their neurodevelopmental status was assessed using the Kyoto Scale of Psychological Development at corrected 18 months (n = 92) and 36 months (n = 82) (n = 35 and 23 during the COVID-19 pandemic, respectively). Results: Multiple regression analysis adjusted for confounding factors showed that the developmental quotient at corrected 18 months was not associated with parental visit frequency or invasive procedure count. At 36 months, it was also not associated with parental visit frequency; however, in the cognitive–adaptive domain, it showed a significant association with the number of invasive procedures (B = −0.10; β = −0.45; 95% confidence interval [−0.76, −0.14]; p = 0.0049). Conclusions: These findings highlight the importance of maintaining neonatal pain management during disease outbreaks to support neurodevelopmental outcomes in very preterm infants.

1. Introduction

Preterm birth is associated with long-term neurodevelopmental disorders; the earlier the birth occurs, the higher the risk [1,2]. In preterm infants, the brain continues to develop in an extrauterine environment, where it is exposed to harmful stimuli that may alter the maturation process. Very preterm infants (<33 weeks’ gestation) admitted to the neonatal intensive care unit (NICU) frequently undergo painful procedures for both treatment and diagnostic purposes [3]. Of note, their nociceptive pathways and descending inhibitory control are still immature, making them highly vulnerable to pain [4]. Repeated exposure to pain during this critical period of rapid and complex brain development adversely affects central nervous system (CNS) maturation [5]. A higher number of skin injuries was found to be associated with a reduction in white and gray matter (i.e., impaired myelination) [6]. Additionally, reductions in white and gray matter resulting from pain exposure during infancy may persist into school age [7]. Increased exposure to pain during infancy has also been associated with poorer neurodevelopmental outcomes in cognitive, motor, and behavioral domains, and this association can persist into adolescence and beyond [8,9].
Meanwhile, parent–infant interaction contributes to reducing stress and promoting development in preterm infants. Kangaroo care during NICU hospitalization promotes maturation of the autonomic nervous system [10] and improve neurodevelopment [11] in preterm infants. However, methods without direct parent–infant contact also have positive effects on preterm infant development. For example, the scent of breast milk [12,13] and recordings of the mother’s voice [14] can stabilize physiological functions and promote development in preterm infants. Therefore, parental presence in the NICU may also contribute to the neurodevelopment of these infants [15]. Conversely, separating parents and infants immediately after birth disrupts the parent–child bond [16,17], undermines mother–infant relationships [18,19], and may adversely affect the child’s development. Amid the coronavirus disease 2019 (COVID-19) pandemic, the World Health Organization encouraged uninterrupted skin-to-skin contact between mothers and infants, including preterm infants, as early as after birth while taking preventive measures against infection [20]. Nevertheless, many NICUs worldwide imposed strict visiting restrictions, including banning or limiting parental visits, for infection control [21], thereby reducing parental care for preterm infants admitted to the NICU [22].
Research findings on developmental outcomes in preterm infants during the COVID-19 pandemic are inconsistent. Some studies have reported impairments in cognitive and language development at 18–36 months of corrected age [23,24], while others have noted maintenance in motor, cognitive and language development at 18–24 months of corrected age [25,26]. Still, motor and cognitive development improvements have been observed at 6–12 months of corrected age [27]. These studies, whose findings are inconsistent, have not considered the association with pain exposure. Exposure to pain during the neonatal period has been reported to impair CNS maturation [5] and cause poorer neurodevelopmental outcomes [8,9]. These adverse effects may last longer [8,9] and seriously impact the development of preterm infants. Therefore, when evaluating the impact of visitation restrictions associated with the COVID-19 pandemic on preterm infant development, the effects of pain exposure should also be considered.
This study could be the first to focus on pain exposure in relation to development among preterm infants during the COVID-19 pandemic. This research aimed to clarify the association between pain exposure, as well as parental visitation restrictions at NICU, during the COVID-19 pandemic and development in preterm infants at corrected 18 months and 36 months.
We hypothesized that the frequency of parental visits would be significantly associated with developmental outcomes at corrected 18 months and 36 months, and that the number of invasive procedures during the neonatal period would likewise be significantly associated with developmental outcomes at these ages. In other words, when accounting for the effects of pain exposure, we anticipated that visitation restrictions imposed during the COVID-19 pandemic would negatively influence early childhood development. The findings of this study offer important insights for developing interventions for this vulnerable population experiencing strict NICU restrictions during the COVID-19 pandemic. They also provide a framework for supporting preterm infant development in future infectious disease outbreaks.

2. Methods

2.1. Study Design

This retrospective study, which adhered to the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) guidelines for observational research [28], was conducted on very preterm infants born in Kumamoto, Japan. Data were extracted from medical records and analyzed from March 2024 to March 2026.

2.2. Participants

This study included very preterm infants (N = 280; gestational age: <33 weeks) born between 2017 and 2022 who were discharged from the Level III NICU at Kumamoto University by 1 May 2023, when COVID-19 was designated as a Category 5 infectious disease in Japan. Of the 280 very preterm infants (Figure 1), 31 were excluded because of the presence of periventricular leukomalacia, grade 3 or 4 intraventricular hemorrhage, maternal depression, nonambulatory cerebral palsy, methylmalonic aciduria, and prenatal infection, because these conditions have been reported to substantially affect neurodevelopmental outcomes [29,30]. We also excluded 59 infants who transferred to other hospitals and 39 who transferred from other hospitals, given the incompleteness in medical record data covering the entire duration of NICU hospitalization. Nine cases of death were also excluded. Out of 142 remaining children, 50 were further excluded because of completion of developmental follow-up; failure to attend the appointment for developmental follow-up; follow-up at other hospitals; failure to undergo assessment because of poor health or a bad mood on the test day; and transfer to another department. A total of 92 children remained for the corrected 18-month developmental assessment and thereby included in the analysis. Of these 92 children, 18 were additionally excluded because of failure to attend the appointment for developmental follow-up, follow-up at other hospitals, and completion of developmental follow-up. Meanwhile, eight infants were re-enrolled for the following reasons: emerging developmental concerns, inability to undergo the modified 18-month follow-up because of poor health or a bad mood on the test day, transfer from another hospital, and unknown reasons. Therefore, 82 children ultimately underwent the 36-month developmental assessment and were thereby included in the analysis.
Figure 1. Participant flowchart.
At the study facility, standard pain management care comprised holding, touching, and facilitated tucking; no oral sucrose was administered. For pharmacological therapy, fentanyl or midazolam was used during scheduled endotracheal intubation; no other medications were used for other procedures. Eutectic mixture of local anesthetics (EMLA) cream and EMLA patches were also not administered.
This study obtained approval from the Kumamoto University Ethics Review Committee (approval number: 2905). Given the study’s retrospective design and utilization of existing clinical data, an opt-out approach was used, with parents provided with an explanation and the opportunity to decline participation. All data were derived from examinations performed as part of routine clinical care, with no procedures conducted specifically for research purposes or beyond standard clinical treatment.

2.3. Demographic and Clinical Data Collection and Neurodevelopmental Outcome Assessment

Y.S., T.S. and one NICU nurse independently reviewed the medical records spanning from birth to NICU discharge and extracted the variables.
Pain during the neonatal period was quantified by the number of invasive procedures. Invasive procedures included heel prick, peripheral and central venous punctures, arterial line insertion, subcutaneous injection, intramuscular injection, drain insertion, endotracheal intubation, nasogastric tube insertion, and fundus examinations [5].
The cumulative intravenous (no oral) doses of fentanyl, morphine, and midazolam were calculated by multiplying the average daily dose, adjusted for body weight, by the number of administration days [31].
Additionally, the following data were recorded: gestational age at birth, sex, birth weight, length of NICU stay, Apgar score, number of siblings, mechanical ventilation duration (in days), number of surgical procedures, and surgical history (including laparotomy, hernia repair, colostomy, labial fusion, patent ductus arteriosus closure, and retinal photocoagulation).
Parental visit frequency, defined as the number of visits relative to the length of hospital stay [32], was also calculated. According to previous research, it is the number of parental visits recorded by clinical staff over the total length of each infant’s hospital stay. When the parental visit frequency was close to 1.0, exceeded 1.0, and was below 1.0, the parent visited almost every day, more than once per day (on average), and less than once per day (on average), respectively. Given that the medical records did not contain sufficient details, parental care during visits was limited to the number of kangaroo care sessions. During the COVID-19 pandemic, parental visitation restrictions were implemented from April 2020 to April 2023. Visits were limited to once a day, once every two days, or once a week, depending on the infection situation. Between January and February 2022, parental visits were completely prohibited and permitted only when deemed necessary by a physician. Each visit was limited to a maximum of 15 min. Mothers hospitalized in the maternity ward of the same hospital were allowed a total of three visits per day, each lasting 15 min or less. For predischarge parenting guidance and direct breastfeeding, parental visits were permitted as many times as necessary, lasting up to 60 min per session. Although online visits were introduced in April 2021, none of the parents of the study participants used this option. Before the pandemic, no restrictions on visit duration or frequency were imposed.
Furthermore, data on mothers’ educational attainment, a factor related to child development, were collected [26]. Maternal education has been associated with stimulating parenting practices and early learning opportunities that support child development [33]. This variable was categorized as “high school graduation or less” or “higher than high school graduation” [26].
Preterm infants’ neurodevelopmental outcomes were assessed using the Kyoto Scale of Psychological Development 2001 (KSPD) [34], which is widely used in Japan. Clinical psychologists administered the KSPD during the follow-up examinations of infants at corrected 18 months and 36 months. The developmental quotient (DQ) derived from the overall, postural–motor, cognitive–adaptive, and language–social domains in KSPD was also used for assessing infants’ neurodevelopmental outcomes. A DQ score below 70, equivalent to a Bayley III cognitive score below 85 [35], indicates a significant developmental delay.

2.4. Data Analysis

Data were analyzed using R statistical software version 4.3.2. To investigate the effects of COVID-19-associated parental visitation restrictions and pain exposure during NICU admission on developmental outcomes in early childhood, we conducted multiple regression analysis. The primary exposure variables were the number of invasive procedures during NICU admission and the frequency of parental visits. On the basis of prior research and clinical findings, we preselected candidate confounding factors associated with both the primary exposure variables and early childhood developmental outcomes. The correlations among the variables were then evaluated using Spearman’s correlation analysis. Variables with a correlation coefficient exceeding 0.8 were evaluated for inclusion in the analytical model while considering potential multicollinearity. Mechanical ventilation duration (in days) strongly correlated with the invasive procedure count (r = 0.8163). In this study, the invasive procedures included endotracheal intubation for mechanical ventilation; therefore, the mechanical ventilation duration was considered to be closely related to the number of invasive procedures. The length of hospital stay also showed a strong correlation (r = 0.9314) with the number of invasive procedures. Consequently, we retained the number of invasive procedures—the primary exposure variable—in the final analysis model and excluded the number of days on mechanical ventilation and the length of NICU stay. Furthermore, birth weight strongly correlated with gestational age (r = 0.8027). In the present study, we used gestational age only because it is a more direct indicator of the infant’s maturity, in line with previous studies [36,37]. In addition, only eight infants received morphine, and all of whom were also receiving fentanyl. Thus, the pharmacokinetic exposure variables used were the cumulative doses of fentanyl and midazolam. Of note, morphine equivalents calculated from a mixture of fentanyl and morphine were not used because this method has not been established for newborns [38]. For the multiple regression analysis, the final independent variables included gestational age at birth [24,25,36,37,39,40,41], sex [40], surgery history during NICU admission [42,43], fentanyl exposure [42,43], midazolam exposure [42], age during the examination [25], and maternal education [26,37,39].
All variance inflation factors (VIFs) were within the acceptable range (VIF < 5). Missing data were handled using complete-case analysis, and preterm infants with missing values for any of the variables were excluded from each analysis. To interpret the associations’ magnitude, we calculated the unstandardized regression coefficients (B) and 95% confidence intervals. Standardized regression coefficients (β) were also calculated to indicate the relative strength of the associations among the explanatory variables. Linearity, homoscedasticity, and normality of residuals showed no significant violations according to the Residuals vs. Fitted plot, Scale–Location plot, Q-Q plot, and the Breusch–Pagan test. The points of influence were evaluated using Cook’s distance, and cases with values exceeding 4/n were identified. Given that the multiple regression analyses were conducted at two time points across four developmental domains, we applied Bonferroni correction, with a p-value < 0.00625 (0.05/8) considered statistically significant.
For sensitivity analyses, we conducted multiple regression analysis by replacing the independent variable “parental visit frequency” with “COVID-19 pandemic status,” which influenced the frequency of family visits, and “kangaroo care frequency,” another indicator of parent–child contact, to verify the analysis results’ robustness. Kangaroo care was assessed using the frequency of kangaroo care [32]. To account for the infant’s pain severity and treatment effects, we conducted sensitivity analyses for the primary analyses of corrected 18 months and 36 months development by adding the following as covariates: mechanical ventilation duration (in days), NICU stay duration (in days), 5 min Apgar score, morphine dose administered, and birth weight. We also conducted multiple regression analyses focusing on preterm infants weighing below 1500 g at birth to verify whether the results were consistent even in this high-severity subgroup. Moreover, a multivariate analysis incorporating the corrected 18-month developmental index into the primary analysis of 36-month development was conducted to evaluate the associations when considering development at corrected 18 months. According to an assessment of influence points, we conducted an analysis excluding cases with a Cook’s distance exceeding 4/n and examined the differences in results between this analysis and the primary analysis.

3. Results

Of the 142 very preterm infants included in the study, 92 (35 during the COVID-19 pandemic) and 82 (23 during the COVID-19 pandemic) underwent developmental assessments at corrected 18 months and 36 months, respectively (Table 1).
Table 1. Demographic data of participants (n = 92).
Regarding background factors, the excluded infants (n = 50) had significantly higher gestational age at birth, birth weight, and 1- and 5 min Apgar scores than the study participants (n = 92). Conversely, NICU stay duration, invasive procedure count during the NICU stay, surgery count during NICU admission, surgery history during NICU admission, endotracheal intubation duration, endotracheal intubation history, fentanyl exposure, midazolam exposure, morphine exposure, parental visit count, parental visit frequency, and kangaroo care sessions were significantly lower in the excluded infants than in the study participants (Table 2).
Table 2. Comparison of demographic data between study participants and excluded infants.

3.1. Results on the Association Between DQ and Parental Visit Frequency and Pain Exposure

Adjusted multiple regression analysis showed no significant associations between DQ at corrected 18 months and parental visit frequency or the number of invasive procedures in any domain (Table 3). However, the regression coefficient for the invasive procedures was negative in the cognitive–adaptive domain.
Table 3. Results of multiple regression analysis on the developmental quotient in the corrected 18-month Kyoto Scale of Psychological Development.
Likewise, the 36-month DQ score was not significantly associated with parental visit frequency in all domains. However, it was significantly associated with the number of invasive procedures in the cognitive–adaptive domain (B = −0.10; β = −0.45; 95% CI [−0.76, −0.14]; p = 0.0049) (Table 4).
Table 4. Results of multiple regression analysis on the developmental quotient in the 36-month Kyoto Scale of Psychological Development.

3.2. Sensitivity Analysis Results

The sensitivity analysis results are presented in the Supplementary Tables S1–S17. In preterm infants with a birth weight below 1500 g (n = 84 for corrected 18 months, n = 75 for 36 months), DQ in the cognitive–adaptive domain at 36 months was significantly associated with the number of invasive procedures (B = −0.12, β = −0.52, p = 0.0021), consistent with the results of the primary analysis (Tables S1 and S2).
The results of analyses wherein mechanical ventilation duration, NICU stay duration, and birth weight were each added to the primary analysis showed no significant association between DQ and either parental visit frequency or the invasive procedure count (Tables S3–S8). The results of adding the 5 min Apgar score to the primary analysis revealed a significant association between DQ in the cognitive–adaptive domain at 36 months and the invasive procedure count (B = −0.10, β = −0.46, p = 0.0058), in line with the primary analysis results (Tables S9 and S10).
In the sensitivity analysis wherein the categories of parental visit frequency and whether the period was before or during the COVID-19 pandemic were swapped, DQ in the cognitive–adaptive domain was significantly associated with the invasive procedure count at 36 months (B = −0.10, β = −0.46, p = 0.0044), consistent with the primary analysis results (Tables S11 and S12). Additionally, in another sensitivity analysis wherein the parental visit frequency was swapped with the kangaroo care frequency, DQ in the cognitive–adaptive domain at 36 months was also significantly associated with the invasive procedure count (B = −0.11, β = −0.49, p = 0.0019) (Tables S13 and S14).
Moreover, the multivariate analysis, which added the corrected 18-month developmental index to the primary analysis of development at 36 months, showed a significant association between the corrected 18-month developmental index and the 36-month DQ; however, neither the parental visit frequency nor the invasive procedure count was significantly associated with the 36-month DQ (Table S15).
According to Cook’s distance evaluation, 5 cases at the 18-month follow-up and 8 cases at the 36-month follow-up exceeded the 4/n threshold, thereby judged as influence points. In a sensitivity analysis excluding these cases, the invasive procedure count remained significantly associated with the DQ in the “overall” domain (B = −0.10, β = −0.48, p = 0.0033) and the cognitive–adaptation domain (B = −0.11, β = −0.51, p = 0.0019) at 36 months (Tables S16 and S17).

4. Discussion

This study revealed that COVID-19-associated parental visitation restrictions did not significantly affect early childhood development, but high exposure to pain during the NICU stay was associated with poorer developmental outcomes. The findings of this study partly diverged from the initial hypothesis. To our knowledge, this research is the first to examine the relationship between pain exposure and developmental outcomes in preterm infants admitted to the NICU during the COVID-19 pandemic.

4.1. Association Between Neonatal Pain Exposure and Delayed Development in Early Childhood

We examined the association between the development of very preterm infants and the effects of pain exposure during the COVID-19 pandemic. The DQ at corrected 18 months and 36 months was not associated with parental visit frequency. In contrast, the number of invasive procedures showed a negative association with the DQ in the cognitive–adaptive domain at corrected 18 months (β = −0.37, p = 0.0336), although this association did not remain statistically significant after adjustment for multiple comparisons. At 36 months, the number of invasive procedures was significantly associated with a lower DQ in the cognitive–adaptive domain (β = −0.45, p = 0.0049). In preterm infants, pain pathways are underdeveloped [4], and repeated exposure to pain during a period of complex and rapid brain development adversely affects CNS development [8]. Similarly, repeated pain stimuli in the NICU affect the developing brain [8]. Repeated pain exposure has been associated with changes in white matter microstructure and metabolic abnormalities in the subcortical gray matter [6]. In addition, changes in white matter microstructure have been linked to subsequent impairments in executive function and cognitive development [44]. The association between pain exposure in infancy and poorer cognitive developmental outcomes in early childhood observed in this study is consistent with previous research [5,8].
In this research, we used the number of invasive procedures as an indicator of pain exposure experienced during the NICU stay and examined its association with developmental outcomes. In the primary analysis, the invasive procedure count was associated with the DQ score in the cognitive–adaptive domain at 36 months; however, this association disappeared in models that were further adjusted for the mechanical ventilation duration and NICU stay duration individually. However, the mechanical ventilation duration and NICU stay duration strongly correlated with the invasive procedure count; when these variables were included in the model, the VIF exceeded 5, suggesting the presence of multicollinearity. Consequently, in the analysis adjusted for the mechanical ventilation duration and NICU stay duration, the independent association with the number of invasive procedures may have been underestimated. Meanwhile, the association between pain exposure during NICU admission and developmental delays in the cognitive–adaptive domain at 36 months was similarly observed in the sensitivity analyses of preterm infants with a birth weight below 1500 g—who were likely to be in severe condition—among the study participants, as well as in the sensitivity analyses incorporating the 5 min Apgar score in the primary analysis. Thus, the association between the invasive procedure count and developmental outcomes may reflect not only the effects of invasive procedures themselves but also the possibility that severity contributed to the observed association. Therefore, the potential influence of severity should also be considered. Nonetheless, because the invasive procedure count is considered to reflect cumulative exposure to invasive procedures during the NICU stay, it may have the potential to serve as an important clinical indicator for assessing the developmental prognosis of preterm infants.
Furthermore, the association between the invasive procedure count and DQ was indicated by an unstandardized regression coefficient (B) of −0.10, suggesting that, after adjusting for other covariates, the DQ decreases by 0.10 points on average for each additional invasive procedure. Preterm infants receive approximately 14 invasive procedures per day during their NICU stay [8] and roughly 643 invasive procedures during the first 4 weeks of their NICU stay [45]. in the present study, the infants received a total of 112.75 ± 66.25 invasive procedures (range: 32–331) throughout their NICU stay. Preterm infants, whose nervous system is still immature, receive more invasive procedures for medical treatment than term infants; consequently, they are at a higher risk for neurodevelopmental abnormalities [46,47]. Therefore, cumulative exposure to pain has a significant impact on developmental delays. Moreover, the number of invasive procedures received by a preterm infant is a factor that can be modified in clinical practice. A study examining the impact of differences in invasive procedure count on development reported that reducing the number of blood draws through the use of an arterial line during NICU admission resulted in higher cognitive scores in early childhood compared with repeatedly inserting a needle for blood extraction [37]. Consequently, the association found in this study between the invasive procedure count during NICU hospitalization and developmental delays in early childhood underscores the importance of minimizing invasive procedures in the NICU as much as possible.

4.2. Relationship Between Parental Visitation Restrictions During the Pandemic and Child Development

Reports on preterm infant development during the COVID-19 pandemic are limited, with inconsistent findings [23,24,25,26,27]. Additionally, their analyses did not consider the effects of pain exposure on the development of this age group. After examining the effects of COVID-19–related parental visitation restrictions on child development while considering the impact of pain exposure, we found that the frequency of parental visits was not associated with DQ scores at the corrected 18-month and 36-month time points. Therefore, parental visitation restrictions may not have significantly affected the early childhood development of preterm infants.
We used “parental visit frequency” as an indicator of visitation restrictions, in line with previous research [32]. However, while parental visit frequency reflects the quantity of parent–infant contact opportunities, it is not a direct indicator of parental visit duration or parent–infant interaction quality. The effects of parent–infant contact on the development of preterm infants are not limited to direct contact, such as kangaroo care. Indirect contact, such as the scent of breast milk [12,13] and the mother’s voice [14], has also been shown to stabilize physiological functions and promote development in preterm infants. Therefore, we used parental visit frequency because it reflects opportunities for both direct and indirect contact between parents and infants. Additionally, at the facility studied, parental visit duration during the COVID-19 pandemic was limited to 15 min or less per visit, whereas the pre-pandemic duration was unrestricted. Additionally, a sensitivity analysis wherein “parental visit frequency” was replaced with “before or during the COVID-19 pandemic” yielded results largely consistent with those of the primary analysis. Based on these results, “parental visit frequency” may be considered an indicator reflecting not only parental visitation restrictions associated with the COVID-19 pandemic but also opportunities for direct and indirect parent–child contact. These findings suggest that parental visitation restrictions associated with the COVID-19 pandemic may not have had a significant impact on the early childhood development of preterm infants.
Pain exposure during the neonatal period may have a detrimental effect on a child’s development regardless of the benefits of parent–child physical contact. A multicenter study compared the internalizing and externalizing problem behaviors at corrected 18 months according to the levels of “infant pain management care” (e.g., pain intervention) and “infant-centered care” (e.g., kangaroo care). Results showed that preterm infants in facilities with a high level of “infant pain management care” had lower internalizing problem scores than those in facilities with a low level [48]. In terms of the level of “infant-centered care,” the internalizing and externalizing problem scores did not differ [48]. These findings support the importance of minimizing painful procedures and optimizing pain management.
Development is influenced by various factors, including not only medical factors and pain exposure during NICU hospitalization but also the caregiving environment after discharge. The effects of early-life experiences on developmental outcomes may also differ depending on the age at which development is assessed. While kangaroo care improves cognitive and motor development between 6 months and corrected 12 months of age [49,50], no improvement in cognitive, motor, or social development has been reported at 24–36 months of age [51,52]. The effect of the COVID-19 pandemic on development in healthy young children can persist at 3 years or older, resulting in developmental delays by age 5 [53]. In the present study, developmental assessments were conducted at corrected ages of 18 months and 36 months. One possible explanation for our findings is that although parental visitation restrictions during the COVID-19 pandemic reduced opportunities for parent–infant contact in the NICU, parent–child interaction after discharge may have increased because of social distancing measures, thereby mitigating potential adverse effects on development. To account for the influence of the post-discharge home environment, maternal educational attainment was included as a covariate in the analysis. After adjustment, the frequency of painful procedures remained significantly associated with developmental outcomes.
These findings suggest that although parental visitation restrictions during the COVID-19 pandemic reduced opportunities for parent–child contact in the NICU, they may not have had a substantial impact on early childhood development. Furthermore, our findings suggest that pain management in the NICU, including reducing the number of skin punctures, may remain important even during infectious disease pandemics.

4.3. Limitations

This study has several limitations. First, the sample size was small, and significant differences in baseline characteristics were observed between the study participants and those who were excluded. The excluded group included many infants with milder clinical characteristics, including higher gestational age and birth weight and lower exposure to invasive procedures and intensive care. These infants had completed developmental follow-up, whereas the study participants generally required prolonged NICU hospitalization and long-term follow-up. Consequently, the study participants were exposed to parental visitation restrictions for a longer period, and this study evaluated a population with relatively prolonged exposure to NICU visitation restrictions. Therefore, selection bias cannot be ruled out, and caution is warranted when generalizing these findings to all preterm infants admitted to the NICU.
Second, some variables contained missing data. Although we conducted the analysis using the available data, the possibility of bias resulting from the missing data cannot be ruled out.
Third, this study was retrospective and observational in design; although we adjusted for several potential confounders, the influence of residual confounding cannot be ruled out. Therefore, a causal relationship between the number of invasive procedures and developmental outcomes cannot be established. Furthermore, while the number of invasive procedures is an indicator of cumulative exposure to such procedures during NICU hospitalization, it is also closely associated with severity. Although infants with severe IVH and PVL were excluded from the study, residual confounding due to unmeasured prematurity-related clinical factors cannot be completely ruled out. Consequently, completely separating the effects of the number of invasive procedures from those attributable to severity was difficult.
Fourth, in line with previous research [32], this study used parental visit frequency as an indicator of parental visitation restrictions associated with the COVID-19 pandemic. As a result, we could not examine the potential impact of parent–child contact quality and duration—factors that cannot be fully captured by parental visit frequency alone—on developmental outcomes.
Nevertheless, to our knowledge, this study is the first to include the effects of pain exposure in the assessment of preterm infant development following the COVID-19 pandemic, thereby providing important insights. Notably, our findings demonstrate the importance of pain management during NICU admission and do not imply acceptance of parental visit restriction during an infectious disease pandemic. In the future, studies using larger samples, multicenter collaborative studies, prospective studies that distinguish more precisely between severity and exposure to invasive procedures, and long-term follow-up studies to examine the effects of COVID-19-related NICU visitation restrictions on development beyond early childhood are warranted.

5. Conclusions

Visitation restrictions during the COVID-19 pandemic were not significantly associated with development among preterm infants. However, high exposure to pain during infancy was associated with poorer developmental outcomes in early childhood. Therefore, these findings highlight the importance of minimizing exposure in the NICU, even during a pandemic.

Supplementary Materials

The following supporting information can be downloaded at https://www.mdpi.com/article/10.3390/children13081024/s1, Supplementary File S1: Sensitivity Analyses.

Author Contributions

Conceptualization, Y.S., T.N., M.K., T.Y. and I.S.; Methodology, T.N.; Data curation, Y.S. and T.S.; Formal analysis, Y.S., M.K. and I.S.; Investigation, Y.S.; Writing—original draft, Y.S.; Writing—review and editing, T.N., M.K., T.Y., T.S. and I.S.; Supervision, I.S. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by JSPS KAKENHI (grant number JP24K20341).

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki and approved by the Kumamoto University Ethics Review Committee (approval number: 2905, date 2 February 2024).

Data Availability Statement

The data presented in this study are available on request from the corresponding author due to participant privacy and institutional ethical restrictions.

Acknowledgments

We extend our sincere gratitude to all the participants and their parents and to Kimitoshi Nakamura, Mihoko Higashi, Shoko Nakamura, Hiroko Kokufu and the nursing staff at Kumamoto University Hospital for their invaluable cooperation in this study. We are also grateful to Yukari Imamura and Momoka Asato for their assistance with data collection.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

The following abbreviations are used in this manuscript:
CNSCentral nervous system
COVID-19Coronavirus disease 2019
EMLAEutectic mixture of local anesthetics
NICUNeonatal intensive care unit
STROBEStrengthening the Reporting of Observational Studies in Epidemiology
GAGestational age
KSPDKyoto Scale of Psychological Development 2001
DQDevelopmental quotient
VIFVariance inflation factor

References

  1. Johnson, S.; Marlow, N. Preterm Birth and Childhood Psychiatric Disorders. Pediatr. Res. 2011, 69, 11–18. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  2. Moore, T.; Hennessy, E.M.; Myles, J.; Johnson, S.J.; Draper, E.S.; Costeloe, K.L.; Marlow, N. Neurological and Developmental Outcome in Extremely Preterm Children Born in England in 1995 and 2006. BMJ. 2012, 345, e7961. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  3. Cruz, M.D.; Fernandes, A.M.; Oliveira, C.R. Epidemiology of Painful Procedures Performed in Neonates: A Systematic Review of Observational Studies. Eur. J. Pain 2016, 20, 489–498. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  4. Hathway, G.J.; Koch, S.; Low, L.; Fitzgerald, M. The Changing Balance of Brainstem–spinal Cord Modulation of Pain Processing over the First Weeks of Rat Postnatal Life. J. Physiol. 2009, 587, 2927–2935. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  5. Boggini, T.; Pozzoli, S.; Schiavolin, P.; Erario, R.; Mosca, F.; Brambilla, P.; Fumagalli, M. Cumulative Procedural Pain and Brain Development in Very Preterm Infants: A Systematic Review of Clinical and Preclinical Studies. Neurosci. Biobehav. Rev. 2021, 123, 320–336. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  6. Brummelte, S.; Grunau, R.E.; Chau, V.; Poskitt, K.J.; Brant, R.; Vinall, J.; Gover, A.; Synnes, A.R.; Miller, S.P. Procedural Pain and Brain Development in Premature Newborns. Ann. Neurol. 2012, 71, 385–396. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  7. Ranger, M.; Chau, C.M.Y.; Garg, A.; Woodward, T.S.; Beg, M.F.; Bjornson, B.; Poskitt, K.; Fitzpatrick, K.; Synnes, A.R.; Miller, S.P.; et al. Neonatal Pain-Related Stress Predicts Cortical Thickness at Age 7 Years in Children Born Very Preterm. PLoS ONE 2013, 8, e76702. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  8. Ranger, M.; Grunau, R.E. Early Repetitive Pain in Preterm Infants in Relation to the Developing Brain. Pain Manag. 2014, 4, 57–67. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  9. Walker, S.M. Long-term Effects of Neonatal Pain. Semin. Fetal Neonatal Med. 2019, 24, 101005. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  10. Feldman, R.; Eidelman, A.I.; Sirota, L.; Weller, A. Skin-to-Skin Contact (Kangaroo Care) Accelerates Autonomic and Neurobehavioural Maturation in Preterm Infants. Dev. Med. Child Neurol. 2003, 45, 274–281. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  11. Head, L.M. The Effect of Kangaroo Care on Neurodevelopmental Outcomes in Preterm Infants. J. Perinat. Neonatal Nurs. 2014, 28, 290–299. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  12. Baudesson de Chanville, A.; Brevaut-Malaty, V.; Garbi, A.; Tosello, B.; Baumstarck, K.; Gire, C. Analgesic Effect of Maternal Human Milk Odor on Premature Neonates: A Randomized Controlled Trial. J. Hum. Lact. 2017, 33, 300–308. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  13. Badiee, Z.; Asghari, M. The Calming Effect of Maternal Breast Milk Odor on Premature Infants. Pediatr. Neonatol. 2013, 54, 322–325. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  14. Provenzi, L.; Broso, S.; Montirosso, R. Do Mothers Sound Good? A Systematic Review of the Effects of Maternal Voice Exposure on Preterm Infants’ Development. Neurosci. Biobehav. Rev. 2018, 88, 42–50. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  15. Mann, P.C.; Stansfield, B.K. Optimal Presence: Enhancing Parent Integration to Maximize Neurodevelopmental Outcomes in Preterm Infants. Pediatr. Res. 2024, 96, 1445–1453. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  16. Flacking, R.; Lehtonen, L.; Thomson, G.; Axelin, A.; Ahlqvist, S.; Moran, V.H.; Ewald, U.; Dykes, F. Closeness and Separation in Neonatal Intensive Care. Acta. Paediatr. 2012, 101, 1032–1037. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  17. Welch, M.G.; Ludwig, R.J. Calming Cycle Theory and the Co-regulation of Oxytocin. Psychodyn. Psychiatr. 2017, 45, 519–540. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  18. Johnson, K. Maternal-infant Bonding: A Review of Literature. Int. J. Childbirth Edu. 2013, 28, 17–22. [Google Scholar]
  19. Cena, L.; Biban, P.; Janos, J.; Lavelli, M.; Langfus, J.; Tsai, A.; Youngstrom, E.A.; Stefana, A. The Collateral Impact of COVID-19 Emergency on Neonatal Intensive Care Units and Family-Centered Care: Challenges and Opportunities. Front. Psychol. 2021, 12, 630594. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  20. World Health Organization. Clinical Management of COVID-19: Interim Guidance; World Health Organization: Geneva, Switzerland, 2020. [Google Scholar]
  21. Kostenzer, J.; von Rosenstiel-Pulver, C.; Hoffmann, J.; Walsh, A.; Mader, S.; Zimmermann, L.J.I. Parents’ Experiences Regarding Neonatal Care During the COVID-19 Pandemic: Country-specific Findings of a Multinational Survey. BMJ Open 2022, 12, e056856. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  22. Ozawa, M.; Sakaki, H.; Meng, X. Family Presence Restrictions and Telemedicine Use in Neonatal Intensive Care Units During the Coronavirus Disease Pandemic. Children 2021, 8, 590. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  23. Kim, H.; Jang, Y.H.; Lee, J.Y.; Lee, G.Y.; Sung, J.Y.; Kim, M.J.; Lee, B.G.; Yang, S.; Kim, J.; Yoon, K.S.; et al. Impact of COVID−19 Pandemic on Neurodevelopmental Outcome in Very Low Birth Weight Infants: A Nationwide Cohort Study. Front. Pediatr. 2024, 12, 1368677. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  24. Ohama, N.; Suga, S.; Watanabe, S.; Tanaka, K.; Kusuhara, K. Neurodevelopmental Outcomes in Preterm Infants at 18 Months of Corrected Age Following Coronavirus Disease 2019 (COVID-19) Pandemic-Related Neonatal Intensive Care Unit (NICU) Care Changes. Cureus 2025, 17, e80266. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  25. Lau, M.; Kraus, V.; Schulze, A.F.; Rausch, T.K.; Krüger, M.; Göpel, W. Observational Study on the Neonatal Outcome During the COVID-19 Pandemic in Germany. Acta. Paediatr. 2023, 112, 1892–1897. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  26. Ömercioğlu, E.; Mert Karakaya, E.N.; Özdemir, G.; Şencan Karakuş, B.; Kılınç, Ş.; İskender, H.C.; Cihan Çam, E.; Mete Yeşil, A.; Çelik, H.T.; Karahan, S.; et al. Has the COVID-19 Pandemic Negatively Impacted Children’s Development? an Assessment of the Neurodevelopment of Premature Babies Born During the Pandemic. Turk. J. Pediatr. 2024, 66, 275–286. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  27. Tseng, T.-C.; Wang, T.-M.; Hsu, Y.-C.; Hsu, C.-T.; Lin, Y.-H.; Lin, M.-C. Impact of COVID-19 Pandemic on Neurodevelopmental Outcomes of Premature Infants: A Retrospective National Cohort Study. BMJ Paediatr. Open. 2024, 8, e002493. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  28. von Elm, E.; Altman, D.G.; Egger, M.; Pocock, S.J.; Gøtzsche, P.C.; Vandenbroucke, J.P. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement: Guidelines for Reporting Observational Studies. J. Clin. Epidemiol. 2008, 61, 344–349. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  29. Inder, T.E.; Volpe, J.J.; Anderson, P.J. Defining the Neurologic Consequences of Preterm Birth. N. Engl. J. Med. 2023, 389, 441–453. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  30. Fan, X.; Wu, N.; Tu, Y.; Zang, T.; Bai, J.; Peng, G.; Liu, Y. Perinatal Depression and Infant and Toddler Neurodevelopment: A Systematic Review and Meta-Analysis. Neurosci. Biobehav. Rev. 2024, 159, 105579. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  31. Grunau, R.E.; Whitfield, M.F.; Petrie-Thomas, J.; Synnes, A.R.; Cepeda, I.L.; Keidar, A.; Rogers, M.; MacKay, M.; Hubber-Richard, P.; Johannesen, D. Neonatal Pain, Parenting Stress and Interaction, in Relation to Cognitive and Motor Development at 8 and 18 Months in Preterm Infants. Pain 2009, 143, 138–146. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  32. Scala, M.; Marchman, V.A.; Brignoni-Pérez, E.; Chan Morales, M.; Dubner, S.E.; Travis, K.E. Impact of the COVID-19 Pandemic on Developmental Care Practices for Infants Born Preterm. Early Hum. Dev. 2021, 163, 105483. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  33. Cuartas, J. The Effect of Maternal Education on Parenting and Early Childhood Development: An Instrumental Variables Approach. J. Fam. Psychol. 2022, 36, 280–290. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  34. Ikuzawa, M.; Matsushita, Y.; Nakase, A. Shinpan K Shiki Hattatsu Kensahou 2001 Nenban (The Kyoto Scale of Psychological Development Test); Kyoto International Social Welfare Exchange Center: Kyoto, Japan, 2002. [Google Scholar]
  35. Kono, Y.; Yonemoto, N.; Kusuda, S.; Hirano, S.; Iwata, O.; Tanaka, K.; Nakazawa, J. Developmental Assessment of VLBW Infants at 18 months of Age: A Comparison Study Between KSPD and Bayley III. Brain Dev. 2016, 38, 377–385. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  36. Tortora, D.; Severino, M.; Biase, C.D.; Malova, M.; Parodi, A.; Minghetti, D.; Traggiai, C.; Uccella, S.; Boeri, L.; Morana, G. Early Pain Exposure Influences Functional Brain Connectivity in Very Preterm Neonates. Front. Neurosci. 2019, 13, 899. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  37. Duerden, E.G.; Grunau, R.E.; Chau, V.; Groenendaal, F.; Guo, T.; Chakravarty, M.M.; Benders, M.; Wagenaar, N.; Eijsermans, R.; Koopman, C.; et al. Association of Early Skin Breaks and Neonatal Thalamic Maturation: A Modifiable Risk? Neurology 2020, 95, e3420–e3427. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  38. Ing, M.C.; Keane, O.A.; Lakshmanan, A.; Kim, E.; Lee, H.C.; Kelley-Quon, L.I. Opioid Equipotency Conversions for Hospitalized Infants: A Systematic Review. J. Perinatol. 2024, 44, 1709–1718. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  39. Giordano, V.; Deindl, P.; Gal, E.; Unterasinger, L.; Fuiko, R.; Steinbauer, P.; Weninger, M.; Berger, A.; Olischar, M. Pain and Neurodevelopmental Outcomes of Infants Born Very Preterm. Dev. Med. Child. Neurol. 2023, 65, 1043–1052. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  40. Schneider, J.; Duerden, E.G.; Guo, T.; Ng, K.; Hagmann, P.; Bickle Graz, M.; Grunau, R.E.; Chakravarty, M.M.; Hüppi, P.S.; Truttmann, A.C.; et al. Procedural Pain and Oral Glucose in Preterm Neonates: Brain Development and Sex-Specific Effects. Pain 2018, 159, 515–525. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  41. Vinall, J.; Miller, S.P.; Synnes, A.R.; Grunau, R.E. Parent Behaviors Moderate the Relationship between Neonatal Pain and Internalizing Behaviors at 18 Months of Corrected Age in Children Born Very Prematurely. Pain 2013, 154, 1831–1839. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  42. Zwicker, J.G.; Miller, S.P.; Grunau, R.E.; Chau, V.; Brant, R.; Studholme, C.; Liu, M.; Synnes, A.; Poskitt, K.J.; Stiver, M.L.; et al. Smaller Cerebellar Growth and Poorer Neurodevelopmental Outcomes in Very Preterm Infants Exposed to Neonatal Morphine. J. Pediatr. 2016, 172, 81–87.e2. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  43. McLean, M.A.; Ranger, M.; Bone, J.N.; Selvanathan, T.; Au-Young, S.H.; Chau, C.M.Y.; Chau, V.; Ly, L.; Kelly, E.; Synnes, A.; et al. Neonatal Sucrose and Internalizing Behaviors at 18 Months in Children Born Very Preterm. JAMA Netw. Open 2025, 8, e254477. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  44. Thompson, D.K.; Lee, K.J.; Egan, G.F.; Warfield, S.K.; Doyle, L.W.; Anderson, P.J.; Inder, T.E. Regional White Matter Microstructure in Very Preterm Infants: Predictors and 7-Year Outcomes. Cortex 2014, 52, 60–74. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  45. Cong, X.; Wu, J.; Vittner, D.; Xu, W.; Hussain, N.; Galvin, S.; Fitzsimons, M.; McGrath, J.M.; Henderson, W.A. The Impact of Cumulative Pain/Stress on Neurobehavioral Development of Preterm Infants in the NICU. Early Hum. Dev. 2017, 108, 9–16. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  46. Bhutta, A.T.; Cleves, M.A.; Casey, P.H.; Cradock, M.M.; Anand, K.J.S. Cognitive and Behavioral Outcomes of School-Aged Children Who Were Born Preterm: A Meta-Analysis. JAMA 2002, 288, 728–737. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  47. Marlow, N.; Wolke, D.; Bracewell, M.A.; Samara, M.; EPICure Study Group. Neurologic and Developmental Disability at Six Years of Age after Extremely Preterm Birth. N. Engl. J. Med. 2005, 352, 9–19. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  48. Montirosso, R.; Casini, E.; Del Prete, A.; Zanini, R.; Bellù, R.; Borgatti, R. Neonatal Developmental Care in Infant Pain Management and Internalizing Behaviors at 18 Months in Prematurely Born Children. Eur. J. Pain 2016, 20, 1010–1021. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  49. Tessier, R.; Cristo, M.B.; Velez, S.; Giron, M.; Nadeau, L.; Figueroa de Calume, Z.; Ruiz-Paláez, J.G.; Charpak, N. Kangaroo Mother Care: A Method for Protecting High-risk Low-birth-weight and Premature Infants Against Developmental Delay. Infant Behav. Dev. 2003, 26, 384–397. [Google Scholar] [CrossRef] [Scilit]
  50. Lazarus, M.F.; Marchman, V.A.; Brignoni-Pérez, E.; Dubner, S.; Feldman, H.M.; Scala, M.; Travis, K.E. Inpatient Skin-to-skin Care Predicts 12-month Neurodevelopmental Outcomes in Very Preterm Infants. J. Pediatr. 2024, 274, 114190. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  51. Kristoffersen, L.; Støen, R.; Bergseng, H.; Flottorp, S.T.; Magerøy, G.; Grunewaldt, K.H.; Aker, K. Immediate Skin-to-skin Contact in Very Preterm Neonates and Early Childhood Neurodevelopment: A Randomized Clinical Trial. JAMA Netw. Open. 2025, 8, e255467. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  52. Lode-Kolz, K.; Jonas, W.; Hetland, H.B.; Hovland Instebø, K.H.; Tokvam, H.; Pike, H.; Lilliesköld, S.; Klemming, S.; Linnér, A.; Ådén, U.; et al. Immediate Skin-to-skin Contact at Very Preterm Birth and Neurodevelopment the First Two Years: Secondary Outcomes from a Randomised Clinical Trial. Children 2025, 12, 986. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  53. Sato, K.; Fukai, T.; Fujisawa, K.K.; Nakamuro, M. Association Between the COVID-19 Pandemic and Early Childhood Development. JAMA Pediatr. 2023, 177, 930–938. [Google Scholar] [CrossRef] [Scilit] [PubMed]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Article Metrics

Citations

Article Access Statistics

Multiple requests from the same IP address are counted as one view.