Next Article in Journal
Caregiver Perspectives on Patient Participation in Biological Pediatric Cancer Research
Previous Article in Journal
Diagnostic Performance of Height-Estimated Baseline Creatinine in Diagnosing Acute Kidney Injury in Children with Type 1 Diabetes Mellitus Onset
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Children
Volume 9
Issue 6
10.3390/children9060900
children-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Parent-Reported Perceived Cognitive Functioning Identifies Cognitive Problems in Children Who Survived Neonatal Critical Illness

by
Yerel Ilik
1,
Hanneke IJsselstijn
1,
Saskia J. Gischler
1,
Annabel van Gils-Frijters
1,2,
Johannes M. Schnater
1 and
Andre B. Rietman
1,2,*
1
Department of Pediatric Surgery and Intensive Care, Erasmus MC Sophia Children’s Hospital, Dr. Molewaterplein 40, 3015 GD Rotterdam, The Netherlands
2
Department of Child and Adolescent Psychiatry/Psychology, Erasmus MC Sophia Children’s Hospital, Dr. Molewaterplein 40, 3015 GD Rotterdam, The Netherlands
*
Author to whom correspondence should be addressed.
Children 2022, 9(6), 900; https://doi.org/10.3390/children9060900
Submission received: 9 May 2022 / Revised: 6 June 2022 / Accepted: 14 June 2022 / Published: 16 June 2022
Browse Figures
Review Reports Versions Notes

Abstract

Children with congenital anatomical foregut anomalies and children treated with neonatal extracorporeal membrane oxygenation (ECMO) are at risk for neurocognitive morbidities. We evaluated the association between the parent-reported pediatric perceived cognitive functioning (PedsPCF) questionnaire and the parent-reported behavior rating inventory of executive function (BRIEF) as well as neuropsychological assessments (NPA). We included 8-, 12- and 17-year-old participants who had joined a prospective follow-up program between 2017 and 2019. Self- and parental proxy-reported PedsPCF and proxy-reported BRIEF scores and their mutual association were evaluated. In total, 168 participants were included. Self- and proxy-reported PedsPCF scores were significantly below normal (mean (SD) z-score: −0.35 (0.88), p < 0.001; −0.36 (1.06), p < 0.001, respectively). Total BRIEF scores were significantly above normal (mean (SD) z-score 0.33 (0.98), p < 0.001). Proxy-reported PedsPCF scores and the Metacognition Index subscores of the BRIEF correlated strongly (τ = 0.551, p < 0.001). Self-reported PedsPCF scores were not associated with NPA test scores. Proxy-reported PedsPCF scores were positively associated with multiple NPA test scores, especially intelligence (R2 = 0.141). The proxy-reported PedsPCF revealed cognitive problems more often than the BRIEF in school-aged children who had survived neonatal critical illness. The proxy-reported PedsPCF may support clinical decision-making regarding the need for extensive neuropsychological assessments.

1. Introduction

Survival rates for children born with a congenital anatomical anomaly such as a congenital diaphragmatic hernia (CDH) or esophageal atresia (EA) have increased over the years [1]. The introduction of extracorporeal membrane oxygenation (ECMO) has improved survival rates of neonates suffering from severe respiratory failure [2]. This decrease in mortality, however, has resulted in an increase in long-term morbidity. Previous research has shown that these children generally have an intelligence within the range of the reference population, but show memory and attention deficits at school age [3,4,5,6,7,8,9]. These deficits are suggested to be the cause of a common neurodevelopmental pathway causing hippocampal alterations, irrespective of underlying diagnosis, induced by common conditions associated with neonatal critical illness such as hypoxia, neuroinflammation, and exposure to anesthetics [10].
A longitudinal follow-up program for children with congenital anomalies and/or those treated with neonatal ECMO is being run in our tertiary level hospital since 1999. The program includes standardized screening of physical health, motor function, cognition, executive functioning, and quality of life at set ages [9,11,12,13,14]. In previous studies, neuropsychological assessments (NPA) revealed that children born with EA, CDH, and those treated with neonatal ECMO have problems in attention, memory, and executive functioning [3,4,5,6,7,8,9].
Results of NPA at school age can facilitate early recognition of neurodevelopmental deficits and therefore offer the opportunity for timely intervention. However, NPA are labor-intensive and time-consuming, and instruments that are more efficient for assessing neurocognitive development are being sought. Lai and coworkers developed the pediatric perceived cognitive functioning questionnaire (PedsPCF) to screen for neurocognitive deficits in children with cancer [15,16]. This 30-item questionnaire evaluates perceived cognitive functioning by the child (self-rating) or the parent (proxy-rating). Lai and coworkers suggested that research to evaluate the PedsPCF clinical usefulness should focus on the association between the PedsPCF and tests that objectively measure cognitive function [15]. In 2019, a Dutch version of the PedsPCF was validated [17]. This 10-item Dutch version correlated strongly (r = 0.94, p = <0.001) with the scores of the 30-item form [17]. Several clinical studies have used the PedsPCF to measure cognitive functioning in pediatric patients. For children born with giant omphalocele, multiple congenital anomalies or gastroschisis, the PedsPCF scores appeared to be lower than those of their healthy matched controls, indicating poorer cognitive functioning [18,19]. The PedsPCF also differentiated between different leukoencephalopathy grades for children with brain tumors [20].
Nevertheless, research focusing on the association between the PedsPCF and NPA is still limited. To our knowledge, only one study described the association between the self-reported and proxy-reported PedsPCF with neuropsychological testing results, and showed almost no significant correlation for children with minimal hepatic encephalopathy [21].
We aimed to evaluate the additional value of the PedsPCF within our follow-up program for children with congenital foregut anatomical anomalies and/or neonatal ECMO treatment by assessing the association between the PedsPCF and the frequently used behavior rating inventory of executive function (BRIEF) [22,23] and the association between the PedsPCF and NPA.

2. Materials and Methods

2.1. Participants

In this observational cohort study, we included participants of our prospective longitudinal follow-up program who underwent NPA at 8, 12, or 17 years and who themselves and/or their parents filled in the PedsPCF between September 2017 and December 2019. We excluded children who could not be assessed with standardized instruments due to genetic syndromes affecting neurocognitive development or due to severe neurodevelopmental impairment. The local Medical Ethics Review Board waived approval (‘Medical Research in Human Subjects Act does not apply to this research proposal’; MEC-2016-111).

2.2. Data Collection

We collected data on diagnosis, gestational age, birth weight, duration of initial ventilation, and hospital stay from electronic medical records. PedsPCF, BRIEF, NPA, and school functioning were all administered at one follow-up moment at 8, 12, or 17 years of age. Parents completed the PedsPCF and the BRIEF questionnaires in the waiting room, whereas the children completed the PedsPCF during their assessment with the psychologist. All children underwent NPA by a licensed developmental psychologist. At 8 years, a full intelligence assessment was completed using the WISC-III-NL [24]. At 12 years of age, intelligence was measured with an abbreviated version of the WISC-III-NL, and at 17 years of age, intelligence was assessed using the WAIS-IV-NL [25,26]. During each assessment, attention, verbal memory, visuospatial memory, visuospatial processing, and executive functioning were also tested, by applying validated neuropsychological tests [24,25,26,27,28,29,30,31,32,33]. During a semi-structured interview, the psychologist collected information on the child’s school performance regarding level, grade, and extra help at school.

2.3. Measures

The Dutch version of the PedsPCF consists of 30 items and assesses various neurocognitive domains including memory, attention, and executive functioning. Since previous analyses pointed out that the PedsPCF is unidimensional, there is just a single Peds-PCF score [16,17]. A high raw PedsPCF score represents better perceived cognitive functioning [15]. To compare total scores of the 30-item form with those of the 10-item form, the 10-item scores were extracted from the completed PedsPCF afterwards. The BRIEF consists of 75 questions and provides next to a total score, scores for two subscales, the Behavior Regulation Index (BRI) and the Metacognition Index (MCI). The BRI captures the rated child’s ability to shift cognitive set and modulate emotions and behavior via appropriate inhibitory control. The MI reflects the rated child’s ability to initiate, plan, organize, self-monitor, and sustain working memory. For the BRIEF, higher scores represent worse functioning. To facilitate comparisons, we reversed these scores such that lower scores represent worse functioning [22,23]. Reference population data for the questionnaires and NPA were obtained from large population samples, and if available, from the Dutch population. School functioning was recorded by the psychologist and categorized as: regular—no learning disabilities, no remedial teaching, regular education; regular with help—learning disabilities and/or remedial teaching, regular education; special education—school for children with learning disabilities and/or behavioral disorders. Intelligence, attention, verbal and visuospatial memory, and executive functioning were measured using validated Dutch tests (Table S1: Overview of neuropsychological assessments, Supplementary B: Description of neuropsychological assessments).

2.4. Data Analyses

If responses to 6 or more questions from the 30-item PedsPCF were missing, scores were excluded for further analysis. If less than six items were missing at random, the scores for those items were calculated by mean imputation. If responses to 2 or more questions of the extracted 10-item short version were missing, scores were excluded for further analysis. BRIEF and PedsPCF raw scores were first converted into t-scores using Dutch normative values (mean t-score = 50, SD = 10) and then converted into z-scores (mean z-score = 0, SD = 1).
Scores on the intelligence scale are represented by standard scores (population mean M = 100, SD = 15). NPA results were converted into z-scores (mean z-score = 0, SD = 1). If necessary, z-scores were inverted so that a higher score always indicated better performance. To limit the number of extreme negative outliers in Dot Cancellation test and Stroop test scores, these scores were truncated to −3. Z-scores lower than or equal to −1 were regarded as likely to represent impaired cognitive functioning [15,28].
In descriptive statistics, categorical variables are presented as number (%), continuous variables as mean (SD), and non-normally distributed continuous variables as median (IQR).
Total self-reported and proxy-reported PedsPCF scores, total BRIEF scores, BRI, MCI, school functioning, and NPA outcomes were compared with normative data using one-sample t-tests and chi-squared tests for comparing means and proportions. To assess the utility of the PedsPCF, we determined the association between PedsPCF and BRIEF and the association between PedsPCF and NPA. To compare the PedsPCF with the BRIEF, total scores and subscale scores were analyzed using Kendall’s tau correlation. Simple linear regressions were performed to analyze the association between the PedsPCF and tests of the standardized NPA that represent subdomains measuring concepts comparable to the concepts underlying the PedsPCF [16].
One-way analysis of variance (ANOVA) or Kruskal–Wallis ANOVA was used to analyze the relation between school functioning and PedsPCF and BRIEF scores. To assess the association of the 10-item PedsPCF and the 30-item PedsPCF, scores were compared using Kendall’s tau correlation. Subgroup analyses were performed using ANOVA or Kruskal–Wallis ANOVA. Corresponding to the statistical methods, effect sizes were calculated according to Cohen’s d, r, and Cohen’s f, which resulted in the following interpretations [34]:
  • Cohen’s d (= mean–population mean/sample SD): small = 0.2, medium = 0.5, large = 0.8.
  • r (= standardized test statistic/√N): small = 0.1, medium = 0.3, large = 0.5.
  • Cohen’s f (= (√η2/1 − η2)): small = 0.1, medium = 0.25, large = 0.4.
  • Strengths of the Kendall tau correlation coefficients were interpreted as followed [35]: τ: weak = 0.1, moderate = 0.4, strong = 0.7.
Statistical analyses were performed using SPSS V.25.0. All statistical tests were performed two-sided with a significance level of 0.05.

3. Results

3.1. Participants

In total, 168 children were included, quite equally divided over the assessment ages of 8, 12, and 17 years (Table 1) (p = 0.272). Of the included children, 134 self-reports and 159 proxy-reports were analyzed. The prevalence of children in this cohort attending special education was twice as high as compared to the Dutch reference population (χ2 = 7.701, p = 0.006) [36,37].

3.2. Questionnaire Outcomes

In total, 134 children had sufficient time during the neuropsychological assessment to complete the self-reported PedsPCF, resulting in a response rate of 80%. The proxy-reported PedsPCF and the BRIEF were completed by 160 parents (95%).
Total self- and proxy-reported PedsPCF scores were significantly lower in our study population than in the reference population (both p < 0.001; Table 2). Total BRIEF z-scores were significantly higher than the norm data (p < 0.001). For the self-reported PedsPCF, the proportion of children with scores lower than or equal to −1 SD was 22%. For the proxy-reported PedsPCF, this was 30%. For the parent-rated BRIEF, only 9% of the scores were lower than or equal to −1 SD. Only two parents reporting low BRIEF scores (13%) reported PedsPCF scores within the normal range. However, of the seven children whose parents reported executive functioning problems (i.e., BRIEF scores below −1 SD), three considered their cognitive functioning as normal (i.e., total score PedsPCF self-report above −1 SD). When looking at the different age groups (children of 8, 12, or 17 years old), no significant differences were found regarding total PedsPCF scores (self-reported: F = 0.098, p = 0.907; parent-reported: F = 0.324, p = 0.724).

3.3. Associations of PedsPCF with BRIEF, Outcomes of NPA, and School Functioning

Self-reported PedsPCF scores correlated significantly but weakly with all three BRIEF scores (total BRIEF: τ = 0.265, p < 0.001; BRI: τ = 0.205, p = 0.001; MCI: τ = 0.263, p < 0.001). For proxy-reported PedsPCF, correlations were stronger and significant for all three BRIEF scores, resulting in weak to moderate correlations (total BRIEF: τ = 0.552, p < 0.001; BRI: τ = 0.366, p < 0.001; MCI: τ = 0.551, p < 0.001). For the correlations between the proxy-reported PedsPCF and BRIEF scores, we refer to Figure 1.
Overall, intelligence was not significantly different from that of the norm population (p = 0.951; Table 3). The outcomes of NPA in different subgroups are shown in Supplemental Table S2.
Simple linear regression analyses did not reveal any variable that was significantly associated with the total self-reported PedsPCF score (Table S3: Simple regressions per variable for self-reported PedsPCF). Table 4 presents the simple linear regressions performed for total proxy-reported PedsPCF scores. Total IQ was most prominently associated with total proxy-reported PedsPCF score with R2 = 0.141 (p < 0.001). For all tested subdomains of cognition, multiple variables appeared to be significantly related with the total proxy-reported PedsPCF score with medium to large effect sizes. The assumptions for performing simple linear regressions were checked beforehand [38].
Figure 2 shows clustered box plots of total self-and proxy-reported PedsPCF scores and total BRIEF scores for the three categories of school functioning. Interestingly, children attending special education reported higher self-reported PedsPCF scores than children in the category ‘regular’ or ‘regular with help’, but Kruskal–Wallis ANOVA showed no statistically significant differences (H = 4.605, p = 0.100, Cohen’s f = 0.19). For proxy-reported PedsPCF scores, statistically significant differences between the different school functioning categories were found with a medium effect size (H = 16.991, p < 0.001, Cohen’s f = 0.35) with a lower PedsPCF score for children who needed additional help at school or attended special education. Total BRIEF scores also differed significantly for the different school functioning categories but with a small effect size in the same direction (F = 4.082, p = 0.019, Cohen’s f = 0.23).

3.4. Associations of 30- and 10-Item PedsPCF

For the 30- and 10-item versions of the PedsPCF, Kendall’s tau correlation was significant for self- and proxy-reported scores with a strong association (self-reported: τ = 0.801, p = 0.000; proxy-reported: τ = 0.837, p < 0.001). The association between the 30-item and 10-item PedsPCF is shown in Figure S1.

4. Discussion

We performed this study to assess the additional value of the PedsPCF in the follow-up for children with anatomical foregut anomalies and/or those who were treated with neonatal ECMO. We compared PedsPCF and BRIEF scores with population norm data and examined their mutual association as well as the association between PedsPCF and NPA scores. Our study population scored significantly lower on the self- and proxy-reported PedsPCF compared to normative data. The proxy-rated BRIEF scores, however, were significantly higher than the norm scores. As the mean z-score was 0.33, we regarded this difference not to be clinically relevant. Self-reported PedsPCF scores were all weakly associated with BRIEF scores and not associated with NPA test scores or level of school functioning. Next to this, weak to moderate correlations between proxy-reported PedsPCF and BRIEF scores were found, suggesting their overlap but also their complementarity when mapping the perceived cognitions of these patients. Total proxy-reported PedsPCF scores were significantly associated with multiple NPA test scores. These findings suggest that the proxy-reported PedsPCF in particular can provide a first insight into the child’s neurocognitive performance. Since the 10-item form correlated good with the 30-item form, the short form may already provide sufficient information.
For children born with congenital anatomical malformations, lower scores on the PedsPCF compared to scores of healthy controls have been found in previous studies [18,19]. The moderate correlation found in the present study between the proxy-reported PedsPCF and Metacognition Index score of the proxy-reported BRIEF is similar to that found in a pilot study by Ohnemus and coworkers [21]. This moderate relation could be assigned to the partly overlapping neurocognitive domain investigated in that pilot study, i.e., executive functioning, and the fact that both questionnaires are proxy-reported. On the other hand, the weak correlations between the PedsPCF and the BRIEF’s Behavior Regulation Index subscale could indicate that this particular part of the BRIEF measures additional information that is different from and possibly complementary to the PedsPCF. However, since our study population did not have deficient scores on the BRIEF, it could be argued that the BRIEF is less suitable for detecting cognitive problems in this particular clinical group.
In line with previous research, our study group as a whole had an average IQ within the normal range and showed significantly lower scores on multiple NPA tests [3,4,5,6,7,8,9]. To our current knowledge, only one previous study has explored the associations between the PedsPCF and NPA [21]. In this study, no significant correlation between the PedsPCF and neuropsychological testing for children with minimal hepatic encephalopathy was found, except for a positive association of self-reported PedsPCF scores with one attention test score (r = −0.70) [21]. The discrepancy between this study and the current study may be due to differences in severity of illness and age of onset; generally, children with minimal hepatic encephalopathy were and are less critically ill and are older than children who suffered from neonatal critical illness [10,39]. Another explanation may be that we assessed a broader range of neuropsychological tasks. Nevertheless, we found no association between self-reported PedsPCF and NPA variables, suggesting that, unlike the proxy-reported PedsPCF, the self-reported PedsPCF cannot be used as a screening tool for cognitive problems.
The weak correlation between proxy-reported PedsPCF scores and NPA outcomes found in the present study suggests that some children overestimate themselves and others underestimate themselves with regard to their objectively measured performance. However, the self-reported PedsPCF may still provide additional information about the self-perceived cognitive problems of these children in everyday life. Parents’ perception appears to be more consistent with objectively measured cognitive functions. The absence of associations between pediatric self-reports and clinical outcomes has been described before [14]. We believe that early recognition of neurocognitive problems is important, even when these problems do not seem to affect functioning in everyday life, since school-aged children cannot yet see the potential impact.
With respect to school functioning, scores on the proxy-reported questionnaires appear to be in line with the ordinal levels, i.e., decreasing scores for children in the categories ‘regular with help’ and ‘special’. This finding suggests that the child’s school functioning level is reflected in parent-reported perceived cognitive functioning, which may be regarded as a validation of the proxy-reported PedsPCF. Mean total BRIEF scores across all levels were higher than mean proxy-reported PedsPCF scores, suggesting that the information from the parent-perceived PedsPCF in addition to the BRIEF provides useful information about a child’s cognitive functioning. Mean self-reported PedsPCF scores did not follow the different levels of school functioning. Interestingly, children attending special education scored the highest compared to the children with the other school functioning levels. This tendency for children with learning disabilities to overrate their cognitive abilities is a phenomenon that has been named ‘positive illusionary bias’ [40].
Strengths of our study include the large sample size in view of the rare diagnoses, the structured follow-up, the analysis of both proxy- and self-reported PedsPCF, and the inclusion of multiple neuropsychological tests. Our study not only has clinical implications but may also be instrumental to achieving international multicenter collaborations for the cross-cultural validation of standardized instruments [41].
Some limitations should be discussed. Firstly, some data from the questionnaires and the NPA were missing mainly due to organizational reasons and lack of time, seeing that the children had several assessments on a single day. Although the missing data might have caused an underestimation of the mean neuropsychological test scores and may have affected the associations between the PedsPCF and NPA scores, we assume that the relatively small number of missing data will not have biased the conclusions. Secondly, due to the exploratory nature of this study, we did not correct for multiple testing, which could have resulted in a type 1 error. However, even when correcting for multiple testing (with alpha/10 = 0.005), the majority of the results remain significant, preserving our conclusion. Furthermore, the school functioning category ‘regular with help’ is a very broadly defined concept that is probably more applicable to children in primary education than in secondary education in the Netherlands. To investigate the relation between school functioning level and the PedsPCF, other measurements, such as school test scores or teacher opinions, are necessary. Finally, the extraction of 10 items from the 30-item version of the PedsPCF to create a 10-item version may have resulted in an overestimation of the correlation coefficient.
In summary, we conclude that the proxy-reported PedsPCF reveals perceived cognitive problems for children who survived neonatal critical illness. In our population, the proxy-reported PedsPCF detected different and more cognitive problems than the proxy-reported BRIEF. Since there also appears to be a moderate correlation between the proxy-reported PedsPCF and the BRIEF, one might consider administering the PedsPCF instead of the BRIEF during follow-up, unless a more complete mapping of the perceived cognitive abilities is preferred. The proxy-reported PedsPCF can be used internationally to provide a first screening of these children’s cognitive functioning. With regard to clinical decision-making, the total proxy-reported PedsPCF scores can support the indication for extensive neuropsychological testing—and, therefore, could be a cost-effective implication. In the future, the short version of the PedsPCF may well become standard.
The self-reported PedsPCF proved not to be associated with outcomes from the NPA but can give complementary information about the cognitive problems these children experience in everyday life. We propose to implement a roadmap in which children scoring lower than or equal to −1 SD on the proxy-reported PedsPCF are referred for more detailed assessments (Figure S2: Flowchart). Considering the results of our study, one-third of the children would have been referred. For children whose parents report total PedsPCF scores higher than −1 SD, NPA may be considered after evaluation of anamnestic information from parents and teachers. Future studies should focus on exploring which specific anamnestic information is most informative to establish the need for detailed NPA, but should also focus on the cost-effectiveness of this approach.

Supplementary Materials

The following are available online at https://www.mdpi.com/article/10.3390/children9060900/s1, Supplementary A: Table S1. Overview of neuropsychological assessments; Table S2. Outcomes of neuropsychological assessments in different subgroups; Table S3. Simple regressions per variable for self-reported PedsPCF; Figure S1. Association between 30-item and 10-item PedsPCF; Figure S2. Flowchart triage prior to neuropsychological assessment; Supplementary B. Descriptions of the neuropsychological assessments.

Author Contributions

Conceptualization, Y.I., H.I., A.v.G.-F. and A.B.R.; Data curation, H.I. and A.B.R.; Formal analysis, Y.I. and A.B.R.; Investigation, Y.I., H.I., S.J.G., A.v.G.-F. and A.B.R.; Methodology, Y.I., H.I. and A.B.R.; Project administration, H.I., A.v.G.-F. and A.B.R.; Resources, H.I.; Software, Y.I.; Supervision, A.B.R.; Validation, Y.I., H.I., A.v.G.-F. and A.B.R.; Visualization, Y.I. and A.B.R.; Writing—original draft, Y.I.; Writing—review & editing, Y.I., H.I., S.J.G., J.M.S., A.v.G.-F. and A.B.R. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Ethical review and approval were waived for this study, due to ‘Medical Research in Human Subjects Act does not apply to this research proposal’; MEC-2016-111.

Informed Consent Statement

Patients’ consent was waived due to the retrospective nature of this study. Parents and patients were routinely informed that data were used for research purposes.

Data Availability Statement

Data presented in this study are available on reasonable request from the corresponding author.

Acknowledgments

Ko Hagoort provided editorial advice.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Glinianaia, S.V.; Morris, J.K.; Best, K.E.; Santoro, M.; Coi, A.; Armaroli, A.; Rankin, J. Long-term survival of children born with congenital anomalies: A systematic review and meta-analysis of population-based studies. PLoS Med. 2020, 17, e1003356. [Google Scholar] [CrossRef] [PubMed]
  2. UK collaborative randomised trial of neonatal extracorporeal membrane oxygenation. UK Collaborative ECMO Trail Group. Lancet 1996, 348, 75–82. [CrossRef]
  3. Harmsen, W.J.; Aarsen, F.J.; Zijp, M.H.M.va.; van Rosmalen, J.M.; Wijnen, R.M.H.; Tibboel, D.; IJsselstijn, H. Developmental problems in patients with oesophageal atresia: A longitudinal follow-up study. Arch. Dis. Child. Fetal Neonatal Ed. 2017, 102, F214–F219. [Google Scholar] [CrossRef] [PubMed]
  4. Leeuwen, L.; Schiller, R.M.; Rietman, A.B.; van Rosmalen, J.; Wildschut, E.D.; Houmes, R.J.M.; Tibboel, D.; IJsselstijn, H. Risk Factors of Impaired Neuropsychologic Outcome in School-Aged Survivors of Neonatal Critical Illness. Crit. Care Med. 2018, 46, 401–410. [Google Scholar] [CrossRef] [PubMed]
  5. Madderom, M.J.; Reuser, J.J.; Utens, E.M.; van Rosmalen, J.; Raets, M.; Govaert, P.; Steiner, K.; Gischler, S.J.; Tibboel, D.; van Heijst, A.F.J.; et al. Neurodevelopmental, educational and behavioral outcome at 8 years after neonatal ECMO: A nationwide multicenter study. Intensive Care Med. 2013, 39, 1584–1593. [Google Scholar] [CrossRef]
  6. Madderom, M.J.; Schiller, R.M.; Gischler, S.J.; van Heijst, A.F.; Tibboel, D.; Aarsen, F.K.; IJsselstijn, H. Growing Up After Critical Illness: Verbal, Visual-Spatial, and Working Memory Problems in Neonatal Extracorporeal Membrane Oxygenation Survivors. Crit. Care Med. 2016, 44, 1182–1190. [Google Scholar] [CrossRef]
  7. Madderom, M.J.; Toussaint, L.; Zijp, M.H.M.v.-d.C.-v.; Gischler, S.J.; Wijnen, R.M.; Tibboel, D.; IJsselstijn, H. Congenital diaphragmatic hernia with(out) ECMO: Impaired development at 8 years. Arch. Dis. Child. Fetal Neonatal Ed. 2013, 98, F316–F322. [Google Scholar] [CrossRef]
  8. Mazer, P.; Gischler, S.J.; Zijp, M.H.M.V.D.C.-V.; Tibboel, D.; Bax, N.M.; IJsselstijn, H.; Dijk, M.V.A.N.; Duivenvoorden, H.J. Early developmental assessment of children with major non-cardiac congenital anomalies predicts development at the age of 5 years. Dev. Med. Child Neurol. 2010, 52, 1154–1159. [Google Scholar] [CrossRef]
  9. Schiller, R.M.; Madderom, M.J.; Reuser, J.J.; Steiner, K.; Gischler, S.J.; Tibboel, D.; van Heijst, A.F.J.; IJsselstijn, H. Neuropsychological Follow-up After Neonatal ECMO. Pediatrics 2016, 138, e20161313. [Google Scholar] [CrossRef] [PubMed]
  10. Schiller, R.; IJsselstijn, H.; Hoskote, A.; White, T.; Verhulst, F.; van Heijst, A.; Tibboel, D. Memory deficits following neonatal critical illness: A common neurodevelopmental pathway. Lancet Child Adolesc. Health 2018, 2, 281–289. [Google Scholar] [CrossRef]
  11. Gischler, S.J.; Mazer, P.; Duivenvoorden, H.J.; van Dijk, M.; Bax, N.M.; Hazebroek, F.W.; Tibboel, D. Interdisciplinary structural follow-up of surgical newborns: A prospective evaluation. J. Pediatr. Surg. 2009, 44, 1382–1389. [Google Scholar] [CrossRef] [PubMed]
  12. IJsselstijn, H.; Gischler, S.J.; Wijnen, R.M.H.; Tibboel, D. Assessment and significance of long-term outcomes in pediatric surgery. Semin. Pediatr. Surg. 2017, 26, 281–285. [Google Scholar] [CrossRef]
  13. IJsselstijn, H.; Gischler, S.J.; Toussaint, L.; Spoel, M.; Zijp, M.H.; Tibboel, D. Growth and development after oesophageal atresia surgery: Need for long-term multidisciplinary follow-up. Paediatr. Respir. Rev. 2016, 19, 34–38. [Google Scholar] [CrossRef] [PubMed][Green Version]
  14. Sreeram, I.I.; Ten Kate, C.A.; van Rosmalen, J.; Schnater, J.M.; Gischler, S.J.; Wijnen, R.M.H.; IJsselstijn, H.; Rietman, A.B. Patient-Reported Outcome Measures and Clinical Outcomes in Children with Foregut Anomalies. Children 2021, 8, 587. [Google Scholar] [CrossRef] [PubMed]
  15. Lai, J.S.; Butt, Z.; Zelko, F.; Cella, D.; Krull, K.R.; Kieran, M.W.; Goldman, S. Development of a parent-report cognitive function item bank using item response theory and exploration of its clinical utility in computerized adaptive testing. J. Pediatr. Psychol. 2011, 36, 766–779. [Google Scholar] [CrossRef]
  16. Lai, J.S.; Zelko, F.; Butt, Z.; Cella, D.; Kieran, M.W.; Krull, K.R.; Magasi, S.; Goldman, S. Parent-perceived child cognitive function: Results from a sample drawn from the US general population. Childs Nerv. Syst. 2011, 27, 285–293. [Google Scholar] [CrossRef]
  17. Marchal, J.P.; de Vries, M.; Conijn, J.; Rietman, A.B.; IJsselstijn, H.; Tibboel, D.; Haverman, L.; Maurice-Stam, H.; Oostrom, K.J.; Grootenhuis, M.A. Pediatric Perceived Cognitive Functioning: Psychometric Properties and Normative Data of the Dutch Item Bank and Short Form. J. Int. Neuropsychol. Soc. 2019, 25, 845–856. [Google Scholar] [CrossRef]
  18. Hijkoop, A.; Rietman, A.B.; Wijnen, R.M.H.; Tibboel, D.; Cohen-Overbeek, T.E.; van Rosmalen, J.; IJsselstijn, H. Omphalocele at school age: What do parents report? A call for long-term follow-up of complex omphalocele patients. Early Hum. Dev. 2019, 137, 104830. [Google Scholar] [CrossRef] [PubMed]
  19. Hijkoop, A.; Rietman, A.B.; Wijnen, R.M.H.; Tibboel, D.; Cohen-Overbeek, T.E.; van Rosmalen, J.; IJsselstijn, H. Gastroschisis at school age: What do parents report? Eur. J. Pediatr. 2019, 178, 1405–1412. [Google Scholar] [CrossRef]
  20. Lai, J.S.; Bregman, C.; Zelko, F.; Nowinski, C.; Cella, D.; Beaumont, J.J.; Goldman, S. Parent-reported cognitive function is associated with leukoencephalopathy in children with brain tumors. Qual. Life Res. 2017, 26, 2541–2550. [Google Scholar] [CrossRef]
  21. Ohnemus, D.; Neighbors, K.; Sorensen, L.G.; Lai, J.S.; Alonso, E.M. A Pilot Study of a Screening Tool for Pediatric Minimal Hepatic Encephalopathy. J. Pediatr. Gastroenterol. Nutr. 2019, 69, 655–661. [Google Scholar] [CrossRef] [PubMed]
  22. Gioia, G.A.; Isquith, P.K.; Guy, S.C.; Kenworthy, L. Behavior Rating Inventory of Executive Function BRIEF: Professional Manual; Psychological Assessment Resources(PAR): Lutz, FL, USA, 2000. [Google Scholar]
  23. Smidts, D.P.; Huizinga, M. BRIEF Behavior Rating Inventory of Executive Function-Manual 2. Norms (Dutch: Executieve Functies Gedragsvragenlijsten: Handleiding), 4-23; Hogrefe: Amsterdam, The Netherlands, 2009. [Google Scholar]
  24. Kort, W.; Schittekatte, M.; Dekker, P.H.; Verhaeghe, P.; Compaan, E.L.; Bosmans, M.; Vermeir, G. WISC-III NL Wechsler Intelligence Scale for Children. Handleiding en Verantwoording [Dutch version of the WISC-III], 3rd ed.; Harcourt Test Publishers/Nederlands Instituut voor Psychologen: Amsterdam, The Netherlands, 2005. [Google Scholar]
  25. Pearson. WAIS-IV-NL, Nederlandstalige berwerking. In Technische Handleiding; Pearson Assessment & Information: Amsterdam, The Netherlands, 2012. [Google Scholar]
  26. Pearson. WAIS-IV-NL, Nederlandstalige bewerking. In Afname En Scoringshandleiding; Pearson Assessment & Information: Amsterdam, The Netherlands, 2012. [Google Scholar]
  27. Emslie, H.; WIlson, F.C.; Burden, V. Behavioral Assessment of the Dysexecutive Syndrome for Children (BADS-C), Dutch Version; Amsterdam Harcourt: Amsterdam, The Netherlands, 2006. [Google Scholar]
  28. Lezak, M.D.; Howieson, D.B.; Loring, D.W. Neuropsychological Assessment, 4th ed; Oxford University Press: Oxford, UK, 2004. [Google Scholar]
  29. Schmand, B.; Houx, P.; De Koning, I. Dutch Norms for STROOP Color-Word Test, Trail Making Test, Rey Auditory Verbal-Learning Test, Verbal Fluency, and Story Recall of Rivermead Behavioural Memory Test; Division Neuropsychology of the Dutch Institute for Psychology: Amsterdam, The Netherlands, 2003. [Google Scholar]
  30. van den Burg, W.; Kingma, A. Performance of 225 Dutch school children on Rey’s Auditory Verbal Learning Test (AVLT): Parallel test-retest reliabilities with an interval of 3 months and normative data. Arch. Clin. Neuropsychol. 1999, 14, 545–559. [Google Scholar] [PubMed]
  31. Vos, P. Bourdon-Vos. Handleiding (Manual Dot Cancellation Test); Swets en Zeitlinger: Lisse, The Netherlands, 1992. [Google Scholar]
  32. Watanabe, K.; Ogino, T.; Nakano, K.; Hattori, J.; Kado, Y.; Sanada, S.; Ohtsuka, Y. The Rey-Osterrieth Complex Figure as a measure of executive function in childhood. Brain Dev. 2005, 27, 564–569. [Google Scholar] [CrossRef] [PubMed]
  33. Wechsler, D.; Naglieri, J.A. Wechsler Nonverbal Scale of Ability; Pearson: San Antonio, TX, USA, 2006. [Google Scholar]
  34. Cohen, J. Statistical Power Analysis for the Behavioral Sciences, 2nd ed; Lawrence Erlbaum Associates: New York, NY, USA, 1988. [Google Scholar]
  35. Akoglu, H. User’s guide to correlation coefficients. Turk J. Emerg. Med. 2018, 18, 91–93. [Google Scholar] [CrossRef]
  36. Goyal, S.; Park, A.; Zeglam, A.; Brown, H.; Pemberton, J.D. Choroidal Ganglioneuroma and Orbital Plexiform Neurofibroma Presenting as Buphthalmos in an Infant With Neurofibromatosis Type 1. Ophthalmic. Plast Reconstr. Surg. 2016, 32, e87–e89. [Google Scholar] [CrossRef] [PubMed]
  37. White, S.; Marquez de Prado, B.; Russo, A.F.; Hammond, D.L. Heat hyperalgesia and mechanical hypersensitivity induced by calcitonin gene-related peptide in a mouse model of neurofibromatosis. PLoS ONE 2014, 9, e106767. [Google Scholar]
  38. Petrie, A.; Sabin, C. Medical Statistics at a Glance, 3rd ed; Wiley-Blackwell: Oxford, UK, 2009. [Google Scholar]
  39. Bone, M.F.; Feinglass, J.M.; Goodman, D.M. Risk factors for acquiring functional and cognitive disabilities during admission to a PICU*. Pediatr. Crit. Care Med. 2014, 15, 640–648. [Google Scholar] [CrossRef] [PubMed]
  40. Heath, N.L.; Glen, T. Positive illusory bias and the self-protective hypothesis in children with learning disabilities. J. Clin. Child Adolesc. Psychol. 2005, 34, 272–281. [Google Scholar] [CrossRef] [PubMed]
  41. IJsselstijn, H.; Breatnach, C.; Hoskote, A.; Greenough, A.; Patel, N.; Capolupo, I.; Morini, F.; Scharbatke, H.; Kipfmueller, F.; Ertresvag, K.; et al. Defining outcomes following congenital diaphragmatic hernia using standardised clinical assessment and management plan (SCAMP) methodology within the CDH EURO consortium. Pediatr. Res. 2018, 84, 181–189. [Google Scholar] [CrossRef]
Children 09 00900 g001
Figure 1. Association between proxy-reported BRIEF and proxy-reported PedsPCF scores. PedsPCF = pediatric perceived cognitive functioning, BRIEF = behavior rating inventory of executive function.
Figure 1. Association between proxy-reported BRIEF and proxy-reported PedsPCF scores. PedsPCF = pediatric perceived cognitive functioning, BRIEF = behavior rating inventory of executive function.
Children 09 00900 g001
Children 09 00900 g002
Figure 2. Total PedsPCF and BRIEF z-scores per level of school functioning. PedsPCF = pediatric perceived cognitive functioning, BRIEF = behavior rating inventory of executive function. Y-axis: levels of school functioning. Box-whisker plots represent the different questionnaires with the median, IQR, maximum and minimum scores (three positive outliers with total self-reported PedsPCF scores for children attending regular education are not shown).
Figure 2. Total PedsPCF and BRIEF z-scores per level of school functioning. PedsPCF = pediatric perceived cognitive functioning, BRIEF = behavior rating inventory of executive function. Y-axis: levels of school functioning. Box-whisker plots represent the different questionnaires with the median, IQR, maximum and minimum scores (three positive outliers with total self-reported PedsPCF scores for children attending regular education are not shown).
Children 09 00900 g002
Table 1. Demographic and clinical characteristics of 168 participants.
Table 1. Demographic and clinical characteristics of 168 participants.
Demographic Characteristics
Sex
Male99 (59%)
Female69 (41%)
Clinical characteristics
Diagnosis
CDH57 (34%)
without ECMO treatment46 (81%)
with ECMO treatment11 (19%)
EA54 (32%)
CLM20 (12%)
Neonatal ECMO, non-CDH37 (22%)
Gestational age (weeks)39.0 (37.1–40.4)
Birth weight (grams)3150 (2725–3530)
Duration of initial hospital stay (days)22 (13–48)
Duration of initial ventilation (days)7 (2–16)
At follow-up
Age at assessment
8 years57 (34%)
12 years64 (38%)
17 years47 (28%)
School functioning
Regular130 (78%)
Regular with help22 (13%)
Special educational needs14 (8%)
Missing2 (1%)
Data are presented as number (%) or median (IQR). CDH = congenital diaphragmatic hernia, ECMO = extracorporeal membrane oxygenation, EA = esophageal atresia, CLM = congenital lung malformations.
Table 2. Self- and proxy-reported scores on perceived cognitive functioning and proxy-reported scores on executive functioning compared to population means.
Table 2. Self- and proxy-reported scores on perceived cognitive functioning and proxy-reported scores on executive functioning compared to population means.
MeasurementMean (SD)p-ValueEffect Size (d/r)
Self-reportedPedsPCF 30-item−0.35 (0.88)<0.0010.40 1
Proxy-reportedPedsPCF 30-item−0.36 (1.06)<0.0010.33 1
Total BRIEF0.33 (0.98)<0.0010.34 2
BRI0.37 (0.97)<0.0010.35 1
MCI0.26 (0.96)0.0010.27 2
Data are presented as mean z-scores (SD) (mean = 0, SD = 1). PedsPCF = pediatric perceived cognitive functioning, BRIEF = behavior rating inventory of executive function, BRI = Behavior Regulation Index, MCI = Metacognition Index. 1 One sample Wilcoxon signed rank test. Effect size = r. 2 One sample t-test. Effect size = Cohen’s d.
Table 3. Norm data comparison neuropsychological assessments.
Table 3. Norm data comparison neuropsychological assessments.
VariableMean (SD)p-ValueEffect Size (d/r)
IntelligenceTotal IQ100 (18)0.9510.00 2
AttentionTMTA t0.30 (1.15)<0.001 ***0.37 1
Stroop IF−0.23 (1.19)0.0510.16 1
DCT-ST−0.93 (1.28)<0.001 ***0.60 1
DCT-SD−1.17 (1.52)<0.001 ***0.60 1
Verbal MemoryTotal Digit Span0.04 (1.00)0.5650.04 1
RAVLT total−0.35 (1.26)<0.001 ***0.28 2
RAVLT recall−0.64 (1.38)<0.001 ***0.40 1
Visuospatial MemoryWNV-SS total−0.21 (0.92)0.004 **0.23 2
WNV-SS forward−0.07 (1.04)0.2980.08 1
RCFT immediate−0.62 (1.23)<0.001 ***0.42 1
RCFT delayed−0.76 (1.26)<0.001 ***0.51 1
RCFT recognition−0.08 (1.21)0.9330.01 1
Executive FunctioningBADS-C Key Search0.18 (1.10)0.0520.15 1
BADS-C Modified Six Elements−0.48 (0.81)<0.001 ***0.50 1
TMTB t0.09 (1.08)0.013 *0.20 1
WNV-SS backwards−0.29 (0.86)<0.001 ***0.35 1
PSI−0.04 (1.13)0.6200.04 2
Most data are presented as mean z-scores (SD) (mean = 0, SD = 1). Total IQ is presented as standard scores (mean = 100, SD = 15). IQ = Intelligence Quotient, TMTA t = Trail Making Test Section A time, Stroop IF = Stroop interference factor, DCT-ST = Dot Cancellation Test series time, DCT-SD = Dot Cancellation Test standard deviation series time, RAVLT: Rey Auditory Verbal Learning Test, WNV-SS: Wechsler Nonverbal Scale of Ability-Spatial Span, RCFT: Rey Complex Figure Test, BADS-C = Behavioral Assessment of the Dysexecutive Syndrome for Children, TMTB t: Trail Making Test Section B time, PSI: Processing Speed Index. 1 One sample Wilcoxon signed rank test. Effect size = r. 2 One sample t-test. Effect size = Cohen’s d. * p < 0.05, ** p < 0.01, *** p < 0.001.
Table 4. Association between proxy-reported PedsPCF score and neuropsychological assessments.
Table 4. Association between proxy-reported PedsPCF score and neuropsychological assessments.
VariableCases (n)B (SE)95% CI of B R2p-Value
IntelligenceWISC-III-NL Total IQ1580.022 (0.004)0.013–0.0310.141<0.001 ***
AttentionTMTA t1550.223 (0.071)0.082–0.3640.0600.002 **
Stroop IF1490.067 (0.074)−0.079–0.2130.0060.365
DCT-ST1510.139 (0.066)0.009–0.2690.0290.036 *
DCT-SD1510.106 (0.056)−0.004–0.2710.0240.059
Verbal MemoryWISC-III-NL Total Digit Span1570.255 (0.083)0.090–0.4190.0570.003 **
RAVLT total1580.231 (0.065)0.103–0.3590.075<0.001 ***
RAVLT recall1580.188 (0.060)0.070–0.3050.0600.002 **
Visuospatial MemoryWNV-SS total1550.266 (0.091)0.085–0.4460.0520.004 **
WNV-SS forwards1550.159 (0.082)−0.003–0.3220.0240.055
RCFT immediate1550.191 (0.067)0.059–0.3230.0510.005 **
RCFT delayed1550.191 (0.066)0.061–0.3210.0520.004 **
RCFT recognition1560.164 (0.071)0.024–0.3040.0340.022 *
Executive FunctioningBADS-C Key Search1550.208 (0.076)0.058–0.3580.0470.007 **
BADS-C Modified Six Elements88 ****0.083 (0.144)−0.202–0.3690.0040.563
TMTB t1470.236 (0.083)0.071–0.4000.0520.005 **
WNV-SS backwards1550.275 (0.097)0.082–0.4670.0490.005 **
Processing Speed Index1580.319 (0.069)0.183–0.4560.120<0.001 ***
B (SE) = Unstandardized coefficient β (standard error); 95% CI of B = 95% confidence interval of unstandardized β coefficient. PedsPCF = pediatric perceived cognitive functioning, IQ = Intelligence Quotient, TMTA t = Trail Making Test Section A time, Stroop IF = Stroop interference factor, DCT-ST = Dot Cancellation Test series time, DCT-SD = Dot Cancellation Test standard deviation series time, RAVLT = Rey Auditory Verbal Learning Test, WNV-SS = Wechsler Nonverbal Scale of Ability- Spatial Span, RCFT = Rey Complex Figure Test, BADS-C = Behavioral Assessment of the Dysexecutive Syndrome for Children, TMTB t = Trail Making Test Section B time. * p < 0.05, ** p < 0.01, *** p < 0.001, ****: Last subtest of the assessments, which was often not administered due to lack of time.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Ilik, Y.; IJsselstijn, H.; Gischler, S.J.; van Gils-Frijters, A.; Schnater, J.M.; Rietman, A.B. Parent-Reported Perceived Cognitive Functioning Identifies Cognitive Problems in Children Who Survived Neonatal Critical Illness. Children 2022, 9, 900. https://doi.org/10.3390/children9060900

AMA Style

Ilik Y, IJsselstijn H, Gischler SJ, van Gils-Frijters A, Schnater JM, Rietman AB. Parent-Reported Perceived Cognitive Functioning Identifies Cognitive Problems in Children Who Survived Neonatal Critical Illness. Children. 2022; 9(6):900. https://doi.org/10.3390/children9060900

Chicago/Turabian Style

Ilik, Yerel, Hanneke IJsselstijn, Saskia J. Gischler, Annabel van Gils-Frijters, Johannes M. Schnater, and Andre B. Rietman. 2022. "Parent-Reported Perceived Cognitive Functioning Identifies Cognitive Problems in Children Who Survived Neonatal Critical Illness" Children 9, no. 6: 900. https://doi.org/10.3390/children9060900

APA Style

Ilik, Y., IJsselstijn, H., Gischler, S. J., van Gils-Frijters, A., Schnater, J. M., & Rietman, A. B. (2022). Parent-Reported Perceived Cognitive Functioning Identifies Cognitive Problems in Children Who Survived Neonatal Critical Illness. Children, 9(6), 900. https://doi.org/10.3390/children9060900

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop