Next Article in Journal
The Presence and Consequences of Abortion Aversion in Scientific Research Related to Alcohol Use during Pregnancy
Previous Article in Journal
Estimating the Double Burden of Malnutrition among 595,975 Children in 65 Low- and Middle-Income Countries: A Meta-Analysis of Demographic and Health Surveys
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
IJERPH
Volume 16
Issue 16
10.3390/ijerph16162887
ijerph-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

Adverse Childhood Experiences and Early Pubertal Timing Among Girls: A Meta-Analysis

by
Lei Zhang
,
Dandan Zhang
and
Ying Sun
*
Department of Maternal, Child & Adolescent Health, School of Public Health, Anhui Medical University, 81th Meishan Road, Hefei 230032, Anhui Province, China
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2019, 16(16), 2887; https://doi.org/10.3390/ijerph16162887
Submission received: 24 July 2019 / Revised: 5 August 2019 / Accepted: 10 August 2019 / Published: 13 August 2019
Browse Figures
Review Reports Versions Notes

Abstract

:
The association between adverse childhood experiences (ACEs) and pubertal timing has been a topic of enduring controversy. A systematic search of PubMed and Web of Science databases was undertaken to quantify the magnitude of total and specific forms of ACEs effects on early pubertal timing among girls. Our search identified 3280 records, of which 43 studies with 46 independent data sets met inclusion criteria. We estimated pooled effect sizes (Cohen’s ds) for the association between ACEs with early pubertal timing. Total ACEs was not associated with early pubertal timing. When we examined the specific types of ACEs, associations were small to medium for father absence (d = −0.40, 95% confidence interval [CI]: −0.63, −0.16) and small for sexual abuse (d = −0.13, CI: −0.17, −0.10) and family dysfunction (d = −0.08, CI: −0.11, −0.02). We identified considerable heterogeneity between estimates for almost all of the outcomes. ACEs exposure may affect female reproductive reproduction, particularly father absence, sexual abuse, and family dysfunction. We propose that future research in this area test a theoretical model linking adversity with earlier reproductive strategy, which includes early pubertal timing as a core component linking early adversity and stress physiology with poor health outcomes later in life in females.

1. Introduction

The onset of puberty is pivotal for human growth and development [1]. However, among developed nations, there has been a secular trend of early pubertal timing over the past century, and in recent years, also in developing countries [2,3]. Early pubertal timing has been recognized as a risk factor for adverse health outcomes in adulthood including obesity, hyperinsulinemia, type-2 diabetes, hypertension, coronary heart disease, depression and early mortality [4,5,6,7,8]. Multiple inter-related social and environmental factors have been found to significantly influence pubertal timing, including nutrition and obesity, genetic factors, and general health status, race, and familial socioeconomic status (SES) [9].
Adverse childhood experiences (ACEs), defined as experiences that threaten the child’s bodily, familial, or social safety or security, classically include maltreatment and household dysfunction to more targeted experiences of bullying, exposure to crime, victimization, and economic disadvantage [10]. For the purposes of this meta-analysis, ACEs were defined as exposure to at least one significant form of the following childhood adversities: before the age of 18 years: physical abuse, sexual abuse, neglect (failure to provide and failure to supervise physically or emotionally), family dysfunction (parental death or serious illness, parental separation or divorce, parental incarceration, parental substance abuse, domestic violence, mental illness), low SES, and father absence (separation or divorce of the birth parents followed by absence of the birth father from the home).
ACEs are a major public health problem, with some estimates suggesting that about a third of the general population may be affected [11]. A growing number of studies have examined ACEs as risk factors for early pubertal timing, however, the association has been a topic of enduring controversy [3,9,12,13,14,15,16]. For example, Romans et al. [16] have found associations between father absence and early puberty whereas similar results were not observed by Henrichs et al. [9].
The life history theory provides a theoretical framework for explaining the individual differences in reproductive strategies from adolescence to adulthood, especially the role of family and ecological environment in regulating individual differences in puberty development and reproductive strategies. It attempts to explain the timing of reproductive development and events across the life span in terms of evolved strategies for distributing metabolic resources between the competing demands of growth, maintenance, and reproduction [17]. Specifically, there are environmental conditions in which accelerated maturational development is an adaptive response serving to maximize reproduction opportunities. Based on the life history theory, three middle-level life history models have been advanced to explain why ACEs may increase risk of early pubertal timing. First, the psychosocial acceleration theory, first advanced by Belsky, Steinberg, and Draper, 1991 postulates that ecological stressors in and around the family create conditions that undermine parental functioning and lower the quality of parental investment [18]. Under these conditions, parental investment is unreliable and/or not closely related to the reproductive success of offspring, girls are predicted to develop in a manner that accelerates pubertal maturation and sexual activity, and orients the individual towards unstable pair-bonds. Second, as a variant of the psychosocial acceleration theory, paternal investment theory parallels this logic but posits a more unique and central role for father and other men in the regulation of female pubertal timing, separate from the effects of other dimensions of psychosocial stress and support in the child’s environment [17]. The third theory is an extension on the psychosocial acceleration theory and paternal investment theory and is referred to as the child development theory. The child development theory describes how the composition and quality of family environments might influence the length of childhood as a developmental strategy. According to child development theory, the benefits of a longer childhood (delay puberty) are increased in high-quality family contexts that foster the development of sociocompetitive competencies, while the costs of cutting short childhood (accelerate puberty) are reduced in adverse family contexts that do not significantly facilitate these competencies. Children should be selected to take advantage of the benefits of high-quality parental investment and reduce the costs of low-quality parental investment by contingently altering the length of growth and development prior to reproductive maturity [17,19].
Activation of the hypothalamic-pituitary-adrenal (HPA) axis may be an underlying neuroendocrine mechanism linking ACEs and early pubertal timing, which governs both stress response and adrenarche, the first phase of pubertal maturation [20]. ACEs can alter the response of the HPA axis, with chronic stressful experiences resulting in hyperactivation followed by downregulation of the stress system. The attenuated cortisol profile may actually hasten the pubertal timing because the stress function of the HPA axis is dampened, allowing the cascade of pubertal hormones via the HPG axis to commence [21]. However, given the different forms of ACEs and the multiple indicators of HPA axis, more longitudinal studies are needed to understand the underlying mechanism better.
Variability in study design, methodology, subject characteristics, type of ACEs, and developmental timing limit the ability to draw definitive conclusions. The objective of this meta-analysis was to clarify the relationship between ACEs and early pubertal timing by means of a systematic examination of the literature, which may be beneficial for guiding future empirical and theoretical work in this area.

2. Materials and Methods

2.1. Search Strategy

The study was performed according to the recommendation of the Preferred Reporting Items for Systematic Reviews and Meta-analysis (PRISMA) guidelines [22]. A systematic database search from 1980 up to 2018 was performed on PubMed and Web of Science using the following search themes: (“ACE”, “ACEs”, “adverse childhood experiences”, “adverse childhood events”, “childhood maltreatment”, “child maltreatment”, “childhood adversity”, “child adversity”, “childhood adversities”, “child adversities”, “early adversity”, “early adversities”, “childhood physical abuse”, “child physical abuse”, “physical abuse”, “childhood sexual abuse”, “child sexual abuse”, “sexual abuse”, “childhood neglect”, “child neglect”, “childhood physical neglect”, “child physical neglect”, “physical neglect”, “child abuse”, “childhood abuse”; “child emotional abuse”, “childhood emotional abuse”, “emotional abuse”, “child emotional neglect”, “childhood emotional neglect”, “child trauma”, “childhood trauma”, “emotional neglect”, “parental incapacities”, “family incapacities”, “adverse family experiences”, “adverse family events”, “trauma”, “poverty”; “socioeconomic status”, “parental loss”, “adversity”, “early life stress”, “bullying”) combined with pubertal timing related search terms (“puberty”, “pubertal status”, “early puberty”, “early pubertal timing”, “age of menarche”, “early age of menarche”, “early maturation”, “pubertal timing”). In addition, we searched the bibliographies of the articles found on the subject [14,23]. The present analysis focused on childhood sexual abuse, physical abuse, neglect, father absence, low SES, family dysfunction. All the included studies were published in English and from peer-reviewed journals.

2.2. Inclusion Criteria and Exclusion Criteria

Selection criteria for the meta-analysis included articles exploring the association between ACEs and early pubertal timing. We excluded review articles, editorials, commentaries, and animal studies. The life history theory to pubertal timing pivots around the trade-off between the allocation of resources to physical growth versus production of offspring, which is particularly relevant to females. It has been applied more broadly and successfully to the question of female rather than male pubertal timing. In addition, there is a clear and easily assessed marker of female but not male pubertal timing: age at menarche [17]. Given the theoretical and empirical reasons, we included female participants only.
The majority of studies utilized age at menarche, Tanner staging scores, Pubertal Development Scale (PDS) and relative perceived timing questions to the evaluation of pubertal developmental. For studies using age at menarche, menarche occurring before the age of 11 years was considered as early pubertal timing, while after the age of 14 years as delayed pubertal timing. For those studies only reporting the correlation between ACEs with age at menarche, negative direction suggested that ACEs was associated with early pubertal timing. For studies using Tanner staging and the PDS, pubertal timing was then examined such that early pubertal timing were adolescents who scored two standard deviations above the mean and late pubertal timing were two standard deviations below the mean. Some studies also trichotomized pubertal timing groups, such that one standard deviation above the mean was categorized as early. Some studies used a single self-report item to assess relative perceived timing of puberty. Generally, this item was stated as follows “Compared with other boys/girls your age, would you say your physical development has developed ‘much earlier,’ ‘somewhat earlier,’ ‘about the same,’ ‘somewhat later,’ or ‘much later’ than other boys or girls your age?” Due to the considerable variation in the measurement method of pubertal timing, subgroup analysis was performed to examine significant sources of this heterogeneity [24].

2.3. Risk of Bias Assessment

Two reviewers independently assessed the methodology quality of included cohort studies using the Newcastle–Ottawa Scale (NOS) (range, 0 to 9 scores) [25]. Assessment items included the selection (four items, four scores), comparability (one item, two scores), and assessment of outcome (three items, three scores). Studies are then stratified by score: low quality (scored 0–3), medium quality (scored 4–6), and high quality (scored 7–9). The cross-sectional study quality was assessed using the Agency for Healthcare Research and Quality guidelines [26]. Studies are then stratified by score: low quality (scored 0–3), medium quality (scored 4–7), and high quality (scored 8–11). The third reviewer was involved when any disagreements existed. The quality scores did not affect studies for inclusion but were considered when performing sensitivity analysis and interpreting our research results.

2.4. Data Screening and Extraction

After duplicate citations were removed, two reviewers independently screened the titles and abstracts to identify potentially relevant citations. Then the potentially eligible studies were then screened again by full texts. The pre-designed criteria mentioned above were used to guide the entire process of screening. Subsequently, the following data were extracted from all the included studies using a pre-designed extraction form by two reviewers: (1) general information, including authors, publication year, (2) study design and specific types of ACE, (3) sample size, (4) the measure of ACEs, (5) the measure of early pubertal timing. The third reviewer was involved when any disagreements existed.

2.5. Effect Size Computation and Statistical Analyses

All analyses were carried out using the meta-analysis commands of Stata 11.0. For each study, we computed an effect size Cohen’s d [27] using the effect size calculator [28] for the association between ACEs and early pubertal timing. Cohen’s guidelines [27] were used to interpret effect sizes such that effects sizes of ds = 0.20 were considered small, ds = 0.50 were considered moderate, and ds = 0.80 were considered large. If correlations (r) or odds ratios (OR) were reported, they were converted to Cohen’s d using the formulas d = 2r/(1 − r2)1/2 [29] or d = 31/2/πlog (OR) [30], respectively. To examine the global association between ACEs and early pubertal timing, a meta-analysis was carried out on the effects extracted from studies providing a summary measure of exposure to ACEs [31]. Unadjusted values were calculated in the program, thus avoiding biases that may have arisen from adjustments to different confounders done in each study. Heterogeneity was calculated using the Q test and I2 statistic and the values of I2 metric 25%, 50%, and 75% were considered as low, medium, and high heterogeneity [32]. The effect of specific types of ACEs (i.e., sexual abuse, physical abuse, neglect, father absence, low SES, family dysfunction) were tested in this meta-analysis. Due to the large overlap, these analyses were treated as independent research syntheses and no attempt was made to statistically compare these effects using meta-regression or subgroup analyses. We did sensitivity analyses by excluding outlying studies. We explored risk of publication bias using the Egger tests when sufficient studies were included in the meta-analysis (at least 10 samples).
Planned meta-regressions and subgroup analyses were conducted to explore possible sources of heterogeneity. We did univariate analyses to test the individual association of the covariates (sample size, publication year) with pooled estimates. Subgroups were delineated using the following criteria: ACEs measure (questionnaire, interview, and combination), pubertal timing measure (age at menarche, number of early menarches, PDS, Tanner stage), original variable type (categorical, continuous and others), as well as study design (cross-sectional and longitudinal).

3. Results

3.1. Search Results

As illustrated in Figure 1, after duplicates removed, the search strategy resulted in 3002 records, of which 2767 were excluded following title and abstract, and a further 193 were excluded following review of the full text, 42 studies with 45 independent data sets met full inclusion criteria. Table 1 summarizes the characteristics of the eligible studies. 26 articles used data from cross-sectional studies and 16 used data from longitudinal studies.

3.2. Association between Total ACEs and Early Pubertal Timing

Figure 2 shows the association between total ACEs (n = 35) and early pubertal timing, with an effect of Cohen’s d: −0.04 (95% CI: −0.14, 0.06). The Q and I2 tests indicated that the association between total ACEs and early pubertal timing was statistically heterogeneous (I2 = 99%, p < 0.001), subgroup analyses were performed to examine significant sources of this heterogeneity. Egger’s test (B = 2.21, SE = 2.17, p = 0.32) showed no evidence of substantial publication bias. We examined possible changes in the effects by omitting one study at a time in the analysis but did not find any meaningful changes. Analyzing all studies except Tahirović HF et al. [61] on account of its indefinite type of ACEs, we obtained a significant results with an effect of Cohen’s d: −0.09 (95% CI: −0.17, −0.01), but the heterogeneity was still considerable (I2 = 98.3%, p < 0.001). We excluded Alvergne et al. [36], which had a huge outlier value, from the analysis. Using the random effect model, we got a pooled Cohen’s d: 0.04 (95% CI: −0.05, 0.14), suggesting that the association between total ACEs and delay puberty was still small and not significant.

3.3. Associations between Specific Types of ACEs and Early Pubertal Timing

The pooled effect size of specific types of ACEs are presented in Table 2. Influence analyses were performed on each type of adversities, we did not find any meaningful changes. We found that the effect for sexual abuse (Cohen’s d −0.14 (95% CI −0.18, −0.11), I2 = 72.4, p < 0.001) and family dysfunction (Cohen’s d −0.08 (95% CI −0.11, −0.04), I2 = 66.9, p = 0.001) was small, while father absence (Cohen’s d −0.40 (95% CI −0.63, −0.16), I2 = 98.2, p < 0.001) was between small to medium. When we excluded Alvergne et al. [36], the effect size of father absence was reduced by nearly half (Cohen’s d −0.19 (95% CI −0.27, −0.11), I2 = 83.2, p < 0.001). We did not observe significant associations in other types of ACEs, or across total ACEs.
Except for physical abuse, neglect and low SES, the association between ACEs and early pubertal timing was small but significant, and the pooled effect size was highest for father absence and the least for family dysfunction. We found considerable heterogeneity between estimates for almost all of the outcomes. Heterogeneity between estimates was higher for father absence and lower for sexual abuse, relatively. Meta-regression revealed that the publication years (p = 0.083) and sample size (p = 0.661) in the primary studies did not influence the observed effect sizes.
Subgroup analyses are presented in Table 3. After subgroup analysis by ACEs measure (questionnaire, interview and combination), pubertal timing measure (age at menarche, number of early menarche, PDS, Tanner stage), original variable type (categorical, continuous and others), as well as study design (cross-sectional and longitudinal), heterogeneity between estimates is still considerable. In the subgroup analysis by pubertal timing measure, the pooled effect size was small but significant in studies measuring pubertal timing by a number of early menarche and Tanner stage. Pooled effect size of one study measuring pubertal timing by Tanner stage was Cohen’s d: −0.27 (95% CI: −0.52, −0.03) [12]. Similarly, in subgroup analysis by original variable type, the pooled effect size for categorical was small but significant.

4. Discussion

To our knowledge, this is the first meta-analysis to examine the association between ACEs and early pubertal timing and has extended previous studies by quantifying the effect size for early pubertal timing. Our finding suggests that sexual abuse, father absence, and growing up with challenging family circumstances were significantly associated with early pubertal timing among girls. Using Cohen’s categorization, the effect for sexual abuse and family dysfunction is small, while father absence is between small to medium. However, similar associations were not observed in other types of ACEs, or across total ACEs.
Herman-Giddens et al. [67] first reported in 1997 that child sexual abuse increased the risk of girls’ pubic hair and breast development before age 8. Subsequent studies have consistently found that sexual abuse was associated with early pubertal timing [16,42,43]. Recently, a cohort study of the Avon Longitudinal Study of Parents and Children (ALSPAC) mothers showing that total ACEs was not associated with age at menarche, while childhood sexual abuse was associated with lower age at menarche, which is consistent with our findings [54]. Sexual abuse is often regarded as the most prevalent health problem children face with the most serious array of consequences, while in our study, early pubertal timing may be more affected by father absence instead of sexual abuse.
As early as the 1980s to the 1990s, Draper and Harpending [68] and Belsky et al. [18] began to focus on the association between father absence and reproductive behaviors in adulthood, which has received increased attention over recent years. Majority of these studies have indicated a significant association between father absence and early pubertal timing. A study from a large UK birth cohort (ALSPAC) demonstrated that girls from father-absent homes had earlier menarche than girls from father-present homes [46]. The observed association between father absence and early pubertal timing has also been supported by other articles [20,23]. Moreover, the earlier that father absence occurs, the earlier girls tend to experience puberty, there is evidence to suggest that exposure to father absence during the first five years of life is more strongly associated with early menarche than father absence later in childhood [24].
It has been previously argued that the effects of age at menarche may be explained by low SES arising as a result of father absence, for example, decrease in family income, major financial problems [69]. However, in this meta-analysis, we did not find a significant association between low SES and early pubertal timing. When we excluded studies in which pubertal timing measured by Tanner stage or PDS [12,15,23,60], results suggested that girls living in low SES households may experience delayed onset of menarche (Cohen’s d: 0.12, 95% CI: 0.003, 0.25). A longitudinal study on 1091 black and 986 white girls from the three sites in the United States found that high SES was a protective factor for the risk of early menarche among white girls but opposite among black girls [14]. Given the challenges in methodology and definition of SES along with socially heterogeneous of study populations, it is difficult to draw firm conclusions concerning the relationship between low SES and early pubertal timing.
The association between family dysfunction and early pubertal timing was weak, we suspect that family dysfunction may be a proxy variable that represents a range of other family characteristics (including parental divorce, separation, mental illness, and family conflict) and have an effect similar to father absence. However, when we excluded three articles involving parental divorce or separation, the effect size was small but still significant. The effect of total ACEs on adolescent development was not significant. One explanation may be that there are great individual differences in the types, timing, duration, and severity of ACEs. Another explanation is that the association may differ depending on race/ethnicity. As demonstrated in prior research, high SES was a protective factor for the risk of early menarche among white girls but opposite among black girls [14].
Overall, despite some inconsistencies across specific forms of ACEs with early pubertal timing, these results support that ACEs exposure may affect female reproductive function. Given the association between ACEs and early pubertal timing, clinicians should sensitively enquire about past childhood experiences, and tailor support accordingly, thus resetting their trajectory for lifelong health and reducing the risk of chronic diseases and conditions.
There are also several limitations. Firstly, most of the measurements relied on retrospective self-report which is subject to recall or reporting biases. Secondly, this sample was restricted to females, and these findings cannot be extrapolated to males. In addition, the analysis revealed substantial statistical heterogeneity, which allows for less confidence in the estimated effect sizes, but is not surprising given the methodological and analytic variances in the identified studies. We cannot rule out the effect of interactions of ACEs with other factors (parental early puberty history, physical activity, etc.) in the current meta-analysis because most studies did not adjust for these interactions, or partly adjusted for these factors as possible moderators. The current meta-analysis focused on specific types of ACEs (sexual abuse, physical abuse, neglect, father absence, low SES, and family dysfunction). Nevertheless, adversity is a heterogeneous concept (including types of ACEs not considered here, such as bullying, exposure to war, and natural disasters, etc.). Although most studies measured ACEs at any point in childhood or adolescence, we were unable to obtain sufficient information about the frequency, timing, and duration of ACEs. Additionally, studies without sufficient statistical information for the computation of effects were not included in our analysis. Nevertheless, the thorough search of literature ensures a full coverage of the existing evidence and makes the results more convincing. Moreover, the large sample of the study population derived from the included studies enhances the possibility of effect detection with reasonable statistical power.
These limitations also suggest some directions for future research. Identification of distinct dimensions, duration and sensitive periods of adverse childhood experience that differentially influence pubertal development are required to uncover mechanisms that explain how childhood adversity is associated with female reproductive strategies.

5. Conclusions

In summary, our analyses indicate that father absence is more strongly related to early pubertal timing among girls, followed by sexual abuse and family dysfunction. Additional research is needed to better understand the mechanisms driving these relationships. Due to the high heterogeneity, a conclusive statement on the effect size of the association between ACEs and early pubertal timing should be made with caution.

Author Contributions

Y.S. and L.Z. contributed to the conception and design of the review. L.Z. applied the search strategy. L.Z. and D.Z. applied the selection criteria. L.Z. and D.Z. completed the assessment of risk of bias. L.Z. and Y.S. analyzed the data and interpreted data. L.Z. and Y.S. drafted this manuscript. All authors edited this manuscript.

Funding

This work was supported by the National Natural Science Foundation of China [grant number 81872638] and Natural Science Foundation for Distinguished Young Scholars of Anhui Province [grant number 1908085J26].

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Perry, J.R.; Murray, A.; Day, F.R.; Ong, K.K. Molecular insights into the aetiology of female reproductive ageing. Nat. Rev. Endocrinol. 2015, 11, 725–734. [Google Scholar] [CrossRef] [PubMed]
  2. Sørensen, K.; Mouritsen, A.; Aksglaede, L.; Hagen, C.P.; Mogensen, S.S.; Juul, A. Recent secular trends in pubertal timing: Implications for evaluation and diagnosis of precocious puberty. Horm. Res. Paediatr. 2012, 77, 137–145. [Google Scholar] [CrossRef] [PubMed]
  3. Islam, M.S.; Hussain, M.A.; Islam, S.; Mahumud, R.A.; Biswas, T.; Islam, S.M.S. Age at menarche and its socioeconomic determinants among female students in an urban area in Bangladesh. Sex. Reprod. Healthc. 2017, 12, 88–92. [Google Scholar] [CrossRef] [PubMed]
  4. Elks, C.E.; Ong, K.K.; Scott, R.A.; van der Schouw, Y.T.; Brand, J.S.; Wark, P.A.; Amiano, P.; Balkau, B.; Barricarte, A.; Boeing, H.; et al. Age at menarche and type 2 diabetes risk: The EPIC-InterAct study. Diabetes Care 2013, 36, 3526–3534. [Google Scholar] [CrossRef] [PubMed]
  5. Canoy, D.; Beral, V.; Balkwill, A.; Wright, F.L.; Kroll, M.E.; Reeves, G.K.; Green, J.; Cairns, B.J.; Million Women Study Collaborators. Age at menarche and risks of coronary heart and other vascular diseases in a large UK cohort. Circulation 2015, 131, 237–244. [Google Scholar] [CrossRef] [PubMed]
  6. Charalampopoulos, D.; McLoughlin, A.; Elks, C.E.; Ong, K.K. Age at menarche and risks of all-cause and cardiovascular death: A systematic review and meta-analysis. Am. J. Epidemiol. 2014, 180, 29–40. [Google Scholar] [CrossRef] [PubMed]
  7. Negriff, S.; Hillman, J.B.; Dorn, L.D. Does competence mediate the associations between puberty and internalizing or externalizing problems in adolescent girls? J. Adolesc. Health 2011, 49, 350–356. [Google Scholar] [CrossRef] [PubMed]
  8. Himes, J.H. Examining the evidence for recent secular changes in the timing of puberty in US children in light of increases in the prevalence of obesity. Mol. Cell. Endocrinol. 2006, 254, 13–21. [Google Scholar] [CrossRef]
  9. Henrichs, K.L.; McCauley, H.L.; Miller, E.; Styne, D.M.; Saito, N.; Breslau, J. Early menarche and childhood adversities in a nationally representative sample. Int. J. Pediatr. Endocrinol. 2014, 2014, 14. [Google Scholar] [CrossRef]
  10. Suglia, S.F.; Koenen, K.C.; Boynton-Jarrett, R.; Chan, P.S.; Clark, C.J.; Danese, A.; Faith, M.S.; Goldstein, B.I.; Hayman, L.L.; Isasi, C.R.; et al. Childhood and Adolescent Adversity and Cardiometabolic Outcomes: A Scientific Statement From the American Heart Association. Circulation 2018, 137, e15–e28. [Google Scholar] [CrossRef]
  11. Kessler, R.C.; McLaughlin, K.A.; Green, J.G.; Gruber, M.J.; Sampson, N.A.; Zaslavsky, A.M.; Aguilar-Gaxiola, S.; Alhamzawi, A.O.; Alonso, J.; Angermeyer, M.; et al. Childhood adversities and adult psychopathology in the WHO World Mental Health Surveys. Br. J. Psychiatry 2010, 197, 378–385. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  12. Noll, J.G.; Trickett, P.K.; Long, J.D.; Negriff, S.; Susman, E.J.; Shalev, I.; Li, J.C.; Putnam, F.W. Childhood Sexual Abuse and Early Timing of Puberty. J. Adolesc. Health 2017, 60, 65–71. [Google Scholar] [CrossRef] [PubMed]
  13. Obradović, J.; Hipwell, A. Psychopathology and social competence during the transition to adolescence: The role of family adversity and pubertal development. Dev. Psychopathol. 2010, 22, 621–634. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  14. Braithwaite, D.; Moore, D.H.; Lustig, R.H.; Epel, E.S.; Ong, K.K.; Rehkopf, D.H.; Wang, M.C.; Miller, S.M.; Hiatt, R.A. Socioeconomic status in relation to early menarche among black and white girls. Cancer Causes Control 2009, 20, 713–720. [Google Scholar] [CrossRef] [PubMed]
  15. Negriff, S.; Blankson, A.N.; Trickett, P.K. Pubertal Timing and Tempo: Associations with Childhood Maltreatment. J. Res. Adolesc. 2015, 25, 201–213. [Google Scholar] [CrossRef] [PubMed]
  16. Romans, S.E.; Martin, J.M.; Gendall, K.; Herbison, G.P. Age of menarche: The role of some psychosocial factors. Psychol. Med. 2003, 33, 933–939. [Google Scholar] [CrossRef] [PubMed]
  17. Ellis, B.J. Timing of pubertal maturation in girls: An integrated life history approach. Psychol. Bull. 2004, 130, 920–958. [Google Scholar] [CrossRef]
  18. Belsky, J.; Steinberg, L.; Draper, P. Childhood experience, interpersonal development, and reproductive strategy: And evolutionary theory of socialization. Child Dev. 1991, 62, 647–670. [Google Scholar] [CrossRef]
  19. Ellis, B.J.; Essex, M.J. Family environments, adrenarche, and sexual maturation: A longitudinal test of a life history model. Child Dev. 2007, 78, 1799–1817. [Google Scholar] [CrossRef]
  20. Mendle, J.; Ryan, R.M.; McKone, K.M. Early Childhood Maltreatment and Pubertal Development: Replication in a Population-Based Sample. J. Res. Adolesc. 2016, 26, 595–602. [Google Scholar] [CrossRef]
  21. Ruttle, P.L.; Shirtcliff, E.A.; Armstrong, J.M.; Klein, M.H.; Essex, M.J. Neuroendocrine coupling across adolescence and the longitudinal influence of early life stress. Dev. Psychobiol. 2015, 57, 688–704. [Google Scholar] [CrossRef] [PubMed]
  22. Moher, D.; Liberati, A.; Tetzlaff, J.; Altman, D.G. Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. Int. J. Surg. 2010, 8, 336–341. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  23. Deardorff, J.; Ekwaru, J.P.; Kushi, L.H.; Ellis, B.J.; Greenspan, L.C.; Mirabedi, A.; Landaverde, E.G.; Hiatt, R.A. Father absence, body mass index, and pubertal timing in girls: Differential effects by family income and ethnicity. J. Adolesc. Health 2011, 48, 441–447. [Google Scholar] [CrossRef] [PubMed]
  24. Ullsperger, J.M.; Nikolas, M.A. A meta-analytic review of the association between pubertal timing and psychopathology in adolescence: Are there sex differences in risk? Psychol. Bull. 2017, 143, 903–938. [Google Scholar] [CrossRef] [PubMed]
  25. Lo, C.K.; Mertz, D.; Loeb, M. Newcastle-Ottawa Scale: Comparing reviewers’ to authors’ assessments. BMC Med. Res. Methodol. 2014, 14, 45. [Google Scholar] [CrossRef] [PubMed]
  26. Agency for Healthcare Research and Quality. Methods Guide for Effectiveness and Comparative Effectiveness Reviews. Available online: http://effectivehealthcare.ahrq.gov/index.cfm/search-for-guides-reviews-and-reports/?pageaction = displayproduct&productid = 318 (accessed on 13 July 2018).
  27. Cohen, J. Statistical Power Analysis for the Behavioral Sciences, 2nd ed.; Lawrence Erlbaum Associates: New York, NY, USA, 1998. [Google Scholar]
  28. Effect Size Calculator. Available online: https://cebcp.org/practical-meta-analysis-effect-size-calculator/standardized-mean-difference-d/means-and-standard-deviations/ (accessed on 13 July 2018).
  29. Bornstein, M.; Hedges, L.V.; Higgins, J.P.T.; Rothstein, H.R. Introduction to Meta-Analysis; John Wiley & Sons, Ltd.: Hoboken, NJ, USA, 2009. [Google Scholar]
  30. Sánchez-Meca, J.; Marín-Martínez, F.; Chacón-Moscoso, S. Effect-size indices for dichotomized outcomes in meta-analysis. Psychol. Methods 2003, 8, 448–467. [Google Scholar] [CrossRef] [PubMed]
  31. Trotta, A.; Murray, R.M.; Fisher, H.L. The impact of childhood adversity on the persistence of psychotic symptoms: A systematic review and meta-analysis. Psychol. Med. 2015, 45, 2481–2498. [Google Scholar] [CrossRef]
  32. Higgins, J.P.; Thompson, S.G.; Deeks, J.J.; Altman, D.G. Measuring inconsistency in meta-analyses. BMJ 2003, 327, 557–560. [Google Scholar] [CrossRef] [Green Version]
  33. Abioye-Kuteyi, E.A.; Ojofeitimi, E.O.; Aina, O.I.; Kio, F.; Aluko, Y.; Mosuro, O. The influence of socioeconomic and nutritional status on menarche in Nigerian school girls. Nutr. Health 1997, 11, 185–195. [Google Scholar] [CrossRef]
  34. Adalı, T.; Koç, I. Menarcheal age in Turkey: Secular trend and socio-demographic correlates. Ann. Hum. Biol. 2011, 38, 345–353. [Google Scholar] [CrossRef]
  35. Al-Sahab, B.; Ardern, C.I.; Hamadeh, M.J.; Tamim, H. Age at menarche in Canada: Results from the National Longitudinal Survey of Children & Youth. BMC Public Health 2010, 10, 736. [Google Scholar] [CrossRef]
  36. Alvergne, A.; Faurie, C.; Raymond, M. Developmental plasticity of human reproductive development: Effects of early family environment in modern-day France. Physiol. Behav. 2008, 95, 625–632. [Google Scholar] [CrossRef] [PubMed]
  37. Amigo, H.; Vásquez, S.; Bustos, P.; Ortiz, G.; Lara, M. Socioeconomic status and age at menarche in indigenous and non-indigenous Chilean adolescents. Cad. Saude Publica 2012, 28, 977–983. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  38. Asgharnia, M.; Faraji, R.; Sharami, H.; Yadak, M.; Oudi, M. A study of menarcheal age in northern iran (rasht). Oman Med. J. 2009, 24, 95–98. [Google Scholar] [CrossRef] [PubMed]
  39. Barrios, Y.V.; Sanchez, S.E.; Nicolaidis, C.; Garcia, P.J.; Gelaye, B.; Zhong, Q.; Williams, M.A. Childhood abuse and early menarche among Peruvian women. J. Adolesc. Health. 2015, 56, 197–202. [Google Scholar] [CrossRef] [PubMed]
  40. Bleil, M.E.; Adler, N.E.; Appelhans, B.M.; Gregorich, S.E.; Sternfeld, B.; Cedars, M.I. Childhood adversity and pubertal timing: Understanding the origins of adulthood cardiovascular risk. Biol. Psychol. 2013, 93, 213–219. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  41. Blell, M.; Pollard, T.M.; Pearce, M.S. Predictors of age at menarche in the newcastle thousand families study. J. Biosoc. Sci. 2008, 40, 563–575. [Google Scholar] [CrossRef] [PubMed]
  42. Boynton-Jarrett, R.; Harville, E.W. A prospective study of childhood social hardships and age at menarche. Ann. Epidemiol. 2012, 22, 731–737. [Google Scholar] [CrossRef] [Green Version]
  43. Boynton-Jarrett, R.; Wright, R.J.; Putnam, F.W.; Hibert, E.L.; Michels, K.B.; Forman, M.R.; Rich-Edwards, J. Childhood abuse and age at menarche. J. Adolesc. Health 2013, 52, 241–247. [Google Scholar] [CrossRef] [PubMed]
  44. Buzney, C.D.; DeCaro, J.A. Explanatory models of female pubertal timing: Discordances between cultural models of maturation and the recollection and interpretation of personal developmental experiences. Cult. Med. Psychiatry 2012, 36, 601–620. [Google Scholar] [CrossRef]
  45. Chavarro, J.; Villamor, E.; Narváez, J.; Hoyos, A. Socio-demographic predictors of age at menarche in a group of Colombian university women. Ann. Hum. Biol. 2004, 31, 245–257. [Google Scholar] [CrossRef] [PubMed]
  46. Culpin, I.; Heron, J.; Araya, R.; Melotti, R.; Lewis, G.; Joinson, C. Father absence and timing of menarche in adolescent girls from a UK cohort: The mediating role of maternal depression and major financial problems. J. Adolesc. 2014, 37, 291–301. [Google Scholar] [CrossRef] [PubMed]
  47. Junqueira Do Lago, M.; Faerstein, E.; De Souza Lopes, C.; Werneck, G.L. Family socio-economic background modified secular trends in age at menarche: Evidence from the Pró-Saúde Study (Rio de Janeiro, Brazil). Ann. Hum. Biol. 2003, 30, 347–352. [Google Scholar] [CrossRef] [PubMed]
  48. El Dosoky, M.; Al Amoudi, F. Menarcheal age of school girls in the city of Jeddah, Saudia Arabia. J. Obstet. Gynaecol. 1997, 17, 195–198. [Google Scholar] [CrossRef] [PubMed]
  49. Ersoy, B.; Balkan, C.; Gunay, T.; Onag, A.; Egemen, A. Effects of different socioeconomic conditions on menarche in Turkish female students. Early Hum. Dev. 2004, 76, 115–125. [Google Scholar] [CrossRef]
  50. Graber, J.A.; Brooks-Gunn, J.; Warren, M.P. The antecedents of menarcheal age: Heredity, family environment, and stressful life events. Child Dev. 1995, 66, 346–359. [Google Scholar] [CrossRef] [PubMed]
  51. James-Todd, T.; Tehranifar, P.; Rich-Edwards, J.; Titievsky, L.; Terry, M.B. The impact of socioeconomic status across early life on age at menarche among a racially diverse population of girls. Ann. Epidemiol. 2010, 20, 836–842. [Google Scholar] [CrossRef]
  52. Jorm, A.F.; Christensen, H.; Rodgers, B.; Jacomb, P.A.; Easteal, S. Association of adverse childhood experiences, age of menarche, and adult reproductive behavior: Does the androgen receptor gene play a role? Am. J. Med. Genet. Part B Neuropsychiatr. Genet. 2004, 125, 105–111. [Google Scholar] [CrossRef]
  53. Kelly, Y.; Zilanawala, A.; Sacker, A.; Hiatt, R.; Viner, R. Early puberty in 11-year-old girls: Millennium Cohort Study findings. Arch. Dis. Child. 2017, 102, 232–237. [Google Scholar] [CrossRef]
  54. Magnus, M.C.; Anderson, E.L.; Howe, L.D.; Joinson, C.J.; Penton-Voak, I.S.; Fraser, A. Childhood psychosocial adversity and female reproductive timing: A cohort study of the ALSPAC mothers. J. Epidemiol. Community Health 2018, 72, 34–40. [Google Scholar] [CrossRef]
  55. Matchock, R.L.; Susman, E.J. Family composition and menarcheal age: Anti-inbreeding strategies. Am. J. Hum. Biol. 2006, 18, 481–491. [Google Scholar] [CrossRef] [PubMed]
  56. Mendle, J.; Turkheimer, E.; D’Onofrio, B.M.; Lynch, S.K.; Emery, R.E.; Slutske, W.S.; Martin, N.G. Family structure and age at menarche: A children-of-twins approach. Dev. Psychol. 2006, 42, 533–542. [Google Scholar] [CrossRef] [PubMed]
  57. Moffitt, T.E.; Caspi, A.; Belsky, J.; Silva, P.A. Childhood experience and the onset of menarche: A test of a sociobiological model. Child Dev. 1992, 63, 47–58. [Google Scholar] [CrossRef] [PubMed]
  58. Onat, T.; Ertem, B. Age at menarche: Relationships to socioeconomic status, growth rate in stature and weight, and skeletal and sexual maturation. Am. J. Hum. Biol. 1995, 7, 741–750. [Google Scholar] [CrossRef] [PubMed]
  59. Opare-Addo, P.M.; Stowe, M.; Ankobea-Kokroe, F.; Zheng, T. Menarcheal and pubertal development and determining factors among schoolgirls in Kumasi, Ghana. J. Obstet. Gynaecol. 2012, 32, 159–165. [Google Scholar] [CrossRef]
  60. Sun, Y.; Mensah, F.K.; Azzopardi, P.; Patton, G.C.; Wake, M. Childhood Social Disadvantage and Pubertal Timing: A National Birth Cohort from Australia. Pediatrics 2017, 139, e20164099. [Google Scholar] [CrossRef]
  61. Tahirović, H.F. Menarchal age and the stress of war: An example from Bosnia. Eur. J. Pediatr. 1998, 157, 978–980. [Google Scholar] [CrossRef]
  62. Tekgül, N.; Saltık, D.; Vatansever, K. Secular trend of menarche age in an immigrant urban city in Turkey: Izmir. Turk. J. Pediatr. 2014, 56, 138–143. [Google Scholar]
  63. Tither, J.M.; Ellis, B.J. Impact of fathers on daughters’ age at menarche: A genetically and environmentally controlled sibling study. Dev. Psychol. 2008, 44, 1409–1420. [Google Scholar] [CrossRef]
  64. Toromanović, A.; Tahirović, H. Effect of family disintegration on age at menarche. Acta Med. Acad. 2015, 44, 124–134. [Google Scholar] [CrossRef]
  65. Vigil, J.M.; Geary, D.C.; Byrd-Craven, J. A life history assessment of early childhood sexual abuse in women. Dev. Psychol. 2005, 41, 553–561. [Google Scholar] [CrossRef]
  66. Wise, L.A.; Palmer, J.R.; Rothman, E.F.; Rosenberg, L. Childhood abuse and early menarche: Findings from the black women’s health study. Am. J. Public Health 2009, 99 (Suppl 2), S460–S466. [Google Scholar] [CrossRef]
  67. Herman-Giddens, M.E.; Slora, E.J.; Wasserman, R.C.; Bourdony, C.J.; Bhapkar, M.V.; Koch, G.G.; Hasemeier, C.M. Secondary sexual characteristics and menses in young girls seen in office practice: A study from the Pediatric Research in Office Settings network. Pediatrics 1997, 99, 505–512. [Google Scholar] [CrossRef]
  68. Draper, P.; Harpending, H. Father absence and reproductive strategy: An evolutionary perspective. J. Anthropol. Res. 1982, 38, 255–273. [Google Scholar] [CrossRef]
  69. Ellis, B.J.; McFadyen-Ketchum, S.; Dodge, K.A.; Pettit, G.S.; Bates, J.E. Quality of early family relationships and individual differences in the timing of pubertal maturation in girls: A longitudinal test of an evolutionary model. J. Personal. Soc. Psychol. 1999, 77, 387–401. [Google Scholar] [CrossRef]
Ijerph 16 02887 g001 550
Figure 1. Flow chart of study selection.
Figure 1. Flow chart of study selection.
Ijerph 16 02887 g001
Ijerph 16 02887 g002 550
Figure 2. Forest plot of effect sizes reported as Cohen’s d (x-axis) evaluating adverse childhood experiences (ACEs) and early pubertal timing using the random effects model.
Figure 2. Forest plot of effect sizes reported as Cohen’s d (x-axis) evaluating adverse childhood experiences (ACEs) and early pubertal timing using the random effects model.
Ijerph 16 02887 g002
Table
Table 1. Descriptive statistics and study characteristics for included studies.
Table 1. Descriptive statistics and study characteristics for included studies.
StudyStudy DesignNAge (Year)ACEs TypeACEs MeasurePuberty Measure
Abioye-Kuteyi EA (1997) [33] C6014.2low SESquestionnaireAAM
Adalı T(2011) [34]C278915–49low SEScombinationAAM
Al-Sahab B (2010) [35]C140314–17low SESquestionnaireNO.
Alvergne A (2008) [36]C70820.9FBquestionnaireAAM
Amigo H (a) (2012) [37]C1278–16low SESinterviewAAM
Amigo H (b) (2012) [37]C1148–16low SESinterviewAAM
Asgharnia M (2009) [38]C9111–16low SEScombinationAAM
Barrios YV (2015) [39]C149928PA, SAquestionnaireNO.
Bleil ME (2013) [40]C65034.9FDcombinationAAM
Blell M (a) (2008) [41]L9449–51low SESquestionnaireAAM
Blell M (b) (2008) [41]L10649–51low SESquestionnaireAAM
Boynton-Jarrett R (2012) [42]L452416PA, SA, neglectcombinationNO.
Boynton-Jarrett R (2013) [43]L67,65825–44abusequestionnaireNO.
Braithwaite D (a) (2009) [14]L109118–19low SESinterviewNO.
Braithwaite D (b) (2009) [14]L98618–19low SESinterviewNO.
Buzney CD (2012) [44]C7019–25low SEScombinationAAM
Chavarro J (2004) [45]C3015−42low SESquestionnaireAAM
Culpin I (2014) [46]L37858–17FBquestionnaireAAM
Deardorff J (2011) [23]L4448–10FB, low SESinterviewTanner staging
Junqueira DLM (2003) [47]C20539–19low SESquestionnaireAAM
El Dosoky M (1997) [48]C9299–18low SESquestionnaireAAM
Ersoy B (2004) [49]C53415.7low SEScombinationAAM
Graber JA (1995) [50]L7511.93FB, low SESquestionnaireAAM
Henrichs KL (2014) [9]C328845.7PA, SA, neglect, low SES, FB, FDinterviewNO.
Islam MS (2017) [3]C68014low SESquestionnaireNO.
James-Todd T (2010) [51]L237—alow SESquestionnaireAAM
Jorm AF (2004) [52]C3702—aPA, SA, neglect, FBquestionnaireAAM
Kelly Y (2016) [53]L583911.2 low SESinterviewPDS
Magnus MC (2018) [54]L898428.5Total adversity, SA, FDquestionnaireAAM
Matchock RL (2006) [55]C189620FBquestionnaireAAM
Mendle J (2006) [56]C128424.5FB, FDinterviewAAM
Mendle J (2016) [20]L627328.7SA, PA, neglectinterviewAAM
Moffitt TE (1992) [57]L41615FB, low SES, FDcombinationAAM
Negriff S (2015) [15]L2138–13SAquestionnairePDS
Noll JG (2017) [12]L1736–16SAinterviewTanner staging
Onat T (1995) [58]L1698.5–13.4low SESquestionnaireAAM
Opare-Addo PM (2012) [59]C7207–17low SESquestionnaireAAM
Romans SE (2003) [16]C48839.1low SES, PA, SA, FBinterviewNO.
Sun Y(2017) [60]L177010–11low SESquestionnairesPDS
Tahirovic HF (1998) [61]C60778–17WarquestionnaireAAM
Tekgül N (2014) [62]C61,29315–49low SESinterviewAAM
Tither JM (2008) [63]C13616–44FBquestionnaireAAM
Toromanović A (2015) [64]C22,4699–17.5FDquestionnaireAAM
Vigil JM (2005) [65]C61626.9SAquestionnaireAAM
Wise LA (2009) [66]C35,330M = 38PA, SAquestionnaireNO.
L = longitudinal, C = cross-sectional, PA = physical abuse, SA = sexual abuse, FB = father absence, FD = family dysfunction, SES = socioeconomic status, AAM = age at menarche, NO. = number of participants with early menarche, PDS = Pubertal Development Scale. a Dashed cells indicate insufficient information available in study.
Table
Table 2. Pooled effect size of specific types of ACEs.
Table 2. Pooled effect size of specific types of ACEs.
Types of AdversityKCohen’s d (95% CI)I2 (%), p Value
Sexual abuse12−0.14(−0.18, −0.11)72.4, <0.001
Physical abuse8−0.03 (−0.07,0.01)91.5, <0.001
Neglect40.02 (−0.1,0.14)72.8, 0.011
Low SES250.07 (−0.03,0.18)97.4, <0.001
Father absence12−0.40 (−0.63, −0.16)98.2, <0.001
Family dysfunction11−0.08 (−0.11,−0.04)66.9, 0.001
Data in parentheses are 95% Cis, ES = effect size (Cohen’s d), SES = socioeconomic status.
Table
Table 3. Subgroup analyses of Associations between ACEs and Early Pubertal Timing.
Table 3. Subgroup analyses of Associations between ACEs and Early Pubertal Timing.
ModeratorCohen’s d95% Confidence Intervalp-ValueI2 (%)
LowerUpper
ACEs measure
 questionnaire−0.06−0.220.100.49399.1
 interview−0.07−0.230.090.38298.7
 combination0.03−0.140.200.72886.3
Puberty measure
 No. of early menarche−0.050−0.090−0.0110.01281.3
 PDS−0.109−0.2680.0500.18082.1
 Tanner staging−0.270−0.515−0.0250.031—
 age at menarche0.013−0.1720.1990.88999.3
Original variable type
 categorical−0.073−0.114−0.0310.00182.1
 continuous−0.011−0.2540.2330.93199.5
 others0.098−0.1370.3330.41565.3
Study design
 cross-sectional−0.050−0.1940.0940.49299.3
 longitudinal−0.051−0.1410.0380.26291.4
Cohen’s d effect sizes coded such that more negative values reflect a stronger association between early pubertal timing and ACEs. No. of early menarche = number of participants with early menarche.

Share and Cite

MDPI and ACS Style

Zhang, L.; Zhang, D.; Sun, Y. Adverse Childhood Experiences and Early Pubertal Timing Among Girls: A Meta-Analysis. Int. J. Environ. Res. Public Health 2019, 16, 2887. https://doi.org/10.3390/ijerph16162887

AMA Style

Zhang L, Zhang D, Sun Y. Adverse Childhood Experiences and Early Pubertal Timing Among Girls: A Meta-Analysis. International Journal of Environmental Research and Public Health. 2019; 16(16):2887. https://doi.org/10.3390/ijerph16162887

Chicago/Turabian Style

Zhang, Lei, Dandan Zhang, and Ying Sun. 2019. "Adverse Childhood Experiences and Early Pubertal Timing Among Girls: A Meta-Analysis" International Journal of Environmental Research and Public Health 16, no. 16: 2887. https://doi.org/10.3390/ijerph16162887

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop