Next Article in Journal
Attachment Style Is Related to Quality of Life for Assistance Dog Owners
Previous Article in Journal
Level of Sedentary Behavior and Its Associated Factors among Saudi Women Working in Office-Based Jobs in Saudi Arabia
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Paternal Risk Factors for Oral Clefts in Northern Africans, Southeast Asians, and Central Americans

by
Stephanie Ly
1,2,
Madeleine L. Burg
3,
Ugonna Ihenacho
4,
Frederick Brindopke
1,
Allyn Auslander
1,
Kathleen S. Magee
5,
Pedro A. Sanchez-Lara
6,
Thi-Hai-Duc Nguyen
7,
Viet Nguyen
7,
Maria Irene Tangco
8,9,
Angela Rose Hernandez
8,9,
Melissa Giron
10,
Fouzia J. Mahmoudi
11,
Yves A. DeClerck
12,
William P. Magee III
1 and
Jane C. Figueiredo
4,13,*
1
Division of Plastic & Maxillofacial Surgery, Children’s Hospital Los Angeles, Los Angeles, CA 90027, USA
2
Department of Community Health Sciences and California Center for Population Research (CCPR), UCLA Fielding School of Public Health, Los Angeles, CA 90095, USA
3
Department of Medicine, Keck School of Medicine, University of Southern California, Los Angeles, CA 90033, USA
4
Department of Preventive Medicine, Keck School of Medicine, University of Southern California, Los Angeles, CA 90033, USA
5
Operation Smile Inc., Virginia Beach, VA 23453 USA
6
Departments of Pediatrics and Pathology and Laboratory Medicine, Keck School of Medicine, University of Southern California, Children’s Hospital Los Angeles, Los Angeles, CA 90027, USA
7
Operation Smile Vietnam, Hanoi 100803, Vietnam
8
Operation Smile Philippines, Makati City 1209, Philippines
9
Department of Surgery, Faculty of Medicine and Surgery, University of Santo Tomas, Manila 1008, Philippines
10
Operación Sonrisa Honduras, Tegucigalpa 11101, Honduras
11
Operation Smile Morocco, Casablanca 20 000, Morocco
12
Departments of Pediatrics and Biochemistry and Molecular Biology, Keck School of Medicine, University of Southern California and Children’s Hospital Los Angeles, Los Angeles, CA 90027, USA
13
Department of Medicine, Samuel Oschin Comprehensive Cancer Institute, Cedars-Sinai Medical Center 8700 Beverly Blvd, Room AC1072, Los Angeles, CA 90048, USA
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2017, 14(6), 657; https://doi.org/10.3390/ijerph14060657
Submission received: 26 April 2017 / Revised: 9 June 2017 / Accepted: 15 June 2017 / Published: 19 June 2017
(This article belongs to the Section Global Health)

Abstract

:
While several studies have investigated maternal exposures as risk factors for oral clefts, few have examined paternal factors. We conducted an international multi-centered case–control study to better understand paternal risk exposures for oral clefts (cases = 392 and controls = 234). Participants were recruited from local hospitals and oral cleft repair surgical missions in Vietnam, the Philippines, Honduras, and Morocco. Questionnaires were administered to fathers and mothers separately to elicit risk factor and family history data. Associations between paternal exposures and risk of clefts were assessed using logistic regression adjusting for potential confounders. A father’s personal/family history of clefts was associated with significantly increased risk (adjusted OR: 4.77; 95% CI: 2.41–9.45). No other significant associations were identified for other suspected risk factors, including education (none/primary school v. university adjusted OR: 1.29; 95% CI: 0.74–2.24), advanced paternal age (5-year adjusted OR: 0.98; 95% CI: 0.84–1.16), or pre-pregnancy tobacco use (adjusted OR: 0.96; 95% CI: 0.67–1.37). Although sample size was limited, significantly decreased risks were observed for fathers with selected occupations. Further research is needed to investigate paternal environmental exposures as cleft risk factors.

1. Introduction

Oral clefts represent the most common craniofacial birth defect affecting 1–2 per 1000 live births globally with substantial variability by geographic region and ethnic/racial origin, highlighting the importance of genetic and environmental factors [1,2,3]. Research on maternal risk factors from our study [4] and others [5,6,7,8,9] have demonstrated that selected exposures, including nutrition, smoking, alcohol, medications, and chemicals, are associated with oral clefts. Noticeably lacking are data on paternal-specific factors that may influence the risk of oral clefts.
Overall, few paternal factors have been hypothesized to be associated with birth defects, most notably advanced age [10], family history [4,11,12], socioeconomic status (SES) [4,13,14,15,16], smoking [17,18,19,20], and occupational status/exposures [8,21,22]. Advanced paternal age has been shown to be a likely risk factor for oral clefts, although there is significant variability in the definition of “advanced age” across studies [13,23,24,25]. A large meta-analysis found an increased risk of 58% for isolated cleft palate in fathers greater than 40 years old (OR: 1.58, 95% CI: 1.15–2.17) [26]. Paternal family history of clefts has also been consistently identified as a risk factor [4,11,12]. In our prior study using maternal reports of a father’s cleft status, we found an increased risk of oral clefts in children with either fathers or paternal relatives who also had clefts (OR: 10.5, 95% CI: 5.9–18.8) [4]. Paternal smoking has been associated with an increased risk of oral clefts in some studies [4,15,27,28], but not others [5,8,29]. Fathers with lower education levels and/or lower socioeconomic status have been shown to have higher risk of children with oral clefts in several studies [4,13,14,15,16]. Lastly, certain occupational exposures, such as pesticides [6,30,31] have been hypothesized to be associated with a higher risk of clefts with inconclusive evidence. Overall, studies examining paternal exposures have been based on small sample sizes and proxy reports from mothers, and lack specificity to identify specific exposures associated with specific congenital conditions [16,21,32].
In this report, we present an international case–control study on paternal exposures in diverse, underserved populations to further examine the paternal risk factors for clefts independent of maternal factors.

2. Methods

2.1. Study Population

Methods have been previously published [4]. In brief, we used a case–control study design and collected data on children with cleft lip with or without cleft palate (CL ± P) and cleft palate only (CP) (cases), children without any oral clefts (controls), and their parents in Vietnam, the Philippines, Honduras, and Morocco. Male and female children with a diagnosis of an isolated non-syndromic oral cleft who were singleton births, under age 3, and accompanied by a parent (age ≥18 years) were eligible for inclusion. A pediatrician or clinical geneticist assisted in screening children with oral clefts for other congenital malformations or suspected genetic syndromes, although it was not possible to screen for subclinical or asymptomatic anomalies. Case children were recruited during surgical missions between 2011 and 2015 with Operation Smile, an international not-for-profit organization that specializes in treatment of patients with cleft lip and/or cleft palate, providing millions of patient evaluations and hundreds of thousands of free surgeries across the globe for children and young adults born with craniofacial deformities.
Eligible controls were healthy children of age 3 and under without an oral cleft or other physical congenital malformation at public hospitals in each country from 2011 to 2015. Other exclusion criteria included children who were twins or triplets, children with other congenital anomalies (including limb, craniofacial or skeletal abnormalities), and those whose mothers were pregnant at the time of data collection or had a subsequent pregnancy to reduce the possibility of misreporting exposures unrelated to the pregnancy of interest. Table 1 outlines the dates and location of the data collection sites.
All subjects provided written and/or verbal informed consent. This study was approved by the Institutional Review Board of the University of Southern California (FWA #: 00005906) and the University of Santo Tomas IRB in Manila, Philippines (FWA #: A00009240). In Vietnam, Honduras, and Morocco, collaborating hospital directors reviewed the study and made revisions regarding ethical, cultural, clinical, and vocabulary appropriateness and provided an authorization for human subject research, which were reviewed by the Institutional Review Board of the University of Southern California.

2.2. Data Collection and Variable Definitions

Data collection procedures for mothers have been previously published [4]. In this report, we include data collection procedures for interviewing fathers. In brief, all fathers of case and control children were interviewed by a local research assistant at the participating hospitals and clinics in each of the four countries. Research recruiters were trained to interview participants in a standardized manner using a risk factor questionnaire. Fathers and mothers were interviewed in separate areas whenever possible to ensure independent responses. Fathers were asked to report their lifestyle during the periconceptional period (defined as 12–18 months prior to the birth of the child) on demographics, location of residence, alcohol use, tobacco use, health conditions and family history, environmental exposures (i.e., chemicals, radiation), and occupation.
Smoking was defined as regular use of tobacco products, including cigarettes, cigars, and pipes. Alcohol use was defined as regular consumption of wine, beer, or liquor. If present, mothers of these children were also asked to report independently on selected paternal factors, including family history of oral clefting and other health conditions, selected exposures (i.e., smoking), and lifestyle (i.e., educational level, income, and employment status).

2.3. Statistical Analysis

To assess potential differences based on parental involvement (mother and father, mother only, or father only), we compared selected characteristics of the study population using chi-square tests for categorical variables (or Fisher’s exact test for variables with small numbers) and Student’s t-tests for continuous variables. Data for parental groups with both a participating mother and father (n = 626) were used for further analysis in order to adjust for maternal risk factors as reported on the mother’s questionnaire. Logistic regression was used to calculate odds ratios (OR) and 95% confidence intervals (CI) to measure the association between selected self-reported paternal exposures and risk of oral cleft in their children. Adjusted models included the following potential confounders and maternal risk factors: child’s sex, the mother’s place of residence during pregnancy (rural/city), the mother’s and father’s employment status (employed/unemployed), the mother’s and father’s education (completed primary school or less/completed secondary school or more), the mother’s and father’s age at time of delivery, and country. For mothers and fathers missing age at time of delivery, a mean value for age by country and case status was imputed. A “missing” response was created for categorical variables. p-values less than 0.05 were considered statistically significant.
Additionally, maternal reports on paternal exposures were compared to results of self-reported paternal data. Kappa statistics were evaluated to assess agreement between mother and father reports. Assessment of adequate agreement was evaluated at the threshold of kappa coefficients greater than 0.70. Assessment of poor agreement was evaluated at threshold of kappa coefficients less than 0.40.
All statistical analysis was performed using SAS software, Version 9.4 of the SAS System for Windows (SAS Institute Inc., Cary, NC, USA).

3. Results

Characteristics of the entire study population and the subset with information from fathers are shown in Table 2. There were 626 (24.2%) families with a mother and father that completed a questionnaire, 1895 (73.1%) families with only a mother that completed a questionnaire, and 71 (2.7%) families with only a father that completed a questionnaire. By case status, families with an affected child were more likely to have both parents or only fathers complete a questionnaire compared to control families (p < 0.01). There was also a significant difference in the participation of mothers and fathers by country (p < 0.01). The majority of families with a participating father and mother, or a mother only, were from Vietnam (40.1% and 36.8%, respectively). The majority of the families with only a participating father were from Morocco (39.4%). More mothers and mothers’ families with clefts were reported among families with a participating mother and father (15.8%, p < 0.01), but otherwise there were no significant differences by participant group in maternal factors according to the mother. In regard to paternal factors according to the father, pre-pregnancy alcohol use, tobacco use, and cigarette use was reported more frequently among fathers with participating mothers compared to families with fathers only (p < 0.01, p = 0.49, and p = 0.02, respectively).
Comparing parental reports of paternal factors, we found reasonable agreement among a father’s cleft status (κ: 0.83; 95% CI: 0.67–0.99), a father’s family history of clefts (κ: 0.80; 95% CI: 0.72–0.87), and education (κ: 0.77; 95% CI: 0.72–0.81, Table 3). Moderate agreement was observed for several variables, notably, employment status (κ: 0.68; 95% CI: 0.57–0.79), household tobacco use (κ: 0.65; 95% CI: 0.59–0.71), cigarette use (κ: 0.66; 95% CI: 0.60–0.72), and other tobacco use (κ: 0.66; 95% CI: 0.23–1.00). Poor agreement was found for sexually transmitted infections (HIV and syphilis), diabetes and selected industrial/chemical exposures. Fully concordant responses were given for the assessment of Japanese encephalitis among Vietnamese and Filipino populations and cigar use among the Moroccan mission population (data not shown).
Table 4 provides the measures of association for selected paternal factors and risk of a child with a cleft. Both father’s cleft status (adjusted OR: 3.31; 95% CI: 0.40–27.5) and father’s family history of clefts (adjusted OR: 5.01; 95% CI: 2.46–10.2) were statistically significantly associated with an increased risk (data not shown). When these variables were combined (father’s cleft status and father’s family history of clefts), the adjusted OR was 4.77 (95% CI: 2.41–9.45). Advanced paternal age (5-year adjusted OR: 0.98; 95% CI: 0.84–1.16), pre-pregnancy tobacco use (adjusted OR: 0.96; 95% CI: 0.67–1.37), and pre-pregnancy cigarette use (adjusted OR: 0.95; 95% CI: 0.66–1.37) were not significantly associated with cleft risk. Education level, employment status, and alcohol use were also not statistically significantly associated with risk. When we subdivided occupation into specified categories, exposure to industrial chemicals was associated with a decreased risk of oral cleft (adjusted OR: 0.51; 95% CI: 0.30–0.85) as well as some occupations (mechanics, adjusted OR: 0.54; 95% CI: 0.30–0.95; chemical factory workers, adjusted OR: 0.42; 95% CI: 0.20–0.87; carpenters, adjusted OR: 0.40; 95% CI: 0.23–0.71; and electricians, adjusted OR: 0.47; 95% CI: 0.24–0.94), although sample sizes were limited.

4. Discussion

While several maternal exposures have been demonstrated to affect fetal development, paternal exposures are largely unexplored risk factors. Additionally, many studies that report “paternal” risk factors are based on proxy reports from mothers. Here we present data from four international centers in underserved areas to further explore paternal-specific effects on the risk of oral clefts, while accounting for known maternal risk factors. Our results show that a father’s cleft status and family history of clefts are risk factors independent of maternal exposures; however, we found no evidence of paternal environmental risk factors.
The inheritance pattern of oral clefts is thought to be multifactorial, and research has shown a higher recurrence rate in those of affected family members [33], including paternal family history [34]. Our results showed the strongest paternal risk factors to be a father’s cleft status (adjusted OR: 3.31; 95% CI: 0.40–27.5) and a father’s family history of clefts (adjusted OR: 5.01; 95% CI: 2.46–10.2), which supports the important role of genetics in the incidence of oral clefts. Further research is warranted exploring the numbers of generations between affected paternal family members and the child, as well as large population-based studies examining rates of subclinical cleft lip and/or cleft palate amongst fathers of affected children, to fully determine the role of paternal genetics in oral clefts.
Selected paternal occupational and/or chemical exposures have been implicated with a higher incidence of birth defects among their children; however, research specifically examining oral clefts has been inconsistent [8,21,27,35]. The hypothesized mechanism is that occupational exposures may affect DNA integrity prior to conception [36,37]. However, our research found a decreased risk of oral clefts with industrial chemical exposure, along with most fathers who held any type of employment. Although unexpected, these findings among employed fathers may reflect a better standard of living and thus access to prenatal care, due to a higher socioeconomic status, which are associated with lower risk. Further research thoroughly examining the amount and frequency of chemical exposure is needed to confirm this observation.
Previous studies have observed an association between paternal smoking and birth defects among their children [7,15,27]. Our study did not find paternal smoking to be a risk factor after adjustment for other confounders using reports from fathers, in contrast to our previous analysis using proxy reports from mothers (OR: 1.5, 95% CI: 1.1–1.9) [4]. This may reflect the difference in sample size as current reports among father is based on only half the sample size of our prior study focused on mothers. Also of note, data reported from mothers showed a higher proportion of smoking compared to those obtained directly from fathers, which may represent underreporting of tobacco use by fathers. Further research is needed to clarify the role of paternal smoking in oral clefts.
There are several noted strengths and limitations of our study. The data presented here represents one of the largest and most diverse studies focused on paternal-specific exposures. The limitations of this study include a clinic-based study design, biases associated with paternal self-reported data, and a limited sample size. Other factors beyond the scope of our questionnaire that may affect the overall health of the father include atmospheric exposures and water and air quality.

5. Conclusions

Oral clefts represent one of the most common birth defects among children born worldwide. Although maternal factors have been studied for decades, there is an important need for studies examining paternal-specific risk factors. Our results suggest that paternal cleft status and family history of clefts are risk factors independent of maternal exposure. We found no evidence of increased risk of oral clefts with paternal environmental risk factors.

Acknowledgments

We are indebted to the mothers and fathers and their children who participated in this study and the local medical centers who facilitated our research. We would like to thank the following individuals at the various institutions for their assistance in logistical support and management during missions, interviewing parents, sample preparation, and data entry: University of Southern California: Julissa Ramirez, Nathalie Nguyen, Yaquelin Perez, Daniel Collin, Jessica Khankhanian, Serena Zhou, Anh T. Diep, Lia Jacobson, Nicolle Rueras, Joanna Filopoulos, Kelsie Cowman, Ha Dang, Brian Davis, Annie Vu, Grace Jang, Emily Zolfaghari, Katelyn Krolick, Annie Pham, Louella Gonzalez, and Yvette Estrada. Operation Smile International: Haley Marie Raimondi, Ana Karina Lizarraga, Melissa Dibona, Beth Marshall, Trevor Hebenstreit, Melissa Medel, Lili Arakaki, and Joey Feduniewicz. Operation Smile South Africa: Mwepu Idesbald Mwebe, Nunda Misabe’o Pacifique, Sifa Kinyongo Angie, Nawej Fidelie, Tamlin Abrahams, Mark Beers, Melissa Hodges, Max Ryan, Kia Guarino, Sara Cowles, Aime Lokulutu Boongo, Yona Sibusisiwe, Fukiau Degach, Mbakata Carine, Shabani Raissa, Yeman Ruphin, Kanjinga Genevieve, and Lumande Kasindi Fidele. Operation Smile Vietnam: Viet Nguyen, Thi-Hai-Duc Nguyen, Hanh Nguyen, Kim Dung, Margot Neufeld, Ta Mai Ly, Dao Quang Anh, Bao Ngoc Nguyen, Anh Nguyen Thi Nguyet, Hoa Ngo Thi Kim, Linh Le Thuy, Nguyen Minh Trang, Thanh Le, Vu Trang, Hung Nguyen Ngoc, and Thuy Bui. Operation Smile Morocco: Boukind El Hassan, Najib Jilali, Othmane El Ammouni, Abderrahim Lagdani, Mehdi Merimi, Nour Mahmoudi, Yassine Rabba Fakri, Mounir Benmoumen, Mohammed El Meknassia, Zahra Sokar. Operation Smile Philippines, University of Santo Tomas, HOPE Volunteers Foundation, Teresita L. Jalandoni Provincial Hospital, Corazon Locsin Montelibano Memorial Regional Hospital: Leo Angelo Doble, Angela Rose C. Hernandez, Governor Alfredo G. Marañon, Jr., Edith Y. Villanueva, Ceres Baldevia-Gay, Gloria Melocoton, Monica T. Aguilar, Ken Atonson, Percinie Mendoza, Akiko Miyagi, Syrus R. Valiao, Rhea Mae Magbanua, Roville Balajadia, Bianca Marie Ordoñez, Winnie Sombilo, Vincent Villaruz, Cheza Mira, Nelly Ramos, Kiev Jasper Tamayo, Leslie Mae Marsado, Angelica Tangco, Vincent Reyles, Vivina Chiu, Willie Go, Gian Trebol, and Weng Velasquez. Operación Sonrisa Honduras & Hospital San Felipe: Giannina Güell, Oscar Sarmiento, Pedro Zelaya, Jeanie Barjum, Melissa Girón, Danilo Reyes, Jessie Carrasco, Vanessa Betancourth, Leticia López, Ibeth Corrales, Seydi Sánchez, Bianka Vasquez, Jocelyn Chevez, Alejandra Molina, Rafael Pineda, Giselle Mejia, Daniela Aragon, Esther Urquia, Yorlenis Hernandez, Robert Mudgett, Sofía Coto, Tamar Bendeck, Vivi Montoya, Elly van Steenwyk, Llairam Eblasi Rodas, Dairamise Rodas, Linda Orellana Bertrand, Evelyn Rivera, Josseline Argeñal, Rosa Elvir, Maira Ramos Mejia, Marcela A. Cerrato, Reina Izaguirre, Kellyn Ramos, Sandra Perdomo, Carlos Roberto Garcia, Oscar Rodriguez, and Nathalie Penman. Institutional funds from Keck School of Medicine of USC (J.C.F.), Operation Smile International (K.M.), Sorenson Legacy Foundation (K.M.), the Rallis Foundation (K.M.), the Marguerite Foundation (K.M.), and the California Community Adelaide Foundation (W.M.).

Author Contributions

Jane C. Figueiredo, Ugonna Ihenacho, and Stephanie Ly conceived study and contributed to study design and methodology, analysis and interpretation of data, and writing of the manuscript. Frederick Brindopke contributed to study methodology, data collection, and data analysis. Madeleine L. Burg contributed to data collection and writing and submission of manuscript. William P. Magee III, Pedro A. Sanchez-Lara, Kathleen S. Magee, Allyn Auslander, Yves A. DeClerck, Maria Irene Tangco, Angela Rose Hernandez, Melissa Giron, Thi-Hai-Duc Nguyen, Viet Nguyen, and Fouzia J. Mahmoudi contributed to study materials, data collection, interpretation of data, and writing of the manuscript.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Mossey, P.A.; Little, J.; Munger, R.G.; Dixon, M.J.; Shaw, W.C. Cleft lip and palate. Lancet 2009, 374, 1773–1785. [Google Scholar] [CrossRef]
  2. Murray, J.C. Gene/environment causes of cleft lip and/or palate. Clin. Genet. 2002, 61, 248–256. [Google Scholar] [CrossRef] [PubMed]
  3. Dixon, M.J.; Marazita, M.L.; Beaty, T.H.; Murray, J.C. Cleft lip and palate: Understanding genetic and environmental influences. Nat. Rev. Genet. 2011, 12, 167–178. [Google Scholar] [CrossRef] [PubMed]
  4. Figueiredo, J.C.; Ly, S.; Magee, K.S.; Ihenacho, U.; Baurley, J.W.; Sanchez-Lara, P.A.; Brindopke, F.; Nguyen, T.H.; Nguyen, V.; Tangco, M.I.; et al. Parental risk factors for oral clefts among central africans, southeast asians, and central americans. Birth Defect. Res. A Clin. Mol. Teratol. 2015, 103, 863–879. [Google Scholar] [CrossRef] [PubMed]
  5. Shaw, G.M.; Wasserman, C.R.; Lammer, E.J.; O’Malley, C.D.; Murray, J.C.; Basart, A.M.; Tolarova, M.M. Orofacial clefts, parental cigarette smoking, and transforming growth factor-alpha gene variants. Am. J. Hum. Genet. 1996, 58, 551–561. [Google Scholar] [PubMed]
  6. Garcia, A.M.; Fletcher, T.; Benavides, F.G.; Orts, E. Parental agricultural work and selected congenital malformations. Am. J. Epidemiol. 1999, 149, 64–74. [Google Scholar] [CrossRef] [PubMed]
  7. Krapels, I.P.; Zielhuis, G.A.; Vroom, F.; de Jong-van den Berg, L.T.; Kuijpers-Jagtman, A.M.; van der Molen, A.B.; Steegers-Theunissen, R.P.; Eurocran Gene-Environment Interaction Group. Periconceptional health and lifestyle factors of both parents affect the risk of live-born children with orofacial clefts. Birth Defect. Res. A Clin. Mol. Teratol. 2006, 76, 613–620. [Google Scholar] [CrossRef] [PubMed]
  8. Mirilas, P.; Mentessidou, A.; Kontis, E.; Asimakidou, M.; Moxham, B.J.; Petropoulos, A.S.; Emmanouil-Nikolousi, E.N. Parental exposures and risk of nonsyndromic orofacial clefts in offspring: A case-control study in Greece. Int. J. Pediatr. Otorhinolaryngol. 2011, 75, 695–699. [Google Scholar] [CrossRef] [PubMed]
  9. Valentine, J.L.; Cebrian, M.E.; Garcia-vargas, G.G.; Faraji, B.; Kuo, J.; Gibb, H.J.; Lachenbruch, P.A. Daily selenium intake estimates for residents of arsenic-endemic areas. Environ. Res. 1994, 64, 1–9. [Google Scholar] [CrossRef] [PubMed]
  10. Buwe, A.; Guttenbach, M.; Schmid, M. Effect of paternal age on the frequency of cytogenetic abnormalities in human spermatozoa. Cytogenet. Genome Res. 2005, 111, 213–228. [Google Scholar] [CrossRef] [PubMed]
  11. Buyu, Y.; Manyama, M.; Chandika, A.; Gilyoma, J. Orofacial clefts at bugando medical centre: Associated factors and postsurgical complications. Cleft Palate Craniofac. J. 2012, 49, 736–740. [Google Scholar] [CrossRef] [PubMed]
  12. Leite, I.C.; Koifman, S. Oral clefts, consanguinity, parental tobacco and alcohol use: A case-control study in Rio de Janeiro, Brazil. Braz. Oral. Res. 2009, 23, 31–37. [Google Scholar] [CrossRef] [PubMed]
  13. Omo-Aghoja, V.W.; Omo-Aghoja, L.O.; Ugboko, V.I.; Obuekwe, O.N.; Saheeb, B.D.; Feyi-Waboso, P.; Onowhakpor, A. Antenatal determinants of oro-facial clefts in southern nigeria. Afr. Health Sci. 2010, 10, 31–39. [Google Scholar] [PubMed]
  14. Rosano, A.; Del Bufalo, E.; Burgio, A. Socioeconomic status and risk of congenital malformations. Epidemiol. Prev. 2008, 32, 21–26. [Google Scholar] [PubMed]
  15. Hao, Y.; Tian, S.; Jiao, X.; Mi, N.; Zhang, B.; Song, T.; An, L.; Zheng, X.; Zhuang, D. Association of parental environmental exposures and supplementation intake with risk of nonsyndromic orofacial clefts: A case-control study in Heilongjiang province, China. Nutrients 2015, 7, 7172–7184. [Google Scholar] [CrossRef] [PubMed]
  16. Yang, J.; Carmichael, S.L.; Canfield, M.; Song, J.; Shaw, G.M.; National Birth Defects Prevention Study. Socioeconomic status in relation to selected birth defects in a large multicentered us case-control study. Am. J. Epidemiol. 2008, 167, 145–154. [Google Scholar] [CrossRef] [PubMed]
  17. Cresci, M.; Foffa, I.; Ait-Ali, L.; Pulignani, S.; Gianicolo, E.A.; Botto, N.; Picano, E.; Andreassi, M.G. Maternal and paternal environmental risk factors, metabolizing GSTM1 and GSTT1 polymorphisms, and congenital heart disease. Am. J. Cardiol. 2011, 108, 1625–1631. [Google Scholar] [CrossRef] [PubMed]
  18. Jianyan, L.; Zeqiang, G.; Yongjuan, C.; Kaihong, D.; Bing, D.; Rongsheng, L. Analysis of interactions between genetic variants of bmp4 and environmental factors with nonsyndromic cleft lip with or without cleft palate susceptibility. Int. J. Oral. Maxillofac. Surg. 2010, 39, 50–56. [Google Scholar] [CrossRef] [PubMed]
  19. Zhang, J.; Savitz, D.A.; Schwingl, P.J.; Cai, W.W. A case-control study of paternal smoking and birth defects. Int. J. Epidemiol. 1992, 21, 273–278. [Google Scholar] [CrossRef] [PubMed]
  20. Du, J.M.; Guo, W.H.; Han, J.; Zhuang, H.X. Case control study on risk factors of congenital microtia. Zhonghua Er Bi Yan Hou Tou Jing Wai Ke Za Zhi 2006, 41, 107–111. [Google Scholar] [PubMed]
  21. Desrosiers, T.A.; Herring, A.H.; Shapira, S.K.; Hooiveld, M.; Luben, T.J.; Herdt-Losavio, M.L.; Lin, S.; Olshan, A.F.; National Birth Defects Prevention Study. Paternal occupation and birth defects: Findings from the national birth defects prevention study. Occup. Environ. Med. 2012, 69, 534–542. [Google Scholar] [CrossRef] [PubMed]
  22. Qi, L.; Liu, J.; Zhang, Y.; Wang, J.; Yang, M.; Gong, T.; Shen, M.; Du, Y. Risk factors for non-syndromic oral clefts: A matched case-control study in Hubei province, China. Oral. Dis. 2013. [Google Scholar] [CrossRef] [PubMed]
  23. Salihu, S.; Krasniqi, B.; Sejfija, O.; Heta, N.; Salihaj, N.; Geci, A.; Sejdini, M.; Arifi, H.; Isufi, R.; Ueeck, B.A. Analysis of potential oral cleft risk factors in the kosovo population. Int. Surg. 2014, 99, 161–165. [Google Scholar] [CrossRef] [PubMed]
  24. Green, R.F.; Devine, O.; Crider, K.S.; Olney, R.S.; Archer, N.; Olshan, A.F.; Shapira, S.K.; National Birth Defects Prevention Study. Association of paternal age and risk for major congenital anomalies from the national birth defects prevention study, 1997 to 2004. Ann. Epidemiol. 2010, 20, 241–249. [Google Scholar] [CrossRef] [PubMed]
  25. Gonzalez, B.S.; Lopez, M.L.; Rico, M.A.; Garduno, F. Oral clefts: A retrospective study of prevalence and predisposal factors in the state of mexico. J. Oral Sci. 2008, 50, 123–129. [Google Scholar] [CrossRef] [PubMed]
  26. Herkrath, A.P.; Herkrath, F.J.; Rebelo, M.A.; Vettore, M.V. Parental age as a risk factor for non-syndromic oral clefts: A meta-analysis. J. Dent. 2012, 40, 3–14. [Google Scholar] [CrossRef] [PubMed]
  27. Campos Neves, A.T.; Volpato, L.E.; Espinosa, M.M.; Aranha, A.M.; Borges, A.H. Environmental factors related to the occurrence of oral clefts in a brazilian subpopulation. Niger. Med. J. 2016, 57, 167–172. [Google Scholar] [CrossRef] [PubMed]
  28. Zhang, B.; Jiao, X.; Mao, L.; Xue, J. Cigarette smoke exposure before pregnancy and the associated risk of having a child with orofacial clefts in china: A case-control study. Plast. Reconstr. Surg. 2011, 127, 61e–62e. [Google Scholar] [CrossRef] [PubMed]
  29. Ebadifar, A.; Hamedi, R.; KhorramKhorshid, H.R.; Kamali, K.; Moghadam, F.A. Parental cigarette smoking, transforming growth factor-alpha gene variant and the risk of orofacial cleft in Iranian infants. Iran. J. Basic Med. Sci. 2016, 19, 366–373. [Google Scholar] [PubMed]
  30. Cordier, S. Evidence for a role of paternal exposures in developmental toxicity. Basic Clin. Pharmacol. Toxicol. 2008, 102, 176–181. [Google Scholar] [CrossRef] [PubMed]
  31. Lacasana, M.; Vazquez-Grameix, H.; Borja-Aburto, V.H.; Blanco-Munoz, J.; Romieu, I.; Aguilar-Garduno, C.; Garcia, A.M. Maternal and paternal occupational exposure to agricultural work and the risk of anencephaly. Occup. Environ. Med. 2006, 63, 649–656. [Google Scholar] [CrossRef] [PubMed]
  32. Brender, J.D.; Suarez, L.; Langlois, P.H. Parental occupation, hispanic ethnicity, and risk of selected congenital malformations in offspring. Ethn. Dis. 2008, 18, 218–224. [Google Scholar] [PubMed]
  33. Rahimov, F.; Jugessur, A.; Murray, J.C. Genetics of nonsyndromic orofacial clefts. Cleft Palate Craniofac. J. 2012, 49, 73–91. [Google Scholar] [CrossRef] [PubMed]
  34. Garg, P.; Ludwig, K.U.; Bohmer, A.C.; Rubini, M.; Steegers-Theunissen, R.; Mossey, P.A.; Mangold, E.; Sharp, A.J. Genome-wide analysis of parent-of-origin effects in non-syndromic orofacial clefts. Eur. J. Hum. Genet. 2014, 22, 822–830. [Google Scholar] [CrossRef] [PubMed]
  35. Romitti, P.A.; Herring, A.M.; Dennis, L.K.; Wong-Gibbons, D.L. Meta-analysis: Pesticides and orofacial clefts. Cleft Palate Craniofac. J. 2007, 44, 358–365. [Google Scholar] [CrossRef] [PubMed]
  36. Wei, Y.; Schatten, H.; Sun, Q.Y. Environmental epigenetic inheritance through gametes and implications for human reproduction. Hum. Reprod. Update 2015, 21, 194–208. [Google Scholar] [CrossRef] [PubMed]
  37. Abolghasemi, H.; Radfar, M.H.; Rambod, M.; Salehi, P.; Ghofrani, H.; Soroush, M.R.; Falahaty, F.; Tavakolifar, Y.; Sadaghianifar, A.; Khademolhosseini, S.M.; et al. Childhood physical abnormalities following paternal exposure to sulfur mustard gas in iran: A case-control study. Confl. Health 2010, 4, 13. [Google Scholar] [CrossRef] [PubMed]
Table 1. Dates and location of data collection sites.
Table 1. Dates and location of data collection sites.
CountryCities/ProvincesDates CollectedCollection Sites
VietnamHanoi, Can Tho, Hai Phong, Hue, Nghe An, Ho Chi Minh City, An GiangNovember 2011, November 2012, January 2013, November 2014, March 2015, October–December 2015Vietnam Cuba Friendship Hospital, Hanoi Maternity Hospital, Hanoi 108 Hospital, Hai Phong Provincial Hospital, Hue Hospital for Odonto-Stomatology, An Giang Hospital, Nghe An 115 Hospital, Thu Duc Hospital, Nghe An Provincial Hospital, Operation Smile Vietnam Care Center, Benh Vien Da Khoa Trung Uong Can Tho Hospital, HCMC Medical Center, Hue Medical and Pharmacy Hospital
PhilippinesBacolod CityNovember 2012University of Santo Tomas, HOPE Foundation Cleft Center, Corazon Montelibano Memorial Regional Hospital, Teresita L. Jalandoni Provincial Hospital, Ricardo P. Rodriguez Memorial Hospital, Escolastica Romero District Hospital, Diosdado P. Macapagal Memorial Hospital, Eastern Samar Provincial Hospital, Lying-In Clinic of Borongan City, General Emilio Aguinaldo Memorial Hospital, Paanakan sa Mandaue, Consolacion Municipal Health Office, Grengia Maternity House, St. Anthony Mother and Child Hospital, Our Lady of Mercy Hospital, Jesus A. Datu Medical Center, Operation Smile Care Center: Santa Ana, Miller Adventist Hospital
Silay City, Angeles City, Manila, Borongan, Dasmarinas City, Cebu, Davao CityJune 2014
Cebu City, Bacolod City, Pampanga, Santa AnaJune 2015
MoroccoMarrakesh and OujdaApril and August 2014Operation Smile Morocco, El Farabi Hospital
Dahkla and TiznitApril and August 2015Operation Smile Morocco, Hospital Hasan II (Dahkla), Hasan I (Tiznit) Hospital
HondurasTegucigalpa, Comayagua, Choluteca, Santa Rosa CopanOctober 2013, February 2014, June 2014, August 2014, November 2014, February 2015, April 2015, November 2015San Felipe Hospital, Operation Smile Honduras Clinic, Santa Teresa Regional Hospital, Hospital del Sur, Western Regional Hospital (Hospital Occidente)
Table 2. Comparison of families in the study with a participating father and those without a father available to participate.
Table 2. Comparison of families in the study with a participating father and those without a father available to participate.
CharacteristicsFamilies with a Participating Mother and FatherFamilies with a Non-Participating FatherFamilies with Non-Participating Motherp-Value *
N (%) 626 (24.2)1895 (73.1)71 (2.7)
Case status
 Case392 (62.6)869 (45.9)45 (63.4)<0.01 **
 Control234 (37.4)1021 (53.9)25 (35.2)
 Missing0 (0)5 (0.3)1 (1.4)
Country
 Vietnam251 (40.1)697 (36.8)14 (19.7)<0.01
 Philippines195 (31.2)530 (28.0)18 (25.4)
 Honduras119 (19.0)546 (28.8)11 (15.5)
 Morocco61 (9.74)122 (6.4)28 (39.4)
Sex
 Male384 (61.3)1051 (55.5)N/A<0.01 **
 Female239 (38.2)841 (44.4)
 Missing3 (0.5)3 (0.2)
Cleft type
 CL99 (25.3)225 (25.9)N/A0.98
 CLP220 (56.1)490 (56.4)
 CP67 (17.1)140 (16.1)
 Missing6 (1.5)14 (1.6)
MATERNAL FACTORS—according to mother
Age at birth, years
 mean (SD)27.2 (6.0)27.2 (6.1)Not collected0.89
Education level
 University159 (25.4)461 (24.3)Not collected0.26
 Secondary313 (50.0)934 (49.3)
 None/Primary150 (24.0)468 (24.7)
 Missing4 (0.6)32 (1.7)
Employment status
 Unemployed340 (54.3)1040 (54.9)Not collected0.91
 Employed275 (43.9)818 (43.2)
 Missing11 (1.8)37 (2.0)
Mother cleft status & mother’s family history of clefts
 Yes99 (15.8)211 (11.1)Not collected<0.01
 No525 (83.9)1675 (88.4)
 Missing2 (0.3)9 (0.5)
Location during pregnancy
 Rural277 (44.3)820 (43.3)Not collected0.76
 City301 (48.1)913 (48.2)
 Missing48 (7.7)162 (8.6)
PATERNAL FACTORS—according to father
Age at birth, years
 mean (SD)30.6 (7.0)Not collected31.6 (7.5)0.26
Education level
 University178 (28.4)Not collected18 (25.4)0.33
 Secondary296 (47.3)29 (40.9)
 None/Primary141 (22.5)23 (32.4)
 Missing11 (1.8)1 (1.4)
Pre-pregnancy employment status
 Unemployed26 (4.2)Not collected2 (2.8)0.93 **
 Employed579 (92.5)67 (94.4)
 Missing21 (3.4)2 (2.8)
Father’s cleft status & father’s family history of clefts
 Yes83 (13.3)Not collected13 (18.3)0.23
 No543 (86.7)58 (31.7)
 Missing0 (0)0 (0)
Chemical exposures
 Industrial chemical79 (12.6)Not collected6 (8.5)0.31
 Agricultural chemical188 (30.0)17 (23.9)0.29
 Radiation41 (6.6)5 (7.0)0.80 **
 Lead21 (3.5)1 (1.4)0.50 **
 Mercury11 (1.8)0 (0)0.61 **
 Chemical waste24 (3.8)0 (0)0.16 **
 Agent Orange (Vietnam only)6 (2.4)0(0)0.56
Pre-pregnancy alcohol use
 Yes409 (65.3)Not collected27 (38.0)<0.01 **
 No213 (34.0)43 (60.6)
 Missing4 (0.6)1 (1.4)
Pre-pregnancy tobacco use
 Yes244 (39.0)Not collected18 (25.4)0.049
 No376 (60.1)53 (74.7)
 Missing6 (1.0)0 (0)
Frequency of tobacco use
 <122 (9.0)Not collected2 (11.1)0.90 **
 1–347 (19.3)4 (22.2)
 6–1447 (19.3)5 (27.8)
 15–2041 (16.8)2 (11.1)
 20+82 (33.6)5 (27.8)
 Missing5 (2.1)0 (0)
Pre-pregnancy cigarette use
 Yes232 (37.1)Not collected16 (22.5)0.02
 No384 (61.3)55 (77.5)
 Missing10 (1.6)0 (0)
Frequency of cigarette use
 <122 (9.5)Not collected2 (12.5)0.82 **
 1–342 (18.1)4 (25.0)
 6–1444 (19.0)4 (25.0)
 15–2039 (16.8)1 (6.3)
 20+78 (33.6)5 (31.3)
 Missing7 (3.0)0 (0)
Father’s occupation
 Farmer272 (43.5)Not collected26 (36.6)0.27
 Driver104 (16.6)11 (15.5)0.81
 Mechanic60 (9.6)4 (5.6)0.27
 Factory worker35 (5.6)6 (8.5)0.29 **
 Carpenter62 (9.9)11 (15.5)0.15
 Painter65 (10.4)3 (4.2)0.10
 Welder58 (9.3)6 (8.5)0.82
 Electrician41 (6.6)3 (4.2)0.61 **
* X2 or ANOVA to for test for differences between families with and without a participating father. Data given as number and column percentages unless otherwise noted. ** p-value given by Fisher’s Exact Test.
Table 3. Kappa statistics on paternal exposures based on questionnaires completed by mothers and fathers *.
Table 3. Kappa statistics on paternal exposures based on questionnaires completed by mothers and fathers *.
VariableN **Kappa (95% CI)p-Value
Father’s cleft status5980.83 (0.67–0.99)<0.0001
Father’s family history of clefts6000.80 (0.72–0.87)<0.0001
Education5970.77 (0.72–0.81)<0.0001
Employment status5970.68 (0.57–0.79)<0.0001
Malaria5320.70 (0.54–0.85)<0.0001
Typhoid5800.51 (0.26–0.76)<0.0001
Hepatitis5830.62 (0.44–0.80)<0.0001
Dengue5820.65 (0.54–0.77)<0.0001
Meningitis5380 (0–0)-
HIV582−0.002 (−0.004–0.001)0.97
Syphilis531−0.002 (−0.005–0.001)0.97
Birth defect5850.50 (−0.10–1.00)<0.0001
Vision defect5860.69 (0.52–0.87)<0.0001
Hearing defect5850.44 (0.03–0.85)<0.0001
Diabetes579−0.002 (−0.006–0.001)0.95
Other condition4830.47 (0.22–0.71)<0.0001
Household tobacco use6080.65 (0.59–0.71)<0.0001
Household tobacco use frequency (N = 215)2060.59 (0.50–0.68)<0.0001
Cigarette use5950.66 (0.60–0.72)<0.0001
Other tobacco use3710.66 (0.23–1.00)<0.0001
Industrial chemical exposure5470.38 (0.27–0.50)<0.0001
Agricultural chemicals exposure5460.51 (0.43–0.59)<0.0001
Thuoc lao use—Vietnam only (N = 251)1120.76 (0.61–0.92)<0.0001
Agent orange exposure—Vietnam only (N = 251)2250.24 (−0.16–0.64)<0.0001
Tuberculosis—Vietnam only (N = 251)2340.80 (0.52–1.00)<0.0001
* Evaluated for questions where both mother and father provided a response (missing responses excluded from analysis). ** Total N varies due to missing values. Weighted kappa reported.
Table 4. Paternal health status and exposures prior to conception and the risk of a child with an orofacial cleft.
Table 4. Paternal health status and exposures prior to conception and the risk of a child with an orofacial cleft.
CasesControlsCrude OR (95% CI)Adjusted OR (95% CI)
N (%)392 (62.6)234 (37.4)
* Age at birth, years
 mean (SD)31.0 (7.3)30.0 (6.4)1.11 (0.99–1.25)0.98 (0.84–1.16)
Father’s and father’s family history of clefts
 Yes72 (18.4)11 (4.7)4.66 (2.40–9.01) 4.77 (2.41–9.45)
 No320 (81.6)223 (95.3)RefRef
Education level
 University93 (23.7)85 (36.3)RefRef
 Secondary195 (49.7)101 (43.2)1.77 (1.21–2.59) 1.47 (0.97–2.21)
 None/Primary94 (24.0)47 (20.1)1.89 (1.17–3.06) 1.29 (0.74–2.24)
 Missing10 (2.6)1 (0.4)
Pre-pregnancy employment status
 Unemployed12 (3.1)14 (6.0)RefRef
 Employed366 (93.4)213 (91.0)2.03 (0.92–4.50)2.08 (0.90–4.85)
 Missing14 (3.6)7 (3.0)
Pre-pregnancy alcohol use
 Yes247 (63.0)162 (69.2)0.70 (0.46–1.06)0.77 (0.49–1.21)
 No141 (36.0)72 (30.8)RefRef
 Missing4 (1.0)0 (0)
Pre-pregnancy tobacco use
 Yes149 (38.0)95 (40.6)0.91 (0.65–1.27)0.96 (0.67–1.37)
 No238 (60.7)138 (59.0)RefRef
 Missing5 (1.3)1 (0.4)
Frequency of tobacco use
 <117 (11.4)5 (5.3)RefRef
 1–328 (18.8)19 (20.0)0.39 (0.12–1.26)0.42 (0.12–1.45)
 6–1428 (18.8)19 (20.0)0.37 (0.11–1.20)0.46 (0.13–1.64)
 15–2027 (18.1)14 (14.7)0.52 (0.16–1.72)0.65 (0.18–2.34)
 20+44 (29.5)38 (40.0)0.29 (0.10–0.89) 0.34 (0.10–1.12)
 Missing5 (3.4)0 (0)
Pre-pregnancy cigarette use
 Yes140 (35.7)92 (39.3)0.88 (0.63–1.23)0.95 (0.66–1.37)
 No243 (62.0)141 (60.3)RefRef
 Missing9 (2.3)1 (0.4)
Frequency of cigarette use
 <117 (12.1)5 (5.4)RefRef
 1–324 (17.1)18 (19.6)0.37 (0.11–1.20)0.40 (0.11–1.42)
 6–1425 (17.9)19 (20.7)0.34 (0.10–1.10)0.41 (0.11–1.49)
 15–2026 (18.6)13 (14.1)0.54 (0.16–1.81)0.68 (0.19–2.52)
 20+42 (30.0)36 (39.1)0.31 (0.21–23.6)0.33 (0.10–1.11)
 Missing6 (4.3)1 (1.1)
Chemical exposures
 Industrial chemical40 (10.2)39 (16.7)0.57 (0.35–0.91) 0.51 (0.30–0.85)
 Agricultural chemical129 (32.9)59 (25.2)1.47 (1.02–2.12) 0.99 (0.66–1.49)
 Radiation20 (5.1)21 (9.0)1.83 (0.97–3.46)0.66 (0.33–1.33)
 Lead10 (2.6)12 (5.1)0.48 (0.21–1.14)0.39 (0.15–1.01)
 Mercury5 (1.3)6 (2.6)0.49 (0.15–1.63)0.37 (0.09–1.47)
 Chemical waste12 (3.1)12 (5.1)0.58 (0.26–1.32)0.58 (0.24–1.42)
 Agent Orange (Vietnam only)5 (3.0)1 (1.2)2.61 (0.30–22.7)3.06 (0.22–42.5)
Father’s occupation
 Farmer188 (48.0)84 (35.9)1.66 (1.19–2.32) 1.12 (0.76–1.65)
 Driver64 (16.3)40 (17.1)0.95 (0.61–1.46)1.03 (0.65–1.65)
 Mechanic27 (6.9)33 (14.1)0.45 (0.26–0.77) 0.54 (0.30–0.95)
 Factory worker15 (3.8)20 (8.6)0.43 (0.21–0.85) 0.42 (0.20–0.87)
 Carpenter27 (6.9)35 (15.0)0.42 (0.25–0.71) 0.40 (0.23–0.71)
 Painter37 (9.4)28 (12.0)0.76 (0.45–1.29)0.77 (0.44–1.35)
 Welder33 (8.4)25 (10.7)0.77 (0.45–1.33)0.97 (0.54–1.74)
 Electrician18 (4.6)23 (9.8)0.44 (0.23–0.84) 0.47 (0.24–0.94)
Adjusted by child’s sex, mother’s place of residence during pregnancy (rural/city), mother’s and father’s employment status (employed/unemployed), mother’s and father’s education (completed primary school or less/completed secondary school or more), mother’s and father’s age at time of delivery and country. * 5 year OR given. Crude models were adjusted by country. p is significant at the 0.05 level.

Share and Cite

MDPI and ACS Style

Ly, S.; Burg, M.L.; Ihenacho, U.; Brindopke, F.; Auslander, A.; Magee, K.S.; Sanchez-Lara, P.A.; Nguyen, T.-H.-D.; Nguyen, V.; Tangco, M.I.; et al. Paternal Risk Factors for Oral Clefts in Northern Africans, Southeast Asians, and Central Americans. Int. J. Environ. Res. Public Health 2017, 14, 657. https://doi.org/10.3390/ijerph14060657

AMA Style

Ly S, Burg ML, Ihenacho U, Brindopke F, Auslander A, Magee KS, Sanchez-Lara PA, Nguyen T-H-D, Nguyen V, Tangco MI, et al. Paternal Risk Factors for Oral Clefts in Northern Africans, Southeast Asians, and Central Americans. International Journal of Environmental Research and Public Health. 2017; 14(6):657. https://doi.org/10.3390/ijerph14060657

Chicago/Turabian Style

Ly, Stephanie, Madeleine L. Burg, Ugonna Ihenacho, Frederick Brindopke, Allyn Auslander, Kathleen S. Magee, Pedro A. Sanchez-Lara, Thi-Hai-Duc Nguyen, Viet Nguyen, Maria Irene Tangco, and et al. 2017. "Paternal Risk Factors for Oral Clefts in Northern Africans, Southeast Asians, and Central Americans" International Journal of Environmental Research and Public Health 14, no. 6: 657. https://doi.org/10.3390/ijerph14060657

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop