“Are You a Boy or a Girl?”—A Missing Response Analysis
Abstract
:1. Introduction
1.1. Reasons for Item Non-Response
1.2. Binary Gender Questions in Health Surveys as a Potential Problem for Gender-Nonconforming Youth
- For transgender people, the question may be ambiguous, i.e., it is unclear whether the question is aimed at the sex assigned at birth or current gender identity [20].
- Since it is not clarified whether the item asks about biological sex or gender identity—and asking about being “a boy” or “a girl” is not being helpful in this sense—some participants may understand it as tapping into their sex. The dichotomous answers “male” and “female” ignore intersex persons, i.e., “people … born with sex characteristics (including genitals, gonads and chromosome patterns) that do not fit typical binary notions of male or female bodies” [21].
- For people who question their gender identity and people who reject a binary gender concept, a binary question may be inappropriate per se [22].
1.3. Health Disparities of Transgender/Intersex/Gender-Nonconforming Adolescents
1.4. Research Questions and Hypotheses
- More psychosomatic health complaints;
- Lower peer support;
- Lower family support;
- Lower classmate support;
- Lower life satisfaction;
- Higher percentage of bullying victimisation;
- Higher prevalence of smoking, drinking alcohol, drunkenness and cannabis use in the last 30 days;
- Higher percentage of poor self-rated health.
2. Materials and Methods
2.1. About HBSC
2.2. Measures
- Gender: To assess gender, the question “Are you a boy or a girl?” was asked.
- Age was measured by asking both year and month of birth. Those who did not answer one or both questions were considered age non-responders.
- General item non-response: The HBSC mandatory questionnaire used in 2018 consisted of 97 items (other than gender and month and year of birth). For 64 of these items, the number of questions not answered was counted. For the remaining 33 items, this was not possible, partly because they were coded 0/1 or due to skip patterns.
- Psychosomatic health complaints: The HBSC study surveys the prevalence of eight common symptoms in adolescents (e.g., backache and feeling low), which can be regarded as a measure of psychosomatic health [31]. Students were asked how often these complaints had occurred during the past 6 months, with answer options ranging from 1 “about every day” to 5 “rarely or never”. This study analysed how many complaints occurred more than once a week (i.e., options 1 and 2).
- Peer support and family support were measured using four items for each kind of support adapted from the Multidimensional Scale of Perceived Social Support [32]. These items (e.g., “My friends really try to help me” and “My family really tries to help me”) were measured using a seven-point Likert scale (1 = very strongly disagree, 7 = very strongly agree). This study used the mean of the four items, with higher values indicating higher peer support and family support, respectively.
- Classmate support was measured using the mean of three items developed by the HBSC study (e.g., “Other students accept me as I am”) asked on a five-point Likert scale. For the analysis, the original response scale (1 = strongly agree, 5 = strongly disagree) was reversed so that higher values represented more support from classmates.
- Life satisfaction was measured using the Cantril ladder [33]. This is an eleven-point measure of global satisfaction with one’s life, where 0 means “the worst possible life” and 10 is “the best possible life”.
- Bullying victimisation: Bullying was first defined in a preamble based on the definition of Olweus [34]. Then, students were asked two similar questions. The first question asked about the frequency of bullying victimisation at school, and the second one asked about cyberbullying victimisation in the past months. Answers ranged from 1 “I have not been bullied” to 5 “[I have been bullied] Several times a week”. Those who stated that they had been bullied and/or cyberbullied two times or more often (i.e., codes 3 to 5) were considered victims of frequent bullying.
- Smoking, cannabis use, alcohol use and drunkenness in the past 30 days were measured in a similar way using the following items: “On how many days (if any) have you smoked cigarettes?”, “On how many days (if any) have you used cannabis?”, “On how many days (if any) have you drunk alcohol?”, and “Have you ever had so much alcohol that you were really drunk?” All questions referred to the last 30 days, and the answer options ranged from 1 = “never” to 7 = “30 days or more” for smoking, cannabis and alcohol use and from 1 = “no, never” to 5 = “yes more than 10 times” for drunkenness. All answers greater than 1 were counted as smoking, cannabis use, alcohol use and drunkenness in the last 30 days, respectively. The measures for smoking, alcohol use, drunkenness and classmate support were developed and validated by the HBSC network [1].
- Self-rated health was measured using the item developed by Kaplan and Camacho [35]: “Would you say your health is…”, with response options of “excellent”, “good”, “fair” and ““poor”. Here, a bottom box count of the category “poor” was used.
2.3. Statistical Analyses
3. Results
4. Discussion
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Inchley, J.; Currie, D.; Cosma, A.; Samdal, O. Health Behaviour in School-aged Children (HBSC) Study Protocol: Background, Methodology and Mandatory Items for the 2017/18 Survey, St Andrews. 2018. Available online: https://hbsc.org/publications/survey-protocols/ (accessed on 6 September 2023).
- Riphahn, R.T.; Serfling, O. Item Non-Response on Income and Wealth Questions; IZA Discussion Papers No. 573; Institute for the Study of Labor: Bonn, Germany, 2002; Available online: https://www.econstor.eu/bitstream/10419/21355/1/dp573.pdf (accessed on 6 September 2023).
- Strack, F.; Martin, L.L. Thinking, Judging, and Communicating: A Process Account of Context Effects in Attitude Surveys. In Social Information Processing and Survey Methodology; Hippler, H.-J., Schwarz, N., Sudman, S., Eds.; Springer: New York, NY, USA, 1987; pp. 123–148. ISBN 978-0-387-96570-3. [Google Scholar]
- Tourangeau, R.; Rips, L.J.; Rasinski, K.A. The Psychology of Survey Response; Cambridge University Press: Cambridge, UK, 2000. [Google Scholar]
- Schwarz, N. Cognitive aspects of survey methodology. Appl. Cogn. Psychol. 2007, 21, 277–287. [Google Scholar] [CrossRef]
- Borgers, N.; Hox, J. Item Nonresponse in Questionnaire Research with Children. J. Off. Stat. 2001, 17, 321–335. [Google Scholar]
- Hitt, C.; Trivitt, J.; Cheng, A. When you say nothing at all: The predictive power of student effort on surveys. Econ. Educ. Rev. 2016, 52, 105–119. [Google Scholar] [CrossRef]
- Singer, E.; Mathiowetz, N.A.; Couper, M.P. The Impact of Privacy and Confidentiality Concerns on Survey Participation: The Case of the 1990 U.S. Census. Public Opin. Q. 1993, 57, 465. [Google Scholar] [CrossRef]
- Plutzer, E. Privacy, Sensitive Questions, and Informed Consent. Public Opin. Q. 2019, 83, 169–184. [Google Scholar] [CrossRef]
- Tourangeau, R.; Yan, T. Sensitive questions in surveys. Psychol. Bull. 2007, 133, 859–883. [Google Scholar] [CrossRef]
- Borg, I.; Braun, M.; Baumgärtner, M.K. Attitudes of demographic item non-respondents in employee surveys. Int. J. Manpow. 2008, 29, 146–160. [Google Scholar] [CrossRef]
- Hunter, J.; Landreth, A. Evaluating Bilingual Versions of the Non-Response Follow-Up (NRFU) for the 2004 Census Test; Survey Methodology 2006-7. 2006. Available online: https://www.census.gov/library/working-papers/2006/adrm/ssm2006-07.html (accessed on 6 September 2023).
- Ridolfo, H.; Perez, K.; Miller, K. Testing of Sexual Identity and Health Related Questions: Results of Interviews Conducted May-July 2005, 2011. Available online: https://wwwn.cdc.gov/qbank/report/Ridolfo_NCHS_2011_NCHSSexualityMeasures.pdf (accessed on 6 September 2023).
- Guss, C.E.; Eiduson, R.; Khan, A.; Dumont, O.; Forman, S.F.; Gordon, A.R. “It’d Be Great to Have the Options There”: A Mixed-Methods Study of Gender Identity Questions on Clinic Forms in a Primary Care Setting. J. Adolesc. Health 2020, 67, 590–596. [Google Scholar] [CrossRef]
- Clark, T.C.; Lucassen, M.F.G.; Bullen, P.; Denny, S.J.; Fleming, T.M.; Robinson, E.M.; Rossen, F.V. The health and well-being of transgender high school students: Results from the New Zealand adolescent health survey (Youth’12). J. Adolesc. Health 2014, 55, 93–99. [Google Scholar] [CrossRef]
- Reisner, S.L.; Conron, K.J.; Tardiff, L.A.; Jarvi, S.; Gordon, A.R.; Austin, S.B. Monitoring the health of transgender and other gender minority populations: Validity of natal sex and gender identity survey items in a U.S. national cohort of young adults. BMC Public Health 2014, 14, 1224. [Google Scholar] [CrossRef]
- Shields, J.P.; Cohen, R.; Glassman, J.R.; Whitaker, K.; Franks, H.; Bertolini, I. Estimating population size and demographic characteristics of lesbian, gay, bisexual, and transgender youth in middle school. J. Adolesc. Health 2013, 52, 248–250. [Google Scholar] [CrossRef]
- Becker, I.; Ravens-Sieberer, U.; Ottová-Jordan, V.; Schulte-Markwort, M. Prevalence of Adolescent Gender Experiences and Gender Expression in Germany. J. Adolesc. Health 2017, 61, 83–90. [Google Scholar] [CrossRef] [PubMed]
- Ciria-Barreiro, E.; Moreno-Maldonado, C.; Rivera, F.; Moreno, C. A Comparative Study of Health and Well-being among Cisgender and Binary and Nonbinary Transgender Adolescents in Spain. LGBT Health 2021, 8, 536–544. [Google Scholar] [CrossRef]
- Harwell, D. Testing of Demographic Questions in an ACASI Format. 2012. Available online: https://wwwn.cdc.gov/qbank/report/Harwell_NCHS_2012_ACASI.pdf (accessed on 6 September 2023).
- United Nations for LGBT Equality. Intersex: Factsheet. 2017. Available online: https://www.unfe.org/wp-content/uploads/2017/05/UNFE-Intersex.pdf (accessed on 6 September 2023).
- Travers, M.; Murray, L. Cognitive Testing of Select Questions from the 2017 New York City Youth Risk Behavior Survey (YRBS). 2018. Available online: https://wwwn.cdc.gov/QBANK/Report/Travers_2018_DOHMH_YRBS.pdf (accessed on 6 September 2023).
- Burke, M.; Alexander, J.; Morton, J.; Sohrakoff, K.; Willson, S. Focus Group and Cognitive Interviews to Assess Questions Developed for the Transgender HIV Behavioral Survey: A Pilot among Racial and Ethnic Minority Male-to-Female Transgender Persons A Proposed Component of the National HIV Behavioral Surveillance (NHBS) System. 2009. Available online: https://wwwn.cdc.gov/QBANK/Report/Willson_NCHS_2009_Transgender.pdf (accessed on 6 September 2023).
- Steensma, T.D.; Kreukels, B.P.C.; de Vries, A.L.C.; Cohen-Kettenis, P.T. Gender identity development in adolescence. Horm. Behav. 2013, 64, 288–297. [Google Scholar] [CrossRef] [PubMed]
- Aparicio-García, M.E.; Díaz-Ramiro, E.M.; Rubio-Valdehita, S.; López-Núñez, M.I.; García-Nieto, I. Health and Well-Being of Cisgender, Transgender and Non-Binary Young People. Int. J. Environ. Res. Public Health 2018, 15, 2133. [Google Scholar] [CrossRef] [PubMed]
- Eisenberg, M.E.; Gower, A.L.; McMorris, B.J.; Rider, G.N.; Shea, G.; Coleman, E. Risk and Protective Factors in the Lives of Transgender/Gender Nonconforming Adolescents. J. Adolesc. Health 2017, 61, 521–526. [Google Scholar] [CrossRef]
- Connolly, M.D.; Zervos, M.J.; Barone, C.J.; Johnson, C.C.; Joseph, C.L.M. The Mental Health of Transgender Youth: Advances in Understanding. J. Adolesc. Health 2016, 59, 489–495. [Google Scholar] [CrossRef]
- Költő, A.; Vaughan, E.; O’Sullivan, L.; Shine, K.T.; Kelly, C.; Saewyc, E.; Nic Gabhainn, S. LGBTI+ Youth in Ireland and across Europe: A Two-Phased Landscape and Research Gap Analysis; Department of Children, Equality, Disability, Integration and Youth: Dublin, Ireland, 2021. [Google Scholar] [CrossRef]
- De Leeuw, E.D.; Hox, J.; Huisman, M. Prevention and Treatment of Nonresponse. J. Off. Stat. 2003, 19, 153–176. [Google Scholar]
- Olson-Kennedy, J.; Cohen-Kettenis, P.T.; Kreukels, B.P.C.; Meyer-Bahlburg, H.F.L.; Garofalo, R.; Meyer, W.; Rosenthal, S.M. Research priorities for gender nonconforming/transgender youth: Gender identity development and biopsychosocial outcomes. Curr. Opin. Endocrinol. Diabetes Obes. 2016, 23, 172–179. [Google Scholar] [CrossRef]
- Heinz, A.; Sischka, P.E.; Catunda, C.; Cosma, A.; García-Moya, I.; Lyyra, N.; Kaman, A.; Ravens-Sieberer, U.; Pickett, W. Item response theory and differential test functioning analysis of the HBSC-Symptom-Checklist across 46 countries. BMC Med. Res. Methodol. 2022, 22, 253. [Google Scholar] [CrossRef]
- Zimet, G.D.; Dahlem, N.W.; Zimet, S.G.; Farley, G.K. The Multidimensional Scale of Perceived Social Support. J. Personal. Assess. 1988, 52, 30–41. [Google Scholar] [CrossRef]
- Cantril, H. The Pattern of Human Concerns; Rutgers University Press: New Brunswick, NJ, USA, 1965. [Google Scholar]
- Olweus, D. PsycTESTS Dataset; American Psychological Association: Washington, DC, USA, 2006. [Google Scholar]
- Kaplan, G.A.; Camacho, T. Perceived health and mortality: A nine-year follow-up of the human population laboratory cohort. Am. J. Epidemiol. 1983, 117, 292–304. [Google Scholar] [CrossRef]
- Okada, K. Is Omega Squared Less Biased? A Comparison of Three Major Effect Size Indices in One-Way ANOVA. Behaviormetrika 2013, 40, 129–147. [Google Scholar] [CrossRef]
- Page, N.; Hallingberg, B.; Brown, R.; Lowthian, E.; Hewitt, G.; Murphy, S.; Moore, G. Change over time in adolescent smoking, cannabis use and their association: Findings from the School Health Research Network in Wales. J. Public Health 2021, 43, e620–e628. [Google Scholar] [CrossRef] [PubMed]
- Day, J.K.; Perez-Brumer, A.; Russell, S.T. Safe Schools? Transgender Youth’s School Experiences and Perceptions of School Climate. J. Youth Adolesc. 2018, 47, 1731–1742. [Google Scholar] [CrossRef] [PubMed]
- Tupler, L.A.; Zapp, D.; DeJong, W.; Ali, M.; O’Rourke, S.; Looney, J.; Swartzwelder, H.S. Alcohol-Related Blackouts, Negative Alcohol-Related Consequences, and Motivations for Drinking Reported by Newly Matriculating Transgender College Students. Alcohol. Clin. Exp. Res. 2017, 41, 1012–1023. [Google Scholar] [CrossRef] [PubMed]
- Kidd, J.D.; Jackman, K.B.; Wolff, M.; Veldhuis, C.B.; Hughes, T.L. Risk and Protective Factors for Substance Use among Sexual and Gender Minority Youth: A Scoping Review. Curr. Addict. Rep. 2018, 5, 158–173. [Google Scholar] [CrossRef]
- Pampati, S.; Andrzejewski, J.; Sheremenko, G.; Johns, M.; Lesesne, C.A.; Rasberry, C.N. School Climate among Transgender High School Students: An Exploration of School Connectedness, Perceived Safety, Bullying, and Absenteeism. J. Sch. Nurs. 2020, 36, 293–303. [Google Scholar] [CrossRef]
- Jones, T. Re-Doing Research: Best Practices for Asking About Gender and Sexuality in Education Studies. In Uplifting Gender and Sexuality Education Research; Jones, T., Coll, L., van Leent, L., Taylor, Y., Eds.; Springer International Publishing: Cham, Switzerland, 2019; pp. 185–230. ISBN 978-3-030-24204-6. [Google Scholar]
- Költő, A.; Ciria-Barreiro, E.; Chan, A.; Taylor, A.B.; Willis, M.; Inchley, J.; Young, H.; Saewyc, E.M.; Nic Gabhainn, S. Asking about Sex, Gender and Youth Health: A Pilot Study. Available online: https://osf.io/2urak/ (accessed on 6 October 2023).
Answered the Question “Are You a Boy or a Girl”? | |||
---|---|---|---|
Yes | No | ||
Answered the question on age | Yes | Responder | Gender non-responder |
No | Age non-responder |
n | Age Range | Mean Age | SD | |
---|---|---|---|---|
Belgium (Flemish) | 9551 | 11–18 | 14.7 | 2.2 |
Ireland | 11,499 | 11–18 | 14.1 | 1.9 |
Luxembourg | 8936 | 11–18 | 14.8 | 2.2 |
Hungary | 4792 | 11–18 | 13.9 | 1.8 |
France | 14,780 | 11–18 | 13.5 | 1.4 |
Scotland | 5275 | 11–18 | 13.6 | 1.6 |
Total | 54,833 | 11–18 | 14.1 | 1.9 |
Item Non-Response Rate % (n) | Non-Response Classification | |||||
---|---|---|---|---|---|---|
Country | Month of Birth | Year of Birth | Gender | Gender Non-Responder (Did Not State Gender, but Age) | Age Non-Responder (Did Not State Age) | Responder (Stated Both Age and Gender) |
Belgium (Fl.) | 0.5% (45) | 0.6% (58) | 0.9% (85) | 0.7% (65) | 1.0% (93) | 98.3% (9393) |
Ireland | 0.5% (63) | 0.7% (84) | 0.8% (92) | 0.4% (41) | 0.8% (92) | 98.8% (11,366) |
Luxembourg | 1.1% (95) | 2.6% (228) | 1.0% (90) | 0.6% (52) | 3.1% (274) | 96.3% (8610) |
Hungary | 2.3% (111) | 0.4% (21) | 0.4% (18) | 0.3% (14) | 2.4% (117) | 97.3% (4661) |
France | 0.3% (40) | 0.4% (59) | 0.4% (55) | 0.4% (52) | 0.6% (91) | 99.0% (14,637) |
Scotland | 3.1% (163) | 2.3% (120) | 0.5% (26) | 0.3% (16) | 3.5% (185) | 96.2% (5074) |
Total | 0.9% (517) | 1.0% (570) | 0.7% (366) | 0.4% (240) | 1.6% (852) | 98.0% (53,741) |
χ2 (5) = 472.04, p < 0.001; Cramer’s V = 0.093 | χ2 (5) = 380.61, p < 0.001; Cramer’s V = 0.083 | χ2 (5) = 53.76, p < 0.001; Cramer’s V = 0.031 | χ2 (10) = 462.72; p < 0.001; Cramer’s V = 0.065 |
R | GNR | ANR | R-GNR | R-ANR | ANR-GNR | |
---|---|---|---|---|---|---|
Continuous Outcomes 1 | M (SD) | M (SD) | M (SD) | |||
Number of health complaints (more than once a week; range 0–8) | 1.48 (1.81) | 1.85 (2.14) | 1.57 (1.98) | * | n.s. | n.s. |
Family support (1 = low, 7 = high) | 5.63 (1.67) | 5.19 (1.87) | 5.41 (1.88) | ** | n.s. | n.s. |
Peer support (1 = low, 7 = high) | 5.49 (1.67) | 5.08 (1.91) | 5.32 (1.78) | n.s. | n.s. | n.s. |
Student/classmate support (1 = low, 5 = high) | 3.88 (0.80) | 3.82 (0.92) | 3.76 (0.87) | n.s. | *** | n.s. |
Life satisfaction (0 = low, 10 = high) | 7.56 (1.78) | 7.29 (2.25) | 7.35 (2.04) | n.s. | ** | n.s. |
R | GNR | ANR | R-GNR | R-ANR | ANR-GNR | |
---|---|---|---|---|---|---|
Dichotomous Outcomes (Comparison of Column Proportions) 1 | % (n) | % (n) | % (n) | |||
Self-rated health “poor” | 1.7% (928) | 4.7% (11) | 3.9% (32) | * | * | n.s. |
Bullying victimisation | 9.7% (5042) | 13.0% (30) | 12.1% (97) | n.s. | n.s. | n.s. |
Drank alcohol last 30 days | 25.9% (13,186) | 35.6% (79) | 34.9% (274) | * | * | n.s. |
Drunkenness last 30 days | 8.1% (4169) | 14.1% (31) | 15.6% (121) | * | * | n.s. |
Smoked last 30 days | 8.4% (4196) | 15.0% (34) | 19.4% (145) | * | * | n.s. |
Cannabis use last 30 days | 6.3% (2144) | 14.9% (27) | 16.8% (83) | * | * | n.s. |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Heinz, A.; Költő, A.; Taylor, A.B.; Chan, A. “Are You a Boy or a Girl?”—A Missing Response Analysis. Children 2023, 10, 1695. https://doi.org/10.3390/children10101695
Heinz A, Költő A, Taylor AB, Chan A. “Are You a Boy or a Girl?”—A Missing Response Analysis. Children. 2023; 10(10):1695. https://doi.org/10.3390/children10101695
Chicago/Turabian StyleHeinz, Andreas, András Költő, Ashley B. Taylor, and Ace Chan. 2023. "“Are You a Boy or a Girl?”—A Missing Response Analysis" Children 10, no. 10: 1695. https://doi.org/10.3390/children10101695
APA StyleHeinz, A., Költő, A., Taylor, A. B., & Chan, A. (2023). “Are You a Boy or a Girl?”—A Missing Response Analysis. Children, 10(10), 1695. https://doi.org/10.3390/children10101695