Next Article in Journal
“Returning to Ordinary Citizenship”: A Qualitative Study of Chinese PWUD’s Self-Management Strategies and Disengagement Model of Identity
Previous Article in Journal
Characteristics Associated with Good Self-Perceived Mental Health among United States Adults with Arthritis
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Development of a Scale for COVID-19 Stigma and Its Psychometric Properties: A Study among Pregnant Japanese Women

by
Toshinori Kitamura
1,2,3,4,*,†,
Asami Matsunaga
1,5,†,
Ayako Hada
1,2,6,†,
Yukiko Ohashi
1,7 and
Satoru Takeda
8,9
1
Kitamura Institute of Mental Health Tokyo, Tokyo 151-0063, Japan
2
Kitamura KOKORO Clinic Mental Health, Tokyo 151-0063, Japan
3
T. and F. Kitamura Foundation for Studies and Skill Advancement in Mental Health, Tokyo 151-0063, Japan
4
Department of Psychiatry, Graduate School of Medicine, Nagoya University, Nagoya 464-0814, Japan
5
Department of Mental Health and Psychiatric Nursing, Tokyo Medical and Dental University, Tokyo 113-0034, Japan
6
Department of Community Mental Health and Law, National Institute of Mental Health, National Center of Neurology and Psychiatry, Tokyo 187-0031, Japan
7
Department of Nursing, Faculty of Nursing, Josai International University, Togane 283-0002, Japan
8
Department of Obstetrics & Gynecology, Faculty of Medicine, Juntendo University, Tokyo 113-8421, Japan
9
Aiiku Research Institute for Maternal, Child Health and Welfare, Imperial Gift Foundation Boshi-Aiiku-Kai, Tokyo 106-0047, Japan
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
Behav. Sci. 2022, 12(8), 257; https://doi.org/10.3390/bs12080257
Submission received: 6 June 2022 / Revised: 20 July 2022 / Accepted: 20 July 2022 / Published: 27 July 2022
(This article belongs to the Section Social Psychology)

Abstract

:
Background: Stigma towards COVID-19 may negatively impact people who suffer from it and those supporting and treating them. Objective: To develop and validate a scale to assess 11-item COVID-19–related stigma. Methods: A total of 696 pregnant women at a gestational age of 12 to 15 weeks were surveyed using an online survey with a newly developed scale for COVID-19 stigma and other variables. The internal consistency of the scale was calculated using omega indices. We also examined the measurement invariance of the scale. Results: Exploratory factor analyses (EFAs) of the scale items were conducted using a halved sample (n = 350). Confirmatory factor analyses (CFAs) among the other halved sample (n = 346) compared the single-, two-, three-, and four-factor structure models derived from the EFAs. The best model included the following three-factor structure (χ2/df = 2.718, CFI = 0.960, RMSEA = 0.071): Omnidirectional Avoidance, Attributional Avoidance, and Hostility. Its internal consistency was excellent (all omega indices > 0.70). The three-factor structure model showed configuration, measurement, and structural invariances between primiparas and multiparas, and between younger (less than 32 years) and older women (32 years or older). Fear of childbirth, mother–fetal bonding, obsessive compulsive symptoms, depression, adult attachment self-model, and borderline personality traits were not significantly correlated with the Omnidirectional Avoidance subscale but correlated with the Attributional Avoidance and Hostility subscales (p < 0.001). Conclusion: The findings suggested that our scale for COVID-19 stigma was robust in its factor structure, as well as in construct validity.

1. Introduction

Infectious diseases sometimes induce stigma in the general public. Historically, patients have experienced stigma due to infection with disease. Currently, researchers and practitioners share concerns regarding the stigma towards COVID-19 [1,2]. Stigma towards an infectious disease imposes an additional burden on patients who suffer from it. Furthermore, people who are stigmatised often develop self-stigma, which is the internalisation of external stigma that leads to declining self-efficacy and self-esteem for the stigmatised [3,4]. Bagcchi [5] reported that people suffering from COVID-19 are subjected to stigma, such as abandonment by their family members or the public whereas healthcare workers experience social ostracism and even attacks. This is a phenomenon observed worldwide [6,7,8]. Such stigma disrupts effective interventions and can even lead to a loss of the control of the pandemic. Stigmatising attitudes may also cause psychological distress among people suffering from COVID-19 as well as those caring for and supporting them. While the evolutionary psychological perspective indicates that infectious disease stigmatisation is adaptive for the survival and protection of the community, stigma no longer serves such a function in modern societies [9].
The COVID-19 pandemic in Japan has made people fearful of infection. In a close-knit society such as Japan, people are increasingly sensitive to community behaviour. An individual who does not do as others do may be “left out” or even seen as an “outlaw”. Such a person may be advised or even criticised in public. People without legal responsibility have been reported to provide harsh advice to citizens who they think do not conform to the social norm. Such demands of the societal norm may come from stigma in society.
Pregnant women are likely to experience psychological difficulties during the COVID-19 pandemic. Research has shown that they often suffer from mood, anxiety, and trauma symptoms (e.g., [10,11]). Stigma that pregnant women have towards the infection and infected people may negatively impact their psychological adjustment.
To control COVID-19 effectively and minimise adverse psychological effects, an examination of the influence of stigma is of primary importance. To address this issue, the development of an easy-to-use and psychometrically standardised measure of stigmatisation towards COVID-19 is a necessary first step [12]. When searching PubMed with ((stigma) AND (COVID-19)) AND (Scale OR inventory OR Measurement)), a total of 339 papers were returned. Of these, we identified 14 papers that delt with COVID-19 stigma. However, none of them treated the issue in psychometric detail (e.g., content validity, factor structure, and measurement invariance).
We reported the development and validation of a self-report scale for assessing the degree of the stigma. The data derived from a research project investigating the influences of COVID-19 on health behaviour and mental health in pregnant women in Japan. Understanding the degree of stigma towards COVID-19 by the general public using this scale would contribute to efforts to decrease the stigma and its adverse effects.

2. Methods

2.1. Study Procedures and Participants

The participants of this internet study were 696 pregnant women at 12 to 15 weeks’ gestational age. Participants were recruited for two weeks, from 7–21 December 2020, via internet application by LunaLuna and Luna Luna Baby (MTI Ltd., Tokyo, Japan). The participants were from across almost all prefectures in Japan. Anonymity was assured, and participation was voluntary. The questionnaire contained an information page, with the aims of the study, affiliations, information about informed consent, and the address of the consultation desk for the research provided. As an incentive, participants received electronic money which could be used for Amazon shopping. In order to examine structural, measurement, and structural invariances of the factor structure of the scale, we sent an e-mail to invite 696 pregnant women to participate in a follow-up study about 10 weeks later. Of the pregnant women, 245 (35.2%) responded to it.

2.2. Measurements

COVID-19 stigma: We developed a scale based on theoretical considerations. This instrument consists of 11 items (Table 2). Each item was rated with a 7-point Likert scale from not at all true = 0 to very much true = 6. The original questionnaire was in Japanese. Items were translated into English (see Table 2) and this was retranslated into Japanese by an individual who was unaware of the original wording, to verify the content.
Preventive means against COVID-19: We asked about the use of 7 means of infection prevention (mask, hand washing, gargling, showering, alcohol disinfection, gloves, and face guard) with a 7-point scale consisting of not at all = 0; once or twice a month = 1; once a week = 2; a few times a week = 3; once a day = 4; a few times a day = 5; and several times a day = 6.
Demographic and obstetric variables: We asked (a) the participant’s age, (b) gestational age in weeks, (c) number of past pregnancies, (d) number of past deliveries, (e) educational level, (f) infertility treatment and its types and duration in years, (g) occupational status (full- or part-time or no job), and (h) marital status.
Attitude towards the present pregnancy: With regard to the attitude towards the current pregnancy, we asked how happy or unhappy the participant was when she became aware of the pregnancy (denial of pregnancy) and whether the pregnancy was desired (intended pregnancy), both with a 5-point scale. A higher score indicated a greater denial of pregnancy and unintended (unwanted) pregnancy, respectively. In addition, we asked if they were unwilling to care for the baby after childbirth (quit caring) and if they wished to terminate the current pregnancy (wish to terminate) both with a 7-point scale.
Current pregnancy: Regarding the current pregnancy, we measured the severity of emesis using the Japanese version [13] of the 24 h Pregnancy-unique Quantification of Emesis (PUQE-24; [14,15]). This consists of only three items ((a) nausea (the length of nausea in hours for the last 24 h), (b) vomiting (number of vomiting episodes in the last 24 h), and (c) retching (the number of retching episodes in the last 24 h)) with a 5-point scale. Higher scores indicate more severe nausea and vomiting during pregnancy.
In addition, we asked how much the current pregnancy influenced the participant (perceived impact of pregnancy). The scores were between +100 and −100 with positive scores indicating that the pregnancy was good, joyful, and happy and negative scores indicating that the pregnancy was awful, perplexing, and unhappy.
We asked whether the participant had undergone infertility treatment and, if so, about the duration of the treatment in years.
Fear of childbirth: We used the Japanese version [16] of the Wijma Delivery Expectancy/Experience Questionnaire (WDEQ; [17]). This consists of 33 items with a 5-point scale. Higher scores indicate more severe fear of the forthcoming delivery. In this study, item 31 was erroneously deleted.
Foetal bonding: We used the short version [18] of the Scale for Parent-to-Baby Emotion (SPBE; [19]). This consists of 20 items with a 7-point scale. It has 10 subscales including six basic emotions (Happiness, Anger, Fear, Sadness, Disgust, and Surprise) and four self-conscious emotions (Shame, Guilt, Alpha Pride, and Beta Pride). Each item was preceded by the question “How much do you feel the following emotion when you think of your baby in the womb?”
Substance use: The following two ad hoc items were used to assess the frequency of tobacco and alcohol use: “How many cigarettes did you smoke before pregnancy?” and “Did you drink alcohol before pregnancy?” (Yes/No).
Obsessive compulsive symptoms: We used the Japanese version [20] of the Obsessive Compulsive Inventory-Revised (OCI-R; [21]). This consists of 18 items with a 7-point scale. It has the following six subscales: Washing, Checking, Ordering, Obsessing, Hoarding, and Neutralising.
Depression: We used two items asking about the first two items of Major Depressive Episode (MDE), namely depressed mood and lack of interest. Each item was rated with a 4-point scale: none = 0, a few days a week = 1, more than half a week = 2, and almost every day = 3. Research showed that a set of the two questions could predict MDE reasonably well [22,23,24,25,26,27,28,29].
Adult attachment: We used the Japanese version [30] of the Relationship Questionnaire (RQ; [31]). The RQ consists of four items and a 7-point scale (does not apply to me at all = 0 to applies to me very much = 6). They indicate the following different styles of adult attachment: Secure, Fearful, Preoccupied, and Dismissing. We created the following two subscales: Positive Self- and Positive Other-models according to Bartholomew and Horowitz [31]. These were calculated as follows:
Positive Self-model = Secure − Fearful − Preoccupied + Dismissing
Positive Other-model = Secure − Fearful + Preoccupied − Dismissing
Borderline personality traits: We used the short version [32] of the Personality Organisation Inventory (IPO; [33]). This consists of nine items with a 7-point scale. It has the following three subscales: Primitive Defence (PD), Identity Diffusion (ID), and Reality Testing (RT) Disturbance.

2.3. Data Analysis

The whole sample was divided into the following two groups randomly: one for EFA (n = 350) and another for CFA (n = 346). Using the data from the first group, we calculated mean, SD, skewness, and kurtosis of each scale item. The Kaiser–Meyer–Olkin (KMO) index and Bartlett’s sphericity were tested as a means of assessing the factorability of the data [34]. Then, a series of exploratory factor analyses (EFAs) were performed. The maximum-likelihood method with PROMAX rotation was adopted. The model comparison of a single-, two-, three-, and four-factor structure was examined. To compare the EFA-derived factor models, we used the data from the second halved sample and performed a series of confirmatory factor analyses (CFAs) as cross-validation [35,36,37]. Starting with the single-factor model, the next model was subsequently judged as accepted if χ2 decreased significantly for the difference of df. This was examined repeatedly until we reached the best model. The absolute fit of the models was evaluated in terms of chi-squared, comparative fit index (CFI), and root mean square of error approximation (RMSEA). A good fit is suggested by χ2/df < 2, CFI > 0.97, and RMSEA < 0.05, and an acceptable fit by χ2/df < 3, CFI > 0.95, and RMSEA < 0.08 [38,39]. We also examined Akaike Information Criterion (AIC; [40]) of which lower scores indicate a better model.
The internal consistency of the model was calculated using ω. The omega coefficient is a preferable index of internal consistency of a psychological measure when the scale consists of more than one factor [41,42,43]. The proportion of variance of all the items explained by all the factors was computed as follows:
ω = λ g r o u p 1 2 + λ g r o u p 2 2 + λ g r o u p 3 2 λ g r o u p 1 2 + λ g r o u p 2 2 + λ g r o u p 3 2 + 1 k δ  
where there are three group factors. λ and δ refer to the factor loading and the unique variance of the item, respectively. The proportion of variance of the items belonging to each group factor explained by parameter estimates for the specific group factor is calculated as follows:
ω g r o u p 1 = λ g r o u p 1 2 λ g r o u p 1 2 + δ  
After model comparison, the best model’s measurement and structural invariances were examined across different attributes (parity and age) using data from the whole sample. Starting from configuration invariances, through to metric, scalar, residual, factor variance, and factor covariance invariances to factor mean invariance were examined. The progress from one step to the next was judged as accepted if (a) the χ2 decrease was not significant for the df difference, (b) the decrease of CFI was less than 0.01, or (c) the increase in RMSEA was less than 0.015 [44,45]. This procedure was applied because an χ2 decrease is strongly sensitive to sample size (N) and, particularly in the case of a large sample, produces an unreasonable rejection of invariance.
The subscale scores were calculated by adding the scores of items derived from the factor analyses. The subscale scores were correlated with the scores of the other variables described in the measurement. The alpha level was set at p < 0.001 because of multiple comparisons.

2.4. Ethical Considerations

This study was approved by the Institutional Review Board (IRB) of the Kitamura Institute of Mental Health Tokyo (No. 2020101501). All participants provided their electronic informed consent after understanding the study rationale and procedure. The authors assert that all procedures contributing to this study comply with the ethical standards of the National and Institutional Committees on human experimentation and with the Helsinki Declaration of 1975 as revised in 2008.

3. Results

3.1. Characteristics of the Participants

The mean (SD) age of the participants was 31.7 (4.5) years, and the mean (SD) gestational age was 13.4 (1.14) weeks (Table 1). For about half of the women, the current pregnancy was their first experience. About three-quarters of the women (73.6%) were nulliparae and 26.4% were multiparae. About 90% of the women had a job at the time of the investigation. Most of them had a partner (99%). One-third of them had received infertility treatment.

3.2. Scale Items

Mean, SD, skewness, and the kurtosis of 11 items of the scale in the first halved sample are shown in Table 2. None of the items showed a skewness of greater than 2. Kurtosis was less than 4 in all the items.

3.3. EFA

The factorability of this data was examined with KMO = 0.837 and Bartlett’s sphericity test χ2 (55) = 1864.463, p < 0.001. Therefore, we performed EFAs (Table 3). In the single-factor model, all the items except items 1, 2, and 3 showed factor loading > 0.30 [46]. In the two-factor model, items 2, 6, 7, 8, 9, and 11 loaded on the first factor, and all other items except the first factor; items 6, 7, and 8 loaded on the second factor; and items 1, 2, 9, and 11 loaded on the third factor. In the four-factor model, however, only two items loaded on the second, third, and fourth factor with 0.3 or more. Thus, the four-factor model was found to be unstable as a measurement model.

3.4. CFA

For the cross-validation of the EFA-derived factor models, we performed CFAs with maximum likelihood mean adjusted (MLM) using the other halved sample. Single-, two-, and three-factor models were compared in terms of the goodness-of-fit (Table 4). The goodness-of-fit of the model was significantly and increasingly better from the single- to three-factor models. Thus, the three-factor model showed even better fit than any other models: χ2/df = 2.718, CFI = 0.960, RMSEA = 0.0.071 (Figure 1). The absolute values of goodness-of-fit were acceptable at CFI > 0.95 and RMSEA< 0.8. The first factor was loaded by items representing the avoidance of COVID-19 infected people and their family members. Nevertheless, because a substantial portion of infection symptoms were subclinical (asymptomatic), people were unaware of those who are COVID-19 positive. Thus, their avoidance and possible fear of infection were not targeted against a specific group of individuals but were more general and widespread. We termed this Omnidirectional Avoidance. The second factor was loaded by items representing avoidance of specific people who are, allegedly, more prone to infection such as medical and service workers and those who attend a clinic. Their avoidance and possibly fear towards infection were characterised by demographic features of the target of stigma (e.g., occupation). We termed this Attributional Avoidance. The third factor was loaded by items representing reproaching infected people. This may be a reflection of the participants’ hostile and potentially accusatory attitude towards those who are ‘carelessly’ infected by SaRS-COV2. We named this Hostility. We then calculated MacDonald’s ω. It was 0.71 for the whole scale and 0.70, 0.84, and 0.91 for Omnidirectional Avoidance, Attributional Avoidance, and Hostility, respectively. Therefore, the internal consistency was excellent.

3.5. Measurement Invariance

The comparison between nulliparae and multiparae (Table 5), and between the younger (less than 32) and older (32 or more) age groups (Table 6) showed that the three-factor model was invariant from the configuration, metric, scalar, factor variance, and factor covariance perspective. The factor mean for the three-factor model did not show significant differences (Table 7). This factor model was also invariant in terms of configural, measurement, and structural aspects between the two observation times (the first and second trimesters) (Table not shown).

3.6. Construct Validity

The scores of the three subscales―Omnidirectional Avoidance, Attributional Avoidance, and Hostility―were correlated differently from the other variables (Table 8). Omnidirectional Avoidance was significantly correlated only with the Washing scores of the OCI-R. On the other hand, the Attributional Avoidance scores were linked to fear of childbirth, all of which are subscales of the OCI-R, MDE, poor self-model, and the total score of the IPO-SV. The correlations of Hostility with the other variables were similar to those of Attributional Avoidance; however, they were also associated with negative emotions towards the foetus.

4. Discussion

To the best of our knowledge, our study was the first to develop a COVID-19–specific stigma scale. It consists of three independent subscales, and the three-factor structure was stable in terms of configuration, measurement, and structural invariances. Factor means did not differ in terms of parity and age. The three subscales derived from factor analyses were differently related with the other variables.
Stigma towards an illness and those people suffering from it is an attitude that appears in different domains. It may be expressed in people’s avoidant behaviours of the target illness. The target illness may, however, be difficult to recognise in such cases where the illness or suffering of people is not easily identifiable. COVID-19 is one such case. There are many cases of subclinical infection that show no observable signs or symptoms. People fear infection but find it difficult to determine whom or where they should avoid. This results in general fear of getting close to an unidentifiable target. This is represented by Omnidirectional Avoidance. Second, people learn from media, regardless of its truthfulness, that there are some groups of people who are more likely to be virus positive. These include people working at bars and restaurants, hospitals, clinics, and those attending a medical institution. The target to be avoided is clear in such cases. This is represented by Attributional Avoidance. Third, the fear of infection presents as aggression towards people who are suffering. Some people resent having recovered people return to their workplace. They no longer want to communicate with recovered people. They may claim that people who become infected are careless and therefore responsible for the spread of COVID-19. They may even claim that they should apologise. This is represented by Hostility. Although these three factors are correlated with each other to some extent, they are nevertheless independent.
We speculate that the three domains of COVID-19 stigma have different causes and consequences. Pregnant women indicating Attributional Avoidance and Hostility were more likely to show all aspects of obsessive compulsive symptoms, MDE, and borderline personality traits. Such psychopathology may lead to prejudice or vice versa. Longitudinal studies may clarify causality. These women’s marital relationship was characterised by a poor self-model. Feeling that they are not worthy of being loved may increase fear and anger towards infected people. Women high in Hostility are more likely to show borderline personality traits. We speculate that such personality traits underlie stigma and prejudice. Pregnant women expressing high Attributional Avoidance and Hostility were more likely to be fearful about the forthcoming childbirth. Women expressing high Hostility were more likely to express negative emotions towards their foetus. Tokophobia (e.g., [16,47,48]) and foetal emotional bonding (e.g., [49,50]) are very important health issues in perinatal care. Clinicians should pay careful attention to expectant women if they show strong stigma towards COVID-19.
We should consider the limitations of this study. We developed a statistically robust measure of COVID-19 stigma. However, this was limited to a population of pregnant women. We should exercise caution in extrapolating the data. Because of the research design, the participants were limited to those in the first trimester. Results may be different in women in the second or third trimester. Issues such as stigma may be influenced by social desirability. Our results may be biased and the participants may underestimate their attitudes.
Taking into consideration these drawbacks, however, the instrument we developed is an easy-to-use, statistically robust measure of stigma against COVID-19 and people infected with the virus. The present study revealed the multifaceted nature of stigma against COVID-19.

Author Contributions

T.K. and S.T. set up the research design. T.K. collected data. A.M., A.H. and Y.O. analysed data. A.M., A.H. and T.K. wrote the manuscript. All authors have read and agreed to the published version of the manuscript.

Funding

The present study was funded by Health, Labour and Welfare Policy Research Grants: Special research: The Effects of Self-Restraint under the Novel Coronavirus Infection (COVID-19) Epidemic: A Survey on Unexpected Pregnancy, etc. and Research to Establish an Appropriate Support System for Women’s Health (20CA2062; Principal Researcher-Tomoko Adachi).

Institutional Review Board Statement

This study was approved by the Institutional Review Board (IRB) of the Kitamura Institute of Mental Health Tokyo (No. 2020101501). All the participants gave electronic informed consent after understanding the study rationale and procedures. The authors assert that all procedures contributing to this study comply with the ethical standards of the National and Institutional Committees on human experimentation and with the Helsinki Declaration of 1975 as revised in 2008.

Informed Consent Statement

Not applicable.

Data Availability Statement

The datasets used and analysed in the present study are available from the corresponding author upon reasonable request.

Acknowledgments

We thank all the participants of the online survey.

Conflicts of Interest

The authors declare that they have no conflict of interest.

References

  1. Abdelhafiz, A.S.; Alorabi, M. Social Stigma: The Hidden Threat of COVID-19. Front. Public Health 2020, 8, 429. [Google Scholar] [CrossRef]
  2. Yoshioka, T.; Maeda, Y. COVID-19 Stigma Induced by Local Government and Media Reporting in Japan: It’s Time to Reconsider Risk Communication Lessons From the Fukushima Daiichi Nuclear Disaster. J. Epidemiol. 2020, 30, 372–373. [Google Scholar] [CrossRef] [PubMed]
  3. Link, B.G.; Phelan, J.C. Conceptualizing Stigma. Annu. Rev. Sociol. 2001, 27, 363–385. [Google Scholar] [CrossRef]
  4. Link, B.G.; Phelan, J.C. Stigma and its public health implications. Lancet 2006, 367, 528–529. [Google Scholar] [CrossRef]
  5. Bagcchi, S. Stigma during the COVID-19 pandemic. Lancet Infect. Dis. 2020, 20, 782. [Google Scholar] [CrossRef]
  6. Bhanot, D.; Singh, T.; Verma, S.K.; Sharad, S. Stigma and Discrimination During COVID-19 Pandemic. Front. Public Health 2021, 8, 577018. [Google Scholar] [CrossRef]
  7. Sotgiu, G.; Dobler, C.C. Social stigma in the time of coronavirus disease 2019. Eur. Respir. J. 2020, 56, 2002461. [Google Scholar] [CrossRef] [PubMed]
  8. Villa, S.; Jaramillo, E.; Mangioni, D.; Bandera, A.; Gori, A.; Raviglione, M.C. Stigma at the time of the COVID-19 pandemic. Clin. Microbiol. Infect. 2020, 26, 1450–1452. [Google Scholar] [CrossRef]
  9. Smith, R.A.; Hughes, D. Infectious Disease Stigmas: Maladaptive in Modern Society. Commun. Stud. 2014, 65, 132–138. [Google Scholar] [CrossRef] [PubMed]
  10. Preis, H.; Mahaffrey, B.; Heiselman, G.; Lobel, M. Vulnerability and resilience to pandemic-related stress among U.S. women pregnant at the start of the COVID-19 pandemic. Soc. Sci. Med. 2020, 266, 1133–1148. [Google Scholar] [CrossRef]
  11. Yan, H.; Ding, Y.; Guo, W. Mental health of pregnant and postpartum women during the coronavirus disease 2019 pandemic: A systematic review and meta-analysis. Front. Psychol. 2020, 11, 617001. [Google Scholar] [CrossRef] [PubMed]
  12. Ransing, R.; Ramalho, R.; de Filippis, R.; Ojeahere, M.I.; Karaliuniene, R.; Orsolini, L.; da Costa, M.P.; Ullah, I.; Grandinetti, P.; Bytyçi, D.G.; et al. Infectious disease outbreak related stigma and discrimination during the COVID-19 pandemic: Drivers, facilitators, manifestations, and outcomes across the world. Brain Behav. Immun. 2020, 89, 555–558. [Google Scholar] [CrossRef] [PubMed]
  13. Hada, A.; Minatani, M.; Yamagishi, Y.; Wakamatsu, M.; Koren, G.; Kitamura, T. The Pregnancy-Unique Quantification of Emesis and Nausea (PUQE-24): Configural, measurement, and structural invariance between nulliparas and multiparas and across two measurement time points. Healthcare 2021, 9, 1553. [Google Scholar] [CrossRef]
  14. Koren, G.; Boskovic, R.; Hard, M.; Maltepe, C.; Navioz, Y.; Einarson, A. Motherisk: PUQE (pregnancy-unique quantification of emesis and nausea) scoring systm for nausea and vomiting of pregnancy. Am. J. Obstet. Gynecol. 2002, 186, s210–s214. [Google Scholar] [CrossRef]
  15. Koren, G.; Piwko, C.; Ahn, E.; Boskovic, R.; Maltepe, C.; Einarson, A.; Navioz, Y.; Ungar, W.J. Validation studies of the Pregnancy Unique-Quantification of Emesis (PUQE) scores. J. Obstet. Gynaecol. 2005, 25, 241–244. [Google Scholar] [CrossRef]
  16. Takegata, M.; Haruna, M.; Matsuzaki, M.; Shiraishi, M.; Okano, T.; Severinsson, E. Aetiological relationship between factors associated with postnatal traumatic symptoms among Japanese primiparas and multiparas: A longitudinal study. Midwifery 2017, 44, 14–23. [Google Scholar] [CrossRef]
  17. Wijma, K.; Wijma, B.; Zar, M. Psychometric aspects of the W-DEQ; A new questionnaire for the measurement of fear of childbirth. J. Psychosom. Obstet. Gynecol. 1998, 19, 84–97. [Google Scholar] [CrossRef]
  18. Hada, A.; Imura, M.; Takeda, S.; Kitamura, T. Development and validation of a short version of the Scale for Parent to Baby Emotions (SPBE-20): Conceptual replication among pregnant women in Japan. 2022; Journal article under review. [Google Scholar]
  19. Hada, A.; Imura, M.; Kitamura, T. Development of a scale for parent-to-baby emotions: Concepts, design, and factor structure. Psychiatry Clin. Neurosci. Rep. 2022, 1, e30. [Google Scholar] [CrossRef]
  20. Koike, H.; Tsuchiyagaito, A.; Hirano, Y.; Oshima, F.; Asano, K.; Sugiura, Y.; Kobori, O.; Ishikawa, R.; Nishinaka, H.; Shimizu, E.; et al. Reliability and validity of the Japanese version of the Obsessive-Compulsive Inventory-Revised (OCI-R). Curr. Psychol. 2017, 39, 89–95. [Google Scholar] [CrossRef]
  21. Foa, E.B.; Huppert, J.D.; Leiberg, S.; Langner, R.; Kichic, R.; Hajcak, G.; Salkovskis, P.M. The obsessive-compulsive inventory: Development and validation of a short version. Psychol. Assess. 2002, 14, 485–496. [Google Scholar] [CrossRef]
  22. Bowling, A. Just one question: If one question works, why ask several? J. Epidemiol. Community Health 2005, 59, 342–345. [Google Scholar] [CrossRef] [PubMed]
  23. Chochinov, H.M.; Wilson, K.G.; Enns, M.; Lander, S. “Are you depressed?” Screening for depression in the terminally ill. Am. J. Psychiatry 1997, 154, 674–676. [Google Scholar] [CrossRef] [PubMed]
  24. Cutler, C.B.; Legano, L.A.; Dreyer, B.P.; Fierman, A.H.; Berkule, S.B.; Lusskin, S.I.; Tomopoulos, S.; Roth, M.; Mendelsohn, A.L. Screening for maternal depression in a low education population using a two item questionnaire. Arch. Women’s Ment. Health 2007, 10, 277–283. [Google Scholar] [CrossRef]
  25. De Boer, A.G.E.M.; van Lanschot, J.J.B.; Stalmeier, P.F.M.; van Sandick, J.W.; Hulscher, J.B.F.; de Haes, J.C.J.M.; Sprangers, M.A.G. Is a single-item visual analogue scale as valid, reliable and responsive as mitiitem scales in measuring quality of life? Qual. Life Res. 2004, 13, 311–320. [Google Scholar] [CrossRef]
  26. Mitchell, A.J. Are one or two simple questions sufficient to detect depression in cancer and palliative care? A Bayesian meta-analysis. Br. J. Cancer 2008, 98, 1934–1943. [Google Scholar] [CrossRef]
  27. Mitchell, A.J.; Coyne, J.C. Do ultra-short screening instruments accurately detect depression in primary care? A pooled analysis and meta-analysis of 22 studies. Br. J. Gen. Pr. 2007, 57, 144–151. [Google Scholar]
  28. Mishina, H.; Hayashino, Y.; Fukuhara, S. Test performance of two-question screening for postpartum depressive symptoms. Pediatr. Int. 2009, 51, 48–53. [Google Scholar] [CrossRef]
  29. Richardson, L.P.; Rockhill, C.; Russo, J.E.; Grossman, D.C.; Richards, J.; McCarty, C.; McCauley, E.; Katon, W. Evaluation of the PHQ-2 as a Brief Screen for Detecting Major Depression Among Adolescents. Pediatrics 2010, 125, e1097–e1103. [Google Scholar] [CrossRef]
  30. Matsuoka, N.; Uji, M.; Hiramura, H.; Chen, Z.; Shikai, N.; Kishida, Y.; Kitamura, T. Adolescents’ attachment style and early experiences: A gender difference. Arch. Women’s Ment. Health 2006, 9, 23–29. [Google Scholar] [CrossRef]
  31. Bartholomew, K.; Horowitz, L.M. Attachment styles among young adults: A test of four-category model. J. Personal. Soc. Psychol. 1991, 61, 226–244. [Google Scholar] [CrossRef]
  32. Yamada, F.; Kataoka, Y.; Nagara, T.; Kitamura, T. Development and Validation of a Short Version of the Primary Scales of the Inventory of Personality Organization: A Study among Japanese University Students. Psychology 2022, 13, 872–890. [Google Scholar] [CrossRef]
  33. Kernberg, O.F.; Clarkin, J.F. The Inventory of Personality Organization; New York Hospital-Cornell Medical Center: New York, NY, USA, 1995. [Google Scholar]
  34. Burton, L.J.; Mazerolle, S.M. Survey instrument validity Part I: Principles of survey instrument development and validity in athletic training education research. Athl. Train. Educ. J. 2011, 6, 27–35. [Google Scholar] [CrossRef]
  35. Cliff, N. Some Cautions Concerning the Application of Causal Modeling Methods. Multivar. Behav. Res. 1983, 18, 115–126. [Google Scholar] [CrossRef]
  36. Cudeck, R.; Browne, M.W. Cross-Validation of Covariance Structures. Multivar. Behav. Res. 1983, 18, 147–167. [Google Scholar] [CrossRef] [PubMed]
  37. Romera, I.; Delgado-Cohen, H.; Perez, T.; Caballero, L.; Gilaberte, I. Factor analysis of the Zung self-rating depression scale in a large sample of patients with major depressive disorder in primary care. BMC Psychiatry 2008, 8, 4. [Google Scholar] [CrossRef]
  38. Bentler, P.M. Comparative Fit Indexes in Structural Models. Psychol. Bull. 1990, 107, 238–246. [Google Scholar] [CrossRef] [PubMed]
  39. Schermelleh-Engel, K.; Moosbrugger, H.; Müller, H. Evaluating the fit of structural equation models: Tests of significance and descriptive goodness-of-fit measures. Methods Psychol. Res. 2003, 8, 23–74. [Google Scholar]
  40. Akaike, H. Factor analysis and AIC. Psychometrika 1987, 52, 317–332. [Google Scholar] [CrossRef]
  41. Dunn, T.J.; Baguley, T.; Brunsden, V. From alpha to omega: A practical solution to the pervasive problem of internal consistency estimation. Br. J. Psychol. 2014, 105, 399–412. [Google Scholar] [CrossRef]
  42. Peters, G.-J.Y. The alpha and the omega of scale reliability and validity: Why and how to abandon Cronbach’s alpha and the route towards more comprehensive assessment of scale quality. Eur. Health Psychol. 2014, 16, 56–69. [Google Scholar]
  43. Zinberg, R.E.; Revelle, W.; Yovel, I.; Li, W. Cronbach’s α, Revelle’s β, and McDonald’s ωH: Their relations with each other and two alternative conceptualizations of reliability. Psychomterika 2005, 70, 123–133. [Google Scholar] [CrossRef]
  44. Chen, F.F. Sensitivity of Goodness of Fit Indexes to Lack of Measurement Invariance. Struct. Equ. Model. A Multidiscip. J. 2007, 14, 464–504. [Google Scholar] [CrossRef]
  45. Cheung, G.W.; Rensvold, R.B. Evaluating goodness-of-fit indexes for testing measurement invariance. Struct. Equ. Model. 2002, 9, 233–255. [Google Scholar] [CrossRef]
  46. Costello, A.B.; Osborne, J. Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Pract. Assess. Res. Eval. 2005, 10, 7. [Google Scholar]
  47. Størksen, H.T.; Garthus-Niegel, S.; Adams, S.S.; Vangen, S.; Eberhard-Gran, M. Fear of childbirth and elective caesarean section: A population-based study. BMC Pregnancy Childbirth 2015, 15, 221. [Google Scholar] [CrossRef] [PubMed]
  48. Takegata, M.; Haruna, M.; Morikawa, M.; Yonezawa, K.; Komada, M.; Severinsson, E. Qualitative exploration of fear of childbirth and preferences for mode of birth among Japanese primiparas. Nurs. Health Sci. 2018, 20, 338–345. [Google Scholar] [CrossRef]
  49. Branjerdporn, G.; Meredith, P.; Strong, J.; Garcia, J. Association between maternal-foetal attachment and infant development outcomes: A systematic review. Matern. Child Health 2017, 21, 540–553. [Google Scholar] [CrossRef]
  50. Yarcheski, A.; Mahon, N.E.; Yarcheski, T.J.; Hanks, M.M.; Cannella, B.L. A meta-analytic study of predictors of maternal-fetal attachment. Int. J. Nurs. Stud. 2009, 46, 708–715. [Google Scholar] [CrossRef]
Figure 1. Confirmatory factor analysis of the scale items (n = 346). CFI, comparative fit index; RMSEA, root mean square error of approximation; AIC, Akaike information criteria. Paths are standardised. The names of error variables are not shown.
Figure 1. Confirmatory factor analysis of the scale items (n = 346). CFI, comparative fit index; RMSEA, root mean square error of approximation; AIC, Akaike information criteria. Paths are standardised. The names of error variables are not shown.
Behavsci 12 00257 g001
Table 1. Demographic characteristics (n = 697).
Table 1. Demographic characteristics (n = 697).
Mean SD
Age31.74.53
Gestational age (weeks)13.41.14
n%
Gravidity
0 39456.6
1 time16924.3
2 times7911.4
3 times344.9
4 times121.7
5 times60.9
6 times20.3
Parity
Nuliarae51273.6
Multiparae18426.4
1 time12618.1
2 times415.9
3 times142.0
4 times30.4
Education
Secondary school172.4
High school13219.0
Junior college or Vocational school19227.6
Bachelor’s 32046.0
Master’s 324.6
Doctorate 30.4
Infertility treatment
None (spontaneously)46667.0
Intercourse timing therapy14921.4
Assisted conception8111.6
Mean SD
Treatment duration (years)0.290.72
n%
Student
Yes60.9
No69099.1
Employment
Unemployed8311.9
Temporary work10915.7
Full-time employment or Self-employed50472.4
Have a partner
Yes69099.1
No60.9
Table 2. Mean, SD, skewness, kurtosis of the COVID-19 stigma scale items (n = 350).
Table 2. Mean, SD, skewness, kurtosis of the COVID-19 stigma scale items (n = 350).
Item No.Items (Abbreviations)Mean (SD)SkewnessKurtosis
1People get infected because they are careless. (condemn carelessness)2.03 (1.48)0.06−0.92
2Those who are infected/positive should apologise. (demand for apology)0.56 (1.07)1.963.34
3I do not want to get close to those who are infected/positive. (avoidance of infected people)4.97 (1.32)−1.592.92
4I do not want to get close to the families of those who are infected/positive. (avoidance of families of infected person)4.34 (1.50)−0.820.47
5I do not want to touch anything touched by those who are infected/positive. (avoidance of polluted objects)4.56 (1.53)−1.121.08
6I do not want to get close to those who are in the hospitality industry. (avoidance of people in the hospitality industry)1.55 (1.50)0.65−0.24
7I do not want to get close to those who visit hospitals. (avoidance of hospital visitors)1.40 (1.47)0.82−0.18
8I do not want to get close to health care professionals. (avoidance of health care professionals)1.14 (1.42)1.050.17
9Those who were infected/positive should not go to workplace (school) even after they are cured. (restriction on activity of infected people)1.25 (1.49)1.010.09
10Those who are infected/positive should not use public transportation or public places. (restrictions on utilisation of public facilities)4.12 (1.99)−0.89−0.34
11I do not think I will be able to associate as before with those who are infected/positive.
(avoidance of communicating with infected people)
0.84 (1.24)1.491.70
Table 3. EFA of the COVID-19 scale items (n = 350).
Table 3. EFA of the COVID-19 scale items (n = 350).
Item No.Item Contents (Label)1-Factor2-Factor3-Factor4-Factor
IIIIIIIIIIIIIIIIIV
1condemn carelessness0.330.220.200.170.030.300.110.020.030.44
2demand for apology0.430.350.130.080.080.43−0.050.010.030.80
3avoidance of infected people0.37−0.020.830.85−0.00−0.070.83−0.00−0.110.07
4avoidance of families of infected person0.450.060.830.840.05−0.020.850.05−0.01−0.02
5avoidance of polluted objects0.420.010.860.86−0.050.060.87−0.040.06−0.01
6avoidance of people in hospitality industry0.800.80−0.000.020.750.050.000.76−0.030.11
7avoidance of hospital visitors0.930.97−0.04−0.021.01−0.03−0.021.01−0.03−0.01
8avoidance of health care professionals0.880.89−0.020.010.830.050.020.850.07−0.08
9restriction on activity of infected people0.550.500.07−0.020.080.690.020.090.670.00
10restrictions on utilisation of public facilities0.290.110.370.34−0.010.180.36−0.000.21−0.05
11avoidance of communicating with infected people0.490.440.07−0.04−0.050.81−0.00−0.030.750.05
Factor loadings > 0.3 are in bold.
Table 4. Comparison of EFA-derived factor models (n = 347).
Table 4. Comparison of EFA-derived factor models (n = 347).
Modelsχ2/dfDχ2 (df)CFIDCFIRMSEADRMSEAAIC
Models derived from EFA
1-factor905.466/46 = 19.684Ref0.515Ref0.233Ref967.466
2-factor314.468/44 = 7.147590.998 (2) ***0.8470.3320.1330.100380.468
3-factor111.439/41 = 2.718203.029 (3) ***0.9600.1130.0710.062183.439
Note. CFI, comparative fit index; RMSEA, root mean square error of approximation; AIC, Akaike information criteria. *** p < 0.001.
Table 5. Configuration, measurement, and structural invariances of the 3-factor model between nulliparae (n = 512) and multiparae (n = 185).
Table 5. Configuration, measurement, and structural invariances of the 3-factor model between nulliparae (n = 512) and multiparae (n = 185).
χ2dfχ2/dfΔχ2 (df)CFIΔCFIRMSEAΔRMSEAAICJudgement
Configuration198.317822.419Ref0.968Ref0.045Ref342.317ACCEPT
Metric205.422902.2827.015(8)NS0.9680.0000.0430.002333.422ACCEPT
Scalar219.9891012.17814.567(11)NS0.9670.0010.0410.001325.989ACCAPT
Residual244.0511122.17924.062(11) *0.9640.0030.0410.000328.051ACCEPT
Factor variance248.4481152.1604.397(3) NS0.9630.0010.0410.000326.448ACCEPT
Factor covariance253.4432282.1485.365(113) NS0.9630.0010.0410.000325.813ACCEPT
* p < 0.05; NS, not significant; CFI, comparative fit index; RMSEA, root mean square of error approximation; AIC, Akaike information criterion.
Table 6. Configuration, measurement, and structural invariances of the 3-factor model between age < 32 (n = 344) and age ≥ 32 (n = 353).
Table 6. Configuration, measurement, and structural invariances of the 3-factor model between age < 32 (n = 344) and age ≥ 32 (n = 353).
χ2dfχ2/dfΔχ2 (df)CFIΔCFIRMSEAΔRMSEAAICJudgement
Configuration213.294822.601Ref0.964Ref0.048Ref357.294ACCEPT
Metric220.685902.4527.391(8)NS0.9640.0000.046−0.004348.685ACCEPT
Scalar234.2561012.31913.571(11)NS0.9630.0010.044−0.002340.256ACCAPT
Residual253.9251122.26719.669(11) *0.9610.0020.043−0.001337.925ACCEPT
Factor variance259.7201152.2585.795(3)NS0.9600.0010.0430.000337.720ACCEPT
Factor covariance267.5751182.2687.855(3) *0.9590.0010.0430.000339.575ACCEPT
* p < 0.05; NS, not significant; CFI, comparative fit index; RMSEA, root mean square of error approximation; AIC, Akaike information criterion.
Table 7. Factor mean of the 3-factor model.
Table 7. Factor mean of the 3-factor model.
Factor Mean (SE)
F1: Omnidirectional AvoidanceF2: Attributional AvoidanceF3: Hostility
Nulliparae (n = 512) compared with multiparae (n =184)−0.070 (0.082) NS−0.199 (0.115) NS0.034 (0.359) NS
age less than 32 years (n = 344) compared with
age 32 years or older (n = 353)
−0.122 (0.074) NS−0.049 (0.101) NS−0.052 (0.083) NS
NS, not significant; SE, standard error.
Table 8. Correlations of Omnidirectional avoidance, Attributional avoidance, and Hostility with predictor variables.
Table 8. Correlations of Omnidirectional avoidance, Attributional avoidance, and Hostility with predictor variables.
Omnidirectional AvoidanceAttributional AvoidanceHostility
Demographic and obstetric variables
Age0.060.040.02
Gestational age0.10.20.7
Past pregnancy (times)−0.040.00−0.06
Past childbirth (times)−0.050.04−0.04
Preventive means against COVID-19
Mask−0.02−0.06−0.13 **
Hand washing−0.03−0.07−0.12 **
Gargling−0.060.01−0.03
Showering−0.07−0.02−0.05
Alcohol disinfection−0.03−0.04−0.05
Gloves−0.13 **−0.04−0.08 *
Faceguard−0.10 **−0.04−0.01
Attitude towards the present pregnancy
Denial of pregnancy−0.030.010.04
Unintended pregnancy−0.06−0.030.03
Quit caring−0.040.10 **0.04
Wish to terminate0.010.070.10 **
Current pregnancy
PUQE Total0.00−0.040.06
Perceived impact of pregnancy0.05−0.00−0.10
Assisted conception (yes, 1; no, 0)0.09−0.000.05
Infertility treatment duration (years)0.070.0300.05
Mental state and psychopathology
Fear of child birth 0.040.13 ***0.15 ***
Foetal bonding
Happiness0.03−0.09 *−0.15 **
Anger −0.040.09 *0.13 **
Fear0.010.070.15 ***
Sadness−0.010.12 **0.18 ***
Disgust−0.030.10 **0.16 ***
Surprise0.010.040.17 ***
Shame−0.030.10 **0.14 ***
Guilt−0.100.040.12 **
Alpha pride 0.020.020.04
Beta pride0.05−0.01−0.07
Substance use
Smoking amount0.000.010.02
Alcohol−0.05−0.06−0.07
Obsessive compulsive symptoms
Washing0.17 ***0.31 ***0.31 ***
Checking0.030.23 ***0.21 ***
Ordering0.12 **0.21 ***0.24 ***
Obsession0.11 **0.19 ***0.24 ***
Hoarding0.070.15 ***0.23 ***
Neutralising0.060.20 ***0.28 ***
MDE
Depression0.08 *0.13 **0.15 ***
Anhedonia0.040.14 ***0.15 **
Total0.060.14 ***0.15 ***
Adult attachment
Self-model0.02−0.14 ***−0.15 ***
Other-model0.08 *−0.08 *−0.05
Borderline personality traits
Primitive difences0.030.11 **0.24 ***
Identity delusion0.060.11 **0.21 ***
Reality testing0.010.20 ***0.21 ***
Total0.040.16 ***0.26 ***
* p < 0.05; ** p < 0.01; *** p < 0.001.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Kitamura, T.; Matsunaga, A.; Hada, A.; Ohashi, Y.; Takeda, S. Development of a Scale for COVID-19 Stigma and Its Psychometric Properties: A Study among Pregnant Japanese Women. Behav. Sci. 2022, 12, 257. https://doi.org/10.3390/bs12080257

AMA Style

Kitamura T, Matsunaga A, Hada A, Ohashi Y, Takeda S. Development of a Scale for COVID-19 Stigma and Its Psychometric Properties: A Study among Pregnant Japanese Women. Behavioral Sciences. 2022; 12(8):257. https://doi.org/10.3390/bs12080257

Chicago/Turabian Style

Kitamura, Toshinori, Asami Matsunaga, Ayako Hada, Yukiko Ohashi, and Satoru Takeda. 2022. "Development of a Scale for COVID-19 Stigma and Its Psychometric Properties: A Study among Pregnant Japanese Women" Behavioral Sciences 12, no. 8: 257. https://doi.org/10.3390/bs12080257

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop