Segmenting Attitudes Toward Vaccination—Behavioral Insights into Influenza Vaccination Refusal in Romania
Abstract
Introduction
Methods
Data collection
Statistical analysis
Results


Discussion
Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Data Availability Statement
Acknowledgments
Conflicts of interest
References
- Lafond, K.E.; Porter, R.M.; Whaley, M.J.; et al. Global burden of influenza-associated lower respiratory tract infections and hospitalizations among adults: a systematic review and meta-analysis. PLoS Med. 2021, 18, e1003550. [Google Scholar] [CrossRef]
- Yokomichi, H.; Mochizuki, M.; Lee, J.J.; Kojima, R.; Yokoyama, T.; Yamagata, Z. Incidence of hospitalisation for severe complications of influenza virus infection in Japanese patients between 2012 and 2016: a cross-sectional study using routinely collected ad-ministrative data. BMJ Open. 2019, 9, e024687. [Google Scholar] [CrossRef]
- Feng, J.N.; Zhao, H.Y.; Zhan, S.Y. Global burden of influenza lower respiratory tract infections in older people from 1990 to 2019. Aging Clin Exp Res. 2023, 35, 2739–2749. [Google Scholar] [CrossRef]
- Montero, D.A.; Vidal, R.M.; Velasco, J.; et al. Two centuries of vaccination: historical and conceptual approach and future perspectives. Front Public Health. 2024, 11, 1326154. [Google Scholar] [CrossRef] [PubMed]
- Hammarsten, J.F.; Tattersall, W.; Hammarsten, J.E. Who discovered smallpox vaccination? Edward Jenner or Benjamin Jesty? Trans Am Clin Climatol Assoc. 1979, 90, 44–55. [Google Scholar] [PubMed]
- Nandi, A.; Shet, A. Why vaccines matter: understanding the broader health, economic, and child development benefits of routine vaccination. Hum Vaccin Immunother. 2020, 16, 1900–1904. [Google Scholar] [CrossRef]
- Stephens, A.B.; Hofstetter, A.M.; Stockwell, M.S. Influenza vaccine hesitancy: scope, influencing factors, and strategic interventions. Pediatr Clin North Am. 2023, 70, 227–241. [Google Scholar] [CrossRef] [PubMed]
- Kempe, A.; Saville, A.W.; Albertin, C.; et al. Parental hesitancy about routine childhood and influenza vaccinations: a national survey. Pediatrics. 2020, 146, e20193852. [Google Scholar] [CrossRef]
- MacDonald, N.E.; SAGE Working Group on Vaccine Hesitancy. Vaccine hesitancy: definition, scope and determinants. Vaccine. 2015, 33, 4161–4164. [Google Scholar] [CrossRef]
- Dubé, E.; Vivion, M.; MacDonald, N.E. Vaccine hesitancy, vaccine refusal and the anti-vaccine movement: influence, impact and implications. Expert Rev Vaccines. 2015, 14, 99–117. [Google Scholar] [CrossRef]
- Cinelli, M.; De Francisci Morales, G.; Galeazzi, A.; Quattrociocchi, W.; Starnini, M. The echo chamber effect on social media. Proc Natl Acad Sci U S A. 2021, 118, e2023301118. [Google Scholar] [CrossRef] [PubMed]
- Puri, N.; Coomes, E.A.; Haghbayan, H.; Gunaratne, K. Social media and vaccine hesitancy: new updates for the era of COVID-19 and globalized infectious diseases. Hum Vaccin Immunother. 2020, 16, 2586–2593. [Google Scholar] [CrossRef]
- Holford, D.L.; Fasce, A.; Costello, T.H.; Lewandowsky, S. Psychological profiles of anti-vaccination argument endorsement. Sci Rep. 2023, 13, 11219. [Google Scholar] [CrossRef] [PubMed]
- Larson, H.J.; Jarrett, C.; Schulz, W.S.; et al. Measuring vaccine hesitancy: the development of a survey tool. Vaccine. 2015, 33, 4165–4175. [Google Scholar] [CrossRef]
- Cvjetković, S.; Jeremić Stojković, V.; Piperac, P.; Djurdjević, O.; Bjegović-Mikanović, V. Determinants of COVID-19 vaccine hesitancy: questionnaire development and validation. Cent Eur J Public Health. 2020, 30, 99–106. [Google Scholar] [CrossRef]
- Xiao, X.; Wong, R.M. Vaccine hesitancy and perceived behavioral control: a meta-analysis. Vaccine. 2020, 38, 5131–5138. [Google Scholar] [CrossRef]
- Mărcău, F.C.; Peptan, C.; Nedelcuță, R.M.; Băleanu, V.D.; Băleanu, A.R.; Niculescu, B. Parental COVID-19 vaccine hesitancy for children in Romania: national survey. Vaccines (Basel). 2022, 10, 547. [Google Scholar] [CrossRef]
- Enciu, B.G.; Pitigoi, D.; Zaharia, A.; et al. The influenza vaccination uptake in Romania during the 2022-2023 season. Farmacia. 2023, 71, 1289–1294. [Google Scholar] [CrossRef]
- Government of Romania. Hotărâre privind aprobarea strategiei nationale de vaccinare 2023-2030. Available online: https://sgglegis.gov.ro/legislativ/docs/2023/08/g63hp1 tcrwfb8s02dv5m.pdf (accessed on 30 August 2024).
- Government of Romania. Hotărâre 20/27.06.2023 - Portal Legislativ. Available online: https://legislatie.just.ro/Public/DetaliiDocument/271771 (accessed on 29 July 2024).
- Linzer, D.A.; Lewis, J.B. poLCA: an R package for polytomous variable latent class analysis. J Stat Softw. 2021, 42, 1–29. [Google Scholar] [CrossRef]
- Holford, D.; Lopez-Lopez, E.; Fasce, A.; et al. Identifying the underlying psychological constructs from self-expressed anti-vaccination argumentation. Humanit Soc Sci Commun. 2024, 11, 926. [Google Scholar] [CrossRef]
- Lazar, M.; Stănescu, A.; Penedos, A.R.; Pistol, A. Characterisation of measles after the introduction of the combined measles-mumps-rubella (MMR) vaccine in 2004 with focus on the laboratory data, 2016 to 2019 outbreak, Romania. Euro Surveill. 2019, 24, 1900041. [Google Scholar] [CrossRef]
- Dascalu, S. Measles epidemics in Romania: lessons for public health and future policy. Front Public Health. 2019, 7, 98. [Google Scholar] [CrossRef] [PubMed]
- European Centre for Disease Prevention and Control. Ongoing outbreak of measles in Romania, risk of spread and epidemiological situation in EU/EEA countries. Available online: https://www.ecdc.europa.eu/sites/default/files/media/en/publications/Publications/27-02-2017-RRA-Measles-Romania%2C%20European%20Union%20countries.pdf (accessed on 31 August 2024).
- Betsch, C.; Schmid, P.; Heinemeier, D.; Korn, L.; Holtmann, C.; Böhm, R. Beyond confidence: development of a measure assessing the 5C psychological antecedents of vaccination. PLoS One. 2018, 13, e0208601. [Google Scholar] [CrossRef]
- Dubé, E.; Vivion, M.; MacDonald, N.E. Vaccine hesitancy, vaccine refusal and the anti-vaccine movement: influence, impact and implications. Expert Rev Vaccines. 2015, 14, 99–117. [Google Scholar] [CrossRef]
- Wilson, S.L.; Wiysonge, C. Social media and vaccine hesitancy. BMJ Glob Health. 2020, 5, e004206. [Google Scholar] [CrossRef]
- The COCONEL Group. A future vaccination campaign against COVID-19 at risk of vac-cine hesitancy and politicisation. Lancet Infect Dis. 2020, 20, 769–770. [Google Scholar] [CrossRef] [PubMed]
- Almotairy, A.M.; Sheikh, W.A.; Joraid, A.A.A.; Bajwi, A.A.; Alharbi, M.S.F.; Al-Dubai, S.A.R. Association between knowledge of influenza vaccine and vaccination status among general population attending primary health care centers in Al-Madinah, Saudi Arabia. J Family Med Prim Care. 2019, 8, 2971–2974. [Google Scholar] [CrossRef] [PubMed]
- Sato, A.P.S.; Andrade, F.B.; Duarte, Y.A.O.; Antunes, J.L.F. Vaccine coverage and factors associated with influenza vaccination in the elderly in the city of São Paulo, Brazil: SABE Study 2015. Cad Saude Publica. 2020, 36 (Suppl. 2), e00237419. [Google Scholar] [CrossRef]
- Frew, P.M.; Saint-Victor, D.S.; Owens, L.E.; Omer, S.B. Socioecological and message framing factors influencing maternal influenza immunization among minority women. Vaccine. 2014, 32, 1736–1744. [Google Scholar] [CrossRef]
- Schmid, P.; Rauber, D.; Betsch, C.; Lidolt, G.; Denker, M.L. Barriers of influenza vaccination intention and behavior - a systematic review of influenza vaccine hesitancy, 2005 - 2016. PLoS One. 2017, 12, e0170550. [Google Scholar] [CrossRef]
- Kempe, A.; Saville, A.W.; Albertin, C.; et al. Parental hesitancy about routine childhood and influenza vaccinations: a national survey. Pediatrics. 2020, 146, e20193852. [Google Scholar] [CrossRef]
- Rief, W. Fear of adverse effects and COVID-19 vaccine hesitancy: recommendations of the treatment expectation expert group. JAMA Health Forum. 2021, 2, e210804. [Google Scholar] [CrossRef] [PubMed]
- Lionis, C.; Dumitra, G.; Kurpas, D.; et al. Building research capacity in rural health settings: barriers, priorities and recommendations for practitioners. Aust J Rural Health. 2018, 26, 300–302. [Google Scholar] [CrossRef]
- Diaz, P.; Zizzo, J.; Balaji, N.C.; et al. Fear about adverse effect on fertility is a major cause of COVID-19 vaccine hesitancy in the United States. Andrologia. 2022, 54, e14361. [Google Scholar] [CrossRef] [PubMed]
- Robinson, R.; Nguyen, E.; Wright, M.; et al. Factors contributing to vaccine hesitancy and reduced vaccine confidence in rural underserved populations. Humanit Soc Sci Commun. 2022, 9, 416. [Google Scholar] [CrossRef] [PubMed]
- Barbieri, V.; Wiedermann, C.J.; Lombardo, S.; et al. Rural-urban disparities in vaccine hesitancy among adults in South Tyrol, Italy. Vaccines (Basel). 2022, 10, 1870. [Google Scholar] [CrossRef]
- Piccoliori, G.; Barbieri, V.; Wiedermann, C.J.; Engl, A. Special roles of rural primary care and family medicine in improving vaccine hesitancy. Adv Clin Exp Med. 2023, 32, 401–406. [Google Scholar] [CrossRef]
- Surugiu, R.; Iancu, M.A.; Lăcătus, A.M.; et al. Unveiling the presence of social prescribing in Romania in the context of sustainable healthcare - a scoping review. Sustainability. 2023, 15, 11652. [Google Scholar] [CrossRef]

| Number of offices (physicians praxis) | Number of patients allocated | Number of consultations | Number of patients consulted | Number of refusals recorded | |
| Urban | 9 | 19427 | 8209 | 5333 (27.5% of the allocated patients) | 118 (2.2% of the consulted patients) |
| Rural | 7 | 18431 | 5768 | 4120 (22.4% of the allocated patients) | 154 (3.7% of the consulted patients) |
| Total | 16 | 37858 | 13977 | 9453 (25% of the allocated patients) | 272 (2.9% of the consulted patients) |
| Characteristics | All (n=272) | Adults (n=245) | Parents (n=27) | p value |
|---|---|---|---|---|
| Age, years mean±SD median (IQR) range | 57.5±17.2 58.5 (44-72) 18-91 | 59.5±16.8 62 (47-73) 18-91 | 39.7±6.48 38 (36-45) 28-50 | <0.001** |
| Gender, male | 109 (40.1%) | 92 (36.2%) | 17 (63.0%) | 0.011* χ2(1)=6.54 |
| Environment, urban | 118 (43.4%) | 95 (37.4%) | 23 (85.2%) | <0.001** χ2(1)=21.3 |
| Marital status, married (%) | 168 (61.8%) | 152 (58.8%) | 16 (59.3%) | 0.778 χ2(1)=0.08 |
| Chronic diseases, yes (%) | 187 (68.8%) | 186 (73.2%) | 1 (3.7%%) | <0.001** χ2(1)=59.0 |
| Having had flu in the past 5 years Yes No I do not know | 28 (10.3%) 189 (69.5%) 55 (20.2%) | 24 (9.4%) 170 (66.9%) 51 (20.1%) | 4 (14.8%) 19 (70.4%) 4 (14.8%) | 0.597 χ2(2)=1.03 |
| Past flu vaccination, yes | 62 (22.8%) | 59 (23.2%) | 3 (11.1%) | 0.127 χ2(1)=2.32 |
| Past COVID-19 vaccination, yes | 96 (35.3%) | 96 (37.8%) | 0 | <0.001** χ2(1)=16.4 |
| Other vaccines, yes | 50 (18.4%) | 32 (12.6%) | 18 (66.7%) | <0.001** χ2(1)=46.6 |
| Answers with “Yes” | All (n=272) | Adults (n=245) | Parents (n=27) | p value | |
|---|---|---|---|---|---|
| R1 | I don't think it's necessary | 84 (31%) | 78 (30.7%) | 6 (22.2%) | 0.299 χ2(1)=1.08 |
| R2 | I am afraid of adverse effects | 91 (33.6%) | 80 (31.5%) | 11 (40.7%) | 0.406 χ2(1)=0.69 |
| R3 | I don't have enough information about the vaccine | 2 (0.7%) | 2 (0.8%) | 0 | 0.637 χ2(1)=0.222 |
| R4 | I have had a previous negative experience with a vaccine | 28 (10.3%) | 28 (11.0%) | 0 | 0.064 χ2(1)=3.44 |
| R5 | I've never had the flu and I don't think I need it | 63 (23.2%) | 55 (21.7%) | 8 (29.6%) | 0.401 χ2(1)=0.705 |
| R6 | I consider myself to have a strong immune system | 31 (11.4%) | 28 (11.3%) | 3 (11.1%) | 0.961 χ2(1)=0.002 |
| R7 | I have chronic diseases that can get worse | 2 (0.7%) | 2 (0.8%) | 0 | 0.637 χ2(1)=0.222 |
| R8 | I don't trust the vaccine | 51 (18.8%) | 45 (17.7%) | 6 (22.2%) | 0.626 χ2(1)=0.237 |
| R9 | I do not vaccinate for religious reasons | 6 (2.2%) | 4 (1.6%) | 2 (7.4%) | 0.053 χ2(1)=3.76 |
| R10 | The vaccine is made to control people | 7 (2.6%) | 7 (2.8%) | 0 | 0.374 χ2(1)=0.792 |
| R11 | I don't use any vaccine anymore. I believe that the COVID vaccine was a business | 25 (9.2%) | 25 (9.8%) | 0 | 0.082 χ2(1)=3.03 |
| R12 | It's too expensive | 3 (1.1%) | 3 (1.2%) | 0 | 0.563 χ2(1)=0.334 |
| R13 | I am afraid of injections | 3 (1.1%) | 3 (1.2%) | 0 | 0.563 χ2(1)=0.334 |
| Number of classes | log-likelihood | AIC | BIC | p-value |
| 2-Class Model | -844.5 | 1737 | 1823 | 0.140 |
| 3-Class Model | -805.5 | 1693 | 1841 | 0.080 |
| 4-Class Model | -777.6 | 1671 | 1880 | 0.060 |
| Root of attitude | Reason of refusal | n (%) Total=272 |
| Conspiracist ideation | R10 The vaccine is made to control people | 7 (2.6%) |
| Distrust | R3 I don't have enough information about the vaccine R8 I don't trust the vaccine | 53 (19.5%) |
| Unwarranted beliefs | - | 0 |
| Worldview and politics | R11 I don't use any vaccine anymore. I believe that the COVID vaccine was a business R12 It's too expensive | 27 (9.9%) |
| Religious concerns | R9 I do not vaccinate for religious reasons | 6 (2.2%) |
| Moral concerns | - | 0 |
| Fear and phobias | R2 I am afraid of adverse effects R13 I am afraid of injections | 93 (34.2%) |
| Distorted risk perception | R1 I don't think it's necessary R5 I've never had the flu and I don't think I need it | 128 (47.1%) |
| Perceived self-interest | R6 I consider myself to have a strong immune system | 31 (11.4%) |
| Epistemic relativism | R4 I have had a previous negative experience with a vaccine R7 I have chronic diseases that can get worse | 30 (11.0%) |
| Reactance | - | 0 |
© GERMS 2024.
Share and Cite
Dumitra, G.G.; Alexiu, S.A.; Sănduţu, D.; Berbecel, C.; Curelea, M.; Barbu, C.V.; Deleanu, A.; Grom, A.; Lup, M.; Budiu, I.; et al. Segmenting Attitudes Toward Vaccination—Behavioral Insights into Influenza Vaccination Refusal in Romania. GERMS 2024, 14, 362-374. https://doi.org/10.18683/germs.2024.1446
Dumitra GG, Alexiu SA, Sănduţu D, Berbecel C, Curelea M, Barbu CV, Deleanu A, Grom A, Lup M, Budiu I, et al. Segmenting Attitudes Toward Vaccination—Behavioral Insights into Influenza Vaccination Refusal in Romania. GERMS. 2024; 14(4):362-374. https://doi.org/10.18683/germs.2024.1446
Chicago/Turabian StyleDumitra, Gheorghe Gindrovel, Sandra Adalgiza Alexiu, Dorica Sănduţu, Cosmina Berbecel, Monica Curelea, Cristina Vasilica Barbu, Anca Deleanu, Adrian Grom, Maria Lup, Ioana Budiu, and et al. 2024. "Segmenting Attitudes Toward Vaccination—Behavioral Insights into Influenza Vaccination Refusal in Romania" GERMS 14, no. 4: 362-374. https://doi.org/10.18683/germs.2024.1446
APA StyleDumitra, G. G., Alexiu, S. A., Sănduţu, D., Berbecel, C., Curelea, M., Barbu, C. V., Deleanu, A., Grom, A., Lup, M., Budiu, I., Vesa, M., Surugiu, R., Lăcătuş, A., & Turcu-Stiolica, A. (2024). Segmenting Attitudes Toward Vaccination—Behavioral Insights into Influenza Vaccination Refusal in Romania. GERMS, 14(4), 362-374. https://doi.org/10.18683/germs.2024.1446
