Next Article in Journal
Comparison of Microbial Preservation Methods: A Narrative Review
Previous Article in Journal
Isolation of Shiga Toxin-Producing Escherichia coli O157 and Non-O157 from Retail Imported Frozen Beef Marketed in Saudi Arabia Using Immunomagnetic Separation and Multiplex PCR
 
 
GERMS is published by MDPI from Volume 15 Issue 4 (2025). Previous articles were published by another publisher in Open Access under a CC-BY (or CC-BY-NC-ND) licence, and they are hosted by MDPI on mdpi.com as a courtesy and upon agreement with the former publisher Infection Science Forum.
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Segmenting Attitudes Toward Vaccination—Behavioral Insights into Influenza Vaccination Refusal in Romania

by
Gheorghe Gindrovel Dumitra
1,2,
Sandra Adalgiza Alexiu
2,
Dorica Sănduţu
2,
Cosmina Berbecel
2,
Monica Curelea
2,
Cristina Vasilica Barbu
2,
Anca Deleanu
2,
Adrian Grom
2,
Maria Lup
2,
Ioana Budiu
2,
Mădălina Vesa
2,
Roxana Surugiu
3,*,
Anca Lăcătuş
2,* and
Adina Turcu-Stiolica
4
1
Family Medicine Department, University of Medicine and Pharmacy of Craiova, 2-4 Petru Rares Street, 200349 Craiova, Romania
2
Immunization Working Group, Romanian National Society of Family Medicine, 65, Popa Nan Street, Bucharest, Romania
3
Department of Biochemistry, University of Medicine, and Pharmacy of Craiova, 2 Petru Rares Street, 200349 Craiova, Romania
4
Pharmacoeconomics Department, University of Medicine and Pharmacy of Craiova, 2-4 Petru Rares Street, 200349 Craiova, Romania
*
Authors to whom correspondence should be addressed.
GERMS 2024, 14(4), 362-374; https://doi.org/10.18683/germs.2024.1446
Submission received: 9 December 2024 / Revised: 31 December 2024 / Accepted: 31 December 2024 / Published: 31 December 2024

Abstract

Introduction Vaccine hesitancy remains a significant public health challenge, particularly in rural populations where geographic and socioeconomic barriers exacerbate the issue. This study aimed to examine the factors influencing vaccine hesitancy, focusing on influenza vaccinations in rural and urban communities in Romania. Methods The study was conducted between October 4 and October 30, 2024, across 16 family medicine practices, including seven in rural and nine in urban areas from Romania. A 13-item vaccine hesitancy questionnaire, assessing factors such as fear of adverse effects, distrust in vaccines, and perceived necessity included 272 responses. Latent Class Analysis (LCA) was used to identify distinct subgroups of hesitancy, while Chi-square and odds ratio analyses assessed geographic differences. We performed logistic regression for the most observed root attitudes on influenza vaccination refusal. Results Rural residents were significantly more likely to refuse influenza vaccination compared to urban residents. The LCA revealed three distinct latent classes, characterized by varying levels of agreement with key hesitancy items. Class 1 demonstrated low hesitancy, Class 2 exhibited high hesitancy driven by beliefs in natural immunity and perceived lack of necessity, and Class 3 showed intermediate hesitancy, influenced by distrust in vaccines and past negative experiences. Among the key significant triggers underlying vaccine refusal were fear of adverse effects, parental status, chronic diseases, and previous vaccination experiences, while factors such as age and gender showed limited impact. Conclusions Vaccine hesitancy persists as a complex, multidimensional issue, with rural populations disproportionately affected. Targeted, context-specific interventions addressing key drivers such as distorted risk perception, fear of adverse effects and distrust in vaccines are critical for improving vaccination rates These findings underscore the importance of tailored public health strategies to promote equitable vaccine uptake.

Introduction

Influenza viruses are a major cause of severe respiratory illness worldwide, leading to significant hospitalizations and deaths, particularly among older adults [1,2].
Despite declining mortality rates and disability-adjusted life years over the past three decades, influenza-related lower respiratory tract infections (LRTIs) continue to disproportionately affect males, older adults, and low-sociodemographic index regions, with the highest burden observed in individuals over 85 years old [3].
Over the past century, advancements in science and technology, particularly in vaccinology, have revolutionized public health by preventing numerous infectious diseases. Building on the pioneering work of Benjamin Jesty and Edward Jenner in smallpox control, these innovations culminated in milestones such as the licensing of the first Haemophilus influenzae type b conjugated vaccine in the 1980s [4,5]. Today, the World Health Organization estimates that vaccines save over 3.5 million lives annually by preventing diseases such as diphtheria, tetanus, pertussis, influenza, and measles [4,6].
Despite the critical role of vaccination in preventing influenza-related disease and the rising rates of LRTIs associated with influenza, vaccine hesitancy remains a significant barrier, hindering vaccination efforts and impacting the effectiveness of this preventive measure [7,8]. Vaccine hesitancy, characterized by a delay in accepting or refusal of vaccines despite their availability, has become an issue of increasing concern [9]. The internet and social media platforms have transformed the way information is shared and consumed, reshaping public health communication on a global scale. This shift has had a significant influence on vaccine acceptance, as these platforms serve as both a tool for spreading accurate health information and a channel for misinformation [10,11,12].
Understanding the psychological underpinnings of vaccine hesitancy is crucial for developing effective public health strategies. The JitsuVAX project has identified several key factors contributing to vaccine hesitancy: conspiracist ideation, distrust, unwarranted beliefs, worldview and politics, religious concerns, fear and phobias, distorted risk perception, perceived self-interest, and reactance [13].
Although numerous questionnaires have been developed to address vaccine hesitancy [14,15,16], data specific to Romania remain scarce, with one study that highlighted a notable fear of adverse effects associated with new vaccines compared to those included in the national immunization program [17].
In Romania, influenza vaccination rates are on a declining trend, despite the vaccines being available to specific population groups [18].
In the past years, the vaccines were purchased centrally by the Ministry of Health based on pre-orders provided by the county public health departments in consultation with family doctors. Subsequently, the vaccine was distributed to hospitals for healthcare personnel, social or medical-social assistance units for institutionalized individuals, and primarily to primary healthcare offices to be administered to at-risk groups as follows: medical and auxiliary personnel, pregnant women, children aged between 6 months and 5 years, individuals over
65 years old, and people with certain chronic illnesses. The vaccination system faced challenges, including delays from centralized procurement, uneven distribution across counties, limited urban supply, and inadequate logistics, requiring family doctors to manage transportation. The National Vaccination Program focused on pediatric and at-risk groups, with influenza vaccination being the primary vaccine for adults, limiting their perception of lifelong vaccination needs.
In September 2023, a new vaccine procurement and distribution mechanism was introduced through the electronic prescription system of the National Health Insurance House. This initiative expanded public access to vaccines by including HPV, dTap, pneumococcal, meningococcal, hepatitis B, measles, mumps, and rubella (MMR), and varicella vaccines, alongside the influenza vaccine. The new system lays the foundation for implementing the “lifelong vaccination” principle to prevent vaccine-preventable diseases in the adult population. Also, influenza vaccination reimbursement coverage has been expanded to include children aged 6 months to 18 years, pregnant women, individuals 65 and older, healthcare personnel, and adults aged 19-64 with chronic conditions. Additionally, adults aged 45-64 without chronic diseases receive 50% compensation for the vaccine [19,20].
Influenza vaccination has experienced a noticeable decline in the post-pandemic period, influenced by misinformation and disinformation surrounding COVID-19 and the SARS-CoV-2 vaccine. Additionally, administrative challenges highlighted at both European and national level regarding the measures taken to limit the spread of the disease or vaccination against COVID-19 have contributed to this trend.
In this context, we aimed to identify and categorize the reasons invoked by patients for refusing vaccination in the 2024-2025 influenza vaccination season, providing insights to guide educational programs for vaccinating and to improve public communication strategies by authorities, using a tailored questionnaire distributed across several family medicine practices in both rural and urban areas of Romania.

Methods

Data collection

The study was conducted in Romania between October 4 and October 30, 2024, across 16 family medicine practices, including seven in rural areas and nine in urban areas with national distribution that met the following inclusion criteria (1) they agreed to collect anonymized data from office records on patients who presented in October 2024; (2) they integrated the recommendation for influenza vaccination into routine practice for all patients visiting the office, regardless of the reason; (3) they documented in primary records the reasons for vaccine refusal and collected anamnestic data on vaccination for patients on their own list.
The 16 participating practices had as their main physicians members (11 medical practices) of the Immunization Working Group (IWG) of the Romanian National Society of Family Medicine (SNMF) who agreed to participate in this study. In order to balance the number of patients included in the study by urban or rural area where the activity was carried out, we also called on 5 other family doctors from Romania who agreed to participate and met the inclusion criteria. These offices work in 9 counties (Alba, Arad, Brașov, Dolj, Iași, Ilfov, Timiș, Vaslui and Bucharest) out of the 42.
We chose to conduct the study taking into account all presentations at the practice only in October because it is the most appropriate month to recommend influenza vaccination in accordance with the recommendations of the international authority and the influenza vaccine prescription protocol developed by National Immunization Technical Advisory Groups (NITAG). We did not continue the study in November because the patients presenting to the consultation could have been the same considering the characteristics of presentations in family medicine.
The research focused on patients who declined the recommended influenza vaccination and included a total of 272 responses. A 13-item vaccine refusal questionnaire was utilized, comprising "Yes" or "No" responses to specific statements: (R1) – “I don't think it's necessary”, (R2) – “I am afraid of adverse effects”, (R3) – “I lack sufficient information about the vaccine”, (R4) – “I have had a previous negative experience with a vaccine”, (R5) – “I have never had the flu and do not consider vaccination necessary”, (R6) – “I consider myself to have a strong immune system”, (R7) – “I have chronic illnesses that may worsen”, (R8) – “I do not trust the vaccine”, (R9) – “I refuse vaccination for religious reasons”, (R10) – “I believe the vaccine is made to control people”, (R11) – “I no longer use vaccines as I view the COVID-19 vaccine as a business venture”, (R12) – “It is too expensive”, (R13) – “I am afraid of injections”. The items were then ranked according to the highest number of “Yes”. Those that accumulated the highest numbers were considered relevant for our research.
The questionnaire was designed by a team of experts in vaccinations (Gheorghe Gindrovel Dumitra – GGD, Roxana Surugiu – RS and members of IWG) and included the most important factors influencing vaccine hesitancy, as highlighted in the literature or identified through their clinical practice. Prior to distribution, a brief pilot study including 10 files of patients was conducted to ensure that the questions were well-constructed and easily understood. IWG of SNMF is a special interest group in the main professional society in family medicine in Romania. The group provides expertise in the field of vaccination to family doctors in Romania, authorities and the general public. GGD is the coordinator of this group and a member of NITAG of the Ministry of Health of Romania and the group is formed by 14 family physicians with a special interest in the field of vaccination who provide medical services in 9 counties out of the 42 of the country.
The study received ethical approval from the Ethics Committee of the University of Medicine and Pharmacy of Craiova, Romania (approval number 399/04.10.2024).

Statistical analysis

Descriptive statistics are reported for sample characteristics and hesitancy of a flu vaccine. All statistical tests were conducted using R, and statistical significance was set to 0.05. We conducted a Latent Class Analysis (LCA) using the poLCA [21] package for R (v.1.6.0.1 Linzer and Lewis, 2011). We computed the Akaike Information Criterion (AIC) and the Bayesian Information Criterion (BIC) to evaluate and compare the goodness-of-fit of different models while penalizing for model complexity. In the context of our LCA, these criteria help us determine the optimal number of latent classes that best represent our data on vaccine refusal. Lower AIC values indicate a better model fit, balancing goodness-of-fit with model simplicity. Lower BIC values suggest a better model, with a stronger emphasis on model simplicity compared to AIC.
We performed the logistic regression for the most observed root attitudes on influenza vaccination refusal. We first assessed the multicollinearity and casewise list of residuals, then the odds ratio greater than 1 indicates the odds of the outcome increase as the predictor variable increases.

Results

We collected and used data from participating physicians who selected from the database 272 patient records that expressed a reason for refusing to receive vaccination. We included in the study a number of 16 offices distributed in urban areas (n=9) and rural areas (n=7) which allowed the analysis on a capitation list consisting of 37858 patients distributed approximately equally (19427 in urban areas and 18431 in rural areas). During the time interval taken into the study, more patients presented in urban areas, but the number of refusals recorded was higher in rural areas (Table 1). There was a significant difference in refusal rates between urban and rural settings (χ2(1)=18.81, p<0.001). Rural areas exhibited a higher proportion of refusals relative to their consultations compared to urban areas, as seen in Figure 1.
Odds of vaccine refusal given perceptions characteristics are presented in Table 2 and Table 3.
The 3-class model was found to be better among the three models as seen in Table 4, being the most balanced choice considering BIC, interpretability, and parsimony (AIC was best for 4-Class Model, but could be unnecessarily complex, whereas BIC was best for 3-Class Model) – Table 4.
Lower AIC and BIC values indicate better models, with BIC placing a stronger emphasis on model simplicity compared to AIC. In our analysis, we observed that as the number of latent classes increased, AIC values continued to decrease, reflecting improved model fit. However, BIC values continued to increase and reached a minimum at two latent classes, but with the highest p-value. We considered 3-classe model indicating that this model strikes the best balance between goodness-of-fit and parsimony.
To ensure robustness in model selection, we prioritized the BIC values in our final decision because of its tendency to favor simpler models, especially in smaller sample sizes. Additionally, the interpretability of the model with three classes aligned with the theoretical framework of vaccine refusal, further justifying its selection as the optimal model. Models with more classes exhibited smaller gains in AIC/BIC improvements while increasing model complexity and interpretive challenges.
Thus, the final model with three latent classes was selected based on a combination of statistical evidence and practical interpretability.
The probabilities of different responses for the key items (R1, R2, R4, R5, R6, R8, R11) across the three latent classes derived from the Latent Class Analysis (LCA) are shown in Figure 1. The three classes are expected to differ in their response patterns to these seven items (Figure 1).
Class 1 predominantly responds with “No” (blue) for most items, indicating a strong tendency toward this type of response across all items, except for R2 (“I am afraid of adverse effects”), where all members of this class responded with “Yes” (orange).
Class 2 shows greater variability in responses, alternating between “No” (blue) and “Yes” (orange) depending on the item. For certain items (e.g., R1, R5, R6), there is a substantial probability of responding with “Yes” suggesting that members of this class are more likely to choose this response for these specific items. However, for other items, the preference for “No” (blue) remains dominant, albeit less consistent compared to Class 1.
Class 3 also predominantly chooses “No” (blue) for most items, but the probability of responding with “Yes” (orange) is higher for certain items, such as R4 (“I have had a previous negative experience with a vaccine”). For some items, the responses in Class 3 align with those of Class 2, particularly for R2 (“I am afraid of adverse effects”) and R8 (“I don't trust the vaccine”).
Items like R1 (“I don't think it's necessary”), R2 (“I am afraid of adverse effects”), R4 (“I have had a previous negative experience with a vaccine”), and R5 (“I've never had the flu, so I don't think I need it”) appear to distinguish the classes more clearly. For instance, Class 1 demonstrates a much higher likelihood of responding “Yes” to R2, while Class 3 shows a higher likelihood of responding “Yes” to both R2 and R5. Additionally, Class 3 has a markedly higher likelihood of responding “Yes” to R4 compared to the other classes.
The three latent classes represented in Figure 2 represent the three distinct subgroups within our data, each with unique response patterns. Class 1 (Red polygon) has lower probabilities of responding positively across most items compared to the other classes. R2 has a higher probability, but its overall profile suggests more uniform and lower levels of agreement with the items. Class 2 (Green polygon) has the highest probabilities of responding positively (“Yes”) for several items (e.g., R1, R5, and R6). This indicates that individuals in Class 2 are more likely to agree or identify with the statements in these items, distinguishing this group as the most positively inclined class. Class 3 (Blue polygon) falls between Class 1 and Class 2. Class 3 has noticeable peaks for certain items (e.g., R4 and R8), suggesting that individuals in this class are more likely to agree with these items compared to Class 1 but less so than Class 2 (Figure 2).
Figure 2. Item by class. Blue represents the response "No" (Y=1), while orange represents the response "Yes" (Y=2). Taller bars for a given response level indicate a higher likelihood of that response within the respective class. Each subplot corresponds to a specific item from the questionnaire.
Figure 2. Item by class. Blue represents the response "No" (Y=1), while orange represents the response "Yes" (Y=2). Taller bars for a given response level indicate a higher likelihood of that response within the respective class. Each subplot corresponds to a specific item from the questionnaire.
Germs 14 00362 g002
Figure 3. Radar chart representing the three distinct classes in the LCA. Each polygon (red, green, blue) represents the response patterns of a specific class. The average polygon represents the overall pattern across all classes. The values along the axes represent probabilities (from 0 to 1) showing the likelihood of a particular response for that item within each class.
Figure 3. Radar chart representing the three distinct classes in the LCA. Each polygon (red, green, blue) represents the response patterns of a specific class. The average polygon represents the overall pattern across all classes. The values along the axes represent probabilities (from 0 to 1) showing the likelihood of a particular response for that item within each class.
Germs 14 00362 g003
Items like R1, R2, R4, R5 and R6 are the most discriminative, as they show the most variation across classes. These items may be key to distinguishing the underlying traits or attitudes of each class.
We superimposed the patients' answers regarding the reasons for refusing vaccination on the roots of attitudes described in the specialized literature [22]. Statistical analysis shows that the most frequent roots of the identified attitudes are: distorted risk perception (n=128), fear and phobia (n=93), distrust (n=53), perceived selfinterest (n=31) – Table 5.
Interpretation of the logistic regression results for distorted risk perception as a predictor of influenza vaccination refusal found that marital status did not have a statistically significant impact on flu vaccination refusal (p>0.05). Age was not statistically significant (p>0.05), although it approached significance (p=0.080). There was a slight increase in the odds of refusal with each additional year of age (OR=1.018). Having chronic conditions was found to be associated with a significant decrease in the odds of flu vaccination refusal by approximately 57.2% (p=0.027). Individuals with a history of influenza vaccination had 76.2% lower odds of refusal flu vaccination due to a distorted risk perception (p<0.001).
Based on the logistic regression analysis examining fear and phobia, significant predictors include gender (females exhibited an 83.3% increase in the odds of refusal, p=0.046), being a parent (associated with a substantial 1445.7% increase in the odds of refusal, p<0.001), and having chronic diseases (associated with a 1393.1% increase in the odds of refusal, p<0.001). Non-significant predictors include age, COVID-19 vaccination status, and a history of past vaccination with other vaccines (p>0.05).
According to the logistic regression analysis, marital status (unmarried or widowed) significantly increased the odds of distrust in flu vaccination by 175.8% (p=0.021). Membership in the category of parents significantly reduced the odds of distrust by approximately 91.3% (p=0.004). Similarly, being vaccinated against COVID-19 decreased the odds of distrust by approximately 84.8% (p=0.001). Conversely, having a history of receiving other vaccines significantly increased the odds of distrust by approximately 604.6% (p<0.001). Age, gender, environmental factors, chronic diseases, and past flu vaccination did not have a statistically significant effect on distrust (p>0.05).

Discussion

This study provides valuable insights into the factors influencing influenza vaccine refusal, within rural and urban populations in Romania, highlighting key sociodemographic and behavioral predictors. The findings underscore the complexity of vaccine hesitancy, which is influenced by diverse factors ranging from marital status and parenting status to prior vaccination history and gender.
Vaccine hesitancy remains a significant issue in Romania, affecting numerous vaccines, including pediatric ones. This has contributed to several measles outbreaks in Romania, resulting in 64 deaths between 2016 and 2020 [23,24], and 21 additional deaths during 2023-2024 [25]. Among adults, the perception of the need for lifelong vaccination is notably low, as reflected in Romania’s poor acceptance rates of vaccination against COVID-19.
Through the 13-item vaccine hesitancy questionnaire, key patterns of hesitancy were identified. The LCA distinguished three distinct subgroups (latent classes) among respondents. These patterns could help us understand underlying behavioral or attitudinal differences related to the items. The three latent classes identified through the LCA align with patterns observed in previous research on vaccine hesitancy, emphasizing the diversity in hesitancy drivers and attitudes across populations. Class 2, representing individuals more open to vaccination, reflects a segment that aligns closely with those described in the literature as “acceptors” or “pro-vaccine” individuals. Studies have shown that this group often exhibits higher trust in health authorities and vaccines, influenced by positive experiences with vaccination or a strong belief in the collective benefits of herd immunity [26]. Interventions for this group may not require extensive effort, as they are likely to respond well to general public health messaging reinforcing the benefits and safety of vaccines.
Class 1, on the other hand, appears to align with those labeled as "vaccine hesitant" or "resisters" in prior research [27]. These individuals often harbor deep-seated concerns about vaccine safety, efficacy, and trust in health systems. Factors such as exposure to misinformation, cultural or religious beliefs, and previous negative healthcare experiences may play a significant role in shaping their attitudes [28]. Addressing this class requires more intensive and personalized strategies, such as community-based education, engagement with trusted community leaders, or transparent communication addressing specific fears and misconceptions.
Class 3, the intermediate group, aligns with descriptions of “fence-sitters” in the literature – individuals who may neither strongly accept nor outright reject vaccines but are influenced by contextual factors such as perceived risk, social norms, or specific concerns like the one highlighted (e.g., distrust in the vaccine itself). Studies have suggested that targeted interventions, such as addressing perceived risks versus benefits and leveraging positive peer influence, can be effective in nudging this group toward vaccine acceptance [29]. Tailored messaging that acknowledges their concerns while providing clear, evidence-based information may be key to converting hesitancy into acceptance.
Understanding these classes not only highlights the multifaceted nature of vaccine hesitancy but also underscores the importance of segmented approaches in designing public health interventions. Such differentiation allows for the deployment of resources more effectively, targeting those who need them most while maintaining the trust of those already inclined to vaccinate.
The logistic regression analysis revealed that marital status is significantly associated with distrust toward influenza vaccination, suggesting that factors such as the lack of familial support networks may contribute to attitudes of distrust. Similar results have been reported in the literature, with a positive association between marital status and influenza vaccine uptake [30,31]. Conversely, being a parent was associated with a significant reduction in the odds of distrust, which may indicate a greater awareness of the role of vaccination in protecting both the individual and their family [32,33].
Secondly, the majority of respondents were middle-aged or older, with a significant proportion reporting chronic illnesses. Despite these risk factors, hesitancy persisted, particularly among those citing fears of adverse effects, distrust in vaccines, or a belief in natural immunity. Similar findings have been reported in the literature, with fear of adverse effects emerging as the most prominent factor [34,35].
We further identified geographic disparities in vaccine refusal, with a significant association between the area of residence (urban/rural) and influenza vaccine refusal, with rural residents being more likely to decline vaccination. This finding is consistent with previous studies showing that rural populations often face unique barriers [36], including limited healthcare access [37], lower health literacy [38], and deeply ingrained cultural or religious beliefs [39], or other socio-demographic factors [40].
Our study highlights the need for comprehensive interventions to address the fear of post-vaccination adverse effects, including the implementation of social prescribing measures, special in rural areas, to facilitate greater acceptance of vaccination [41].
The findings emphasize the need for geographically and demographically tailored public health campaigns to mitigate vaccine hesitancy and vaccine refusal. In rural areas, strategies should focus on improving access to healthcare services, enhancing health education, and engaging trusted local healthcare providers or other stakeholders to build trust in vaccines and increase awareness in vaccine preventable diseases risk perception. Furthermore, addressing specific hesitancy drivers—such as fear of adverse effects, distrust in vaccines, and perceived lack of necessity—will be crucial. The distinct patterns identified through LCA suggest that interventions should be customized for different subgroups to maximize their effectiveness.
While this study provides important insights, several limitations should be considered. First, the reliance on self-reported data may introduce bias, and the sample size may limit the generalizability of findings. Second, the cross-sectional design captures attitudes at a single point in time, which may not fully reflect dynamic changes in hesitancy over time. Future research should explore longitudinal trends in vaccine hesitancy and evaluate the impact of tailored interventions on improving vaccine acceptance.

Conclusions

Vaccine hesitancy remains a multifaceted challenge, with rural populations being disproportionately impacted. Implementing targeted and context-specific interventions that address key factors such as distorted risk perception, fear of adverse effects and distrust in vaccines is essential for enhancing vaccination coverage. These results highlight the necessity of tailored public health strategies to ensure equitable vaccine access and acceptance.

Author Contributions

Conceptualization, GGD and RS; methodology, GGD, RS; investigations, ATS; software, ATS; validation, ATS, GGD, AL, RS; formal analysis, ATS; resources, GGD; data curation, SAA, DS, CB, MC, CVB, AD, AG, ML, IB, MV, AL; writing—original draft preparation, GGD, RS; writing – review and editing, AL, RS; supervision, ATS, RS; project administration GGD; All authors read and approved the final version of the manuscript.

Funding

None to declare.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki and approved by the Ethics Committee from the University of Medicine and Pharmacy of Craiova, Romania (no. 399/04.10.2024).

Data Availability Statement

The datasets used and/or analyzed during the current study are available from the corresponding authors on reasonable request.

Acknowledgments

The authors want to express special thanks to our colleagues who contributed to data collection: Mihaela Valeria Nicolae, Nicoleta Cristina Popescu, Doina Bunescu, Paula Popescu, Gabriela Luchian, Mirela Mustață.

Conflicts of interest

All authors – none to declare.

References

  1. Lafond, K.E.; Porter, R.M.; Whaley, M.J.; et al. Global burden of influenza-associated lower respiratory tract infections and hospitalizations among adults: a systematic review and meta-analysis. PLoS Med. 2021, 18, e1003550. [Google Scholar] [CrossRef]
  2. Yokomichi, H.; Mochizuki, M.; Lee, J.J.; Kojima, R.; Yokoyama, T.; Yamagata, Z. Incidence of hospitalisation for severe complications of influenza virus infection in Japanese patients between 2012 and 2016: a cross-sectional study using routinely collected ad-ministrative data. BMJ Open. 2019, 9, e024687. [Google Scholar] [CrossRef]
  3. Feng, J.N.; Zhao, H.Y.; Zhan, S.Y. Global burden of influenza lower respiratory tract infections in older people from 1990 to 2019. Aging Clin Exp Res. 2023, 35, 2739–2749. [Google Scholar] [CrossRef]
  4. Montero, D.A.; Vidal, R.M.; Velasco, J.; et al. Two centuries of vaccination: historical and conceptual approach and future perspectives. Front Public Health. 2024, 11, 1326154. [Google Scholar] [CrossRef] [PubMed]
  5. Hammarsten, J.F.; Tattersall, W.; Hammarsten, J.E. Who discovered smallpox vaccination? Edward Jenner or Benjamin Jesty? Trans Am Clin Climatol Assoc. 1979, 90, 44–55. [Google Scholar] [PubMed]
  6. Nandi, A.; Shet, A. Why vaccines matter: understanding the broader health, economic, and child development benefits of routine vaccination. Hum Vaccin Immunother. 2020, 16, 1900–1904. [Google Scholar] [CrossRef]
  7. Stephens, A.B.; Hofstetter, A.M.; Stockwell, M.S. Influenza vaccine hesitancy: scope, influencing factors, and strategic interventions. Pediatr Clin North Am. 2023, 70, 227–241. [Google Scholar] [CrossRef] [PubMed]
  8. Kempe, A.; Saville, A.W.; Albertin, C.; et al. Parental hesitancy about routine childhood and influenza vaccinations: a national survey. Pediatrics. 2020, 146, e20193852. [Google Scholar] [CrossRef]
  9. MacDonald, N.E.; SAGE Working Group on Vaccine Hesitancy. Vaccine hesitancy: definition, scope and determinants. Vaccine. 2015, 33, 4161–4164. [Google Scholar] [CrossRef]
  10. Dubé, E.; Vivion, M.; MacDonald, N.E. Vaccine hesitancy, vaccine refusal and the anti-vaccine movement: influence, impact and implications. Expert Rev Vaccines. 2015, 14, 99–117. [Google Scholar] [CrossRef]
  11. Cinelli, M.; De Francisci Morales, G.; Galeazzi, A.; Quattrociocchi, W.; Starnini, M. The echo chamber effect on social media. Proc Natl Acad Sci U S A. 2021, 118, e2023301118. [Google Scholar] [CrossRef] [PubMed]
  12. Puri, N.; Coomes, E.A.; Haghbayan, H.; Gunaratne, K. Social media and vaccine hesitancy: new updates for the era of COVID-19 and globalized infectious diseases. Hum Vaccin Immunother. 2020, 16, 2586–2593. [Google Scholar] [CrossRef]
  13. Holford, D.L.; Fasce, A.; Costello, T.H.; Lewandowsky, S. Psychological profiles of anti-vaccination argument endorsement. Sci Rep. 2023, 13, 11219. [Google Scholar] [CrossRef] [PubMed]
  14. Larson, H.J.; Jarrett, C.; Schulz, W.S.; et al. Measuring vaccine hesitancy: the development of a survey tool. Vaccine. 2015, 33, 4165–4175. [Google Scholar] [CrossRef]
  15. Cvjetković, S.; Jeremić Stojković, V.; Piperac, P.; Djurdjević, O.; Bjegović-Mikanović, V. Determinants of COVID-19 vaccine hesitancy: questionnaire development and validation. Cent Eur J Public Health. 2020, 30, 99–106. [Google Scholar] [CrossRef]
  16. Xiao, X.; Wong, R.M. Vaccine hesitancy and perceived behavioral control: a meta-analysis. Vaccine. 2020, 38, 5131–5138. [Google Scholar] [CrossRef]
  17. Mărcău, F.C.; Peptan, C.; Nedelcuță, R.M.; Băleanu, V.D.; Băleanu, A.R.; Niculescu, B. Parental COVID-19 vaccine hesitancy for children in Romania: national survey. Vaccines (Basel). 2022, 10, 547. [Google Scholar] [CrossRef]
  18. Enciu, B.G.; Pitigoi, D.; Zaharia, A.; et al. The influenza vaccination uptake in Romania during the 2022-2023 season. Farmacia. 2023, 71, 1289–1294. [Google Scholar] [CrossRef]
  19. Government of Romania. Hotărâre privind aprobarea strategiei nationale de vaccinare 2023-2030. Available online: https://sgglegis.gov.ro/legislativ/docs/2023/08/g63hp1 tcrwfb8s02dv5m.pdf (accessed on 30 August 2024).
  20. Government of Romania. Hotărâre 20/27.06.2023 - Portal Legislativ. Available online: https://legislatie.just.ro/Public/DetaliiDocument/271771 (accessed on 29 July 2024).
  21. Linzer, D.A.; Lewis, J.B. poLCA: an R package for polytomous variable latent class analysis. J Stat Softw. 2021, 42, 1–29. [Google Scholar] [CrossRef]
  22. Holford, D.; Lopez-Lopez, E.; Fasce, A.; et al. Identifying the underlying psychological constructs from self-expressed anti-vaccination argumentation. Humanit Soc Sci Commun. 2024, 11, 926. [Google Scholar] [CrossRef]
  23. Lazar, M.; Stănescu, A.; Penedos, A.R.; Pistol, A. Characterisation of measles after the introduction of the combined measles-mumps-rubella (MMR) vaccine in 2004 with focus on the laboratory data, 2016 to 2019 outbreak, Romania. Euro Surveill. 2019, 24, 1900041. [Google Scholar] [CrossRef]
  24. Dascalu, S. Measles epidemics in Romania: lessons for public health and future policy. Front Public Health. 2019, 7, 98. [Google Scholar] [CrossRef] [PubMed]
  25. European Centre for Disease Prevention and Control. Ongoing outbreak of measles in Romania, risk of spread and epidemiological situation in EU/EEA countries. Available online: https://www.ecdc.europa.eu/sites/default/files/media/en/publications/Publications/27-02-2017-RRA-Measles-Romania%2C%20European%20Union%20countries.pdf (accessed on 31 August 2024).
  26. Betsch, C.; Schmid, P.; Heinemeier, D.; Korn, L.; Holtmann, C.; Böhm, R. Beyond confidence: development of a measure assessing the 5C psychological antecedents of vaccination. PLoS One. 2018, 13, e0208601. [Google Scholar] [CrossRef]
  27. Dubé, E.; Vivion, M.; MacDonald, N.E. Vaccine hesitancy, vaccine refusal and the anti-vaccine movement: influence, impact and implications. Expert Rev Vaccines. 2015, 14, 99–117. [Google Scholar] [CrossRef]
  28. Wilson, S.L.; Wiysonge, C. Social media and vaccine hesitancy. BMJ Glob Health. 2020, 5, e004206. [Google Scholar] [CrossRef]
  29. The COCONEL Group. A future vaccination campaign against COVID-19 at risk of vac-cine hesitancy and politicisation. Lancet Infect Dis. 2020, 20, 769–770. [Google Scholar] [CrossRef] [PubMed]
  30. Almotairy, A.M.; Sheikh, W.A.; Joraid, A.A.A.; Bajwi, A.A.; Alharbi, M.S.F.; Al-Dubai, S.A.R. Association between knowledge of influenza vaccine and vaccination status among general population attending primary health care centers in Al-Madinah, Saudi Arabia. J Family Med Prim Care. 2019, 8, 2971–2974. [Google Scholar] [CrossRef] [PubMed]
  31. Sato, A.P.S.; Andrade, F.B.; Duarte, Y.A.O.; Antunes, J.L.F. Vaccine coverage and factors associated with influenza vaccination in the elderly in the city of São Paulo, Brazil: SABE Study 2015. Cad Saude Publica. 2020, 36 (Suppl. 2), e00237419. [Google Scholar] [CrossRef]
  32. Frew, P.M.; Saint-Victor, D.S.; Owens, L.E.; Omer, S.B. Socioecological and message framing factors influencing maternal influenza immunization among minority women. Vaccine. 2014, 32, 1736–1744. [Google Scholar] [CrossRef]
  33. Schmid, P.; Rauber, D.; Betsch, C.; Lidolt, G.; Denker, M.L. Barriers of influenza vaccination intention and behavior - a systematic review of influenza vaccine hesitancy, 2005 - 2016. PLoS One. 2017, 12, e0170550. [Google Scholar] [CrossRef]
  34. Kempe, A.; Saville, A.W.; Albertin, C.; et al. Parental hesitancy about routine childhood and influenza vaccinations: a national survey. Pediatrics. 2020, 146, e20193852. [Google Scholar] [CrossRef]
  35. Rief, W. Fear of adverse effects and COVID-19 vaccine hesitancy: recommendations of the treatment expectation expert group. JAMA Health Forum. 2021, 2, e210804. [Google Scholar] [CrossRef] [PubMed]
  36. Lionis, C.; Dumitra, G.; Kurpas, D.; et al. Building research capacity in rural health settings: barriers, priorities and recommendations for practitioners. Aust J Rural Health. 2018, 26, 300–302. [Google Scholar] [CrossRef]
  37. Diaz, P.; Zizzo, J.; Balaji, N.C.; et al. Fear about adverse effect on fertility is a major cause of COVID-19 vaccine hesitancy in the United States. Andrologia. 2022, 54, e14361. [Google Scholar] [CrossRef] [PubMed]
  38. Robinson, R.; Nguyen, E.; Wright, M.; et al. Factors contributing to vaccine hesitancy and reduced vaccine confidence in rural underserved populations. Humanit Soc Sci Commun. 2022, 9, 416. [Google Scholar] [CrossRef] [PubMed]
  39. Barbieri, V.; Wiedermann, C.J.; Lombardo, S.; et al. Rural-urban disparities in vaccine hesitancy among adults in South Tyrol, Italy. Vaccines (Basel). 2022, 10, 1870. [Google Scholar] [CrossRef]
  40. Piccoliori, G.; Barbieri, V.; Wiedermann, C.J.; Engl, A. Special roles of rural primary care and family medicine in improving vaccine hesitancy. Adv Clin Exp Med. 2023, 32, 401–406. [Google Scholar] [CrossRef]
  41. Surugiu, R.; Iancu, M.A.; Lăcătus, A.M.; et al. Unveiling the presence of social prescribing in Romania in the context of sustainable healthcare - a scoping review. Sustainability. 2023, 15, 11652. [Google Scholar] [CrossRef]
Figure 1. Overall distribution of refusals between urban and rural settings. The blue color represents patients who accepted the vaccination as well as patients who were hesitant but mentioned that a decision regarding vaccination will be made later. It does not equal those who were actually vaccinated this month.
Figure 1. Overall distribution of refusals between urban and rural settings. The blue color represents patients who accepted the vaccination as well as patients who were hesitant but mentioned that a decision regarding vaccination will be made later. It does not equal those who were actually vaccinated this month.
Germs 14 00362 g001
Table 1. Distribution of consultations, patients, and vaccination refusals across urban and rural medical practices.
Table 1. Distribution of consultations, patients, and vaccination refusals across urban and rural medical practices.
Number of offices
(physicians praxis)
Number of
patients allocated
Number of
consultations
Number of patients
consulted
Number of refusals
recorded
Urban91942782095333 (27.5% of the
allocated patients)
118 (2.2% of the
consulted patients)
Rural71843157684120 (22.4% of the
allocated patients)
154 (3.7% of the
consulted patients)
Total1637858139779453 (25% of the
allocated patients)
272 (2.9% of the
consulted patients)
Number of refusals recorded includes only patients who expressed a refusal reason to being vaccinated. This category did not include patients who were vaccinated, as well as those who presented a reason but stated that they would be vaccinated later.
Table 2. Characteristics of the respondents.
Table 2. Characteristics of the respondents.
CharacteristicsAll
(n=272)
Adults
(n=245)
Parents
(n=27)
p value
Age, years
mean±SD
median (IQR)
range

57.5±17.2
58.5 (44-72)
18-91

59.5±16.8
62 (47-73)
18-91

39.7±6.48
38 (36-45)
28-50
<0.001**
Gender, male109 (40.1%)92 (36.2%)17 (63.0%)0.011*
χ2(1)=6.54
Environment, urban118 (43.4%)95 (37.4%)23 (85.2%)<0.001**
χ2(1)=21.3
Marital status, married (%)168 (61.8%)152 (58.8%)16 (59.3%)0.778
χ2(1)=0.08
Chronic diseases, yes (%)187 (68.8%)186 (73.2%)1 (3.7%%)<0.001**
χ2(1)=59.0
Having had flu in the past 5 years Yes
No
I do not know

28 (10.3%)
189 (69.5%)
55 (20.2%)

24 (9.4%)
170 (66.9%)
51 (20.1%)

4 (14.8%)
19 (70.4%)
4 (14.8%)
0.597
χ2(2)=1.03
Past flu vaccination, yes62 (22.8%)59 (23.2%)3 (11.1%)0.127
χ2(1)=2.32
Past COVID-19 vaccination, yes96 (35.3%)96 (37.8%)0<0.001**
χ2(1)=16.4
Other vaccines, yes50 (18.4%)32 (12.6%)18 (66.7%)<0.001**
χ2(1)=46.6
Data is presented as n (%) unless otherwise stated. *p value <0.05, **p value < 0.001.
Table 3. Odds of vaccine refusal given perceptions characteristics.
Table 3. Odds of vaccine refusal given perceptions characteristics.
Answers with “Yes”All (n=272)Adults (n=245)Parents (n=27)p value
R1I don't think it's necessary84 (31%)78 (30.7%)6 (22.2%)0.299
χ2(1)=1.08
R2I am afraid of adverse effects91 (33.6%)80 (31.5%)11 (40.7%)0.406
χ2(1)=0.69
R3I don't have enough information about the
vaccine
2 (0.7%)2 (0.8%)00.637
χ2(1)=0.222
R4I have had a previous negative experience with
a vaccine
28 (10.3%)28 (11.0%)00.064
χ2(1)=3.44
R5I've never had the flu and I don't think I need
it
63 (23.2%)55 (21.7%)8 (29.6%)0.401
χ2(1)=0.705
R6I consider myself to have a strong immune
system
31 (11.4%)28 (11.3%)3 (11.1%)0.961
χ2(1)=0.002
R7I have chronic diseases that can get worse2 (0.7%)2 (0.8%)00.637
χ2(1)=0.222
R8I don't trust the vaccine51 (18.8%)45 (17.7%)6 (22.2%)0.626
χ2(1)=0.237
R9I do not vaccinate for religious reasons6 (2.2%)4 (1.6%)2 (7.4%)0.053
χ2(1)=3.76
R10The vaccine is made to control people7 (2.6%)7 (2.8%)00.374
χ2(1)=0.792
R11I don't use any vaccine anymore. I believe that
the COVID vaccine was a business
25 (9.2%)25 (9.8%)00.082
χ2(1)=3.03
R12It's too expensive3 (1.1%)3 (1.2%)00.563
χ2(1)=0.334
R13I am afraid of injections3 (1.1%)3 (1.2%)00.563
χ2(1)=0.334
Data is presented as n (%). Perceptions were self-reported yes/no.
Table 4. Comparison among models with different number of classes.
Table 4. Comparison among models with different number of classes.
Number of classeslog-likelihoodAICBICp-value
2-Class Model-844.5173718230.140
3-Class Model-805.5169318410.080
4-Class Model-777.6167118800.060
Table 5. Root of attitudes for influenza vaccine refusal.
Table 5. Root of attitudes for influenza vaccine refusal.
Root of attitudeReason of refusaln (%)
Total=272
Conspiracist ideationR10 The vaccine is made to control people7 (2.6%)
DistrustR3 I don't have enough information about the vaccine
R8 I don't trust the vaccine
53 (19.5%)
Unwarranted beliefs-0
Worldview and politicsR11 I don't use any vaccine anymore. I believe that the COVID vaccine was a business
R12 It's too expensive
27 (9.9%)
Religious concernsR9 I do not vaccinate for religious reasons6 (2.2%)
Moral concerns-0
Fear and phobiasR2 I am afraid of adverse effects R13 I am afraid of injections93 (34.2%)
Distorted risk perceptionR1 I don't think it's necessary
R5 I've never had the flu and I don't think I need it
128 (47.1%)
Perceived self-interestR6 I consider myself to have a strong immune system31 (11.4%)
Epistemic relativismR4 I have had a previous negative experience with a vaccine
R7 I have chronic diseases that can get worse
30 (11.0%)
Reactance-0

Share and Cite

MDPI and ACS Style

Dumitra, G.G.; Alexiu, S.A.; Sănduţu, D.; Berbecel, C.; Curelea, M.; Barbu, C.V.; Deleanu, A.; Grom, A.; Lup, M.; Budiu, I.; et al. Segmenting Attitudes Toward Vaccination—Behavioral Insights into Influenza Vaccination Refusal in Romania. GERMS 2024, 14, 362-374. https://doi.org/10.18683/germs.2024.1446

AMA Style

Dumitra GG, Alexiu SA, Sănduţu D, Berbecel C, Curelea M, Barbu CV, Deleanu A, Grom A, Lup M, Budiu I, et al. Segmenting Attitudes Toward Vaccination—Behavioral Insights into Influenza Vaccination Refusal in Romania. GERMS. 2024; 14(4):362-374. https://doi.org/10.18683/germs.2024.1446

Chicago/Turabian Style

Dumitra, Gheorghe Gindrovel, Sandra Adalgiza Alexiu, Dorica Sănduţu, Cosmina Berbecel, Monica Curelea, Cristina Vasilica Barbu, Anca Deleanu, Adrian Grom, Maria Lup, Ioana Budiu, and et al. 2024. "Segmenting Attitudes Toward Vaccination—Behavioral Insights into Influenza Vaccination Refusal in Romania" GERMS 14, no. 4: 362-374. https://doi.org/10.18683/germs.2024.1446

APA Style

Dumitra, G. G., Alexiu, S. A., Sănduţu, D., Berbecel, C., Curelea, M., Barbu, C. V., Deleanu, A., Grom, A., Lup, M., Budiu, I., Vesa, M., Surugiu, R., Lăcătuş, A., & Turcu-Stiolica, A. (2024). Segmenting Attitudes Toward Vaccination—Behavioral Insights into Influenza Vaccination Refusal in Romania. GERMS, 14(4), 362-374. https://doi.org/10.18683/germs.2024.1446

Article Metrics

Back to TopTop