Next Article in Journal
Hybridization of Particle Swarm Optimization with Variable Neighborhood Search and Simulated Annealing for Improved Handling of the Permutation Flow-Shop Scheduling Problem
Next Article in Special Issue
Addressing Complexity in Chronic Disease Prevention Research
Previous Article in Journal
Spatial-Temporal Differentiation and Spatial Interaction Effect Analysis of Residents’ Consumption Capacity and Consumption Upgrading in China
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Investigation and Modeling of the Variables of the Decision to Vaccinate as the Foundation of an Algorithm for Reducing Vaccination Reluctance

by
Daniela Cîrnaţu
1,2,
Silviu Gabriel Szentesi
3,
Lavinia Denisia Cuc
3,
Elena Ciurariu
4,*,
Liliana Renate Bran
5,
Graziella-Corina Bâtcă-Dumitru
6,
Cosmin Silviu Raul Joldes
7,
Mioara Florina Pantea
3 and
Simona Pârvu
2,8
1
Department of Medicine, Vasile Goldis Western University of Arad, 310045 Arad, Romania
2
National Public Health Institut, 050463 Bucharest, Romania
3
Department of Economic Disciplines, Faculty of Economics, Aurel Vlaicu University of Arad, 310130 Arad, Romania
4
Department of Medicine, Victor Babes University of Medicine and Pharmacy, 300041 Timisoara, Romania
5
Department of Education Science, Psychology and Social Worker Aurel Vlaicu University of Arad, 310130 Arad, Romania
6
Department of Accounting and Audit, Faculty of Accounting and Management Information Systems, Bucharest University of Economic Studies, 010374 Bucharest, Romania
7
Department of International Business and Economics, Faculty of International Business and Economics, Bucharest University of Economic Studies, 010374 Bucharest, Romania
8
Complementary Sciences Department, Faculty of Medicine, University of Medicine and Pharmacy Carol Davila, 050474 Bucharest, Romania
*
Author to whom correspondence should be addressed.
Systems 2023, 11(5), 220; https://doi.org/10.3390/systems11050220
Submission received: 28 February 2023 / Revised: 4 April 2023 / Accepted: 19 April 2023 / Published: 26 April 2023

Abstract

:
The purpose of this study is to examine the factors that influence vaccination options, including vaccination against COVID-19, in order to develop a management algorithm for decision-makers to reduce vaccination reluctance. This paper’s primary objective is to empirically determine the relationships between different variables that correlate to non-vaccination behavior of the target population, as well as the implications for public health and situational management strategies for future vaccination intentions. We created a questionnaire to investigate the personal approach to disease prevention measures in general and vaccination in particular. Using SmartPLS, load factors for developing an algorithm to manage vaccination reluctance were calculated. The results shows that the vaccination status of an individual is determined by their vaccine knowledge. The evaluation of the vaccine itself influences the choice not to vaccinate. There is a connection between external factors influencing the decision not to vaccinate and the clients’ motives. This plays a substantial part in the decision of individuals not to protect themselves by vaccination. External variables on the decision not to vaccinate correlate with agreement/disagreement on COVID-19 immunization, but there is no correlation between online activity and outside influences on vaccination refusal or on vaccine opinion in general.

1. Introduction

In the absence of a specific treatment for SARS-CoV-2 infections, preventing COVID-19 infection has become a top priority. Initially, prevention consisted of non-pharmacological measures [1] suggested by the World Health Organization and adopted by each state through normative acts. In Europe, the European Medicines Agency authorized the use of a vaccine only 10months after the announcement of the pandemic, followed shortly after by three other vaccines. One year after the start of the vaccination campaign, the full-scheme vaccination coverage in many European countries did not meet the targets set by the authorities. This finding coincides with low population confidence in the quality of medical services and a general unwillingness to vaccinate. Vaccination reluctance is not a new phenomenon [2,3], but it has recently been identified as one of the greatest threats to public health [4]. In the context of a pandemic, hesitancy regarding COVID-19 vaccination has been observed globally, and there are numerous studies [5,6] investigating factors that influence vaccination options [7], but they do not address the general population, but rather specific populations [8,9] or professional categories. Moreover, our study supplements the information on the option to vaccinate [10] and confidence in the measures ordered by the authorities, and deployed through the health system, during the pandemic [11,12,13,14,15,16,17].
This study aims to examine the factors that influence, in Romania, the options available for the COVID-19 vaccine, as well as the prophylactic measures chosen by the general population and by average healthcare professionals. In designing this research, we assumed that reluctance to vaccination is caused by factors related to the vaccine (doubt about its safety, quality, or efficacy) on the one hand, and that reluctance is influenced and fed by media information, opinion leaders, and acquaintances on the other hand. To investigate these factors, a questionnaire was administered online, as well as via letter support, to adults from all over the nation, both rural and urban.
Beginning with the premise that well-informed people have a modern lifestyle that emphasizes health, the positive role of physical activity, and sustainability, we devised a 27-item questionnaire consisting of multiple-choice questions to investigate personal attitudes towards disease prevention measures in general and vaccination in particular.

2. Materials and Methods

The purpose of this study was to analyze the reasons for rejecting or accepting vaccination in order to develop tools to encourage unvaccinated individuals to make a vaccination decision, as well as to empirically determine the relationships between various factorial variables and the non-vaccinating behavior of the target population to receive the COVID-19 vaccine.
We developed a 27-item questionnaire (Appendix A), which includes demographic data (age, gender), socio-professional data, and movement-related information, based on the premise that people are informed by scientifically validated sources and live a modern lifestyle that emphasizes health, the positive role of physical activity, and sustainability (occupation, environment). Multiple-choice questions probed respondents’ attitudes toward disease prevention measures in general, and vaccination against COVID-19, influenza, and other diseases for which there are vaccines in particular. The formulation of questions addressing vaccine aversion was based on the findings of previous studies [11,12,13,14,15,16,17]. The questionnaire items addressed the level of satisfaction with the pandemic activities of local authorities, county public health authorities, the emergency medical care system, primary care, specialized medical care, and emergency medical care. For a preliminary study on the decision of citizens to receive the SARS-CoV-2 vaccine, the following hypotheses were considered:
H1: 
A person’s vaccination status is determined by the knowledge he or she has regarding the vaccine.
H2: 
External influences on the decision not to vaccinate are related to the evaluation of the vaccine itself.
H3: 
There is a connection between external influences on the decision not to vaccinate and the customers’ reasons, which play a crucial role in the person’s decision not to protect themselves through vaccination.
H4: 
An association exists between external influences on the decision not to vaccinate and agreement/disagreement on COVID-19 vaccination.
H5: 
There is a correlation between online activity and external influences on the decision not to vaccinate.
H6: 
There is a link between online activity and opinion about vaccines in general (not just for COVID-19).
H7: 
There is a connection between the reasons of the customers, who play a crucial role in the decision not to protect themselves by vaccination, and the agreement/disagreement regarding vaccination against COVID-19.
H8: 
There is a connection between the fundamental reasons for refusing COVID-19 vaccination and the choice to vaccinate.
H9: 
There is a connection between the essential grounds for refusing COVID-19 vaccination and vaccination status.
H10: 
There is a correlation between a positive view of vaccines in general (not just for COVID-19) and the decision to vaccinate against COVID-19.
H11: 
There is a connection between the decision to vaccinate against COVID-19 and the vaccination status.
H12: 
There is a correlation between the decision to vaccinate against COVID-19 and the vaccination status of individuals who place a high value on their own health.
The questionnaires were administered online as well as on paper between October and December 2021, and results were then entered into the database. Using the SmartPLS3.3 program [18], the reliability and validity of the data were examined.
A total of 1673 respondents with an average age of 36.50 years and a gender distribution of 78.56 percent females chose to complete the survey. The respondents completed 94.5% of the questionnaires autonomously, while the interviewer helped respondents to complete 5.5% of the questionnaires.

3. Results and Discussion

Although 63.4% of respondents from our study agreed that vaccination is an extremely effective method for boosting immunity, vaccination is not a widely accepted practice. The vaccination acceptance rate is consistent with the statistics revealed in previous studies, which indicate a global percentage of 71.5%, ranging from 90% in China to 55% in Russia [19]. Within this broader context, 65.2% of Romanian respondents reported being immunized against COVID-19. The percentage is higher than that found in other European countries such as Poland (56.31%) [19] and France (58.89%) [19], but it should be noted that 89.9% of respondents in our study declared a medium or high level of medical knowledge. This high level of knowledge could explain why the vaccination acceptance rate is higher in our study group than in other European countries. The percentage of respondents who approve of immunization against COVID-19 varies not only from country to country or across occupational groups [20], but also with the length of time since the vaccine’s introduction into medical practice. The reasons for refusing vaccination against COVID-19 also change over time [21]. It is worth noting that at the time of survey completion (October–December 2021), 10.2% of respondents were also vaccinated with the influenza vaccine for the 2021–2022 season, even though no negative influence was detected and there were no safety concerns regarding co-administration [22]. The results of an investigation into the explanations for COVID-19 vaccination refusal for our subjects is reported in Figure 1.
Regarding reasons for vaccine reluctance (Table 1), our findings concur with those of other meta-analyses [23,24], in which side effects, lack of trust, or concern about potential side effects were the most prevalent. A total of 24.8% from the unvaccinated respondents believed in the possibility of conspiracy theories, supporting the conclusion of a previous study that “conspiracy beliefs pose a significant threat to public health” [25]. For this reason, it is essential to find the most effective communication strategy, such as conveying the weight of evidence and scientific consensus surrounding vaccines and related myths, or incorporating humor and warnings about encountering misinformation [26].
It is also worth mentioning that from the unvaccinated respondents, 52.0% indicated they would be vaccinated, whereas 21.2% rejected the idea and 11.0% did not trust the result. Reluctance to vaccinate is not a generally applicable principle, as 56% of respondents believe vaccines are beneficial, 24.9% agree with some of them, and 19% agree with those that prevent childhood diseases but not the COVID-19 vaccine. However, 61.2% of respondents agree that vaccination has contributed to a decline in the number of hospitalized cases in countries with vaccination rates exceeding 80%. According to other studies, the vaccine was found to be 68.8% effective in preventing SARS-CoV-2 infection and hospitalization [27]. This may explain why a high proportion (56%) of respondents in our study believe the COVID-19 vaccine to be beneficial.
In order to gain a better understanding of the factors that lead to vaccination acceptance, non-vaccinated respondents were asked to answer additional questions. Results are presented in Table 2.
These data are consistent with global predictors of vaccine reluctance [28].Using additional questions, we studied the determinants of vaccine refusal among the unvaccinated. The results are presented in Table 3.
As can be seen, the role of social media in vaccine reluctance is relatively minor. Another previous study suggests that social media vaccination campaigns are ineffective [29]. The high proportion of unvaccinated respondents who cited doctors as an important factor in their decision not to be vaccinated was also observed at the international level, where the overall acceptance of vaccination was 51% [28] among healthcare workers, with statistically significant heterogeneity by gender, age, or medical specialty. In our study, females between the ages of 41 and 50 had the highest acceptance rate (77.1%) for the COVID-19 vaccine, while males between the ages of 31 and 40 had the lowest rate (34.6%). It is important to note that in our study, the majority of respondents were female (78.57%), but there is no correlation between the number of males surveyed and vaccine acceptance [26].
Non-vaccinated respondents were solicited for more information in this regard in order to find factors that could increase vaccination acceptance. Results are presented in Figure 2.
This paper’s primary objective is to empirically determine the relationships between various factorial variables and the non-vaccinating behavior of the target population, as well as the implications of managing their current situation on their future vaccination intention. In designing this research, we assumed that vaccine reluctance is caused by factors related to the vaccine (not believing in its safety, quality, or efficacy) on the one hand, and by media information, opinion leaders, and known individuals on the other.
In order to test hypotheses and develop a model, we first assessed the trustworthiness (reliability) and validity of the collected data. The concepts of reliability and validity are used to evaluate the quality of research. They indicate the effectiveness of a method, technique, or test. Validity refers to the precision of a measure, whereas reliability refers to the consistency of a measure. When designing research, it is essential to consider reliability and validity, particularly in quantitative research.
The variables’ dependability is evaluated utilizing the Cronbach’s alpha method and composite reliability (CR). The results regarding reliability and validity, as well as the factor loads for the remaining elements, are presented in Table 1 for the overall sample and each specific sample. It has been determined that the alpha values and CRs in the calculation performed exceed the minimum recommended value of 0.700. The Average Variation Extracted (AVE) and correlation coefficients (CRs) were all greater than or close to 0.500 and 0.700, supporting convergent validity. Due to the large sample size and its representativeness, the results reflect those of the broader population, are based on a clear, easily repeatable methodology, and show that the nine constructs in the proposed model are robust from a scientific perspective (statistically): information about vaccine; non-vaccination reasons; online activity; reasons evaluation for non-vaccination; reasons for vaccination; and reasons for vaccination evaluation.
Cross-loading was used to evaluate the discrimination’s efficacy. All factor loads are greater than their respective cross-loads, indicating discriminatory validity. The discrimination’s validity was also evaluated using the criteria proposed by Fornelland Larcker and the heterotrait–monotrait method (HTMT). The outcomes of both tests are displayed in Table A1 from Appendix A.
We utilized SmartPLS 3.3 to assess the confidence in the collected data (reliability) and the validity of the data. As shown in Table A1 from Appendix A, for all the indicators used in the assessment of validity and reliability, Cronbach’s alpha, rhoA, composite reliability, and Average Variation Extracted (AVE), the result is positive, and the collected data are accurate and reflective of reality.
We have also examined significant connections between the questions asked and the formulated constructs. The results are presented in the table (Table A2 from Appendix A), which demonstrates a very strong correlation between the constructs used in the development of the relationship model in the SmartPLS program and the survey questions. Each response was coded in order to be used in SmartPLS program.
We developed an empirical model of the logically possible relationships between these constructs, and after processing in the SmartPLS program, we obtained the model depicted in Figure 3 and loading factors for each construct (outer loadings) according to Table A2 from Appendix A. In Table 4, each item of the questionnaire with associated code is presented.
The loading factors for each construct that are found to have a high value, as those factors observed in the research to have a significant impact within each construct, were selected through multiple interactions. This method aids in gaining a comprehensive understanding of a concept’s underlying elements.
Using the SmartPLS program, we have calculated the correlation between the latent variables based on the data presented in Table A3 from Appendix A. In some cases, based on the correlation coefficient, there are fairly robust correlations between the proposed constructions. Correlation analysis between latent variables reveals relationships that cannot be directly observed or measured. If we correlate these latent variables with other observable variables, we can infer the values of the latent variables from the observations of the observable variables. The analysis of the correlation between the latent variables reveals that there is a strong latent link between the criteria underlying the evaluation of non-vaccination or vaccination and variables such as information about vaccine (0.886), non-vaccination reasons (0.810), and vaccination for health (0.833), whereas there is a weaker latent link between the expectations related to the vaccine as a product and the criteria underlying the evaluation of non-vaccination (0.494) or the denial (Table A3 in Appendix A).
In addition, a descriptive statistic has been developed, which can assist us in better comprehending the distribution of statistical values and expanding the descriptive analysis (Table 5 and Table 6).
The acceptance of this study’s hypotheses by means of statistical tests is displayed in the Table 7.
In a large number of previous meta-analyses [30,31] it was found that social factors were associated with vaccine acceptance. Even though efforts to control the spread of SARS-CoV-2 may increase the use of social media as individuals try to remain connected while physically apart [32], our findings do not support the role of social media in vaccine hesitancy due to the high level of medical knowledge reported by respondents, which has also been reported by other studies [25].In a separate study, a strong correlation between attitude and vaccination intent was also discovered [33].Three parameters are known to influence a person’s willingness to accept a vaccine: complacency, confidence, and convenience [34]. Our research indicates that a well-designed and targeted informational campaign could increase vaccine acceptance. General vaccine information is recognized as a predictor factor for COVID-19 vaccine acceptance [35].The available COVID-19 vaccines are the most effective means of containing the pandemic [36]. Our study found a vaccine acceptance rate of up to 56%, which is significantly lower than the globally averaged acceptance rate of the COVID-19 vaccine, which was 64.9% [95% CI: 60.5% to 69.0%] [37]. The correlation between vaccine acceptance in general and COVID-19 vaccine acceptance in particular was found in our study as well as in previous studies that investigated the confidence of healthcare professionals in theCOVID-19 vaccine [38]. The role played by socioeconomic status [39] or by a modern lifestyle that emphasizes health was shown to be a factor by our study as well as by previous findings [40]. The health systems are organized differently, but the medical approach to pandemic preparedness was guided by WHO recommendations, ensuring a global response to a global threat [41]. Administrative measures that aided the implementation of public health interventions had varying effects. [42] While in Poland, public health was legally prioritized over individual liberties [43], punitive administrative measures taken against those who violated the regulations were cancelled in Romania due to some legal inconsistencies. In this context, 1.4% of respondents chose to vaccinate because they were afraid of the authorities. The hesitancy for COVID-19 vaccination was found to be a significant problem in older people, particularly those with low incomes and low levels of education, according to a previous study [9]. Individuals who are altruists, care for others, follow government recommendations, and support collective responsibility are more likely to receive COVID-19 vaccination, according to an explanatory factor analysis, findings that are supported by previous research [43].Other studies have found that social media or online activity has a relatively low influence on the decision not to vaccinate, but these channels could be used in order to understand vaccination perceptions [44]. The emotional approach to subjects of public interest could lead to an increase in the vaccination acceptance rate [45]. Employer pressure or workplace constraints do not increase the intention to vaccinate, according to the current study and another conducted in Poland [46]. The measures taken by the employer during the pandemic to protect the staff can contribute to the state of safety at the workplace [47].

4. Conclusions

The vaccination status of a person depends on the knowledge they have about the vaccine. From this perspective, it would be advantageous for health authorities to communicate more openly on potential adverse reactions. Within this context, the companies whose COVID-19 vaccines have been approved for human use are required to present their own results (studies on the beneficial effects of the vaccine concurrently with the possible adverse reactions). Additionally, the approval authorities are required to submit the conclusions of their own studies or validated studies conducted by other research entities with the utmost confidence. This research has shown that there is a connection between the decision not to vaccinate and the evaluation of the vaccine itself, and that citizens are practically influenced by external factors when deciding not to vaccinate. There is no clear connection between online activity and outside influences on the decision not to vaccinate. The decision not to vaccinate is unique to online-active individuals. In the model utilized here, there is a correlation between the decision to vaccinate against COVID-19 for those who place a high value on individual health and the vaccination status. Our approach can be used to determine the causes of vaccination refusal in a community, whether for a newly released vaccine or immunization in general. Our model focuses on COVID-19 vaccination, however a similar pattern applies to all vaccines. In a community with low vaccination rates, it is possible to identify the perception-related factors that cause parents (in the case of being responsible for children) or adults to be reluctant to vaccinate. Information campaigns might concentrate on factors unique to each community.

4.1. Study Limitation

Despite the fact that this study is based on a large and representative sample of Romanians, the percentage of vaccinated people in the sample is higher than the percentage of vaccinated people in the nation. The primary objective of this first paper was to empirically determine the relationships between various factorial variables and the non-vaccination behavior of the population, i.e., the entire population of Romania. No research was conducted to determine the factors that encourage vaccination, despite the fact that these data are available as a result of our study. This diverse and intricate information will be utilized in an upcoming article.

4.2. Futher Directions

A future research direction will be to deepen this study in order to empirically determine the relationships between various factor variables and the behavior of vaccine beneficiaries. The aim will be to better understand the factors, the interdependence of relationships, and the mechanisms that determine vaccination. The implications for process management and the management of the vaccination situation including vaccination intention, mode, techniques, and channels of communication with the vaccine recipients represent an additional future research direction using modern tools such as the internet of things [48].

Author Contributions

All authors have contributed to the study and writing of this research. Conceptualization—S.G.S. and D.C.; methodology—S.G.S. and D.C.; software—L.D.C.; validation—S.G.S. and L.D.C.; formal analysis—S.P.; investigation—E.C., M.F.P., C.S.R.J. and L.R.B.; resources—M.F.P.; data curation, L.D.C.; writing—original draft preparation, D.C.; writing—review and editing, L.D.C. and L.R.B.; visualization—S.P. and G.-C.B.-D. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

The Perception of Vaccination against COVID-19

This survey aims to analyze the perception of the general population regarding vaccination against COVID-19. Systems 11 00220 i001Systems 11 00220 i002Systems 11 00220 i003Systems 11 00220 i004Systems 11 00220 i005Systems 11 00220 i006Systems 11 00220 i007
Table A1. Cronbach values and composite reliability. Indicators of reliability and validity.
Table A1. Cronbach values and composite reliability. Indicators of reliability and validity.
Cronbachs AlpharhoAComposite ReliabilityAverage Variance Extracted (AVE)
Information about vaccine0.9860.9860.9890.946
Non-vaccination reasons0.9820.9820.9840.859
Online activity1.0001.0001.0001.000
Reasons evaluation for non-vaccination0.9770.9810.9800.844
Reasons for non-vaccination decision0.8790.8930.9160.733
Regarding vaccine1.0001.0001.0001.000
Vaccination decision 1.0001.0001.0001.000
Vaccination for health1.0001.0001.0001.000
Vaccination status1.0001.0001.0001.000
Table A2. Outer loadings.
Table A2. Outer loadings.
QuestionInformations about VaccineNon-VaccinationReasonsOnline ActivityReasons forEvaluation for Non-VaccinationReasons for Non-Vaccination DecisionRegarding VaccinesVaccination DecisionVaccination for HealthVaccination Status
Are you vaccinated against COVID-19? 1.000
What is your information on the COVID-19vaccine:0.976
   −
Benefits pertaining to your health
0.984
   −
Prevention of serious and severe disease forms
0.976
   −
Reducing the spread of disease
0.974
   −
How the vaccine functions
0.953
   −
Side effects
1.000
If your health is important, are you willing to receive the COVID-19 vaccine? 1.00
To what extent are you willing to receive a COVID-19 vaccination? 0.886
   −
Yes
0.936
   −
Not at all
0.922
   −
So-so
0.933
If the answer is no and you refuse vaccination, does your refusal play a significant role in your decision not to increase your immunity/protection through vaccination? 0.947
   −
The negative campaign occasionally conducted by mass media
0.949
   −
Opinion leaders who oppose vaccination
0.928
   −
Information from Facebook
0.923
   −
Messages and information from friends
0.915
   −
Specialized pages (sites)
0.867
   −
Internet sites
0.885
   −
Scientific articles
0.883
   −
Physician
0.786
   −
Employee
0.905
   −
Other sources
0.906
   −
If the answer is no and you refuse vaccination, the following factors played a crucial role in your decision not to increase your immunity/protection through vaccination:
0.892
   −
The anti-COVID-19vaccine (of all types) has not been adequately evaluated, so I lack confidence in its efficacy.
0.923
   −
Uncertainty surrounds adverse reactions.
0.940
   −
The long-term effects of COVID-19vaccines are unknown.
0.931
   −
There are severe and/or fatal adverse effects.
0.936
   −
There are introduced substances that weaken the body and cause vaccine addiction, necessitating frequent revaccinations.
0.905
   −
Unknown components of the vaccine contribute to mistrust.
0.929
Table A3. Latent Variable Correlations.
Table A3. Latent Variable Correlations.
VariableInformation about VaccineNon-Vaccination ReasonsOnline ActivityReasons forEvaluation for Non-VaccinationReasons for Non-vaccination DecisionRegarding VaccineVaccination Decision Vaccination for HealthVaccination Status
Information about vaccine1.0000.8480.0110.8860.7350.5230.8560.8400.917
Non-vaccination reasons0.8481.000−0.0130.8100.7830.5870.8070.8640.912
Online activity0.011−0.0131.000−0.0140.0220.0010.009−0.014−0.012
Reasons for evaluation for non-vaccination0.8860.810−0.0141.0000.6710.4940.8740.8330.919
Reasons for non-vaccination decision0.7350.7830.0220.6711.0000.6230.6280.8250.814
Regarding vaccine0.5230.5870.0010.4940.6231.0000.3960.6880.625
Vaccination decision 0.8560.8070.0090.8740.6280.3961.0000.7160.871
Vaccination for health0.8400.864−0.0140.8330.8250.6880.7161.0000.950
Vaccination status0.9170.912−0.0120.9190.8140.6250.8710.9501.000

References

  1. Horga, N.G.; Cirnatu, D.; Kundnani, N.R.; Ciurariu, E.; Parvu, S.; Ignea, A.L.; Borza, C.; Sharma, A.; Morariu, S. Evaluation of Non-Pharmacological Measures Implemented in the Management of the COVID-19 Pandemic in Romania. Healthcare 2022, 10, 1756. [Google Scholar] [CrossRef] [PubMed]
  2. Dubé, E.; Gagnon, D.; MacDonald, N.E.; Sage Working Group on Vaccine Hesitancy. Strategies intended to address vaccine hesitancy: Review of published reviews. Vaccine 2015, 33, 4191–4203. [Google Scholar] [CrossRef] [PubMed]
  3. Dubé, E.; Laberge, C.; Guay, M.; Bramadat, P.; Roy, R.; Bettinger, J.A. Vaccine hesitancy: An overview. Hum. Vaccines Immunother. 2013, 9, 1763–1773. [Google Scholar] [CrossRef] [PubMed]
  4. Xiao, X.; Wong, R.M. Vaccine hesitancy and perceived behavioral control: A meta-analysis. Vaccine 2020, 38, 5131–5138. [Google Scholar] [CrossRef] [PubMed]
  5. Robinson, E.; Jones, A.; Lesser, I.; Daly, M. International estimates of intended uptake and refusal of COVID-19 vaccines: A rapid systematic review and meta-analysis of large nationally representative samples. Vaccine 2021, 39, 2024–2034. [Google Scholar] [CrossRef]
  6. Vujovich-Dunn, C.; Kaufman, J.; King, C.; Skinner, S.R.; Wand, H.; Guy, R.; Leask, J. A systematic review and meta-analysis of effectiveness of decision aids for vaccination decision-making. Vaccine 2021, 39, 3655–3665. [Google Scholar] [CrossRef]
  7. Larson, H.J.; Jarrett, C.; Schulz, W.S.; Chaudhuri, M.; Zhou, Y.; Dubé, E.; Schuster, M.; MacDonald, N.E.; Wilson, R.; The SAGE Working Group on Vaccine Hesitancy. Measuring vaccine hesitancy: The development of a survey tool. Vaccine 2015, 33, 4165–4175. [Google Scholar] [CrossRef]
  8. Veronese, N.; Saccaro, C.; Demurtas, J.; Smith, L.; Dominguez, L.J.; Maggi, S.; Barbagallo, M. Prevalence of unwillingness and uncertainty to vaccinate against COVID-19 in older people: A systematic review and meta-analysis. Ageing Res. Rev. 2021, 72, 101489. [Google Scholar] [CrossRef]
  9. Crescitelli, M.E.D.; Ghirotto, L.; Sisson, H.; Sarli, L.; Artioli, G.; Bassi, M.; Appicciutoli, G.; Hayter, M. A meta-synthesis study of the key elements involved in childhood vaccine hesitancy. Public Health 2019, 180, 38–45. [Google Scholar] [CrossRef]
  10. Cotfas, L.-A.; Delcea, C.; Gherai, R. COVID-19 Vaccine Hesitancy in the Month Following the Start of the Vaccination Process. Int. J. Environ. Res. Public Health 2021, 18, 10438. [Google Scholar] [CrossRef]
  11. Ionescu, T.C.; Fetecau, B.I.; Giurgiuca, A.; Tudose, C. Acceptance and Factors Influencing Acceptance of COVID-19 Vaccine in a Romanian Population. J. Pers. Med. 2022, 12, 452. [Google Scholar] [CrossRef] [PubMed]
  12. Manolescu, L.S.C.; Zaharia, C.N.; Dumitrescu, A.I.; Prasacu, I.; Radu, M.C.; Boeru, A.C.; Boidache, L.; Nita, I.; Necsulescu, A.; Medar, C.; et al. COVID-19 Parental Vaccine Hesitancy in Romania: Nationwide Cross-Sectional Study. Vaccines 2022, 10, 493. [Google Scholar] [CrossRef] [PubMed]
  13. Kotta, I.; Kalcza-Janosi, K.; Szabo, K.; Marschalko, E.E. Development and Validation of the Multidimensional COVID-19 Vaccine Hesitancy Scale. Hum. Vaccines Immunother. 2021, 18, 1–10. [Google Scholar] [CrossRef]
  14. Mărcău, F.C.; Peptan, C.; Nedelcuță, R.M.; Băleanu, V.D.; Băleanu, A.R.; Niculescu, B. Parental COVID-19 Vaccine Hesitancy for Children in Romania: National Survey. Vaccines 2022, 10, 547. [Google Scholar] [CrossRef] [PubMed]
  15. Dima, A.; Jurcut, C.; Balaban, D.V.; Gheorghita, V.; Jurcut, R.; Dima, A.C.; Jinga, M. Physicians’ Experience with COVID-19 Vaccination: A Survey Study. Healthcare 2021, 9, 1746. [Google Scholar] [CrossRef] [PubMed]
  16. Maftei, A.; Holman, A.C. SARS-CoV-2 Threat Perception and Willingness to Vaccinate: The Mediating Role of Conspiracy Beliefs. Front. Psychol. 2021, 12, 672634. [Google Scholar] [CrossRef] [PubMed]
  17. Cristea, D.; Ilie, D.-G.; Constantinescu, C.; Fîrțală, V. Vaccinating against COVID-19: The Correlation between Pro-Vaccination Attitudes and the Belief That Our Peers Want to Get Vaccinated. Vaccines 2021, 9, 1366. [Google Scholar] [CrossRef]
  18. Ringle, C.M.; Wende, S.; Becker, J.-M. “SmartPLS 3.” Boenningstedt: SmartPLS GmbH. 2015. Available online: https://www.smartpls.com (accessed on 18 April 2023).
  19. Lazarus, J.V.; Ratzan, S.C.; Palayew, A.; Gostin, L.O.; Larson, H.J.; Rabin, K.; Kimball, S.; El-Mohandes, A. A global survey of potential acceptance of a COVID-19 vaccine. Nat. Med. 2021, 27, 225–228. [Google Scholar] [CrossRef]
  20. La Vecchia, C.; Negri, E.; Alicandro, G.; Scarpino, V. Attitudes towards influenza vaccine and a potential COVID-19 vaccine in Italy and differences across occupational groups, September 2020: Attitudes towards influenza vaccine and a potential COVID-19 vaccine in Italy. Med. Lav. 2020, 111, 445–448. [Google Scholar] [CrossRef]
  21. Pires, C. Global Predictors of COVID-19 Vaccine Hesitancy: A Systematic Review. Vaccines 2022, 10, 1349. [Google Scholar] [CrossRef]
  22. Janssen, C.; Mosnier, A.; Gavazzi, G.; Combadière, B.; Crépey, P.; Gaillat, J.; Launay, O.; Botelho-Nevers, E. Coadministration of seasonal influenza and COVID-19 vaccines: A systematic review of clinical studies. Hum. Vaccines Immunother. 2022, 18, 2131166. [Google Scholar] [CrossRef]
  23. Roy, D.N.; Biswas, M.; Islam, E.; Azam, S. Potential factors influencing COVID-19 vaccine acceptance and hesitancy: A systematic review. PLoS ONE 2022, 17, e0265496. [Google Scholar] [CrossRef] [PubMed]
  24. Wang, Q.; Yang, L.; Jin, H.; Lin, L. Vaccination against COVID-19: A systematic review and meta-analysis of acceptability and its predictors. Prev. Med. 2021, 150, 106694. [Google Scholar] [CrossRef] [PubMed]
  25. Anakpo, G.; Mishi, S. Hesitancy of COVID-19 vaccines: Rapid systematic review of the measurement, predictors, and preventive strategies. Hum. Vaccines Immunother. 2022, 18, 2074716. [Google Scholar] [CrossRef] [PubMed]
  26. Bierwiaczonek, K.; Gundersen, A.B.; Kunst, J.R. The role of conspiracy beliefs for COVID-19 health responses: A meta-analysis. Curr. Opin. Psychol. 2022, 46, 101346. [Google Scholar] [CrossRef]
  27. Zheng, C.; Shao, W.; Chen, X.; Zhang, B.; Wang, G.; Zhang, W. Real-world effectiveness of COVID-19 vaccines: A literature review and meta-analysis. Int. J. Infect. Dis. 2021, 114, 252–260. [Google Scholar] [CrossRef]
  28. Salomoni, M.G.; Di Valerio, Z.; Gabrielli, E.; Montalti, M.; Tedesco, D.; Guaraldi, F.; Gori, D. Hesitant or Not Hesitant? A Systematic Review on Global COVID-19 Vaccine Acceptance in Different Populations. Vaccines 2021, 9, 873. [Google Scholar] [CrossRef]
  29. Whitehead, H.S.; French, C.E.; Caldwell, D.M.; Letley, L.; Mounier-Jack, S. A systematic review of communication interventions for countering vaccine misinformation. Vaccine 2023, 41, 1018–1034. [Google Scholar] [CrossRef]
  30. Argyris, Y.A.; Nelson, V.R.; Wiseley, K.; Shen, R.; Roscizewski, A. Do social media campaigns foster vaccination adherence? A systematic review of prior intervention-based campaigns on social media. Telemat. Inform. 2023, 76, 101918. [Google Scholar] [CrossRef]
  31. Cascini, F.; Pantovic, A.; Al-Ajlouni, Y.A.; Failla, G.; Puleo, V.; Melnyk, A.; Lontano, A.; Ricciardi, W. Social media and attitudes towards a COVID-19 vaccination: A systematic review of the literature. Eclinicalmedicine 2022, 48, 101454. [Google Scholar] [CrossRef]
  32. Abdou, M.S.; Kheirallah, K.A.; Aly, M.O.; Ramadan, A.; Elhadi, Y.A.M.; Elbarazi, I.; Deghidy, E.A.; El Saeh, H.M.; Salem, K.M.; Ghazy, R.M. The coronavirus disease 2019 (COVID-19) vaccination psychological antecedent assessment using the Arabic 5c validated tool: An online survey in 13 Arab countries. PLoS ONE 2021, 16, e0260321. [Google Scholar] [CrossRef] [PubMed]
  33. Feleszko, W.; Lewulis, P.; Czarnecki, A.; Waszkiewicz, P. Flattening the Curve of COVID-19 Vaccine Rejection—An International Overview. Vaccines 2021, 9, 44. [Google Scholar] [CrossRef] [PubMed]
  34. Gerretsen, P.; Kim, J.; Caravaggio, F.; Quilty, L.; Sanches, M.; Wells, S.; Brown, E.E.; Agic, B.; Pollock, B.G.; Graff-Guerrero, A. Individual determinants of COVID-19 vaccine hesitancy. PLoS ONE 2021, 16, e0258462. [Google Scholar] [CrossRef] [PubMed]
  35. Terry, E.; Cartledge, S.; Damery, S.; Greenfield, S. Factors associated with COVID-19 vaccine intentions during the COVID-19 pandemic; a systematic review and meta-analysis of cross-sectional studies. BMC Public Health 2022, 22, 1667. [Google Scholar] [CrossRef]
  36. Sharif, N.; Alzahrani, K.J.; Ahmed, S.N.; Dey, S.K. Efficacy, Immunogenicity and Safety of COVID-19 Vaccines: A Systematic Review and Meta-Analysis. Front. Immunol. 2021, 12, 714170. [Google Scholar] [CrossRef]
  37. Wang, L.; Wang, Y.; Cheng, X.; Li, X.; Yang, Y.; Li, J. Acceptance of coronavirus disease 2019 (COVID-19) vaccines among healthcare workers: A meta-analysis. Front. Public Health 2022, 10, 881903. [Google Scholar] [CrossRef]
  38. Luo, C.; Yang, Y.; Liu, Y.; Zheng, D.; Shao, L.; Jin, J.; He, Q. Intention to COVID-19 vaccination and associated factors among health care workers: A systematic review and meta-analysis of cross-sectional studies. Am. J. Infect. Control. 2021, 49, 1295–1304. [Google Scholar] [CrossRef]
  39. Shakeel, C.S.; Mujeeb, A.A.; Mirza, M.S.; Chaudhry, B.; Khan, S.J. Global COVID-19 Vaccine Acceptance: A Systematic Review of Associated Social and Behavioral Factors. Vaccines 2022, 10, 110. [Google Scholar] [CrossRef]
  40. Kazeminia, M.; Afshar, Z.M.; Rajati, M.; Saeedi, A.; Rajati, F. Evaluation of the Acceptance Rate of Covid-19 Vaccine and its Associated Factors: A Systematic Review and Meta-analysis. J. Prev. 2022, 43, 421–467. [Google Scholar] [CrossRef]
  41. Mengistu, D.A.; Demmu, Y.M.; Asefa, Y.A. Global COVID-19 vaccine acceptance rate: Systematic review and meta-analysis. Front. Public Health 2022, 10, 1044193. [Google Scholar] [CrossRef]
  42. Prezerakos, P.; Dadouli, K.; Agapidaki, E.; Kravvari, C.-M.; Avakian, I.; Peristeri, A.-M.; Anagnostopoulos, L.; Mouchtouri, V.A.; Fountoulakis, K.N.; Koupidis, S.; et al. Behavioral and Cultural Insights, a Nationwide Study Based on Repetitive Surveys of WHO Behavioral Insights Tool in Greece Regarding COVID-19 Pandemic and Vaccine Acceptance. Int. J. Environ. Res. Public Health 2022, 20, 216. [Google Scholar] [CrossRef] [PubMed]
  43. Paplicki, M.; Susło, R.; Najjar, N.; Ciesielski, P.; Augustyn, J.; Drobnik, J. Conflict of individual freedom and community health safety: Legal conditions on mandatory vaccinations and changes in the judicial approach in the case of avoidance. Fam. Med. Prim. Care Rev. 2018, 20, 389–395. [Google Scholar] [CrossRef]
  44. Alam, M.T.; Sohail, S.S.; Ubaid, S.; Shakil; Ali, Z.; Hijji, M.; Saudagar, A.K.J.; Muhammad, K. It’s Your Turn, Are You Ready to Get Vaccinated? Towards an Exploration of Vaccine Hesitancy Using Sentiment Analysis of Instagram Posts. Mathematics 2022, 10, 4165. [Google Scholar] [CrossRef]
  45. Susło, R.; Pobrotyn, P.; Mierzecki, A.; Drobnik, J. Fear of Illness and Convenient Access to Vaccines Appear to Be the Missing Keys to Successful Vaccination Campaigns: Analysis of the Factors Influencing the Decisions of Hospital Staff in Poland concerning Vaccination against Influenza and COVID-19. Vaccines 2022, 10, 1026. [Google Scholar] [CrossRef] [PubMed]
  46. Waszkiewicz, P.; Lewulis, P.; Górski, M.; Czarnecki, A.; Feleszko, W. Public Vaccination Reluctance: What Makes Us Change Our Minds? Results of A Longitudinal Cohort Survey. Vaccines 2022, 10, 1081. [Google Scholar] [CrossRef] [PubMed]
  47. Szentesi, S.G.; Cuc, L.D.; Feher, A.; Cuc, P.N. Does COVID-19 Affect Safety and Security Perception in the Hospitality Industry? A Romanian Case Study. Sustainability 2021, 13, 11388. [Google Scholar] [CrossRef]
  48. Szentesi, S.G.; Cuc, L.D.; Lile, R.; Cuc, P.N. Internet of Things (IoT), Challenges and Perspectives in Romania: A Qualitative Research. Amfiteatru Econ. 2021, 23, 448–464. [Google Scholar] [CrossRef]
Figure 1. Reasons for COVID-19 vaccine reluctance.
Figure 1. Reasons for COVID-19 vaccine reluctance.
Systems 11 00220 g001
Figure 2. Reasons for vaccination cited by unvaccinated subjects.
Figure 2. Reasons for vaccination cited by unvaccinated subjects.
Systems 11 00220 g002
Figure 3. Loadings variables within the model.
Figure 3. Loadings variables within the model.
Systems 11 00220 g003
Table 1. Aspects playing an essential role in the decision to not vaccinate.
Table 1. Aspects playing an essential role in the decision to not vaccinate.
Total AgreementAgreementSo-SoLessNot at All
The anti-COVID-19 vaccine (all types) has not been sufficiently tested, and from this point of view it does not inspire confidence.50.80%21.50%14.30%5.90%7.60%
Adverse reactions are not yet fully known.52%27%11.70%4%5.30%
The long-term effects of anti-COVID-19vaccines are not known.56.10%24.60%10.30%3.40%5.50%
There are severe and/or potentially fatal side effects.36.70%28.10%19.40%11.40%4.50%
There are introduced substances that weaken the body and generate addiction to the vaccine, a fact that requires frequent revaccinations.19.30%12.70%23.20%23.90%20.80%
Certain components of the vaccine are unknown and lead to mistrust.29.40%25.80%21.30%12.90%10.50%
A microchip may be inserted through which people can be controlled.10.70%6%11.90%16.20%55.20%
I am waiting for a better and/or Romanian vaccine that I can trust.20.30%15.70%19.40%16.40%28.20%
I don’t trust the manufacturing companies.22%13.40%24.40%16%24.10%
Table 2. Information regarding self-reported knowledge of the COVID-19 vaccine.
Table 2. Information regarding self-reported knowledge of the COVID-19 vaccine.
I Do Not KnowI Do Not Know WellSo-SoI KnowI Know Very Well
The benefits regarding your own health11.70%13.90%20.40%34%19.90%
Prevention of serious and severe forms of the disease12.90%12%18.40%38.70%18%
Reducing disease transmission13.20%12.70%17.50%36.10%20.40%
How the vaccine works19.20%11.90%23%32.30%13.60%
Adverse effects20.60%20.60%19.60%29%18.60%
Table 3. Opinion on the role in the decision to not vaccinate.
Table 3. Opinion on the role in the decision to not vaccinate.
Not at AllLess ImportantSo-SoImportant Very Important
The negative campaign sometimes carried out by the mass media30.40%16.70%25.90%16.20%10.80%
Opinion leaders who are against vaccination35.10%18.40%25.30%13.60%7.70%
Information from Facebook47.60%21.80%18.40%7.60%4.60%
Messages and information from friends/relatives33.50%18%24.90%17%6.50%
Specialized pages (sites)27.70%13.60%26.10%21.10%11.50%
Sites on the internet35.20%35.20%25.30%11.20%6.40%
Scientific articles21%13.20%22.30%23.90%19.60%
Physician14.80%7.20%24.90%29.70%23.40%
Employee38.50%18.60%29.90%8.20%4.80%
Other sources38.30%18.90%28.40%8.20%6.20%
Table 4. Item from the questionnaire used in the model and associated code.
Table 4. Item from the questionnaire used in the model and associated code.
Item Code
Online activity
Socializing6OL1
InformedOL2
Spend moneyOL3
    I am inactiveOL4
Vaccinated? Vaccine done13VD
Details about vaccines. Which information about the COVID-19 vaccine do you have:14 IV
Benefits considering one’s health14IV1
Prevention of serious and severe disease forms14IV2
Reduction of disease transmission14IV3
How the vaccine is effective14IV4
Negative effects14IV5
Immunization for health. If your health is important, are you willing to undergo COVID-19 vaccination? Yes15VH1
                No15VH2
Vaccination determination. To what extent are you willing to vaccinate against the COVID-19 virus?16DV
Not at all16DV1
So-so16DV2
Agreement16DV3
No immunization motives
If the answer is no and you decline vaccination, what role does this play in your decision not to develop immunity/protect yourself through vaccination?
17NVR
Persistent negative campaign occasionally through media17NVR1
Opinion leaders expressing opposition to vaccination17NVR2
Details from Facebook17NVR3
Messages and data from friends/relatives17NVR4
Specialized pages (sites)17NVR5
    Web pages on the internet17NVR6
    Scientifically aware17NVR7
Physician17NVR8
Employee17NVR9
Other origin17NVR10
Justifications for not vaccinating
If the answer is no and you decline vaccination, the decision not to build immunity/protect yourself through vaccination is due to the following:
18RNVD
    All types of the COVID-19 vaccine were not adequately tested, and this does not inspire confidence in my opinion.18RNVD1
    I am not yet aware of all adverse reactions.18RNVD2
    Long-term effects of vaccines against COVID-19 are unknown.18RNVD3
There are life-threatening adverse reactions which can occur.18 RNVD4
    There is an introduced substance that weakens the body and causes vaccine addiction, a fact that the requires frequent revaccinations.18 RNVD5
    Unknown components of the vaccine contribute to mistrust.18 RNVD6
    It is possible to implant a microchip that can be used to control individuals.18 RNVD7
    I am awaiting a superior vaccine and/or Romanian one in which I have confidence.18 RNVD8
    I lack confidence in the manufacturers of the vaccine.18 RNVD9
    Other.18 RNVD10
Evaluation of non-vaccination reasons19ERNV
    All COVID-19 vaccines were not adequately tested, and as a result, I cannot recommend them.19ERNV1
    I am currently unaware of all adverse reactions.19ERNV2
    I am unaware of the long-term effects of anti-COVID-19 vaccines19ERNV3
There are life-threatening adverse reactions.19ERNV4
    There is an introduced substance that weakens the body and causes vaccine addiction, a fact that requires frequent revaccinations.19ERNV5
    Unknown components of the vaccine contribute to mistrust.19ERNV6
    It is possible to implant a microchip that can be used to control individuals.19ERNV7
    I am waiting for a better and/or Romanian vaccine on which I can rely.19ERNV8
    I lack confidence in the manufacturers of vaccines.19ERNV9
Regarding vaccines24 RV
I consider them beneficial.24RV1
    I agree with some of them.24RV2
    I agree with those who work to prevent childhood diseases, but I disagree with the COVID-19 vaccine.24 RV3
Table 5. Indicative statistics trailing coefficients.
Table 5. Indicative statistics trailing coefficients.
MeanMedianMinMaxStandard DeviationExcess KurtosisSkewnessNumber of Observations Used
Information about vaccine0.000−0.672−0.6722.2861.000−0.5811.0371673
Non-vaccination reasons0.000−0.666−0.6663.1421.000−0.1091.1411673
Online activity0.000−0.119−1.2022.0481.000−0.5300.5261673
Reasons evaluation for non-vaccination0.000−0.670−0.6703.1231.000−0.1131.1221673
Reasons for non-vaccination decision0.000−0.594−0.5942.3081.0000.4051.4121673
Regarding vaccine0.000−0.804−0.8041.7501.000−0.9700.7541673
Vaccination decision 0.000−0.639−0.6392.7331.0000.8321.4061673
Vaccination for health0.000−0.694−0.6941.6361.000−10680.8781673
Vaccination status0.000−0.731−0.7311.3711.000−15900.6411673
Table 6. Hypothesis mean, STDEV, T-values, p-values.
Table 6. Hypothesis mean, STDEV, T-values, p-values.
0Original Sample (O)Sample Mean Standard Deviation T Values p-Values
H10.1170.1170.0148.6670.000
H20.8100.8110.01077.7180.000
H30.6960.6960.03917.9770.000
H40.8480.8480.02829.8140.000
H5−0.013−0.0130.0250.5040.615
H60.0010.0000.0250.0230.982
H70.1070.1080.0402.6570.008
H80.0430.0440.0361.2180.224
H90.0410.0400.0113.7210.000
H10−0.128−0.1290.0206.4940.000
H110.3280.3280.01129.1670.000
H120.5830.5830.01539.5720.000
Table 7. Result of tested hypotheses.
Table 7. Result of tested hypotheses.
H1A person’s vaccination status is determined by the knowledge he or she has about the vaccine.Accepted hypothesis.
H2External influences on the decision not to vaccinate are related to the evaluation of the vaccine itself.Accepted hypothesis.
H3There is a relationship between external influences on the decision not to vaccinate and the clients’ reasons, which plays a significant role in the decision not to protect themselves by vaccination.Accepted hypothesis.
H4There is a relationship between external influences on the decision not to vaccinate and agreement/disagreement on COVID-19 vaccination.Accepted hypothesis.
H5There is a connection between online activity and external influences on the decision not to vaccinate.Hypothesis is not supported.
H6There is a link between online activity and opinion about vaccines in general (not just for COVID-19).Hypothesis is not supported.
H7There is a relationship between the clients’ reasons, which play a significant role in their decision not to protect themselves by vaccination, and their agreement/disagreement on COVID-19 vaccination.Accepted hypothesis.
H8There is a relationship between the essential reasons for refusing COVID-19 vaccination and the decision to vaccinate.Hypothesis is not supported.
H9There is a relationship between the essential reasons for refusing COVID-19 vaccination and vaccination status. Accepted hypothesis.
H10There is a connection between the positive opinion/opinion about vaccines in general (not just for COVID-19) and the decision to vaccinate against COVID-19.Accepted hypothesis.
H11There is a correlation between the decision to vaccinate against COVID-19 and the vaccination status.Accepted hypothesis.
H12There is a correlation between the decision to vaccinate against COVID-19 for those who place value on individual health and the vaccination status.Accepted hypothesis.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Cîrnaţu, D.; Szentesi, S.G.; Cuc, L.D.; Ciurariu, E.; Bran, L.R.; Bâtcă-Dumitru, G.-C.; Joldes, C.S.R.; Pantea, M.F.; Pârvu, S. Investigation and Modeling of the Variables of the Decision to Vaccinate as the Foundation of an Algorithm for Reducing Vaccination Reluctance. Systems 2023, 11, 220. https://doi.org/10.3390/systems11050220

AMA Style

Cîrnaţu D, Szentesi SG, Cuc LD, Ciurariu E, Bran LR, Bâtcă-Dumitru G-C, Joldes CSR, Pantea MF, Pârvu S. Investigation and Modeling of the Variables of the Decision to Vaccinate as the Foundation of an Algorithm for Reducing Vaccination Reluctance. Systems. 2023; 11(5):220. https://doi.org/10.3390/systems11050220

Chicago/Turabian Style

Cîrnaţu, Daniela, Silviu Gabriel Szentesi, Lavinia Denisia Cuc, Elena Ciurariu, Liliana Renate Bran, Graziella-Corina Bâtcă-Dumitru, Cosmin Silviu Raul Joldes, Mioara Florina Pantea, and Simona Pârvu. 2023. "Investigation and Modeling of the Variables of the Decision to Vaccinate as the Foundation of an Algorithm for Reducing Vaccination Reluctance" Systems 11, no. 5: 220. https://doi.org/10.3390/systems11050220

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop