Next Article in Journal
Analysis of Antibodies Induced after SARS-CoV-2 Vaccination Using Antigen Coded Bead Array Luminex Technology
Next Article in Special Issue
What Motivates the Vaccination Rift Effect? Psycho-Linguistic Features of Responses to Calls to Get Vaccinated Differ by Source and Recipient Vaccination Status
Previous Article in Journal
Differential COVID-19 Vaccination Uptake and Associated Factors among the Slum and Estate Communities in Uganda: A Cross-Sectional Population-Based Survey
Previous Article in Special Issue
COVID-19 Vaccine Status, Intent, Hesitancy, and Disease-Related Beliefs in People with Multiple Sclerosis
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Cognitive and Behavioral Factors Predicting the Decision to Vaccinate against COVID-19 in Clinical Psychiatric Population—A Cross-Sectional Survey

by
Gabriela Mariana Marcu
1,2,3,
Ana Maria Radu
1,4,*,
Mihaela Dana Bucuță
1,
Radu Sorin Fleacă
5,
Ciprian Tanasescu
5,
Mihai Dan Roman
5,
Adrian Boicean
5 and
Ciprian Ionuț Bacilă
2,5
1
Department of Psychology, Faculty of Social Sciences and Humanities, “Lucian Blaga” University of Sibiu, 550201 Sibiu, Romania
2
Collective of Scientific Research in Neurosciences of the Clinical Psychiatry Hospital “Dr. Gheorghe Preda”, 550082 Sibiu, Romania
3
Division of Physiology and Neuroscience, “Carol Davila” University of Medicine and Pharmacy, 020021 Bucharest, Romania
4
Psychology Department, Faculty of Sociology and Psychology, West University of Timișoara, 300223 Timișoara, Romania
5
Faculty of Medicine, “Lucian Blaga” University of Sibiu, 550169 Sibiu, Romania
*
Author to whom correspondence should be addressed.
Vaccines 2023, 11(2), 441; https://doi.org/10.3390/vaccines11020441
Submission received: 6 January 2023 / Revised: 9 February 2023 / Accepted: 9 February 2023 / Published: 15 February 2023

Abstract

:
The spread of the COVID-19 virus created more than a medical crisis, while it also negatively affected the mental health of the general population. This context increased the vulnerability of the psychiatric population. While research interest highly targeted vaccine hesitancy and acceptance, many studies focused on trust issues—both in vaccine efficacy and in communication with authorities. Less is known about the psychological underpinnings of the COVID vaccination decision, specifically in the high-uncertainty circumstances due to the novelty of the virus. In a cross-sectional study, we investigated the predictive value of several cognitive (perceived risk, vulnerability, uncertainty, and trust in one’s decision) and behavioral (previous vaccinations, social media use, and practicing preventive behavior) factors, for the vaccination decision against COVID-19, for 252 psychiatric inpatients (data collected between September 2021 and February 2022). Demographics and diagnostics were also considered. We found a significant relationship between the “Perceived risk of vaccination” and the choice of vaccination (χ2(2, N = 252) = 58.59, p ≤ 0.001), and between the “Trust in own decision to vaccinate” and the decision to vaccinate (χ2(2, N = 252) = 31,5, p ≤ 0.001). The overall regression model was statistically significant (χ2 (9, N = 252) = 97.1, p < 0.001), with between 30% and 45% of the variance in the odds of a positive decision explained by the predictor set. The model coefficients analysis showed that an individual with a psychiatric disorder but with higher confidence in their decision had significant (p < 0.001) increased odds of the decision to vaccinate against COVID-19 by 893%. A former voluntary vaccination did not significantly associate with the decision to vaccinate against COVID-19 (χ2(1, N = 252) = 2.74, p > 0.05) in this special population. No other behavioral factors, diagnosis, or demographics were significant as predictors, for the clinical psychiatric population surveyed, except the educational level. Implications for future vaccination acceptance of this special population are discussed.

1. Introduction

The decision to vaccinate against COVID-19 has been a global research topic in the last three years, and the challenge to find its main triggers is even larger when working with psychiatric populations, where the decision-making process might be impaired. On the other side, people with mental health problems are considered vulnerable to epidemic outbursts. Together, context (mental health and epidemic) and individual factors might reveal a specific configuration that should be specifically addressed in increasing the vaccination rate.
This study focuses on the Romanian population and proposes a possible explanatory model for the vaccination decision of people with psychiatric disorders. The model is built based on the analysis of five factors, supposedly associated with the decision to administer the COVID-19 vaccine. The proposed factors are risk perception regarding the illness, risk perception of vaccination, perception of personal vulnerability, attitude toward uncertainty, and trust in personal choice. First, this paper briefly presents data from previous studies to bring supportive evidence for illustrating that the psychiatric population is a risk category for COVID-19 infection and, therefore, it could be vital to discover the factors that influence their decision-making process regarding vaccination. Secondly, we address the process of decision-making under uncertainty. Confidence in the healthcare system represents another factor that has a high impact on people’s decision to get vaccinated. In this study, we investigate variables related to or highly influential on an individual’s confidence in the healthcare system: the severity of the diagnosis and the presence of comorbidities, former voluntary vaccination, the use of social media, and the confidence in its contents, and practicing preventive behavior to protect against infection. (When discussing preventive behaviors, we translate that people engage in activities such as respecting social distance measures, wearing a face mask, regular ventilation of indoor spaces, quarantining, hand washing for at least 30 s, covering coughs and sneezes). Thirdly, we explore the psychological factors involved in the decision-making process in a medical context based on the Health Belief Model (HBM) [1] and the arguments for the vaccination against COVID-19, to illustrate reasons why it creates insecurity. The five factors included in the HBM model (perceived susceptibility, perceived severity, health motivation, perceived benefits, and perceived risks) as well as the impact of psychological characteristics on the vaccination decision or hesitancy are analyzed.

1.1. Psychiatric Population as a Highly Vulnerable Category for COVID-19 Infection

The COVID-19 pandemic has been a health emergency, which reached a pandemic in March 2020. The World Health Organization presents anti-COVID-19 vaccination as being critical to the end of this pandemic, but in various countries, such as it is in Romania, the vaccination rates remained low [2].
Furthermore, research shows that the pandemic context can significantly deteriorate individuals’ wellness and increase mental health issues. The stress caused by this medical crisis leaves the general population in distress, reduces life satisfaction, and even triggers reactive psychosis [3,4]. Therefore, the clinical psychiatric population, which is already a group characterized by vulnerability, would be constantly at considerable risk of rapid deterioration. For this reason, it is vital to understand the cognitive and behavioral factors that predict the intention to vaccinate against COVID-19 in individuals with clinical psychiatric issues.
Research suggests that patients with severe mental illness represent a high-risk category for developing an aggravated form of respiratory syndrome coronavirus [5], or a higher risk for COVID-19-related infection, hospitalization, and mortality [6,7,8,9]. A connection between having a psychiatric illness and a high risk for COVID-19-related negative outcomes [9] or developing more serious forms of the respiratory syndrome [6] was found, compared to the general population. Increased risk of COVID-19 infection was reported on participants with psychiatric disorders, within a sample of 421,014 participants from the UK Biobank. A total of 69.2% of individuals positively tested for the COVID-19 virus or having a cause of death related to the virus were individuals with a psychiatric diagnosis [9]. However, some evidence revealed no connection between increased COVID-19-related mortality and two of the mental health conditions (mood and anxiety disorders) [10]. One convergent point is that the psychiatric population has a two-to-three-times-higher mortality rate compared to the rest of the population [11,12], which also increases the risk of negative outcomes related to COVID-19 [13].
Moreover, mental illness was commonly associated with poor decision-making, such as non-compliance to treatment or suicide attempts [14,15]. Nevertheless, the decision-making deficits differ according to the diagnosis and associated symptoms. For example, anxiety is associated with two biases that impact the decision-making process—a response to threat-related information (response to threat-related information) and a tendency to interpret information gathered from ambiguous or neutral stimuli as negative (bias toward negative interpretation), which can lead to decision-making impairments [15]. Furthermore, a large body of literature brings evidence to the idea that cognitive dysfunctions in schizophrenia can occur even if the patient has proper symptom control [16], negatively altering the patient’s decision-making process [15]. The connection between mental illness and the impaired decision-making process is also salient in addictions, where inter-temporal choice is highly affected in addicted patients compared to healthy individuals [14].

1.2. Heterogeneity of Vaccination Determinants

Attempts to find an explanatory model of vaccination hesitancy/acceptance have led to heterogeneous results in the literature. Social, cognitive, behavioral, or political factors have been analyzed in attempts to identify the reasons that lead to the increase in vaccination acceptance. Conceptualizing the decision to vaccinate as a choice in a context of uncertainty and integrating this choice into a model of health beliefs, we can separate some influential factors that deserve further investigation:

1.2.1. Cognitive Factors: Risk Perception and Uncertainty in Health Decisions

Risky decisions or choices between options of different probabilities of risk are often performed under the “bounded rationality” [17] condition. As a result, predictions for such choices must be investigated empirically. The effect of perceived risk in decisions was identified a long time ago in a version of a study on overestimating the results obtained in small samples, known as the “law of small numbers” [18]. Nowadays, the tendency extends to several situations in which people have erroneous intuitions about probabilities. This trend is amplified by the perception of risk.
Existing studies suggest that disease risk perception is a critical determinant of active and protective health behavior, the higher perception of risk being a predictor for the practice of general preventive behavior [19,20], or particularly as social distancing, but not hand washing [21]. However, the nature of the association between high-risk perception and health behavior also depends on the type of risk perception (deliberative, affective, experiential, etc.) and the accuracy of these perceptions [22]. In addition, it is speculated that people support emotional and experiential risk judgments (such as in anxiety and worry conditions) with greater conviction than deliberative, rational ones [23]. We tried to identify in this study which of the proposed risks could have such a similar valence, to influence the final vaccination decision.
However, the perceived risk per se is not sufficient to cause major changes in intentions and behavior, as evidenced by several studies on vaccination behavior [24], preventive behaviors in the COVID-19 pandemic [25], or intentions and behaviors in general [26]. Many of the studies on active or protective behaviors regarding illness used the “Health Belief Model” [1], which associates, in a rational paradigm, the increase in commitment to such behavior as the perceived risk of disease increases. Perceptions of disease risk, however, show significant variability, moderated by the degree of trust people have in their risk judgments or “belief in risk perception” [27]—the belief that this belief is correct. The model proposed by Taber and Klein suggests that the more confident people are that the threat is real, the more willing they are to engage in protective behavior that involves various costs (personal, material, etc.). As a result, to increase the accuracy of the predictions related to the vaccination decision, the level of perceived risk in the language is also important to determine the confidence that people have in their convictions, implicitly in those of risk estimation.
Interestingly, the lockdown has somewhat changed the weight of predictors in the vaccination decision, as the intention to vaccinate was found to be less affected by vaccination beliefs, while the perception of risk was increased during lockdown periods, with more people willing to be vaccinated against COVID-19 [28]. We could assume that the context of uncertainty was changed by the lockdown, which established a secure framework for perceiving a high risk [29].
Taber and Klein’s review concludes with only modest correlations between risk perception and people’s intentions/behavior, possibly due to a risk measuring problem [27]. Meanwhile, at the applicative level, interventions are still being designed in the hope that an increase in risk perception would lead to a change in behavior—initiatives that are often proved ineffective. Through this study, we want to provide a measure of association between the perceived risk (of getting the illness, of vaccination) and the decision to vaccinate, to establish the predictive value of risk perception for active COVID-19-related behaviors.

1.2.2. Behavioral Factors: Vaccination History, Social Media Use, and Preventive Behaviors

Former voluntary vaccination has also been proposed in the current study to be associated with the acceptance of vaccination and as a factor to influence the process of decision-making regarding future vaccinations. Having a vaccination history could increase the acceptance rate of a COVID-19 vaccine by three times [28] or might raise the percentage of a new vaccine acceptance in 91.3% of the formerly vaccinated population [30]. Moreover, in a rapid systematic review [31] regarding the receptivity of the COVID-19 vaccine, the vaccination history was found as a strong predictor in six studies that associated the previous vaccination with the decision to get vaccinated [31]. There is also research on the vaccination for influenza that supports these findings, showing that the majority of individuals that chose to vaccinate once against influenza are most likely to get vaccinated in the next season as well [32].
The rapid opportunities for communication on social media platforms and the lack of scientific vetting create an environment where individual opinions, scientific data, or evidence are constantly debated and modified by people all around the world. If there is internet access, social media can reach significant audiences and any topic can be debated or searched for. In addition, it offers its users the possibility to reject the content they are not comfortable with and to subscribe to self-chosen streams of content that is in accordance with their personal views [33,34]. In theory, content can be transferred between users with different opinions, but this hardly occurs [35]. As social media offers an opportunity to access information quickly and effortlessly, many people look for advice or answers to various uncertainties on those platforms, including health-related information. Furthermore, there is a growing community of anti-vaccine groups that use social media networks to coordinate and manipulate discussions. A review of health-related misinformation on social media [36] shows that those groups receive significant attention and suggest that they have a significant influence on people’s decisions and behaviors. For example, out of 87 YouTube video clips on the topics “vaccine safety” and “vaccines and children”, 65% of them encouraged an anti-vaccine attitude, of which 36.8% did not offer empirical or scientific evidence. The misleading information from those clips receives a lot of popularity and viewers do not question their authenticity—hence the substantial number of trending video clips that have no scientific base [36].
Social media was also found to positively influence individuals to embrace preventive behaviors and to make them more prone to getting vaccinated. A study (N = 886) that examined the connection between social media exposure, preventive attitudes and behaviors, and risk perceptions of the COVID-19 virus found that high exposure to social media was associated with a higher risk perception, which was further connected to engagement in preventive behaviors and vaccination acceptance [37]. Positive associations were confirmed in a study regarding vaccination intentions in China, where a high engagement with COVID-19 content on social media was found positively correlated with vaccination acceptance [38].
Engagement in preventive behaviors was found to be associated with intentions to get vaccinated in several research studies, such as in a study from the USA (N = 592) where individuals without an intention to vaccinate have expressed lower levels of engagement in preventive behaviors such as avoiding social gatherings, wearing a mask, and frequently washing hands [39]. This is further supported by a study conducted in China, which showed similarly high percentages of protective behaviors such as constantly sanitizing hands, avoiding attending social gatherings, or wearing a facemask, which was positively associated with higher rates of vaccination intentions [38].

1.3. Current Study

The present study aims to explore the measure of association between cognitive and behavioral factors—such as perceived risk or vulnerability, confidence in one’s own decision, or previous preventive behaviors—and the choice for vaccination, in order to establish the predictive value of such factors in initiating a behavioral change in the health domain and on the decision to vaccinate.
Based on the existing evidence, we propose a prediction model, for the psychiatric population, with the following hypotheses:
When perceived risk of illness is high, compared with low, it will have a positive impact on the decision to vaccinate against COVID-19.
When perceived risk of vaccination is high, compared with low, it will have a negative impact on the decision to vaccinate against COVID-19.
When perceived personal vulnerability is high, compared with low, it will have a negative impact on the decision to vaccinate against COVID-19.
When perceived uncertainty is high compared with low, it will have a negative impact on the decision to vaccinate against COVID-19.
When trust in one’s decision to vaccinate is high compared to low, it will have a positive impact on the decision to vaccinate against COVID-19.
Former voluntary vaccination is positively associated with the decision to vaccinate against COVID-19
The use of social media and the confidence in its content are negatively associated with the decision to vaccinate against COVID-19
Practicing a preventive behavior to protect against infection will have a positive impact on the decision to vaccinate against COVID-19
Besides the above-proposed predictors, some other variables are investigated in relation to the decision to vaccinate against COVID-19 to add to the literature with possible new hypotheses for further investigation; thus, demographics, the severity of the diagnosis, and the presence of comorbidities are investigated for their effect on the decision for vaccination in the sense of reducing it.

Diagnosis Severity, Comorbidities, and Vaccination Decision

Multiple studies gathered evidence supporting the idea that the severity of the diagnosis and the presence of co-morbidities are factors that influence individuals to get vaccinated [40,41,42]. Research regarding influenza vaccination (flu vaccination) suggested that individuals who perceive the seriousness of the disease and its risks are more likely to vaccinate [40,41]. Recent research [42] found that people who self-reported a chronic illness are more inclined to accept an anti-COVID-19 vaccine compared to healthy individuals. The presence of comorbidities might represent a factor that positively influences the acceptance of vaccination [42]. Empirical evidence supported the relationship between acceptance of COVID-19 vaccination and perceived severity of the disease [43] and also between the existence of co-morbidities and decisions on vaccination against influenza [44,45].
But research does not show homogenous results on the association of illness severity and vaccination, reflecting the probable variability of the factors definition. Oppositely to the previously presented results, another study did not find a significant correlation between the severity of the disease and vaccination acceptance, concluding that perceived benefits from the vaccine and cue to action are the variables that positively influenced the decision to vaccinate [32]. However, their sample was small (N = 299) and the study targeted a specific population—Israeli nurses. Therefore, those findings might not be relevant to other groups (psychiatric population, for example) or the general population [32].

2. Materials and Methods

2.1. Participants

A total of 252 patients (63.5% females, mean age 56.6; SD 13.4) hospitalized in the Clinical Hospital of Psychiatry “Dr. Gh. Preda” from Sibiu, Romania, were recruited between September 2021 and February 2022. Sample size was determined by a priori calculation (with G-power program) for a research power of 95% and an effect size of 0.5 (Cohen’s d). A total of 51.6% of participants were high-school-level graduates, while 19.4% had higher academic studies. Most of the participants were diagnosed with affective disorders (66.4%), while 13.9% were diagnosed with psychotic disorders, and the rest were diagnosed with addictive disorders (8%), personality disorders (6.3%) and degenerative disorders (5.5%). A total of 150 participants (59.5%) were married.

2.2. Design and Procedure

After being assigned a GDPR code and signing the informed consent, patients completed a questionnaire structured on several dimensions related to decision-making; the completion of the questionnaire was carried out by operators (medical staff from the hospital) and was completed by patients from several departments of the hospital, with various pathologies. The study was previously approved by the Ethics Committee of the hospital. In addition, the research followed the STROBE checklist for reporting observational studies [46]. The checklist is available in the supplementary materials (Table S1).

2.3. Instruments and Measurements

The questionnaire was built in Romanian, based on the consultation of the available literature on vaccination in general and vaccination against COVID-19 in particular. The instrument consisted, in addition to demographic and medical history data, of 29 items, structured on 5 dimensions—related to factors identified in the literature as being associated with the decision to vaccinate. Factors were selected to provide a possible explanatory model for the decision to vaccinate of people with mental disorders: risk perception regarding the disease (1), risk perception regarding vaccination (2), perception of personal vulnerability (3), attitude toward uncertainty (4), and confidence in one’s own beliefs (5). An English translation of the questionnaire can be found in the Supplementary Material as Annex S1.
The underlying theory in the construction of the questionnaire was the Health Belief Model (HBM) [1], an often-used model in studies investigating health-related behaviors. The model suggests that, if a person perceives a threat to their health, they will be consequently oriented to action, and if its perceived benefits outweigh the perceived barriers, then they are likely to take the recommended preventive health action.
Risk perception on disease was assessed by 8 Likert-type scale items that investigated dimensions of perception toward both COVID-19 and similar but familiar diseases such as influenza. Questions assessed perceived susceptibility (“How likely do you think it is to get sick from…”), perceived severity (“How severe do you think is the disease generated by the influenza virus/SARS-CoV-2”), perceived anxiety (“How scared you feel about contacting the influenza virus/SARS-CoV-2”), and confidence in the effectiveness of the vaccine. Perception of the risk of vaccination was evaluated through 8 items of the 5-step Likert scale (total disagreement/agreement) that formulated beliefs and behaviors associated with pro-health behavior and vaccination. (For example: “I need more information than what exists now, to decide to vaccinate”).
Perception of personal vulnerability was assessed by 4 questions on a 10-point Likert scale (for example: “I think my chances of getting infected with COVID-19 are” non-existent (1)–extremely high (10)).
The attitude toward uncertainty was assessed through 4 Likert-scale items, which operationalized the concept through questions such as “It is difficult for me to make a decision when I am not sure of the outcome”.
Confidence in one’s own beliefs was assessed on a 10-point Likert scale, by formulating a single item, related to the decision to vaccinate: “How sure am I of the decision made regarding the vaccination against COVID-19”.
In addition to the 5 cognitive factors, the questionnaire included items that measured behaviors hypothetically associated with pro-health attitudes: the use of social media, the choice and frequency of preventive behaviors (for example: wearing a mask, washing hands, avoiding crowded places), as well as a self-report of reasons for non-vaccination (such as “I don’t trust the effectiveness of the vaccine, I have other diseases and I’m afraid that they won’t get worse as a result of the vaccination, I don’t like having something imposed on me, I think the vaccine is bad for me, I read information that convinced me not to do it”).
Demographic measures included: age, gender, studies, marital status, and number of children. Medical information contained the clinical diagnosis, time in hospital, treatment taken, comorbidities, smoking, and other vaccines taken (Figure 1).

2.4. Data Analysis

The Jamovi software (version 2.3.18.0, The Jamovi project, 2022, Sydney, Australia) was used for statistical analysis of the data. Descriptive analysis and normality tests were performed for demographics and predictor variables and frequency tables were drawn. For the dichotomous variables, the analysis was performed with contingency tables (association or incidence) and, later, the χ2 test was applied to explore the association between pairs of variables of interest. For all data, the threshold of significance was defined for the value of p < 0.05 for a confidence interval of 95%. For all tests, a “two-tailed” significance criterion of 5% was applied.
The cognitive and behavioral factors were operationalized by outlined sections in the questionnaire, with several items for each section and each item counting for a specific variable/measure of the factor. Furthermore, six predictive factors to include in the analysis model were computed as means of specific variables’ raw scores, resulting in six computed continuous variables: “perceived risk” of illness/disease ((1) PERC_RISK_ILL) and of vaccination ((1) PERC_RISK_VACC), “Perceived personal vulnerability” ((2) PERC_VULN), “Perceived uncertainty” ((3) PERC_UNCERTAIN), “Use of social media” ((6) SOCIAL_MEDIA), and “Practicing a preventive behavior” ((7) PREV_BEHAV). The other two predictive factors were one categorial variable—“trust in one’s belief” to vaccinate ((4) TRUST_VACC_DEC, with 3 levels: low, moderate, and high)—and a dummy variable, “Former voluntary vaccination” ((5) PREV_VACC: with yes/no values). A binary logistic regression with a prediction model was conducted with these cognitive and behavioral factors as predictors.
Bivariate association hypothesis testing was performed using the Pearson χ2 test for categorical (nominal) variables and Jamovi’s one-way ANOVA for non-parametric data for continuous variables with a nonnormal distribution. One analysis decision for avoiding confirmation bias was to test both for difference and equivalence. Running both tests for relevance and for equivalence supported the drawing of conclusions accordingly [47]. Thus, for all the tested effects that showed significance, equivalence tests (TOST procedure, Jamovi) were used, to conclude if the found effects were large enough to be worth further examination. The TOST procedure requires setting an upper and lower equivalence bound, which can be determined by using the smallest effect size of interest. The values that remain in between the thresholds are alleged to be equivalent to the lack of an effect that is worth analysis [48].

3. Results

3.1. Demographic Data

Among the 252 participants, 68.3% were vaccinated against COVID-19. Most participants were females (N = 160), out of whom 107 were vaccinated and 53 not vaccinated. Therefore, the vaccination rate among females was 66.87%. The male participants (N = 92) had a slightly higher vaccination rate, 70.65% (65 vaccinated participants and 27 not vaccinated). A characteristic associated with higher vaccination rates was the education level. A total of 71.4% of participants with higher education (N = 49) were vaccinated and 78.4% of subjects with secondary school studies (N = 130) while only 47.9% of individuals with primary studies (N = 73) were vaccinated. Other analyzed sociodemographic characteristics were age categories (18–39, 40–46, 65 and over), psychiatric diagnosis (affective disorders, psychotic disorders, addictive disorders, personality disorders, and degenerative disorders), smoking behavior, marital status, and previous voluntary vaccination. The frequency tables for each characteristic can be found in the supplementary materials (Table S2).
Furthermore, the crosstabulation was performed to test the association of demographics and decision to vaccinate against COVID-19. As it can be seen in the frequencies (Table 1), a significant relationship was found only between the level of education and choice of vaccination (χ2 (dF = 4, N = 252) = 20.37, p < 0.01).

3.2. Factors Associated with the Vaccination Decision

For the variables hypothesized to predict the decision to vaccinate, we first performed a normality test. The distributions were significantly nonnormal for the variables: (1) perception of risk of vaccination (PERC_RISK_VACC) (W = 0.90, p < 0.01), (3) perceived uncertainty (PERC_UNCERTAIN) (W = 0.813, p < 0.01), (4) trust in one’s own decision (TRUST_OWN_DEC) (W = 0.732, p < 0.01), (6) social media behavior (SOCIAL_MEDIA_BEHAV) (W = 0.691, p < 0.01), and (7) preventive behavior (PREV_BEHAV) (W = 0.971, p < 0.01) according to Shapiro–Wilk tests (plots available in Supplementary materials, Table S2). The complete results can be seen in Table 2. Based on this outcome, a non-parametric test was used further.
A Chi-Square Test of Independence was performed to assess the relationship between the proposed cognitive and behavioral factors and the decision to vaccinate. There was a significant relationship between the “Perceived risk of vaccination” and the choice of vaccination (χ2(2, N = 252) = 58,59, p ≤ 0.001) (Table 3). Psychiatric patients with a high perceived risk of vaccination were less likely to decide to get a vaccine against COVID-19 compared to those with a low perceived risk (Figure 2). The TOST equivalence test was performed for the statistically significant difference and the null equivalence hypothesis was confirmed. The difference between groups fell outside the interval indicated by the established equivalence bounds (−0.5–0.5), which means that the found differences were not statistically equivalent (Table 4).
We also found a significant relationship between the “Trust in own decision to vaccinate” and the decision to vaccinate (χ2(2, N = 252) = 30.43, p ≤ 0.001). Psychiatric patients with a reduced trust in their decision to vaccinate were less likely to decide to get a vaccine against COVID-19 compared to those with a trust rated high (Table 5).
Surprisingly, a former voluntary vaccination did not significantly associate with the decision to vaccinate against COVID-19 (χ2(1, N = 252) = 2.74, p > 0.05) (Table 6). Also, Figure 3. illustrates a comparison between previously vaccinated participants who also agreed to vaccinate against COVID-19 and participants who were not previously vaccinated but agreed to the immunization against COVID-19.
For the factors expressed by continuous variables, Spearman’s rank correlations were computed to assess the relationship. There were highly significant positive correlations between perception of vulnerability (PERC_VULN) and perception of risk of illness (PERC_RISK_ILL), r(250) = 0.48, p < 0.001; (PERC_VULN) and perception of risk of vaccination (PERC_RISK_VACC), r(250) = 0.21, p < 0.001; preventive behavior (PREV_BEHAV) and PERC_RISK_VACC, r(250) = 0.25, p < 0.001. Negative significant correlations were between social media (SOCIAL_MEDIA) and PERC_RISK_ILL, r(250) = −0.12, p = 0.044; PERC_RISK_VACC, r(250) = −0.19, p = 0.002; PERC_VULN, r(250) = −0.17, p = 0.005. The complete correlation matrix can be found in Table 7.
A TOST equivalence test was applied for the found significant correlations to test if the observed difference falls outside the prior specified equivalence bounds of −0.03 and 0.03. The conclusion of statistical equivalence was rejected for the pairs (1) PERC_RISK_VACC and (7) PREV_BEHA, 90%CI [0.157, 0.356]; (2) PERC_VULN and (1) PERC_RISK_VACC, 90%CI (0.107, 0.3113]; (2) PERC_VULN and (1) PERC_RISK_Illness, 90%CI [0.402, 0.565]. With 252 participants, the study had a 90% power to detect a correlation of 0.3 for this pair of variables.
Furthermore, we wanted to see which specific preventive behavior mostly correlates with the risk perception of vaccination, and the correlation matrix revealed that the chemicals (whether hand gel r(252) = 0.214, p < 0.001 or disinfectant r(252) = 0.218, p < 0.001) were the preferred preventive means for individuals with higher risk perception (Table 8).

3.3. Regression Model for Prediction of Decision to Vaccinate

A binary logistic regression was conducted to determine whether a psychiatric patient’s decision to vaccinate against COVID-19 could be predicted by the four cognitive and three behavioral factors. The overall model was statistically significant (χ2 (9, N = 252) = 97.2, p < 0.001) with between 30% and 45% of the variance in the odds of a positive decision explained by the predictor set (Table 9). Across both outcome categories, 81.7% of cases were accurately classified, with the specificity higher than sensitivity. The decision to vaccinate was correctly predicted in 82% of cases compared to 81.3% of no vaccination choice. The behavioral factor of practicing a preventing behavior was associated with an increase in the likelihood of a positive decision for vaccination against COVID-19 (OR = 1.677, 95%CI [0.9, 2.9]). The model coefficients analysis showed that an individual practicing preventive behavior has marginally significant (p = 0.058) increased odds of the decision to vaccinate against COVID-19 by 67.7%. In addition, an individual with higher confidence in their decision to vaccinate has significantly (p < 0.001) increased odds (OR = 8.936, 95%CI [2.6, 30]) to vaccinate, by 893%, than one with low confidence. Another predictor significantly related to the odds was the “Perceived risk of vaccination”, but the effect size (0.21) was small.
Tests to see if the data met the assumption of collinearity indicated that multicollinearity was not a concern (tolerance between 0.807 and 0.986, VIF between 1.01 and 1.24).
ROC curve analysis showed an optimal cut-off value of 0.3 (Sensitivity = 81.3%; Specificity = 82%). The predictive value of the regression model was 81.7%. (More graphs and tables in Supplementary Materials, Tables S3 and S4).

4. Discussion

The study’s main finding is the identification of psychiatric population characteristics that lower the odds of getting a vaccine against COVID-19: patients with lower education (elementary), who perceive a high risk of getting vaccinated and have little trust in their own decision on vaccination, and who practice little preventive behavior. No significant differences were found in sex, age, smoking behavior, marital status, and psychiatric diagnosis, regarding the decision to vaccinate against COVID-19, besides previous findings that linked higher risk perception with female gender, advanced age, poor health, city residence [20], low income [49], and reduced ability to calculate [50].

4.1. Psychiatric Patients vs. Normal Population in the Decision to Vaccinate against COVID-19

Even though many studies have already focused on vaccine hesitancy and decision factors for the normal population, little is presently known about the specificity of the decision to vaccinate in vulnerable populations such as psychiatric patients. The psychiatric population represents vulnerable groups in society, and it is essential to identify and understand the predictive factors that influence their vaccination decision about COVID-19, to be able to improve the uptake and consequently reduce their vulnerabilities [8,9]. The current study reveals the detriments behind the vaccination decision of psychiatric patients and the demographic and psychological predictive variables for vaccination against COVID-19. Surprisingly, the only demographic characteristic that predicts the vaccination decision for this population is the education level. Age did not induce statistically significant results, but we remark that the group aged between 40- and 46- years-old had the higher vaccination rate, in the psychiatric population, while participants in the age group over 60-years-old were in the lowest range of vaccination.
Mental illness could alter the decision-making process [14,15,51]. However, each condition could have a different impact on decision-making ability. In depression, for instance, the process could be longer compared to healthy individuals. Similarly, in schizophrenia, it could be slow, but also, less flexible and risky [52]. We conducted a crosstabulation to test the association of five diagnoses (affective disorder, psychosis, dementia, addiction, and personality disorder) and the decision to vaccinate against COVID-19. Our analysis did not reveal any significant differences between the included illnesses in regard to the vaccination decision (χ2 (dF = 5, N = 238) = 3.12, p = 0.54). Those results can only support the idea that the influence of one’s diagnosis over the decision-making process can vary.

4.2. Cognitive Predictors: Risk Perception

Risk perception is one of the psychological factors involved in the decision-making process based on the Health Belief Model (HBM) [1]. In the case of COVID-19 vaccination decisions, the whole context is new and uncertain. To make the best decision under uncertainty, people try to know as much as possible about the probabilities of the consequences of each option; thus, the strategy becomes irrational because people generally tend to overweight lower probabilities. Our study reveals that the perceived risk of vaccination could be one of those triggers to impact the decision to vaccinate, as it might be linked to uncertain outcomes and, thus, increase the hesitancy for vaccination. As experiential states such as anxiety and worry were considered affective variants of risk perception, in conditions of uncertainty, analogous to deliberative perception [23], in this study, the perceived risk of vaccination was such a variant that might have induced an affective component in the vaccination decision. This would be in line with the association of preventive behaviors with perceptions of affective risk found in a recent meta-analysis [53].
Risk perception and trust are cognitive factors that recurrently occur in studies explaining human decision-making. We tested risk perception as a critical determinant of active and protective health behavior and we found a significant relationship between the “Perceived risk of vaccination”, but not of “perceived risk of illness” (as forms of protective behavior), and the decision to vaccinate (χ2(2, N = 252) = 58.59, p ≤ 0.001), but the effect size is small. In addition, the risk perception on vaccination significantly correlated (Spearman’s rho = 0.26, p < 0.001) with some other preventive behaviors, which is in line with previous research findings [19,20]. More specifically, we remark here that among all preventive behaviors of choice (wearing a mask, washing hands for 20s, avoiding crowded places, etc.), the ones that correlated most with the perceived risk of vaccination were the behaviors involving disinfecting substances, such as hand gel use (Spearman’s rho = 0.214, p < 0.001) and disinfectant substances use (Spearman’s rho = 0.218, p < 0.001). We could not tell whether this preference is characteristic of the psychiatric population or whether it is more general in the healthy population; therefore, this remains a hypothesis to be tested in further research.

4.3. Cognitive Predictors: Perceived Personal Vulnerability, Perceived Uncertainty, and Trust in One’s Own Decision to Vaccinate

No significant association was found in the current study between the perception of personal vulnerability, perceived uncertainty, and vaccine acceptance. Perceived vulnerability and known as well as perceived susceptibility were proposed for analysis as being major components of threat perception in the Health Belief Model. The model suggests that the greater the perceived personal vulnerability, the greater the perceived threat, and the more likely a person will perform health-oriented behaviors such as immunization. Perceived vulnerability is also an important component of threat appraisal in Protection Motivation Theory [54,55], but, at the moment, there is no definitive measurement scale or strategy to operationalize it. However, Likert-type response scales are usually utilized for measuring the perceived likelihood a negative event will occur, which we also used in the present study. That was more like an absolute measure of perceived vulnerability, which might have the weakness of inducing a confounding with expectations or intentions and which might explain the lack of association with vaccination adherence.
We also did not find a significant association between perceived uncertainty and decision to vaccinate against COVID-19, in the current study, which is in line with similar research: perceptions of COVID-19 uncertainty were not associated with vaccine intentions or testing [56] and perceived uncertainty did not influence attitudes toward vaccination [57].

4.4. Behavioral Predictors: Former Voluntary Vaccination

Previous vaccination against influenza was one of the influencing factors found to increase the odds of COVID-19 vaccination [30]. It can be argued that individuals’ perception over the COVID-19 infection was associated with their flu perception and, consequently, with their attitude toward immunization. This association was influenced by mass media or politicians’ discourses [28]. In this study, the regression model coefficients analysis did not show a significant association between vaccination history and decision to vaccinate against COVID-19 (χ2(1, N = 252) = 2.74, p > 0.05) for the psychiatric population. However, we should take into consideration the fact that the data for the current study were collected in the context of a national lockdown. This context (declared emergency state) could contribute to a change in the perceived risk assumption and, therefore, the previous vaccination would not be as relevant in comparison to the increased perception of risk or personal vulnerability. Similarly, other scholars reveal that there can be significant changes in perception that can further be reflected into behaviors in the time frame pre- and post-lockdown [28]. In addition, the participants in this study represent a specific vulnerable group and one can assume that their decision-making process would differ from the general population—hence, previous vaccination might not represent a highly influencing factor for the vaccination decision.

4.5. Behavioral Predictors: Social Media Engagement

While there is some evidence regarding the influence of social media on the decision to vaccinate, to our knowledge, no studies reported its influence on the psychiatric population. On one hand, studies show that social media can discourage individuals from preventive behaviors, encourage conspiracy theories, and spread misinformation, which can negatively impact on the vaccination decision or health-related behaviors [36,58,59]. On the other hand, if social media content is positive, it may encourage individuals to vaccinate [38]. In addition, social media was associated with a higher risk perception for COVID-19, which was also a factor that increased the chances of vaccination [37]. The literature on vaccination debates points out that social media disengages its users from debates and reinforces their own beliefs by confining the content they receive following their previously held beliefs [35]. COVID-19 conspiracy theories and social media were also linked in studies that found a negative association between folding COVID-19 conspiracy beliefs and engagement in protective behaviors. Moreover, the use of social media for accessing COVID-19 information was found to negatively influence individuals’ protective behaviors [58]. For the current study, as informed by the cited literature, we expected social media use to positively influence individuals’ perspectives on vaccination and their engagement in health-protective behaviors.
The psychiatric population represents a vulnerable group, and their diagnosis could negatively influence their decision-making process [9,14,15]. Considering that those studies focused on the association between social media influence and vaccination decision had a sample of healthy individuals (without a psychiatric diagnosis), one can argue that psychiatric patients could be even more susceptible to social media’s influence regarding vaccination decisions. Nevertheless, the current research did not gather data about what type of content the participants accessed on social media, but only the quantitative time spent on social networks such as Facebook or Instagram. Our analysis revealed negative significant correlations between social media engagement and perceived risk of illness (r(250) = −0.12, p = 0.044), perceived risk of vaccination (r(250) = −0.19, p = 0.002), and perceived vulnerability (r(250) = −0.17, p = 0.005). These correlations can only reveal that there is an association between social media use and the other three potential predictors explored in this study.
One explanation for this result could be the positively skewed distribution of social media use in our studied population. More than 80% of the patients in the study used social media less than an hour a day, data that are not similar to the healthy population (the use of social media for the years 2020–2022, in the age range of 16–64 years, was an average of 2.5 h, worldwide) [60]. Therefore, this negative correlation we found in the study should be interpreted with caution, as more studies in psychiatric patients (perhaps with a less skewed social media use distribution curve) are needed to confirm an inverse relationship with risk perception. We cannot conclude that social media is a factor that decreases the odds of getting vaccinated for the psychiatric population, while, besides this correlation, no other significant findings support this idea.

4.6. Behavioral Predictors: Preventive Behaviors

Practicing preventive behavior correlates with confidence in one’s decision to vaccinate (Spearman’s rho = 0.207, p < 0.001), and again, the highest correlations are with the two behaviors involving disinfectants: hand gel use (Spearman’s rho = 0.210, p < 0.001) and use of other disinfectant substances (Spearman’s rho = 0.206, p < 0.001). The results are convergent with the Taber and Klein model [27], which suggests a positive association between people engaging in protective behavior and confidence in their belief about the threat. Individuals who engage in preventive behaviors could be more motivated, self-aware, or self-efficient regarding their health and, therefore, they would take measures to conserve their state of health—hence, they engage in preventive behaviors [49]. In addition, risk perception on vaccination significantly correlated (Spearman’s rho = 0.26, p < 0.001) with some preventive behaviors; the result is supported by findings from other studies [19,20]. Therefore, the association between risk perception and engagement in preventive behaviors could be explained as follows. If the perceived risk of a certain event is high, an individual would take action to protect themself against the situation associated with the high risk. However, the analyses conducted in this study cannot provide explanations for the individuals’ choices of preventive behaviors, such as reasons why they prefer to choose using disinfectants.

4.7. Vaccine Coverage—Country-Specific Differences

The World Health Organization statistics on the anti-COVID-19 vaccination showed very low vaccination rates at the national level in Romania [2]. Even at the end of 2022, when most European countries reported vaccination rates of 80–99%, vaccine coverage in the Romanian general population was low at the country level (46.5%—as reported by the Ministry of Health and the European Center for Disease Prevention and Control (ECDC)) a phenomenon that deeply concerned the specialists in the field of public health. This was also a low coverage compared to the average (75.2%) found in 23 countries [61]. Regarding the rate per county, in Sibiu County where the study took place, the rate was not much different from the national value (41.45%). However, the vaccination percentage in psychiatric patients was 68.3% in the current study, showing a large difference compared to the national and county number. This difference is very specific to the Romanian population and contrasts with other reported coverage rates, such as those in a study on N = 1151 psychiatric patients in Belgium, where the willingness to receive a COVID-19 vaccination was found to be as high as in the general population [62] or a similar finding reported for the Danish study [63].
The large difference in the percentage of vaccination between the psychiatric population included in the study (68.3%) and the general population of Romania (40–45%) could be explained by the fact that the average age of the psychiatric population in the study is over 55 years, with most patients being included in a risk group with priority for vaccination, which was included in the first vaccination rounds when the anti-COVID-19 vaccine was available.

4.8. Psychiatric Population Peculiarities

There is one important thing to point out regarding the results of risk perception on vaccination of this special population. It is known that even for the healthy population, the perception of risk is not always clear and often cannot be strongly supported; one could wonder what the case in populations with mental health issues would be. When the perception of risk is unclear, it does not fully capture how people think about risk. Thus, those people who cannot formulate their own beliefs or cannot estimate whether they are correct are unlikely to form a perception of risk that is predictive of intentions and behaviors. We expected people with different psychiatric illnesses to show differences in risk perception, but that did not happen. This might be because perceptions of affective and experiential risk are less dependent on formulation and that can also explain why they are often stronger in predicting behavior than deliberate risk assessments [27].

4.9. Limitations

Even though low education levels were found to be associated with the prediction of a negative vaccination decision in this study, as in a recent Chinese study on vaccination coverage in psychiatric patients [64], the current study did not assess the psychological status of the patients. In addition, the Health Belief Model is not the only model that has proven useful in investigating the determinants of health-related behaviors, such as vaccination. Other studies have proposed other models, such as the COM-B model (ability, motivation, opportunity–behavior) [65] that might reveal other reliable factors of encouraging vaccination.

5. Conclusions

To conclude, the present study investigated the relationship between different cognitive and behavioral factors and the decision to vaccinate against COVID-19 on a specific vulnerable group: the psychiatric population. The study expanded the theoretical perspective in regard to the vaccination decision. There is considerable available literature concerning the vaccine hesitancy and trust issues; few studies examined the psychological factors involved in the decision-making process under uncertainty. Our study was conducted in a Romanian Psychiatric Hospital and gathered 252 psychiatric patients.
Despite some general expectations, such as having the clinical diagnosis or a previous vaccination as an influence on the decision to vaccinate, the current study’s results did not confirm these factors as reliable predictors but showed a relatively narrow configuration of factors to act as predictors. Among the seven factors considered, four cognitive factors (perceived risk, vulnerability, uncertainty, and trust in one’s decision) and three behavioral (previous vaccinations, social media use, and preventive behavior), only two revealed a significant predictive value. We found a significant relationship between the “Perceived risk of vaccination” and the choice of vaccination (χ2(2, N = 252) = 58.59, p ≤ 0.001), and between the “Trust in own decision to vaccinate” and the decision to vaccinate (χ2(2, N = 252) = 31.5, p ≤ 0.001). The model of prediction integrates the risk of vaccination and confidence in one’s choice as predictors, supported by the overall regression model.
Our results raise some points of interest in targeting possible hesitancy in vaccination decisions, which could help in directing future health strategies, for people with psychiatric disorders. The study findings show no specific determinant (either cognitive or behavioral) that weighs most in the decision to vaccinate against COVID-19, but some associated small influences that are worth further investigation in order to build on a strong motivational strategy. It is important that such factors could be addressed by therapeutic techniques (such as cognitive-behavioral, e.g., reappraisal, reframing, or contingency management) in order to increase the odds of vaccination, especially for highly vulnerable populations.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/vaccines11020441/s1, Table S1: SM_STROBE Checklist.pdf; Table S2: SM_Normality_tests.pdf; Table S3: SM_Logistic_Regression_results.pdf; Table S4: SM_TOST_correlations.pdf; Annex S1: SM_Annex S1—Questionnaire.pdf.

Author Contributions

Conceptualization, G.M.M. and M.D.B.; methodology, G.M.M., C.I.B. and A.M.R.; formal analysis, G.M.M.; investigation, G.M.M., C.I.B., R.S.F., C.T., M.D.R. and A.B., resources, C.I.B., R.S.F., C.T., M.D.R., A.B. and M.D.B.; writing—original draft preparation, G.M.M. and A.M.R.; writing—review and editing, G.M.M., C.I.B. and A.M.R.; supervision, G.M.M.; project administration, G.M.M.; funding acquisition, C.I.B. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Ministry of Research, Innovation and Digitization through Program 1—Development of the national research-development system, Subprogram 1.2—Institutional performance—Projects for financing excellence in RDI, contract no. 28 PFE/30 December 2021. Grant number C1.2.PFE-CDI.2021_563.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki and approved by the Institutional Ethics Committee of the Clinical Psychiatric Hospital “Dr. Gh. Preda” from Sibiu, Romania.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are available on request from the corresponding author.

Acknowledgments

We want to acknowledge the contributions of our technical staff, Daniela Dicu and Alexandru Henzel, and of our colleague, Claudia Anghel, that aided the efforts of the authors in data collection. We also acknowledge the contribution of our collaborator Cornel Mihali in data analysis guidance.

Conflicts of Interest

The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.

References

  1. Rosenstock, I.M. The Health Belief Model and Preventive Health Behavior. Health Educ. Behav. 1974, 2, 354–386. [Google Scholar] [CrossRef]
  2. Romania: WHO Coronavirus Disease (COVID-19) Dashboard With Vaccination Data|WHO Coronavirus (COVID-19) Dashboard With Vaccination Data. Available online: https://covid19.who.int/region/euro/country/ro/ (accessed on 6 January 2023).
  3. Blix, I.; Birkeland, M.S.; Thoresen, S. Worry and mental health in the COVID-19 pandemic: Vulnerability factors in the general Norwegian population. BMC Public Health 2021, 21, 928. [Google Scholar] [CrossRef] [PubMed]
  4. Valdés-Florido, M.J.; López-Díaz, Á.; Palermo-Zeballos, F.J.; Martínez-Molina, I.; Martín-Gil, V.E.; Crespo-Facorro, B.; Ruiz-Veguilla, M. Reactive psychoses in the context of the COVID-19 pandemic: Clinical perspectives from a case series. Rev. Psiquiatr. Salud Ment. 2020, 13, 90–94. [Google Scholar] [CrossRef] [PubMed]
  5. Mazereel, V.; Van Assche, K.; Detraux, J.; De Hert, M. COVID-19 vaccination for people with severe mental illness: Why, what, and how? Lancet Psychiatry 2021, 8, 444–450. [Google Scholar] [CrossRef]
  6. Lee, S.W.; Yang, J.M.; Moon, S.Y.; Yoo, I.K.; Ha, E.K.; Kim, S.Y.; Park, U.M.; Choi, S.; Lee, S.-H.; Ahn, Y.M.; et al. Association between mental illness and COVID-19 susceptibility and clinical outcomes in South Korea: A nationwide cohort study. Lancet Psychiatry 2020, 7, 1025–1031. [Google Scholar] [CrossRef]
  7. Maripuu, M.; Bendix, M.; Öhlund, L.; Widerström, M.; Werneke, U. Death Associated With Coronavirus (COVID-19) Infection in Individuals With Severe Mental Disorders in Sweden During the Early Months of the Outbreak-An Exploratory Cross-Sectional Analysis of a Population-Based Register Study. Front. Psychiatry 2020, 11, 609579. [Google Scholar] [CrossRef] [PubMed]
  8. Wang, Q.; Xu, R.; Volkow, N.D. Increased risk of COVID-19 infection and mortality in people with mental disorders: Analysis from electronic health records in the United States. World Psychiatry 2021, 20, 124–130. [Google Scholar] [CrossRef]
  9. Yang, H.; Chen, W.; Hu, Y.; Chen, Y.; Zeng, Y.; Sun, Y.; Ying, Z.; He, J.; Qu, Y.; Lu, D.; et al. Pre-pandemic psychiatric disorders and risk of COVID-19: A UK Biobank cohort analysis. Lancet Healthy Longev. 2020, 1, e69–e79. [Google Scholar] [CrossRef]
  10. Nemani, K.; Li, C.; Olfson, M.; Blessing, E.M.; Razavian, N.; Chen, J.; Petkova, E.; Goff, D.C. Association of Psychiatric Disorders With Mortality Among Patients With COVID-19. JAMA Psychiatry 2021, 78, 380–386. [Google Scholar] [CrossRef]
  11. Vinogradova, Y.; Coupland, C.; Hippisley-Cox, J.; Whyte, S.; Penny, C. Effects of severe mental illness on survival of people with diabetes. Br. J. Psychiatry 2010, 197, 272–277. [Google Scholar] [CrossRef]
  12. Walker, E.R.; McGee, R.E.; Druss, B.G. Mortality in mental disorders and global disease burden implications: A systematic review and meta-analysis. JAMA Psychiatry 2015, 72, 334–341. [Google Scholar] [CrossRef]
  13. De Hert, M.; Mazereel, V.; Detraux, J.; Van Assche, K. Prioritizing COVID-19 vaccination for people with severe mental illness. World Psychiatry 2021, 20, 54–55. [Google Scholar] [CrossRef] [PubMed]
  14. Bechara, A.; Martin, E.M. Impaired decision making related to working memory deficits in individuals with substance addictions. Neuropsychology 2004, 18, 152–162. [Google Scholar] [CrossRef] [PubMed]
  15. Cáceda, R.; Nemeroff, C.B.; Harvey, P.D. Toward an understanding of decision making in severe mental illness. J. Neuropsychiatry Clin. Neurosci. 2014, 26, 196–213. [Google Scholar] [CrossRef] [PubMed]
  16. Lesh, T.A.; Niendam, T.A.; Minzenberg, M.J.; Carter, C.S. Cognitive control deficits in schizophrenia: Mechanisms and meaning. Neuropsychopharmacology 2011, 36, 316–338. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  17. Simon, H.A. A Behavioral Model of Rational Choice. Q. J. Econ. 1955, 69, 99. [Google Scholar] [CrossRef]
  18. Tversky, A.; Kahneman, D. Belief in the law of small numbers. Psychol. Bull. 1971, 76, 105–110. [Google Scholar] [CrossRef] [Green Version]
  19. Borges, J.; Byrne, M. Investigating COVID-19 risk perception and preventive behaviours in third-level students in Ireland. Acta Psychol. (Amst.) 2022, 224, 103535. [Google Scholar] [CrossRef] [PubMed]
  20. Lu, P.; Kong, D.; Shelley, M. Risk Perception, Preventive Behavior, and Medical Care Avoidance among American Older Adults During the COVID-19 Pandemic. J. Aging Health 2021, 33, 577–584. [Google Scholar] [CrossRef]
  21. Trifiletti, E.; Shamloo, S.E.; Faccini, M.; Zaka, A. Psychological predictors of protective behaviours during the Covid-19 pandemic: Theory of planned behaviour and risk perception. J. Community Appl. Soc. Psychol. 2022, 32, 382–397. [Google Scholar] [CrossRef] [PubMed]
  22. Ferrer, R.; Klein, W.M. Risk perceptions and health behavior. Curr. Opin. Psychol. 2015, 5, 85–89. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  23. Loewenstein, G.F.; Weber, E.U.; Hsee, C.K.; Welch, N. Risk as feelings. Psychol. Bull. 2001, 127, 267–286. [Google Scholar] [CrossRef] [PubMed]
  24. Brewer, N.T.; Chapman, G.B.; Gibbons, F.X.; Gerrard, M.; McCaul, K.D.; Weinstein, N.D. Meta-analysis of the relationship between risk perception and health behavior: The example of vaccination. Health Psychol. 2007, 26, 136–145. [Google Scholar] [CrossRef] [Green Version]
  25. Savadori, L.; Lauriola, M. Risk Perception and Protective Behaviors During the Rise of the COVID-19 Outbreak in Italy. Front. Psychol. 2020, 11, 577331. [Google Scholar] [CrossRef]
  26. Sheeran, P.; Harris, P.R.; Epton, T. Does heightening risk appraisals change people’s intentions and behavior? A meta-analysis of experimental studies. Psychol. Bull. 2014, 140, 511–543. [Google Scholar] [CrossRef] [PubMed]
  27. Taber, J.M.; Klein, W.M.P. The role of conviction in personal disease risk perceptions: What can we learn from research on attitude strength? Soc. Personal. Psychol. Compass 2016, 10, 202–218. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  28. Caserotti, M.; Girardi, P.; Rubaltelli, E.; Tasso, A.; Lotto, L.; Gavaruzzi, T. Associations of COVID-19 risk perception with vaccine hesitancy over time for Italian residents. Soc. Sci. Med. 2021, 272, 113688. [Google Scholar] [CrossRef] [PubMed]
  29. Attema, A.E.; L’Haridon, O.; Raude, J.; Seror, V. COCONEL Group Beliefs and Risk Perceptions About COVID-19: Evidence from Two Successive French Representative Surveys during Lockdown. Front. Psychol. 2021, 12, 619145. [Google Scholar] [CrossRef] [PubMed]
  30. Wang, J.; Jing, R.; Lai, X.; Zhang, H.; Lyu, Y.; Knoll, M.D.; Fang, H. Acceptance of COVID-19 Vaccination during the COVID-19 Pandemic in China. Vaccines 2020, 8, 482. [Google Scholar] [CrossRef]
  31. Lin, C.; Tu, P.; Beitsch, L.M. Confidence and Receptivity for COVID-19 Vaccines: A Rapid Systematic Review. Vaccines 2020, 9, 16. [Google Scholar] [CrossRef] [PubMed]
  32. Shahrabani, S.; Benzion, U.; Yom Din, G. Factors affecting nurses’ decision to get the flu vaccine. Eur. J. Health Econ. 2009, 10, 227–231. [Google Scholar] [CrossRef] [PubMed]
  33. Betsch, C.; Brewer, N.T.; Brocard, P.; Davies, P.; Gaissmaier, W.; Haase, N.; Leask, J.; Renkewitz, F.; Renner, B.; Reyna, V.F.; et al. Opportunities and challenges of Web 2.0 for vaccination decisions. Vaccine 2012, 30, 3727–3733. [Google Scholar] [CrossRef] [Green Version]
  34. Puri, N.; Coomes, E.A.; Haghbayan, H.; Gunaratne, K. Social media and vaccine hesitancy: New updates for the era of COVID-19 and globalized infectious diseases. Hum. Vaccin. Immunother. 2020, 16, 2586–2593. [Google Scholar] [CrossRef] [PubMed]
  35. Yuan, X.; Schuchard, R.J.; Crooks, A.T. Examining emergent communities and social bots within the polarized online vaccination debate in twitter. Soc. Media Soc. 2019, 5, 205630511986546. [Google Scholar] [CrossRef] [Green Version]
  36. Wang, Y.; McKee, M.; Torbica, A.; Stuckler, D. Systematic Literature Review on the Spread of Health-related Misinformation on Social Media. Soc. Sci. Med. 2019, 240, 112552. [Google Scholar] [CrossRef] [PubMed]
  37. Zeballos Rivas, D.R.; Lopez Jaldin, M.L.; Nina Canaviri, B.; Portugal Escalante, L.F.; Alanes Fernández, A.M.C.; Aguilar Ticona, J.P. Social media exposure, risk perception, preventive behaviors and attitudes during the COVID-19 epidemic in La Paz, Bolivia: A cross sectional study. PLoS ONE 2021, 16, e0245859. [Google Scholar] [CrossRef]
  38. Zhang, K.C.; Fang, Y.; Cao, H.; Chen, H.; Hu, T.; Chen, Y.; Zhou, X.; Wang, Z. Behavioral Intention to Receive a COVID-19 Vaccination Among Chinese Factory Workers: Cross-sectional Online Survey. J. Med. Internet Res. 2021, 23, e24673. [Google Scholar] [CrossRef]
  39. Latkin, C.; Dayton, L.A.; Yi, G.; Konstantopoulos, A.; Park, J.; Maulsby, C.; Kong, X. COVID-19 vaccine intentions in the United States, a social-ecological framework. Vaccine 2021, 39, 2288–2294. [Google Scholar] [CrossRef]
  40. Hofmann, F.; Ferracin, C.; Marsh, G.; Dumas, R. Influenza vaccination of healthcare workers: A literature review of attitudes and beliefs. Infection 2006, 34, 142–147. [Google Scholar] [CrossRef] [PubMed]
  41. Nexøe, J.; Kragstrup, J.; Søgaard, J. Decision on influenza vaccination among the elderly. A questionnaire study based on the Health Belief Model and the Multidimensional Locus of Control Theory. Scand. J. Prim. Health Care 1999, 17, 105–110. [Google Scholar] [CrossRef]
  42. Seale, H.; Heywood, A.E.; Leask, J.; Sheel, M.; Durrheim, D.N.; Bolsewicz, K.; Kaur, R. Examining Australian public perceptions and behaviors towards a future COVID-19 vaccine. BMC Infect. Dis. 2021, 21, 120. [Google Scholar] [CrossRef]
  43. Graffigna, G.; Palamenghi, L.; Boccia, S.; Barello, S. Relationship between Citizens’ Health Engagement and Intention to Take the COVID-19 Vaccine in Italy: A Mediation Analysis. Vaccines 2020, 8, 576. [Google Scholar] [CrossRef] [PubMed]
  44. Cohen, B.; Ferng, Y.; Wong-McLoughlin, J.; Jia, H.; Morse, S.S.; Larson, E.L. Predictors of flu vaccination among urban Hispanic children and adults. J. Epidemiol. Community Health 2012, 66, 204–209. [Google Scholar] [CrossRef]
  45. Kee, S.Y.; Lee, J.S.; Cheong, H.J.; Chun, B.C.; Song, J.Y.; Choi, W.S.; Jo, Y.M.; Seo, Y.B.; Kim, W.J. Influenza vaccine coverage rates and perceptions on vaccination in South Korea. J. Infect. 2007, 55, 273–281. [Google Scholar] [CrossRef]
  46. Cevallos, M.; Egger, M. STROBE (STrengthening the Reporting of Observational studies in Epidemiology). In Guidelines for Reporting Health Research: A User’s Manual; Moher, D., Altman, D.G., Schulz, K.F., Simera, I., Wager, E., Eds.; John Wiley & Sons, Ltd.: Hoboken, NJ, USA, 2014; pp. 169–179. [Google Scholar] [CrossRef]
  47. Lakens, D. Equivalence Tests: A Practical Primer for t Tests, Correlations, and Meta-Analyses. Soc. Psychol. Personal. Sci. 2017, 8, 355–362. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  48. Lakens, D.; Scheel, A.M.; Isager, P.M. Equivalence testing for psychological research: A tutorial. Adv. Methods Pract. Psychol. Sci. 2018, 1, 259–269. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  49. Bhuiya, T.; Klares Iii, R.; Conte, M.A.; Cervia, J.S. Predictors of misperceptions, risk perceptions, and personal risk perceptions about COVID-19 by country, education and income. J. Investig. Med. 2021, 69, 1473–1478. [Google Scholar] [CrossRef] [PubMed]
  50. Reyna, V.F.; Nelson, W.L.; Han, P.K.; Dieckmann, N.F. How numeracy influences risk comprehension and medical decision making. Psychol. Bull. 2009, 135, 943–973. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  51. Strauss, G.P.; Waltz, J.A.; Gold, J.M. A review of reward processing and motivational impairment in schizophrenia. Schizophr. Bull. 2014, 40 (Suppl. 2), S107–S116. [Google Scholar] [CrossRef] [PubMed]
  52. Benke, T.; Marksteiner, J.; Ruepp, B.; Weiss, E.M.; Zamarian, L. Decision Making under Risk in Patients Suffering from Schizophrenia or Depression. Brain Sci. 2021, 11, 1178. [Google Scholar] [CrossRef]
  53. Hay, J.L.; McCaul, K.D.; Magnan, R.E. Does worry about breast cancer predict screening behaviors? A meta-analysis of the prospective evidence. Prev. Med. 2006, 42, 401–408. [Google Scholar] [CrossRef]
  54. Maddux, J.E.; Rogers, R.W. Protection motivation and self-efficacy: A revised theory of fear appeals and attitude change. J. Exp. Soc. Psychol. 1983, 19, 469–479. [Google Scholar] [CrossRef]
  55. Rogers, R.W. A protection motivation theory of fear appeals and attitude change1. J. Psychol. 1975, 91, 93–114. [Google Scholar] [CrossRef] [PubMed]
  56. Gillman, A.S.; Scharnetzki, L.; Boyd, P.; Ferrer, R.A.; Klein, W.M.P.; Han, P.K.J. Perceptions and tolerance of uncertainty: Relationship to trust in COVID-19 health information and vaccine hesitancy. J. Behav. Med. 2022, 1–14. [Google Scholar] [CrossRef]
  57. Brun, C.; Akinyemi, A.; Houtin, L.; Zerhouni, O.; Monvoisin, R.; Pinsault, N. Intolerance of Uncertainty and Attitudes towards Vaccination Impact Vaccinal Decision While Perceived Uncertainty Does Not. Vaccines 2022, 10, 1742. [Google Scholar] [CrossRef]
  58. Allington, D.; Duffy, B.; Wessely, S.; Dhavan, N.; Rubin, J. Health-protective behaviour, social media usage and conspiracy belief during the COVID-19 public health emergency. Psychol. Med. 2021, 51, 1763–1769. [Google Scholar] [CrossRef]
  59. Basch, C.H.; Zybert, P.; Reeves, R.; Basch, C.E. What do popular YouTubeTM videos say about vaccines? Child Care Health Dev. 2017, 43, 499–503. [Google Scholar] [CrossRef] [PubMed]
  60. Global Daily Social Media Usage 2022|Statista. Available online: https://www.statista.com/statistics/433871/daily-social-media-usage-worldwide/ (accessed on 5 February 2023).
  61. Lazarus, J.V.; Wyka, K.; White, T.M.; Picchio, C.A.; Rabin, K.; Ratzan, S.C.; Parsons Leigh, J.; Hu, J.; El-Mohandes, A. Revisiting COVID-19 vaccine hesitancy around the world using data from 23 countries in 2021. Nat. Commun. 2022, 13, 3801. [Google Scholar] [CrossRef]
  62. Mazereel, V.; Vanbrabant, T.; Desplenter, F.; De Hert, M. COVID-19 vaccine uptake in patients with psychiatric disorders admitted to or residing in a university psychiatric hospital. Lancet Psychiatry 2021, 8, 860–861. [Google Scholar] [CrossRef]
  63. Jefsen, O.H.; Kølbæk, P.; Gil, Y.; Speed, M.; Dinesen, P.T.; Sønderskov, K.M.; Østergaard, S.D. COVID-19 vaccine willingness amongst patients with mental illness compared with the general population. Acta Neuropsychiatr. 2021, 33, 273–276. [Google Scholar] [CrossRef] [PubMed]
  64. Qin, Y.; Zhao, Z.; Teng, Z.; Xu, B.; Wang, X.; Guo, J.; Huang, J.; Wu, H. COVID-19 vaccination coverage among patients with psychiatric disorders in China during the pandemic: A cross-sectional study. BMC Psychiatry 2022, 22, 659. [Google Scholar] [CrossRef]
  65. Michie, S. Encouraging vaccine uptake: Lessons from behavioural science. Nat. Rev. Immunol. 2022, 22, 527–528. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Schematic overview of the study’s conception. (Hypotheses are noted with “h”).
Figure 1. Schematic overview of the study’s conception. (Hypotheses are noted with “h”).
Vaccines 11 00441 g001
Figure 2. Decision to vaccinate in association with the perception of risk to vaccinate. The horizontal axis: groups of vaccinated/not vaccinated; the vertical axis: risk perception on vaccination; Higher numbers correspond to lower risk (e.g., 5 means lowest perceived risk and 1 means highest perceived risk).
Figure 2. Decision to vaccinate in association with the perception of risk to vaccinate. The horizontal axis: groups of vaccinated/not vaccinated; the vertical axis: risk perception on vaccination; Higher numbers correspond to lower risk (e.g., 5 means lowest perceived risk and 1 means highest perceived risk).
Vaccines 11 00441 g002
Figure 3. Previous voluntary vaccination and decision to vaccinate against COVID-19. The horizontal axis: groups of previously vaccinated/not vaccinated; the vertical axis: percentage of vaccinated against COVID-19.
Figure 3. Previous voluntary vaccination and decision to vaccinate against COVID-19. The horizontal axis: groups of previously vaccinated/not vaccinated; the vertical axis: percentage of vaccinated against COVID-19.
Vaccines 11 00441 g003
Table 1. Sociodemographic characteristics and decision to vaccinate, in the psychiatric population.
Table 1. Sociodemographic characteristics and decision to vaccinate, in the psychiatric population.
Cross Table for Dependent: Vaccinated
NYes (N = 172)No (N = 80)Statistical Test
SMOKER: No2500.6 107/170 (62.94%)0.7 57/80 (71.25%)X12 = 1.66, p = 0.202
AGE252 X22 = 5.85, p = 0.052
18–39 years 0.1 14/172 (8.14%)0.2 14/80 (17.5%)
40–64 years 0.6 107/172 (62.21%)0.5 40/80 (50%)
65 and above 65 years 0.3 51/172 (29.65%)0.3 26/80 (32.5%)
SEX: Female2520.6 107/172 (62.21%)0.7 53/80 (66.25%)X12 = 0.38, p = 0.542
DIAGNOSTIC238 X42 = 3.12, p = 0.542
Affective disorder 0.7 111/160 (69.38%)0.6 47/78 (60.28%)
Psychosis 0.1 19/160 (11.88%)0.2 14/78 (17.95%)
Dementia 0.0 7/160 (4.38%)0.1 6/78 (7.69%)
Addiction 0.1 10/160 (6.25%)0.1 6/78 (7.69%)
Personality disorder 0.1 10/160 (6.25%)0.1 5/78 (6.41%)
MARITAL STATUS: No1520.4 68/172 (39.53%)0.4 34/80 (42.5%)X12 = 0.20, p = 0.662
STUDIES252
Primary 0.2 35/172 (20.35%)0.5 38/80 (47.5%)
Secondary 0.6 102/172 (59.3%)0.3 28/80 (35%)
Higher 0.2 35/172 (20.35%)0.2 14/80 (17.5%)
SOCIAL MEDIA252 X42 = 0.94, p = 0.922
0 h 0.4 74/172 (43.02%)0.4 30/80 (37.5%)
Under 1 h 0.4 64/172 (37.21%)0.4 32/80 (40%)
1–3 h 0.2 31/172 (18.02%)0.2 16/80 (20%)
3–5 h 0.0 2/172 (1.16%)0.0 1/80 (1.25%)
Above 5 h 0.0 1/172 (0.58%)0.0 1/80 (1.25%)
TRUST IN SOCIAL MEDIA165 X22 = 0.18, p = 0.912
Low 0.6 67/108 (62.04%)0.6 35/57 (61.4%)
Medium 0.3 30/108 (27.78%)0.3 15/57 (26.32%)
High 0.1 11/108 (10.19%)0.1 7/57 (12.28%)
N is the number of non-missing values.
Table 2. Predictors normality test.
Table 2. Predictors normality test.
NMeanMedianSDVarianceMinimumMaximumWp
Perceived risk of vaccination2523.9874.2860.8320.6931.005.000.900<0.001 *
Perceived risk of illness2525.4125.5001.4732.1711.009.130.9900.076 *
Perceived vulnerability2525.2095.2501.7323.0001.009.250.9840.007 *
Perceived uncertainty2526.3046.5000.8060.6492.007.000.813<0.001 *
Trust in own decision2528.19010.0002.5666.5851100.732<0.001 *
Social media engagement2520.9920.5001.4041.9700.0010.500.691<0.001 *
Preventive behavior2523.7833.9170.6740.4551.505.000.971<0.001 *
* Shapiro–Wilk.
Table 3. Associations between cognitive and behavioral factors and decision to vaccinate.
Table 3. Associations between cognitive and behavioral factors and decision to vaccinate.
Cognitive and Behavioral Factorsχ2dfpε2
Perceived risk of illness6.829710.0090.02721
Perceived risk of vaccination58.58871<0.0010.23342
Perceived vulnerability0.058410.8092.33 × 10−4
Perceived uncertainty1.658410.1980.00661
Social media engagement0.521010.4700.00208
Preventive behavior1.427910.2320.00569
Cognitive factors: “perceived risk of illness/disease” and of vaccination, “Perceived personal vulnerability”, “Perceived uncertainty”. Behavioral factors: “Use of social media” and “Practicing a preventive behavior”.
Table 4. Equivalence test and effect size.
Table 4. Equivalence test and effect size.
90% Confidence Interval
EstimateLowerUpper
(1) PERC_RISK_VACCCohen’s d(av)1.220.9821.49
Raw0.9410.7561.13
Note. Denominator set to the average SD.
Table 5. Trust in one’s decision and decision to vaccinate against COVID-19.
Table 5. Trust in one’s decision and decision to vaccinate against COVID-19.
Trust in One’s Decision to VaccinateVACCINATEDTotal
YesNo
low51621
Medium262349
High14141182
Total17280252
ValueDfp
χ231.52<0.001
N = 252, Cognitive factor: “Trust in one’s belief” to vaccinate.
Table 6. Previous voluntary vaccination and decision to vaccinate against COVID-19.
Table 6. Previous voluntary vaccination and decision to vaccinate against COVID-19.
VACCINATEDTotal
Previously Vaccinated YesNo
YesObserved612081
% Within row75.3%24.7%100.0%
NoObserved11160171
% Within row64.9%35.1%100.0%
TotalObserved17280252
% Within row68.3 %31.7%100.0%
Valuedfp
χ22.7410.098
N = 252, Behavioral factor: “Former voluntary vaccination”.
Table 7. Correlation matrix of cognitive and behavioral factors.
Table 7. Correlation matrix of cognitive and behavioral factors.
Perceived Risk of IllnessPerceived Risk of VaccinationPerceived VulnerabilityPerceived UncertaintySocial Media EngagementPreventive Behavior
Perceived risk of illnessSpearman’s rho
p-value
Perceived risk of vaccinationSpearman’s rho−0.062
p-value0.330
Perceived vulnerabilitySpearman’s rho0.488 ***0.211 ***
p-value<0.001<0.001
Perceived uncertaintySpearman’s rho0.0830.0410.063
p-value0.1900.5190.318
Social media engagementSpearman’s rho−0.127 *−0.196 **−0.177 **0.076
p-value0.0440.0020.0050.230
Preventive behaviorSpearman’s rho−0.0390.259 ***0.0490.080−0.014
p-value0.539<0.0010.4390.2030.823
* p < 0.05, ** p < 0.01, *** p < 0.001.
Table 8. Correlation matrix of preventive behaviors and risk perception about vaccination.
Table 8. Correlation matrix of preventive behaviors and risk perception about vaccination.
Perceived Risk of VaccinationMaskHand GelWashing 20sAvoid CrowdsDisinfectantsSearch Info
Perceived risk of vaccinationSpearman’s rho
p-value
MaskSpearman’s rho0.002
p-value0.975
Hand GelSpearman’s rho0.214 ***0.414 ***
p-value<0.001<0.001
Washing 20sSpearman’s rho0.163 *0.447 ***0.590 ***
p-value0.010<0.001<0.001
Avoid crowdsSpearman’s rho0.152 *0.339 ***0.375 ***0.526 ***
p-value0.016<0.001<0.001<0.001
DisinfectantsSpearman’s rho0.218 ***0.138 *0.459 ***0.431 ***0.432 ***
p-value<0.0010.032<0.001<0.001<0.001
Search infoSpearman’s rho0.153 *0.1000.1250.227 ***0.308 ***0.479 ***
p-value0.0210.1310.063<0.001<0.001<0.001
* p < 0.05, *** p < 0.001.
Table 9. Regression model fit measures and coefficients.
Table 9. Regression model fit measures and coefficients.
Model Fit Measures
Overall Model Test
ModelDevianceAICMcFCSNχ2dfp
12182380.3090.3200.44997.29<0.001
Model Coefficients—VACCINATED
95% Confidence Interval
PredictorEstimateSEZpOdds RatioLowerUpper
Intercept0.60921.9800.3080.7581.8390.037989.105
(5) PREV_VACC:
No—Yes0.37070.3920.9460.3441.4490.67223.123
(4) TRUST_VACC_DEC:
Low-high2.19010.6193.540<0.0018.9362.657930.045
Medium-high1.05550.4192.5200.0122.8731.26456.529
(1) PERC_RISK_ILL0.23330.1461.6000.1101.2630.94891.680
(1) PERC_RISK_VACC−1.56390.239−6.530<0.0010.2090.13090.335
(2) PERC_VULN−0.03090.120−0.2570.7970.9700.76601.227
(3) PERC_UNCERTAIN0.15040.2090.7200.4711.1620.77191.750
(6) SOCIAL_MEDIA−0.03990.128−0.3120.7550.9610.74761.235
(7) PREV_BEHAV0.51700.2731.8950.0581.6770.98242.863
Note. Estimates represent the log odds of “VACCINATED = No” vs. “VACCINATED = Yes”.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Marcu, G.M.; Radu, A.M.; Bucuță, M.D.; Fleacă, R.S.; Tanasescu, C.; Roman, M.D.; Boicean, A.; Bacilă, C.I. Cognitive and Behavioral Factors Predicting the Decision to Vaccinate against COVID-19 in Clinical Psychiatric Population—A Cross-Sectional Survey. Vaccines 2023, 11, 441. https://doi.org/10.3390/vaccines11020441

AMA Style

Marcu GM, Radu AM, Bucuță MD, Fleacă RS, Tanasescu C, Roman MD, Boicean A, Bacilă CI. Cognitive and Behavioral Factors Predicting the Decision to Vaccinate against COVID-19 in Clinical Psychiatric Population—A Cross-Sectional Survey. Vaccines. 2023; 11(2):441. https://doi.org/10.3390/vaccines11020441

Chicago/Turabian Style

Marcu, Gabriela Mariana, Ana Maria Radu, Mihaela Dana Bucuță, Radu Sorin Fleacă, Ciprian Tanasescu, Mihai Dan Roman, Adrian Boicean, and Ciprian Ionuț Bacilă. 2023. "Cognitive and Behavioral Factors Predicting the Decision to Vaccinate against COVID-19 in Clinical Psychiatric Population—A Cross-Sectional Survey" Vaccines 11, no. 2: 441. https://doi.org/10.3390/vaccines11020441

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop