Next Article in Journal
Phonological Awareness as the Foundation of Reading Acquisition in Students Reading in Transparent Orthography
Previous Article in Journal
Effectiveness of a Multicomponent Group Psychological Intervention Program in Patients with Inflammatory Bowel Disease: A Randomized Trial
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Time Waits for No One: Longitudinal Study on the Effects of an Anti-Stigma Seminar on the Psychology Student Population

1
Department of Biomedical, Metabolic and Neural Sciences, Università degli Studi di Modena e Reggio Emilia, 41125 Modena, Italy
2
Department of Health Professions, Azienda USL—IRCCS di Reggio Emilia, 42122 Reggio Emilia, Italy
3
Department of Mental Health, Azienda USL—IRCCS di Reggio Emilia, 42122 Reggio Emilia, Italy
4
Care Policy Evaluation Centre, London School of Economics and Political Science, London WC2A 2AE, UK
5
Centre for Global Mental Health, Institute of Psychiatry, Psychology and Neuroscience, King’s College London, London SE5 8AF, UK
6
Department of Medicine and Surgery, University of Parma, 43125 Parma, Italy
7
Department of Humanities, Social Sciences and Cultural Industries, University of Parma, 43121 Parma, Italy
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2021, 18(10), 5441; https://doi.org/10.3390/ijerph18105441
Submission received: 28 April 2021 / Revised: 14 May 2021 / Accepted: 15 May 2021 / Published: 19 May 2021
(This article belongs to the Section Mental Health)

Abstract

:
The primary aim is to describe the changes in the knowledge of mental health conditions, the attitudes toward the mentally ill, and the intended behaviour towards people with mental illness among the entire student population of the third year of a degree course in Psychology. A total of 570 students attended a seminar on stigma towards mental illness and were invited to complete an online survey which collected data on sociodemographic characteristics and three validated questionnaires evaluating different aspects of stigma at three different time points (pre-intervention, post-intervention, and at one year follow up). A total of 253 students (44.39%) completed the questionnaires at t0, t1, and t2. The mean age of the sample was 23.7 (SD = ±5.89), and 86.96% (n = 220) were females. Between t0 and t1, a statistically significant improvement was observed for all three outcomes, while the intended behaviour outcome was no longer significant between t1 and t2 (Z = −0.70; p = 0.48). Females and who participated live at the seminar maintained a significant knowledge of mental illness and a better attitude toward community mental health care. The effects of the seminar focused on reducing stigma tended to diminish over time at one year follow-up, particular in relation to intended behaviour.

1. Introduction

In 1963, the American sociologist Goffman used the term “stigma” to indicate those attributes (ethnic, religious, physical, etc.) that connoted those who owned them as “... tainted, discounted one” [1]. Goffman’s first definition, thanks to the advances highlighted in the research, was further developed by Link and Phelan, who described the constituent components of the stigma process: labelling, stereotyping separation, status loss, and discrimination [2,3].
Lack of knowledge generates stereotypes that are assimilated and considered as truthful by the general population (mental health literacy). Agreement with the stereotype can result in a particular attitude, for example, fear of whether people with a mental illness are considered dangerous or capable of violent actions. The emotional experience ultimately leads to discriminatory behaviours, such as requiring that people with mental illness be locked up in institutions (asylums) that isolate them from society [4,5,6].
Besides the already mentioned public stigma, other types of stigma related to mental illness have been described in the literature: structural stigma, self-stigma, felt or perceived stigma, experienced stigma, label avoidance, courtesy stigma, and spiritual stigma [3,7,8].
The phenomenon of stigma towards mental illness generates dramatic consequences made evident by a number of studies. For example, stigma is the first obstacle to seeking help from mental health professionals [9,10,11,12], and it can lead from a decrease of autonomy and self-efficacy [13] to a worsening of the psychopathological condition and even to suicidal behaviours [14,15]: The World Health Organization (WHO) identified general stigma toward those with mental illness as the greatest barrier to effective psychiatric patient care [16]. Of all the consequences of stigma, those affecting social relations are the most dramatic: feelings of shame, social isolation, and difficulties with personal relationships. Finally, stigma is a barrier to achieving life goals, such as having a job, living alone independently, having a stable emotional relationship, or completing education [6,17,18,19,20].
Healthcare professionals and especially mental health workers can be both victims and perpetrators of stigmatizing attitudes. An interesting paper by Bhugra and colleagues [21] described, for example, how psychiatrists and psychiatric patients have always been stigmatized against. Several studies have shown that medical students do not believe that psychiatry is a medical discipline or that it is less scientific and precise than the others [22,23]. However, evidence in the literature also shows how mental health service users have experienced discriminatory attitudes from general practitioners and health professionals [24]. Nordt and colleagues showed that psychiatrists have more negative stereotypes than the general population and that there are no substantial differences between the social distance maintained by mental health professionals and the general population [6,25].
In order to define the presence and to fight stigmatizing attitudes in health professionals, several studies were conducted with the involvement of undergraduate students in health degree courses: psychology students [16,26,27], nursing students [28,29,30], medical students [31], and general mental health professional students [20].
The first aim of this longitudinal study was to describe the changes over time in the knowledge of mental disorders, the attitudes toward people who are mentally ill, and the intended behaviour towards people with mental illness in the entire student population of the third year of the degree course in Psychology of the Inter-University of Parma with Modena and Reggio Emilia after attending a Clinical Psychology course including a seminar on stigma towards mental illness. Secondly, we investigated whether changes in stigma outcomes differed for certain subpopulations: males and females, students who attended lessons in person vs. those who attended virtually, and students who had/did not have a first- or second-degree relative with a mental illness.
Based on previous studies [32,33,34] that underlined how the evidence is not homogeneous about the effectiveness of educational strategies especially regarding the maintenance of the effect over time, we hypothesized that: the seminar would have an immediate positive impact (reduction of stigma in behaviour and attitude and increase of knowledge between t0 and t1) in the student population; however, the benefit would not remain stable over time, with a reduction between t1 and t2.

2. Materials and Methods

2.1. Sample and Intervention

For two consecutive academic years (A.Y.) (2018/2019 and 2019/2020), the students in the third year of the inter-university degree course in Psychology (University of Parma and University of Modena and Reggio Emilia) (n = 300 in 2018/2019; n = 270 in 2019/2020) were invited to complete an online survey that collected data on sociodemographic characteristics and validated stigma outcomes related to knowledge, attitudes, and intended stigmatising behaviour.
Participants completed the survey at three different time points: two weeks prior to the start of the Clinical Psychology lectures; in the time window between 80 and 150 days after the end of the Clinical Psychology lectures; and in the time window between 240 and 330 days from the second compilation. The Clinical Psychology course is around 64 h and includes a 4-h seminar on stigma towards mental illness (including information on definitions and classifications, strategies to fight stigma, psychometric tools, and international campaigns against stigma). Our sample size calculation suggested that we needed 230 participants to complete the study based on a total population of 570 students and considering 5% as margin of error (confidence level: 95%).

2.2. Sociodemographic Information and Stigma Questionnaire

Students who agreed to fill in the questionnaires were asked for the following socio-demographic information: gender, age, class participation (face to face or remotely), having already participated in stigma awareness events, and having first- and second-degree relatives who have/had a mental illness.
The online survey comprised three validated psychometric questionnaires. The Italian version of the Mental Health Knowledge Schedule (MAKS-I) [35,36] is a self-administered questionnaire composed of 12 items scored on a Likert scale (from 1: “Strongly Disagree” to 5: “Strongly Agree”). “Don’t know” is coded as neutral (value of 3) according to the scoring guidelines. The MAKS-I questionnaire is categorised into two parts. The first six statements can be summed into a total score representing stigma-related mental health knowledge (the higher the score, the greater the knowledge of mental illness). Items from 7 to 12 assess recognition and familiarity with six different conditions.
The CAMI Scale (community attitudes to mentally illness) refers to attitudes towards people who are mentally ill. Participants rate the 27 statements from 1, “Strongly Disagree”, to 5, “Strongly Agree”, and a high score corresponds with positive attitude [37,38,39].
The Italian version of the Reported and Intended Behaviour Scale (RIBS) is a self-administered questionnaire composed of eight items evaluating reported and intended behaviours across four different domains: (1) living with, (2) working with, (3) living nearby, and (4) continuing a relationship with someone with a mental health problem. The total intended behaviour score is calculated by summing the answers for items five through eight. A higher score indicates a higher level of intended behaviour and/or contact with someone with a mental health problem [40,41].

2.3. Statistical Analysis

The interval variables were described using means and standard deviations (SDs), and the categorical and ordinal variables were described using frequencies and percentages. Homogeneity test between students of the two A.Y. were carried out through Mann–Whitney U test for interval variables and chi-square test for ordinal, categorial, and nominal variables [42].
The Shapiro–Wilk Test was used to verify if the scores obtained on the questionnaires have a normal distribution [43]. To verify the change over time of the scores obtained in the three questionnaires, the Friedman test as a non-parametric statistical test was used [44]. The comparison in the sub-populations was carried out using the Wilcoxon test [45].

3. Results

Of the 570 students contacted, 302 (52.98%) agreed to be involved in the study, and 253 (44.39%) completed the questionnaires at t0, t1, and t2. The mean age of the sample was 23.74 (SD = ±5.89), and 86.96% (n = 220) was female. Only 40 students (15.81%) had already participated in stigma awareness events, while 25.30% (64) have/had a first- or second-degree relative with a psychiatric disorder (n = 64; 25.30%). The homogeneity test failed only for the age variable (24.78 ± 6.18 vs. 22.94 ± 5.55; p < 0.001). The sociodemographic characteristics of the sample and the test of homogeneity are described in Table 1.
Due to the high difference in the representation of males vs. females, it was considered appropriate to run the analysis of subgroups as a sensitivity analysis.
Table 2 describes changes in stigma-related mental health knowledge (MAKS-I), community attitudes to mental illness (CAMI), and the intended behaviour towards people with mental illness (RIBS-I) at pre (t0), post (t1), and one year follow-up (t2) time points. Between t0 and t1, a statistically significant improvement was observed for all three outcomes. There was no significant change between t1 and t2 in intended behaviour (Z = −0.70; p = 0.48): the percentage of those who obtained a higher score and those who obtained the same score with respect to t0 are almost the same (n = 89; 35.89% vs. n = 87; 35.08%). Through the Friedman test, a statistically significant improvement was highlighted for all questionnaire scores in repeated measurements at t0, t1, and t2. (MAKS-I: Χ2 = 85.46; df = 2; p < 0.001—CAMI: Χ2 = 195.59; df = 2; p < 0.001—RIBS-I: Χ2 = 83.99; df = 2; p < 0.001).
Both the male and female subpopulations (Table 3) had a statistically significant improvement between t0 and t1. From the comparison between t1 and t2, for the male subpopulation, an improvement emerged for the three questionnaires, but it was not statistically significant. For the female subpopulation, there was a statistically significant improvement only for stigma-related mental health knowledge (MAKS-I) (Z = −2.16; p < 0.001) and attitudes (CAMI) (Z = −3.10; p = 0.002). For both subpopulations, there was a statistically significant improvement for all questionnaires considering the repeated measures at t0, t1, and t2.
Both students attending face-to-face lectures in the classroom and those attending virtual lectures had a statistically significant improvement between t0 and t1 in all three stigma outcomes. There was no statistically significant improvement between t1 and t2 among those attending in person or virtually and regarding intended behaviour towards people with mental illness (Classroom: Z = −0.72, p = 0.47; Distance learning: Z = −0.14, p = 0.89). Students who attended the remote frequency (RF) course did not experience a statistically significant improvement between t1 and t2 in the stigma-related knowledge of mental disorders (Z = −1.29; p = 0.20) or attitudes (Z = −0.37; p = 0.71). Trends over time of MAKS-I, CAMI, and RIBS-I for students who attended in the classroom and those in distance learning are described in Table 4.
A statistically significant improvement from t0 to t1 was observed both among those who have/had a first- or second-degree relative with a psychiatric disorder and among those who did not. Between t1 and t2, there was only a statistically significant improvement in attitudes among those who have/do not have a relative with a psychiatric disorder. For both subpopulations, there was a statistically significant improvement for all stigma outcomes (knowledge, attitude, and behaviour) considering the repeated measures at t0, t1, and t2.

4. Discussion

Before proceeding with the discussion of the results obtained, we describe the limitations that characterize this study. First, the homogeneity test failed by comparing the gender of the student population of the two academic years (A.Y. 2018/2019 and 2019/2020): the percentage of female students is slightly higher in the A.Y. 2019/2020 (89.51% vs. 92.64%). Furthermore, the number of males and females is very different; therefore, the results obtained must be compared with those in the literature with caution. The questionnaires validated in the Italian language used in this study provided decidedly good psychometric qualities in the previous validation processes [36,41]; however, it is necessary to take their results carefully as there are still few studies regarding their reliability and validity. Finally, the number of students who completed the study is sufficient (253 compared to the 230 requested), but a response rate of 44.39% can hide some critical issues: probably the most motivated students participated in the study, while the data relative to the less interested or more stigmatizing ones, we could hypothesize, did not appear in the study. Despite the limitations, we believe that there are results worthy of attention and discussion.
We found that, for the entire students’ populations, intended stigmatising behaviour improved statistically significantly only between t0 and t1. Several studies in the literature have shown that non-stigmatizing effects on behaviour of anti-stigma interventions reduce over time: Evans-Lacko and colleagues, evaluating a brief anti-stigma campaign (pre, during, and post), described how there were not evident improvements for attitudinal or behavioural elements [46]. Even in anti-stigma campaigns (e.g., “Time to Change”), it has been verified that, despite the efforts made, there was no significant improvement in behaviour among the general public population [47].
In the results of the trend over time in subpopulations (male vs. female, Table 3; classroom vs. distance learning, Table 4; having or not a first- or second-degree relative with a psychiatric disorder, Table 5), it emerges with even greater clarity that the effectiveness of the anti-stigma activity tends to decrease over time: all the evaluations between t0 and t1 are positive and statistically significant; in the comparison between t1 and t2, change is always positive (less stigma) but rarely statistically significant. We can hypothesize that, over time, the anti-stigma activity loses its effectiveness, and we could therefore speak of a dose effect: the anti-stigma activity leads to short-term benefits, but its effect tends to fade over time as already described in the literature [48].
By analysing the results over time in the different subpopulations, it appears that the female population, unlike the male population, maintains a significant knowledge of mental illness and a better attitude toward people who are mentally ill. This finding may have been affected by the differential representation of female vs. male subjects in the study population. The results obtained from this study are congruent with literature: females tend to have greater knowledge of mental illness [12,49,50] and more positive attitudes [15]. Studies on populations of university students also seem to confirm this: Rafal and colleagues [51], for example, described how college men are less likely to correctly identify depression, anxiety, and severe stress. Another study described how male psychology students have a higher level of stigmatizing attitudes than the female population [26].
As described in the systematic review conducted by Janoušková and colleagues [52], anti-stigma strategies carried out using video interventions (e.g., an interview with a person with mental illness in recovery) showed improvements in stigmatising attitudes and appeared to be more effective than other interventions, such as classical face-to-face educational sessions or simulation of hallucinations. In particular, the effectiveness of video-based contact interventions have been shown to be particularly effective: adding a video-based contact can significantly improve program effectiveness when presented following a lesson; short video contact intervention also reduced stigma in a sample of nursing students [53]. In our study, the difference between attending the stigma seminar in the classroom or seeing it recorded online was described. Our data seem to favour the presence in classroom because, comparing second and third assessment (t1–t2), there was a non-significant improvement (the percentage of participants who obtained a score at t2 higher than that obtained at t1 is always greater than that of those who obtained a lower score) in all three questionnaires in the virtual group while, for the students in the classroom, a statistically significant improvement remained for knowledge of mental disorders and attitudes toward people who are mentally ill. Our results, therefore, seem not to confirm what is described in literature: for example, Clements and colleagues [54] described that DVD and live interventions were equally effective and interventions with social contact (DVD/live) were more effective than the lecture alone (which also does not provide for social contact). We can hypothesize that the difference can be that the recorded lesson was not designed for this purpose but only to allow the working students to attend the event.
In the literature, there are several studies that demonstrate that contact is the preferred strategy in the fight against stigma [6,55]. As described by Pettigrew and Tropp [56], intergroup contact typically reduces intergroup prejudice: the meta-analysis results suggest that greater intergroup contact is generally associated with lower levels of prejudice. The literature is more mixed about the association between having a family member with a mental illness and stigmatizing attitudes. For example, Gonzales-Sanguino and colleagues [16] highlighted how greater implicit stigma was found in people who had a family member with a psychiatric diagnosis, while Korszun and colleagues [31] described that fewer stigmatizing attitudes are associated with personal experience of mental health treatment or that among family and friends. In a previous study that considered a psychology student population [35], we found that there was no association between having a family member with a mental health problem and knowledge of different clinical conditions. In the population of psychology students of this study, minimal differences in t0 scores were found between the different subpopulations (having/not having a family member with a psychiatric disorder) for MAKS-I and RIBS-I. Even between t1 and t2, only those who had no family member with a mental illness showed a statistically significant improvement.

5. Conclusions

The fight against stigma is undoubtedly one of the priority goals of mental health. In this study that involved psychology students, despite the limitations described, it was possible to identify the positive effects of a seminar on stigma, but these tended to reduce over time. Furthermore, it is emphasized that interventions must always be evaluated in the respective subpopulations to have more reliable and useful results. In order to overcome the problem of the reduction over time of sensitivity to the theme of stigma following anti-stigma initiatives, it is important to undertake new research aiming to evaluate activities that can be repeated over time (annual seminars) with an increasing involvement of peer-workers and with increasing accessibility (web, social networks, and distance learning).

Author Contributions

Conceptualization, L.P. and C.F.; methodology, L.P., S.E.-L., and A.M.; investigation, M.F., M.L., and T.M.; data curation, M.L.; writing—original draft preparation, L.P., G.M.G., A.M., and C.F.; writing—review and editing, L.P., S.E.-L., S.C., S.F., M.F., G.M.G., M.L., T.M., A.M., A.M.N., and C.F. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

According to the Internal Review Board, the ethical approval for this study was not necessary because it did not involve cases nor patients: the questionnaires used were administered to general population and do not produce diagnosis nor allow the definition of psychopathological conditions. Detailed information on the study was given to each participant, and consent was asked also for processing of personal data. The authors assert that all procedures contributing to this work comply with the ethical standards of the relevant national and institutional committees on human experimentation and with the Helsinki Declaration of 1975, as revised in 2008.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

All data used for this study are available upon request by the corresponding author.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Goffman, E. Stigma: Notes on the Management of Spoiled Identity; A Touchstone Book; 26th pr.; Simon & Schuster: New York, NY, USA, 1986; ISBN 978-0-671-62244-2. [Google Scholar]
  2. Link, B.G.; Phelan, J.C. Conceptualizing Stigma. Annu. Rev. Sociol. 2001, 27, 363–385. [Google Scholar] [CrossRef]
  3. Evans-Lacko, S.; Gronholm, P.C.; Hankir, A.; Pingani, L.; Corrigan, P. Practical strategies to fight stigma in mental health. In Psychiatry in Practice; Oxford University Press (OUP): Oxford, UK, 2016; pp. 237–256. [Google Scholar]
  4. Thornicroft, G. Stigma and discrimination limit access to mental health care. Epidemiol. Psichiatr. Soc. 2008, 17, 14–19. [Google Scholar] [CrossRef] [Green Version]
  5. Corrigan, P.W.; Shapiro, J.R. Measuring the impact of programs that challenge the public stigma of mental illness. Clin. Psychol. Rev. 2010, 30, 907–922. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  6. Schafer, T.; Wood, S.; Williams, R. A survey into student nurses’ attitudes towards mental illness: Implications for nurse training. Nurse Educ. Today 2011, 31, 328–332. [Google Scholar] [CrossRef] [PubMed]
  7. Angermeyer, M.C.; Schulze, B.; Dietrich, S. Courtesy stigma. Soc. Psychiatry Psychiatr. Epidemiol. 2003, 38, 593–602. [Google Scholar] [CrossRef] [PubMed]
  8. Pingani, L.; Giberti, S.; Coriani, S.; Ferrari, S.; Fierro, L.; Mattei, G.; Nasi, A.M.; Pinelli, G.; Wesselmann, E.D.; Galeazzi, G.M. Translation and Validation of an Italian Language Version of the Religious Beliefs and Mental Illness Stigma Scale (I-RBMIS). J. Relig. Heal. 2021, 1–15. [Google Scholar] [CrossRef]
  9. Gulliver, A.; Griffiths, K.M.; Christensen, H. Perceived barriers and facilitators to mental health help-seeking in young people: A systematic review. BMC Psychiatry 2010, 10, 113. [Google Scholar] [CrossRef] [Green Version]
  10. Corrigan, P.W.; Druss, B.G.; Perlick, D.A. The Impact of Mental Illness Stigma on Seeking and Participating in Mental Health Care. Psychol. Sci. Public Interes. 2014, 15, 37–70. [Google Scholar] [CrossRef] [Green Version]
  11. Choudhry, F.R.; Mani, V.; Ming, L.C.; Khan, T.M. Beliefs and perception about mental health issues: A meta-synthesis. Neuropsychiatr. Dis. Treat. 2016, 12, 2807–2818. [Google Scholar] [CrossRef] [Green Version]
  12. Fekih-Romdhane, F.; Chebbi, O.; Sassi, H.; Cheour, M. Knowledge, attitude and behaviours toward mental illness and help-seeking in a large nonclinical Tunisian student sample. Early Interv. Psychiatry 2020, 13080. [Google Scholar] [CrossRef]
  13. Corrigan, P.W.; Larson, J.E.; Rüsch, N. Self-stigma and the “why try” effect: Impact on life goals and evidence-based practices. World Psychiatry 2009, 8, 75–81. [Google Scholar] [CrossRef]
  14. Thornicroft, G. Physical health disparities and mental illness: The scandal of premature mortality. Br. J. Psychiatry 2011, 199, 441–442. [Google Scholar] [CrossRef] [Green Version]
  15. Ferrari, S.; Bressi, C.; Busnelli, E.; Mattei, G.; Pozzoli, S.; Oliva, A.; Galeazzi, G.M.; Pingani, L. Stigma on Mental Health among High School Students: Validation of the Italian Version of the Attribution Questionnaire-27 (AQ-27-I) in a High School Student Population. Int. J. Environ. Res. Public Heal. 2020, 17, 5207. [Google Scholar] [CrossRef] [PubMed]
  16. González-Sanguino, C.; Muñoz, M.; Castellanos, M.A.; Pérez-Santos, E.; Orihuela-Villameriel, T. Study of the relationship between implicit and explicit stigmas associated with mental illness. Psychiatry Res. 2019, 272, 663–668. [Google Scholar] [CrossRef]
  17. Thornicroft, G. Actions Speak Louder: Tackling Discrimination against People with Mental Illness; Mental Health Foundation: London, UK, 2006; ISBN 978-1-903645-80-2. [Google Scholar]
  18. Evans-Lacko, S.; Courtin, E.; Fiorillo, A.; Knapp, M.; Luciano, M.; Park, A.-L.; Brunn, M.; Byford, S.; Chevreul, K.; Forsman, A.K.; et al. The state of the art in European research on reducing social exclusion and stigma related to mental health: A systematic mapping of the literature. Eur. Psychiatry 2014, 29, 381–389. [Google Scholar] [CrossRef]
  19. Boudewyns, V.; Himelboim, I.; Hansen, D.L.; Southwell, B.G. Stigma’s Effect on Social Interaction and Social Media Activity. J. Heal. Commun. 2015, 20, 1337–1345. [Google Scholar] [CrossRef]
  20. Pingani, L.; Catellani, S.; Del Vecchio, V.; Sampogna, G.; Ellefson, S.E.; Rigatelli, M.; Fiorillo, A.; Evans-Lacko, S.; Corrigan, P.W. Stigma in the context of schools: Analysis of the phenomenon of stigma in a population of university students. BMC Psychiatry 2016, 16, 29. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  21. Bhugra, D.; Sartorius, N.; Fiorillo, A.; Evans-Lacko, S.; Ventriglio, A.; Hermans, M.; Vallon, P.; Dales, J.; Racetovic, G.; Samochowiec, J.; et al. EPA guidance on how to improve the image of psychiatry and of the psychiatrist. Eur. Psychiatry 2015, 30, 423–430. [Google Scholar] [CrossRef]
  22. Farooq, K.; ISOSCCIP Group; Lydall, G.J.; Malik, A.; Ndetei, D.M.; Bhugra, D. Why medical students choose psychiatry-a 20 country cross-sectional survey. BMC Med. Educ. 2014, 14, 12. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  23. Fiorillo, A.; Malik, A.; Luciano, M.; Del Vecchio, V.; Sampogna, G.; Del Gaudio, L.; Kuzman, M.R.; Jovanovic, N.; Nawka, A.; Volpe, U. Challenges for trainees in psychiatry and early career psychiatrists. Int. Rev. Psychiatry 2013, 25, 431–437. [Google Scholar] [CrossRef]
  24. Pranckeviciene, A.; Žardeckaitė-Matulaitienė, K.; Markšaitytė, R.; Endriulaitienė, A.; Tillman, D.R.; Hof, D.D. Social distance in Lithuanian psychology and social work students and professionals. Soc. Psychiatry Psychiatr. Epidemiol. 2018, 53, 849–857. [Google Scholar] [CrossRef]
  25. Nordt, C.; Rössler, W.; Lauber, C. Attitudes of Mental Health Professionals Toward People with Schizophrenia and Major Depression. Schizophr. Bull. 2005, 32, 709–714. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  26. Zaninotto, L.; Qian, J.; Sun, Y.; Bassi, G.; Solmi, M.; Salcuni, S. Gender, Personality Traits and Experience With Psychiatric Patients as Predictors of Stigma in Italian Psychology Students. Front. Public Heal. 2018, 6, 362. [Google Scholar] [CrossRef] [PubMed]
  27. Pingani, L.; Coriani, S.; Galeazzi, G.M.; Nasi, A.M.; Franceschini, C. Can stigmatizing attitudes be prevented in psychology students? J. Ment. Heal. 2020, 1–6. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  28. Liu, W. Recognition of, and beliefs about, causes of mental disorders: A cross-sectional study of US and Chinese undergraduate nursing students. Nurs. Heal. Sci. 2018, 21, 28–36. [Google Scholar] [CrossRef] [PubMed]
  29. Hawthorne, A.; Fagan, R.; Leaver, E.; Baxter, J.; Logan, P.; Snowden, A. Undergraduate nursing and midwifery student’s attitudes to mental illness. Nurs. Open 2020, 7, 1118–1128. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  30. Martin, A.; Krause, R.; Chilton, J.; Jacobs, A.; Amsalem, D. Attitudes to psychiatry and to mental illness among nursing students: Adaptation and use of two validated instruments in preclinical education. J. Psychiatr. Ment. Heal. Nurs. 2019, 27, 308–317. [Google Scholar] [CrossRef]
  31. Korszun, A.; Dinos, S.; Bhui, K.; Korszun, A.; Ahmed, K. Medical Student Attitudes About Mental Illness: Does Medical-School Education Reduce Stigma? Acad. Psychiatry 2012, 36, 197–204. [Google Scholar] [CrossRef]
  32. Griffiths, K.M.; Carron-Arthur, B.; Parsons, A.; Reid, R. Effectiveness of programs for reducing the stigma associated with mental disorders. A meta-analysis of randomized controlled trials. World Psychiatry 2014, 13, 161–175. [Google Scholar] [CrossRef]
  33. Corrigan, P.; Michaels, P.J.; Morris, S. Do the Effects of Antistigma Programs Persist Over Time? Findings from a Meta-Analysis. Psychiatr. Serv. 2015, 66, 543–546. [Google Scholar] [CrossRef]
  34. Corrigan, P.W.; Morris, S.B.; Michaels, P.J.; Rafacz, J.D.; Rüsch, N. Challenging the Public Stigma of Mental Illness: A Meta-Analysis of Outcome Studies. Psychiatr. Serv. 2012, 63, 963–973. [Google Scholar] [CrossRef] [PubMed]
  35. Pingani, L.; Sampogna, G.; Evans-Lacko, S.; Gozzi, B.; Giallonardo, V.; Luciano, M.; Galeazzi, G.M.; Fiorillo, A. How to Measure Knowledge About Mental Disorders? Validation of the Italian Version of the MAKS. Community Ment. Heal. J. 2019, 55, 1354–1361. [Google Scholar] [CrossRef] [PubMed]
  36. Evans-Lacko, S.; Little, K.; Meltzer, H.; Rose, D.; Rhydderch, D.; Henderson, C.; Thornicroft, G. Development and Psychometric Properties of the Mental Health Knowledge Schedule. Can. J. Psychiatry 2010, 55, 440–448. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  37. Taylor, S.M.; Dear, M.J. Scaling Community Attitudes Toward the Mentally Ill. Schizophr. Bull. 1981, 7, 225–240. [Google Scholar] [CrossRef] [Green Version]
  38. Buizza, C.; Pioli, R.; Ponteri, M.; Vittorielli, M.; Corradi, A.; Minicuci, N.; Rossi, G. Community attitudes towards mental illness and socio-demographic characteristics: An Italian study. Epidemiol. Psichiatr. Soc. 2005, 14, 154–162. [Google Scholar] [CrossRef]
  39. Rüsch, N.; Evans-Lacko, S.E.; Henderson, C.; Flach, C.; Thornicroft, G. Knowledge and Attitudes as Predictors of Intentions to Seek Help for and Disclose a Mental Illness. Psychiatr. Serv. 2011, 62, 675–678. [Google Scholar] [CrossRef]
  40. Pingani, L.; Evans-Lacko, S.; Luciano, M.; Del Vecchio, V.; Ferrari, S.; Sampogna, G.; Croci, I.; Del Fatto, T.; Rigatelli, M.; Fiorillo, A. Psychometric validation of the Italian version of the Reported and Intended Behaviour Scale (RIBS). Epidemiol. Psychiatr. Sci. 2015, 25, 485–492. [Google Scholar] [CrossRef]
  41. Evans-Lacko, S.; Rose, D.; Little, K.; Flach, C.; Rhydderch, D.; Henderson, C.; Thornicroft, G. Development and psychometric properties of the Reported and Intended Behaviour Scale (RIBS): A stigma-related behaviour measure. Epidemiol. Psychiatr. Sci. 2011, 20, 263–271. [Google Scholar] [CrossRef]
  42. Zar, J.H. Biostatistical Analysis; Pearson Education, Inc.: Upper Saddle River, NJ, USA, 2018; ISBN 978-0-13-499544-1. [Google Scholar]
  43. Shapiro, S.S.; Wilk, M.B. An Analysis of Variance Test for Normality (Complete Samples). Biomes 1965, 52, 591. [Google Scholar] [CrossRef]
  44. Friedman, M. The Use of Ranks to Avoid the Assumption of Normality Implicit in the Analysis of Variance. J. Am. Stat. Assoc. 1937, 32, 675–701. [Google Scholar] [CrossRef]
  45. Kraska-Miller, M. Nonparametric Statistics for Social and Behavioral Sciences; Apple Academic Press: Treasure Island, FL, USA, 2013. [Google Scholar]
  46. Evans-Lacko, S.; London, J.; Little, K.; Henderson, C.; Thornicroft, G. Evaluation of a brief anti-stigma campaign in Cambridge: Do short-term campaigns work? BMC Public Heal. 2010, 10, 339. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  47. Smith, M. Anti-stigma campaigns: Time to change. Br. J. Psychiatry 2013, 202, s49–s50. [Google Scholar] [CrossRef] [Green Version]
  48. Evans-Lacko, S.; Corker, E.; Williams, P.; Henderson, C.; Thornicroft, G. Effect of the Time to Change anti-stigma campaign on trends in mental-illness-related public stigma among the English population in 2003–13: An analysis of survey data. Lancet Psychiatry 2014, 1, 121–128. [Google Scholar] [CrossRef] [Green Version]
  49. Angermeyer, M.C.; Matschinger, H.; Holzinger, A. Gender and attitudes towards people with schizophrenia. Results of a representative survey in the Federal Republic of Germany. Int. J. Soc. Psychiatry 1998, 44, 107–116. [Google Scholar] [CrossRef] [PubMed]
  50. Evans-Lacko, S.; Henderson, C.; Thornicroft, G. Public knowledge, attitudes and behaviour regarding people with mental illness in England 2009–2012. Br. J. Psychiatry 2013, 202, s51–s57. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  51. Rafal, G.; Gatto, A.; DeBate, R. Mental health literacy, stigma, and help-seeking behaviors among male college students. J. Am. Coll. Heal. 2018, 66, 284–291. [Google Scholar] [CrossRef] [PubMed]
  52. Janoušková, M.; Tušková, E.; Weissová, A.; Trančík, P.; Pasz, J.; Evans-Lacko, S.; Winkler, P. Can video interventions be used to effectively destigmatize mental illness among young people? A systematic review. Eur. Psychiatry 2017, 41, 1–9. [Google Scholar] [CrossRef] [PubMed]
  53. Winkler, P.; Janoušková, M.; Kožený, J.; Pasz, J.; Mladá, K.; Weissová, A.; Tušková, E.; Evans-Lacko, S. Short video interventions to reduce mental health stigma: A multi-centre randomised controlled trial in nursing high schools. Soc. Psychiatry Psychiatr. Epidemiol. 2017, 52, 1549–1557. [Google Scholar] [CrossRef]
  54. Clement, S.; Van Nieuwenhuizen, A.; Kassam, A.; Flach, C.; Lazarus, A.; De Castro, M.; McCrone, P.; Norman, I.; Thornicroft, G. Filmed v. live social contact interventions to reduce stigma: Randomised controlled trial. Br. J. Psychiatry 2012, 201, 57–64. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  55. Corrigan, P.W.; River, L.P.; Lundin, R.K.; Penn, D.L.; Uphoff-Wasowski, K.; Campion, J.; Mathisen, J.; Gagnon, C.; Bergman, M.; Goldstein, H.; et al. Three Strategies for Changing Attributions about Severe Mental Illness. Schizophr. Bull. 2001, 27, 187–195. [Google Scholar] [CrossRef] [Green Version]
  56. Pettigrew, T.F.; Tropp, L.R. A meta-analytic test of intergroup contact theory. J. Pers. Soc. Psychol. 2006, 90, 751–783. [Google Scholar] [CrossRef] [PubMed] [Green Version]
Table 1. Sociodemographic characteristics of the sample and verification of the homogeneity.
Table 1. Sociodemographic characteristics of the sample and verification of the homogeneity.
Mean ± SDHomogeneity
Total sampleAcademic Year 2018/2019Academic Year 2019/2020Mann–Whitney U test
Age23.74 ± 5.8924.78 ± 6.1822.94 ± 5.55p < 0.001
n (%)Homogeneity
Total sampleAcademic Year 2018/2019Academic Year 2019/2020Χ2 test
Sex
Male33 (13.04%)18 (16.36%)15 (10.49%)Χ2 = 1.89; df = 1; p = 0.17
Female220 (86.96%)92 (83.64%)128 (89.51%)
Participation in lectures
In the classroom172 (67.98%)69 (62.73%)103 (72.03%)Χ2 = 2.47; df = 1; p = 0.12
In distance
learning
81 (32.02%)41 (37.27%)40 (27.97%)
Participation in mental health stigma events
Yes40 (15.81%)19 (17.27%)21 (14.69%)Χ2 = 0.31; df = 1; p = 0.58
No213 (84.19%)91 (82.73%)122 (85.31%)
Having a first- or second-degree relative with a psychiatric
disorder
Yes64 (25.30%)29 (26.36%) 35 (24.48%)Χ2 = 0.12; df = 1; p = 0.73
No189 (74.70%)81 (73.64%)108 (75.52%)
Table 2. Trend over time of the scores obtained in the knowledge of mental disorders (MAKS-I), the attitudes towards people who are mentally ill (CAMI), and the intended behaviour towards people with mental illness (RIBS-I).
Table 2. Trend over time of the scores obtained in the knowledge of mental disorders (MAKS-I), the attitudes towards people who are mentally ill (CAMI), and the intended behaviour towards people with mental illness (RIBS-I).
t0
(Means ± SD)
t1
(Means ± SD)
t2
(Means ± SD)
Wilcoxon Test
(t0–t1)
Wilcoxon Test
(t1–t2)
Friedman Test (t0–t1–t2)
IQ aIIQ bIIIQ c
MAKS-I
(n = 247)
20.85 ± 2.6622.26 ± 2.5422.69 ± 2.58t1 < t0: 56
(22.67%)
Z = −7.83; p < 0.001t2 < t1: 89
(36.03%)
Z = −2.56; p = 0.01t0192122Χ2 = 85.46; df = 2; p < 0.001
t1 > t0: 157
(63.56%)
t2 > t1: 120
(48.58%)
t1202224
t1 = t0: 34
(13.77%)
t2 = t1: 38
(15.38%)
t2212324
CAMI
(n = 248)
109.08 ± 2.58115.87 ± 8.21116.89 ± 8.97t1 < t0: 35
(14.11%)
Z = −11.26; p < 0.001t2 < t1: 90
(36.29%)
Z = −3.34; p = 0.001t0103110115Χ2 = 195.59; df = 2; p < 0.001
t1 > t0: 204
(82.56%)
t2 > t1: 142
(57.26%)
t1112116.50122
t1 = t0: 9
(3.63%)
t2 = t1: 16
(6.45%)
t2112118.50123
RIBS-I
(n = 248)
15.98 ± 2.5817.35 ± 2.2817.40 ± 2.36t1 < t0: 50
(20.16%)
Z = −8.53; p < 0.001t2 < t1: 72
(29.03%)
Z = −0.70; p = 0.48t014.251618Χ2 = 83.99; df = 2; p < 0.001
t1 > t0: 144
(58.06%)
t2 > t1: 89
(35.89%)
t1161819
t1 = t0: 54
(21.77%)
t2 = t1: 87
(35.08%)
t2161819
a: first quartile; b: second quartile; c: third quartile.
Table 3. Trend over time of the scores obtained in the knowledge of mental disorders (MAKS-I), the attitudes towards people who are mentally ill (CAMI), and the intended behaviour towards people with mental illness (RIBS-I) for male and female subpopulations.
Table 3. Trend over time of the scores obtained in the knowledge of mental disorders (MAKS-I), the attitudes towards people who are mentally ill (CAMI), and the intended behaviour towards people with mental illness (RIBS-I) for male and female subpopulations.
Male/Femalet0
(Means ± SD)
t1
(Means ± SD)
t2
(Means ± SD)
Wilcoxon Test
(t0–t1)
Wilcoxon Test
(t1–t2)
Friedman Test (t0–t1–t2)
IQ aIIQ bIIIQ c
MAKS-IM
(n = 31)
21.26 ± 3.4422.90 ± 2.3323.65 ± 2.58t1 < t0: 7
(22.58%)
Z = −3.01; p = 0.003t2 < t1: 9
(29.03%)
Z = −1.56; p = 0.12t0192124Χ2 = 10.77; df = 2; p = 0.005
t1 > t0: 18
(58.06%)
t2 > t1: 15
(48.39%)
t1212325
t1 = t0: 6
(19.35%)
t2 = t1: 7
(22.58%)
t2222425
F
(n = 216)
20.79 ± 2.5322.17 ± 2.5622.56 ± 2.56t1 < t0: 49
(22.69%)
Z = −7.23; p < 0.001t2 < t1: 80
(37.04%)
Z = −2.16; p = 0.03t0192122Χ2 = 74.91; df = 2; p < 0.001
t1 > t0: 139
(64.35%)
t2 > t1: 105
(48.61%)
t1202224
t1 = t0: 28
(12.96%)
t2 = t1: 31
(14.35%)
t2212324
CAMIM
(n = 32)
109.75 ± 9.82117.09 ± 7.30117.97 ± 8.49t1 < t0: 5
(15.63%)
Z = −4.17; p < 0.001t2 < t1: 11
(34.38%)
Z = −1.25; p = 0.21t0104110.50117.75Χ2 = 26.80; df = 2; p < 0.001
t1 > t0: 25
(78.13%)
t2 > t1: 21
(65.63%)
t1112118122
t1 = t0: 2
(6.25%)
t2 = t1: 0t2114121124.75
F
(n = 216)
108.98 ± 8.32115.69 ± 8.33116.73 ± 9.05t1 < t0: 30
(13.89%)
Z = −10.45; p < 0.001t2 < t1: 79
(36.57%)
Z = −3.10; p = 0.002t0103110115Χ2 = 169.26; df = 2; p < 0.001
t1 > t0: 179
(82.87%)
t2 > t1: 121
(56.02%)
t1112116122
t1 = t0: 7
(3.24%)
t2 = t1: 16
(7.41%)
t2112118123
RIBS-IM
(n = 33)
16.30 ± 2.2817.58 ± 2.1117.48 ± 2.15t1 < t0: 3
(9.09%)
Z = −3.51; p < 0.001t2 < t1: 7
(21.21%)
Z = −0.09; p = 0.93t014.501618Χ2 = 18.23; df = 2; p < 0.001
t1 > t0: 18
(54.55%)
t2 > t1: 11
(33.33%)
t1161819.50
t1 = t0: 12
(36.36%)
t2 = t1: 15
(45.45%)
t2161720
F
(n = 215)
15.93 ± 2.6317.31 ± 2.3117.39 ± 2.40t1 < t0: 47
(21.86%)
Z = −7.79; p < 0.001t2 < t1: 65
(30.23%)
Z = −0.81; p = 0.42t0141618Χ2 = 67.39; df = 2; p < 0.001
t1 > t0: 126t2 > t1: 78
(36.28%)
t1161819
t1 = t0: 42
(19.53%)
t2 = t1: 15
(6.98%)
t2161819
a: first quartile; b: second quartile; c: third quartile.
Table 4. Trend over time of the scores obtained in the knowledge of mental disorders (MAKS-I), the attitudes towards people who are mentally ill (CAMI), and the intended behaviour towards people with mental illness (RIBS-I) for students who attended in the classroom and those in distance learning.
Table 4. Trend over time of the scores obtained in the knowledge of mental disorders (MAKS-I), the attitudes towards people who are mentally ill (CAMI), and the intended behaviour towards people with mental illness (RIBS-I) for students who attended in the classroom and those in distance learning.
Classroom/Distance Learningt0
(Means ± SD)
t1
(Means ± SD)
t2
(Means ± SD)
Wilcoxon Test
(t0–t1)
Wilcoxon Test
(t1–t2)
Friedman Test (t0–t1–t2)
IQ aIIQ bIIIQ c
MAKS-IClassroom
(n = 169)
20.64 ± 2.5122.11 ± 2.5122.55 ± 2.39t1 < t0: 33
(19.53%)
Z = −7.01; p < 0.001t2 < t1: 60
(35.50%)
Z = −2.22; p = 0.03t0192122Χ2 = 66.45; df = 2; p < 0.001
t1 > t0: 107
(63.31%)
t2 > t1: 84
(49.70%)
t1202224
t1 = t0: 29
(17.16%)
t2 = t1: 25
(14.79%)
t2212324
Distance learning
(n = 78)
21.31 ± 2.9122.60 ± 2.5923 ± 2.95t1 < t0: 23
(29.49%)
Z = −3.71; p < 0.001t2 < t1: 29
(37.18%)
Z = −1.29; p = 0.20t0192123Χ2 = 19.86; df = 2; p < 0.001
t1 > t0: 50
(74.10%)
t2 > t1: 36
(46.15%)
t120.752225
t1 = t0: 5
(6.41%)
t2 = t1: 13
(16.67%)
t2212325.25
CAMIClassroom
(n = 170)
108.97 ± 8.53116.05 ± 7.84117.61 ± 8.64t1 < t0: 23
(13.53%)
Z = −9.43; p < 0.001t2 < t1: 56
(32.94%)
Z = −3.73; p < 0.001t0103110.50115Χ2 = 153.63; df = 2; p < 0.001
t1 > t0: 141
(82.94%)
t2 > t1: 102
(60%)
t1111117122
t1 = t0: 6
(3.53%)
t2 = t1: 12
(7.06%)
t2113.75119124
Distance learning
(n = 78)
109.32 ± 8.52115.50 ± 9.01115.32 ± 9.53t1 < t0: 12
(15.38%)
Z = −6.14; p < 0.001t2 < t1: 34
(43.59%)
Z = −0.37; p = 0.71t0104110115Χ2 = 45.53; df = 2; p < 0.001
t1 > t0: 63
(80.77%)
t2 > t1: 40
(51.28%)
t1113116121
t1 = t0: 3
(3.85%)
t2 = t1: 4
(5.13%)
t2111117122
RIBS-IClassroom
(n = 169)
16.09 ± 2.4117.46 ± 2.1217.56 ± 2.50t1 < t0: 33
(19.53%)
Z = −7.23; p < 0.001t2 < t1: 47
(27.81%)
Z = −0.72; p = 0.47t0151618Χ2 = 59.47; df = 2; p < 0.001
t1 > t0: 99
(58.58%)
t2 > t1: 66
(39.05%)
t1161819
t1 = t0: 37
(21.89%)
t2 = t1: 56
(33.14%)
t2161820
Distance learning
(n = 79)
15.76 ± 2.9217.11 ± 2.6017.06 ± 2.58t1 < t0: 17
(21.52%)
Z = −4.59; p < 0.001t2 < t1: 25
(31.65%)
Z = −0.14; p = 0.89t0141618Χ2 = 25.01; df = 2; p < 0.001
t1 > t0: 45
(56.96%)
t2 > t1: 23
(29.11%)
t1151819
t1 = t0: 17
(21.52%)
t2 = t1: 31
(39.24%)
t2161719
a: first quartile; b: second quartile; c: third quartile.
Table 5. Trend over time of the scores obtained in the knowledge of mental disorders (MAKS-I), the attitudes towards people who are mentally ill (CAMI), and the intended behaviour towards people with mental illness (RIBS-I) for students who have/not have a first- or second-degree relative with a psychiatric disorder.
Table 5. Trend over time of the scores obtained in the knowledge of mental disorders (MAKS-I), the attitudes towards people who are mentally ill (CAMI), and the intended behaviour towards people with mental illness (RIBS-I) for students who have/not have a first- or second-degree relative with a psychiatric disorder.
Having a First- or Second-Degree Relative with a Psychiatric Disordert0
(Means ± SD)
t1
(Means ± SD)
t2
(Means ± SD)
Wilcoxon Test
(t0–t1)
Wilcoxon Test
(t1–t2)
Friedman Test
(t0–t1–t2)
IQ aIIQ bIIIQ c
MAKS-IYes
(n = 64)
21.52 ± 2.5822.78 ± 2.4523.45 ± 2.45t1 < t0: 11
(17.19%)
Z = −3.68; p < 0.001t2 < t1: 23
(35.94%)
Z = −1.77; p = 0.08t0202123Χ2 = 27.59; df = 2; p < 0.001
t1 > t0: 41
(64.06%)
t2 > t1: 35
(54.59%)
t1212324
t1 = t0: 12
(18.75%)
t2 = t1: 6
(9.38%)
t2222425.75
No
(n = 183)
20.62 ± 2.6522.08 ± 2.5622.43 ± 2.57t1 < t0: 45
(24.59%)
Z = −6.86; p < 0.001t2 < t1: 66
(36.07%)
Z = −1.90; p = 0.06t0192122Χ2 = 58.33; df = 2; p < 0.001
t1 > t0: 116
(63.39%)
t2 > t1: 85
(49.13%)
t1202224
t1 = t0: 22
(12.02%)
t2 = t1: 32
(17.49%)
t2212324
CAMIYes
(n = 61)
109.74 ± 7.71117.339 ± 7.91117.66 ± 7.70t1 < t0: 7
(11.48%)
Z = −5.93; p < 0.001t2 < t1: 28
(45.90%)
Z = −0.47; p = 0.64t0103.50111115.50Χ2 = 51.30; df = 2; p < 0.001
t1 > t0: 52
(85.25%)
t2 > t1: 30
(49.18%)
t1112119123.50
t1 = t0: 2
(3.28%)
t2 = t1: 3
(4.92%)
t2113.50118123
No
(n = 187)
108.87 ± 8.77115.38 ± 8.26116.64 ± 9.36t1 < t0: 28
(14.97%)
Z = −9.60; p < 0.001t2 < t1: 62
(33.16%)
Z = −3.61; p < 0.001t0103110115Χ2 = 146.06; df = 2; p < 0.001
t1 > t0: 152
(81.28%)
t2 > t1: 112
(59.89%)
t1111116121
t1 = t0: 7
(3.74%)
t2 = t1: 13
(6.95%)
t2112119123
RIBS-IYes
(n = 62)
15.89 ± 2.9317.35 ± 2.3817.27 ± 2.32t1 < t0: 11
(17.74%)
Z = −4.37; p < 0.001t2 < t1: 19
(30.65%)
Z = −0.86; p = 0.39t0141618Χ2 = 18.43; df = 2; p < 0.001
t1 > t0: 33
(53.23%)
t2 > t1: 22
(35.38%)
t115.751819
t1 = t0: 18
(29.03%)
t2 = t1: 21
(33.87%)
t215.751819
No
(n = 186)
16.02 ± 2.4617.43 ± 2.5617.44 ± 2.38t1 < t0: 39
(20.97%)
Z = −7.32; p < 0.001t2 < t1: 53
(28.49%)
Z = −0.08; p = 0.94t0151618Χ2 = 66.62; df = 2; p < 0.001
t1 > t0: 111
(59.68%)
t2 > t1: 67
(36.02%)
t1161819.25
t1 = t0: 36
(19.35%)
t2 = t1: 66
(35.48%)
t2161820
a: first quartile; b: second quartile; c: third quartile.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Pingani, L.; Evans-Lacko, S.; Coriani, S.; Ferrari, S.; Filosa, M.; Galeazzi, G.M.; Lorenzini, M.; Manari, T.; Musetti, A.; Nasi, A.M.; et al. Time Waits for No One: Longitudinal Study on the Effects of an Anti-Stigma Seminar on the Psychology Student Population. Int. J. Environ. Res. Public Health 2021, 18, 5441. https://doi.org/10.3390/ijerph18105441

AMA Style

Pingani L, Evans-Lacko S, Coriani S, Ferrari S, Filosa M, Galeazzi GM, Lorenzini M, Manari T, Musetti A, Nasi AM, et al. Time Waits for No One: Longitudinal Study on the Effects of an Anti-Stigma Seminar on the Psychology Student Population. International Journal of Environmental Research and Public Health. 2021; 18(10):5441. https://doi.org/10.3390/ijerph18105441

Chicago/Turabian Style

Pingani, Luca, Sara Evans-Lacko, Sandra Coriani, Silvia Ferrari, Maria Filosa, Gian Maria Galeazzi, Mattia Lorenzini, Tommaso Manari, Alessandro Musetti, Anna Maria Nasi, and et al. 2021. "Time Waits for No One: Longitudinal Study on the Effects of an Anti-Stigma Seminar on the Psychology Student Population" International Journal of Environmental Research and Public Health 18, no. 10: 5441. https://doi.org/10.3390/ijerph18105441

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop