Skip to Content
Behavioral SciencesBehavioral Sciences
  • Article
  • Open Access

12 August 2026

16 Pages

Reappraisal of Mental Illness-Related Beliefs During Psychiatric Clinical Exposure: Perceived Dangerousness, Ruminative Thought Style, and Cognitive–Metacognitive Characteristics

,
,
,
,
,
and
1
Department of Psychiatry, Faculty of Medicine, Tokat Gaziosmanpaşa University, 60250 Tokat, Turkey
2
Department of Child and Adolescent Psychiatry, Faculty of Medicine, Tokat Gaziosmanpaşa University, 60250 Tokat, Turkey
*
Author to whom correspondence should be addressed.

Abstract

Stigma-related beliefs toward mental illness may change during psychiatric clinical exposure, but individual differences in this process remain insufficiently understood. This single-center observational pre–post study examined observed changes in mental illness-related beliefs among 185 medical interns who completed an approximately 30-day psychiatry clerkship between May 2025 and May 2026, with perceived dangerousness defined as the primary outcome. Beliefs were assessed before and after the exposure period using the Beliefs Toward Mental Illness Scale. Associations between baseline cognitive–metacognitive characteristics and observed change were evaluated using paired comparisons, linear mixed-effects models, and sensitivity analyses. Dangerousness scores decreased by the end of the exposure period, mean change = −2.66, 95% CI [−3.48, −1.81], q < 0.001, dz = −0.47. Smaller decreases were observed in Helplessness and Deterioration in Interpersonal Relationships, whereas no significant change was found in the two-item Shame subscale. Higher baseline ruminative thought style was associated with a more limited decrease in dangerousness scores; B = 1.70, SE = 0.55, 95% CI [0.62, 2.77], q = 0.023. Although this association was consistent across sensitivity analyses, its incremental contribution was small (ΔR2marginal = 0.017; f2 = 0.018 in the focused model). The finding should therefore be interpreted as a quantitatively modest association with observed belief change, not as a clinically meaningful predictor. Because the study included no concurrent control group or experimental manipulation and was conducted at one center, it does not establish a causal clerkship effect or support educational screening based on ruminative thought style.

1. Introduction

Stigma toward mental illness is not limited to general societal attitudes; it is a multidimensional process in which misinformation-based beliefs, prejudicial emotional responses, and discriminatory behaviors are closely intertwined. This process may adversely affect help-seeking behavior, access to healthcare, and participation in social life among individuals with mental illness (Clement et al., 2015; Corrigan & Watson, 2002; Knaak et al., 2017). Individuals with mental illness may face not only symptoms and functional impairment, but also processes of exclusion arising from established and often inaccurate beliefs about mental illness. For this reason, beliefs toward mental illness should not be examined only as a single global indicator of stigma, but also at the level of subdimensions that carry distinct cognitive and interpersonal meanings. Among these subdimensions, perceived dangerousness occupies a particularly central position because of its links with fear, avoidance, and social distance (Corrigan & Watson, 2002; Mannarini et al., 2022). These threat-related beliefs may also contribute to exclusionary responses that compound pre-existing psychosocial adversity through discrimination and restricted participation (Knaak et al., 2017; Thornicroft et al., 2016).
The perception of individuals with mental illness as dangerous, unpredictable, or difficult to control is one of the most salient components of public stigma (Corrigan & Watson, 2002). Such beliefs may be related, at the individual level, to threat appraisal and avoidance tendencies and, at the societal level, to increased social distance and the legitimization of discriminatory practices. In a large community sample examining stigma-related associations toward schizophrenia, Mannarini et al. (2022) reported that perceived dangerousness was associated with the desire for social distance and that social distance was in turn related to avoidance behavior. However, perceived dangerousness is not a fixed evaluation that emerges in the same way for all mental disorders or across all individuals. The diagnostic category, symptom patterns, social representations, previous contact experiences, and clinical observations may all contribute to the formation of this perception. Accordingly, perceived dangerousness represents a priority domain for understanding the psychological reappraisal of mental illness-related beliefs.
Psychiatric clinical exposure may provide a naturalistic context in which pre-existing beliefs about mental illness can be reconsidered. During the psychiatry clerkship, medical students and interns encounter not only theoretical knowledge but also clinical observation, patient interviews, ward rounds, and supervised assessments. These experiences may allow them to evaluate individuals with mental illness not only through diagnostic categories or social representations, but also in relation to personal histories, levels of functioning, treatment processes, and possibilities for recovery. Previous studies have reported decreases in some stigma-related attitudinal indicators following psychiatric education or clinical contact (Vilar Queirós et al., 2021; Zavorotnyy et al., 2023). Reductions in stigma indicators have also been shown to be more pronounced in educational practices that include patient-centered and reflective clinical experience (Hopp et al., 2023). Nevertheless, such findings do not indicate that clinical exposure produces change in the same direction or to the same extent in all students. How clinical experience is perceived, interpreted, and integrated with prior belief systems may differ across individuals.
The literature therefore provides a stronger basis for expecting average attitudinal improvement than for explaining heterogeneity in that improvement. The principal contribution of the present study is not another demonstration that stigma-related beliefs may decline during a psychiatry clerkship, but an examination of whether students exposed to the same routine curriculum differ in the extent of belief revision. This distinction shifts the theoretical question from who holds more stigmatizing beliefs to which characteristics may facilitate or constrain updating when students encounter information that is inconsistent with their prior assumptions.
Previous attempts to explain who changes during clinical exposure have been limited and have generally focused on demographic, contact, or educational characteristics rather than cognitive processing styles. In a controlled study of patient-centered clinical teaching involving psychiatric patients, Hopp et al. (2023) examined sex, previous contact with people with mental illness, interest in psychiatry or psychosomatics, and self-esteem. These factors were associated with baseline stigma, but none moderated stigma reduction. Zavorotnyy et al. (2023) reported that change in stigma covaried with willingness to pursue psychiatry, but did not test a baseline cognitive moderator of belief change. Longitudinal qualitative findings further suggest that the amount and quality of direct patient contact, students’ active role in consultations, supervisory support, and pre-existing beliefs may shape how perceptions evolve during a clerkship (Manley et al., 2024). Thus, heterogeneity in response has been recognized, but direct quantitative tests of baseline cognitive processing characteristics as moderators of within-person stigma-related change remain scarce.
Belief updating during clinical exposure requires attention to potentially disconfirming information, disengagement from established threat appraisals, and integration of patient-specific observations into broader representations of mental illness. Within this gap, ruminative thought style was selected as the focal cognitive candidate because it describes a content-independent tendency toward repetitive, persistent processing and difficulty disengaging from ongoing appraisals (Brinker & Dozois, 2009; Ehring & Watkins, 2008; Watkins, 2008). By comparison, psychological distress and negative automatic thoughts primarily index current affective or evaluative content, thought fusion concerns the significance and power attributed to thoughts, and the AnTI metacognition subscale captures worry-related metacognitive content (Hollon & Kendall, 1980; Lovibond & Lovibond, 1995; Wells, 1994; Wells et al., 2001). These constructs remain theoretically plausible and were examined in the same multivariable framework. The proposed distinction concerns conceptual proximity to the operation of belief updating; the study did not directly compare mechanisms or establish that rumination is globally more important than the alternatives.
This study examined observed change in beliefs toward mental illness during an approximately 30-day period of psychiatric clinical exposure among medical interns and evaluated whether that change was associated with baseline cognitive and metacognitive characteristics. Two hypotheses were specified. H1 was that dangerousness scores would decrease during the clinical exposure period. H2 was that higher baseline RTSQ scores would be associated with a more limited decrease in dangerousness scores. Other BTMI dimensions and interactions involving psychological distress, negative automatic thoughts, thought fusion, and worry-related metacognitive patterns were treated as complementary analyses. Because no concurrent control group was included, the hypotheses concerned observed longitudinal patterns and associated individual differences rather than a causal effect of the psychiatry clerkship.

2. Materials and Methods

2.1. Study Design and Context

This study was designed as a single-center, observational, longitudinal pre–post assessment to examine changes in beliefs toward mental illness during an approximately 30-day period of psychiatric clinical exposure among medical interns and to evaluate the association of these changes with baseline cognitive and metacognitive characteristics. The study was conducted with sixth-year medical students who completed their psychiatry clerkship at Tokat Gaziosmanpaşa University Faculty of Medicine between May 2025 and May 2026.
The psychiatry clerkship lasts approximately 30 days and combines theoretical instruction with clinical practice. During the clerkship, students receive training in core clinical skills, including psychiatric history-taking, mental status examination, participation in inpatient ward rounds, and evaluation of clinical follow-up processes. The program also covers psychiatric emergencies, mood disorders, psychotic disorders, anxiety- and trauma-related disorders, cognitive disorders, basic psychopharmacology, psychoeducation, and relevant legal processes. No additional educational or anti-stigma intervention was implemented beyond the routine clerkship program. The approximately 30-day duration was determined by the institution’s standard curriculum rather than selected by the research team; it should therefore be understood as the observed curricular window, not as an experimentally validated exposure dose or minimum duration for attitudinal change.
The study did not include a concurrent control group. Therefore, differences between pre-clerkship and post-clerkship measurements were interpreted not as the causal effect of the psychiatry clerkship, but as longitudinal patterns of change observed during the psychiatric clinical exposure period.

2.2. Participants

A total of 205 sixth-year medical students who completed the psychiatry clerkship during the study period were assessed for eligibility. Twenty students who did not participate in the initial assessment at the start of the clerkship were excluded from the analytic sample. Thus, the baseline analytic sample consisted of 185 medical interns.
The inclusion criteria for the analyses were completion of the psychiatry clerkship during the study period, participation in the baseline assessment at the beginning of the clerkship, and availability of the measurements required for the relevant analysis. For the analytic cohort, exclusion occurred only when a student did not participate in the baseline assessment; no additional clinical or academic-performance exclusion criteria were applied. Because some students had block-level missing data for the cognitive and metacognitive scales, the sample size varied across models. In the focused RTSQ analysis, 170 students and 339 repeated observations were evaluated. Students with missing data for a given analysis were excluded only from the relevant model and were retained in other analyses for which the necessary data were available.

2.3. Procedure

Data were collected using printed forms at two prespecified assessment points: at the beginning of the clerkship, before the routine clinical exposure period (day 0), and at the end of the approximately 30-day clerkship period (day 30). The same day-0/day-30 schedule was applied sequentially across routine clerkship blocks conducted between May 2025 and May 2026. Beliefs toward mental illness were measured at both assessment points. Baseline cognitive and metacognitive characteristics were entered into the predictor analyses using scores obtained at the initial assessment.
To match pre-clerkship and post-clerkship forms, each student was assigned a study-specific, randomly generated code. The research team provided the codes, and the identity–code linkage was known only to the researcher responsible for this procedure. Data collection on day 30 of the clerkship was conducted by a different researcher who was unaware of participant identities or baseline data. After the forms were matched using study-specific codes, the identity–code key was deleted, and all analyses were conducted on a de-identified dataset.
The forms were completed in an environment that allowed participants to respond independently, protected privacy, and provided standardized conditions. Participation in the study was voluntary. Students were informed that their decision to participate or not participate would not affect their psychiatry clerkship evaluations or academic grades. To reduce potential power asymmetry, faculty members responsible for evaluating students’ clerkship performance were separated from the researchers involved in data collection and analysis. No academic incentive was attached to participation.

2.4. Measures

2.4.1. Sociodemographic Information Form

A two-item form prepared by the researchers was used to record participants’ age and sex. These variables were evaluated as demographic covariates in the main analyses.

2.4.2. Beliefs Toward Mental Illness Scale

The Beliefs Toward Mental Illness Scale (BTMI; Turkish: Ruhsal Hastalıklara Yönelik İnançlar Ölçeği, RHYİÖ) is a 21-item self-report instrument that assesses general beliefs toward individuals with mental illness (Bilge & Çam, 2008; Hirai & Clum, 2000). Items are scored from 0 to 5, with higher scores indicating more negative beliefs. The Turkish form consists of three subscales: Helplessness and Deterioration in Interpersonal Relationships, dangerousness, and Shame (Bilge & Çam, 2008). In this study, the dangerousness subscale was defined as the primary outcome; the Helplessness and Deterioration in Interpersonal Relationships subscale as a prioritized secondary outcome; the two-item Shame subscale as an exploratory outcome; and the total score as a complementary outcome.
For the Helplessness and Deterioration in Interpersonal Relationships subscale, the internal consistency coefficients were α = 0.85 and ω = 0.86 at baseline and α = 0.84 and ω = 0.84 at the end of the clerkship. For the dangerousness subscale, the internal consistency coefficients were α = 0.77 and ω = 0.78 at baseline and α = 0.79 and ω = 0.80 at the end of the clerkship. For the total score, the internal consistency coefficients were α = 0.90 and ω = 0.90 at baseline and α = 0.89 and ω = 0.90 at the end of the clerkship. For the Shame subscale, the inter-item correlation and Spearman–Brown coefficients were rii = 0.33 and SB = 0.50 at baseline and rii = 0.37 and SB = 0.54 at the end of the clerkship. Because of the limited internal consistency observed for the two-item Shame subscale, findings related to this subscale were interpreted only at an exploratory and descriptive level. They were not included in the primary inferences.

2.4.3. Ruminative Thought Style Questionnaire

The Ruminative Thought Style Questionnaire (RTSQ; Turkish: Ruminatif Düşünce Biçimi Ölçeği, RDBÖ) is a 20-item, seven-point Likert-type self-report instrument assessing individuals’ general tendency toward ruminative thinking (Brinker & Dozois, 2009; Karatepe et al., 2013). Higher total scores indicate a more pronounced ruminative thought style. In this study, the baseline RTSQ total score was treated as the main predictor. The internal consistency coefficients were α = 0.94 and ω = 0.94 at baseline and α = 0.96 and ω = 0.96 at the end of the clerkship.

2.4.4. Depression Anxiety Stress Scales—21

The Depression Anxiety Stress Scales—21 (DASS-21) is a 21-item, four-point Likert-type scale assessing symptoms of depression, anxiety, and stress (Lovibond & Lovibond, 1995; Yılmaz et al., 2017). In this study, the raw total score was used without multiplying the subscale scores by two. Higher scores indicate more pronounced psychological distress. The internal consistency coefficients were α = 0.89 and ω = 0.89 at baseline and α = 0.91 and ω = 0.91 at the end of the clerkship.

2.4.5. Automatic Thoughts Questionnaire (ATQ-30)

The Automatic Thoughts Questionnaire (ATQ-30; Turkish: Otomatik Düşünceler Ölçeği, ODÖ-30) is a 30-item, five-point Likert-type scale assessing the frequency of negative automatic thoughts associated with depression (Aydın & Aydın, 1990; Hollon & Kendall, 1980). Higher scores indicate more frequent negative automatic thoughts. The internal consistency coefficients were α = 0.96 and ω = 0.96 at baseline and α = 0.97 and ω = 0.97 at the end of the clerkship.

2.4.6. Thought Fusion Instrument

The Thought Fusion Instrument (TFI; Turkish: Düşünce Kaynaşması Ölçeği, DKÖ) is a 14-item self-report instrument that assesses metacognitive beliefs about the meaning and power of thoughts (Güneysu et al., 2021; Wells et al., 2001). Higher scores indicate more pronounced thought fusion. The internal consistency coefficients were α = 0.87 and ω = 0.88 at baseline and α = 0.90 and ω = 0.91 at the end of the clerkship.

2.4.7. Anxious Thoughts Inventory

The Anxious Thoughts Inventory (AnTI; Turkish: Kaygı Düşünceleri Envanteri, KDE) is a 22-item, four-point Likert-type self-report instrument assessing the content and process dimensions of worry (Kart et al., 2020; Wells, 1994). In this study, the AnTI metacognitive subscale was evaluated as a complementary and exploratory metacognitive variable. Higher scores indicate more pronounced metacognitive worry patterns. The internal consistency coefficients for the AnTI total scale items were α = 0.93 and ω = 0.93 at baseline and α = 0.92 and ω = 0.92 at the end of the clerkship.

2.5. Statistical Analysis

Statistical analyses were conducted using R 4.5.1 (R Core Team, 2025). The psych, lme4, lmerTest, car, sandwich, lmtest, lavaan, semTools, simr, and pwr packages were used for data preparation, scoring, and analyses. Linear mixed-effects models were fitted using the lme4 and lmerTest packages, whereas latent variable analyses were conducted using lavaan (Bates et al., 2015; Kuznetsova et al., 2017; Rosseel, 2012).
The analytic approach was based on subscale-level change in the BTMI. Because the BTMI total score combines conceptually distinct content domains, it was treated as a complementary outcome. The two-item Shame subscale, which showed a marked floor effect, was evaluated only at an exploratory and descriptive level. Cronbach’s alpha and McDonald’s omega coefficients were reported together to assess internal consistency.
Before scoring, item response ranges, missing observations, and the consistency of scale scores with scores recalculated from item responses were checked. Continuous variables were summarized using means and standard deviations, and categorical variables using counts and percentages. Change between pre-clerkship and post-clerkship BTMI scores was evaluated using paired-samples t tests, 95% bootstrap confidence intervals based on 5000 resamples, and Cohen’s dz effect size. To examine sensitivity to distributional assumptions, the Wilcoxon signed-rank test was used as a supportive analysis. The Benjamini–Hochberg false-discovery rate correction was applied to subscale-level comparisons (Benjamini & Hochberg, 1995).
To evaluate the association of the baseline cognitive and metacognitive characteristics with the change in BTMI scores, linear mixed-effects models with participant-specific random intercepts were fitted. The time variable was coded as 0 for the pre-clerkship assessment and 1 for the post-clerkship assessment; continuous predictors were z-standardized. The predictors were entered in two theory-informed blocks for joint model comparison. The first block included DASS-21 and ATQ total scores, representing current affective distress and negative evaluative content. The second block included the TFI total score, RTSQ total score, and AnTI metacognitive subscale score, representing repetitive or metacognitive processing. This block structure was an analytic grouping and did not imply equal theoretical priority among the three second-block variables. The time × RTSQ interaction was the focal predictor-specific test corresponding to H2, whereas interactions involving the other constructs were complementary. The main effect of each predictor and its interaction with time were included in the model. Nested models differing in fixed effects were compared using maximum-likelihood estimation, whereas final coefficients were reported from restricted maximum-likelihood models. Degrees of freedom were calculated using the Satterthwaite approximation. The Benjamini–Hochberg correction was applied to the time × predictor tests conducted for the two prioritized BTMI subscales. Multicollinearity among predictors was examined using variance inflation factors, tolerance values, and condition indices.
After a time × RTSQ interaction was identified for the dangerousness subscale, simple time slopes were calculated at low (−1 SD), mean, and high (+1 SD) levels of RTSQ. The robustness of the main finding was examined using an age- and sex-adjusted mixed model, a paired complete-sample model, ANCOVA models adjusted for baseline dangerousness score, HC3-robust standard errors, inverse probability weighting, and participant-level leave-one-out influential-observation analyses. The incremental contribution of the time × RTSQ interaction was quantified using the change in marginal R2 and f2.
Block-level joint missingness was observed in the cognitive and metacognitive scales. Multiple imputation was not applied because there were insufficient auxiliary variables to support imputation and because the missingness mechanism could not be definitively classified based on observed data. The main analyses were conducted using a complete-case approach; findings were tested using an inverse probability-weighted sensitivity analysis based on observed age, sex, and baseline BTMI subscale scores.
Measurement-error sensitivity was evaluated through a secondary ordinal latent change model. Detailed invariance testing, residual specifications, and item-level robustness analyses are reported in Supplementary Table S6; the main text focuses on whether the latent analysis altered the substantive inference (Wu & Estabrook, 2016).
Because the study was based on a completed longitudinal dataset, post hoc observed power analyses were not conducted. Instead, minimum detectable effect sizes were calculated based on the achieved sample sizes. In the sensitivity analyses, the approximate minimum detectable coefficient for the time × baseline RTSQ interaction in the focused linear mixed model was B = 1.20. In supportive analyses, the minimum detectable effect size was calculated as Cohen’s dz = 0.208 for the paired pre–post comparison and Cohen’s f2 = 0.048 for the ANCOVA model adjusted for baseline dangerousness score. All tests were two-sided, and the level of statistical significance was set at 0.05. These calculations characterize the smallest effects detectable with the achieved samples and were not interpreted as post hoc evidence that the study was adequately powered for every null association.

3. Results

3.1. Participant Characteristics and Analytic Sample

Of the 205 medical interns who completed the psychiatry clerkship during the study period, 20 were not included in the analytic sample because they did not participate in the baseline assessment at the beginning of the clerkship. Among the 185 participants with baseline data, the mean age was 24.26 years (SD = 1.22), and 51.4% of the sample were women. Baseline cognitive and metacognitive scale scores, together with the number of missing observations for these variables, are presented in Table 1. Because Ruminative Thought Style Questionnaire (RTSQ) data were available for 170 participants, the focused RTSQ mixed model was based on 339 repeated observations from 170 participants.
Table 1. Participant characteristics and baseline cognitive/metacognitive predictor scores.

3.2. Observed Change During Psychiatric Clinical Exposure

Observed changes in the subscales of the Beliefs Toward Mental Illness Scale (BTMI) between the pre-clerkship and post-clerkship assessments are presented in Table 2. A significant decrease was observed in dangerousness scores, the primary outcome variable, by the end of the clerkship period (mean change = −2.66; 95% CI [−3.48, −1.81]; q < 0.001). The effect size for this change was small to moderate; dz = −0.47. A more limited decrease was also found in the Helplessness and Deterioration in Interpersonal Relationships subscale; mean change = −1.59, 95% CI [−2.84, −0.33], q = 0.021, dz = −0.18. In contrast, no significant difference was found between pre-clerkship and post-clerkship scores on the Shame subscale (q = 0.820). Because of its two-item structure and limited internal consistency, this subscale was evaluated only at a descriptive and exploratory level. The BTMI total score, examined as a complementary outcome, was also lower at the end of the clerkship; mean change = −4.22, 95% CI [−6.16, −2.29], p < 0.001, dz = −0.31.
Table 2. Internal consistency and observed change in Beliefs Toward Mental Illness dimensions.

3.3. Associations of Baseline Cognitive and Metacognitive Characteristics with Change

The associations of baseline cognitive and metacognitive characteristics with change in BTMI scores were examined using multivariable linear mixed-effects models. The results of the time × predictor tests conducted for the two prioritized subscales are presented in Table 3. No significant time × predictor interaction was detected between change in the Helplessness and Deterioration in Interpersonal Relationships subscale and baseline DASS-21, ATQ-30, TFI, RTSQ, or AnTI metacognitive subscale scores.
Table 3. Baseline predictors of change in Beliefs Toward Mental Illness dimensions in multivariable mixed-effects models.
For the dangerousness subscale, however, the time × RTSQ interaction was significant; B = 1.70, SE = 0.55, 95% CI [0.62, 2.77], p = 0.002, q = 0.023. The positive interaction coefficient indicates that students with a more pronounced baseline ruminative thought style showed a more limited decrease in dangerousness scores. The interactions between time and the other cognitive and metacognitive predictors examined for the dangerousness subscale were not significant.
The theoretical block comparisons were consistent with this pattern. For the Helplessness and Deterioration in Interpersonal Relationships subscale, the incremental contribution of the cognitive and metacognitive blocks to the model could not be demonstrated. For the dangerousness subscale, the first block, which included the DASS-21 and ATQ-30 interactions, remained at the threshold of significance after false-discovery rate correction (q = 0.054). In contrast, the second block, which included the TFI, RTSQ, and AnTI metacognitive subscale interactions, made a significant contribution to model fit; Δχ2 = 9.59, Δdf = 3, q = 0.045; see Supplementary Table S1.

3.4. Change in Dangerousness Scores According to Levels of Ruminative Thought Style

To improve the interpretability of the time × RTSQ interaction for the dangerousness subscale, simple time slopes were calculated at low, mean, and high baseline RTSQ levels. In the model adjusted for age and sex, the expected decrease in dangerousness scores was −4.38 points among students with low baseline RTSQ scores (−1 SD; 95% CI: [−5.76, −2.99]; p < 0.001). At the mean RTSQ level, the expected decrease was −2.77 points; 95% CI [−3.95, −1.59], p < 0.001. In contrast, among students with high baseline RTSQ scores (+1 SD), the expected decrease was more limited and not statistically significant: −1.16 points (95% CI [−2.68, 0.36]), p = 0.136. Marginal predictions derived from the primary mixed model visually supported the same pattern (Figure 1).
Figure 1. Estimated dangerousness subscale scores before and after psychiatric clinical exposure by baseline RTSQ level. Points and error bars represent marginal estimates and 95% confidence intervals derived from the focused linear mixed-effects model without age and sex adjustment; they are not raw group means. Dangerousness scores decreased more clearly at low and mean RTSQ levels, whereas the estimated decrease was smaller and not statistically significant at a high RTSQ level.

3.5. Focused Analyses and Sensitivity Checks

The time × RTSQ interaction for the dangerousness subscale remained generally consistent across alternative modeling approaches (Table 4). In the focused mixed model including all available observations, the interaction coefficient was B = 1.638, SE = 0.428, 95% CI [0.799, 2.476], p < 0.001. The findings did not materially change after adjustment for age and sex, restriction to participants with complete data at both time points, or use of ANCOVA models accounting for baseline dangerousness scores. In the extended ANCOVA model, baseline RTSQ score also retained its association with follow-up dangerousness score; B = 1.601, SE = 0.531, 95% CI [0.560, 2.642], p = 0.003.
Table 4. Focused RTSQ analyses and sensitivity models for dangerousness.
Detailed predictor correlations, multicollinearity checks, missing-data comparisons, and the inverse probability-weighted analysis are reported in Supplementary Tables S2 and S3. None materially altered the RTSQ estimate, although selection related to unobserved characteristics remains possible.
Convergence, residual, and participant-level influence diagnostics are reported in Supplementary Table S4. The coefficient retained its direction after each leave-one-out deletion; however, the interaction added only ΔR2marginal = 0.017 (f2 = 0.018), confirming that model stability did not translate into a large practical contribution.

3.6. Latent Variable Sensitivity Analysis

The secondary latent change analysis was directionally consistent with the observed-score result. Technical details of partial intercept invariance, category handling, residual covariances, and item-level robustness checks are provided in Supplementary Table S6 rather than repeated in the main text.
The time × RTSQ interaction for dangerousness was also supported in the more conservative Benjamini–Hochberg sensitivity correction in which the predefined analytic families were evaluated together; q = 0.011; see Supplementary Table S8.

4. Discussion

This study documented observed changes in mental illness-related beliefs during an approximately 30-day period of psychiatric clinical exposure among medical interns and identified an association between baseline ruminative thought style and change in dangerousness scores. The time × RTSQ coefficient retained its direction across alternative models and sensitivity analyses. The analytic stability indicates that the estimate was not dependent on a single modeling choice; it does not establish causality, replicability, predictive accuracy, or educational importance. The interaction accounted for only ΔR2marginal = 0.017 (f2 = 0.018), and its practical contribution was therefore limited. In addition, without a concurrent control group, the average pre–post change and the moderator pattern may reflect repeated measurement, secular or cohort effects, experiences outside the clerkship, or unmeasured differences in how students encountered the curriculum. The result is best understood as a quantitatively modest association between a baseline processing style and observed within-clerkship change.
The decrease in perceived dangerousness is consistent with previous studies reporting more favorable attitudes after psychiatric education and clinical contact (Vilar Queirós et al., 2021; Zavorotnyy et al., 2023). It should therefore be interpreted mainly as a contextual replication of an established pattern rather than as the novel contribution of this study. Prior research suggests that direct patient interaction, supervised clinical experience, and reflective learning may accompany more favorable attitudinal change (Hopp et al., 2023). Longitudinal qualitative work likewise indicates that real-life patient contact, active participation in consultations, and supportive supervision can facilitate belief revision, whereas limited contact and durable pre-existing beliefs may constrain it (Manley et al., 2024). Brief or limited-contact approaches may produce less consistent effects (Papish et al., 2013). The present study extends this literature by examining the heterogeneity in change under routine clinical exposure, not by demonstrating that the clerkship itself caused the observed reduction.
The differentiation between subscales is important because beliefs toward mental illness do not constitute a uniform construct. Stigma-related beliefs may involve dangerousness, fear, avoidance, social distance, perceived treatability, and expectations regarding interpersonal functioning (Corrigan & Watson, 2002; Mannarini et al., 2022). Previous studies likewise indicate that attitudinal domains do not change uniformly after psychiatric education or contact-based experiences (da Rocha Neto et al., 2017; Kerby et al., 2008). Perceived dangerousness may be relatively amenable to reappraisal when students encounter patients, hear individual narratives, and observe treatment and recovery. By contrast, the Helplessness and Deterioration in Interpersonal Relationships dimension includes broader evaluations of illness course, functioning, and social participation, which may change less during a brief curricular period. The absence of significant change in Shame cannot establish resistance to change because this two-item subscale showed a floor effect and limited internal consistency.
Perceived dangerousness also has implications beyond individual attitudes. When threat-based stereotypes are translated into avoidance, restrictive practices, or unequal treatment, they may contribute to structural stigma, discrimination, and processes of oppression affecting people with mental illness (Knaak et al., 2017; Thornicroft et al., 2016; Zavorotnyy et al., 2023). The present study did not measure institutional practices, discrimination, or oppression directly; therefore, the observed reduction in dangerousness scores should not be interpreted as evidence that these broader processes changed during the clerkship.
The most distinctive finding was the association between baseline ruminative thought style and the magnitude of change in dangerousness scores. Rumination involves sustained engagement with ongoing appraisals and difficulty shifting away from established thought patterns (Ehring & Watkins, 2008; Mor et al., 2014; Watkins, 2008; Whitmer & Gotlib, 2012). In a clinical learning context, this processing style could make it harder to integrate patient-specific evidence that conflicts with prior threat-related assumptions. This mechanism was not measured directly, and the observed interaction does not show that rumination caused limited belief revision.
The comparative pattern across the measured constructs is consistent with, but does not prove, the proposed process distinction. Psychological distress and negative automatic thoughts may be more closely related to the emotional tone or content of baseline evaluations, whereas thought fusion and worry-related metacognition may affect the significance attributed to thoughts or the persistence of concern. Ruminative thought style is more directly aligned conceptually with sustained processing and disengagement, which provided the basis for its focal status in H2. This is an interpretive distinction rather than evidence that rumination is mechanistically superior. The nonsignificant interactions for the alternative constructs should not be interpreted as evidence that they are unimportant; limited power for small interaction effects, measurement overlap, and construct-specific reliability may have obscured associations. Replication with direct measures of cognitive flexibility, attentional shifting, and threat updating is required.
The small incremental effect materially constrains interpretation. Even if the association replicates, a variable explaining approximately 1.7% additional marginal variance would have limited standalone value for predicting which students will show attitudinal change. The study was not designed to establish an actionable threshold, classify students, or estimate individual educational benefit. Small effects can inform theory in educational research, but practical use requires replication and evidence that the association predicts durable behavioral outcomes (Kraft, 2020). Here, assessment ended with the clerkship and relied on self-report; persistence, social-distance behavior, and subsequent clinical conduct were not evaluated. The finding is therefore best treated as a hypothesis-generating signal about one possible source of heterogeneity, not as a clinically meaningful predictor.
Given the observational design, the educational and clinical-training implications are limited to testable intervention hypotheses. Future controlled studies could compare routine clerkship with structured reflective components, such as brief elicitation of expectations before patient contact, guided comparison of those expectations with patient-specific evidence, debriefing after emotionally salient encounters, and supervisor prompts that distinguish recurrent impressions from case-specific observations. Such trials should assess whether these components improve durable attitudes, social distance, standardized-patient behavior, or other clinically relevant outcomes. The present data do not show that these strategies are effective, do not support screening students by RTSQ score, and do not justify assigning differentiated curricula on the basis of ruminative thought style.
The strengths of this study include its examination of beliefs toward mental illness not only through a total score, but also at the level of subdimensions with theoretically distinct meanings. In addition, evaluating the association between baseline cognitive and metacognitive characteristics and change over time in a routine clinical training environment strengthens the ecological validity of the study. The preservation of the main finding across different analytic approaches, including adjusted mixed models, ANCOVA models accounting for baseline scores, inverse probability weighting, participant-level leave-one-out checks, and a latent change-score model accounting for measurement error, supports that the result was not dependent on a single modeling choice.
Several limitations should be considered. Most importantly, the observational pre–post design and the absence of a concurrent control group preclude attributing the observed changes specifically to the psychiatry clerkship or to any particular component of the curriculum. Repeated measurement, time-related change, social desirability, and experiences outside the clerkship remain plausible alternative explanations. Recruitment also occurred across successive routine clerkship blocks, and unmeasured variation in patient contact, clinical case mix, or supervision may have contributed to differences between cohorts.
The generalizability of the findings is limited by the inclusion of sixth-year medical interns from a single Turkish medical school and by the institution-specific approximately 30-day curriculum. The findings may therefore not extend directly to other stages of medical education, training programs, or cultural and healthcare settings. In addition, assessments were conducted only at the beginning and end of the clerkship and relied on self-report measures; consequently, the persistence of the observed changes and their correspondence with clinical behavior remain unknown. Finally, the proposed relevance of ruminative thought style to belief updating remains a theoretical interpretation, because cognitive flexibility, attentional disengagement, and threat-related updating were not directly measured.
Future research would benefit from controlled, multicenter designs comparing different educational programs or forms of clinical contact, longer follow-up periods, and the inclusion of measures of clinical behavior, social distance tendencies, or performance-based indicators alongside self-report assessments. Given the adverse effects of stigma on help-seeking, access to healthcare, and care processes, future studies should examine not only changes in scale scores, but also the extent to which attitudinal change is reflected in behavioral and clinical outcomes (Clement et al., 2015; Knaak et al., 2017). In addition, examining components such as the quality of patient contact, supervised clinical practice, educator feedback, and reflective learning sessions separately may better clarify the experiential processes through which change is shaped. Whether the association between ruminative thought style and change in perceived dangerousness replicates across different samples and whether possible intermediary processes such as cognitive flexibility, attentional shifting, or threat interpretation play a role in this association should also be evaluated.

5. Conclusions

This single-center observational pre–post study found that perceived dangerousness decreased during an approximately 30-day period of psychiatric clinical exposure among medical interns and that higher baseline ruminative thought style was associated with a more limited decrease. The association was consistent across several analytic approaches but small in incremental magnitude. It should therefore be understood as an associated individual characteristic, not as a clinically meaningful predictor, screening marker, or basis for differentiated education. Neither the average change nor the interaction can be attributed causally to the clerkship. Controlled multicenter studies across training stages and curricula, with longer follow-up and behavioral outcomes, are required before educational or clinical-training implications can be established.

Supplementary Materials

The following supporting information can be downloaded at https://www.mdpi.com/article/10.3390/bs16081383/s1, Table S1: Theory-informed block contributions to mixed-effects models; Table S2: Predictor correlations and multicollinearity diagnostics; Table S3: Missing-data evaluation and IPW sensitivity analysis; Table S4: Mixed-model diagnostics and influence analyses; Table S5: HC3-robust ANCOVA sensitivity model; Table S6: Latent measurement diagnostics and i13 robustness analyses; Table S7: Conditional latent change-score model; Table S8: Overall Benjamini–Hochberg sensitivity analysis; Table S9: Incremental effect size and power sensitivity analyses; Figure S1: Expected change in dangerousness by baseline RTSQ level in the age- and sex-adjusted model; Figure S2: Residuals versus fitted values for the final mixed-effects model; Figure S3: Normal Q-Q plot of residuals from the final mixed-effects model; Figure S4: Simulation-based sensitivity analysis for the focused mixed-effects model.

Author Contributions

Conceptualization, İ.G. and S.G.; Methodology, İ.G.; Formal Analysis, İ.G.; Investigation, İ.G., S.G., B.E., F.Ü.D., S.A., M.E.Y. and C.B.; Data Curation, İ.G., M.E.Y. and C.B.; Writing—Original Draft Preparation, İ.G.; Writing—Review and Editing, S.G., B.E., F.Ü.D., S.A., M.E.Y. and C.B.; Supervision, İ.G.; Project Administration, İ.G. and S.G. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki and approved by the Tokat Gaziosmanpaşa University Faculty of Medicine Non-Interventional Scientific Research Ethics Committee (protocol code 24-MOBAEK-019; approval date: 12 December 2024).

Data Availability Statement

The data supporting the findings of this study are available from the corresponding author upon reasonable request. The data are not publicly available because of privacy and ethical restrictions.

Acknowledgments

The authors thank the medical interns who participated in the study. The authors also acknowledge Aslıhan Özdemir Yaşaran and Soner Akar for their support during the initial study planning and participant-facing documentation process. These individuals are acknowledged for their early-stage support; their contributions did not meet the criteria for authorship. Preliminary findings from this study were presented as an oral presentation entitled “Cognitive Factors Associated with Beliefs Toward Psychiatry in Medical Interns: A Transdiagnostic Perspective” at the 4th International and 28th National Clinical Education Symposium, held on 19–22 April 2026. The presentation included only preliminary and partial findings. The present article is based on the complete dataset and includes extended statistical and sensitivity analyses, together with a substantially developed theoretical and methodological framework. During the preparation of this manuscript, the authors used OpenAI’s ChatGPT (GPT-5.5 and GPT-5.6) solely for language editing and formatting support. All generated output was critically reviewed and edited by the authors, who take full responsibility for the content of the publication.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Aydın, G., & Aydın, O. (1990). Otomatik düşünceler ölçeğinin geçerlik ve güvenirliği. Psikoloji Dergisi, 7(24), 51–55. [Google Scholar]
  2. Bates, D., Mächler, M., Bolker, B., & Walker, S. (2015). Fitting linear mixed-effects models using lme4. Journal of Statistical Software, 67(1), 1–48. [Google Scholar] [CrossRef] [Scilit]
  3. Benjamini, Y., & Hochberg, Y. (1995). Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society: Series B (Methodological), 57(1), 289–300. [Google Scholar] [CrossRef] [Scilit]
  4. Bilge, A., & Çam, O. (2008). Ruhsal hastaliğa yönelik inançlar ölçeği’nin geçerliliği ve güvenilirliği. Anadolu Psikiyatri Dergisi, 9, 91–96. [Google Scholar]
  5. Brinker, J. K., & Dozois, D. J. A. (2009). Ruminative thought style and depressed mood. Journal of Clinical Psychology, 65(1), 1–19. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  6. Clement, S., Schauman, O., Graham, T., Maggioni, F., Evans-Lacko, S., Bezborodovs, N., Morgan, C., Rüsch, N., Brown, J. S. L., & Thornicroft, G. (2015). What is the impact of mental health-related stigma on help-seeking? A systematic review of quantitative and qualitative studies. Psychological Medicine, 45(1), 11–27. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  7. Corrigan, P. W., & Watson, A. C. (2002). Understanding the impact of stigma on people with mental illness. World Psychiatry, 1(1), 16–20. [Google Scholar] [PubMed]
  8. da Rocha Neto, H. G., Rosenheck, R. A., Stefanovics, E. A., & Cavalcanti, M. T. (2017). Attitudes of Brazilian medical students towards psychiatric patients and mental illness: A quantitative study before and after completing the psychiatric clerkship. Academic Psychiatry, 41(3), 315–319. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  9. Ehring, T., & Watkins, E. R. (2008). Repetitive negative thinking as a transdiagnostic process. International Journal of Cognitive Therapy, 1(3), 192–205. [Google Scholar] [CrossRef]
  10. Güneysu, İ., Batmaz, S., Akpınar Aslan, E., & Güneysu, S. (2021). Obsesif kompülsif bozukluğun üstbilişsel değerlendirilmesi: Düşünce kaynaşmasi ölçeği, ritüeller hakkindaki inanişlar ölçeği ve durdurma işaretleri ölçeği’nin Türkçe versiyonlarının geçerlilik ve güvenilirliği. Bilişsel Davranışçı Psikoterapi ve Araştırmalar Dergisi, 10(2), 177–193. [Google Scholar] [CrossRef] [Scilit]
  11. Hirai, M., & Clum, G. A. (2000). Development, reliability, and validity of the beliefs toward mental illness scale. Journal of Psychopathology and Behavioral Assessment, 22(3), 221–236. [Google Scholar] [CrossRef] [Scilit]
  12. Hollon, S. D., & Kendall, P. C. (1980). Cognitive self-statements in depression: Development of an automatic thoughts questionnaire. Cognitive Therapy and Research, 4(4), 383–395. [Google Scholar] [CrossRef] [Scilit]
  13. Hopp, A., Dechering, S., Wilm, S., Pressentin, M., Müller, T., Richter, P., Schäfer, R., Franz, M., & Karger, A. (2023). The influence of patient-centered teaching on medical students’ stigmatization of the mentally ill. GMS Journal for Medical Education, 40(4), Doc46. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  14. Karatepe, H. T., Yavuz, F. K., & Türkcan, A. (2013). Validity and reliability of the Turkish version of the ruminative thought style questionnaire. Klinik Psikofarmakoloji Bülteni-Bulletin of Clinical Psychopharmacology, 23(3), 231–241. [Google Scholar] [CrossRef] [Scilit]
  15. Kart, A., Yücens, B., & Türkçapar, H. (2020). Kaygı düşünceleri envanteri Türkçe formunun geçerlik ve güvenirlik çalışması. Bilişsel Davranışçı Psikoterapi ve Araştırmalar Dergisi, 9(3), 196–201. [Google Scholar] [CrossRef] [Scilit]
  16. Kerby, J., Calton, T., Dimambro, B., Flood, C., & Glazebrook, C. (2008). Anti-stigma films and medical students’ attitudes towards mental illness and psychiatry: Randomised controlled trial. Psychiatric Bulletin, 32(9), 345–349. [Google Scholar] [CrossRef] [Scilit]
  17. Knaak, S., Mantler, E., & Szeto, A. (2017). Mental illness-related stigma in healthcare: Barriers to access and care and evidence-based solutions. Healthcare Management Forum, 30(2), 111–116. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  18. Kraft, M. A. (2020). Interpreting effect sizes of education interventions. Educational Researcher, 49(4), 241–253. [Google Scholar] [CrossRef] [Scilit]
  19. Kuznetsova, A., Brockhoff, P. B., & Christensen, R. H. B. (2017). lmerTest package: Tests in linear mixed effects models. Journal of Statistical Software, 82(13), 1–26. [Google Scholar] [CrossRef] [Scilit]
  20. Lovibond, S. H., & Lovibond, P. F. (1995). Manual for the depression anxiety stress scales (2nd ed.). Psychology Foundation of Australia. [Google Scholar]
  21. Manley, A. E., Biddle, L., Savović, J., & Moran, P. (2024). Changing medical student perceptions of mental illness through a psychiatry clinical clerkship: A longitudinal qualitative study. Academic Psychiatry, 48(6), 570–580. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  22. Mannarini, S., Taccini, F., Sato, I., & Rossi, A. A. (2022). Understanding stigma toward schizophrenia. Psychiatry Research, 318, 114970. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  23. Mor, N., Hertel, P., Ngo, T. A., Shachar, T., & Redak, S. (2014). Interpretation bias characterizes trait rumination. Journal of Behavior Therapy and Experimental Psychiatry, 45(1), 67–73. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  24. Papish, A., Kassam, A., Modgill, G., Vaz, G., Zanussi, L., & Patten, S. B. (2013). Reducing the stigma of mental illness in undergraduate medical education: A randomized controlled trial. BMC Medical Education, 13, 141. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  25. R Core Team. (2025). R: A language and environment for statistical computing (Version 4.5.1) [Computer software]. R Foundation for Statistical Computing. Available online: https://www.R-project.org/ (accessed on 8 August 2026).
  26. Rosseel, Y. (2012). lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48(2), 1–36. [Google Scholar] [CrossRef] [Scilit]
  27. Thornicroft, G., Mehta, N., Clement, S., Evans-Lacko, S., Doherty, M., Rose, D., Koschorke, M., Shidhaye, R., O’Reilly, C., & Henderson, C. (2016). Evidence for effective interventions to reduce mental-health-related stigma and discrimination. The Lancet, 387(10023), 1123–1132. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  28. Vilar Queirós, R., Santos, V., & Madeira, N. (2021). Decrease in stigma towards mental illness in Portuguese medical students after a psychiatry course. Acta Médica Portuguesa, 34(7–8), 498–506. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  29. Watkins, E. R. (2008). Constructive and unconstructive repetitive thought. Psychological Bulletin, 134(2), 163–206. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  30. Wells, A. (1994). A multi-dimensional measure of worry: Development and preliminary validation of the anxious thoughts inventory. Anxiety, Stress, & Coping, 6(4), 289–299. [Google Scholar] [CrossRef] [Scilit]
  31. Wells, A., Gwilliam, P., & Cartwright-Hatton, S. (2001). The thought fusion instrument [Unpublished scale]. University of Manchester.
  32. Whitmer, A. J., & Gotlib, I. H. (2012). Switching and backward inhibition in major depressive disorder: The role of rumination. Journal of Abnormal Psychology, 121(3), 570–578. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  33. Wu, H., & Estabrook, R. (2016). Identification of confirmatory factor analysis models of different levels of invariance for ordered categorical outcomes. Psychometrika, 81(4), 1014–1045. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  34. Yılmaz, Ö., Boz, H., & Arslan, A. (2017). Depresyon anksiyete stres ölçeğinin (DASS 21) Türkçe kısa formunun geçerlilik-güvenilirlik çalışması. Finans Ekonomi ve Sosyal Araştırmalar Dergisi, 2(2), 78–91. [Google Scholar]
  35. Zavorotnyy, M., Klatte, S., Yang, Y., Liu, W., Wagner, U., & Kircher, T. (2023). The effects of a psychiatric clerkship on stigmatizing attitudes toward mental disorders as held by German medical students. Frontiers in Psychiatry, 14, 1306403. [Google Scholar] [CrossRef] [Scilit] [PubMed]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Article Metrics

Citations

Article Access Statistics

Multiple requests from the same IP address are counted as one view.