Next Article in Journal
Attachment and Relational Dynamics in Residential Care Contexts: Perceptions of Reference Adults and Implications for Resilience
Previous Article in Journal
Exploratory Longitudinal Associations Between SAPs and Individual and Contextual Variables: Toward the Development of Educational Guidelines
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Development of the Nurses’ Attitudes Toward Violence by Patients and Patients’ Relatives Scale: A Methodological Study

1
Vocational School, Atlas University, 34403 Istanbul, Türkiye
2
Department of Nursing Management, Florence Nightingale Faculty of Nursing, Istanbul University-Cerrahpasa, 34320 Istanbul, Türkiye
*
Author to whom correspondence should be addressed.
Retired.
Behav. Sci. 2026, 16(9), 1665; https://doi.org/10.3390/bs16091665
Submission received: 27 July 2026 / Revised: 10 September 2026 / Accepted: 13 September 2026 / Published: 16 September 2026

Abstract

Violence against nurses is a global occupational health and safety issue, yet instruments that assess nurses’ attitudes towards violence from patients and their relatives are limited. This methodological study involved the development and evaluation of the Nurses’ Attitudes Towards Violence by Patients and Patients’ Relatives Scale. In the qualitative phase, 39 nurses were interviewed in depth until data saturation was reached, generating a pool of 61 items. Content validity with 15 experts (CVI = 0.90) yielded a draft of 57 items. The original quantitative sample (N = 608) was randomly divided into exploratory (n = 304) and confirmatory (n = 304) subsamples. Principal axis factoring with ProMax rotation supported a 36-item, three-factor solution that explained 52.3% of the common variance. This solution comprised the following factors: perception and causes of violence (20 items); effects of violence (13 items); and response to violence (3 items). In the original confirmatory subsample, the final model with six theory-based residual covariances was subjected to WLSMV confirmatory factor analysis, showing an overall acceptable fit (χ2(585) = 1297.5, χ2/df = 2.22, CFI = 0.900, TLI = 0.892, RMSEA = 0.063 [90% CI 0.059–0.068], SRMR = 0.093). A robustness wave involving 45 additional nurses, conducted between 27 August and 2 September 2026, produced almost identical results when combined with the confirmatory subsample (n = 349). Supplementary analyses supported composite reliability and discriminant validity, and found that measurement invariance was supported across institution type, whereas findings regarding sex invariance were interpreted as preliminary. In the original sample of N = 608, Cronbach’s α was 0.943, 0.930 and 0.842 for the three factors, and 0.950 for the total scale. Two-week test–retest reliability was r = 0.976. The scale provides a multidimensional measure of nurses’ evaluative-attributional beliefs, perceived effects and responses to violence from patients and relatives.

1. Introduction

Violence against healthcare workers is widespread and constitutes a significant occupational safety issue (Fiorino et al., 2026; Mahmoudi et al., 2026). It attracts considerable attention because it has an adverse effect on healthcare workers (Dopelt et al., 2022). Furthermore, violent incidents disrupt care processes, hindering the effective delivery of healthcare services (Seddik et al., 2023).
Violence is a multidimensional concept that can be interpreted in different ways in legal, clinical, public health and experiential contexts. While legal definitions depend on whether particular behaviours meet established legal thresholds, lived experience encompasses a broader range of behaviours that are perceived as hostile, coercive, harmful or intimidating. In this study, violence perpetrated by patients and their relatives was defined in accordance with the framework developed by the International Labour Organization (ILO), the International Council of Nurses (ICN), the World Health Organization (WHO) and Public Services International (PSI) to address workplace violence in the healthcare sector. Accordingly, violence encompasses both physical and psychological forms, including verbal abuse and threats, as perceived and reported by nurses. This operational definition recognises that nurses’ experiences and interpretations of violence may not always align directly with formal or legal definitions, and therefore these definitions should be taken into account when interpreting the findings.
According to meta-analysis data, 62% of healthcare workers encountered patient or visitor violence in the previous year. According to a WHO report (2020), between 8% and 38% of healthcare workers experience physical violence at some point in their careers. The number of healthcare workers subjected to verbal assault or threats is even higher than these figures suggest (Liu et al., 2019; World Health Organization, 2022). The prevalence of violence at this level highlights the need for a comprehensive approach to addressing its impacts, causes and prevention.
Nurses, numbering approximately 28 million and forming the majority of the entire healthcare workforce (World Health Organization, 2020), are at twice the risk of being subjected to violence and five times the risk of experiencing physical violence compared to physicians (Berger et al., 2024). Nevertheless, violence, most often perpetrated by patients and their relatives, is frequently perceived as a routine part of work in clinical settings (Alfuqaha et al., 2022; Berger et al., 2024; Connell et al., 2026). The normalisation of violence perpetrated by patients and visitors, coupled with a lack of knowledge about how to report it, fear of blame, a lack of support, feelings of hopelessness and the complexity of the reporting process, all hinder reporting of violence (Dunsford, 2022; Spencer et al., 2023; Elsharkawy et al., 2025; Lee et al., 2025). As more than 80% of violent incidents go unreported, access to detailed information about violence against nurses is limited (Christensen & Wilson, 2022; Mahmoudi et al., 2026).
According to research, the emergence of violence is influenced by various factors, including patient-related variables such as the severity of the illness, substance abuse or alcohol use (Pol et al., 2019; Perkins et al., 2020; Timmins & Timmins, 2021), psychiatric disorders (Salzmann-Erikson & Yifter, 2020), psychological issues and a history of violence (Cho et al., 2023). Employee youth or inexperience, as well as a lack of communication skills, are also contributing factors in cases of violence (Bagnasco et al., 2024; Yang et al., 2025). Environmental factors, particularly in emergency departments, such as long waiting times, continuous 24/7 services and high patient volumes, which put pressure on staff, can also trigger incivility (Wirth et al., 2021; Xie et al., 2025). Furthermore, systemic issues related to the healthcare system may cause such violence. The lack of legislation against violence in healthcare, the commercialisation of health services and inadequate access to healthcare can provoke tensions between patients and employees (Wu et al., 2022).
The ILO, ICN, WHO, and PSI have long emphasised the need for policies to prevent and address violence against healthcare workers (International Labour Office et al., 2002). Existing efforts have focused predominantly on managing violence rather than reducing it (Spelten et al., 2020; Timmins & Timmins, 2021).
For affected employees, violence can have long-term consequences such as sleep disturbances, stress, an increased desire to leave their job and burnout (Dunsford, 2022), as well as minor to severe physical injuries (Cho et al., 2023). Violence towards nurses also impacts caregiving processes. Following exposure to violence, nurses continue to provide patient care despite ethical concerns (Dunsford, 2022). They may then face the dilemma of either stopping or delaying care services in order to consider the patient’s needs (Aljohani et al., 2021; Hou et al., 2022), or of balancing personal safety with providing patient care (Beattie et al., 2020).
The international literature indicates that instruments designed to measure workplace violence primarily assess the frequency and types of violence experienced by healthcare workers, the reasons why such violence is not reported through legal channels, and the strategies employed to prevent it. Various instruments focusing on attitudes have been developed to evaluate these dimensions of the learning environment. One such instrument is the Factors Affecting Patient Aggression Scale (FAPAS), which was created by Lepiešová et al. (2021) to evaluate nurses’ perceptions of the factors that increase the risk of patient aggression. It is structured into six subscales: gender aspects; physical and emotional distress; nurse-related factors; nurse shift organisation factors; patient-related factors; and nursing environment factors. This scale addresses the antecedents of aggression rather than the nurses’ attitudinal responses.
The Hospital Violence Attitude Scale-18 (HVAS-18), developed by Ha et al. (2015), comprises 18 items distributed across five factors: awareness; response; reaction; and consequences for nursing and the perpetrator. However, it lacks an integrated framework for causal evaluation and behavioural responses. Similarly, the Perception of Aggression Scale (POAS), introduced by Jansen et al. (1997) and later re-evaluated for psychometric properties by Nam et al. (2022), focuses on nurses’ cognitive evaluations of aggression, but does not address its determinants or the strategies nurses use in response. Together, these instruments show that current attitude scales tend to focus on one dimension rather than providing a comprehensive tool that assesses violence, its perceived causes, and nurses’ behavioural or coping responses. This is evident in the FAPAS’s focus on perceived causes of aggression, the HVAS-18’s multifactorial yet response-centred structure, and the POAS’s exclusive cognitive evaluation approach.
Currently, there is no comprehensive scale that simultaneously assesses nurses’ attitudes towards violence by evaluating violence, identifying perceived causes and assessing the intervention or coping strategies employed. The scale developed in this study aims to address this issue by providing nurses with a multidimensional assessment tool for violence committed by patients and their relatives. By combining these three dimensions, this scale is anticipated to meet the measurement needs identified in the literature more effectively than existing instruments.
This study aimed to develop a measurement tool to assess nurses’ attitudes toward patient and patient-related violence. This study is based on the doctoral dissertation titled “Development of the Attitude Scale for Nurses Toward Patient and Patient Relative Violence,” completed in 2023 (Gür, 2023).

2. Materials and Methods

2.1. Design

This methodological study comprised two phases. In the first phase, a qualitative method was used to create an item pool. The second phase involved evaluating the validity and reliability of the developed measurement tool (Figure 1).

2.2. Phase 1: Creation of the Item Pool

2.2.1. Data Collection

This study applied a qualitative research method, which is frequently used in scale development studies and enables the collection of rich data (Neuman, 2014; Creswell, 2013/2016). Individual in-depth interviews were conducted with 39 nurses. After interviewing the 39th participant, it was evident that responses were becoming repetitive and no new substantive codes or themes were emerging. Consequently, data saturation was deemed to have been reached and the interviews were concluded.
Following the interviews, the written reports were systematically organised through coding and thematisation. Four main themes were identified: ‘Definition of violence’, ‘Violence in healthcare’, ‘Violence against nurses’, and ‘Prevention of violence in healthcare’. Thirteen sub-themes and 38 codes were then created from the texts under these themes (Gür, 2023).
Data were collected from the sample of hospitals using the snowball sampling method. Initial contact was made with intermediary nurses to identify participants who had experienced violence. After interviewing one nurse, individuals recommended by that nurse were contacted (Creswell, 2013/2021). The sample group was formed to ensure maximum diversity of the data. Interviews were scheduled with nurses who agreed to participate in the study. This approach is valued in qualitative research as it reduces the risk of selection bias (Malone et al., 2014). A semi-structured interview form containing 10 questions, which was prepared by the researcher with the help of literature, was used. The researcher recorded the interviews using a Sony digital voice recorder (Sony Corporation, Tokyo, Japan) and transcribed them verbatim. The audio recordings were transcribed verbatim on a computer.

2.2.2. Qualitative Analysis and Content Validity

The transcripts were analysed using Colaizzi’s (1978) inductive content analysis method. The recordings were transcribed verbatim and significant statements related to the phenomenon were identified. These statements were then coded and organised under sub-themes and themes. The fit between these themes and the original accounts was then checked and the fundamental structure of the phenomenon was described.
Two researchers coded the transcripts independently. First, each researcher reviewed and coded the transcripts separately. They then compared the resulting code lists, discussing any differences in wording, grouping or interpretation until consensus was reached. The two analyses showed considerable conceptual overlap, and the final codebook, sub-themes and themes were agreed upon jointly. No formal inter-coder reliability coefficient (e.g., Cohen’s kappa) was calculated; agreement was established through a consensus-based coding process, which is consistent with qualitative approaches that use negotiated agreement (O’Connor & Joffe, 2020).
Four main themes (‘definition of violence’, ‘violence in healthcare’, ‘violence against nurses’, and ‘prevention of violence in healthcare’), 13 sub-themes, and 38 codes were obtained (Gür, 2023). The items were written based on the participants’ own statements and were categorised under four content domains: perception of violence (10 items), causes of violence (20 items), responses to violence (14 items) and effects of violence (17 items), totalling 61 items.
The Davis Technique was employed to evaluate the content validity ratio (CVR) of the items. Opinions were obtained from fifteen experts in management, psychiatry, the Turkish language and scale evaluation. The experts rated each item on a scale from “appropriate” (4) to “not appropriate” (1) and provided suggestions. A CVR above 0.80 indicates appropriate content validity for scale items (Davis, 1992; Delgado-Rico et al., 2012). Based on the experts’ opinions and the CVR, two items (10 and 49) were removed due to a low CVR, one item (28) due to similarity, and one item (26) was deemed unnecessary. This reduced the number of draft scale items from 61 to 57. The scale was a 5-point Likert scale, with response options ranging from 1 (strongly disagree) to 5 (strongly agree).

2.3. Phase 2: Validity and Reliability Study

2.3.1. Sampling

To ensure maximum diversity, data were collected from three hospital groups: a Ministry of Health hospital, a university hospital and a private hospital, all of which were located in Istanbul, Turkey. Nurses working at the public university hospital were selected at random. Including participants with a wide variety of characteristics reduces sampling bias (DeVellis, 2017). The literature recommends that the sample size should be ten times the number of items on the scale. Since the draft scale consisted of 57 items, data were collected from at least 600 individuals (Watkins, 2018). Participants at the public university hospital were approached during working hours and the data collection tool was distributed by hand after consent was obtained. A total of 167 survey forms were collected from nurses on the same day; four declined to participate due to their workload. Nurses working in both private and public hospitals were contacted via Google Forms (Google LLC, Mountain View, CA, USA). Of those who responded to the consent question before the survey to indicate their acceptance of participation, 441 nurses were included in the study. A total of 608 datasets were obtained for the quantitative phase of the study.
Following peer review, an additional data collection exercise was conducted to evaluate the robustness of the confirmatory findings. Between 27 August and 2 September 2026, an additional 45 nurses (44 women and 1 man, with a mean age of 34.6 ± 8.6 years) completed the final 36-item form. The inclusion criteria and informed-consent procedure were the same as before, with 20 nurses coming from the university hospital, 17 from Ministry of Health hospitals and 8 from private hospitals. The supplementary data collection wave was conducted under the same ethics approval as it involved the same target population, inclusion criteria, data collection procedure and informed consent process as the original study. Additional participants were not included in the exploratory factor analysis or item-selection process; the original confirmatory subsample (n = 304) remained the primary CFA sample. The additional data were only used for supplementary robustness analyses, which involved combining them with the original confirmatory subsample (n = 349), and for supplementary measurement-invariance analyses (combined N = 653).

2.3.2. Construct Validity and Reliability

To avoid testing the factor structure on the sample from which it was derived, the original 608 questionnaires were randomly divided into two subsamples: an exploratory subsample of 304 and an independent confirmatory subsample of 304. This approach was taken in line with previous studies on the development of nursing scales (Çelebi Çakıroğlu & Baykal, 2021). The exploratory factor analysis, item-retention decisions and primary confirmatory analysis were based exclusively on the original sample. The 45 nurses recruited during the revision process only completed the final 36-item form, and their responses were used in supplementary robustness analyses (enlarged confirmatory sample, n = 349) and measurement-invariance analyses (combined N = 653). They did not contribute to the revision of the item composition or factor structure.
Exploratory factor analysis: Because the items were expected to reflect correlated latent attitudes rather than independent constructs, the common-factor model was used: principal axis factoring with promax rotation (κ = 4) (Watkins, 2018). Sampling adequacy was assessed using the Kaiser–Meyer–Olkin measure (≥0.70 for overall and item-level) and Bartlett’s test. The number of factors was determined using Horn’s (1965) parallel analysis (95th percentile of 300 random datasets), together with the interpretability of the rotated solution. Items were retained if their pattern coefficient on the primary factor was ≥0.40, if the difference from the largest secondary coefficient was ≥0.20, and if the item content was consistent with that of the other items in the same factor.
Confirmatory factor analysis: Because the items were five-point ordinal variables, several of which showed strong negative skewness and ceiling effects, the primary CFA was estimated using polychoric correlations with the diagonally weighted least squares (DWLS) estimator and mean- and variance-adjusted test statistics (WLSMV) in the original confirmatory subsample (n = 304). This is an appropriate estimator for ordinal indicators (Li, 2016). Maximum likelihood (ML) estimates were retained alongside WLSMV for comparability with the original submission and the wider scale-development literature. In response to the reviewer’s request for a fuller re-examination of the measurement model, competing models, residual diagnostics and theory-based residual covariances were evaluated in the enlarged robustness sample (n = 349). The fit of the final model was then compared directly with that obtained in the original confirmatory subsample. Residual covariances were admitted only between items belonging to the same factor that shared a specific content facet and had been presented consecutively in the questionnaire (Cole et al., 2007). Fit was evaluated with χ2(df), χ2/df, CFI, TLI, NFI, GFI, RMSEA with its 90% confidence interval, and SRMR; the indices were interpreted jointly rather than by treating conventional cutoffs as universal pass/fail rules (McNeish & Wolf, 2023).
Convergent and discriminant validity: Composite reliability (CR) and average variance extracted (AVE) were computed from the final model’s standardised loadings (Fornell & Larcker, 1981). Discriminant validity was assessed using the Fornell–Larcker criterion (where the square root of the AVE for each factor exceeds its correlations with the other factors) and the heterotrait–monotrait ratio of correlations (HTMT), with a conservative threshold of 0.85 (Henseler et al., 2015).
Measurement invariance: As a supplementary analysis requested by the reviewer, the configural, metric and scalar invariances of the final model were tested using multi-group confirmatory factor analysis (CFA) on the combined sample (N = 653), categorised by institution type (public: Ministry of Health and university hospitals vs. private hospitals) and sex. Invariance was accepted when the decrease in CFI did not exceed 0.010 and was accompanied by ΔRMSEA ≤ 0.015 and ΔSRMR ≤ 0.030 for metric invariance and ≤0.015 for scalar invariance (Chen, 2007). However, Δχ2 is oversensitive at this sample size and is therefore not reported. As the male subgroup was small (n = 70), sex-invariance findings were interpreted cautiously and as preliminary.
Reliability: The internal consistency of the final 36-item scale was primarily reported for the original scale-development sample (N = 608), using Cronbach’s α. To address possible redundancy in the items, supplementary evidence was included in the form of McDonald’s ω and mean inter-item correlations. The recommended range for constructs of moderate breadth is 0.15–0.50 (Clark & Watson, 2019). Inspection of highly correlated item pairs was also performed. Temporal stability was examined using a two-week test–retest procedure with 32 nurses.

2.4. Data Analysis

Qualitative data were analysed using Colaizzi’s (1978) inductive content analysis technique. Content validity indices were computed using the Davis (1992) technique. Descriptive statistics, item analysis, exploratory factor analysis and reliability coefficients were computed using IBM SPSS Statistics for Windows, Version 22.0 (IBM Corp., Armonk, NY, USA). ML confirmatory factor analyses and multi-group invariance models were computed using IBM SPSS Amos, Version 26.0 (IBM Corp., Armonk, NY, USA). Polychoric correlations, WLSMV confirmatory models, parallel analysis, CR, AVE and HTMT were computed using R, Version 4.6.1 (R Foundation for Statistical Computing, Vienna, Austria), with the lavaan (Rosseel, 2012) package, the psych (Revelle, 2024) package and the semTools (Jorgensen et al., 2022) package. Two data-entry errors in items not included in the final scale (one out-of-range value and one missing value) were replaced by the median value of the respective item. In this article, the authors used generative artificial intelligence (GenAI) only to make minor edits to the text (e.g., correcting grammar, spelling, punctuation and formatting).

3. Results

3.1. Descriptive Analyses

Of the nurses who participated in the original quantitative study, 57.9% were aged 30 or under (mean age = 32.17; standard deviation = 8.09). The majority were female (88.7%) and had a bachelor’s degree (75.8%). Participants worked in university hospitals (27.6%), Ministry of Health hospitals (41.3%) or private hospitals (31.1%). The 45 nurses in the second data-collection wave had a similar profile: 97.8% were women, with a mean age of 34.6 years, and 44.4% worked in a university hospital, 37.8% in a Ministry of Health hospital and 17.8% in a private hospital. In terms of professional experience, 63.8% of participants had worked for less than 10 years (mean = 9.51 years; SD = 8.24). Additionally, 64.3% had worked at their current institution for less than six years (M = 6.47 years; SD = 6.44) and 61.2% worked shifts.

3.2. Item Pool Construction

The scale items were developed through qualitative research. Four subcategories were identified and each item was allocated to the relevant sub-dimension. Fifteen experts assessed the 61 items on the draft scale using the Davis method. The experts were scholars specialising in Nursing Management, Psychiatric Nursing and Turkish Language, as well as individuals experienced in scale development. The CVI (Content Validity Index) was 0.90. Four items were eliminated due to similarity or because they were deemed unnecessary, leaving 57 items.

3.3. Validity and Reliability

The draft scale was used to collect data from participants. Data were collected from 608 nurses. Afterwards, validity and reliability tests were conducted on the data. To avoid introducing model-specific bias when performing both exploratory and confirmatory analyses on the same dataset, the database was randomly split into two. An EFA was performed on the first half of the dataset (n = 304) and a CFA on the model identified in the EFA was performed on the second half of the dataset (n = 304).

3.3.1. Exploratory Factor Analysis

In the exploratory subsample (n = 304), the 57-item draft underwent factor analysis using principal axis factoring and promax rotation. The sampling adequacy was excellent (KMO = 0.93, with an item-level KMO of at least 0.70, and a Bartlett chi-squared value of 7967.42, with a p-value of less than 0.001). Twenty-one items were subsequently removed because they did not load on any factor (items 4, 6, 25, 31, 34, 36, 37, 38, 41, 47, 52, 54 and 55); loaded below the retention criterion (items 5, 18, 20, 26, 33, 39 and 40); or were the weakest of four items belonging to a factor whose content was inconsistent with that of the remaining three items (Table 1).
For the remaining 36 items, parallel analysis clearly supported three factors (with eigenvalues of 14.37, 3.37 and 2.46, compared to 95th-percentile random eigenvalues of 1.80, 1.69 and 1.61). A fourth factor was only marginally more significant than its random counterpart (with an eigenvalue of 1.67 versus 1.55), and a four-factor solution was not interpretable. The three-factor solution explained 52.3% of the common variance (38.6%, 8.1%, and 5.6%). All items had their largest pattern coefficient on the expected factor (range 0.41–0.89); the largest secondary coefficient was 0.35; and communalities ranged from 0.27 to 0.69 (Table 2). The factors were named F1: Perception and causes of violence (20 items); F2: Effects of violence (13 items); and F3: Response to violence (three items). F1 and F2 were moderately correlated (r = 0.61), whereas F3 correlated weakly with F1 (r = 0.16) and F2 (r = 0.19).

3.3.2. Confirmatory Factor Analysis

The original confirmatory subsample (n = 304) was used to confirm the three-factor structure. Distributional diagnostics in the expanded robustness sample (n = 349) revealed significant non-normality and ceiling effects. All items were negatively skewed, except for the three response items. Notably, 87.4% of respondents selected ‘strongly agree’ for item 1, 77.7% for item 2, and 76.5% for item 16. Univariate skewness ranged from −4.54 to 0.47, kurtosis from −0.94 to 22.19, and Mardia’s normalised multivariate kurtosis was 46.9. Accordingly, WLSMV estimates were used primarily for the ordinal items. Figure 2 and Figure 3 show the initial and final three-factor models for the original confirmatory subsample. Table 3 reports the full competing-model re-estimation in the enlarged robustness sample, as well as the direct final-model comparison between n = 304 and n = 349.
In the expanded robustness sample (n = 349), the initial three-factor model (Model B) fit the data substantially better than the one-factor model, although the CFI remained below the conventional criterion (WLSMV CFI = 0.871, RMSEA = 0.072). Examining the standardised residuals and modification indices revealed a small number of theoretically interpretable within-factor item pairs, primarily among the initial normative statements and items with closely related content. The factor correlations were low to moderate (0.21–0.59), indicating that the remaining misfit was not due to factor redundancy. A four-factor model that separated perception from causes (Model C) produced only a modest improvement and did not yield a clearly distinct additional factor.
The final model (Model D) retained the three-factor structure and included six residual covariances based on theory between items with shared content within the same factor (Table 4). In the enlarged robustness sample, this model exhibited an acceptable overall fit under the weighted least squares mean and variance (WLSMV) estimator: χ2(585) = 1364.5, χ2/df = 2.33, CFI = 0.905, TLI = 0.898, root mean square error of approximation (RMSEA) = 0.062 [90% confidence interval (CI) 0.058–0.066], and standardised root mean square residual (SRMR) = 0.089. Notably, the same model produced highly comparable results in the original confirmatory subsample (n = 304): χ2(585) = 1297.5, χ2/df = 2.22, CFI = 0.900, TLI = 0.892, RMSEA = 0.063 [90% CI 0.059–0.068] and SRMR = 0.093. These highly similar results suggest that the conclusions drawn from the final model remained essentially unchanged following the inclusion of the additional cases. A more extensively modified model (Model E) produced only a small additional improvement in CFI (ΔCFI = 0.008), so it was not retained. All standardised factor loadings in the final model were statistically significant, and the original 36-item structure was retained.

3.3.3. Convergent and Discriminant Validity

In the expanded robustness sample, the composite reliability score was high for all three factors (CR = 0.89–0.93). AVE was 0.74 for factor 3 (F3), approximately 0.50 for factor 2 (F2), and 0.40 for factor 1 (F1). Convergent validity was strongest for factor 3 (F3), while the AVE values for factors 1 (F1) and 2 (F2) were interpreted cautiously. Discriminant validity was supported as the square root of the AVE for each factor exceeded the corresponding inter-factor correlation, and all HTMT values were below 0.85 (Table 5). The original confirmatory subsample showed the same overall pattern.

3.3.4. Measurement Invariance

In the combined sample (N = 653), changes in the fit indices met the pre-specified criteria for both metric and scalar invariance across institution type (ΔCFI = −0.005 and −0.009, respectively). Metric invariance was supported across sex (ΔCFI = −0.005), whereas full scalar invariance was only just supported (ΔCFI = −0.011). Allowing the intercept of item 25 to vary resulted in partial scalar invariance (ΔCFI = −0.009). As the male subgroup was small (n = 70), the sex-invariance findings should be considered preliminary (Table 6).

3.3.5. Reliability

Internal consistency was primarily evaluated in the original scale-development sample (N = 608). Cronbach’s α was 0.943 for F1 (Perception and causes of violence), 0.930 for F2 (Effects of violence), 0.842 for F3 (Response to violence), and 0.950 for the total scale. Supplementary analyses conducted in response to the reviewer’s concern regarding possible item redundancy showed McDonald’s ω values of 0.89–0.93 across the three factors. Mean inter-item correlations were 0.40 for F1, 0.44 for F2, and 0.65 for F3. Only one item pair (items 1 and 2, r = 0.87) exceeded 0.75, suggesting that the high α of F1 was not attributable to widespread item redundancy, although local similarity between these two items was noted. Temporal stability was high, with a two-week test–retest correlation of r = 0.976 (p < 0.001) in 32 nurses.
Subscale scores are calculated as item means, ranging from 1 to 5. An increasing mean score in the first dimension (F1: Perception and causes of violence) indicates a stronger perception of violence and a greater recognition of perceived contributing factors. An increase in the mean score in the second dimension (F2: Effects of violence) suggests that nurses are being affected more severely by violence from patients and their relatives. An increase in the mean score in the third dimension (F3: Response to violence) indicates greater endorsement of the response patterns represented by the three retained items. As no empirical cut-off scores were established, subscale scores should be interpreted dimensionally rather than categorised as low or high. Due to the weak correlations between F3 and F1 and F2, it is recommended that subscale scores are interpreted rather than relying on a single total score.

4. Discussion

This study developed and validated the Nurses’ Attitudes Toward Violence by Patients and Patients’ Relatives Scale, a 36-item instrument with three dimensions grounded in nurses’ own accounts of violence in Turkish hospitals. Rather than restating the methods, we discuss here what the final structure means, why it differs from the four-domain framework that guided item writing, how the fit and validity evidence should be read, and what the instrument adds to the existing measures.

4.1. Meaning of the Three Dimensions

The first dimension, ‘Perception and causes of violence’, captures a set of evaluative-attributional beliefs: that violence is categorically unacceptable; that it has become normalised in healthcare; and that it is produced by identifiable antecedents located in patients and relatives (e.g., intoxication, negative previous experiences and misperceptions about neglect); in the nurse’s role (e.g., accessibility, enforcing rules and an inability to attend due to workload); and in the institution and society (e.g., inadequate security and sanctions, media image and emergency department crowding). This dimension therefore reflects the themes of ‘violence in healthcare’ and ‘violence against nurses’ from the qualitative phase, and is conceptually similar to the attribution-based factors of the Perception of Aggression Scale (POAS; Jansen et al., 1997). However, it is based on situations that nurses themselves described.
The second dimension, ‘Effects of violence’, spans emotional consequences (e.g., fear, anticipatory anxiety and feelings of helplessness), behavioural consequences (e.g., avoiding the violent patient, not entering the room alone and raising a code white) and professional identity consequences (e.g., feeling that one’s profession is worthless and that effort goes unrewarded, and loss of trust in people). The strongest indicators are anticipatory fear at work and fear of being followed. This mirrors the finding that the psychological consequences of workplace violence experienced by nurses are dominated by fear and hypervigilance rather than physical injury (Hou et al., 2022).
The third dimension, Response to violence, comprises three behaviours—remaining silent so that the incident does not escalate, ignoring negative remarks, and hesitating to react. Although the original factor label was retained, the three items predominantly represent passive or avoidant response tendencies. Higher scores therefore indicate greater endorsement of the response patterns captured by these items. The relatively weak correlations of F3 with F1 and F2 (0.21 and 0.32, respectively) suggest that responses to violence represent a comparatively distinct aspect of nurses’ attitudes toward violence.

4.2. Final Factor Structure

The item pool was initially organised under four content domains (perception, causes, response, and effects); however, the perception and causes domains did not emerge as clearly distinct factors. In the exploratory analysis, items from these two domains loaded on a single factor. Consistent with this finding, a forced four-factor model showed a correlation between the perception and causes factors ranging from 0.49 (ML) to 0.70 (WLSMV) in the confirmatory sample. Furthermore, only the three normative statements presented at the beginning of the questionnaire (items 1–3) substantially loaded onto the separate perception factor, while the remaining perception items had loadings below 0.45. When a fourth factor was extracted in the exploratory sample, it consisted primarily of the seven most strongly endorsed items (means 4.1–4.7) rather than mapping clearly onto a prespecified content domain; the three-factor solution was therefore retained on interpretability grounds. Conceptually, the idea of merging the two is plausible. Statements such as ‘violence in healthcare has become normalised’ or ‘nurses experience more violence than other healthcare workers’ are perceptions of violence and attributions of its causes. The nurses interviewed described what violence is and why it happens within the same narratives. We therefore interpret the first dimension as a single evaluative-attributional belief system. However, the three initial normative items share specific variance beyond this system. This is why their residual covariances were modelled. They are retained because they are anchored in the universal condemnation of violence expressed by every interviewee, and because removing them does not alter the fit of the model.

4.3. The Three-Item Response Dimension

The response domain initially included 14 items representing a range of strategies, such as seeking help, raising a code white, remaining calm, leaving the scene, pursuing legal rights, and remaining silent. These behaviours represent heterogeneous ways of responding to violence and did not converge on a single common factor. During factor analysis, several items were removed because of low or split loadings, while “raising a code white” loaded with the Effects of violence dimension. The three items retained in the Response to violence factor represent a narrower pattern characterised mainly by remaining silent, ignoring negative remarks, and hesitating to react.
In the original quantitative sample (N = 608), the mean scores were 2.49 (SD = 1.30) for remaining silent to prevent escalation, 2.57 (SD = 1.26) for ignoring negative remarks and 2.44 (SD = 1.28) for hesitating to react. As all three mean scores were below the midpoint (3) of the 1–5 response scale, the sample generally did not favour passive/avoidant response patterns.
Despite comprising only three items, this factor exhibited strong and consistent coefficients in both the exploratory and confirmatory analyses (EFA loadings = 0.72–0.79; WLSMV loadings = 0.83–0.89). The CR was 0.89 and the AVE was 0.74. While these findings support the internal coherence of the retained items, they also indicate that the factor captures a relatively narrow range of responses. Future studies may examine whether additional active-response items could broaden this dimension without compromising its factorial coherence. It is important to note that this factor does not indicate that nurses in the sample generally showed a ‘weak’ response to violence; rather, it reflects endorsement of the specific response patterns represented by the three retained items.

4.4. Interpreting Model Fit

The initial model misfit was concentrated in a limited number of same-factor item pairs with closely related content. After six theoretically justified residual covariances were added, the final WLSMV model showed overall acceptable fit in the original confirmatory subsample (CFI = 0.900, TLI = 0.892, RMSEA = 0.063, SRMR = 0.093). Highly comparable results were obtained in the enlarged robustness sample (CFI = 0.905, TLI = 0.898, RMSEA = 0.062, SRMR = 0.089), indicating that the overall interpretation of the model remained stable after inclusion of the additional cases. Although TLI remained slightly below 0.90, the fit indices were interpreted jointly rather than as evidence of excellent fit. WLSMV was treated as the primary estimator because of the ordinal and markedly non-normal item distributions, while ML results were retained for transparency and comparability. A sensitivity model with six additional residual covariances produced only a small improvement and was not retained, thereby limiting further data-driven modification.

4.5. Reliability, Validity, and Invariance

The high alpha of the first dimension in the original sample (α = 0.943) was examined directly rather than treated as evidence of superior reliability. In supplementary analyses, its mean inter-item correlation was 0.40, within the range recommended for constructs of moderate breadth (Clark & Watson, 2019), and only items 1 and 2 showed a consistently very high association. Their shared specific variance was modelled explicitly in the CFA. Thus, the findings do not indicate widespread redundancy across F1, although the local similarity of the opening normative items is acknowledged. As reported above, composite reliability was high, while the AVE of F1 remained below the conventional 0.50 benchmark. Rather than treating this as license to overlook the shortfall—composite reliability being a less conservative estimate that can mask a substantial share of error variance (Fornell & Larcker, 1981)—item loadings were all statistically significant, and inspection confirmed no single indicator was disproportionately relatively small number of male participants responsible for the low AVE. Discriminant validity was nonetheless supported by both the Fornell–Larcker and HTMT results, the latter considered more robust under marginal-AVE conditions (Henseler et al., 2015). Supplementary invariance analyses supported institution-type comparisons, whereas the sex-invariance findings remain preliminary given the small male subgroup (n = 70) and should be interpreted with caution pending replication in more balanced samples.
An additional interpretive consideration pertains to the construct itself. As highlighted in the Introduction, there is a potential divergence between formal definitions of violence and those based on lived experiences. The current scale was intentionally developed based on the latter; it includes items that reflect behaviors identified as violent by nurses during the qualitative phase, rather than adhering to a predetermined legal or clinical standard. Consequently, scores should be interpreted as representing the nurses’ own threshold for violence, which is influenced by cultural norms, previous exposure, and the type of behavior. It is important to note that physical acts are more readily classified than psychological or verbal ones. Therefore, cross-context comparisons should take this into account.

4.6. Contribution and Use of the Scale

Existing instruments primarily assess exposure to workplace violence or attitudes toward aggression in specific clinical settings, such as the POAS and HVAS-18. The present scale differs by being developed from nurses’ own accounts of violence by patients and relatives and by integrating evaluative-attributional beliefs, perceived effects, and responses to violence within a single instrument. Supplementary analyses also provided support for measurement invariance across institution type, although further validation in different samples is warranted.
The scale does not assess the frequency of violence exposure or the full range of coping strategies and should not be regarded as a diagnostic tool. It may be used to examine nurses’ attitudes toward violence across units or institutions, to evaluate changes following violence-prevention interventions, and as a measure in studies examining related outcomes such as reporting behaviour or turnover intention.

4.7. Limitations

This study has several limitations. Participants were recruited from hospitals in a single city, which may limit the generalisability of the findings. In the quantitative phase, part of the sample was reached through an online form, which may have introduced self-selection bias. The relatively small number of male participants (n = 70) also limited the strength of the sex-invariance analysis. As discussed in Section 4.5, the scale’s reliance on nurses’ self-perceived definition of violence, rather than a fixed legal or clinical criterion, should also be considered when interpreting and comparing scores across contexts. Model fit was stronger with the ordinal WLSMV estimator than with ML; in the original confirmatory subsample, CFI reached 0.900 whereas TLI remained slightly below 0.90. In addition, the final model included six theoretically justified residual covariances, which should be re-examined in future independent samples. Future studies should further examine criterion-related validity, measurement invariance, and the scale’s performance in larger and more diverse samples. Although the qualitative phase specifically included nurses with direct experience of violence, the quantitative phase did not classify or compare participants according to their prior exposure to violence. Future studies should examine whether scale scores differ according to the type and history of exposure.

5. Conclusions

The Nurses’ Attitudes Towards Violence by Patients and Patients’ Relatives Scale is a 36-item, three-dimensional instrument based on nurses’ own experiences and supported by exploratory and confirmatory evidence obtained from independent subsamples of the original study of 608 participants. The WLSMV confirmatory results were highly comparable in a supplementary robustness analysis that included an additional 45 nurses. The three dimensions—Perception and Causes of Violence, Effects of Violence, and Response to Violence—can be scored separately and represent distinct yet related aspects of nurses’ attitudes towards violence. The scale provides researchers and nurse managers with a multidimensional tool with which to examine how nurses perceive, are affected by, and respond to violence from patients and their relatives.
As the current sample was recruited exclusively from hospitals in Istanbul, it is recommended that further cross-cultural validation studies be conducted in different geographical regions, healthcare settings, cultural contexts and specialised clinical units, in order to confirm the scale’s psychometric properties and examine how attitudes towards violence may vary across organisational, cultural and individual contexts.

Author Contributions

Conceptualization, D.G. and Ü.B.; Methodology, D.G. and Ü.B.; Software, D.G.; Validation, D.G. and Ü.B.; Formal Analysis, D.G. and Ü.B.; Investigation, D.G.; Resources, D.G.; Data Curation, D.G. and Ü.B.; Writing—Original Draft Preparation, D.G.; Writing—Review and Editing, D.G. and Ü.B.; Visualization, D.G.; Supervision, D.G. and Ü.B.; Project Administration, D.G. and Ü.B. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding. The Article Processing Charge (APC) will be covered by Istanbul Atlas University.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki. Ethical approval for the study was obtained from the Istanbul University-Cerrahpaşa Social and Human Sciences Research Ethics Committee (Decision No. 2021/28, dated 8 March 2021). Institutional approval was also obtained from the university hospital included in the study group. Written and verbal consent was obtained from participants during data collection. The supplementary data-collection wave was conducted under the same ethics approval because it followed the same approved study population and data-collection procedures.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data supporting the findings of this study are available from the corresponding author upon reasonable request. The data are not publicly available due to privacy considerations relating to the sensitive nature of the participant-level data on workplace violence (including qualitative interview data) and to protect the confidentiality of the participants.

Conflicts of Interest

The authors declare no conflicts of interest.

Abbreviations

The following abbreviations are used in this manuscript:
CVIContent Validity Index
ILOThe International Labour Organization
ICNInternational Council of Nurses
WHOWorld Health Organization
PSIPublic Services International
CVRcontent validity ratio
EFAExploratory Factor Analysis
CFAConfirmatory Factor Analysis
x2/dfChi-square goodness of fit index
RMSEARoot Mean Square Error of Approximation
CFIComparative Fit Index
NFINormed Fit Index
SRMRStandardized Root Mean Square Residual
TLITucker–Lewis Index
GFIGoodness of Fit Index
WLSMVWeighted Least Squares Mean- and Variance-adjusted
MLMaximum Likelihood
PAFPrincipal Axis Factoring
CRComposite Reliability
AVEAverage Variance Extracted
HTMTHeterotrait–Monotrait ratio
MIModification Index
POASPerception of Aggression Scale
HVAS-18Hospital Violence Attitude Scale-18

References

  1. Alfuqaha, O. A., Albawati, N. M., Alhiary, S. S., Alhalaiqa, F. N., Haha, M. F. F., Musa, S. S., Shunnar, O., & Al Thaher, Y. (2022). Workplace violence among healthcare providers during the COVID-19 health emergency: A cross-sectional study. Behavioral Sciences, 12(4), 106. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  2. Aljohani, B., Burkholder, J., Tran, Q. K., Chen, C., Beisenova, K., & Pourmand, A. (2021). Workplace violence in the emergency department: A systematic review and meta-analysis. Public Health, 196, 186–197. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  3. Bagnasco, A., Catania, G., Pagnucci, N., Alvaro, R., Cicolini, G., Dal Molin, A., Lancia, L., Lusignani, M., Mecugni, D., Motta, P. C., Watson, R., Hayter, M., Timmins, F., Aleo, G., Napolitano, F., Signori, A., Zanini, M., Sasso, L., Mazzoleni, B., & CEASE-IT Working Group. (2024). Protective and risk factors of workplace violence against nurses: A cross-sectional study. Journal of Clinical Nursing, 33(11–12), 4748–4758. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  4. Beattie, J., Innes, K., Griffiths, D., & Morphet, J. (2020). Workplace violence: Examination of the tensions between duty of care, worker safety, and zero tolerance. Health Care Management Review, 45(3), E13–E22. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  5. Berger, S., Grzonka, P., Frei, A. I., Hunziker, S., Baumann, S. M., Amacher, S. A., Gebhard, C. E., & Sutter, R. (2024). Violence against healthcare professionals in intensive care units: A systematic review and meta-analysis of frequency, risk factors, interventions, and preventive measures. Critical Care, 28, 61. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  6. Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling, 14(3), 464–504. [Google Scholar] [CrossRef] [Scilit]
  7. Cho, Y., Lim, K., & Kim, H. (2023). Patient violence towards mental health nurses: A concept analysis. Perspectives in Psychiatric Care, 2023, 9496021. [Google Scholar] [CrossRef] [Scilit]
  8. Christensen, S. S., & Wilson, B. L. (2022). Why nurses do not report patient aggression: A review and appraisal of the literature. Journal of Nursing Management, 30(6), 1759–1767. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  9. Clark, L. A., & Watson, D. (2019). Constructing validity: New developments in creating objective measuring instruments. Psychological Assessment, 31(12), 1412–1427. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  10. Colaizzi, P. F. (1978). Psychological research as the phenomenologist views it. In R. S. Valle, & M. King (Eds.), Existential-phenomenological alternatives for psychology (pp. 48–71). Oxford University Press. [Google Scholar]
  11. Cole, D. A., Ciesla, J. A., & Steiger, J. H. (2007). The insidious effects of failing to include design-driven correlated residuals in latent-variable covariance structure analysis. Psychological Methods, 12(4), 381–398. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  12. Connell, K. A., Byers, J. G., & Muir, K. J. (2026). Workplace violence against nurses is a patient safety crisis, not “part of the job”. Health Affairs Scholar, 4(4), qxag077. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  13. Creswell, J. W. (2016). Nitel araştırma yöntemleri: Beş yaklaşıma göre nitel araştırma ve araştırma deseni [Qualitative inquiry and research design: Choosing among five approaches] (M. Bütün, & S. B. Demir, Eds. & Trans.; 3rd ed.). Siyasal Kitabevi. (Original work published 2013). [Google Scholar]
  14. Creswell, J. W. (2021). Nitel araştırma yöntemleri: Beş yaklaşıma göre nitel araştırma ve araştırma deseni [Qualitative inquiry and research design: Choosing among five approaches] (S. B. Demir, & M. Bütün, Eds. & Trans.). Siyasal Kitabevi. (Original work published 2013). [Google Scholar]
  15. Çelebi Çakıroğlu, O., & Baykal, Ü. (2021). Development and psychometric properties of the attitude scale towards female workers in healthcare settings. Journal of Advanced Nursing, 77(7), 3238–3253. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  16. Davis, L. L. (1992). Instrument review: Getting the most from a panel of experts. Applied Nursing Research, 5(4), 194–197. [Google Scholar] [CrossRef] [Scilit]
  17. Delgado-Rico, E., Carretero-Dios, H., & Ruch, W. (2012). Content validity evidences in test development: An applied perspective. International Journal of Clinical and Health Psychology, 12(3), 449–460. [Google Scholar]
  18. DeVellis, R. F. (2017). Scale development: Theory and applications (4th ed.). SAGE. [Google Scholar]
  19. Dopelt, K., Davidovitch, N., Stupak, A., Ben Ayun, R., Lev Eltsufin, A., & Levy, C. (2022). Workplace violence against hospital workers during the COVID-19 pandemic in Israel: Implications for public health. International Journal of Environmental Research and Public Health, 19(8), 4659. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  20. Dunsford, J. (2022). Nursing violent patients: Vulnerability and the limits of the duty to provide care. Nursing Inquiry, 29(2), e12453. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  21. Elsharkawy, N. B., Alruwaili, A. N., Elsayed Ramadan, O. M., Alruwaili, M. M., Alhaiti, A., & Abdelaziz, E. M. (2025). Barriers to reporting workplace violence: A qualitative study of nurses’ perceptions in tertiary care settings. BMC Nursing, 24, 395. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  22. Fiorino, F. S., Oliveri, C., Vivarelli, S., & Fenga, C. (2026). The rising tide of workplace violence in the healthcare sector: A global scoping review of burden, determinants, and prevention strategies (2021–2025). Frontiers in Public Health, 14, 1851734. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  23. Fornell, C., & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39–50. [Google Scholar] [CrossRef] [Scilit]
  24. Gür, D. (2023). Hemşirelerin hasta ve hasta yakını şiddetine yönelik tutumu ölçeğinin geliştirilmesi [Development of the attitude scale toward violence by patients and their relatives against nurses] [Doctoral dissertation, Istanbul University-Cerrahpasa]. CoHE Thesis Center, Thesis No. 818620. [Google Scholar]
  25. Ha, E.-H., Cho, J.-Y., & Kim, J.-M. (2015). Development and validation of the Hospital Violence Attitude Scale-18 (HVAS-18) for clinical nurses. Korean Journal of Adult Nursing, 27(1), 39–51. [Google Scholar] [CrossRef] [Scilit]
  26. Henseler, J., Ringle, C. M., & Sarstedt, M. (2015). A new criterion for assessing discriminant validity in variance-based structural equation modeling. Journal of the Academy of Marketing Science, 43(1), 115–135. [Google Scholar] [CrossRef] [Scilit]
  27. Horn, J. L. (1965). A rationale and test for the number of factors in factor analysis. Psychometrika, 30(2), 179–185. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  28. Hou, Y., Corbally, M., & Timmins, F. (2022). Violence against nurses by patients and visitors in the emergency department: A concept analysis. Journal of Nursing Management, 30(6), 1688–1699. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  29. International Labour Office, International Council of Nurses, World Health Organization & Public Services International. (2002). Framework guidelines for addressing workplace violence in the health sector. International Labour Office. Available online: https://www.who.int/publications/i/item/9221134466 (accessed on 10 June 2026).
  30. Jansen, G. J., Dassen, T. W. N., & Moorer, P. (1997). The perception of aggression. Scandinavian Journal of Caring Sciences, 11(1), 51–55. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  31. Jorgensen, T. D., Pornprasertmanit, S., Schoemann, A. M., & Rosseel, Y. (2022). semTools: Useful tools for structural equation modeling (R package version 0.5-6). Available online: https://CRAN.R-project.org/package=semTools (accessed on 10 June 2026).
  32. Lee, J., Havaei, F., Hirani, S., & Adhami, N. (2025). Nurses’ workplace violence reporting behaviours and reasons for not formally reporting: A cross-sectional secondary analysis. Journal of Clinical Nursing, 34(10), 4235–4245. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  33. Lepiešová, M., Farský, I., Zanovitová, M., Čáp, J., Žiaková, K., & Kalánková, D. (2021). The factors affecting patient aggression scale: Psychometric testing of a new tool. Central European Journal of Nursing and Midwifery, 12(2), 342–352. [Google Scholar] [CrossRef] [Scilit]
  34. Li, C.-H. (2016). Confirmatory factor analysis with ordinal data: Comparing robust maximum likelihood and diagonally weighted least squares. Behavior Research Methods, 48(3), 936–949. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  35. Liu, J., Gan, Y., Jiang, H., Li, L., Dwyer, R., Lu, K., Yan, S., Sampson, O., Xu, H., Wang, C., Zhu, Y., Chang, Y., Yang, Y., Yang, T., Chen, Y., Song, F., & Lu, Z. (2019). Prevalence of workplace violence against healthcare workers: A systematic review and meta-analysis. Occupational and Environmental Medicine, 76(12), 927–937. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  36. Mahmoudi, F., Garmaroudi, G., Saniee, N., Razavi, N., Mosadeghrad, A. M., & Ashoorkhani, M. (2026). Causes of workplace violence against nurses and strategies for its prevention in developed countries: A scoping review. BMC Nursing, 25, 232. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  37. Malone, H., Nicholl, H., & Tracey, C. (2014). Awareness and minimisation of systematic bias in research. British Journal of Nursing, 23(5), 279–282. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  38. McNeish, D., & Wolf, M. G. (2023). Dynamic fit index cutoffs for confirmatory factor analysis models. Psychological Methods, 28(1), 61–88. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  39. Nam, S., Hong, S., Kim, H., Wong, J. Y. H., & Fong, D. Y. T. (2022). Reliability and validity of the Korean 12-item Perception of Aggression Scale. Journal of Psychiatric and Mental Health Nursing, 29(3), 442–450. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  40. Neuman, W. L. (2014). Social research methods: Qualitative and quantitative approaches (7th ed.). Pearson Education. [Google Scholar]
  41. O’Connor, C., & Joffe, H. (2020). Intercoder reliability in qualitative research: Debates and practical guidelines. International Journal of Qualitative Methods, 19, 1–13. [Google Scholar] [CrossRef] [Scilit]
  42. Perkins, M., Wood, L., Soler, T., Walker, K., Morata, L., Novotny, A., & Estep, H. (2020). Inpatient nurses’ perception of workplace violence based on specialty. Journal of Nursing Administration, 50(10), 515–520. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  43. Pol, A., Carter, M., & Bouchoucha, S. (2019). Violence and aggression in the intensive care unit: What is the impact of the Australian National Emergency Access Target? Australian Critical Care, 32(6), 502–508. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  44. Revelle, W. (2024). psych: Procedures for psychological, psychometric, and personality research (R package). Northwestern University. Available online: https://CRAN.R-project.org/package=psych (accessed on 12 June 2026).
  45. Rosseel, Y. (2012). lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48(2), 1–36. [Google Scholar] [CrossRef] [Scilit]
  46. Salzmann-Erikson, M., & Yifter, L. (2020). Risk factors and triggers that may result in patient-initiated violence on inpatient psychiatric units: An integrative review. Clinical Nursing Research, 29(7), 504–520. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  47. Seddik, S. A., Abdelhai, R., Aboushady, A. T., Nawwar, A. E., El Essawy, R. A., & Hegazy, A. A. (2023). Violence against healthcare workers during the COVID-19 pandemic: A cross-sectional survey at Cairo University Hospital. Frontiers in Public Health, 11, 1277056. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  48. Spelten, E., Thomas, B., O’Meara, P., van Vuuren, J., & McGillion, A. (2020). Violence against emergency department nurses: Can we identify the perpetrators? PLoS ONE, 15(4), e0230793. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  49. Spencer, C., Sitarz, J., Fouse, J., & DeSanto, K. (2023). Nurses’ rationale for underreporting of patient- and visitor-perpetrated workplace violence: A systematic review. BMC Nursing, 22, 134. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  50. Timmins, F., & Timmins, B. (2021). An integrative review of waiting time, queuing, and design as contributory factors to emergency department violence. Journal of Evidence-Based Medicine, 14(2), 139–151. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  51. Watkins, M. W. (2018). Exploratory factor analysis: A guide to best practice. Journal of Black Psychology, 44(3), 219–246. [Google Scholar] [CrossRef] [Scilit]
  52. Wirth, T., Peters, C., Nienhaus, A., & Schablon, A. (2021). Interventions for workplace violence prevention in emergency departments: A systematic review. International Journal of Environmental Research and Public Health, 18(16), 8459. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  53. World Health Organization. (2020). State of the world’s nursing 2020: Investing in education, jobs and leadership. World Health Organization. Available online: https://www.who.int/publications/i/item/9789240003279 (accessed on 10 June 2026).
  54. World Health Organization. (2022). Violence and harassment. Available online: https://www.who.int/tools/occupational-hazards-in-health-sector/violence-harassment (accessed on 10 June 2026).
  55. Wu, D., Wang, Y., Yang, S. Z., Wang, N., Sun, K. S., Lam, T. P., & Zhou, X. D. (2022). A socio-ecological framework for understanding workplace violence in China’s health sector: A qualitative analysis of health workers’ responses to an open-ended survey question. Journal of Interpersonal Violence, 37(11–12), NP9168–NP9190. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  56. Xie, R., Timmins, F., Zhang, M., Zhao, J., & Hou, Y. (2025). Emergency department crowding as a contributing factor related to patient-initiated violence against nurses: A literature review. Journal of Advanced Nursing, 81(8), 4500–4518. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  57. Yang, H.-L., Tai, J.-C., Wang, C.-H., Shyu, Y.-K., Chou, K.-R., & Pien, L.-C. (2025). Workplace violence, work characteristics, and seniority levels among nurses: A cross-sectional study. BMC Nursing, 24, 281. [Google Scholar] [CrossRef] [Scilit] [PubMed]
Figure 1. Phases in Developing the Attitude Scale for Nurses Toward Patient and Patient Relative Violence.
Figure 1. Phases in Developing the Attitude Scale for Nurses Toward Patient and Patient Relative Violence.
Behavsci 16 01665 g001
Figure 2. Initial first-order three-factor confirmatory factor analysis model (Model B; original confirmatory subsample, n = 304; standardized ML estimates).
Figure 2. Initial first-order three-factor confirmatory factor analysis model (Model B; original confirmatory subsample, n = 304; standardized ML estimates).
Behavsci 16 01665 g002
Figure 3. Final first-order three-factor model with six theory-based residual covariances (Model D; original confirmatory subsample, n = 304; standardized ML estimates).
Figure 3. Final first-order three-factor model with six theory-based residual covariances (Model D; original confirmatory subsample, n = 304; standardized ML estimates).
Behavsci 16 01665 g003
Table 1. Items Removed in Exploratory Factor Analysis and Item Loadings.
Table 1. Items Removed in Exploratory Factor Analysis and Item Loadings.
Items F1: F2: F3:
26. Poor management of tense situations increases the tendency for violence. 0.550
18. Nurses’ harsh and rude speech sets the stage for the violence. 0.486
20. Female nurses experience more violence. 0.481
5. I perceive situations in which I am not respected as violent acts. 0.478
39. After a violent incident, I exercise all my legal rights to the fullest. 0.508
40. When I encounter violence, I try to manage the situation by controlling my anger. 0.483
33. When subjected to violence, I seek help from a colleague. 0.483
32. I attempt to resolve violent incidents without notifying security. 0.518
Table 2. Pattern coefficients, communalities, and corrected item–total correlations of the 36-item scale (principal axis factoring, promax rotation; exploratory subsample, n = 304).
Table 2. Pattern coefficients, communalities, and corrected item–total correlations of the 36-item scale (principal axis factoring, promax rotation; exploratory subsample, n = 304).
ItemContent (Abridged)F1F2F3h2r(it)
12 (S15)People with negative hospital experiences show a tendency to violence.0.844−0.1730.0580.5780.722
7 (S10)Lack of respect for the nursing profession leads to violence.0.821−0.103−0.0120.5780.730
18 (S23)The negative perception created by the media leads to violence in health care.0.7420.031−0.0770.5660.713
19 (S24)Inadequate security measures in hospitals increase violence.0.744−0.0640.0430.5110.683
14 (S17)Alcohol and substance use increase the tendency to violence.0.7150.118−0.1140.6110.751
11 (S14)Failure to communicate an unexpected patient death appropriately leads to violence.0.6800.0070.2240.5690.705
9 (S12)Warning a patient/relative who breaks hospital rules leads to violence.0.739−0.2720.1070.4000.567
8 (S11)Nurses’ accessibility sets the stage for their exposure to violence.0.659−0.0780.1230.4150.617
20 (S27)Processing reactive patients faster leads others to become violent.0.6180.0840.2150.5490.682
6 (S9)Nurses experience more violence than other health workers.0.6490.064−0.0660.4650.666
16 (S21)Inadequate penalties for violence against health workers increase violence.0.6380.238−0.2260.6330.711
15 (S19)A nurse’s inability to attend to the patient because of heavy workload increases violence.0.633−0.0830.3040.4880.616
1 (S1)Violence is unacceptable under any circumstances.0.6300.286−0.2770.6900.730
17 (S22)Non-urgent patients presenting to emergency departments create an environment for violence.0.6100.1170.1100.5120.671
3 (S3)I perceive the violation of my personal boundaries as violence.0.6480.080−0.1520.4770.664
13 (S16)Violence is common when the patient is in pain.0.663−0.2340.1160.3330.521
5 (S8)I think violence in health care has been normalised.0.6050.1260.0140.4790.670
2 (S2)No living being should be subjected to violence.0.6190.231−0.2800.6100.688
10 (S13)The perception that health workers neglect their duties increases the tendency to violence.0.6050.114−0.1460.4500.630
4 (S7)I perceive speaking loudly as violence.0.566−0.1130.0780.2720.498
31 (S49)After experiencing violence, I come to work worrying about what I will go through today.−0.1410.8870.0560.6730.767
30 (S48)I am afraid that the violent patient/relative will follow me.−0.0770.8560.0560.6770.774
32 (S50)The violence I experience negatively affects my family and social life.−0.0160.7950.0130.6200.766
28 (S45)I feel uneasy when performing procedures on a violent patient.0.0710.7130.0480.5910.735
26 (S43)I take care not to go alone to the room of a violent patient.0.0150.7150.0220.5310.684
27 (S44)I try to spend less time with a violent patient/relative.0.0980.6770.0360.5620.712
29 (S46)After a violent incident, I have difficulty focusing on my work.0.0200.6990.0540.5230.689
25 (S42)I am afraid of violent incidents.−0.1240.6710.2040.4480.586
33 (S51)When I am subjected to violence, my trust in people decreases.0.1310.5700.0940.4660.684
34 (S53)Being subjected to violence makes me feel that my profession is worthless.0.2400.5220.0250.4900.682
35 (S56)After being subjected to violence, I feel helpless.0.1000.5560.1280.4350.652
36 (S57)When subjected to violence, I think my professional effort is not rewarded.0.3480.455−0.1300.5030.642
24 (S35)In a violent incident, I raise a “code white” alarm.0.2900.413−0.0280.3960.563
22 (S29)I ignore negative remarks; I do not care.−0.0540.1390.7870.6590.765
21 (S28)I remain silent so that the violent incident does not escalate.−0.0920.0600.7310.5350.691
23 (S30)I hesitate to react to violent situations.−0.0620.1160.7180.5410.669
h2 = communality; r(it) = corrected item–total correlation with its own factor. Factor correlations: F1–F2 = 0.61, F1–F3 = 0.16, F2–F3 = 0.19. Sums of squared loadings after extraction: 13.90, 2.91, 2.02. KMO = 0.93; Bartlett χ2(630) = 7967.42, p < 0.001. The final scale numbers with the original draft numbers in parentheses.
Table 3. Fit statistics of the competing measurement models in the enlarged post-review robustness sample (n = 349).
Table 3. Fit statistics of the competing measurement models in the enlarged post-review robustness sample (n = 349).
(a) Maximum likelihood (AMOS 26)
Modelχ2 (df)χ2/dfCFITLINFIGFIRMSEA [90% CI]SRMRAIC
A. One factor3767.8 (594.0)6.340.4860.4540.4460.5390.124 [0.120, 0.128]0.1143911.8
B. Three factors, first order, no residual covariances (initial)2543.8 (591.0)4.300.6840.6630.6260.6780.097 [0.094, 0.101]0.0872693.8
C. Four factors (qualitative domains)2205.0 (588.0)3.750.7380.7190.6760.7190.089 [0.085, 0.093]0.0952361.0
D. Three factors + 6 residual covariances (final)1919.8 (585.0)3.280.7840.7670.7180.7530.081 [0.077, 0.085]0.0812081.8
E. Three factors + 12 residual covariances (sensitivity)1775.0 (579.0)3.070.8060.7890.7390.7690.077 [0.073, 0.081]0.0791949.0
(b) WLSMV on polychoric correlations (lavaan)
Modelχ2 (df)χ2/dfCFITLIRMSEA [90% CI]SRMR
A. One factor3668.8 (594.0)6.180.6250.6020.122 [0.118, 0.126]0.147
B. Three factors, first order, no residual covariances (initial)1652.6 (591.0)2.800.8710.8620.072 [0.068, 0.076]0.099
C. Four factors (qualitative domains)1542.4 (588.0)2.620.8840.8750.068 [0.064, 0.072]0.094
D. Three factors + 6 residual covariances (final)1364.5 (585.0)2.330.9050.8980.062 [0.058, 0.066]0.089
E. Three factors + 12 residual covariances (sensitivity)1290.5 (579.0)2.230.9130.9060.059 [0.055, 0.064]0.086
(c) Robustness of the final model (Model D) in the original and enlarged confirmatory samples
Indexn = 304 (original)n = 349 (enlarged)
WLSMV χ2 (df), χ2/df1297.5 (585), 2.221364.5 (585), 2.33
WLSMV CFI/TLI0.900/0.8920.905/0.898
WLSMV RMSEA [90% CI]/SRMR0.063 [0.059, 0.068]/0.0930.062 [0.058, 0.066]/0.089
ML χ2 (df), χ2/df1879.6 (585), 3.211919.8 (585), 3.28
ML CFI/TLI0.769/0.7520.784/0.767
ML RMSEA [90% CI]/SRMR0.085 [0.081, 0.090]/0.0840.081 [0.077, 0.085]/0.081
Note. All χ2 p < 0.001. WLSMV χ2 is the mean- and variance-adjusted statistic. A second-order model with three first-order factors is just-identified and has the same fit as Model B. Residual covariances in Model D: e1–e2, e1–e3, e2–e3, e8–e9, e18–e19, e34–e36; Model E adds e26–e27, e26–e28, e27–e28, e30–e31, e32–e33, e35–e36. Panel (c) shows that the final-model conclusions were essentially unchanged when the 45 post-review cases were added to the original confirmatory subsample.
Table 4. Standardized factor loadings of the final model (Model D) under WLSMV and ML, and residual covariances (enlarged post-review robustness sample, n = 349).
Table 4. Standardized factor loadings of the final model (Model D) under WLSMV and ML, and residual covariances (enlarged post-review robustness sample, n = 349).
FactorItemλ WLSMV (SE)zλ MLUnstd. ML (SE)CRR2 WLSMVR2 ML
F112 (S15)0.680 (0.032)21.10.6341.000 (—)0.4630.402
F17 (S10)0.754 (0.029)26.40.7171.023 (0.090)11.340.5690.514
F118 (S23)0.783 (0.028)27.70.7520.964 (0.082)11.760.6130.565
F119 (S24)0.708 (0.038)18.70.6580.826 (0.078)10.560.5010.432
F114 (S17)0.637 (0.038)16.60.5610.694 (0.075)9.270.4060.315
F111 (S14)0.679 (0.033)20.70.6221.027 (0.102)10.120.4600.387
F19 (S12)0.576 (0.036)16.00.5161.026 (0.119)8.620.3320.267
F18 (S11)0.624 (0.036)17.30.5550.977 (0.106)9.180.3890.308
F120 (S27)0.598 (0.037)16.00.5530.962 (0.105)9.160.3580.306
F16 (S9)0.482 (0.049)9.90.4280.700 (0.096)7.300.2320.183
F116 (S21)0.699 (0.039)18.00.5870.624 (0.065)9.640.4880.345
F115 (S19)0.686 (0.034)20.40.6290.997 (0.098)10.210.4700.396
F11 (S1)0.585 (0.066)8.90.4630.516 (0.066)7.830.3420.214
F117 (S22)0.832 (0.023)36.10.7861.161 (0.095)12.170.6920.617
F13 (S3)0.489 (0.043)11.30.4630.582 (0.074)7.830.2390.215
F113 (S16)0.527 (0.038)13.90.4750.829 (0.103)8.010.2780.226
F15 (S8)0.640 (0.035)18.20.6001.105 (0.113)9.820.4100.360
F12 (S2)0.330 (0.055)6.00.3760.449 (0.069)6.470.1090.142
F110 (S13)0.630 (0.033)19.20.5050.765 (0.090)8.470.3970.255
F14 (S7)0.471 (0.043)11.00.4390.784 (0.105)7.460.2210.193
F231 (S49)0.833 (0.022)38.00.7891.000 (—)0.6940.622
F230 (S48)0.771 (0.025)30.90.7280.963 (0.068)14.250.5950.530
F232 (S50)0.751 (0.024)31.30.7400.988 (0.068)14.530.5650.547
F228 (S45)0.794 (0.024)33.40.7170.929 (0.066)13.990.6310.514
F226 (S43)0.629 (0.035)18.20.5780.715 (0.066)10.910.3950.335
F227 (S44)0.672 (0.031)21.90.5920.762 (0.068)11.190.4510.350
F229 (S46)0.699 (0.037)19.00.5740.749 (0.069)10.820.4890.330
F225 (S42)0.594 (0.034)17.60.5460.795 (0.078)10.220.3530.298
F233 (S51)0.803 (0.023)34.30.7000.904 (0.067)13.590.6450.489
F234 (S53)0.654 (0.041)16.00.5040.599 (0.064)9.350.4280.254
F235 (S56)0.662 (0.034)19.30.5850.931 (0.084)11.050.4390.343
F236 (S57)0.720 (0.039)18.40.4800.571 (0.064)8.860.5190.230
F224 (S35)0.518 (0.051)10.20.4420.534 (0.066)8.110.2680.195
F322 (S29)0.886 (0.022)41.00.8751.000 (—)0.7850.766
F321 (S28)0.834 (0.024)34.20.8071.011 (0.064)15.880.6960.651
F323 (S30)0.850 (0.026)33.20.7690.934 (0.061)15.250.7230.591
Residual covariances
PairShared content facetWLSMV estimate (SE)zML estimate (SE)CRML standardized r
e1 ↔ e2Normative definition of violence0.657 (0.051)13.00.302 (0.027)11.210.779
e1 ↔ e3Normative definition of violence0.413 (0.058)7.10.216 (0.025)8.760.554
e2 ↔ e3Normative definition of violence0.366 (0.057)6.50.224 (0.027)8.290.512
e34 ↔ e36Professional devaluation0.276 (0.040)6.90.379 (0.045)8.390.530
e8 ↔ e9Nurse-role antecedents0.220 (0.041)5.40.279 (0.052)5.350.315
e18 ↔ e19Institutional antecedents0.188 (0.035)5.40.093 (0.018)5.080.326
Note. Factor correlations (WLSMV/ML): F1–F2 = 0.59/0.52; F1–F3 = 0.21/0.21; F2–F3 = 0.32/0.32. SEs of WLSMV loadings are robust (sandwich) standard errors. CR = critical ratio. Marker items (unstandardized loading fixed to 1): items 12, 31, and 22.
Table 5. Composite reliability, average variance extracted, latent correlations, HTMT ratios, and Fornell–Larcker criterion (final model; enlarged post-review robustness sample, n = 349).
Table 5. Composite reliability, average variance extracted, latent correlations, HTMT ratios, and Fornell–Larcker criterion (final model; enlarged post-review robustness sample, n = 349).
FactorkCRAVE√AVECR (ML)AVE (ML)r F1r F2r F3HTMT F1HTMT F2HTMT F3
F1 Perception & causes200.9280.3980.6310.9060.3320.5850.2120.6010.196
F2 Effects130.9270.4980.7060.8890.3870.5850.3240.6010.308
F3 Response30.8930.7350.8570.8580.6700.2120.3240.1960.308
Note. CR, AVE, r, and HTMT were computed from the WLSMV solution unless labelled ML. HTMT was based on polychoric correlations (Pearson-based HTMT: 0.58, 0.21, 0.33). The Fornell–Larcker criterion is met when √AVE exceeds the corresponding inter-factor correlations.
Table 6. Supplementary measurement invariance of the final model across institution type and sex (combined sample, N = 653; ML).
Table 6. Supplementary measurement invariance of the final model across institution type and sex (combined sample, N = 653; ML).
(a) Public (n = 456) vs. private hospitals (n = 197)
Modelχ2 (df)CFIRMSEASRMRΔχ2 (Δdf)ΔCFIΔRMSEAΔSRMR
Configural6352.5 (1170)0.6780.0820.091
Metric6471.5 (1203)0.6730.0820.098119.0 (33)−0.005−0.0000.007
Scalar6656.0 (1236)0.6630.0820.098184.5 (33)−0.0090.0000.000
(b) Women (n = 583) vs. men (n = 70)
Modelχ2 (df)CFIRMSEASRMRΔχ2 (Δdf)ΔCFIΔRMSEAΔSRMR
Configural4961.0 (1170)0.7460.0710.089
Metric5069.1 (1203)0.7410.0700.095108.1 (33)−0.005−0.0000.006
Scalar5260.9 (1236)0.7310.0710.096191.7 (33)−0.0110.0000.001
Partial scalar (intercept of item 25 free)5231.8 (1235)0.7320.0710.096162.6 (32)−0.0090.0000.000
Note. All Δχ2 p < 0.001. Invariance accepted when ΔCFI ≤ 0.010, ΔRMSEA ≤ 0.015, and ΔSRMR ≤ 0.030 (metric)/0.015 (scalar) (Chen, 2007).
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Gür, D.; Baykal, Ü. Development of the Nurses’ Attitudes Toward Violence by Patients and Patients’ Relatives Scale: A Methodological Study. Behav. Sci. 2026, 16, 1665. https://doi.org/10.3390/bs16091665

AMA Style

Gür D, Baykal Ü. Development of the Nurses’ Attitudes Toward Violence by Patients and Patients’ Relatives Scale: A Methodological Study. Behavioral Sciences. 2026; 16(9):1665. https://doi.org/10.3390/bs16091665

Chicago/Turabian Style

Gür, Deniz, and Ülkü Baykal. 2026. "Development of the Nurses’ Attitudes Toward Violence by Patients and Patients’ Relatives Scale: A Methodological Study" Behavioral Sciences 16, no. 9: 1665. https://doi.org/10.3390/bs16091665

APA Style

Gür, D., & Baykal, Ü. (2026). Development of the Nurses’ Attitudes Toward Violence by Patients and Patients’ Relatives Scale: A Methodological Study. Behavioral Sciences, 16(9), 1665. https://doi.org/10.3390/bs16091665

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop