The Psychosocial Risks and Impacts in the Workplace Assessment Tool: Construction and Psychometric Evaluation
Abstract
:1. Introduction
2. Materials and Methods
2.1. Instrument Development
2.1.1. Copenhagen Psychosocial Questionnaire
2.1.2. Utrecht Work Engagement Scale
2.1.3. The Stanford Presenteeism Scale
2.2. Participants
2.3. Procedure
3. Results
3.1. Exploratory Factor Analysis
3.2. Confirmatory Factor Analysis
3.3. Internal Consistency and Test–Retest Reliability
3.4. Validating Measures
4. Discussion
5. Conclusions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- European Agency for Health & Safety at Work. In European Survey of Enterprises on New & Emerging Risks (ESENER). Managing Safety & Health at Work; Office for Official Publications of the European Communities: Luxembourg, 2010.
- 2. European Agency for Health & Safety at Work. In Expert Forecast for Emerging Psychosocial Risks Related to Occupational Safety & Health; Office for Official Publications of the European Communities: Luxembourg, 2007.
- Psychosocial Risk Management European Framework [PRIMA-EF]. Monitoring Psychosocial Risks at Work. 2008. Available online: http://www.prima-ef.org/uploads/1/1/0/2/11022736/08_english.pdf (accessed on 16 January 2023).
- Leka, S.; Jain, A. PAS1010: Guidance on the Management of Psychosocial Risks in the Workplace; British Standards Institution: London, England, 2011. [Google Scholar]
- International Labour Organization [ILO]. Psychosocial Factors at Work: Recognition and Control; Occupational Safety and Health Series No. 56; International Labour Office: Geneva, Switzerland, 1986. [Google Scholar]
- Committee of Senior Labour Inspectors [SLIC]. Psychosocial Risks at Work: Background; 2012; Available online: http://www.av.se/slic2012/ (accessed on 7 January 2022).
- Cox, T.; Griffiths, A. Monitoring the changing organization of work: A commentary. Soz. Und Präventivmedizin 2005, 47, 354–355. [Google Scholar]
- Leka, S.; Cox, T.; Zwetsloot, G. The European Framework for Psychosocial Risk Management (PRIMA-EF). In The European Framework for Psychosocial Risk Management: PRIMA-EF.; Leka, S., Cox, T., Eds.; I-WHO Publications: Nottingham, UK, 2008; pp. 1–16. [Google Scholar]
- Cox, T.; Rial-González, E. Work-related stress: The European picture. Mag. Eur. Agency Saf. Health Work 2002, 5, 4–6. Available online: http://www.mentalhealthpromotion.net/resources/magazine5_en.pdf (accessed on 17 January 2023).
- Rick, J.; Brimner, R.B. Psychosocial Risk Assessment: Problems & Prospects. Occup Med. 2000, 50, 310–314. [Google Scholar] [CrossRef]
- European Commission. Guidance on Work-Related Stress: Spice of Life or Kiss of Death? Office for Official Publications of the European Communities: Luxembourg, 2000. Available online: https://www.stress.org/wp-content/uploads/2011/11/Guidance2520on2520work-realted2520stress.pdf (accessed on 17 January 2023).
- Armenakis, A.A.; Bedeian, A.G. Organizational Change: A review of theory and research in the 1990’s. J. Manag. 1999, 25, 293–315. [Google Scholar] [CrossRef]
- Mack, D.A.; Nelson, D.L.; Quick, J.C. The stress of occupational change: A dynamic process model. Appl. Psychol. 1998, 47, 219–232. [Google Scholar] [CrossRef]
- Cooper, C.; Dewe, D. Well-being-absenteeism, presenteeism, costs & challenges. Occup Med. 2008, 58, 522–524. [Google Scholar] [CrossRef] [Green Version]
- Shaw Trust. Mental Health: Still The Last Workplace Taboo? London, UK, 2010; Available online: https://trajectorypartnership.com/wp-content/uploads/2013/09/Mental-Health-Report.pdf (accessed on 23 January 2023).
- Kausto, J.; Pentti, J.; Oksanen, T.; Virta, L.J.; Virtanen, M.; Kivimäki, M.; Vahtera, J. Length of sickness absence and sustained return-to-work in mental disorders and musculoskeletal diseases: A cohort study of public sector employees. Scand J. Work Environ. Health 2017, 43, 358–366. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Sainsbury Centre for Mental Health. Mental Health at Work: Developing the Business Case; Sainsbury Centre for Mental Health: London, UK, 2007. [Google Scholar]
- Midford, R.; Welander, F.; Allsop, S. Preventing alcohol and other drug problems in the workplace. In Preventing Harmful Substance Use: The Evidence Base for Policy and Practice; Stockwell, T., Gruenewald, P.J., Toumbourou, J.W., Loxley, W., Eds.; Wiley: Chichester, UK, 2006; pp. 191–205. [Google Scholar]
- Maxwell, C. Occupational Health & Safety Act Review; State of Victoria: Melbourne, Australia, 2004. [Google Scholar]
- Council Directive 89/391/EEC of 12 June 1989 on the introduction of measures to encourage improvements in the safety and health of workers at work. Available online: https://eur-lex.europa.eu/legal-content/EN/ALL/?uri=celex%3A31989L0391 (accessed on 17 January 2022).
- Pejtersen, J.H.; Kristensen, T.S.; Borg, V.; Bjorner, J.B. The second version of the Copenhagen Psychosocial Questionnaire. Scand. J. Public Health 2010, 38, 8–24. [Google Scholar] [CrossRef] [PubMed]
- Edwards, J.A.; Webster, S.; Van Laar, D.; Easton, S. Psychometric analysis of the UK Health and Safety Executive’s Management Standards work-related stress Indicator Tool. Work Stress 2008, 22, 96–107. [Google Scholar] [CrossRef] [Green Version]
- Tabanelli, M.C.; Depolo, M.; Cooke, R.M.T.; Sarchielli, G.; Bonfiglioli, R.; Mattioli, S.; Violante, F.S. Available instruments for measurement of psychological factors in the work environment. Int Arch Occup Environ Health 2008, 82, 1–12. [Google Scholar] [CrossRef] [PubMed]
- Validation of the General Nordic Questionnaire (QPSNordic) for Psychological and Social Factors at Work; Nordic Council of Ministers [Nordiska Ministerrådet]: Gothenburg, Sweden, 2000.
- Moncada, S.; Utzet, M.; Molinero, E.; Llorens, C.; Moreno, N.; Galtés, A.; Navarro, A. The Copenhagen Psychosocial Questionnaire II (COPSOQ II) in Spain—A tool for psychosocial risk assessment at the workplace. Am. J. Ind. Med. 2014, 57, 97–107. [Google Scholar] [CrossRef] [PubMed]
- Schaufeli, W.B.; Bakker, A.B.; Salanove, M. The Measurement of Work Engagement with a Short Questionnaire: A Cross-National Study. Educ. Psychol. Meas. 2006, 66, 701–716. [Google Scholar] [CrossRef]
- Koopman, C.; Pelletier, K.R.; Murray, J.F.; Sharda, C.E.; Berger, M.L.; Turpin, R.S.; Hackleman, P.; Gibson, P.; Holmes, D.M.; Bendel, T. Stanford Presenteeism Scale: Health Status and Employee Productivity. J. Occup Environ. Med. 2002, 44, 14–20. [Google Scholar] [CrossRef] [PubMed]
- McClain, E. Critical synthesis package: Stanford presenteeism scale (SPS-6). MedEdPORTAL Publications 2013, 9, 9602. [Google Scholar] [CrossRef]
- Hutcheson, G.D.; Sofroniou, N. The Multivariate Social Scientist: An Introduction to Generalized Linear Models; Sage Publications: Thousand Oaks, CA, USA, 1999. [Google Scholar]
- Field, A.P. Discovering Statistics Using SPSS: And Sex and Drugs and Rock ‘n’ Roll, 3rd ed.; Sage: London, UK, 2009. [Google Scholar]
- Kline, R.B. Exploratory and confirmatory factor analysis. In Applied Quantitative Analysis in the Social Sciences; Petscher, Y., Schatschneider, C., Eds.; Routledge: New York, NY, USA, 2013; pp. 171–207. [Google Scholar]
- Graham, J.M.; Guthrie, A.C.; Thompson, B. Consequences of not interpreting structure coefficients in published CFA research: A reminder. Struct. Equ. Modeling 2003, 10, 142–153. [Google Scholar] [CrossRef]
- Arbuckle, J.L. IBM SPSS Amos 21 User’s Guide; IBM Corp: Chicago, IL, USA, 2012. [Google Scholar]
- Schreiber, J.B.; Nora, A.; Stage, F.K.; Barlow, E.A.; King, J. Reporting Structural Equation Modeling and Confirmatory Factor Analysis Results: A Review. J. Educ. Res. 2006, 99, 323–337. [Google Scholar] [CrossRef]
- Byrne, B.M. Structural Equation Modeling with AMOS: Basic Concepts, Applications and Programming; Lawrence Erlbaum Associates: Mahwah, NJ, USA, 2001. [Google Scholar]
- Marsh, H.W.; Hau, K.-T.; Grayson, D. Goodness of Fit in Structural Equation Models. In Contemporary psychometrics: A festschrift for Roderick, P. McDonald; Maydeu-Olivares, A., McArdle, J.J., Eds.; Lawrence Erlbaum Associates Publishers, 2005; pp. 275–340. [Google Scholar]
- Carmines, E.G.; McIver, J.P. Analyzing Models with Unobserved Variables: Analysis of Covariance Structures. In Social Measurement: Current Issues; Bohrnstedt, G.W., Borgatta, E.F., Eds.; Sage Publications: Beverly Hills, CA, USA, 1981; pp. 65–115. [Google Scholar]
- Nunnally, J.C.; Bernstein, I.H. Psychometric Theory; McGraw-Hill: New York, NY, USA, 1994. [Google Scholar]
- Donaldson, S.I.; Grant-Vallone, E.J. Understanding self-report bias in organizational behavior research. J. Bus. Psychol. 2002, 17, 245–260. [Google Scholar] [CrossRef]
Socio-Demographic Characteristics | Sample 1 f rf | Sample 2 * f rf | Sample 3 f rf | Sample 4 f rf | Sample 5 f rf | Sample 6 f rf |
---|---|---|---|---|---|---|
Total | 1051 100 | 1309 100 | 494 100 | 402 100 | 283 100 | 149 100 |
Nationality Greek Other Missing | 878 83.5 | 1182 90.3 | 469 94.9 | 402 100 | 261 92.2 | 137 91.9 |
6 0.6 | 10 0.8 | 6 1.0 | 2 0.7 | 3 2.0 | ||
167 15.9 | 117 8.9 | 10 2.0 | 20 7.1 | 9 6.0 | ||
Gender Male Female Missing | 406 38.6 626 59.6 19 1.8 | 523 40.0 776 59.3 10 0.7 | 209 42.3 275 55.7 10 2.0 | 362 90.0 40 10.0 | 95 33.6 177 62.5 11 3.9 | 61 40.9 87 58.4 1 0.7 |
Age <25 years old 25-34 years old 35-44 years old 45-54 years old >55 years old Missing | 149 14.2 402 38.2 282 26.8 134 12.7 43 4.1 41 3.9 | 143 10.9 476 36.4 383 29.3 216 16.5 60 4.6 31 2.4 | 23 4.7 147 29.8 151 30.6 125 25.3 30 6.1 19 3.6 | 17 4.2 217 54.0 150 37.3 18 4.5 | 14 4.9 76 26.9 69 24.4 83 29.3 22 7.8 19 6.7 | 24 16.1 40 26.8 33 22.1 39 26.2 13 8.7 |
Education Compulsory Lyceum University Graduate Missing | 15 1.4 210 20.0 542 51.6 262 24.9 22 2.1 | 18 1.4 285 21.8 658 50.3 336 25.7 12 0.8 | 12 2.4 140 28.3 226 45.7 106 21.5 10 2.0 | 18 4.5 312 77.6 54 13.4 18 4.5 | 9 3.2 55 19.4 135 47.7 73 25.8 11 3.9 | 6 4.0 23 15.4 76 51.0 43 28.9 1 0.7 |
Marital status Single Married Living with partner Divorced Widowed Missing | 557 53.0 353 33.6 61 5.8 52 4.9 4 0.4 24 2.3 | 190 38.5 250 50.6 9 1.8 33 6.7 3 0.6 9 1.8 | 49 12.2 309 76.9 11 2.7 33 8.2 | 94 33.2 140 49.5 18 6.4 18 6.4 2 0.7 11 3.9 | 70 47.0 63 42.3 8 5.4 6 4.0 2 1.3 | |
Kids Yes No Missing | 595 56.6 282 26.8 174 16.6 | 237 48.0 242 49 15 3.0 | 320 79.6 82 20.4 | 139 49.1 133 47.0 11 3.9 | 67 45.0 73 49.0 9 6.0 | |
Employment sector Public Private Missing | 325 30.9 569 54.2 157 14.9 | 76 15.4 406 82.2 12 2.4 | 402 100 | 169 59.7 113 39.9 1 0.4 | 62 41.6 82 55.0 5 3.3 | |
Occupational status Higher management Lower management White-collar worker Blue-collar worker Other Missing | 38 3.6 339 32.3 421 40.1 177 16.8 25 2.4 51 4.9 | 19 3.8 204 41.3 172 34.8 74 15.0 12 2.4 13 2.6 | 64 15.9 304 75.7 34 8.4 | 4 1.4 14 4.9 58 20.5 28 9.9 6 2.1 173 61.1 | 12 8.1 40 26.8 71 47.7 13 8.7 10 6.7 | |
Job contract Permanent Temporary Self-employed Other Missing | 699 66.5 107 10.2 75 7.1 8 0.8 162 15.4 | 395 80.0 45 9.1 42 8.5 12 2.4 | 402 100 | 210 74.2 47 16.6 14 4.9 1 0.4 11 3.9 | 99 66.4 20 13.4 22 14.8 2 1.3 6 4.0 |
Pattern Matrix | Structure Matrix | |
---|---|---|
Factor 1—Organizational Culture (variance explained: 20.1%) | ||
My company fails to appreciate any efforts I make | 0.72 | 0.77 |
My employer does not treat me fairly | 0.72 | 0.74 |
In general, I feel that there is open and trustful communication between management and employees | −0.72 | −0.72 |
I cannot count on my supervisor’s support | 0.68 | 0.72 |
Even if I was the best employee at work, my company would fail to recognize it | 0.66 | 0.72 |
My supervisor helps me and provides me with guidance, when facing problems at work | −0.65 | −0.63 |
I believe that my supervisor is not aware of the problems I face at work | 0.63 | 0.62 |
If it wasn`t for a few particular people at work, I would enjoy my job more | 0.62 | 0.60 |
The work environment at the company I work for is sometimes hostile | 0.60 | 0.64 |
My supervisor and the management do not keep me informed regarding whatever happens at work | 0.60 | 0.65 |
The organization I work for cares more about the profit I can bring, rather than about me | 0.54 | 0.65 |
The objectives and vision of the organization I work for, are not fully clarified | 0.52 | 0.58 |
My role and responsibilities at work have not been fully clarified | 0.51 | 0.58 |
At work, I have often been made to feel bad for the things that I do or say | 0.43 | 0.55 |
Factor 2—Health & Well-Being (variance explained: 7.5%) | ||
I often get headaches | 0.73 | 0.68 |
I often experience muscle pains | 0.69 | 0.68 |
I often take painkillers | 0.67 | 0.63 |
I often feel like I will collapse | 0.64 | 0.74 |
I sometimes have a sudden feeling of numbness and tingling | 0.61 | 0.61 |
I often feel physically exhausted | 0.59 | 0.67 |
I often experience shortness of breath | 0.59 | 0.66 |
Often my heart beats so fast that I cannot cool down | 0.59 | 0.62 |
I frequently have fainting spells or I feel like it | 0.57 | 0.63 |
Sometimes I feel afraid for no reason | 0.52 | 0.61 |
Lately, I have had sleeping problems | 0.50 | 0.58 |
I sometimes feel my arms and legs shaky | 0.49 | 0.57 |
I find it difficult to relax | 0.47 | 0.58 |
Lately, I get more emotional than in the past | 0.43 | 0.45 |
Factor 3—Dysfunctional Behaviors (variance explained: 5.8%) | ||
I have been in trouble at work as a result of alcohol abuse | −0.78 | −0.78 |
I sometimes use drugs or alcohol before and/or during work hours | −0.74 | −0.74 |
I feel guilty about the amount of alcohol I consume | −0.68 | −0.65 |
I drink alcohol in order to fall asleep | −0.67 | −0.67 |
My use of substances is affecting my work performance | −0.61 | −0.63 |
I often become the target of suggestive remarks at work | −0.58 | −0.62 |
I have been threatened with physical assault at work | −0.52 | −0.52 |
I cannot fall asleep if I don’t take sleeping pills | −0.49 | −0.55 |
I have been sexually harassed at work | −0.42 | −0.46 |
Factor 4—Job Satisfaction & Engagement (variance explained: 3.5%) | ||
I do not enjoy my job | −0.86 | −0.87 |
I am proud of the work that I do | 0.75 | 0.72 |
I don’t get any satisfaction from my job | −0.72 | −0.78 |
My job is really a strain on me | −0.71 | −0.80 |
The subject matter of my work does not require creativity | −0.69 | −0.65 |
I remain at this work only due to financial reasons | −0.67 | −0.74 |
I feel detached from my job | −0.66 | −0.74 |
When I get up in the morning, I feel like going to work | 0.64 | 0.64 |
Actually, I don’t really care about what happens at work | −0.62 | −0.70 |
I regret my decision to follow this career path | −0.58 | −0.64 |
I am not ambitious regarding my present job | −0.58 | −0.64 |
I often feel like I am doing my job mechanically, without caring about the results | −0.55 | −0.58 |
I can make decisions concerning my work | −0.40 | 0.37 |
Factor 5—Work Demands (variance explained: 3.0%) | ||
Due to my work, I don’t spend enough time with my family | 0.68 | 0.69 |
My work is so demanding that there is no time left for a social life | 0.67 | 0.70 |
I have no free time for myself | 0.66 | 0.67 |
Due to the heavy workload, it is often expected of me to work overtime | 0.66 | 0.66 |
I cannot find a healthy balance between my job and free time | 0.64 | 0.68 |
I often have to work at a fast pace in order to complete my work | 0.60 | 0.58 |
My job is constantly under demanding deadlines | 0.58 | 0.59 |
I often feel that I have to leave everything behind for my job | 0.58 | 0.58 |
Factor 6—Job insecurity (variance explained: 4.8%) | ||
I am worried about getting fired | 0.82 | 0.83 |
I am afraid I will lose my job due to the financial crisis | 0.79 | 0.81 |
I feel that, in the event I get fired, it will be difficult to find another job | 0.61 | 0.62 |
The fact that my work is not permanent makes me feel insecure | 0.59 | 0.60 |
I am concerned that I might be replaced by a better qualified employee | 0.59 | 0.59 |
The potential for an eventual organizational change makes me feel insecure | 0.56 | 0.61 |
I am worried that, due to organizational changes, I will be transferred to another position against my will | 0.44 | 0.48 |
Factor 7—Presenteeism (variance explained: 2.7%) | ||
I am sometimes unable to work despite how hard I try | 0.72 | 0.74 |
There are times when I am unable to accomplish anything at work because I don’t feel well | 0.71 | 0.77 |
Usually, when something concerns me that is unrelated to my work duties, I am unable to work | 0.68 | 0.69 |
F1 | F2 | F3 | F4 | F5 | F6 | F7 | |
---|---|---|---|---|---|---|---|
Factor 1 | - | 0.34 *** | 0.21 *** | 0.57 *** | 0.26 *** | 0.30 *** | 0.31 *** |
Factor 2 | - | 0.34 *** | 0.30 *** | 0.34 *** | 0.37 *** | 0.34 *** | |
Factor 3 | - | 0.28 *** | 0.11 ** | 0.07 * | 0.21 *** | ||
Factor 4 | - | 0.04 | 0.30 *** | 0.33 *** | |||
Factor 5 | - | 0.12 *** | 0.14 *** | ||||
Factor 6 | - | 0.21 *** | |||||
Factor 7 | - |
Model | χ2/df | CFI | TLI | SRMR | RMSEA | RMSEA CI 90% | AIC |
---|---|---|---|---|---|---|---|
M1 | 90.87 | 0.47 | 0.46 | 0.100 | 0.082 | 0.081–0.083 | 22,082.7 |
M2 | 30.28 | 0.87 | 0.86 | 0.057 | 0.042 | 0.041–0.043 | 7490.8 |
M3 | 20.69 | 0.93 | 0.92 | 0.055 | 0.036 | 0.035–0.037 | 6195.8 |
Items | Mean | SD | Cronbach’s α | |
---|---|---|---|---|
Factor 1—Organizational Culture | 14 | 40.7 | 11.3 | 0.91 |
Factor 2—Health & Well-Being | 14 | 33.0 | 10.4 | 0.89 |
Factor 3—Dysfunctional Behaviors | 9 | 11.5 | 3.2 | 0.74 |
Factor 4—Job Satisfaction & Engagement | 13 | 28.1 | 9.7 | 0.92 |
Factor 5—Work Demands | 8 | 24.2 | 6.1 | 0.82 |
Factor 6—Job insecurity | 7 | 20.9 | 5.4 | 0.80 |
Factor 7—Presenteeism | 3 | 7.6 | 2.7 | 0.74 |
PRIWA F1 × COPSOQ II (Predictability, Quality of leadership, Social support, Feedback at work, and Sense of community) 1 | r(402) = 0.76 *** |
PRIWA F2 × COPSOQ II (General Health, Mental Health, and Vitality) 2 | r(472) = 0.76 *** |
PRIWA F3 × COPSOQ II (Behavioral, Somatic & Cognitive Stress) 2 | r(478) = 0.64 *** |
PRIWA F4 × UWES (Vigor) 3 | r(283) = 0.70 *** |
PRIWA F4 × UWES (Dedication) 3 | r(283) = 0.83 *** |
PRIWA F4 × UWES (Absorption) 3 | r(283) = 0.60 *** |
PRIWA F5 × COPSOQ II (Demands) 2 | r(476) = 0.74 *** |
PRIWA F6 × COPSOQ II (Insecurity at work) 2 | r(475) = 0.67 *** |
PRIWA F7 × SPS-6 4 | r(145) = 0.62 *** |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the author. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Roussos, P.L. The Psychosocial Risks and Impacts in the Workplace Assessment Tool: Construction and Psychometric Evaluation. Behav. Sci. 2023, 13, 104. https://doi.org/10.3390/bs13020104
Roussos PL. The Psychosocial Risks and Impacts in the Workplace Assessment Tool: Construction and Psychometric Evaluation. Behavioral Sciences. 2023; 13(2):104. https://doi.org/10.3390/bs13020104
Chicago/Turabian StyleRoussos, Petros L. 2023. "The Psychosocial Risks and Impacts in the Workplace Assessment Tool: Construction and Psychometric Evaluation" Behavioral Sciences 13, no. 2: 104. https://doi.org/10.3390/bs13020104
APA StyleRoussos, P. L. (2023). The Psychosocial Risks and Impacts in the Workplace Assessment Tool: Construction and Psychometric Evaluation. Behavioral Sciences, 13(2), 104. https://doi.org/10.3390/bs13020104