University Fairness Questionnaire (UFair): Development and Validation of a German Questionnaire to Assess University Justice—A Study Protocol of a Mixed Methods Study
Abstract
:1. Introduction
2. Experimental Design
3. Detailed Procedure
3.1. Step 1: Review of Literature and Creation of Preliminary Items
3.2. Step 2: Conducting Qualitative Interviews: Explorative-Inductive and Translational-Deductive
3.3. Step 3: Synthesis of the Qualitative Results with the Literature
3.4. Step 4: Development of the Questionnaire Items
3.5. Step 5: Validation by Experts
3.6. Step 6: Pretest of the Questionnaire Items
3.7. Step 7: Piloting the Questionnaire
4. Expected Results
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- Hapke, U.; Maske, U.; Scheidt-Nave, C.; Bode, L.; Schlack, R.; Busch, M. Chronic Stress among Adults in Germany; Robert Koch Institut: Berlin, Germany, 2013; Volume 56. [Google Scholar] [CrossRef] [Green Version]
- Breiter, R.; Nash, R.; McCrady, M.; Rhoades, D.; Linscomb, M.; Clarahan, M.; Sammut, S. The prevalence and correlates of depression, anxiety, and stress in a sample of college students. J. Affect. Disord. 2015, 173, 90–96. [Google Scholar] [CrossRef] [PubMed]
- Brenneisen Mayer, F.; Souza Santos, I.; Silveira, P.S.; Itaqui Lopes, M.H.; de Souza, A.R.; Campos, E.P.; de Abreu, B.A.; Hoffmann II, I.; Magalhaes, C.R.; Lima, M.C.P.; et al. Factors associated to depression and anxiety in medical students: A multicenter study. BMC Med. Educ. 2016, 16, 282. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Dahlin, M.; Joneborg, N.; Runeson, B. Stress and depression among medical students: A cross-sectional study. Med. Educ. 2005, 39, 594–604. [Google Scholar] [CrossRef] [PubMed]
- El Ansari, W.; Oskrochi, R.; Haghgoo, G. Are students’ symptoms and health complaints associated with perceived stress at university? Perspectives from the United Kingdom and Egypt. Int. J. Environ. Res. Public Health 2014, 11, 9981–10002. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Opoku-Acheampong, A.; Kretchy, I.A.; Acheampong, F.; Afrane, B.A.; Ashong, S.; Tamakloe, B.; Nyarko, A.K. Perceived stress and quality of life of pharmacy students in University of Ghana. BMC Res. Notes 2017, 10, 115. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Dyrbye, L.N.; Thomas, M.R.; Shanafelt, T.D. Systematic review of depression, anxiety, and other indicators of psychological distress among US and Canadian medical students. Acad. Med. 2006, 81, 354–373. [Google Scholar] [CrossRef]
- Heinen, I.; Bullinger, M.; Kocalevent, R.D. Preceived stress in first year medical students—Associations with personal resources and emotional distress. BMC Med. Educ. 2017, 17, 4. [Google Scholar] [CrossRef] [Green Version]
- Siegrist, J. Adverse health effects of high-effort/low-reward conditions. J. Occup. Health Psychol. 1996, 1, 27–41. [Google Scholar] [CrossRef]
- Nieuwenhuijsen, K.; Bruinvels, D.; Frings-Dresen, M. Psychosocial work environment and stress-related disorders, a systematic review. Occup. Med. 2010, 60, 277–286. [Google Scholar] [CrossRef]
- Rugulies, R.; Aust, B.; Madsen, I.E. Effort-reward imbalance at work and risk of depressive disorders. A systematic review and meta-analysis of prospective cohort studies. Scand. J. Work. Environ. Health 2017, 43, 294–306. [Google Scholar] [CrossRef]
- Eddy, P.; Wertheim, E.H.; Kingsley, M.; Wright, B.J. Associations between the effort-reward imbalance model of workplace stress and indices of cardiovascular health: A systematic review and meta-analysis. Neurosci. Biobehav. Rev. 2017, 83, 252–266. [Google Scholar] [CrossRef] [PubMed]
- Siegrist, J.; Li, J. Associations of Extrinsic and Intrinsic Components of Work Stress with Health: A Systematic Review of Evidence on the Effort-Reward Imbalance Model. Int. J. Environ. Res. Public Health 2016, 13, 432. [Google Scholar] [CrossRef] [PubMed]
- Wege, N.; Li, J.; Muth, T.; Angerer, P.; Siegrist, J. Student ERI: Psychometric properties of a new brief measure of effort-reward imbalance among university students. J. Psychom. Res. 2017, 94, 64–67. [Google Scholar] [CrossRef]
- Hilger-Kolb, J.; Diehl, K.; Herr, R.; Loerbroks, A. Effort reward imbalance among students at German universities—Associations with self-rated health and mental health. Int. Arch. Occup. Environ. Health 2018, 91, 1011–1020. [Google Scholar] [CrossRef]
- Colquitt, J.A.; Conlon, D.E.; Wesson, M.J.; Porter, C.O.; Ng, K.Y. Justice at the millennium: A meta-analytic review of 25 years of organizational justice research. J. Appl. Psychol. 2001, 86, 425–445. [Google Scholar] [CrossRef] [Green Version]
- Siegrist, J.; Wege, N. Adverse Psychosocial Work Environments and Depression–A Narrative Review of Selected Theoretical Models. Front. Psychiatry 2020, 11, 66. [Google Scholar] [CrossRef] [Green Version]
- Murtaza, G.; Roques, O.; Siegrist, J.; Talpur, Q.-U.-A. Unfairness and Stress—An Examination of Two Alternative Models: Organizational-Justice and Effort–Reward Imbalance. Int. J. Public Adm. 2021, 1–11. [Google Scholar] [CrossRef]
- Herr, R.M.; Bosch, J.A.; Loerbroks, A.; van Vianen, A.E.; Jarczok, M.N.; Fischer, J.E.; Schmidt, B. Three job stress models and their relationship with musculoskeletal pain in blue- and white-collar workers. J. Psychosom. Res. 2015, 79, 340–347. [Google Scholar] [CrossRef]
- Byrne, Z.S.; Cropanzano, R. History of organizational justice: The founders speak. In Justice in the Workplace: From Theory to Practice; Cropanzano, R., Ed.; Erlbaum: Mahwah, NJ, USA, 2001; Volume 2, pp. 3–26. [Google Scholar]
- Ndjaboue, R.; Brisson, C.; Vezina, M. Organisational justice and mental health: A systematic review of prospective studies. Occup. Environ. Med. 2012, 69, 694–700. [Google Scholar] [CrossRef]
- Robbins, J.M.; Ford, M.T.; Tetrick, L.E. Perceived Unfairness and Employee Health: A Meta-Analytic Integration. J. Appl. Psychol. 2012, 97, 235–272. [Google Scholar] [CrossRef]
- Brosnan, S.F.; de Waal, F.B. Evolution of responses to (un)fairness. Science 2014, 346, 1251776. [Google Scholar] [CrossRef] [Green Version]
- Folger, R.; Skarlicki, D.P. The evolutionary bases of deontic justice. In Justice, Morality, and Social Responsibility; Gilliland, S.W., Steiner, D.D., Skarlicki, D.P., Eds.; Information Age Publishing: Charlotte, NC, USA, 2008; pp. 29–62. [Google Scholar]
- Folger, R. Fairness as deonance. In Theoretical and Cultural Perspectives on Organizational Justice; Gilliland, S., Steiner, D., Skarlicki, D., Eds.; JAI: Greenwich, CT, USA, 2001; pp. 3–33. [Google Scholar]
- Gillespie, J.Z.; Greenberg, J. Are the Goals of Organizational Justice Self-Interested? In Handbook of Organizational Justice; Greenberg, J., Colquitt, J.A., Eds.; Lawrence Erlbaum Associates Publisher: Mahwah, NJ, USA, 2005; pp. 179–213. [Google Scholar]
- Fischer, R.; Abubakar, A.; Arasa, J.N. Organizational justice and mental health: A multi-level test of justice interactions. Int. J. Psychol. 2014, 49, 108–114. [Google Scholar] [CrossRef] [PubMed]
- Vermunt, R.; Steensma, H. Physiological Relaxation: Stress Reduction through Fair Treatment. Soc. Justice Res. 2003, 16, 135–149. [Google Scholar] [CrossRef]
- Elovainio, M.; Kivimaki, M.; Helkama, K. Organization justice evaluations, job control, and occupational strain. J. Appl. Psychol. 2001, 86, 418–424. [Google Scholar] [CrossRef] [PubMed]
- Herr, R.M.; Bosch, J.A.; van Vianen, A.E.; Jarczok, M.N.; Thayer, J.F.; Li, J.; Schmidt, B.; Fischer, J.E.; Loerbroks, A. Organizational justice is related to heart rate variability in white-collar workers, but not in blue-collar workers-findings from a cross-sectional study. Ann. Behav. Med. A Publ. Soc. Behav. Med. 2015, 49, 434–448. [Google Scholar] [CrossRef]
- Herr, R.M.; Loerbroks, A.; Bosch, J.A.; Seegel, M.; Schneider, M.; Schmidt, B. Associations of Organizational Justice with Tinnitus and the Mediating Role of Depressive Symptoms and Burnout-Findings from a Cross-Sectional Study. Int. J. Behav. Med. 2016, 23, 190–197. [Google Scholar] [CrossRef] [PubMed]
- Herr, R.M.; Bosch, J.A.; Loerbroks, A.; Genser, B.; Almer, C.; van Vianen, A.E.M.; Fischer, J.E. Organizational justice, justice climate, and somatic complaints: A multilevel investigation. J. Psychosom. Res. 2018, 111, 15–21. [Google Scholar] [CrossRef]
- Elovainio, M.; Singh-Manoux, A.; Ferrie, J.E.; Shipley, M.J.; Gimeno, D.; De Vogli, R.; Vahtera, J.; Virtanen, M.; Jokela, M.; Marmot, M.G.; et al. Organisational justice and cognitive function in middle-aged employees: The Whitehall II Study. J. Epidemiol. Community Health 2012, 66, 552–556. [Google Scholar] [CrossRef] [PubMed]
- Kivimäki, M.; Elovainio, M.; Vahtera, J.; Ferrie, J.E. Organisational justice and health of employees: Prospective cohort study. Occup. Environ. Med. 2003, 60, 27–33. [Google Scholar] [CrossRef]
- Kivimäki, M.; Elovainio, M.; Vahtera, J.; Virtanen, M.; Stansfeld, S.A. Association between organizational inequity and incidence of psychiatric disorders in female employees. Psychol. Med. 2003, 33, 319–326. [Google Scholar] [CrossRef] [Green Version]
- Herr, R.M.; Almer, C.; Bosle, C.; Fischer, J.E. Associations of Changes in Organizational Justice with Job Attitudes and Health-Findings from a Prospective Study Using a Matching-Based Difference-in-Difference Approach. Int. J. Behav. Med. 2020, 27, 119–135. [Google Scholar] [CrossRef] [PubMed]
- De Vogli, R.; Ferrie, J.E.; Chandola, T.; Kivimäki, M.; Marmot, M.G. Unfairness and health: Evidence from the Whitehall II Study. J. Epidemiol. Community Health 2007, 61, 513–518. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Elovainio, M.; Leino-Arjas, P.; Vahtera, J.; Kivimäki, M. Justice at work and cardiovascular mortality: A prospective cohort study. J. Psychosom. Res. 2006, 61, 271–274. [Google Scholar] [CrossRef]
- Gimeno, D.; Tabak, A.G.; Ferrie, J.E.; Shipley, M.J.; De Vogli, R.; Elovainio, M.; Vahtera, J.; Marmot, M.G.; Kivimäki, M. Justice at work and metabolic syndrome: The Whitehall II Study. Occup. Environ. Med. 2010, 67, 256–262. [Google Scholar] [CrossRef]
- Kivimäki, M.; Ferrie, J.E.; Brunner, E.; Head, J.; Shipley, M.J.; Vahtera, J.; Marmot, M.G. Justice at work and reduced risk of coronary heart disease among employees: The Whitehall II Study. Arch. Intern. Med. 2005, 165, 2245–2251. [Google Scholar] [CrossRef] [Green Version]
- Kouvonen, A.; Kivimäki, M.; Elovainio, M.; Vaananen, A.; De Vogli, R.; Heponiemi, T.; Linna, A.; Pentti, J.; Vahtera, J. Low organisational justice and heavy drinking: A prospective cohort study. Occup. Environ. Med. 2008, 65, 44–50. [Google Scholar] [CrossRef] [Green Version]
- Kouvonen, A.; Vahtera, J.; Elovainio, M.; Cox, S.J.; Cox, T.; Linna, A.; Virtanen, M.; Kivimäki, M. Organisational justice and smoking: The Finnish public sector study. J. Epidemiol. Community Health 2007, 61, 427–433. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Leventhal, G.S. The Distribution of Rewards and Resources in Groups and Organizations. In Advances in Experimental Social Psychology; Elsevier: Amsterdam, The Netherlands, 1976; pp. 91–131. [Google Scholar]
- Leventhal, G.S. What Should Be Done with Equity Theory? In Social Exchange: Advances in Theory and Research; Gergen, K.J., Greenberg, M.S., Willis, R.H., Eds.; Springer: Boston, MA, USA, 1980; pp. 27–55. [Google Scholar]
- Bies, R.J.; Moag, J.S. Interactional justice: Communication criteria of fairness. In Research on Negotiations in Organizations; Lewicki, R.J., Sheppard, B.H., Bazerman, M.H., Eds.; JAI Press Inc.: Greenwich, UK, 1986; pp. 43–55. [Google Scholar]
- Navarro-Abal, Y.; Gomez-Salgado, J.; Lopez-Lopez, M.J.; Climent-Rodriguez, J.A. Organisational Justice, Burnout, and Engagement in University Students: A Comparison between Stressful Aspects of Labour and University Organisation. Int. J. Environ. Res. Public Health 2018, 15, 2116. [Google Scholar] [CrossRef] [Green Version]
- Creswell, J.W. A Concise Introduction to Mixed Methods Research; SAGE: Thousand Oaks, CA, USA, 2015. [Google Scholar]
- Diehl, K.; Fuchs, A.K.; Rathmann, K.; Hilger-Kolb, J. Students’ Motivation for Sport Activity and Participation in University Sports: A Mixed-Methods Study. BioMed Res. Int. 2018, 2018, 9524861. [Google Scholar] [CrossRef]
- Curry, L.; Nunez-Smith, M. Mixed Methods in Health Sciences Research; SAGE: Thousand Oaks, CA, USA, 2014. [Google Scholar]
- Artino, A.R., Jr.; La Rochelle, J.S.; Dezee, K.J.; Gehlbach, H. Developing questionnaires for educational research: AMEE Guide No. 87. Med. Teach. 2014, 36, 463–474. [Google Scholar] [CrossRef] [Green Version]
- Gehlbach, H.; Artino, A.R., Jr.; Durning, S. AM last page: Survey development guidance for medical education reserachers. Acad. Med. 2010, 85, 925. [Google Scholar]
- WHO. Research Tools: Process of Translation and Adaptation of Instruments; World Health Organization: Geneva, Switzerland, 2015.
- Colquitt, J.A.; Shaw, J.C. How should organizational justice be measured. In Handbook of Organizational Justice; Greenberg, J., Colquitt, J.A., Eds.; Lawrence Erlbaum Associates Publishers: Mahwah, NJ, USA, 2005; pp. 113–152. [Google Scholar]
- Mayring, P.; Fenzl, T. Qualitative inhaltsanalyse. In Handbuch Methoden der Empirischen Sozialforschung; Springer: Berlin/Heidelberg, Germany, 2019; pp. 633–648. [Google Scholar]
- Mayring, P. Qualitative Inhaltsanalyse. Grundlagen und Techniken; Beltz: Weinheim, Germany, 2010. [Google Scholar]
- Destatis. Bildung und Kultur. Studierende an Hochschulen. Fachserie 11, Reihe 4.1. Available online: https://www.destatis.de/DE/Themen/Gesellschaft-Umwelt/Bildung-Forschung-Kultur/Hochschulen/Publikationen/Downloads-Hochschulen/studierende-hochschulen-endg-2110410197004.pdf?__blob=publicationFile (accessed on 21 October 2022).
- Faul, F.; Erdfelder, E.; Buchner, A.; Lang, A.G. Statistical power analyses using G*Power 3.1: Tests for correlation and regression analyses. Behav. Res. Methods 2009, 41, 1149–1160. [Google Scholar] [CrossRef] [Green Version]
- Herr, R.M.; Li, J.; Bosch, J.A.; Schmidt, B.; DeJoy, D.M.; Fischer, J.E.; Loerbroks, A. Psychometric properties of a German organizational justice questionnaire (G-OJQ) and its association with self-rated health: Findings from the Mannheim Industrial Cohort Studies (MICS). Int. Arch. Occup. Environ. Health 2014, 87, 85–93. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Rouquette, A.; Falissard, B. Sample size requirements for the internal validation of psychiatric scales. Int. J. Methods Psychiatr. Res. 2011, 20, 235–249. [Google Scholar] [CrossRef] [Green Version]
- Sonnleitner, P.; Kovacs, C. Differences Between Students’ and Teachers’ Fairness Perceptions: Exploring the Potential of a Self-Administered Questionnaire to Improve Teachers’ Assessment Practices. Front. Educ. 2020, 5, 17. [Google Scholar] [CrossRef]
- Rasooli, A.; DeLuca, C.; Rasegh, A.; Fathi, S. Students’ critical incidents of fairness in classroom assessment: An empirical study. Soc. Psychol. Educ. 2019, 22, 701–722. [Google Scholar] [CrossRef]
- Chory, R.M. Enhancing Student Perceptions of Fairness: The Relationship between Instructor Credibility and Classroom Justice. Commun. Educ. 2007, 56, 89–105. [Google Scholar] [CrossRef]
- Fenu, G.; Galici, R.; Marras, M. Experts’ View on Challenges and Needs for Fairness in Artificial Intelligence for Education. In Proceedings of the Artificial Intelligence in Education; Springer: Cham, Switzerland, 2022; pp. 243–255. [Google Scholar]
Justice Components |
---|
Distributive justice: fairness of distribution of outcomes
|
|
|
Procedural justice: fairness of the decision-making process leading to the allocation of outcomes |
|
|
|
|
|
|
Interactional justice: fairness in interpersonal interactions |
|
|
|
|
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Herr, R.M.; Deyerl, V.M.; Hilger-Kolb, J.; Diehl, K. University Fairness Questionnaire (UFair): Development and Validation of a German Questionnaire to Assess University Justice—A Study Protocol of a Mixed Methods Study. Int. J. Environ. Res. Public Health 2022, 19, 16340. https://doi.org/10.3390/ijerph192316340
Herr RM, Deyerl VM, Hilger-Kolb J, Diehl K. University Fairness Questionnaire (UFair): Development and Validation of a German Questionnaire to Assess University Justice—A Study Protocol of a Mixed Methods Study. International Journal of Environmental Research and Public Health. 2022; 19(23):16340. https://doi.org/10.3390/ijerph192316340
Chicago/Turabian StyleHerr, Raphael M., Veronika M. Deyerl, Jennifer Hilger-Kolb, and Katharina Diehl. 2022. "University Fairness Questionnaire (UFair): Development and Validation of a German Questionnaire to Assess University Justice—A Study Protocol of a Mixed Methods Study" International Journal of Environmental Research and Public Health 19, no. 23: 16340. https://doi.org/10.3390/ijerph192316340
APA StyleHerr, R. M., Deyerl, V. M., Hilger-Kolb, J., & Diehl, K. (2022). University Fairness Questionnaire (UFair): Development and Validation of a German Questionnaire to Assess University Justice—A Study Protocol of a Mixed Methods Study. International Journal of Environmental Research and Public Health, 19(23), 16340. https://doi.org/10.3390/ijerph192316340