Next Article in Journal
Influence of Active Exposure to Tobacco Smoke on Nitric Oxide Status of Pregnant Women
Next Article in Special Issue
Larger Workplaces, People-Oriented Culture, and Specific Industry Sectors Are Associated with Co-Occurring Health Protection and Wellness Activities
Previous Article in Journal
A Systematic Review of the Basis for WHO’s New Recommendation for Limiting Aircraft Noise Annoyance
Previous Article in Special Issue
Moral or Dirty Leadership: A Qualitative Study on How Juniors Are Managed in Dutch Consultancies
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
IJERPH
Volume 15
Issue 12
10.3390/ijerph15122718
ijerph-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

New Burnout Evaluation Model Based on the Brief Burnout Questionnaire: Psychometric Properties for Nursing

by
María del Carmen Pérez-Fuentes
1,*,
María del Mar Molero Jurado
1,
África Martos Martínez
1 and
José Jesús Gázquez Linares
1,2
1
Department of Psychology, Faculty of Psychology, University of Almería, 04120 Almería, Spain
2
Department of Psychology, Universidad Autónoma de Chile, Región Metropolitana, Providencia 7500000, Chile
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2018, 15(12), 2718; https://doi.org/10.3390/ijerph15122718
Submission received: 19 November 2018 / Revised: 28 November 2018 / Accepted: 30 November 2018 / Published: 2 December 2018
(This article belongs to the Special Issue Using Total Worker Health® to Advance Worker Health and Safety)
Browse Figures
Versions Notes

Abstract

:
Health care personnel are considered one of the worker sectors most exposed to heavier workloads and work stress. One of the consequences associated with the exposure to chronic stress is the development of burnout syndrome. Given that evaluating this syndrome requires addressing the context in which they are to be used, the purpose of this work was to analyze the psychometric properties and structure of the Burnout Brief Questionnaire (CBB), and to propose a more suitable version for its application to health professionals, and more specifically nurses. The final study sample was made up of 1236 working nursing professionals. An exploratory factorial analysis was carried out and a new model was proposed through a confirmatory factorial analysis. Thus, validation of the CBB questionnaire for nursing health care personnel showed an adequate discrimination of the items and a high internal consistency of the scale. With respect to the factorial analysis, four factors were extracted from the revised model. Specifically, these new factors, called job dissatisfaction, social climate, personal impact, and motivational abandonment, showed an adequate index of adjustment. Thus, the Brief Burnout Questionnaire Revised for nursing staff has favorable psychometric properties, and this model can be applied to all health care professionals.

1. Introduction

The number of health care workers in Spain increases year after year, as the number of official association members testifies, in fields such as medicine, which in 2015 increased by 1.9%. The number of nurses rose by 3.4% [1] to nearly 300,000 registered nurses according to the latest data from the National Statistics Institute [2]. Furthermore, the role of nursing personnel is more and more important, and the emotional skills and stressful work climate of nurses must be taken into account, but not only for them, as there are now studies analyzing these factors even in students of physiotherapy, for example [3]. Therefore, nurses are gradually facing situations and settings with more pressure and heavier workloads [4], which produce scenarios filled with strain and job stress [5].
According to the Encyclopedia of Mental Health, burnout syndrome is a type of response to chronic emotional and interpersonal stress factors at work, which is recognized as a serious occupational hazard [6]. The presence of stressors at work maintained over long periods of time can cause burnout in workers, especially those who maintain a constant direct care relationship with service users, as is the case of health care personnel [7], although this syndrome may also be discussed in other areas [8,9,10].
The presence of burnout syndrome in workers leads to physical, occupational, and psychological consequences, in particular, cardiovascular problems, pain, depressive symptoms, sleep problems, alcohol abuse, absenteeism, and job dissatisfaction [11]. Its appearance has also been associated with a multitude of individual and psychosocial variables [12,13].
One of the behaviors associated with this syndrome is demotivation [5,14]. Specifically, the deterioration of professional motivation, which affects almost half of nursing personnel [15], is a process derived from the perception of absence of reward and culminates in the individual’s depersonalization [16]. Motivation, which refers to choices of ends and means, depends in large part on an individual’s beliefs and values at the time a situation is evaluated. Motivation generates feelings that lead to action on the job, while demotivation creates limits and promotes expressions of displeasure and distress [17]. According to a study by Achour et al. [18], lack of recognition and motivation are two challenges that health care personnel must face as heavier workloads are assigned and measurements of performance become stricter. This directly affects their performance and job satisfaction [19]. So nursing professionals with the most intrinsic motivation (that is, motivated by their own enjoyment of performing the task for humanitarian reasons) and extrinsic motivation (associated with economic characteristics and scheduling flexibility) show higher levels of job satisfaction and less burnout [20].
Job satisfaction specifically refers to the enjoyment individuals find in their job [21]. Lack of satisfaction in health care jobs has been associated with the presence of burnout in workers, and also with the intention of quitting the profession and diminishing quality of the care given [22,23]. According to Farnaz et al. [24], job satisfaction in nursing is associated mainly with environmental factors, in detriment to sociodemographic and individual factors, so improving satisfaction in job positions involves enriching the characteristics of the organizations nurses work in.
The workplaces with the highest quality, with regard to both setting and structure, are associated with greater well-being and lower levels of burnout among health care personnel [25,26]. Therefore, it is of vital importance that healthy work environments, where the psychological health of nursing staff is given attention, be promoted [27]. In turn, study of the prevention, treatment, and measurement of severe widespread problems in this population, such as burnout syndrome, must continue to progress [28].
The most widely used instrument for the evaluation of burnout is the Maslach Burnout Inventory (MBI) [29]. This instrument was designed for evaluating professionals, such as nurses, who perform their job while interacting with users of their service [30], and has been extensively described and validated internationally [31]. Its manual describes burnout as occurring at high levels of emotional exhaustion and depersonalization, in combination with low scores in personal accomplishment. However, other studies [32] make use of alternative proposals to determine the presence of burnout, such as the definition by Poncet et al. [33], who estimated that this syndrome is present among professionals with a cumulative score over –9 on the MBI.
Although there are studies confirming the Maslach Burnout Inventory questionnaire’s three dimensions [34,35,36], other studies have found factor structures based on two [37,38] and five dimensions [39,40]. Densten [39], after confirmatory analysis of the instrument, found that the structure based on five scales was more strongly supported than the model of three, or even four. Thus, while the depersonalization factor was maintained in this new division of factors, emotional exhaustion was divided into “somatic strain” and “psychological strain,” while personal accomplishment was broken down into “self-accomplishment” and “working with others.”
Another alternative instrument to the MBI for evaluating burnout is the Brief Burnout Questionnaire (CBB) [41]. The CBB comprises 21 items that evaluate not only the syndrome itself, but also its antecedents and consequences. That is, it understands burnout as a process [42]. The instrument was validated in teaching professionals, showing adequate convergent validity with the MBI on the total burnout scale (but not, however, on all the syndrome factors), so the authors recommended it for evaluating some elements present in the burnout process (specifically antecedents, burnout, and consequences), but not for direct evaluation of its specific components. Few studies have used this questionnaire [43,44,45], as shown in the review by Ahola et al. [46], who indicated that they were unaware of the existence of the questionnaire’s validation. It has also been adapted for use with housewives [47], in which a three-factor structure similar to the one found in the original questionnaire was found. However, this instrument has received some criticism. For example, in the validation done in a sample of teachers in Aragon Province, Spain [48], no significant differences were found on some of the scales between men and women, which might be due to the inappropriateness of the items in showing the behavior associated on each scale. The results have also shown low reliability, and it was concluded that its use has generated little validity, mainly because of its factor division [49].
According to Domínguez-Lara [50], the multifactor internal structure of burnout evaluation instruments must be analyzed considering the context where they are going to be used, since even though the construct may have a good theoretical basis, the configuration of its structure may vary when used in real environments. Therefore, the purpose of this study is to show that the CBB is a valid model for different cultures and societies, as this scale has awakened great interest in recent years. In addition to analyzing its psychometric properties and structure, this study proposes the best version or model for its application to health care professionals, and nurses in particular.

2. Materials and Methods

2.1. Participants

The sample was made up of 1352 nurses selected at random from several health centers, and therefore actively employed at the time data were collected. Subjects who did not complete the questionnaire or who gave random answers (detected by control questions) were eliminated from the study. The final sample consisted of a total of 1236 participants, of whom 69.3% (n = 857) were working under temporary contracts and the other 30.7% (n = 379) had permanent contracts.
The mean participant age was 31.50 years (SD = 6.18), in a range of 21 to 57 years. Of the whole sample, 84.5% (n = 1044) were women and 15.5% (n = 192) were men, with a mean age of 31.65 years (SD = 6.23) and 30.71 years (SD = 6.17), respectively. Their marital status was 55% (n = 680) single, 42.1% (n = 520) married or in a stable relationship, 2.8% (n = 34) divorced or separated, and 0.2% (n = 2) widowed. In addition, 68.9% (n = 852) of the participants had no children, 14.5% (n = 179) had 1 child, 13.2% (n = 163) had 2 children, and the remaining 3.3% (n = 41) had 3 or more.
Their distribution by area of work was 32% (n = 396) staff nurse and 21.9% (n = 271) on emergency teams, while 11.4% (n = 141) were working in the ICU, 10.7% (n = 132) in surgery, 2.3% (n = 28) in outpatient care, and 4% (n = 50) in the mental health unit. The remaining 17.6% (n = 218) were working in other areas.

2.2. Instruments

An ad hoc questionnaire was prepared to collect sociodemographic data (age, sex, marital status, and degree) and to compile information on their profession and work experience: years of experience, employment situation (permanent or temporary), work shifts (rotating, 12 h or more, nights only, and morning/afternoon), and number of patients attended to in a workday.
The CBB [41] was used to evaluate burnout syndrome in the professionals. This instrument consists of 21 items in three blocks corresponding to antecedents of burnout and its elements and consequences. Even though the purpose of the questionnaire is to evaluate the professional burnout process, it includes factors proposed in the Maslach and Jackson model [29] and components that precede and support it. The answer format is a 5-point Likert-type scale. Items 2, 4, 8, 9, and 16 must be inverted and recoded after inversion to find the corresponding overall subscale scores.

2.3. Procedure

Before the data were collected, compliance with participant information standards, confidentiality, and ethics in data processing was guaranteed. Questionnaires were implemented on a Web platform, which enabled participants to fill them out online. A series of control questions were included to detect chance or incongruent answers, and any such cases were discarded from the study sample.

2.4. Data Analysis

The descriptive and confirmatory data analyses were done following the steps by Pérez-Fuentes et al. [51]; in addition, validation was performed in two stages following the steps by Álvarez-García et al. [52]. The first stage was intended to study the structure of the CBB. To approach this objective, the sample was first randomly divided into two independent homogeneous subsamples. The first (n = 605) was used as a calibration sample for confirmatory factor analysis (CFA) of the burnout model proposed (Figure 1). Then CFA was done for the proposed model, taking the following fit indices as measures: χ2/gl, comparative fit index (CFI), Tucker–Lewis index (TLI), root mean square error of approximation (RMSEA), with the confidence interval (CI) at 90%. The index χ2/gl was used considering values below 5 acceptable [53], Comparative Fit Index (CFI) and Incremental Fit Index (IFI) over or near 0.95, and RMSEA below or very near 0.06 [54]. As a general rule, good fit of the model would be found when ratio 2/GL (degrees of freedom)≤ 3; Goodness-of-fit index (GFI), adjusted goodness of fit index (AGFI), and TLI > 0.90; CFI > 0.95; and RMSEA ≤ 0.05. The advisable respecifications were made to the proposed model, which showed good fit indices, considering theoretical and statistical criteria (modification indices, estimation errors, standardized errors of measurement). The Akaike information criterion [55] was used for model selection based on the second subsample (n = 635), which was used as the validation sample to validate the respecified model. Cronbach’s alpha [56] and split halves were used for the reliability analysis of the new scale.
In the second stage, an analysis was done to support the proposed invariant factor structure across type of contract (permanent or temporary) and gender (male/female). First, both subsamples were checked to see the goodness of fit of these structures (model M0a, Permanent-Male, and model M0b, Temporary-Female). The four resulting nested models were evaluated: (a) Model 1. Both subsamples were considered simultaneously with free parameter estimation. (b) Model 2. Metric invariance was demonstrated. (c) Model 3. Scalar invariance was demonstrated. (d) Model 4. Strict invariance. There was no consensus criterion to determine the criteria to be used to evaluate the difference in fit of the nested models [57]. This study used ΔCFI to evaluate its fit. ΔCFI interprets the model as fully invariant if the value found is below 0.01 [58]. The analyses were performed using the SPSS version 23.0 Statistical Package for Windows (IBM, Armonk, NY, USA) and the AMOS 22 program (IBM, Armonk, NY, USA).

3. Results

3.1. Preliminary Analyses

In the first place, the data show that the CBB items have a normal distribution according to the criterion of Finney and DiStefano [59], who give 2 and 7 as the maximum permissible for skew and kurtosis, respectively. In our study, the maximum was 1.24 and 2.15, respectively. In the exploratory factor analysis, principal component extraction was used with direct oblimin rotation (KMO = 0.85), which allows correlation between factors. Based on the exploratory analysis and various previous studies on validation of the questionnaire itself, other versions, and previous research, a new model is proposed.

3.2. Exploratory Factor Analysis of the Original CBB Model

The principal component analysis (chosen since the determinant of p = 0.086 showed intercorrelation of the variables, required for this method) revealed the existence of two components with eigenvalues over 1 in the first block, that is, the general antecedents scale. Thus, the scree test indicated the advisability of rotation with two factors with eigenvalues of 3.56 and 1.37, since they were clearly distanced from the third, with a score of 0.86.
After factor analysis, the items with factor saturations over 0.40 were selected from the direct oblimin rotation matrix of rotated components. As seen in Table 1, factor 1 corresponds to the items that make up the scale’s organization factor. Factor 1 comprises four items, all with loadings over 0.60, which explain 38.18% of the variance. Factor 2 is made up of five items and forms part of the task component, and explains 15.22% of the variance.
In the second block of the burnout syndrome scale, principal component analysis (determinant p = 0.124 shows intercorrelation of the variables) revealed the existence of one component with an eigenvalue over 1. As the theoretical structure of the construct was three factors, we used principal axis factoring to force the presence of three factors with varimax rotation. The scree test shows the adequacy of rotation with one factor with a value of 3.38, and the following two are scarcely below 1, with values of 0.98 and 0.96, although they are at a distance from the quartile score of 0.84.
After the factor analysis, we selected the items with the highest factor saturations from the matrix of rotated components (varimax rotation). Table 2 shows how factor 1 corresponds to the items that make up the scale’s emotional exhaustion factor. This factor comprises three items, all with loadings over 0.60, explaining 31.93% of the variance. The original questionnaire did not include item 3 in this factor, which saturated highest in factor 3. Factor 2 comprises four items, which form the lack of accomplishment component, explaining 4.99% of the variance. Item 18 is included in this factor, but not in the original version, where it was in factor 3. Finally, it should be mentioned that factor 3, which is formed by the depersonalization component, is composed of two items, and that item 3 is in this factor, unlike the original questionnaire.
The third part of the scale corresponds to the consequences of burnout, and analysis of principal components revealed the existence of one component with eigenvalues over 1. It comprises three items (13, 17, and 21), all with loadings over 0.75 (.79, 0.79, and 0.76, respectively), which explain 60.53% of the variance (KMO = 0.66; χ2(3) = 560.17, p < 0.000; Cronbach’s alpha = 0.67).

3.3. Exploratory Factor Analysis of Revised CBB Model (CBB-R)

Principal component analysis (chosen because the determinant of p = 0.001 shows intercorrelation of the variables, required by this method) revealed the existence of four components with eigenvalues over 1. The scree plot recommends rotating with four factors, with eigenvalues of 3.56 and 1.37, respectively, as they are at a clear distance from the third with a score of 0.86.
After factor analysis, we selected the items with factor saturations over 0.40 from the direct oblimin rotation matrix of rotated components. As seen in Table 3, factor 1 corresponds to the items that make up the scale’s job dissatisfaction factor. This factor comprises five items, all with loadings over 0.55, explaining 31.77% of the variance. Factor 2 has four items that form the social climate component, explaining 8.41% of the variance. Factor 3 has seven items, which make up the personal impact component and explain 5.05% of the variance. Finally, factor 4 (five items) is related to motivational exhaustion.

3.4. Confirmatory Factor Analysis of CBB Model and CBB-R Model

Table 4 analyzes the fit of the various models of the questionnaire by the original CBB model, the unidimensional CBB model, the proposed four-factor CBB model, and the revision of that model first proposed (CBB-R). The original model and the unidimensional model show values that are not very adequate. The proposed four-factor CBB model, which corresponds to what was found in the exploratory analysis, is better, but while it showed good fit indices, the advisable respecifications were made considering theoretical and statistical criteria (modification indices, errors of estimation, standardized errors of measurement), which led to elimination of items 2, 16, 3, 13, 17, and 11. The revised model showed much better fit with the calibration sample. The difference between the AIC default model value (248.497) and the AIC saturated model value (240.000) is also very small, showing that this is probably the best of the models according to the Akaike model selection criteria.
Fit indices for the proposed CBB-R model with the validation sample (n = 635) are shown in Figure 2. Confirmatory factor analysis for the proposed model was done, taking the following fit indices as measures: χ2/gl = 2.241, CFI = 0.961, TLI = 0.951, RMSEA = 0.044 (0.036–0.053).
The reliability of the model was analyzed using Cronbach’s alpha, where α = 0.89 for the total sample; for factor 1 (job dissatisfaction), comprising four items, α = 0.697; for factor 2 (social climate), made up of three items, α = 0.666; for factor 3 (personal impact), made up of four items, α = 0.808; and for factor 4 (motivational exhaustion), comprising four items, α = 0.529. Furthermore, the data found by split halves also showed both equal-length (Spearman–Brown coefficient = 0.818) and unequal-length (Spearman–Brown coefficient = 0.819) consistency of the scales.
Table 5 shows the values for all six models. It can be seen how ΔCFI is over 0.01 for models 3 and 4, accepting the configural and metric invariance. Specifically, ΔCFI between model 1 (configural and metric base model) and models 3 and 4 is 0.024, so scalar and strict invariance cannot be accepted. In the analysis of variance by gender, in all cases ΔCFI is under 0.01, so the configural, metric, scalar, and strict invariances are accepted.

4. Discussion

The validation of the CBB questionnaire for health care personnel in nursing shows adequate discrimination of items. Cronbach’s alpha for this scale was 0.089, which shows its high internal consistency.
With respect to the factor analysis, four factors were extracted from the revised model, which differed from the original structure of the Brief Burnout Questionnaire [41]. This model was proven to generate better fit of the data than the original. The percentage explained by this model was 51.86%, emphasizing the first factor, where all the items loaded over 0.55 and explained 31.77% of the variance. This factor, called job dissatisfaction, clusters indicators in two dimensions, burnout factors and burnout syndrome. This factor compiles items that refer to the balance between job expectations and reality, and how much enjoyment the individual finds in the job [21]. This coincides with the proposal made by Moreno et al. [35], in their questionnaire for evaluating professional burnout in doctors, where a factor referring to the loss of job expectations was included. Similarly, the second factor, made up of four items, groups indicators corresponding to the relationship the worker establishes with fellow workers and superiors at work. This factor, which is called social climate, responds to a cluster that may be due to the importance in developing burnout of chronic stressful interpersonal situations in the workplace [6]. The third factor grouped seven items, which in the original questionnaire were in the burnout syndrome scale, except for one, which was on the consequences scale. The cluster of these items is called the personal impact factor and refers to the direct consequences exhaustion has on different areas of an employee’s life.
Finally, the fourth factor, called motivational exhaustion, combines five items that in the original model were part of the burnout syndrome scale. The questions grouped under this factor of motivational exhaustion refer to the absence of job growth and stimulation for development in the job position. These are aspects that promote work demotivation, generate distress [17], and are among the challenges health care personnel face most frequently [18].
Although this four-factor model showed adequate fit, after making the corresponding respecifications according to theoretical and statistical criteria, items 2, 16, 3, 13, 17, and 11 were eliminated, so all 21 items in the original questionnaire were not retained. The items that were finally kept in each of the factors in the Brief Burnout Questionnaire Revised were items 6, 14, 19, and 20 for job dissatisfaction; 4, 8, and 9 in the social climate factor; 1, 7, 15, and 21 in personal impact; and 5, 10, 12, and 18 in the motivational exhaustion factor.
The model fit improved considerably this way, and also showed consistency in the validation sample. Configural and metric invariance of the model across the type of job (permanent/temporary) is also assumed, and invariance in all cases (configural, metric, scalar, and strict) across gender. Given the divergence found when clustering items, inquiry into the adequacy of the structure reported by the CBB-R for nursing personnel will have to continue. The multifactorial construct of burnout shown here, which differs from the one reported by the authors of the original study, shows the need for further study of the internal structure of the evaluation instruments in this construct in the population studied [50]. In the process of adapting and validating instruments for certain populations, it must be known whether the factor structure coincides or not with the terms of the original version, as the job characteristics of each sample partly moderate the conditions where burnout appears. The proposed model also includes an analysis of all the burnout risk and protection factors now known as found in the theoretical review.

5. Conclusions

The Brief Burnout Questionnaire Revised for health care personnel in nursing has favorable psychometric properties. The internal consistency of the total scale and each of the factors is adequate, therefore the general fit is acceptable. However, it is recommended that goodness and fit of the model continue to be analyzed to test the psychometric properties of the instrument in other groups, since this model of burnout can be applied to all care professionals.
This new evaluation model based on the CBB questionnaire adapted as an instrument for evaluation of the syndrome in health care personnel is intended to approach even closer to knowledge of burnout, exploring the different facets that comprise it. Thus, the purpose of validating the instrument was to approach burnout’s present reality. As a syndrome linked to the work environment of individuals, burnout will continue to evolve with it, accumulating new factors workers must cope with that may also lead to burnout.

Author Contributions

M.d.M.M.J., Á.M.M., and M.d.C.P.-F. contributed to the conception and design of the review. J.J.G.L. applied the search strategy. All authors applied the selection criteria. All authors completed the assessment of risk of bias. All authors analyzed the data and interpreted data. M.d.M.M.J., M.d.C.P.-F., and Á.M.M. wrote this manuscript. M.d.C.P.-F. and J.J.G.L. edited this manuscript. M.d.C.P.F. is responsible for the overall project.

Funding

This research received no external funding.

Acknowledgments

The present study was undertaken in collaboration with the Excma. Diputación Provincial de Almería. Part of this work has been developed thanks to the financing of the 2018 Own Research Plan of the University of Almería, for the help for the hiring of research personnel in predoctoral training, granted to África Martos Martínez.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. National Statistics Institute. España en Cifras; INE: Madrid, Spain, 2017.
  2. Profesionales Sanitarios Colegiados 2016. Available online: http://www.ine.es/jaxi/Datos.htm?path=/t15/p416/a2016/l0/&file=s08004.px (accessed on 15 August 2018).
  3. González-Cabanach, R.; Souto-Gestal, A.; Fernández-Cervantes, R. Emotion regulation profiles and academic stress in Physiotherapy students. Eur. J. Educ. Psychol. 2017, 10, 57–67. [Google Scholar] [CrossRef]
  4. Zhou, J.; Yang, Y.; Qiu, X.; Pan, H.; Ban, B.; Qiao, Z.; Wang, L.; Wang, W. Serial multiple mediation of organizational commitment and job burnout in the relationship between psychological capital and anxiety in Chinese female nurses: A cross-sectional questionnaire survey. Int. J. Nurs. Stud. 2018, 83, 75–82. [Google Scholar] [CrossRef] [PubMed]
  5. García-Camapayo, J.; Puebla-Guedea, M.; Herrera-Mercadal, P.; Daudén, E. Burnout Syndrome and Demotivation among Health Care Personnel. Managing Stressful Situations: The Importance of Teamwork. Actas Dermosifiliogr. 2016, 107, 400–406. [Google Scholar] [CrossRef]
  6. Maslach, C. Burnout. In Encyclopedia of Mental Health, 2nd ed.; Friedman, H., Ed.; Elsevier: Oxford, UK, 2016; pp. 222–227. ISBN 978-0-12-397045-9. [Google Scholar]
  7. Gómez, L.; Estrella, D. Síndrome de Burnout: Una revisión breve. Ciencia Humanismo Salud 2015, 2, 116–122. [Google Scholar]
  8. De Francisco, C.; Arce, C.; Vílchez, M.P.; Vales, A. Antecedents and consequences of burnout in athletes: Perceived stress and depression. Int. J. Clin. Health Psychol. 2016, 16, 221–314. [Google Scholar] [CrossRef]
  9. Pérez-Fuentes, M.C.; Gázquez, J.J.; Ruiz, M.D.; Molero, M.M. Inventory of Overburden in Alzheimer’s Patient Family Caregivers with no Specialized Training. Int. J. Clin. Health Psychol. 2017, 17, 56–64. [Google Scholar] [CrossRef] [PubMed]
  10. Martos, Á.; Pérez-Fuentes, M.C.; Molero, M.M.; Gázquez, J.J.; Simón, M.M.; Barragán, A.B. Burnout y engagement en estudiantes de Ciencias de la Salud. Eur. J Investig. 2018, 8, 23–36. [Google Scholar] [CrossRef] [Green Version]
  11. Jodas, D.A.; Nesello, F.; Eumann, A.; Durán, A.; Lopez, F.; de Andrade, S.M. Physical, psychological and occupational consequences of job burnout: A systematic review of prospective studies. PLoS ONE 2017, 12, e0185781. [Google Scholar] [CrossRef]
  12. Iorga, M.; Socolov, V.; Muraru, D.; Dirtu, C.; Soponaru, C.; Ilea, C.; Socolov, D.G. Factors Influencing Burnout Syndrome in Obstetrics and Gynecology Physicians. BioMed Res. Int. 2017, 2017, 1–10. [Google Scholar] [CrossRef] [Green Version]
  13. Schneider, A.; Weigl, M. Associations between psychosocial work factors and provider mental well-being in emergency departments: A systematic review. PLoS ONE 2018, 13, e0197375. [Google Scholar] [CrossRef]
  14. Frenet, C.; Trépanier, S.G.; Demers, M.; Austin, S. Motivational pathways of occupational and organizational turnover intention among newly registered nurses in Canada. Nurs. Outlook 2017, 65, 444–454. [Google Scholar] [CrossRef]
  15. Obradovic, Z.; Obradovic, A.; Cesir-Skoro, I. Nurses and burnout síndrome. J. Health Biol. 2013, 3, 60–64. [Google Scholar]
  16. Basinska, B.A.; Wilczek-Ruzyczka, E. The role of rewards and demansd in burnout among surgical nurses. Int. J. Occup. Med. Environ. Health 2013, 26, 593–604. [Google Scholar] [CrossRef]
  17. Pucheu, A. ¿Existen diferencias en la motivación de distintas generaciones en enfermería? Rev. Méd. Clín. Las Condes 2018, 29, 336–342. [Google Scholar] [CrossRef]
  18. Achour, N.; Munokaran, S.; Barker, F.; Soetanto, R. Staff Stress: The Sleeping Cell of Healthcare Failure. Procedia Eng. 2018, 212, 459–466. [Google Scholar] [CrossRef]
  19. Contreras, F.; Espinal, L.; Pachón, A.M.; González, J. Burnout, liderazgo y satisfacción laboral en el personal asistencial de un hospital de tercer nivel en Bogotá. Perspect. Psicol. 2013, 9, 65–80. [Google Scholar] [CrossRef] [Green Version]
  20. Dill, J.; Erickson, R.J.; Diefendorff, J.M. Motivation in caring labor: Implications for the well-being and employment outcomes of nurses. Soc. Sci. Med. 2016, 167, 99–106. [Google Scholar] [CrossRef] [Green Version]
  21. Kabir, M.N.; Parvin, M.M. Factors affecting employee job satisfaction of pharmaceutical sector. Aust. J. Bus. Manag. Res. 2011, 1, 113–123. [Google Scholar]
  22. Elbarazi, I.; Loney, T.; Yousef, S.; Elias, A. Prevalence of and factors associated with burnout among health care professionals in Arab countries: A systematic review. BMC Health Serv. Res. 2017, 17, 1–10. [Google Scholar] [CrossRef]
  23. Van Bogaert, P.; Van Heusden, D.; Verspuy, M.; Wouters, K.; Slootmans, S.; Van der Straeten, J.; Aken, V.; White, M. The Productive Ward Program™: A Two-Year Implementation Impact Review Using a Longitudinal Multilevel Study. Can. J. Nurs. Res. 2017, 49, 28–38. [Google Scholar] [CrossRef]
  24. Farnaz, R.; Kalateh, A.; Hemmati, S.; Ebrahimzade, N.; Sarikhani, Y.; Heydari, S.T.; Lankarani, K.B. The impact of environmental and demographic factors on nursing job satisfaction. Electron. Phys. 2018, 10, 6712–6717. [Google Scholar] [CrossRef] [Green Version]
  25. Molero, M.M.; Pérez-Fuentes, M.C.; Gázquez, J.J.; Simón, M.M.; Martos, Á. Burnout Risk and Protection Factors in Certified Nursing Aides. Int. J. Environ. Res. Public Health 2018, 15, 1116. [Google Scholar] [CrossRef] [PubMed]
  26. Mudallal, R.H.; Othman, W.M.; Al Hassan, N.F. Nurses’ Burnout: The Influence of Leader Empowering Behaviors, Work Conditions, and Demographic Traits. Inquiry 2017, 54, 1–10. [Google Scholar] [CrossRef] [PubMed]
  27. Wei, H.; Sewell, K.A.; Woody, G.; Rose, M.A. The state of the science of nurse work environments in the United States: A systematic review. Int. J. Nurs. Sci. 2018, 5, 1–14. [Google Scholar] [CrossRef]
  28. Pérez-Fuentes, M.C.; Molero, M.M.; Gázquez, J.J.; Oropesa, N.F. The Role of Emotional Intelligence in Engagement in Nurses. Int. J. Environ. Res. Public Health 2018, 15, 1915. [Google Scholar] [CrossRef]
  29. Maslach, C.; Jackson, S.E. Maslach Burnout Inventory; Consulting Psychologists Press: Palo Alto, CA, USA, 1981. [Google Scholar]
  30. Squieres, A.; Finlayson, C.; Gerchow, L.; Cimiotti, J.P.; Matthews, A.; Schwendimann, R.; Griffiths, P.; Busse, R.; Heinen, M.; Brzostek, T.; et al. Methodological considerations when translating “burnout”. Burn Res. 2014, 1, 59–68. [Google Scholar] [CrossRef] [PubMed]
  31. Martins, S.; Teixera, C.M.; Carvalho, A.S.; Hernández-Marrero, P. Compared to Palliative Care, Working in Intensive Care More than Doubles the Chances of Burnout: Results from a Nationwide Comparative Study. PLoS ONE 2016, 11, e0162340. [Google Scholar] [CrossRef]
  32. Merlani, P.; Verdon, M.; Businger, A.; Domenighetti, G.; Pargger, H.; Ricou, B. Burnout in ICU Caregivers: A Multicenter Study of Factors Associated to Centers. Am. J. Respir. Crit. 2011, 184, 1140–1146. [Google Scholar] [CrossRef]
  33. Poncet, M.C.; Toullic, P.; Papazian, L.; Barnes, N.K.; Timsit, J.F.; Pochard, F.; Chevret, S.; Schlemmer, B.; Azoulay, E. Burnout Syndrome in Critical Care Nursing Staff. Am. J. Respir. Crit. 2007, 175, 698–704. [Google Scholar] [CrossRef]
  34. Guerra, C.; Mújica, A.; Nahmias, A.; Rojas, N. Análisis psicométrico de la escala de conductas de autocuidado para psicólogos clínicos. Rev. Latinoam. Psicol. 2011, 43, 319–328. [Google Scholar] [CrossRef]
  35. Moreno, B.; Gálvez, M.; Garrosa, E.; Mingote, J.C. Nuevos planteamientos en la evaluación del burnout. La evaluación específica del desgaste profesional médico. Aten Prim. 2006, 38, 544–549. [Google Scholar] [CrossRef]
  36. Pisanti, R.; Lombardo, C.; Lucidi, F.; Violani, C.; Lazzari, D. Psychometric properties of the Maslach Burnout Inventory for Human Services among Italian nurses: A test of alternative models. J. Adv. Nurs. 2013, 69, 697–707. [Google Scholar] [CrossRef] [PubMed]
  37. Kalliath, T.J.; O´Driscoll, M.P.; Gillespie, D.F.; Bluedorn, A.C. A test of the Maslach Burnout Inventory in three samples of healthcare professionals. Work Stress 2000, 14, 35–50. [Google Scholar] [CrossRef]
  38. Kim, H.; Ji, J. Factor structure and longitudinal invariance of the Maslach Burnout Inventory. Res. Soc. Work Pract. 2009, 19, 325–339. [Google Scholar] [CrossRef]
  39. Densten, I.L. Re-thinking burnout. J. Organ. Behav. 2001, 22, 833–847. [Google Scholar] [CrossRef]
  40. García, J.M.; Herrero, S.; León, J.L. Validez factorial del Maslach Burnout Inventory (MBI) en una muestra de trabajadores del Hospital Psiquiátrico Penitenciario de Sevilla. Apuntes Psicol. 2007, 25, 157–174. [Google Scholar]
  41. Moreno-Jiménez, B.; Bustos, R.; Matallana, A.; Miralles, T. La evaluación del burnout. Problemas y alternativas. El CBB como evaluación de los elementos del proceso. Rev. Psicol. Trabajo Organ. 1997, 13, 185–207. [Google Scholar]
  42. Mingote, J.C.; Moreno, B.; Gálvez, M. Desgaste profesional y salud de los profesionales médicos: Revisión y propuestas de prevención. Med. Clínica 2004, 123, 265–270. [Google Scholar] [CrossRef]
  43. Blanco-Álvarez, T.M.; Thoen, M.A. Factores asociados al estrés laboral en policías penitenciarios costarricenses. Rev. Costarric. Psicol. 2017, 36, 45–59. [Google Scholar] [CrossRef]
  44. Correa-Correa, Z.; Muñoz-Zambrano, I.; Chaparro, A.F. Síndrome de Burnout en docentes de dos universidades de Popayán, Colombia. Rev. Salud Pública 2010, 12, 589–598. [Google Scholar] [CrossRef] [Green Version]
  45. Roger, M.C.; Abalo, J.G.; Pérez, C.M.; Ochoa, I.I.; Abalo, R.G.; Abalo, Y. El control of burnout syndrome de desgaste professional o burnout en enfermeria oncológica: Una experiencia de intervención. Terapia Psicol. 2006, 24, 39–53. [Google Scholar]
  46. Ahola, K.; Toppinen-Tanner, S.; Seppänen, J. Interventions to alleviate burnout symptoms and to support return to work among employees with burnout: Systematic review and meta-analysis. Burn Res. 2017, 4, 1–11. [Google Scholar] [CrossRef]
  47. González-Ramírez, M.T.; Landero, R.; Moral de la Rubia, J.M. Cuestionario de Burnout para amas de casa (CUBAC): Evaluación de sus propiedades psicométricas y del Modelo Secuencial de Burnout. Univ. Psychol. 2009, 8, 533–544. [Google Scholar]
  48. Montero, J.; García-Campayo, J.; Andrés, E. Validez factorial de la estructura del Cuestionario Breve de Burnout (CBB) en una muestra de docentes en Aragón. Rev. Psicopatol. Psicol. Clin. 2009, 14, 123–132. [Google Scholar] [CrossRef]
  49. Domínguez-Lara, S.; Fernández-Arata, M. Cuestionario breve de Burnout, ¿una elección adecuada? Enferm Clín. 2018, 28, 214–215. [Google Scholar] [CrossRef] [PubMed]
  50. Domínguez-Lara, S.A. Análisis factorial y confiabilidad del Burnout Screening Inventory. Educ. Méd. 2017, 19, 125–130. [Google Scholar] [CrossRef]
  51. Pérez-Fuentes, M.C.; Molero, M.M.; Martos, A.; Barragán, A.B.; Gázquez, J.J.; Sánchez-Marchán, C. Spanish analysis and validation of Peer Conflict Scale. Eur. J. Educ. Psychol. 2016, 9, 56–62. [Google Scholar] [CrossRef]
  52. Álvarez-García, D.; Barreiro-Collazo, A.; Núñez, J.C.; Dobarro, A. Validity and reliability of the Cyber-aggression Questionnaire for Adolescents (CYBA). Eur. J. Psychol. Appl. Legal Context 2017, 8, 69–77. [Google Scholar] [CrossRef]
  53. Bentler, P.M. EQS Structural Equations Program Manual; BMDP Statistical Software: Los Angeles, CA, USA, 1989. [Google Scholar]
  54. Hair, J.F.; Black, W.C.; Babin, B.J.; Anderson, R.E.; Tatham, R.L. Multivariate Data Analysis, 7th ed.; Pearson Prentice Hall: Upper Saddle River, NJ, USA, 2006. [Google Scholar]
  55. Akaike, H. A new look at the statistical model identification. IEEE Trans. Autom. Control 1974, 19, 716–723. [Google Scholar] [CrossRef]
  56. Cronbach, L.J. Coefficient alpha and the internal structure of tests. Psychometrika 1951, 16, 297–334. [Google Scholar] [CrossRef] [Green Version]
  57. Byrne, B.M.; Stewart, S.M. The MACS approach to testing for multigroup invariance of a second-order structure: A walk through the process. Struct. Equ. Models 2006, 13, 287–321. [Google Scholar] [CrossRef]
  58. Cheung, G.W.; Rensvold, R.B. Evaluating goodness-of-fit indexes for testing measurement invariance. Struct. Equ. Models 2002, 9, 233–255. [Google Scholar] [CrossRef]
  59. Finney, S.J.; DiStefano, C. Non-normal and categorical data in structural equation modeling. In Structural Equation Modeling: A Second Course; Hancock, G.R., Mueller, R.O., Eds.; Information Age: Greenwich, CT, USA, 2006; pp. 269–314. [Google Scholar]
Ijerph 15 02718 g001 550
Figure 1. Proposed Burnout model.
Figure 1. Proposed Burnout model.
Ijerph 15 02718 g001
Ijerph 15 02718 g002 550
Figure 2. Proposed CBB-R model (validation sample n = 635). Note: F1: job dissatisfaction; F2: social climate; F3: personal impact; F4: motivational exhaustion.
Figure 2. Proposed CBB-R model (validation sample n = 635). Note: F1: job dissatisfaction; F2: social climate; F3: personal impact; F4: motivational exhaustion.
Ijerph 15 02718 g002
Table
Table 1. Factor structure, communalities (h2), eigenvalues, Cronbach’s alpha, and percentage of explained variance (n = 1236). Extraction method: principal component analysis.
Table 1. Factor structure, communalities (h2), eigenvalues, Cronbach’s alpha, and percentage of explained variance (n = 1236). Extraction method: principal component analysis.
Principal component analysisF1F2h2
Item 20.560.630.53
Item 40.65 0.42
Item 6 0.790.63
Item 80.81 0.66
Item 90.79 0.62
Item 10 0.550.31
Item 14 0.680.48
Item 160.78 0.63
Item 20 0.800.64
Eigenvalue3.561.37
Percentage explained variance39.5115.2254.73
Kaiser–Meyer–Olkin0.85
Barlett’s sphericityχ2(36) = 3019.35, p < 0.000
Cronbach’s alpha 0.750.730.79
Note: Items are listed in decreasing order by saturation. Visualization coefficient > 0.40. F1: organization; F2: task.
Table
Table 2. Factor structure, communalities (h2), eigenvalues, Cronbach’s alpha, and percentage of explained variance (n = 1236). Extraction method: principal component analysis.
Table 2. Factor structure, communalities (h2), eigenvalues, Cronbach’s alpha, and percentage of explained variance (n = 1236). Extraction method: principal component analysis.
Principal component analysisF1F2F3h2
Item 10.76 0.68
Item 3 0.720.58
Item 5 0.49 0.27
Item 70.60 0.48
Item 11 0.440.37
Item 12 0.50 0.33
Item 150.72 0.66
Item 18 0.28 0.11
Item 19 0.30 0.17
Eigenvalue3.380.980.96
Percentage explained variance31.934.993.7440.66
Kaiser–Meyer–Olkin 0.84
Barlett’s sphericity χ2(36) = 2569.33, p < 0.000
Cronbach’s alpha0.810.490.570.76
Note: Items are listed order by saturation in decreasing. Visualization coefficient >0.40. F1: emotional exhaustion; F2: lack of accomplishment; F3: depersonalization.
Table
Table 3. Factor structure, communalities (h2), eigenvalues, Cronbach’s alpha, and percentage of explained variance (n = 1236). Extraction method: principal component analysis.
Table 3. Factor structure, communalities (h2), eigenvalues, Cronbach’s alpha, and percentage of explained variance (n = 1236). Extraction method: principal component analysis.
Principal component analysisF1F2F3F4h2
Item 10.560.410.65 0.61
Item 20.590.58 0.55
Item 3 0.620.450.49
Item 4 0.65 0.43
Item 50.43 0.570.41
Item 60.70 0.560.64
Item 70.44 0.62 0.51
Item 8 0.80 0.66
Item 9 0.78 0.62
Item 10 0.610.38
Item 11 0.400.670.51
Item 120.44 0.620.47
Item 13 0.78 0.62
Item 140.56 0.41 0.40
Item 150.56 0.70 0.66
Item 16 0.770.41 0.64
Item 17 0.66 0.47
Item 18 0.530.30
Item 190.66 0.44
Item 200.76 0.64
Item 21 0.62 0.46
Eigenvalue6.671.761.391.06
Percentage explained variance31.778.416.645.0551.86
Kaiser–Meyer–Olkin0.92
Barlett’s sphericity χ2(210) = 8449.54, p < 0.000
Cronbach’s alpha 0.740.750.820.590.88
Note: Items are listed in decreasing order by saturation. Visualization coefficient >0.40. F1: job dissatisfaction; F2: social climate; F3: personal impact; F4: motivational exhaustion.
Table
Table 4. Fit indices for the models proposed (calibration sample; n = 605).
Table 4. Fit indices for the models proposed (calibration sample; n = 605).
Modelχ2 (df)χ2/dfCFITLIRMREst.RMSEA
CI 90%
Bel.Abv.
Original CBB model 931.446 (179)5.2040.8220.7910.0420.083 0.0780.089
Unidimensional CBB model1305.043 (189)6.9040.7350.7060.0590.0990.0940.104
Proposed CBB model 664.676 (183)3.6320.8860.8690.0440.066 0.0610.071
Proposed CBB-R model 176.497 (84)2.1010.9650.9560.0270.043 0.0340.052
Note: CFI, comparative fit index; TLI, Tucker–Lewis index; RMSEA, root mean square error of approximation; CI, confidence interval; df, degrees of freedom; Est., estimation; Bel., below; Abv., above. CBB: CBB-R (Revised CBB Model).
Table
Table 5. Multigroup analysis of variance by type of contract (permanent/temporary) and gender (male/female).
Table 5. Multigroup analysis of variance by type of contract (permanent/temporary) and gender (male/female).
Modelχ2glχ2/glΔχ2CFIΔCFIIFIRMSEA (CI 90%)
M0a (permanent)376.265 (p = 0.000)1682.239 0.960 0.9610.032 (0.027–0.036)
M0b (temporary)417.761 (p = 0.000)1792.333 0.955 0.9550.033 (0.029–0.037)
M1 (base model set)505.309 (p = 0.000)1942.604 0.941 0.9410.036 (0.032–0.040)
M2 (FS)544.696 (p = 0.000)2092.60639.3870.9360.0050.9360.036 (0.032–0.040)
M3 (FS + Int)376.265 (p = 0.000)1682.239129.0440.9600.0240.9610.032 (0.027–0.036)
M4 (FS + Int + Err)376.265 (p = 0.000)1682.239129.0440.9600.0240.9610.032 (0.027–0.036)
M0a (male)383.819 (p = 0.000)1682.284 0.959 0.9600.032 (0.028–0.037)
M0b (female)407.567 (p = 0.000)1792.276 0.957 0.9570.032 (0.028–0.036)
M1 (base model set)446.771 (p = 0.000)1942.302 0.952 0.9530.032 (0.029–0.036)
M2 (FS)474.727 (p = 0.000)2092.27127.9560.9500.0020.9500.032 (0.028–0.036)
M3 (FS + Int)383.819 (p = 0.000)1682.28462.9520.9590.0090.9600.032 (0.028–0.037)
M4 (FS + Int + Err)376.265 (p = 0.000)1682.28462.9520.9590.0090.9600.032 (0.028–0.037)
Nota FS = factor saturation; Int = intercepts; Err = error.

Share and Cite

MDPI and ACS Style

Pérez-Fuentes, M.d.C.; Molero Jurado, M.d.M.; Martos Martínez, Á.; Gázquez Linares, J.J. New Burnout Evaluation Model Based on the Brief Burnout Questionnaire: Psychometric Properties for Nursing. Int. J. Environ. Res. Public Health 2018, 15, 2718. https://doi.org/10.3390/ijerph15122718

AMA Style

Pérez-Fuentes MdC, Molero Jurado MdM, Martos Martínez Á, Gázquez Linares JJ. New Burnout Evaluation Model Based on the Brief Burnout Questionnaire: Psychometric Properties for Nursing. International Journal of Environmental Research and Public Health. 2018; 15(12):2718. https://doi.org/10.3390/ijerph15122718

Chicago/Turabian Style

Pérez-Fuentes, María del Carmen, María del Mar Molero Jurado, África Martos Martínez, and José Jesús Gázquez Linares. 2018. "New Burnout Evaluation Model Based on the Brief Burnout Questionnaire: Psychometric Properties for Nursing" International Journal of Environmental Research and Public Health 15, no. 12: 2718. https://doi.org/10.3390/ijerph15122718

APA Style

Pérez-Fuentes, M. d. C., Molero Jurado, M. d. M., Martos Martínez, Á., & Gázquez Linares, J. J. (2018). New Burnout Evaluation Model Based on the Brief Burnout Questionnaire: Psychometric Properties for Nursing. International Journal of Environmental Research and Public Health, 15(12), 2718. https://doi.org/10.3390/ijerph15122718

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop