Next Article in Journal
Dry Port Terminal Location Selection by Applying the Hybrid Grey MCDM Model
Next Article in Special Issue
Application of Ecosophical Perspective to Advance to the SDGs: Theoretical Approach on Values for Sustainability in a 4S Hotel Company
Previous Article in Journal
Regenerativescapes: Incremental Evaluation for the Regeneration of Unresolved Territories in East Naples
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Constraints and Consequences of Online Teaching

Department of Sociology, West University of Timișoara, 300223 Timisoara, Romania
Sustainability 2020, 12(17), 6982; https://doi.org/10.3390/su12176982
Submission received: 23 July 2020 / Revised: 24 August 2020 / Accepted: 25 August 2020 / Published: 27 August 2020
(This article belongs to the Special Issue The Eco-Philosophy of an Organic Community)

Abstract

:
In Romania, like in many other European countries, schools and universities were closed and classes were transferred entirely online at the beginning of March 2020, due to the new coronavirus SARS-CoV-2 (COVID-19) outbreak, declared as a pandemic by the World Health Organization (WHO). In the context of drastic changes and uncertainty, teachers across Romania had to face the challenges of transferring lectures online. The small window of time left to adapt to new technologies, along with other stressors, called into question their work engagement and performance, as key factors for the sustainability of the educational system. An approach based on the dimensions of induced stress, resilience behavior, professional support, and work engagement was implemented to highlight the impact of socio-professional changes during the COVID-19 on the activity of 400 teachers from Romania. The designed construct was validated and subsequently a model was proposed, by using factor analysis and Structural Equation Modeling (SEM). The article brings updated information on the complex relationship between stress and resilience in the case of employees from the area of education. Among other results, the present research highlights the structure of work engagement and the mediating role of professional support in the relationship between stressors and resilience mechanisms.

1. Introduction

The main purpose of the present study is to find out to what extent the Romanian teachers are able to meet the new requirements of their professional activity and if the current social state might influence their work implication. The social context we are referring to is determined by the social changes that led a series of changes and limitations, both at the psycho-social level (e.g., threats to health and safety, social distancing and isolation, etc.), and at the professional level (e.g., shifting the traditional way of face to face teaching to online education).
This research focuses mainly on the following: the changes in the teachers’ working conditions, the use of new online teaching tools, the way in which the professional community of educators in Romania manages and adapts in order to attain the didactic objectives. The research project started from the assumption that the stressors of Romanian teachers are mainly related to major changes in the form of the professional act (shifting from mainly off-line education to exclusively online education as well as challenges of new educational instruments. Such factors are added to the already existing constraints of the education system. I investigated the way in which contextual factors determine the well-being of school and university employees and the way these factors are managed, in connection with work engagement. The sustainability of an education system is also achieved through the quality of the educational act, with teachers as main characters.
The research focused on identifying the main educational constraints as well as the contextual stressors, to identify the level at which the resilience mechanisms were triggered, to determine the factors that mediate resilience and work engagement. Work engagement and the current state of the teachers in the gear of relations with other research dimensions were considered necessary conditions for ensuring the quality of the educational process in relation to the Sustainable Development Goal (SDG4) of the United Nations, created to guarantee embracive and unbiased quality education and to encourage durable learning opportunities for everyone. I also asked for the opinion of teachers from Romania, on actions that need to be taken in order to ensure the educational process sustainability, in the COVID-19 pandemic context.

1.1. Literature Review

To build the appropriate measurement scales for the research intentions stated above, the existing literature and the similar research in the field were studied. Based on these, I defined several dimensions and indicators to propose a conceptual model.

1.1.1. Constrains and Stress for Teachers (CONSS)

According to the World Health Organization (WHO), occupational stress is defined as “response people may have when presented with work demands and pressures that are not matched to their knowledge and abilities and which challenge their ability to cope” [1].
Nowadays, in the current scientific community, there is an almost unanimous consent regarding the difficulty to narrow down stressors, due to aggregate environmental influences and different ways in which each individual manages and responds to stress.
As to occupational stress, the literature has highlighted that employees are more likely to feel some factors as being stressful in specific contexts, i.e., when there are too high expectations or requirements function to their ability to complete work in good conditions, [2] when changes occur and they are not properly managed by management [3], when there is no optimal ratio between professional demands and the time to recover and rest [4,5]. Likewise, the constraints and stress involved as the result of the professional activity can also be enhanced or mitigated by a number of factors, such as relationships with colleagues and management in terms of support given, the level of collaboration between employees, the degree of employees’ work engagement and the way in which they define themselves in relation to their professional goals, as a projection of self-esteem, personal self-defense mechanisms derived from particularities of their own personality.
Regarding the stress associated with the teaching profession, there are authors who believe that “many school teachers suffer from stress and burnout” [6]. More than this, some research reports point out the fact that employees in education score higher average values of stress than employees in other sectors of activity [7]. Research on education, at various levels, has shown that the sources of stress for teachers with a direct effect on the degree of work engagement are the following: lack of their students’ motivations [8], differences between constrains and workload [9], lack of support from colleagues and management [10], poor working conditions [11], and extra-organizational stressors [12].
Kyriacou [13] makes an inventory of the way in which these factors act as predictors of stress for those working in education. When the stress is not managed properly, it can lead to phenomena of chronic fatigue, defined as burnout, through its three dimensions: emotional exhaustion, depersonalization, and reduced sense of personal accomplishment [14]. Recently, a cross cultural empirical study has shown that occupational stress has a significant reverse correlation with positive mental health [15]. However, there are also studies that indicate that in specific contexts and on short term activities, some level of stress can have a boosting effect on teaching activities and it can also increase job satisfaction [16].
As concerns the measurement of stress, there are several known instruments and scales adapted in various research contexts. The most used ones are: Maslach Burnout Inventory [17], Maslach Burnout Inventory-Educators Survey (MBI-ES) version [18], Copenhagen Burnout Inventory [19] or The Perceived Stress Questionnaire from Levenstein et al. [20].
In order to measure the action of stressors in the teaching activity, in the current context, which also contain the component of constraints and stressors associated with online education (CONSS), our own scale has been built. However, the validation process imposed the limit of this dimension to four indicators.

1.1.2. Negative Affects related to Stress (NEGAFF) and Positive Affects (POSAFF)

There have been a lot of attempts to show how individuals assess changes that occur in their immediate environments and the significance assigned to them. If changes or events occur and are perceived as uncontrollable, they generate stress and negative emotions [21]. Some researchers have agreed that there is a close link between stressors and negative affects, which individuals develop as a result of these, i.e., discomfort, stress, anxiety, depression [22,23,24]. Hu and Gruber [25] defined negative affects as being a universal outcome of unpleasant experiences and subjective stress. Negative emotions are classified as high-arousal affects, such as tension, frustration, and low-arousal affects, such as sadness and boredom. [26]
According to the existing literature, affects or positive emotions, such as joy, excitement, enthusiasm, are classified into two distinct categories: state positive affects (short-term) and trait positive affects (long-term), depending on their degree of stability, and their impact on human behavior [27]. Some researchers [28,29] show that negative emotions can also play a constructive role in learning and solving tasks. Similarly, more recent approaches [30,31] have shown that stress can be approached differently, not only through the negative emotions it causes. Positive emotions play a significant role in activating resilience mechanisms. Emotions have three dimensions: valence (positive and negative), objectifying (results), and degree of activation (they can be activators or inhibitors). Hence, there are emotions such as anger, frustration, anxiety, which are negatively activated, and there are negative emotions, such as sadness and hopelessness, which deactivate [32].
Regarding the measurement of negative and positive affects, the literature shows that there have been several scales over time: Positive and Negative Affect Schedule (PANAS) [33], the negative and positive affect scale (NAPAS) [34], or the State-Trait Emotion Measure (STEM)—scale constructed to asses emotions at the workplace [35]. To measure negative affects, I used a measurement scale with six items, out of which three items were validated.

1.1.3. Teachers Resilience and Coping (RESIL)

Resilience is mainly defined as a positive response to conditions of adversity [36]. The factors that determine an individual’s resilience defined as protective factors of stress, can come from within (specific skills such as problem solving, a high degree of autonomy and organization through goals and future plans, some personality traits, a definite belief system such as internal locus, etc.), or be external (groups, community, social context) [37].
In the organizational and professional environment, individual resilience was analyzed in relation to work performance. It was considered a reducer of counterproductive behaviors through stress management at work (Avery et al., 2011) [38]. Resilience in the professional environment was linked to organizational commitment and work engagement behaviors. There are also authors who consider that resilience is a value that can be part of an organization’s; in this case, it acts as a collective protective barrier and has the effect of an organizational environment with low stress [39,40]. There are some authors who point out that some individuals have an internal predisposition to be more or less resilient (resilience as a trait), while others claim that resilience can be learned and practiced, and use the term emotional fitness (resilience as a developing skill). Resilience, either internal/external or predisposition/behavior, becomes an individual or organizational resource that acts as a buffer against stressors [41,42,43]. Resilience is not is not confined to defense mechanisms triggered by adversity. Recent research has shown that there are positive conditions that can shape resilience and which have the effect of increasing the resilience of employees in organizations. Organizations support the capacity of their members to adapt to challenging circumstances through organizational culture, through stress management, through professional support, etc. Borman and Overman [44] show that resilient students are most likely to come from schools with a positive culture of teacher-student relationship and who have grown up in supportive families. Other recent research has analyzed the relationship between stressors occurring in teachers’ activity and coping strategies based on problem solving or those focused on emotions [45,46,47,48].
To measure the coping level and to identify the various strategies individuals use to respond to stressors several scales have been designed. They have different sizes, such as: scales with 52 items—the COPE Inventory in 1989 [49], or the shorter version, entitled the Brief COPE Inventory, with 28 items [50], up to even more concise versions: Coping Self Efficacy Scale (CSES) 2006, with 26 items [51], or the Brief Resilient Coping Scale (BRCS) [52].
In this article, I measured the coping strategies and the resilience of teachers using a scale, which was initially built with seven items, six of them were validated through factorial analysis.

1.1.4. Organizational and Professional Support (SUPP)

Next, we are going to study the role of support as a major resource of an organization. Bakker and Hakanen [53], showed that some job resources such as support from colleagues, support from the manager, and permanent information for an innovative adaptation are positively associated with an engagement in professional activity. The support that employees receive can take many forms, starting from sharing the best ways of problem solving, giving examples of good practice, all based on reciprocity, help and understanding from both the manager and work colleagues. In 2004, Schaufeli [54] referred to the two existing dimensions in each professional activity: resources and demands. These variables are closely related and can generate positive or negative results function to the dominance of one component over another and function to the specifics of the professional activity that is carried out. Thus, the result can be burnout or work engagement. Griffith et al. [55] showed that the lack of support from others (colleagues, managers) in the work of teachers becomes a stressor, while a supportive and collegial environment at work creates important premises for a serious construction of resilience and coping mechanisms. Scherer suggested that in order to adapt either to the workplace or to new activities or tools, teachers need guidance from teachers with more work experience, who are willing to collaborate [56]. Levine recognized the value of collaborative work in producing optimal results in a professional activity [57]. Other research revealed that environments that are not supportive can affect teacher job satisfaction and become stressors [58].
The measurement of the professional support that the teachers received in the educational activities was made through a scale with three items: getting help and understanding from school management, getting help from local non-governmental organizations (NGOs) and professional associations, and getting help from county and national institutions.

1.1.5. Work Engagement (WENG)

Work engagement is a concept that has often been analyzed in the literature as having an important role in maintaining employee health and organizational performance. On the long run, as far as teachers are concerned, work engagement becomes a prerequisite for the long-term sustainability of any education system.
There have been many ways to measure work engagement. On one hand, there are some authors sharing the idea that engagement of employees is defined in relation to burnout, the first concept being the opposite of the second one and that both can be measured with the same scale. On the other hand, there are the authors arguing that work engagement is a construct that involve a distinct measurement with a separate scale [59]. Some of the most frequently used tools for measuring work engagement, and derived from the two perspectives above, are the Maslach Burnout Inventory (MBI, MBI-General Survey (MBI-GS), which supports the measurement of work engagement using inverse scores on the scale, and the Utrecht Work Engagement Scale (UWES) [60])—which is a scale specifically dedicated to work engagement with several versions. Depending on the number of indicators included, UWES measures work engagement by three dimensions: vigor, dedication, and absorption. Vigor defines on the one hand the sustained desire to overcome obstacles that may occur at work place or in the exerted profession and on the other hand the determination to be resilient when professional or work-related constraints and difficulties occur [61]. Dedication is the component that is activated when someone perceives his/her work as having a high level of importance for him/her and for the others. Absorption refers to the difficulty of the individual to detach himself from his own work [60]. There are also researchers who use Gallup Q12, a tool called “satisfaction-engagement” [62] that measures the engagement defined by both dimensions. Many studies have shown that work engagement occurs when the individual is fully cognitively, emotionally, and physically involved in the profession and work they do [63]. Work engagement was explained and related to other concepts, such as: emotions and affects [64], personality dimensions [65], role performance [66], job resources [67], organizational commitment [68], and job satisfaction [69].
For the purpose of this article, a scale with 10 items was created to measure the work engagement of teachers in the context of online teaching activities (scale of online work engagement in education (OWEE)). Moreover, 6 out of 10 indicators were kept after running exploratory factor analysis.

1.1.6. Analyzed Indicators and Implications for the Sustainability of Education

In recent approaches there is a conceptual distinction between education for sustainable development (ESD), sustainable education (SE), and other related concepts [70]. Irrespective of the differences between these concepts, the formation of a sustainable world begins with the educational process and education is a tool for a better future [71]. A lot of research has highlighted that the path to the sustainability of societies is influenced by the quality of the education systems and by the way in which they will adapt to values related to sustainable development [72]. The future of society and of the environment depends on what education systems will look like in the future [73]. Teachers have an important role in education towards sustainable development [74] and their role is crucial in ensuring the degree of professional expertise in a society in which they have the quality of role models [75,76]. The way in which teachers are engaged in teaching and the skills they acquire become pillars for the sustainability of education.
The literature has shown that the well-being of teachers, the level of stress and the length of the period during which stressors act, the conditions that ensure the work engagement (professional and organizational support), influence the quality of the educational process, which is one of the premises for ensuring sustainability in education [77,78,79].

1.2. Conceptual Model and Hypothesis

Based on the findings resulting from the literature review, I proposed the initial conceptual model shown in Figure 1.
The model postulates several assumptions starting from previous research. On one hand, the changes that took place in the educational process as a result of the COVID-19 pandemic (e.g., adaptation to new technologies, various additional professional requirements) have led to negative emotions (e.g., loss of hope, fears). Job constrains, stress, and negative affects have a negative impact on teachers’ work engagement.
On the other hand, resilience mechanisms to stressors have been triggered. Such mechanisms were enhanced by the professional support that educators received during school closure. The coping behaviors and supporting work context are positively associated with job engagement.
Following related hypotheses provided the basis of the conceptual model:
Hypothesis 1 (H1).
Stress (CONSS) has a negative effect on job engagement (WENG).
Hypothesis 2 (H2).
There is a positive association between stress (CONSS) and negative affects (NEGAFF).
Hypothesis 3 (H3).
Stress (CONSS) is negatively associated with resilience (RESIL).
Hypothesis 4 (H4).
Support (SUPP) is positive associated with resilience (RESIL).
Hypothesis 5 (H5).
There is a positively relationship between job engagement (WENG) and support (SUPP).
Hypothesis 6 (H6).
There is a negative relationship between negative affects (NEGAFF) and work engagement (WENG).
Hypothesis 7 (H7).
Resilience (RESIL) moderates the relationship between stress (CONSS) and work engagement (WENG).

2. Materials and Methods

2.1. Sample and Data Collection

The research was conducted through online data gathering. The proposed questionnaire was developed and delivered by the Romanian platform isondaje.ro. All data were collected between 24 May and 3 June, 2020. A total of 400 out of 428 filled questionnaires were validated, after checking the compliance with the structure of the total population of Romanian teachers (distributed on 4 levels of education: primary, gymnasium, high school, and university). The existing statistical data (National Institute of Statistics Romania (INSSE-RO) INSSE, RO) [80] was used as a reference basis for the calibration of the sample. The 400 respondents came from 35 of the 41 counties of Romania (Table 1).

2.2. Instruments and Measures

To build the measurement scales appropriate to the research intentions, the existing literature and the similar research in the field were studied. Based on these, I defined several dimensions and indicators to propose a conceptual model. A questionnaire was designed as a research tool and it was disseminated to teachers in Romania from almost all educational cycles (primary, secondary, high school and university). The questionnaire included several measurement scales that were built and validated for the Romanian context, on a sample of 400 teachers from Romania.
An inventory was proposed consisting of measuring scales of 48 indicators grouped conceptually in 7 dimensions (Appendix A), as follows:
  • the dimension of changes at professional level—PERSCHANGE (6 indicators, referring to the impact of changes in the current socio-professional context: familiarization with the tools and platforms used in online teaching activities, adaptation of teaching content for this type of education, etc.);
  • the dimension of the constraining conditions and stress generators—CONSTRESS (10 indicators, which referred to the stress determined by the use of new technologies, rapid professional change, demotivation, exhaustion, frustration, etc.);
  • the dimension of negative affects and burnout symptoms—NEGAFF (6 indicators measuring the presence of some emotional states as: loneliness, anxiety, hopelessness and loss of meaning in life, etc.);
  • the dimension of positive affects—POSAFF (4 indicators including feelings such as love, joy, hope, etc.);
  • the dimension of resilience and coping behaviors—RESIL (it initially contained 7 indicators, referring to spending time for pleasant habits and hobbies, outdoor walks, sports, future plans, etc.);
  • the dimension of work engagement—WORKENG (10 indicators, including enthusiasm, creativity, help for pupils/students, professional fulfillment, etc.);
  • the dimension of the socio-professional help received by teachers—SUPPORT (5 indicators referring to family, friends, school or university management, NGOs and institutions with educational support).
All provided items were measured on a Likert type scale, with 5 points of intensity. The scales used for the 7 dimensions were:
(a)
1. Never, 2. Rarely, 3. Occasionally, 4. Often, 5. Nearly always;
(b)
1. To a very small extent, 2. To a small extent, 3. To a moderate extent, 4. To a large extent, 5. To a very large extent.
Additionally, two open-ended questions were provided to see the motivation behind these answers, reactions to professional problems during the pandemic period and teachers’ insights on the sustainability of Romanian education.

2.3. Multivariate Analysis

The analyses were performed with the statistical software IBM SPSS 25 and AMOS 23.
In the first stage of the empirical approach, the exploratory factor analysis (EFA) with IBM SPSS 25 was employed, in order to examine the structure and interrelationships of the variables. For each scale of the questionnaire, I performed the principal axis factoring with orthogonal rotation of factors (varimax) in order to reduce the observed variables to a minimum number of dimensions (or components) describing the maximum proportion of variance for each variable.
Secondly, the validation of the model resulting from the exploratory factor analysis and hypothesis testing was done with IBM AMOS 23.

3. Results

3.1. Exploratory Factor Analysis (EFA)

Firstly, data were checked for suitability to factorial analysis. The Kaiser–Meyer–Olkin Measure of Sampling Adequacy has a value of 0.849. According to Kaiser and Rice [81] a value of this measure over 0.7 is acceptable and above 0.8 is meritorious. (Table 2)
Together with this, the Bartlett’s test of sphericity was performed (Table 1). Sig = 0.000 was obtained, which means significance (<0.05), meaning that the correlation matrix of coefficients is not an identity matrix. In conclusion, starting from the results of these tests, I can say that the data are sufficient and suitable for factor analysis.
The factor loadings show the extent in which every measured variable is reflected in latent variables [82]. The factor loadings (FLs) have been interpreted in the sense of what Hair et al. [83] have shown. According to these authors, the present model has a significant and well-defined structure.
Regarding the communalities, as measures for reliability who indicates the proportion of each variable’s variance that can be explained by the retained factors, some authors recommend to keep items with communalities over 0.2 [84]. In the actual case, only variables with higher values than 0.33 as minimum cut off point were kipped.
The visual tool of Cattell—(scree plots) were used in order to anticipate the number of extracted factors (Figure 2) [85].
Field [86] suggests that the cumulative minimum of variance explained by factors should be around 55–65%. In the present study, the 5 factors cumulative variance explained is 66.29% (Table 3)
Another rule of decision was to follow the Kaiser rule of eigenvalues greater than one [87] and not to keep a factor with fewer than three items, because there are opinions that otherwise the factor would be too weak and unstable [88]. I eliminated 11 items out of 48, because the values of the communities were below the threshold of 0.33; other 15 items were eliminated successively because they caused cross-loadings for several factors. Thus, I achieved a reduction, and the 22 items left were extracted into 5 meaningful factors (Table 4).
The items kept according to all decisions presented above and that arise from the analysis needs are presented in Table 5. The dimensions containing these indicators were included in the SEM (structural equation modeling) and also in the complementary analyzes performed in the following sections of this article.

3.2. Confirmatory Factor Analysis (CFA)

The validation of the model resulting from the exploratory factor analysis was done with IBM AMOS 23 soft. I imported from SPSS the rotated factor matrix of the 5 factors, together with loading factors for each item, using the plugin from Gaskin and Lim [89]. In order to validate the model, I made tests with confirmatory factor analysis (CFA). The aim of the confirmatory factor analysis (CFA) is to help with making decisions about keeping some indicators in scales and instruments, and generally when assessing construct validity [90]. The purpose of the CFA is also to obtain an estimate for each parameter for the proposed model (e.g., load factor, variance factor and covariance, indicator error variance and covariance), that produce a predicted variance-covariance matrix, which resembles as close as possible the variance-covariance matrix sample [91]. First priority was to check the reliability and the validity of the conceptual model. The degree of consistency in measurement among different repeated trials expresses the reliability of a procedure or an instrument [92]. The value of composite reliability (CR) reflects good reliability when it is greater than 0.7 [93]. Cronbach’s alpha indicates the internal reliability of a construct. According to the interpretation of results by DeVellis [94], the present model has 3 “very good factors” and 2 “respectable” ones. The extent to which the collected data are accurately measuring what was intended to measure is the core of validity [95]. A model must indicate that there is evidence for both convergent validity and discriminant validity, because none of them is sufficient alone [96]. The convergent validity is reached when an indicator strongly correlates its construct. The convergent validity resulting from factor loadings shows a good fit in the model. The statistical criterion [97] for convergent validity is that any factors explain more than 50% of construct variance and when the value of composite reliability is greater than the value of the average variance extracted (AVE > 0.5 and CR > AVE). (Table 6)
Discriminant validity refers to the extent to which a set of variables are correlated with their variable outcomes. The statistical criteria for discriminant validity are that a construct should extract more variance AVE than the maximum shared variance by it with any other construct (AVE > Maximum Shared Variance (MSV)) and secondly, the amount of variance that a latent construct extracts in comparison with the error term should be more than the average amount of variance that is shared with any other construct in the model; (AVE > ASV).
I have established so far that the model has 22 observed variables (endogenous) grouped in 5 latent variables (factors). The hypothesized model has a χ2 value of 446,968 with 199 degrees of freedom and probability 0.000 and it shows the fact that the minimum value of discrepancy between unrestricted matrix of covariance and restricted matrix of covariance of the model has been achieved. Furthermore, an assessment for normality was done in order to continue the proposed analysis. In the assessment of normality section from AMOS output, it can be noticed that kurtosis values are positive and negative values, leading to an average value of −0.354. There are researchers [98,99] who argued that data is considered to be normal if skewness is between −2 to +2 and kurtosis is between −7 to +7 and only values over 7 indicate a distance from normal. Curran et al. [100] suggest the same moderate normality thresholds of 2.0 and 7.0 for skewness and kurtosis respectively, when assessing multivariate normality. Moreover, in the section of observation farthest from the centroid (Mahalanobis distances), I observe that differences between values are not significant, data being not distanced, with the only exception of an outlying case. The Mahalanobis distance measures the standard deviation between the individual values and the sample means for all variables (centroid) average of all values [101]. According to the estimates, the multivariate distribution is close to a normal distribution, with no serious reasons to reject the assumption of normality. In that case, further analyzes can be done in AMOS. Before testing the hypothesized structural model, the measurement model was first constructed to estimate the latent variables.
The result of performed test indicates in Table 7 shows an already good fit to the data: χ2 tests, the goodness of fit index (GFI), the comparative fit index (CFI), the root mean square error of approximation (RMSEA), the standardized root mean squared residual (SRMR), p of close fit (PCLOSE), and the Tucker–Lewis index (TLI). The initial values were more than acceptable, referring to Hu and Bentler [102]. The fit of the model can be improved by drawing covariances between two pairs of errors in the same construct, as suggested by high values of modification indices (MI). After drawing covariances, the results of the performed test show an improvement to already good indices, with a decrease in value of χ2 and χ2/df and increase in p of close fit value (Table 7). The measurement model is presented in Figure 3.

3.3. Testing Hypothesis and Structural Equation Modeling (SEM)

Furthermore, in order to examine the assumed relationships by hypothesis between job constraints, negative affects, support, resilience and work engagement, a path analysis approach with structural equation modeling (SEM) was done.
Path coefficients suggested that job constrains and stress were directly and positively associated with negative affects (β = 0.36, p < 0.001); job constrains and stress have a negative effect on work engagement (β = −0.42, p < 0.001); job constrains are negatively associated with resilience (β = −0.17, p < 0.05); there is a positive relationship between received support and work engagement (β = 0.16, p < 0.05); resilience is positively associated with support (β = 0.27, p < 0.001). There is no significative relationship between negative affects and work engagement (β = −0.07, p > 0.05) and there is no mediation of resilience between job constrains and work engagement. (Table 8)
The Bootstrap test was used to examine the significance of the mediating effects of resilience on the relationship between Job Constrains and Stress and Work Engagement. After testing direct and indirect effects, the conclusion was that no direct mediation was found. Neither the direct effect from supposed mediator to WENG is significant (p > 0.05), nor the indirect effect of mediation from CONSS (Job constrains and stress) to WENG (work engagement) (p > 0.05), so there is no real mediation. The H7 hypothesis of mediation cannot be supported.
However, form path model and bootstrap (2000 samples) test results that receive support (SUPP) partially moderate the relationship between CONSS and RESIL. After testing for all direct and indirect effect for all cases, the results show there are significant relationships (p < 0.05).
The results of testing the hypotheses are shown in Figure 4.

3.4. Complementary Analysis

In order to compare the degree to which different indicators of the 5 dimensions (CONSS, RESIL, SUPP, NEGAFF, WENG) have a higher contribution to the predominance of a dimension, I have rated each answer variant as follows: 5 points for “to a very high degree”, 4 points for “to a high degree”, 3 points for “to an adequate degree”, 2 points for “to a small degree”, and 1 point for “to a very small degree”. Therefore, for each indicator, regardless of assigned dimension, the maximum possible score is 2000. It results from the number of respondents (400). The maximum scale score for the answer is “to a very high degree” (5 points). Consequently, the minimum score for each indicator is 400. In order to compare the scores obtained at the level of each indicator and dimensions, the methodological indices from Table 9 were used.
Then, I divided the range between the minimum score and the maximum score of each dimension in equal distances, having 5 scale scores on a continuum from minimum to maximum. The minimum was labelled as “very low” and maximum as “very high”. Thus, 4 equal intervals were obtained for each dimension, as follows: “very low to low”, “low to moderate”, “moderate to high”, “high to very high”. After that, the average for each dimension was calculated, starting from the indicators scores. Table 10 shows the values obtained and the classification for the four dimensions included in the study, as well as the indicators that had the highest/lowest scores compared to dimensional average score (DAI):

4. Discussion

Hypothesis 1 was confirmed and it indicates an inverse relationship between job constraints and stress (CONSS) and the work engagement of the Romanian teachers (WENG). Considering the fact that the education activity consisted only in remote teaching, the number of professional demands among those working in the educational field has increased. Among these, we can mention: the stress induced by new technologies, new tools involved in online teaching, additional time given to transposing and adapting teaching materials for this new type of delivery, a pronounced dynamic of changes. All these changes in a context of uncertainty made teachers feel the stressors more acutely. The intensity of the stressors felt by the teachers, since the beginning of the COVID-19 pandemic, was moderate to high. All of these factors have an inversely proportional effect on the degree of work engagement. The stress generated by adapting to new technologies has the strongest demotivating effect of all the indicators.
Nevertheless, there are also indirect, contextual causes that may be associated with stressors at the professional level. For instance, in the case of teachers working from home, due to the current circumstances of the COVID-19 pandemic, they had to carry out, besides their professional activity, other responsibilities as well. Thus, they had to take over many family responsibilities, such as: quasi-full parenting or full parenting; especially when the other parent did not have a remote job.
Regarding Hypothesis no. 2, which was also confirmed, I can say that the changes that took place and the stress caused by technology led to the occurrence of negative emotions. Among them, the most common one is the loss of hope, enhanced by the idea that there are small chances that the teaching-learning activities will take place directly in front of the pupils/students. However, the intensity of the negative affects was felt at a rather low level.
Stress factors have also influenced the level of resilience behaviors which the teachers adopted in this period. The inverse proportion that exists is of low intensity; its existence being proved by the confirmation of Hypothesis 3. It is very likely that a longitudinal analysis would have brought additional clarifications about the exact moment when the coping mechanisms were triggered. The factor that best counterbalanced the effect of stressors was the larger amount of time available for teachers to enjoy personal activities, in the personal home environment together with their families.
The increase of the resilience capacity can be enhanced by supportive work contexts. This can occur when there are means to facilitate professional resources, such as the support that teachers have benefited from during this period; fact confirmed by Hypothesis no. 4 which shows that the support received during this period directly influenced the increase in resilience. The greatest contributor in this respect was the help and understanding provided by the management of the department or school/university and to a lesser extent the support that teachers received from institutions at the local or national level. The trend I noticed is the following: the greater the distance between teachers and the initiator of the support actions (local-national), the lesser the contribution of the support received to build resilient behaviors.
From a statistic point of view the confirmation of Hypothesis no. 5 leads to another finding, namely: teachers who are more engaged at work are willing to seek and employ sources of support more quickly. This proves that there is a direct relationship between professional involvement and the support received. In other words, supportive mechanisms become a professional resource that is activated when the level of work engagement increases.
One of the findings of this article was that support (SUPP) mediates the relationship between stressors and resilience mechanisms. There have been other recent studies that have highlighted the existence of the mediating role of support between stress and life satisfaction [103]. The novelty of this article is that it brings updated information about the complex relationship between stress and resilience in the case of employees in education field. Teachers who have high levels of stress may maintain low levels of support, and have low resilient behaviors. Besides, the perceived professional support has a role in increasing teachers’ resilience to stressors.
In addition to the main stress factors during this time, some positive effects of the current educational context were also identified. Although schools have moved online and the physical distance between teachers and students has increased, the psychological distance has decreased, and teachers have felt that they are more connected to their pupils/students. The idea of being affected together by the same transitions and challenges acted as a social glue, in the sense that Godwin said in 2005, about the importance of the social relationships that help human individuals cope with uncertainty in their changing world [104]. Further research can be developed based on this variable in order to explain work engagement.
Beyond analyzing how the relationships between the above mentioned dimensions with their corresponding indicators are related in the research (stress, resilient behaviors, work engagement and professional support), two open-ended questions were introduced in the questionnaire applied to teachers. The purpose of the research was to reveal not only the main problems and concerns determined by the pandemic context to which teachers are trying to find solutions, but also immediate interventions that teachers consider vital to ensure the sustainability of the Romanian education system.
The study identified that one of the main problems of the moment for which teachers in Romania are trying to find solutions is keeping their health and that of their family members within the context of corona virus pandemic. This concern is caused by the risk of contamination and by uncertainty; 40% of the respondents invoked this aspect. Another concern for almost a quarter of teachers is connected to the issue of education: what will happen during the next school year, how will be the teaching activity, online teaching, assessments and the situation of their pupils and students. The third issue in the order of importance, in terms of the intensity felt, is caused by the lack of the ordinary socialization, typical before the pandemic, the recommencement of social life and social interactions (15%).
Regarding the necessary actions for a sustainable education in Romania in the immediate future, 20.7% of the teachers participating in the survey invoked the need for increased funding for the Romanian education. This means to modernize it, to grant access to a high-performance technology and to digitalization. Many of those who support this intervention believe that this would increase their motivation and work engagement. It is noteworthy that the percentage of Gross Domestic Product (GDP) assigned to education in Romania is among the lowest in the European Union (3.2% compared to a European average of 4.6%) [105]. Another priority intervention in the opinion of 17.6% of Romanian teachers, consists in equalizing opportunities in education through access to technology and internet. Remote education through online technology has deepened, as in the rest of the world, the inequalities the access to education of the children from disadvantaged families and poor areas. 40% of the Romanian children are at the limit of the risk of social exclusion, over a half of them living in rural areas, where the Internet has a penetration rate of only 47% [106]. This idea is in line with the United Nations SDG4 on ensuring inclusive and equitable quality education and promoting lifelong learning opportunities for all [107].
Another practical solution that contributes to the sustainability of education in Romania involves the imperative of improving teachers’ digital skills by participating to training courses (9.2%). They are necessary to more easily manage constraints caused by the context of school closure and transition to remote education. Adaptation to new technologies is one of the indicators that generates highest level of stress, and the lack of skills in this regard reduces the engagement in the professional activity in the long run, as we noticed in the analysis presented above. Recent research has also shown that acquiring and improving digital skills is a condition of the quality of education, as indicated by United Nations sustainable development Goal 4 [108].
Teachers have also identified other solutions that can ensure the sustainability of Romanian education, including: reforming the education system through a new paradigm aimed at reorganization and modernization (10.2%), revision of school curricula, teaching objectives and taught content to provide an education anchored in practice and adapted to the current context and needs of society (8.9%). Education should be the basis for the sustainable development of a society undergoing major change. There have been other recent studies that have highlighted the need for the education system to adapt quickly to changes and to promote itself the change in accordance with the societal context [109].
Approximately 8.7% of the teachers in Romania believe that the viability of education depends on the return to face to face teaching and on the reopening of the schools.
The data analysis also showed that higher education teachers had a higher adaptability response than primary or secondary school teachers, due to the greater freedom they had in using platforms or tools for online teaching. Work engagement and professional support were more evident in this type of education. There was also a higher success rate in urban schools, regardless of the type of education (primary, secondary or tertiary). Beyond the stress of adapting to new online teaching technologies, another problem felt acutely in terms of the educational process was related to the impossibility of optimal control in the evaluation of the pupils and students and of the feedback received from them.
The article provides a complex perspective of the relationships that take place between factors of occupational stress, professional support, resilience and work engagement of the teachers in Romania. Reducing high-stress demands that can have negative affects can increase the work engagement. By activating and increasing some professional resources, such as: supporting teachers to improve their skills in the use of new technologies involved in online education and development, the resilience mechanisms can be triggered more readily.
The results of the study can be used for various intervention mechanisms to increase the well-being of the teachers and their level of work engagement; essential conditions for the sustainability of the education system.
The purpose of the educational process in general, is to be able to take place in a context in which stress levels are not too high and in which there is an increased level of satisfaction of all the stakeholders. One of the main sustainability goals (goal number 4) of the 2030 Agenda for Sustainable Development by the United Nations focuses on the equal rights of all to receive a fair and quality education. In this regard, teachers play a crucial role, because a sustainable education involves “teachers engaged and empowered, motivated and supported within well-resourced, efficient and effectively governed systems” [110].
The sustainability and the quality of education can also be defined by the impact on the final school year results, translated by engagement, quality of life of future graduates and also by the well-being of teachers in their role as front-runner educational stakeholders. The teachers’ stress affects the success of those who learn from them, just as a better engagement in work activities of people involved in the education system offers greater chances for the teaching activities to lead to optimal results.
In the current context, teachers have had to change on the go the ways in which the contents of the teaching reach their pupils and students. In the future, it is likely that there will be a need to also change the actual content, what is transmitted through the educational process, so that we can talk about the sustainability of education systems as the teachers’ ability to adapt their content to the challenges and changes of the present context.
The study has a limit, given by the fact that the research is a cross-sectional one, meaning that it is difficult to establish a causal determinism between the presented variables. The study can be completed by a longitudinal analysis to capture the cause-effect relationship.
The article offers a perspective on the relationship between analyzed variables in the Romanian education for the period of few months that has passed since the COVID-19 pandemic was declared. Due to the existing uncertainty and the possibility that this context is prolonged, further research is needed to add clarifications in the long run concerning the impact on the sustainability of education.

Funding

This research received no external funding.

Acknowledgments

The author appreciates the collaboration from teachers all over Romania that responded to the survey, providing valuable information for this paper. The author would also like to thank the anonymous experts and reviewers for their valuable suggestions.

Conflicts of Interest

The author declares no conflict of interest.

Appendix A

Table A1. Initial measuring scales and indicators.
Table A1. Initial measuring scales and indicators.
Dimensions/IndicatorsMeasuring Scale
Perschange/6 items
spending time for familiarization with the online tools
spending time for adaptation of taught content for online education
struggling with uncertainty in professional activity
making effort for students to actively participate to online meetings
making effort to evaluate students
feeling compelled to compromise on education
(1—Significantly decreased, 5—Significantly increased)
Rating by answer from 1 to 5
for each item ascending
Job constrains and stress/10 items
feeling that everything about work was changing too quick
feeling detached from work
feeling frustrated with online teaching
being demotivated about job
feeling mentally tired
feeling exhausted in activity
having insomnia
feeling like crying
feeling tensioned about online teaching
feeling to have too much to do and too little time
(1—Never, 5—Nearly always)
Rating by answer from 1 to 5
for each item ascending
Negative affects/6 items
feeling alone
being stressed
feeling nervous
feeling depressed
feeling hopeless
losing the meaning of life
(1—Never, 5—Nearly always)
Rating by answer from 1 to 5
for each item ascending
Positive affects/4 items
feeling gratitude for having my family around
having hope that things will change for better
feeling the pleasure of having extra time for me
feeling the joy of nature and beautiful weather
(1—Never, 5—Nearly always)
Rating by answer from 1 to 5
for each item ascending
Resilience and coping behaviors/7 items
focusing on good interacting with family
making personal future plans
enjoying sleep and rest
enjoying time for personal activities
involving in old activities and hobbies
making outdoor walks
doing sport and physical activities
(1—Never, 5—Nearly always)
Rating by answer from 1 to 5
for each item ascending
Work Engagement/10 items
creating a positive atmosphere among the participants in the online activities.
feeling enthusiastic about work
being creative in teaching online
being fulfilled with job
feeling that helped students to learn
being energetic in professional tasks
feeling engaged in the educational process
feeling connected with students
feeling passionate about work
feeling like a role model for students
(1—Never, 5—Nearly always)
Rating by answer from 1 to 5
for each item ascending
Professional Support/5 items
receiving support from my family
receiving support from students and their families
receiving support from school management
receiving support from local NGOs and professional associations
receiving support help from county level and national institutions
(1—To a very small extent, 5—To a very large extent)
Rating by answer from 1 to 5
for each item ascending

References

  1. World Health Organization. Available online: https://www.who.int/occupational_health/topics/stressatwp/en/ (accessed on 15 June 2020).
  2. Rao, J.V.; Chandraiah, K. Occupational stress, mental health and coping among information technology professionals. Indian J. Occup. Environ. Med. India 2012, 16, 22–26. [Google Scholar] [CrossRef] [Green Version]
  3. Wisse, B.; Sleebos, E. When Change Causes Stress: Effects of Self-construal and Change Consequences. J. Bus. Psychol. 2015, 31, 249–264. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. De Carlo, A.; Girardi, D.; Falco, A.; Dal Corso, L.; di Sipio, A. When Does Work Interfere With Teachers’ Private Life? An Application of the Job Demands-Resources Model. Front. Psychol. 2019, 10, 1–13. [Google Scholar] [CrossRef]
  5. Nicolas, M.; Vachera, P.; Martinent, G.; Mourot, L. Monitoring stress and recovery states: Structural and external stages of the short version of the RESTQ sport in elite swimmers before championships. J. Sport Health Sci. 2019, 8, 77–88. [Google Scholar] [CrossRef] [PubMed]
  6. Stoeber, J.; Rennert, D. Perfectionism in school teachers: Relations with stress appraisals, coping styles, and burnout. Anxiety Stress Coping 2008, 21, 37–53. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  7. Cheryl, J.T.; Cary, L.C. Mental health, job satisfaction and occupational stress among UK teachers. Work Stress 1993, 7, 203–219. [Google Scholar] [CrossRef]
  8. Shen, B.; McCaughtry, N.; Martin, J.; Garn, A.; Kulik, N.; Fahlman, M. The relationship between teacher burnout and student motivation. Br. J. Educ. Psychol. 2015, 85, 519–532. [Google Scholar] [CrossRef] [PubMed]
  9. Pandey, N.K.; Saxena, A. Teacher’s Occupational Stress: A Review Study in National & International Scenario. International J. Organ. Behav. Manag. Perspect. 2015, 4, 1533–1538. [Google Scholar]
  10. Zurlo, M.C.; Pes, D.; Cooper, C.L. Stress in teaching: A study of occupational stress and its determinants among Italian school teachers. Stress Health 2007, 23, 231–241. [Google Scholar] [CrossRef]
  11. Ravalier, J.M.; Walsh, J. Working conditions and stress in the English education system. Occup. Med. 2018, 68, 129–134. [Google Scholar] [CrossRef] [Green Version]
  12. Cooper, C.; Travers, C. Teachers under Pressure: Stress in the Teaching Profession; Routledge: Abingdon, UK, 1995; p. 159. ISBN 0-415-09484-4. [Google Scholar]
  13. Kyriacou, C. Teacher Stress: From Prevalence to Resilience. Handbook of Stress in the Occupations; Edward Edgar Publishing Limited: Cheltenham, UK, 2011; pp. 161–173. ISBN 978-0-85793-114-6. [Google Scholar]
  14. Maslach, C.; Jackson, S.E. The measurement of experienced burnout. J. Organ. Behav. 1981, 2, 99–113. [Google Scholar] [CrossRef]
  15. Moreno Fortes, A.; Tian, L.; Huebner, E.S. Occupational Stress and Employees Complete Mental Health: A Cross-Cultural Empirical Study. Int. J. Environ. Res. Public Health 2020, 17, 3629. [Google Scholar] [CrossRef] [PubMed]
  16. Klassen, R.; Chiu, M.M. Effects on Teachers’ Self-Efficacy and Job Satisfaction: Teacher Gender, Years of Experience, and Job Stress. J. Educ. Psychol. 2010, 102, 741–756. [Google Scholar] [CrossRef]
  17. Maslach, C.; Jackson, S.; Leiter, M. The Maslach Burnout Inventory Manual. In Evaluating Stress: A Book of Resources; Zalaquett, C.P., Wood, R.J., Eds.; The Scarecrow Press: Lanham, MD, USA, 1997; ISBN 13: 978-0810832312. [Google Scholar]
  18. Maslach, C.; Jackson, S.; Schwab, R. Maslach Burnout Inventory–Educators Survey (ES); 1997; Available online: https://www.researchgate.net/publication/277816643 (accessed on 7 June 2020).
  19. Tage, S.K.; Borritz, M.; Villadsen, E.; Karl, B.C. The Copenhagen Burnout Inventory: A new tool for the assessment of burnout. Work Stress 2005, 19, 192–207. [Google Scholar] [CrossRef]
  20. Levenstein, S.; Prantera, C.; Varvo, V.; Scribano, M.L.; Berto, E.; Luzi, C.; Andreoli, A. Development of the Perceived Stress Questionnaire: A new tool for Psychosomatic Research. J. Psychosom. Res. 1993, 37, 19–32. [Google Scholar] [CrossRef]
  21. Biggs, A.; Brough, P.; Drummond, S. Lazarus and Folkman’s Psychological Stress and Coping Theory. In Handbook of Stress and Health; Cooper, C.L., Quick, J.C., Eds.; Wiley: Hoboken, NJ, USA, 2017; pp. 349–364. ISBN 978-1-118-99377-4. [Google Scholar]
  22. Kuiper, N.A.; Olinger, L.J.; Martin, R.A. Dysfunctional attitudes, stress, and negative emotions. Cogn. Ther. Res. 1988, 12, 533–547. [Google Scholar] [CrossRef]
  23. Hutri, M.; Lindeman, M. The Role of Stress and Negative Emotions in an Occupational Crisis. J. Career Dev. 2002, 29, 19–36. [Google Scholar] [CrossRef]
  24. Du, J.; Huang, J.; An, Y.; Xu, W. The relationship between stress and negative emotion: The Mediating role of rumination. Clin. Res. Trials 2018, 4, 1–5. [Google Scholar] [CrossRef]
  25. Hu, J.; Gruber, K.J. Positive and negative affect and health functioning indicators among older adults with chronic illnesses. Issues Ment. Health Nurs. 2008, 29, 895–911. [Google Scholar] [CrossRef]
  26. Warr, P. The measurement of well-being and other aspects of mental health. J. Occup. Organ. Psychol. 1990, 63, 193–210. [Google Scholar] [CrossRef]
  27. Pressman, S.D.; Cohen, S. Does positive affect influence health? Psychol. Bull. 2005, 131, 925–971. [Google Scholar] [CrossRef] [PubMed]
  28. Kannan, J.; Miller, J.L. The Positive Role of Negative Emotions: Fear, Anxiety, Conflict and Resistance as Productive Experiences in Academic Study and in the Emergence of Learner Autonomy. Int. J. Teach. Learn. High. Educ. 2009, 20, 144–154. [Google Scholar]
  29. Rowe, A.D.; Fitness, J. Understanding the Role of Negative Emotions in Adult Learning and Achievement: A Social Functional Perspective. Behav. Sci. 2018, 8, 27. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  30. Folkman, S.; Moskowitz, J.T. Stress, Positive Emotion, and Coping. Curr. Dir. Psychol. Sci. 2000, 9, 115–118. [Google Scholar] [CrossRef]
  31. Folkman, S. The case for positive emotions in the stress process. Anxiety Stress Coping 2008, 21, 3–14. [Google Scholar] [CrossRef] [PubMed]
  32. Pekrun, R.; Perry, R.P. Control-value theory of achievement emotions. In International Handbook of Emotions in Education; Alexander, P.A., Pekrun, R., Linnenbrink-Garcia, L., Eds.; Routledge: London, UK, 2014; pp. 120–141. ISBN 978-0415895026. [Google Scholar]
  33. Watson, D.; Clark, L.A.; Tellegen, A. Development and validation of brief measures of positive and negative affect: The panas scales. J. Pers. Soc. Psychol. 1988, 54, 1063–1070. [Google Scholar] [CrossRef]
  34. Mroczek, D.K.; Kolarz, C.M. The effect of age on positive and negative affect: A developmental perspective on happiness. J. Personal. Soc. Psychol. 1998, 75, 1333–1349. [Google Scholar] [CrossRef]
  35. Levine, E.L.; Xu, X.; Yang, L.Q.; Ispas, D.; Pitariu, H.D.; Bian, R.; Musat, S. Cross-national explorations of the impact of affect at work using the State-Trait Emotion Measure: A coordinated series of studies in the United States, China, and Romania. Hum. Perform. 2011, 24, 405–442. [Google Scholar] [CrossRef]
  36. Luthar, S.S.; Cicchetti, D.; Becker, B. The construct of resilience. A critical evaluation and guidelines for future work. Child Dev. 2000, 71, 543–562. [Google Scholar] [CrossRef]
  37. Masten, A.S.; Best, K.M.; Garmezy, N. Resilience and Development: Contributions from the Study of Children Who Overcome Adversity. Dev. Psychopathol. 1990, 2, 425–444. [Google Scholar] [CrossRef]
  38. Avey, J.B.; Reichard, R.J.; Luthans, F.; Mhatre, K.H. Meta-analysis of the impact of positive psychological capital on employee attitudes, behaviors, and performance. Hum. Resour. Dev. Q. 2011, 22, 127–152. [Google Scholar] [CrossRef]
  39. Kašpárková, L.; Vaculík, M.; Procházka, J.; Schaufeli, W.B. Why resilient workers perform better: The roles of job satisfaction and work engagement. J. Workplace Behav. Health 2018, 33, 43–62. [Google Scholar] [CrossRef]
  40. Wang, Z.; Li, C.; Li, X. Resilience, Leadership and Work Engagement: The Mediating Role of Positive Affect. Soc. Indic. Res. 2017, 132, 699–708. [Google Scholar] [CrossRef]
  41. Bitsika, V.; Sharpley, C.F.; Bell, R. The Buffering Effect of Resilience upon Stress, Anxiety and Depression in Parents of a Child with an Autism Spectrum Disorder. J. Dev. Phys. Disabil. 2013, 25, 533–543. [Google Scholar] [CrossRef]
  42. Lee, J.S.; Ahn, Y.S.; Jeong, K.S.; Chae, J.H.; Choi, K.S. Resilience buffers the impact of traumatic events on the development of PTSD symptoms in firefighters. J. Affect. Disord. 2014, 162, 128–133. [Google Scholar] [CrossRef]
  43. Kaur, M.; Kaur, A. Resilience And Growth Initiative: Buffer Against Acculturation Stress. Int. J. Recent Sci. Res 2017, 8, 21126–21133. [Google Scholar] [CrossRef]
  44. Borman, G.D.; Overman, L.T. Academic resilience in mathematics among poor and minority students. Elem. Sch. J. 2004, 104, 177–195. [Google Scholar] [CrossRef] [Green Version]
  45. Allan, J.F.; McKenna, J.; Dominey, S. Degrees of resilience: Profiling psychological resilience and prospective academic achievement in university inductees. Br. J. Guid. Couns. 2014, 42, 9–25. [Google Scholar] [CrossRef]
  46. Amponsah, K.D.; Adasi, G.S.; Mohammed, S.M.; Ampadu, E.; Okrah, A.K. Stressors and coping strategies: The case of teacher education students at University of Ghana. Cogent. Educ. 2020, 7. [Google Scholar] [CrossRef]
  47. Martínez, J.P.; Méndez, I.; Ruiz-Esteban, C.; Fernández-Sogorb, A.; García-Fernández, J.M. Profiles of Burnout, Coping Strategies and Depressive Symptomatology. Front. Psychol 2020, 11, 591. [Google Scholar] [CrossRef]
  48. Pogere, E.; López-Sangil, M.; García-Señorán, M.; González, A. Teachers’ job stressors and coping strategies: Their structural relationships with emotional exhaustion and autonomy support. Teach. Teach. Educ. 2019, 85, 269–280. [Google Scholar] [CrossRef]
  49. Zeidner, M.; Endler, N.S. (Eds.) Handbook of Coping: Theory, Research, Applications, 1st ed.; John Wiley & Sons: Hoboken, NJ, USA, 1995. [Google Scholar]
  50. Carver, C.S. You want to measure coping but your protocol’ too long: Consider the brief cope. Int. J. Behav. Med. 1997, 4. [Google Scholar] [CrossRef] [PubMed]
  51. Chesney, M.A.; Neilands, T.B.; Chambers, D.B.; Taylor, J.M.; Folkman, S. A validity and reliability study of the coping self-efficacy scale. Br. J. Health Psychol. 2006, 11, 421–437. [Google Scholar] [CrossRef] [PubMed]
  52. Sinclair, V.G.; Wallston, K.A. The Development and Psychometric Evaluation of the Brief Resilient Coping Scale. Assessment 2004, 11, 94–101. [Google Scholar] [CrossRef] [PubMed]
  53. Hakanen, J.; Demerouti, E.; Xanthopoulou, D. Job Resources Boost Work Engagement, Particularly When Job Demands Are High. J. Educ. Psychol. 2007, 99, 274–284. [Google Scholar] [CrossRef] [Green Version]
  54. Schaufeli, W. Job demands, job resources, and their relationship with burnout and engagement: A multi-sample study. J. Organ. Behav. 2004, 25, 293–315. [Google Scholar] [CrossRef] [Green Version]
  55. Griffith, J.; Steptoe, A.; Cropley, M. An investigation of coping strategies associated with job stress in teachers. Br. J. Educ. Psychol. 2000, 69, 517–531. [Google Scholar] [CrossRef]
  56. Scherer, M. The Challenges of Supporting New Teachers: A Conversation with Linda Darling-Hammond. Educ. Leadersh. 2012, 69, 18–23. [Google Scholar]
  57. Levine, T.H. Tools for the Study and Design of Collaborative Teacher Learning: The Affordances of Different Conceptions of Teacher Community and Activity Theory. Teach. Educ. Q. 2010, 37, 109–130. [Google Scholar]
  58. Gruenert, S.; Whitaker, T. School Culture Rewired: How to Define, Assess, and Transform it; ASCD: Alexandria, VA, USA, 2015; ISBN 978-1-4166-1990-1. [Google Scholar]
  59. Schaufeli, W.B.; Bakker, A.B. Defining and measuring work engagement: Bringing clarity to the concept. In Work Engagement: A Handbook of Essential Theory and Research; Bakker, A.B., Leiter, M.P., Eds.; Psychology Press: Sussex, UK, 2010; pp. 10–24. ISBN 978-1-84169-736-9. [Google Scholar]
  60. Schaufeli, W.B.; Salanova, M.; González-Romá, V.; Arnold, B. The Measurement of Engagement and Burnout: A Two Sample Confirmatory Factor Analytic Approach. J. Happiness Stud. 2002, 3, 71–92. [Google Scholar] [CrossRef]
  61. Schaufeli, W.B.; Bakker, A.B.; Salanova, M. The Measurement of Work Engagement With a Short Questionnaire: A Cross-National Study. Educ. Psychol. Meas. 2006, 66, 701–716. [Google Scholar] [CrossRef]
  62. Kuok, A.C.H.; Taormina, R.J. Work Engagement: Evolution of the Concept and a New Inventory. Psychol. Thought 2017, 10, 262–287. [Google Scholar] [CrossRef]
  63. Samson, R.V.; Patil, U. Work Engagement and Teacher Autonomy among Secondary School Teachers; Anchor Academic Publishing: Hamburg, Germany, 2016; p. 7. ISBN 978-3-96067-563-1. [Google Scholar]
  64. Stanley, R.O.; Burrows, G.D. The role of stress in mental illness: The practice. In Handbook of Stress Medicine and Health; Cooper, C.L., Ed.; CRC Press: London, UK, 2005; pp. 63–75. ISBN 9780849318207. [Google Scholar]
  65. Langelaan, S.; Bakker, A.B.; van Doornen, L.J.P.; Schaufeli, W.B. Burnout and work engagement: Do individual differences make a difference? Personal. Individ. Differ. 2006, 40, 521–532. [Google Scholar] [CrossRef]
  66. Kahn, W.A. To Be Fully There: Psychological Presence at Work. Hum. Relat. 1992, 45, 321–349. [Google Scholar] [CrossRef]
  67. Altunel, M.C.; Omer, E.K.; Cankir, B. The Effect of Job Resources on Work Engagement: A Study on Academicians in Turkey. Educ. Sci. Theory Pract. 2015, 15, 409–417. [Google Scholar] [CrossRef] [Green Version]
  68. Meyer, J.P.; Stanley, D.J.; Herscovitch, L.; Topolnytsky, L. Affective, Countinuance, and Normative Commitment to the Organization: A Meta-Analysis of Antecedents, Correlates, and Consequences. J. Vocat. Behav. 2002, 61, 20–52. [Google Scholar] [CrossRef]
  69. Bartram, T.; Joiner, T.A.; Stanton, P. Factors affecting the job stress and job satisfaction of Australian nurses: Implications for recruitment and retention. Contemp. Nurse 2004, 17, 293–304. [Google Scholar] [CrossRef]
  70. Agirreazkuenaga, L. Education for Agenda 2030: What Direction do We Want to Take Going Forward? Sustainability 2020, 12, 2035. [Google Scholar] [CrossRef] [Green Version]
  71. Holfelder, A. Towards a sustainable future with education? Sustain. Sci. 2019, 14, 943–952. [Google Scholar] [CrossRef] [Green Version]
  72. Siraj-Blatchford, J.; Mogharreban, C.; Park, E. International Research on Education for Sustainable Development in Early Childhood; Springer: Berlin/Heidelberg, Germany, 2016; pp. 28–31. ISBN 978-3-319-42208-4. [Google Scholar]
  73. Van den Branden, K. Sustainable Education: Exploiting Students’ Energy for Learning as a Renewable Resource. Sustainability 2015, 7, 5471–5487. [Google Scholar] [CrossRef] [Green Version]
  74. Chisingui, A.V.; Costa, N. Teacher Education and Sustainable Development Goals: A Case Study with Future Biology Teachers in an Angolan Higher Education Institution. Sustainability 2020, 12, 3344. [Google Scholar] [CrossRef] [Green Version]
  75. Azer, S.A. The qualities of a good teacher: How can they be acquired and sustained? J. R. Soc. Med. 2005, 98, 67–69. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  76. Asif, T.; Guangming, O.; Haider, M.A.; Colomer, J.; Kayani, S.; Amin, N. Moral Education for Sustainable Development: Comparison of University Teachers’ Perceptions in China and Pakistan. Sustainability 2020, 12, 3014. [Google Scholar] [CrossRef] [Green Version]
  77. Hyseni Duraku, Z.; Hoxha, L. Self-esteem, study skills, self-concept, social support, psychological distress, and coping mechanism effects on test anxiety and academic performance. Health Psychol. Open 2018, 1–9. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  78. Harmsen, R.; Helms-Lorenz, M.; Maulana, R.; van Veen, K. The relationship between beginning teachers’ stress causes, stress responses, teaching behaviour and attrition. Teach. Teach. 2018, 24, 626–643. [Google Scholar] [CrossRef] [Green Version]
  79. Chan, E.S.S.; Ho, S.K.; Ip, F.F.L.; Wong, M.W.Y. Self-Efficacy, Work Engagement, and Job Satisfaction Among Teaching Assistants in Hong Kong’s Inclusive Education. SAGE Open 2020, 10. [Google Scholar] [CrossRef]
  80. Sistemul Educațional în România. Available online: https://insse.ro/cms/sites/default/files/field/publicatii/sistemul_educational_in_romania_2017_2018.pdf (accessed on 25 May 2020).
  81. Kaiser, H.F. An index of factorial simplicity. Psychometrika 1974, 39, 31–36. [Google Scholar] [CrossRef]
  82. Akgül, Y. Structural Equation Modeling Approaches to E-Service Adoption; IGI Global: Hershey, PA, USA, 2019; pp. 1–359. ISBN 13: 978-1522580157. [Google Scholar]
  83. Hair, J.F.; Black, W.; Babin, B.; Anderson, R. Multivariate Data Analysis: A Global Perspective, 7th ed.; Pearson: London, UK, 2010; ISBN 978-3-030-06030-5. Available online: https://www.researchgate.net/publication/237009923_Multivariate_Data_Analysis_A_Global_Perspective (accessed on 25 May 2020).
  84. Child, D. The Essentials of Factor Analysis, 3rd ed.; Continuum: New York, NY, USA, 2006; ISBN 13: 978-0826480002. [Google Scholar]
  85. Cattell, R.B. The Scree Plot Test for the Number of Factors. Multivar. Behav. Res. 1966, 1, 140–161. [Google Scholar] [CrossRef]
  86. Field, A. Discovering Statistics Using SPSS, 3rd ed.; SAGE Publication: London, UK, 2009; ISBN 13: 978-1847879073. [Google Scholar]
  87. Braeken, J.; van Assen, M.A.L.M. An empirical Kaiser criterion. Psychol. Methods 2017, 22, 450–466. [Google Scholar] [CrossRef] [Green Version]
  88. Costello, A.B.; Osborne, J. Best Practices in Exploratory Factor Analysis: Four Recommendations for Getting the Most From Your Analysis. Practical Assessment. Res. Eval. 2005, 10, 1–9. [Google Scholar]
  89. Gaskin, J.; Lim, J. Pattern Matrix Model Buider, AMOS 23Plugin; Gaskination StatWiki: Provo, UT, USA, 2016. [Google Scholar]
  90. Atkinson, T.M. Using Confirmatory Factor Analysis to Evaluate Construct Validity of the Brief Pain Inventory (BPI). J. Pain Symptom. Manage. 2011, 41, 558–565. [Google Scholar] [CrossRef] [PubMed]
  91. Brown, T.A. Confirmatory Factor Analysis for Applied Research; The Guilford Press: New York, NY, USA, 2006; p. 72. ISBN 978-1-59385-274-0. [Google Scholar]
  92. Hair, J.F., Jr.; Anderson, R.E.; Tatham, R.L.; Black, W.C. Multivariate Data Analysis with Readings, 4th ed.; Englewood Cliffs: Prentice-Hall, NJ, USA, 1998; ISBN 978-0-138-94858-0. [Google Scholar]
  93. Hair, J.F.; Black, W.C.; Babin, B.J.; Anderson, R.E.; Tatham, R.L. Multivariate Data Analysis, 6th ed.; Pearson: Upper Saddle River, NJ, USA, 2005; ISBN 13: 978-0130329295. [Google Scholar]
  94. DeVellis, R.F. Scale Development: Theory and Applications, 3rd ed.; Sage Publications: London, UK, 2012; pp. 95–96. ISBN 13: 9781412980449. [Google Scholar]
  95. Saunders, M.; Lewis, P.; Thornhill, A. Research Methods for Business Students, 3rd ed.; Prentice Hall: Upper Saddle River, NJ, USA, 2003; ISBN 9780273658047. [Google Scholar]
  96. Trochim, W.M.; Donnelly, J.P.; Arora, K. Research Methods the Essential Knowledge Base, 2nd ed.; Cengage Learning: Boston, MA, USA, 2015; p. 78. ISBN 9781133954774. [Google Scholar]
  97. Hair, J.F., Jr.; Hult, G.T.M.; Ringle, C.; Sarstedt, M. A Primer on Partial Least Squares Structural Equation Modeling (PLS-SEM); Sage Publications: London, UK, 2013; ISBN 978-4522-1744-4. [Google Scholar]
  98. Hair, J.; Black, W.; Babin, B.; Anderson, R. Multivariate Data Analysis; Prentice Hall: London, UK, 2009; ISBN 978-0138132637. [Google Scholar]
  99. Byrne, B.M. Structural Equation Modeling with AMOS: Basic Concepts, Applications, and Programming; Routledge: New York, NY, USA, 2010; ISBN 978-0-8058-6372-7. [Google Scholar]
  100. Curran, P.J.; West, S.; Finch, J.F. The Robustness of Test Statistics to Nonnormality and Specification Error in Confirmatory Factor Analysis. Psychol. Methods 1996, 1, 16–29. [Google Scholar] [CrossRef]
  101. Kline, R.B. Principle and Practice of Structural Equation Modeling, 3rd ed.; Guilford Press: New York, NY, USA, 2011; p. 54. ISBN 978-1-60623-877-6. [Google Scholar]
  102. Hu, L.; Bentler, P.M. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Struct. Equ. Modeling 1999, 6, 1–55. [Google Scholar] [CrossRef]
  103. Yang, C.; Xia, M.; Han, M.; Liang, Y. Social Support and Resilience as Mediators Between Stress and Life Satisfaction Among People With Substance Use Disorder in China. Front. Psychiatry 2018, 9, 436. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  104. Goodwin, R. Why I study relationships and culture. Psychologist 2005, 18, 615. [Google Scholar]
  105. EUROSTAT Government Expenditure on Education. Available online: https://ec.europa.eu/eurostat/statistics-explained/index.php/Government_expenditure_on_education (accessed on 11 August 2020).
  106. UNICEF Romania. Available online: https://www.unicef.org/romania/ro/pove%C8%99ti/pandemia-de-covid-19-aduce-la-suprafa%C8%9B%C4%83-o-alt%C4%83-urgen%C8%9B%C4%83-na%C8%9Bional%C4%83 (accessed on 11 August 2020).
  107. UNESCO Leading SDG4–Education 2030. Available online: https://en.unesco.org/themes/education2030-sdg4 (accessed on 11 August 2020).
  108. Tran, T.; Hoang, A.-D.; Nguyen, Y.-C.; Nguyen, L.-C.; Ta, N.-T.; Pham, Q.-H.; Pham, C.-X.; Le, Q.-A.; Dinh, V.-H.; Nguyen, T.-T. Toward Sustainable Learning during School Suspension: Socioeconomic, Occupational Aspirations, and Learning Behavior of Vietnamese Students during COVID-19. Sustainability 2020, 12, 4195. [Google Scholar] [CrossRef]
  109. Wolff, L.-A. Sustainability Education in Risks and Crises: Lessons from Covid-19. Sustainability 2020, 12, 5205. [Google Scholar] [CrossRef]
  110. UNESCO Education 2030-Incheon Declaration and Framework for Action for the Implementation of Sustainable Development Goal 4. Available online: https://unesdoc.unesco.org/ark:/48223/pf0000245656 (accessed on 11 June 2020).
Figure 1. Proposed Conceptual Model.
Figure 1. Proposed Conceptual Model.
Sustainability 12 06982 g001
Figure 2. The scree plot.
Figure 2. The scree plot.
Sustainability 12 06982 g002
Figure 3. Confirmatory factor analysis (measurement model).
Figure 3. Confirmatory factor analysis (measurement model).
Sustainability 12 06982 g003
Figure 4. Adjusted structural equation model (SEM) with path diagrams and standardized regression weights.
Figure 4. Adjusted structural equation model (SEM) with path diagrams and standardized regression weights.
Sustainability 12 06982 g004
Table 1. Research Data Sheet
Table 1. Research Data Sheet
Study Universe234.647 Romanian Teachers
Geographical ScopeRomania, 41 counties
Data Collection MethodStructured questionnaire distributed to professors via internet link/email
Sample UnitTeachers in all forms of education (primary school, gymnasium, high school, university
Sample400 teachers
Margin of Error (Confidence Interval)±4.9%
Confidence Level95%; z = 1.96; p = 0.5
Source: Author.
Table 2. Kaiser-Meyer-Olkin (KMO) and Bartlett’s Test.
Table 2. Kaiser-Meyer-Olkin (KMO) and Bartlett’s Test.
Kaiser–Meyer–Olkin Measure of Sampling Adequacy0.867
Bartlett’s Test of SphericityApprox. Chi-Square8796.611
Degrees of freedom (df)1128
Significance probability (Sig.)0.000
Table 3. Total variance explained by 5 factors.
Table 3. Total variance explained by 5 factors.
FactorTotal% of VarianceCumulative
15.53425.15525.155
23.20914.58639.741
32.31810.53650.277
41.8058.20658.483
51.7187.80866.291
Table 4. Factor loadings for selected indicators in explanatory factor analysis (N = 400).
Table 4. Factor loadings for selected indicators in explanatory factor analysis (N = 400).
Factor 1Factor 2Factor 3Factor 4Factor 5
IndicatorsWork EngagementResilienceJob Constrains and StressNegative EffectsProfessional Support
workeng 30.821−0.048−0.162−0.1160.013
workeng 40.7800.036−0.160−0.1000.006
workeng 20.7300.044−0.190−0.1120.082
workeng 90.7100.097−0.037−0.0040.040
workeng 80.6790.148−0.122−0.0060.132
workeng 50.6210.096−0.038−0.0150.102
resil 30.0750.797−0.0380.002−0.006
resil 70.0760.778−0.020−0.0360.136
resil 60.0400.775−0.112−0.0650.197
posaff 20.1100.749−0.088−0.1050.088
resil 10.0770.649−0.0530.031−0.014
resil 40.0060.552−0.107−0.0250.112
constress2−0.230−0.0100.8150.172−0.074
constress1−0.089−0.0470.7320.1170.062
perschange2−0.182−0.1080.5970.015−0.075
constress4−0.104−0.2850.5860.105−0.184
negaff5−0.086−0.0780.1850.853−0.100
negaff6−0.077−0.0460.0620.825−0.019
negaff4−0.086−0.0220.1050.755−0.038
support40.1340.074−0.020−0.1110.724
support50.1210.157−0.038−0.0010.708
support30.0230.119−0.109−0.0260.664
Variance explained25.15%14.58%10.53%8.20%7.80%
Eigen Value5.533.202.311.801.71
Cronbach’s alpha0.810.860.800.860.76
Note: workeng (work engagement), resil (resilience), posaff (positive affects), constress (job constrains and stress), negaff (negative affects), support (support).
Table 5. Selected items of model and their measuring system.
Table 5. Selected items of model and their measuring system.
Factors/ItemsMeasuring Scale
Work Engagement/6 items
feeling enthusiastic about work
being creative in teaching online
being fulfilled with job
feeling that I helped students to learn
being energetic in professional tasks
feeling engaged in the educational process
(1—Never, 5—Nearly always)
Rating by answer from 1 to 5
for each item ascending
Resilience and coping behaviors/6 items
focusing on the good interaction with family
making personal future plans
enjoying sleep and rest
enjoying time for personal activities
involving in old activities and hobbies
making outdoor walks
(1—Never, 5—Nearly always)
Rating by answer from 1 to 5
for each item ascending
Job constrains and stress/4 items
feeling that everything about work is changing too quickly
being tensioned about online teaching
feeling the stress of adapting to new technologies
feeling exhausted related to teaching online
(1—Never, 5—Nearly always)
Rating by answer from 1 to 5
for each item ascending
Negative affects/3 items
feeling hopeless
feeling depressed
losing the meaning of life
(1—Never, 5—Nearly always)
Rating by answer from 1 to 5
for each item ascending
Professional Support/3 items
receiving support from school management
receiving support from local NGOs and professional associations
receiving support help from county level and national institutions
(1—to a very small extent, 5—to a very large extent)
Rating by answer from 1 to 5
for each item ascending
Table 6. Model reliability and validity Measures.
Table 6. Model reliability and validity Measures.
FactorsCRAVEMSVASV
10.8780.5480.1740.042
20.8730.5370.0930.035
30.8070.5160.1740.069
40.8660.6840.1220.047
50.7610.5160.0930.036
Note: CR = Composite Reliability, AVE = Average Variance Extracted, MSV = Maximum Shared Variance, ASV = Average Shared Variance.
Table 7. Possible improvement of model fit indices.
Table 7. Possible improvement of model fit indices.
Statisticsχ2dfpχ2/dfGFICFIRMSEAPCLOSESRMRTLI
Recommended values <3>0.9>0.9<0.08>0.05<0.08>0.9
T0446.961990.0002.240.900.940.050.080.050.93
T1390.681970.0001.980.910.950.050.530.050.95
Note: T0—at the beginning, T1—after drawing covariances, χ2 (chi square), df (degrees of feeedom), p (probability level), GFI (goodness of fit index), CFI (comparative fit index), RMSEA (root mean square error of approximation), PCLOSE (closeness of fit), SRMR (standardized root mean square residual), TLI(Tucker-Lewis index).
Table 8. Results of hypotheses testing for direct and mediating associations.
Table 8. Results of hypotheses testing for direct and mediating associations.
Hypothesized RelationshipsβS.E.C.R.pDecision
H1: Job constrains and stress →
Work engagement
−0.420.05−7.456***Accepted
H2: Job constrains and stress →
Negative affects
0.360.066.295***Accepted
H3: Job constrains and stress →
Resilience
−0.170.07−2.916< 0.05Accepted
H4: Received Support →
Resilience
0.270.074.164***Accepted
H5: Work engagement →
Received Support
0.160.072.378<0.05Accepted
H6: Negative affects →
Work engagement
−0.070.04−1.657>0.05Rejected
H7: Stress → Resilience →
Work engagement
CONSS to RESIL direct effect significant
RESIL to WENG direct effect not significant
Indirect effect from CONSS to WENG via RESIL not significant
Rejected
Note: CONSS (job constrains and stress), WENG (work engagement), RESIL (resilience), NEGAFF (negative affects), β—Standardized regression weight, S.E.—Standard error, C.R.—Critical ratio, p—Probability value, where *** means p < 0.001.
Table 9. Methodology score indices for each of 5 dimensions.
Table 9. Methodology score indices for each of 5 dimensions.
IndicesCalculation Method or Formula
Maximum score of indicators (MaxSI) = 2000The theoretical number if each respondent were to score 5 points for each indicator
Minimum score of indicators (MinSI) = 400The theoretical number if each respondent were to score 1 point for each indicator
Maximum dimension score (MaxSD)MSD = MaxSI number of measured indicators
Minimum dimension score (MinSD)MinSD = MinSI number of measured indicators
Dimensional score (DS)The empirical (cumulative) score, resulting from adding IS for each dimension
Indicator score (IS)The empirical (cumulative) score, resulting from adding the answers for all respondents, for each indicator
Dimensional average score (DAI)The average of indicator’s score for each dimension
Table 10. Contribution of dimensions and indicators to diagnosis.
Table 10. Contribution of dimensions and indicators to diagnosis.
Dimension Containing Indicators NumberFraming in Scale IntervalsDAI for Each DimensionThe Indicator Contributing the Most to DAIThe Indicator Contributing the Least to DAI
CONSS (4)from moderate to high1340.25feeling the stress of adapting to new technologiesbeing tensioned about online teaching
RESIL (6)from low to moderate1104.16enjoying time for personal activitiesmaking outdoor walks
SUPP (3)from low to moderate1118receiving support from school managementreceiving support help from county level and national institutions
NEGAFF (3)from very low to low732.66feeling hopelesslosing the meaning of life
WENG (6)from moderate to high1300.5feeling enthusiastic about worklosing the meaning of life

Share and Cite

MDPI and ACS Style

Obrad, C. Constraints and Consequences of Online Teaching. Sustainability 2020, 12, 6982. https://doi.org/10.3390/su12176982

AMA Style

Obrad C. Constraints and Consequences of Online Teaching. Sustainability. 2020; 12(17):6982. https://doi.org/10.3390/su12176982

Chicago/Turabian Style

Obrad, Ciprian. 2020. "Constraints and Consequences of Online Teaching" Sustainability 12, no. 17: 6982. https://doi.org/10.3390/su12176982

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop