Next Article in Journal
The Urbanisation Impacts on the Policy Effects of the Carbon Tax in China
Previous Article in Journal
Reliable Requirements Engineering Practices for COVID-19 Using Blockchain
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

COVID-19 and Beyond: Employee Perceptions of the Efficiency of Teleworking and Its Cybersecurity Implications

by
Andreja Mihailović
1,*,
Julija Cerović Smolović
2,
Ivan Radević
2,
Neli Rašović
3 and
Nikola Martinović
2
1
Faculty of Law, University of Montenegro, 81000 Podgorica, Montenegro
2
Faculty of Economics, University of Montenegro, 81000 Podgorica, Montenegro
3
MARRI Regional Centre, MTV Building, Blvd. Goce Delcev, 1000 Skopje, North Macedonia
*
Author to whom correspondence should be addressed.
Sustainability 2021, 13(12), 6750; https://doi.org/10.3390/su13126750
Submission received: 20 April 2021 / Revised: 7 June 2021 / Accepted: 10 June 2021 / Published: 15 June 2021

Abstract

:
The main idea of this research is to examine how teleworking has affected employee perceptions of organizational efficiency and cybersecurity before and during the COVID-19 pandemic. The research is based on an analytical and empirical approach. The starting point of the research is a critical and comprehensive analysis of the relevant literature regarding the efficiency of organizations due to teleworking, digital information security, and cyber risk management. The quantitative approach is based on designing a structural equation model (SEM) on a sample of 1101 respondents from the category of employees in Montenegro. Within the model, we examine simultaneously the impact of their perceptions on the risks of teleworking, changes in cyber-attacks during teleworking, organizations’ capacity to respond to cyber-attacks, key challenges in achieving an adequate response to cyber-attacks, as well as perceptions of key challenges related to cybersecurity. The empirical aspects of our study involve constructing latent variables that correspond to different elements of employee perception; namely, their perception of organizational efficiency and the extent to which the digital information security of their organizations has been threatened during teleworking during the pandemic.

1. Introduction

Teleworking, also referred to as remote work, mobile work, or telecommuting, is not a new concept, since it originated simultaneously with the energy crises of the 1970s [1]. The change in the social paradigm in the light of the expansion of telecommunications and informed extrapolation played a crucial role in the emergence of the concept of teleworking. Its further development took place under the special attention of analysts, who approached it primarily from a sociological aspect, and a decade later teleworking was characterized as the “next working environment revolution” [2]. However, despite the profound interest of researchers in its study, for a long time there has been no comprehensive and formal definition of this work concept. Initial attempts to define teleworking involved its reduction to a one-dimensional component—the place of work, organizational structure, characteristics of employees, or the use of information technology [3,4,5]. This is also evident from the Framework Agreement on Teleworking, adopted by ETUC, UNICE, UEAPME and CEEP with the aim of modernizing the prevailing models of work, which offers the first official definition: “Telework is a form of organising and/or performing work, using information technology, in the context of an employment contract/relationship, where work, which could also be performed at the employers premises, is carried out away from those premises on a regular basis” [6]. The difficulties in defining this concept are two-fold: first, the fact that the process of its implementation was quite timid and sporadic, which is why the literature states that it represents a “never-ending promise” [7], and second, the basic essence of teleworking, which is mirrored in its flexibility and adaptability in order to successfully respond to a wide range of different organizational requirements. Flexibility as a basic determinant of teleworking is also emphasized in the Telework Enhancement Act of 2010, which contains the most comprehensive definition: “The term ‘telework’ or ‘teleworking’ refers to a work flexibility arrangement under which an employee performs the duties and responsibilities of such employee’s position, and other authorized activities, from an approved worksite other than the location from which the employee would otherwise work” [8].
The COVID-19 pandemic has resulted in a transformation of the work environment marked by the accelerated digitization and decentralization of office activities as a result of increased teleworking. According to a January 2021 report by the International Labour Organization, about 93% of the world’s total workforce resides in countries with some form of restrictions or modifications to the conventional work regime [9]. The global response to the health crisis has required the introduction of alternative models of work engagement, which, in turn, initiated the need to provide new answers to old questions on the efficiency and cybersecurity of teleworking. The European Commission estimates that in the period before the pandemic, only 15% of employees in the EU had practiced teleworking at least once, while according to a Eurofound report, close to 40% of employees switched exclusively to teleworking during the pandemic [10,11]. In the United States, the number of teleworkers almost doubled, reaching 67% between mid-March and early April [12]. The unexpected and rapidly growing bloom of teleworking has resulted in a resurgence of interest from the scientific community [13,14], in light of the premise that the pandemic, for white-collar workers, marked a definite crossing of the Rubicon and an irreversible break with traditional work habits.
The fact that we have indeed entered a new business era has been confirmed by numerous studies of employee perceptions that speak in favour of their readiness to at least partially continue working remotely after the end of the pandemic [15,16]. In addition, from the addresses of the most important international actors come increasingly loud appeals for the wider introduction of teleworking and the need for its affirmation by policy makers [9,17,18,19]. In contrast, the aggressive promotion of teleworking is continuously raising concerns about the adequacy of its technological grounds, employee competencies, and the cybersecurity dimensions of virtual offices. The decentralization of office activities, which occurs as an inevitable consequence of teleworking, besides raising the essential question of its efficiency, highlights also the question of their mutual correlation with the cybersecurity of organizations. An increasing number of studies highlight the impact of the pandemic on shaping the global remote working culture in view of the disturbing escalation of security risks [19,20,21]. The tension of the drama is fostered by the fact that the leading geopolitical forces, more than a decade ago, defined cyberspace as the fifth operational domain of warfare, putting it at the very top of their security agendas [22]. On that account, the academic community brings cybersecurity into the context of the “21st century battlefield” [23], issuing alarming warnings that the cybercrisis caused by a rising dependence on information technology could easily escalate into a “new pandemic” [24].

2. Review of the Scientific Literature

Teleworking, taking into account the continuous changes in the business arena, is becoming a topic of interest in theory and in practice, due to the wide-ranging implications of this concept, from the organizational, legal, educational, economic, and sociological standpoints. In such circumstances, cybersecurity is gaining importance as a global business, and private interactions mostly take place in a digital environment. The state of play in the field of teleworking is predominantly based on studies evaluating efficiency and flexibility, potential cost savings, the feasibility of remote work tasks, ways of organizing working hours, the availability and adequacy of communication technologies for remote workers, and job satisfaction and work life balance (WHB). Despite theoretical efforts over the past decades, the literature has failed to provide a sufficiently substantiated justification for the under-representation of teleworking in the pre-pandemic period [25]. The revival of research enthusiasm for researching this concept is unequivocally the result of the COVID-19 outbreak, thus creating a striking line of demarcation in theoretical studies between the period before and after the pandemic.
In that sense, the most significant pre-pandemic theoretical achievements for the development of current research are reflected in the identification of the characteristics of the modern dominant model “telehomeworking” [26,27], and in indicating the potential of the “digital transformation of labour” [28] as a catalyst of an expansion in remote work. Despite obvious differences in the emphasis on different segments of remote work, research from both periods share the same starting point, expressed in the view that the efficiency of teleworking is the result of three key factors: the employee, the organization, and society [29].
While during the pandemic remote work became for many organizations the only way to maintain business continuity and consequently the ultimate measure of their efficiency, the scientific scene in the previous period differed significantly in opinions. Thus, a number of authors held the stance that teleworking has a positive impact on boosting the efficiency of organizations [30,31,32,33], while the standpoint of others was that there is no direct link, since the job performance of employees in the context of flexible working arrangements depends on a number of factors: employee commitment [34], organizational support [35], turnover intentions [36] and work-to-family conflict [37,38]. A certain amount of empirical evidence speaks in favour of the negative implications of telework on the efficiency of the organization, especially the risk of miscommunication that occurs as a result of narrowing employee interaction, delayed responsiveness, reduced creativity and responsibility, along with the risk of freewheeling [39]. On the other hand, it is precisely these circumstances that some authors perceive as an additional incentive for employees to prove their commitment to work tasks outside working hours [40]. Some studies look at the correlation between efficiency and teleworking through the prism of the nature of the job, emphasizing that employees “who held complex jobs, for those in jobs involving low levels of interdependence and for those in jobs with low levels of social support, the extent of telecommuting had a positive association with job performance” [41].
The pandemic-led renaissance of teleworking has led to a radical paradigm shift in employees in terms of their efficiency in a range of diverse activities. Forecasts after the abolition of physical distance measures highlight the increased readiness of employees to reorient from the conventional work environment by intensifying telehomeworking [42], reengineering office routines [43], and transitioning to the concept of “hybrid offices” as a kind of symbiosis of the office and working from home. In addition, employers have seen a decline in traditional skepticism about the effectiveness of flexible working arrangements due to their positive effects during the pandemic, the rationalisation of time, and reductions in operating costs [14,44]. The view of increased productivity due to remote work has long been advocated for in the literature [45] and is explained by a causal link with job satisfaction and work life balance that leads to better work performance [46,47,48].
However, despite the almost daily expansion of the list of benefits of teleworking, this concept should not be glorified. There are authors who warn of the illusory flexibility of teleworking [49], emphasizing the negative social implications of overlapping the home as a specific social space with the place of work [50], and the “extensification of work” due to the unification of the private and business spheres [51,52]. In addition, attention is drawn to the negative implications of home teleworking on the health of employees [53]. Recent studies also raise the issue of the impact of teleworking on career development in terms of limited opportunities for advancement [54].
A significant number of studies highlight a direct positive link between teleworking and the use of information technology in the context of increasing employee autonomy [55,56]. Yet the greatest danger, in the context of teleworking, is the issue of data protection mechanisms, due to the reluctance of many organizations to provide an adequate defence response to a sudden wave of cybercrime [55,57]. Although the issue of cybersecurity has only become a focus of research recently due to the new circumstances, the literature even before the pandemic highlighted the increased information vulnerability of organizations with regard to teleworking [58,59]. While digital transformation has previously been popularized as a determinant of organizational efficiency and competitive advantage [60], it was only by acquiring the role of the hero of the pandemic that it has gained paramount importance. The fourth industrial revolution is pushing companies to develop highly innovative business strategies in order to stay competitive in the marketplace [61,62]. The recontextualization of the work environment has also imposed new challenges on all organizations [63,64], almost reciprocal with the benefits it brings. This is evident in the domain of risk management when it is taken into account that “in the knowledge economy, knowledge risk represents a major factor in achieving organizational performance” [65,66]. Namely, the limited ability to monitor remote workers and the security disproportion between servers within organizations and the broadband networks through which employees connect from home cause additional risks of information leakage, especially in the service and public sectors [54]. In addition, the ubiquitous phenomenon of the digital gap between employees represents a threat to the digital information security of organizations [67,68], as they may fail to recognize the necessity of investing in human capital in order to overcome this problem [69,70,71]. For this reason, the importance of education in the field of cybersecurity and the need for its introduction into regular curricula, with the aim of acquiring the necessary competencies in accordance with the forthcoming changes in the labor market, are increasingly emphasized [72].
While recent research points out that “well-designed telework arrangements can support development policies” [73], cybersecurity has for some time been characterized as “an essential sustainable economic development factor” [74] and “a core need for providing a sustainable and safe society” [75]. However, despite the extensive literature to date in this area, it should be noted that it treats remote working as isolated from cybersecurity issues, while the cross-section of their interactions is still unexplored territory. The COVID-19 crisis has brought this phenomenon closer than ever, and has imposed on the academic and professional public the need to study their convergence as soon as possible, as this is a new and increasingly important determinant of the sustainability of organizations. Namely, pioneering efforts to investigate this convergence have led to the conclusion that despite the rapid adaptability of many organizations to the mass transition to teleworking, many of them have failed in the task of maintaining digital information security due to a lack of technical capacity, failure to meet minimum safety standards, poorly configured home ICT devices [75], rising cybercrime rates, lack of education, and gaps in employee digital literacy [76,77]. The reason for this lies in the fact that the new business reality was imposed in the form of a firefighting measure to extinguish an escalating fire so that practical solutions were implemented before the theory could examine all their implications. In this sense, the intention of our study is to emphasize to the academic community the need to critically consider teleworking as a growing cybersecurity risk in order to accurately identify necessary security adjustments in virtual offices.

3. The Conceptual Framework and Hypothesis Development

The COVID-19 pandemic is an unprecedented event which has had extraordinary impact not only on society and business as a whole, but has also generated cybercrime-related circumstances [78]. The main idea of the research is to analyse the perceptions of employees with regard to efficiency and the degree of threat to the cybersecurity of organizations in performing teleworking during the pandemic. We have based our conceptual framework regarding cyber security on the methodology of Georgiadou, Mouzakitis and Askounis [79], in an effort to develop a brief and comprehensive survey for the assessment of the cyber security readiness of organizations during the crisis with particular emphasis on employees’ thoughts and individuality. Their model defines two levels, organizational and individual, which consist of different domains, with quantitative indicators. On the other hand, the examination of the perception of employees in terms of efficiency was included in our analytical framework according to an appropriate part of the methodology of Vyas and Butakhieo [77]. Thus, the following latent variables were formed: teleworking, and perceptions of organizational efficiency and digital information security. Digital information security is a latent variable that includes perceptions of the risks of teleworking, changes in cyber-attacks during teleworking, response capabilities to cyber-attacks, key challenges in achieving an adequate response to cyber-attacks, as well as perceptions of key challenges related to digital information security. The latent variable of perception of the key challenges related to digital information security is formed based on the most vulnerable links of the digital information security system: information exposure, and the violation of digital information security and cyber security. Our goal is to examine how teleworking affects employees’ perceptions of organizational efficiency and digital information security. Within the model, we examine simultaneously the impact of these perceptions on the risks of teleworking, changes in cyber-attacks during teleworking, the capacity to respond to cyber-attacks, key challenges in achieving an adequate response to cyber-attacks, as well as perceptions of the key challenges related to cyber security. Thus, the connection scheme in the model is presented in the Figure 1.
Accordingly, the first formulated Hypothesis is:
Hypothesis 1.
Teleworking has an impact on digital information security.
In addition to the above links, we examined the possible impact of an organization’s sector on perceptions of organizational efficiency and digital information security, starting from the second hypothesis.
Hypothesis 2.
Teleworking has a positive impact on perceptions of organizational efficiency.
Finally, we also examined the interaction (correlation) between perceptions of organizational efficiency and digital information security by formulating a third hypothesis.
Hypothesis 3.
Perceptions of the key challenges related to digital information security has a strong effect on digital information security.

4. Materials and Methods

The empirical aspects of our study consist of constructing latent variables that correspond to different elements of employee perception, both in terms of organizational efficiency and organizations’ vulnerability to the digital information security threats of teleworking during the COVID-19 pandemic. Multiple observed variables were used and the structural equation model (SEM) was formed in order to investigate the causal relationships amongst the factors.
The SEM is a well-known multivariate analysis model that provides robust use in social sciences [80,81]. It is notably useful in testing theories that contain multiple equations involving dependence relationships [82]. The model is most often used as a confirmatory technique, but it can be used for exploratory analysis as well [83]. We evaluated the structural equation model by the maximum likelihood estimation method with an R package. Thus, all calculations were done with the R package, including the reliability analysis prior to the SEM.
The reliability analysis showing whether the data is appropriate for the SEM should precede the formation of the model. We calculated the Kayser–Meyer–Olkin (KMO) measure of sampling adequacy and Bartlett’s test of sphericity. The results are presented in Table 1. The lower limit of the KMO of acceptability for the analysis was 0.6 [84]. Since the KMO was 0.93, we found that the chosen data set was adequate for further multivariate analysis; therefore, we were more than satisfied with the result obtained, and the whole set of variables remained for the multivariate analysis of construct interrelations.
The null hypothesis of Bartlett’s test of sphericity implies the correlation matrix is identical to the identity matrix. Bartlett’s test of sphericity should be statistically significant, i.e., p < 0.05. If the p-value obtained is larger than 0.05 or 0.01, the null hypothesis is accepted and it means that the correlation matrix is not significantly different from the identity matrix, so the multivariate analysis has no sense in that case. As can be seen in Table 1, the Chi-square statistics were large enough to reject the null hypothesis (p-value < 0.001), so the chosen variables were adequate for multivariate analysis and the SEM.

Data Collection and Data Description

The authors developed a form of questionnaire according to defined research questions. A pilot survey which was carried out in order to examine the validity of the content of the questionnaire was conducted on 30 employees (15 each from the public and private sectors), in the period from 1 to 5 February 2021. Based on their suggestions, the final form of the questionnaire was prepared. The questionnaire was prepared in the Montenegrin and English languages, and its final form was distributed online over a period of seven days (23 February to 3 March 2021). Because of the epidemiological situation during the period of data collection (COVID-19 response measures were in force in Montenegro), the data were collected through the online tool Google Forms, and the survey link was distributed via e-mail to employees in businesses and public administration using publicly available data and registers e-mail registers. Therefore, the survey covered employees from the whole of Montenegro without applying geographical segmentation, although it should be noted that economic activity in Montenegro is concentrated predominantly in the central region; hence, the largest number of respondents come from the central region. The response rate was 24.5% and the total number of completed questionnaires was 1101. Even though questions of the representativeness of the sample and the potential inability to make general conclusions can be raised, it can be said that the number of respondents is significant, especially because, according to the Statistical Office of Montenegro—Monstat, there were as many as 219.4 thousand employees in Montenegro in 2020 [85].
Regarding the type of organization, 46% of respondents were from the public sector, 46.7% were from the private sector, 5.8% were from NGOs, while 1.5% were from political parties (Table 2). In terms of the size of the organization, 56% of respondents belonged to the category of employees in small enterprises, 25.2% to medium and 18.8% to large ones. The three most represented activities were: state administration (15.8%), education (11.2%) and trade (10.7%). Both sexes were symmetrically represented (50.3% women and 49.7% men), while in terms of age structure the category between 31–40 years (40.2%) prevailed, followed by 21–30 years (32.6%), 41–50 (15.6%), 51–60 (7.5%), and ages up to 20 (3.2%) and over 61 (0.8%). Regarding work experience and the years of service of employees who participated in the research, 32.9% of respondents were from the group with up to 5 years of service, 24.4% were from the group with between 6–10 years of service, 19.3% were from the group with between 11–15 years of service, 10.2% were from the group with 16–20 years of service, and 13.2% were from the group with over 21 years of service. The structure of respondents was dominated by higher education (67.1%), followed by post-secondary non-tertiary education (18%), while 14.3% of respondents reported that they have secondary education.
Telework was measured using two variables: Teleworking before the COVID-19 pandemic (T1), and Teleworking during the COVID-19 pandemic (T2). Respondents rated their agreement with a statement asking whether their organization practiced teleworking before and during the COVID-19 pandemic on a 5-point Likert scale, and all items were positively worded: (1) never, (2) almost never, (3) sometimes, (4) relatively often, and (5) often. As can be seen from the data in Table 2, most respondents (about 80%) had experienced working from home during the pandemic, which gives a favorable light to the analysis. The percentage of respondents who had never had the opportunity to work remotely before the pandemic was much higher (48%), and due to the pandemic this percentage decreased to 20%. Hence, we can say that the analysis is a useful contribution of the perceptions of such respondents, because for the first time they encountered such work, especially since this event came unexpectedly and brought companies into a situation of unpreparedness and rapid adaptations.
The sector is a variable that shows the activities of the organization of the respondents. The sector includes the following activities: agriculture, forestry, hunting and fishing, industry, construction, mining, manufacturing, transport, trade, tourism, catering, services, education, health, culture, police, science, army, public administration, and others. It is scaled from 1 to 20, respectively.
Organizational efficiency perceptions were formed by 3 variables: Impact of teleworking on the efficiency of the organization before and during the COVID-19 pandemic (OEP1 and OEP2, respectively), and the ideal organization of work (regardless of the pandemic (OEP3). Scales for the first two variables, OEP1 and OEP2, were as follows: (1) Teleworking significantly reduces the efficiency of the organization; (2) Teleworking slightly reduces the efficiency of the organization; (3) Teleworking is just as effective as office work; (4) Teleworking slightly increases the efficiency of the organization; (5) Teleworking significantly increases the efficiency of the organization. OEP3 was scaled as follows, in favour of teleworking: (1) exclusively office work; (2) predominantly office work; (3) equal working hours distributed from the office and remotely; (4) predominantly teleworking; (5) exclusively teleworking.
Risks of teleworking consisted of four variables, ROT1 to ROT4, which are named in Table 3. Cyber-attack changes had five variables, CC1 to CC5, as can be seen also in Table 3. All variables incorporated into these two constructs, Risks of teleworking and Cyber-attack changes, were scaled by: (1) totally incorrect to (5) totally correct. Cyber-attack response capabilities were formed based on four variables, CRC1 to CRC4, which are listed in Table 3. These four variables were scaled as follows: (1) poorly; (2) satisfactory; (3) good; (4) very good; (5) excellent.
Perceptions about the key challenges related to digital information security included the following constructs: The most vulnerable entry points (variables MVEP1 to MVEP5), Information exposure (IE1 to IE5), Disruption of digital information security (DISD1 to DISD5), and Cyber security (CS1 to CS5). All those variables were scaled on a Likert scale: (1) totally incorrect to (5) totally correct. The same stood for the construct named Key challenges (KC1 to KC5).
Descriptive statistics of the variables used with a reliability analysis of data are shown in Table 3. The reliability coefficients (Cronbach alpha) are presented in the last column of Table 3. Obviously, the coefficients for all groups of variables have excellent values [82].

5. Results and Discussion

The constructs developed were modelled together to empirically estimate the conceptual framework presented in Figure 1. Thus, a confirmatory SEM analysis was conducted in this phase. The results of the estimated model were further confirmed by evaluating fit statistics, and are presented in Table 4. Namely, Steiger [86] noted the root mean square error of approximation (RMSEA) with a value less than 0.07 indicated a good fit. Moreover, Kline [87] denoted 0.1 as the upper acceptable boundary of the RMSEA. The guidelines for the Comparative fit index (CFI) and the Tucker–Lewis index (TFI) were found at Hair et al. [82]. These authors stated that when dealing with a more complex model (number of variables used is larger than 30), the acceptable goodness-of-fit is above 0.90 for the CFI and TFI. Since we had 44 observed variables in our model, we recorded quite good results, and all fit statistics were in an acceptable range. More specifically, the root mean square error of approximation, the comparative fit index and the Tucker-Lewis index of model fit all met the required thresholds.
Examination of the SEM estimation results revealed numerous significant relationships at the 5% level. Table 5 presents non-normalized and normalized path coefficients.
The procedure for estimating the unstandardized path coefficients implies a reference variable to be assigned to each latent construct. Thus, in Table 5 it appears the unstandardized path coefficient is constrained to equal 1. In this respect, the latent variable is measured in the same way as that reference variable. The results presented in Table 5 reveal that the endogenous construct (teleworking) has a positive and significant impact on actual Organizational efficiency perceptions (standardized path coefficient is 0.572). The variable Sector has a statistically significant but not very strong positive impact (0.090) on Organizational efficiency perceptions.
Our results regarding the significant positive impact of teleworking on organizational efficiency support the results obtained by many authors [82,83,84,85,86,87,88,89,90,91,92]. For example, some studies showed that teleworking can increase employees’ productivity, along with having other impacts on job engagement and job performance [93,94]. Similarly, Bhat, Pande, and Ahuja [95] demonstrated key factors in virtual team effectiveness (virtual is equal to remote work). In contrast, some research shows a negative impact of teleworking on organizational efficiency in a way that causes a decline in employee motivation and productivity [96], as well as a weakening of work self-discipline, which consequently endangers the economic viability of the organization [73]. The results of our research additionally contribute to the literature because they confirm that working from home contributes to work efficiency even in a condition like the global pandemic, when certain jobs were forced to be performed remotely.
The standardized coefficients presented in Table 4 suggest that in predicting digital information security, key challenges’ perceptions related to digital information security (0.903) are the strongest predictor of the six constructs and one variable (sector). This estimate suggests that perceptions of key challenges related to digital information security have a relatively strong effect on digital information security in conditions of pronounced teleworking during the COVID-19 pandemic. The standardized coefficient for the key challenges/digital information security (0.699) constructs implies that the key challenges (Lack of employee education on cyber-attack protection mechanisms, Lack of IT staff, Lack of technical capacity, Lack of awareness of the seriousness of cyber risk, and Lack of financial resources) are the second strongest predictor of digital information security. The third strongest predictor of digital information security is the construct Cyber-attack changes (0.530). The risks of teleworking construct is the lowest of the six constructs in terms of affecting digital information security, where the standardized coefficient is 0.068. The results also show that the effect that teleworking has on actual digital information security is not statistically significant, since the p-value corresponding to its path coefficient exceeds 0.1 (0.187). The results also show that the effects that the first three predictors (Key challenges’ perceptions related to digital information security, Key challenges and Cyber-attack changes) have on actual digital information security are very strong, as the standardized coefficients for these effects exceed 0.5.
These results are in line with similar studies. Like Georgiadou et al. [79], our research reveals that human factors as a core sector of cyber security are still not accepted and not well recognized, even in the context of this pandemic. The Montenegrin employees rated lack of employee education, lack of IT staff, lack of technical capacity and lack of awareness of seriousness of cyber risk as key components that challenge the digital information security of their work organization. Evidently, most of the organizations analysed were not adequately equipped with the IT mechanisms needed to enable their employees to work remotely [97]. Furthermore, cyber-attack changes, as a strong predictor of digital information security, have become more frequent and sophisticated during the pandemic, as evidenced in recent studies [78]. Since risks of teleworking showed the least impact (path coefficient of 0.068) in predicting digital information security, we can say that Montenegrin employees do not recognize adequately enough the threat of phishing email scams, the possibility of infecting their devices with malware, cyber-criminals’ easier access to confidential data, etc. Existing literature about cyber security during the COVID-19 outbreak is still scarce, but there are a few studies that emphasize the resilience of current technology within employers’ existing cyber infrastructures [98,99,100].
Regarding the construct Perceptions of key challenges related to digital information security, we investigated the impact of four latent constructs on these perceptions. The most vulnerable entry points (PC and smart phone, Cloud systems, Web server, portable memory storage devices (USB, etc.) and Router) have the strongest impact, measured by a standardized path coefficient of 0.853. Afterwards, the Information exposure construct is the second strongest predictor of Perceptions of key challenges related to digital information security, with a standardized path coefficient of 0.835. Finally, the Cyber security construct is the lowest of the four constructs in terms of affecting Perceptions of key challenges related to digital information security, but has the strongest impact where the standardized coefficient is 0.663. Therefore, as Pranggono and Arabo [98] have stated, employees are aware of vulnerable entry points, and it is important to physically protect home office devices. In circumstances where the threat of cyber-crime is more prevalent than ever, organizations are forced to put the software, policies and tools in place that can ensure business continuity and safeguard against the threat of ransomware [101]. In order to promptly identify and overcome cyber threats, it is necessary that all employees are engaged because cybersecurity risk management is increasingly becoming a vital factor in the security of organizations [75].
Table 6 represents the covariance between two constructs: Organizational efficiency perceptions, and Digital information security. The covariance was found not to be significant. This result implies that perceptions about organizational efficiency and perceptions about digital information security are not interrelated. This is a good aspect for our research, since we have conceptually separated these two types of perceptions, and based on the pilot research, formed the correct conceptual scheme of the model, with the links presented in Figure 1. However, the exact form of this relationship in theory is uncertain, since, to the best of our knowledge, there has been no similar empirical study to date.
Therefore, the main findings of the research are the following: teleworking has no impact on digital information security; teleworking has a positive and significant impact on organizational efficiency perceptions; finally, perceptions of key challenges related to digital information security have a relatively strong effect on digital information security. Based on the research, we emphasize these key findings and implications in the form of recommendations for practitioners:
  • Because we have shown that teleworking has no significant impact on digital information security in this analysis, and have thus rejected our hypothesis H1, our conclusion is that the current state of employees’ perceptions of the importance of digital information security has not improved much, even in the conditions of the COVID-19 pandemic. Work organizations, not only in Montenegro but worldwide, should insist on cyber security training and raising awareness of these issues. Namely, many organizations obviously had not prepared their staff for this unexpected transition to remote work. That is why employers should make particular efforts to ensure their employees have an adequate awareness of the cyber security policies and practices within their workplace [99]. Hence, raising cyber security awareness among employees by constant training and education is important to reduce the risks of cyber-attacks on an organization;
  • Teleworking has a positive and significant impact on organizational efficiency perceptions, which proves the second research hypothesis, H2. Hence, work from home can be beneficial for both employers and employees [77]. This suggests that teleworking can serve as an alternative to office work even after the COVID-19 pandemic, and businesses should embrace this new working reality. This is especially true for jobs that have proven to be feasible remotely, such as financial work, business management, and professional and scientific services [102]. This recommendation is also in line with a number of results in the existing literature that highlight the benefits of working from home for employees, such as the flexibility of employees’ working time and place of work, allowing them to balance work and private life [103].
  • Proving that the third research hypothesis was correct, we have showed that perceptions of the key challenges related to digital information security have a relatively strong effect on digital information security. The Montenegrin employees were aware of the fact that all work devices should have strong endpoint protection measures to secure working infrastructure. When dealing with information exposure, employers should implement a company-wide policy regarding back-up servers and saving documents and data to a secure area, in order to protect business data [101]. Furthermore, it is essential to have the appropriate, latest-generation software that can respond adequately to the threat of serious cyber-attacks caused by malware, so organizations can proactively avoid and reduce cyber-related risks. The fact of great importance that the research has shown is that employees in a relatively small and still developing country have a well-established attitude about the importance of working in a digitally secure environment.
It is certainly useful to examine these results in more detail. Namely, it is important to investigate whether the answers regarding organizational efficiency differed significantly among respondents who did not have experience working from home during the pandemic, from those who worked remotely, especially due to the fact that all the data were perception based. Simply put, as people working from home felt comfortable and able to better reconcile work with family responsibilities, it is possible that there was bias in their responses to the organizational efficiency assessment (because that assessment is subjective). The same applies to digital information security perceptions. This can be established by the analysis of variance (ANOVA). Namely, the SEM model in this case cannot be evaluated separately for respondents who did not have teleworking experience during the pandemic (labeled by 1 in variable RT2), on the one hand, and for those respondents who had that experience (labeled by 4 or 5 in variable RT2), on the other hand, due to the very nature of the model. Such a matrix would not be positively definitive due to small deviations, if any, in the crucial variable RT2 (Teleworking during the COVID-19 pandemic). Therefore, we conducted an ANOVA test in order to examine those possible differences among the five modality groups of variable RT2 (1) never, (2) almost never, (3) sometimes, (4) relatively often, and (5) often practised teleworking during the COVID-19 pandemic). The main variables that we chose to examine were regarding organizational efficiency perceptions (OEP1, OEP2 and OEP3) and variables regarding digital information security perceptions (cyber security, in particular, CS1 to CS5; the same can be showed for the rest of the variables used).
The initial hypothesis of the ANOVA test states that the expected values of the variables examined for the respondents who had different levels of experience of teleworking during the COVID-19 pandemic (variable RT2) would be the same. Based on the results of the ANOVA tests presented in Table 7, it is noticed that there is a certain value of deviation of the average value of the variables per level of the variable RT2 compared to the common average value of the variables for all respondents. The calculated value of F statistics, presented in Table 7 and obtained by applying the factor-residual variance, and the associated probability, indicated that for each variables examined, it is necessary to reject any assumption of the equality of the expected values of the variables regarding organizational efficiency perceptions (OEP1, OEP2 and OEP3) and the variables regarding digital information security perceptions (for example CS1 to CS5), which were measured for groups of respondents with different levels of experience of teleworking during the pandemic. The level of significance, which is made by the rejection of the null hypothesis of the F test, is less than 5% for each variable. Post hoc analysis of Tukey’s test, presented in Appendix A (Table A1), revealed there were basic differences of assessments in all variables among certain groups, especially among those who were not teleworking (labeled by 1 in variable RT2) and those who were often or relatively often teleworking (labeled by 4 or 5 in variable RT2). Hence, we have to be cautious when making conclusions regarding the research results.
The main shortcomings of our paper are that organizational efficiency is evaluated on the basis of a subjective category (perception). Therefore, the recommendation for future research is to include some objective assessment of organizational efficiency. Further, the target group of respondents should include only the employees who had a pronounced experience of teleworking, so that the time spent working remotely is scaled as a time interval. We strongly believe that these preliminary steps would provide more reliable results, especially regarding the nexus between teleworking and work efficiency.

6. Conclusions

Empirical studies conducted in the period before the pandemic came to different results regarding the impact of teleworking on perceptions of organizational efficiency [31,33,34,40]. In that sense, there is agreement in the literature only with regard to the main identified determinants that affect the correlation between teleworking and organizational efficiency (flexibility of work arrangements, employee autonomy, reduction of operating costs, risks of miscommunication, coordination of business activities, possibility of supervision and organizational support), while the assessment of their impact differs significantly. For example, despite the widely held view that the flexibility of teleworking has a positive impact on efficiency gains, some empirical evidence shows a decline in productivity, due to the merging of the private and business spheres [51,53,54]. However, the COVID-19 pandemic has resulted in a radical paradigm shift both in the domain of the perception of organizational efficiency and in the very way of organizing teleworking, which went overnight from an alternative concept to the predominate way of functioning. Bearing in mind that in the pandemic period, teleworking’s introduction came suddenly and en masse, there is a striking distinction in relation to the previous voluntary, pre-planned, organized and work-adapted forms of remote work arrangements. In that sense, the essential problem of the rapid expansion of teleworking in the COVID-19 era is its incompatibility with certain sectors and competencies of employees. Namely, teleworking has traditionally been associated with narrowly defined activities whose nature allowed the smooth organization of work in this way (IT, financial services, scientific activities, real estate [104]), as well as with highly qualified categories of employees—white collar workers [105]. In addition to the type of activity, the efficiency of teleworking largely depends on the size of the organization, since numerous studies have shown a greater degree of its application in large organizations [106]. On the other hand, pandemic teleworking was rapidly introduced, which had a negative impact on the efficiency of certain activities. For this reason, the issue of teleworkability as a vital indicator of the impact of the pandemic on teleworking efficiency has begun to be considered in the literature [107,108]. According to the latest assessments, sectoral teleworkability mostly depends on the number of physical handling tasks, since teleworking is not only inefficient, but also inapplicable to a number of professions (firefighters, agricultural producers, medical staff, etc.) [106]. The high level of teleworkability is closely related to the degree of digitalization of certain activities, i.e., the technical feasibility of work tasks through modern technologies. Nevertheless, although technological innovations are regularly glorified as basic generators of flexible working arrangements [52,109], the pandemic has also shown their negative implications on employee productivity. Namely, increased dependence on IoT and exposure to cyber risks, being flooded with unnecessary information, difficult business communication, together with limited supervision and coordination of business activities have been perceived as essential factors in the decline of organizational efficiency during the pandemic [105].
While the pandemic has imposed teleworking as the ultimate way to maintain business continuity during emergencies, a growing body of research speaks in favour of its further expansion in the post-pandemic period [110,111,112]. Although analyses of its positive and negative aspects provoke sharp and divided attitudes, we should not lose sight of the fact that teleworking, like any artifact, cannot in itself have an unambiguous attribute of good or bad, but must be viewed through the perspective of its application. Given that digital technologies have played a crucial role in establishing vital workplace links during the pandemic, it is logical to expect that the further spread of teleworking will take place simultaneously with their unstoppable development: “Digital assets result in the digitalization of processes, which go beyond the digitalization of information, resources, value creation and revenue growth” [113]. With that in mind, it is more than clear that digital and flexible work patterns are becoming an imperative of the new age. To prepare for the increased prevalence of teleworking, timely and comprehensive consideration of cybersecurity is essential. Given the conspicuous potential of cyber-attacks in the achievement of economic, political, and military goals [114], their expansion is inevitable in the years ahead. The reciprocal correlation of teleworking and the escalation of cyber-attacks imposes the need to develop innovative defense mechanisms in organizations by investing in information infrastructure, along with the continuous education of employees in order to help them adopt a set of digital skills. Anticipation of future work dynamics leads to the conclusion that the degree of resilience to cyber risks and the flexibility of work arrangements will become one of the key determinants of the efficiency of organizations in the era of the digital revolution.
The conducted research has several limitations, which can be the starting point for future research. Primarily, the research covers a large number of unrelated activities, so it does not provide a comparative overview of the degree of representation of teleworking and the key challenges in terms of cybersecurity of individual activities. Bearing in mind that there is a significant disparity between certain categories of activities with regard to their efficiency of teleworking and exposure to cyber-attacks, we believe that future studies should go in the direction of accurately identifying the specific needs of individual business domains. In addition, the relevance of the results achieved is influenced by the personal beliefs and preferences of employees, as well as the present scepticism towards expressing views on sensitive issues related to the most vulnerable links of their organizations’ information security systems. An important factor is the level of information literacy, as a result of which some terminologically more complex questions could be misunderstood by the respondents, which also calls into question the adequacy of the answers obtained. Also, the research was done on the example of Montenegro, and although it is a significant sample in proportion to the number of inhabitants, it should be borne in mind that this is a small country in which the process of digital transformation has been quite slow. In this regard, it would be particularly interesting to conduct a similar study in a more technologically developed country in order to obtain a comparative overview of the situation in the field of teleworking culture and their cybersecurity implications.

Author Contributions

Conceptualization, all authors; methodology, J.C.S.; software, I.R.; data collection, I.R., N.R. and N.M.; validation, I.R. and N.M.; writing—original draft preparation, J.C.S., I.R. and A.M.; writing—review and editing, N.R.; visualization, J.C.S.; supervision, A.M. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Table A1. Tukey’s HSD test results.
Table A1. Tukey’s HSD test results.
Dependent Variable(I) RT2(J) RT2Mean Difference (I − J)Std. ErrorSig.95% Confidence Interval
Lower BoundUpper Bound
OEP110.0020.00−0.256000.117190.186−0.57620.0642
30.00−0.55717 *0.088950.000−0.8002−0.3141
40.00−0.76804 *0.103650.000−10.0513−0.4848
50.00−10.10154 *0.102780.000−10.3824−0.8207
20.0010.000.256000.117190.186−0.06420.5762
30.00−0.30117 *0.108790.045−0.5984−0.0039
40.00−0.51204 *0.121110.000−0.8430−0.1811
50.00−0.84554 *0.120360.000−10.1744−0.5167
30.0010.000.55717 *0.088950.0000.31410.8002
20.000.30117 *0.108790.0450.00390.5984
40.00−0.210880.094050.165−0.46790.0461
50.00−0.54437 *0.093090.000−0.7987−0.2900
40.0010.000.76804 *0.103650.0000.484810.0513
20.000.51204 *0.121110.0000.18110.8430
30.000.210880.094050.165−0.04610.4679
50.00−0.33350 *0.107230.016−0.6265−0.0405
50.0010.0010.10154 *0.102780.0000.820710.3824
20.000.84554 *0.120360.0000.516710.1744
30.000.54437 *0.093090.0000.29000.7987
40.000.33350 *0.107230.0160.04050.6265
OEP210.0020.00−0.288000.121290.123−0.61940.0434
30.00−0.64621 *0.092060.000−0.8978−0.3947
40.00−0.88212 *0.107280.000−10.1752−0.5890
50.00−10.27487 *0.106380.000−10.5655−0.9842
20.0010.000.288000.121290.123−0.04340.6194
30.00−0.35821 *0.112600.013−0.6659−0.0506
40.00−0.59412 *0.125350.000−0.9366−0.2516
50.00−0.98687 *0.124580.000−10.3273−0.6465
30.0010.000.64621 *0.092060.0000.39470.8978
20.000.35821 *0.112600.0130.05060.6659
40.00−0.235900.097340.110−0.50190.0301
50.00−0.62866 *0.096350.000−0.8919−0.3654
40.0010.000.88212 *0.107280.0000.589010.1752
20.000.59412 *0.125350.0000.25160.9366
30.000.235900.097340.110−0.03010.5019
50.00−0.39276 *0.110980.004−0.6960−0.0895
50.0010.0010.27487 *0.106380.0000.984210.5655
20.000.98687 *0.124580.0000.646510.3273
30.000.62866 *0.096350.0000.36540.8919
40.000.39276 *0.110980.0040.08950.6960
OEP310.0020.00−0.207110.106780.297−0.49890.0847
30.00−0.64266 *0.081050.000−0.8641−0.4212
40.00−0.71619 *0.094450.000−0.9743−0.4581
50.00−10.00752 *0.093660.000−10.2634−0.7516
20.0010.000.207110.106780.297−0.08470.4989
30.00−0.43555 *0.099130.000−0.7064−0.1647
40.00−0.50908 *0.110360.000−0.8106−0.2076
50.00−0.80041 *0.109680.000−10.1001−0.5007
30.0010.000.64266 *0.081050.0000.42120.8641
20.000.43555 *0.099130.0000.16470.7064
40.00−0.073530.085700.912−0.30770.1606
50.00−0.36486 *0.084830.000−0.5966−0.1331
40.0010.000.71619 *0.094450.0000.45810.9743
20.000.50908 *0.110360.0000.20760.8106
30.000.073530.085700.912−0.16060.3077
50.00−0.29133 *0.097710.024−0.5583−0.0244
50.0010.0010.00752 *0.093660.0000.751610.2634
20.000.80041 *0.109680.0000.500710.1001
30.000.36486 *0.084830.0000.13310.5966
40.000.29133 *0.097710.0240.02440.5583
CS110.0020.00−0.221330.141080.518−0.60680.1641
30.00−0.35731 *0.107080.008−0.6499−0.0647
40.00−0.57460 *0.124780.000−0.9156−0.2337
50.00−0.78974 *0.123740.000−10.1278−0.4517
20.0010.000.221330.141080.518−0.16410.6068
30.00−0.135980.130970.838−0.49380.2219
40.00−0.353270.145800.110−0.75160.0451
50.00−0.56841 *0.144900.001−0.9643−0.1725
30.0010.000.35731 *0.107080.0080.06470.6499
20.000.135980.130970.838−0.22190.4938
40.00−0.217290.113230.308−0.52670.0921
50.00−0.43243 *0.112070.001−0.7386−0.1262
40.0010.000.57460 *0.124780.0000.23370.9156
20.000.353270.145800.110−0.04510.7516
30.000.217290.113230.308−0.09210.5267
50.00−0.215140.129090.455−0.56790.1376
50.0010.000.78974 *0.123740.0000.451710.1278
20.000.56841 *0.144900.0010.17250.9643
30.000.43243 *0.112070.0010.12620.7386
40.000.215140.129090.455−0.13760.5679
CS210.0020.00−0.100440.132210.942−0.46170.2608
30.00−0.33578 *0.100350.008−0.6100−0.0616
40.00−0.47111 *0.116940.001−0.7906−0.1516
50.00−0.72239 *0.115960.000−10.0392−0.4056
20.0010.000.100440.132210.942−0.26080.4617
30.00−0.235340.122740.309−0.57070.1000
40.00−0.370670.136640.053−0.74400.0027
50.00−0.62195 *0.135800.000−0.9930−0.2509
30.0010.000.33578 *0.100350.0080.06160.6100
20.000.235340.122740.309−0.10000.5707
40.00−0.135330.106110.706−0.42530.1546
50.00−0.38661 *0.105030.002−0.6736−0.0996
40.0010.000.47111 *0.116940.0010.15160.7906
20.000.370670.136640.053−0.00270.7440
30.000.135330.106110.706−0.15460.4253
50.00−0.251280.120980.231−0.58180.0793
50.0010.000.72239 *0.115960.0000.405610.0392
20.000.62195 *0.135800.0000.25090.9930
30.000.38661 *0.105030.0020.09960.6736
40.000.251280.120980.231−0.07930.5818
CS310.0020.00−0.129780.135900.875−0.50110.2415
30.00−0.264540.103150.078−0.54640.0173
40.00−0.44910 *0.120200.002−0.7775−0.1207
50.00−0.71316 *0.119190.000−10.0388−0.3875
20.0010.000.129780.135900.875−0.24150.5011
30.00−0.134760.126160.823−0.47950.2099
40.00−0.319320.140440.154−0.70310.0644
50.00−0.58338 *0.139580.000−0.9648−0.2020
30.0010.000.264540.103150.078−0.01730.5464
20.000.134760.126160.823−0.20990.4795
40.00−0.184570.109070.439−0.48260.1134
50.00−0.44863 *0.107950.000−0.7436−0.1537
40.0010.000.44910 *0.120200.0020.12070.7775
20.000.319320.140440.154−0.06440.7031
30.000.184570.109070.439−0.11340.4826
50.00−0.264060.124350.211−0.60380.0757
50.0010.000.71316 *0.119190.0000.387510.0388
20.000.58338 *0.139580.0000.20200.9648
30.000.44863 *0.107950.0000.15370.7436
40.000.264060.124350.211−0.07570.6038
CS410.0020.000.076440.129560.977−0.27760.4305
30.00−0.107050.098340.812−0.37580.1616
40.00−0.32698 *0.114600.036−0.6401−0.0139
50.00−0.47350 *0.113640.000−0.7840−0.1630
20.0010.00−0.076440.129560.977−0.43050.2776
30.00−0.183500.120280.546−0.51210.1451
40.00−0.40343 *0.133900.022−0.7693−0.0376
50.00−0.54995 *0.133080.000−0.9136−0.1863
30.0010.000.107050.098340.812−0.16160.3758
20.000.183500.120280.546−0.14510.5121
40.00−0.219930.103990.214−0.50410.0642
50.00−0.36645 *0.102920.004−0.6477−0.0852
40.0010.000.32698 *0.114600.0360.01390.6401
20.000.40343 *0.133900.0220.03760.7693
30.000.219930.103990.214−0.06420.5041
50.00−0.146520.118550.730−0.47040.1774
50.0010.000.47350 *0.113640.0000.16300.7840
20.000.54995 *0.133080.0000.18630.9136
30.000.36645 *0.102920.0040.08520.6477
40.000.146520.118550.730−0.17740.4704
CS510.0020.000.041780.130770.998−0.31550.3991
30.00−0.152790.099260.537−0.42400.1184
40.00−0.38011 *0.115660.009−0.6961−0.0641
50.00−0.55145 *0.114690.000−0.8648−0.2381
20.0010.00−0.041780.130770.998−0.39910.3155
30.00−0.194570.121400.496−0.52630.1371
40.00−0.42188 *0.135150.016−0.7911−0.0526
50.00−0.59323 *0.134320.000−0.9602−0.2262
30.0010.000.152790.099260.537−0.11840.4240
20.000.194570.121400.496−0.13710.5263
40.00−0.227310.104950.194−0.51410.0595
50.00−0.39866 *0.103880.001−0.6825−0.1148
40.0010.000.38011 *0.115660.0090.06410.6961
20.000.42188 *0.135150.0160.05260.7911
30.000.227310.104950.194−0.05950.5141
50.00−0.171350.119660.607−0.49830.1556
50.0010.000.55145 *0.114690.0000.23810.8648
20.000.59323 *0.134320.0000.22620.9602
30.000.39866 *0.103880.0010.11480.6825
40.000.171350.119660.607−0.15560.4983
Note: * The mean difference is significant at the 0.05 level. Source: Authors’ calculation.

References

  1. Tavares, A.I. Telework and Health Effects Review. Int. J. Healthc. 2017, 3, 30–36. [Google Scholar] [CrossRef] [Green Version]
  2. Kelly, M.M. The next workplace revolution: Telecommuting. Superv. Manag. 1985, 30, 2–7. [Google Scholar]
  3. Moon, C.; Stanworth, S. Flexible working in Europe. The case of teleworking in the UK. Quad. Psicol. Del Lav. 1997, 5, 337–344. [Google Scholar]
  4. Regenye, S. Telecommuting. J. Inf. Manag. 1985, 6, 15–23. [Google Scholar]
  5. Olson, M.H. Work at home for computer professionals: Current attitudes and future prospects. ACM Trans. Off. Inf. Syst. 1989, 7, 317–338. [Google Scholar] [CrossRef]
  6. Gabaglio, E.; Jacobs, G.; Bonetti, A.; Plassmann, R. Framework Agreement on Teleworking. 2002. Available online: https://resourcecentre.etuc.org/sites/default/files/2020-09/Telework%202002_Framework%20Agreement%20-%20EN.pdf (accessed on 26 February 2021).
  7. Aguilera, A.; Lethiais, V.; Rallet, A.; Proulhac, L. Home-based teleworking in France: Characteristics, barriers and perspectives. Transp. Res. Part A Policy Pract. 2016, 92, 1–11. [Google Scholar] [CrossRef]
  8. GPO. Telework Enhancement Act of 2010. Available online: https://www.congress.gov/111/plaws/publ292/PLAW-111publ292.pdf (accessed on 17 February 2021).
  9. ILO Monitor: COVID-19 and the World of Work. Seventh Edition Updated Estimates and Analysis. 2021. Available online: https://www.ilo.org/wcmsp5/groups/public/---dgreports/---dcomm/documents/briefingnote/wcms_767028.pdf (accessed on 25 February 2021).
  10. European Commission. Telework in the EU before and after the COVID-19: Where We Were, Where We Head to 2020. Available online: https://ec.europa.eu/jrc/sites/jrcsh/files/jrc120945_policy_brief_-_covid_and_telework_final.pdf (accessed on 2 March 2021).
  11. Eurofound. Livingworking Covid-19. 2020. Available online: https://www.eurofound.europa.eu/publications/report/2020/living-working-and-covid-19 (accessed on 3 March 2021).
  12. Brenan, M.U.S. Workers Discovering Affinity for Remote Work. Gallup. 2020. Available online: https://news.gallup.com/poll/306695/workers-discovering-affinity-remote-work.aspx (accessed on 20 February 2021).
  13. Hinsliff, G. Office Life Is Not Over—But the Way We Work Must Surely Change. The Guardian. 2020. Available online: https://www.theguardian.com/commentisfree/2020/may/14/office-life-furloughing-coronavirus (accessed on 10 March 2021).
  14. Parker, L.D. The COVID-19 office in transition: Cost, efficiency and the social responsibility business case. Account. Audit. Account. J. 2020, 33, 1943–1967. [Google Scholar] [CrossRef]
  15. Abulibdeh, A. Can COVID-19 mitigation measures promote telework practices? J. Labor Soc. 2020, 23, 551–576. [Google Scholar] [CrossRef]
  16. Buomprisco, G.; Ricci, S.; Perri, R.; De Sio, S. Health and Telework: New Challenges after COVID-19 Pandemic. Eur. J. Environ. Public Health 2021, 5, 1–5. [Google Scholar] [CrossRef]
  17. OECD. Productivity Gains from Teleworking in the Post COVID-19 Era: How Can Public Policies Make It Happen? 2021. Available online: https://www.oecd.org/coronavirus/policy-responses/productivity-gains-from-teleworking-in-the-post-covid-19-era-a5d52e99 (accessed on 20 March 2021).
  18. Eurofound. Teleworkability and the COVID-19 Crisis: A New Digital Divide. 2021. Available online: https://www.eurofound.europa.eu/sites/default/files/wpef20020.pdf (accessed on 10 March 2021).
  19. Interpol. Global Landscape on Covid-19 Cyberthreat. 2020. Available online: https://www.interpol.int/en/content/download/15217/file/Global%20landscape%20on%20COVID-19%20cyberthreat.pdf (accessed on 14 February 2021).
  20. FBI IC3. Internet Cirme Report. 2020. Available online: https://www.fbi.gov/investigate/cyber/ic3 (accessed on 16 February 2021).
  21. Fortinet. Global Threat Landscape Report: A Semiannual Report by FortiGuard Labs. 2021. Available online: https://www.fortinet.com/content/dam/maindam/PUBLIC/02_MARKETING/08_Report/Threat-Report-H1-2020.pdf (accessed on 16 February 2021).
  22. Department of Defense Strategy for Operating in Cyberspace. 2021. Available online: https://csrc.nist.gov/CSRC/media/Projects/ISPAB/documents/DOD-Strategy-for-Operating-in-Cyberspace.pdf (accessed on 1 February 2021).
  23. Scullen, C.R. Cyberspace: The 21st Century Battlefield. U. Miami Nat’l Security & Armed Conflict L. Rev. 2015, pp. 233–264. Available online: https://repository.law.miami.edu/umnsac/vol6/iss1/5 (accessed on 7 February 2021).
  24. European Court of Aditors. European Audit Institutions Pool Their Work on Cybersecurity. 2021. Available online: https://www.eca.europa.eu/Lists/News/NEWS2012_17/INcompendium_cybersecurity_EN.pdf (accessed on 15 March 2021).
  25. Mayo, M.; Gomez-Mejia, L.; Firfiray, S.; Berrone, P.; Villena, V.H. Leader beliefs and CSR for employees: The case of telework provision. Leadersh. Organ. Dev. J. 2016, 37, 609–634. [Google Scholar] [CrossRef] [Green Version]
  26. Sullivan, C. What’s in a name? Definitions and conceptualisations of teleworking and homeworking. New Technol. Work Employ. 2003, 18, 158–165. [Google Scholar] [CrossRef]
  27. Zhu, P. Telecommuting, household commute and location choice. Urban Stud. 2013, 50, 2441–2459. [Google Scholar] [CrossRef]
  28. Eberhard, B.; Podio, M.; Alonso, A.P.; Radovica, E.; Avotina, L.; Peiseniece, L.; Caamano Sendon, M.; Gonzales Lozano, A.; Sole-Pla, J. Smart work: The transformation of the labour market due to the fourth industrial revolution (I4.0). Int. J. Bus. Econ. Sci. Appl. Res. 2017, 10, 47–66. [Google Scholar] [CrossRef]
  29. Ollo-López, A.; Goñi-Legaz, S.; Erro-Garcés, A. Home-based telework: Usefulness and facilitators. Int. J. Manpow. 2020. [Google Scholar] [CrossRef]
  30. Golden, T.D.; Veiga, J.F. The impact of superior–subordinate relationships on the commitment, job satisfaction, and performance of virtual workers. Leadersh. Q. 2008, 19, 77–88. [Google Scholar] [CrossRef]
  31. Virick, M.; DaSilva, N.; Arrington, K. Moderators of the curvilinear relation between extent of telecommuting and job and life satisfaction: The role of performance outcome orientation and worker type. Hum. Relat. 2010, 63, 137–154. [Google Scholar] [CrossRef]
  32. Martin, B.H.; MacDonnell, R. Is telework effective for organizations? A meta-analysis of empirical research on perceptions of telework and organizational outcomes. Manag. Res. Rev. 2012, 35, 602–616. [Google Scholar] [CrossRef]
  33. Allen, T.D.; Golden, T.D.; Shockley, K.M. How effective is telecommuting? assessing the status of our scientific findings. Psychol. Sci. Public Interest 2015, 16, 40–68. [Google Scholar] [CrossRef]
  34. Chen, Y.; Fulmer, I.S. Fine-tuning what we know about employees’ experience with flexible work arrangements and their job attitudes. Hum. Resour. Manag. 2017, 57, 381–395. [Google Scholar] [CrossRef]
  35. Sturman, M.C.; Walsh, K. Strengthening the employment relationship: The effects of work-hours fit on key employee attitudes. J. Organ. Behav. 2014, 35, 762–784. [Google Scholar] [CrossRef] [Green Version]
  36. Kröll, C.; Nüesch, S. The effects of flexible work practices on employee attitudes: Evidence from a large-scale panel study in Germany. Int. J. Hum. Resour. Manag. 2019, 30, 1505–1525. [Google Scholar] [CrossRef] [Green Version]
  37. de Sivatte, I.; Guadamillas, F. Antecedents and outcomes of implementing flexibility policies in organizations. Int. J. Human Resour. Manag. 2013, 24, 1327–1345. [Google Scholar] [CrossRef]
  38. Ongaki, J. An examination of the relationship between flexible work arrangements, work-family conflict, organizational commitment, and job performance. Management 2019, 23, 169–187. [Google Scholar] [CrossRef] [Green Version]
  39. Thorgeirsdottir, T.; Kelliher, C. Changing interfaces: The implications of flexible work arrangement use on team collaboration. Acad. Manag. Proc. 2017, 17, 7–21. [Google Scholar] [CrossRef]
  40. Gajendran, R.S.; Harrison, D.A.; Delaney-Klinger, K. Are Telecommuters Remotely Good Citizens? Unpacking Telecommuting’s Effects on Performance Via I-Deals and Job Resources. Pers. Psychol. 2014, 68, 353–393. [Google Scholar] [CrossRef]
  41. Golden, T.D.; Gajendran, R.S. Unpacking the Role of a Telecommuter’s Job in Their Performance: Examining Job Complexity, Problem Solving, Interdependence, and Social Support. J. Bus. Psychol. 2019, 34, 55–69. [Google Scholar] [CrossRef]
  42. Beaudoin, C.; Georgules, J.; Raicht, T. Tenant Needs in a Post-Pandemic World: 2020 Forecast. JLL. 2020. Available online: https://www.us.jll.com/en/trends-and-insights/research/2020-first-look-navigating-post-COVID-19 (accessed on 14 March 2021).
  43. Picard, C.F.; Durocher, S.; Gendron, Y. Office design processes, strategizing and time intermingling: An agenda to shape spaces and minds in public accounting firms. Account. Audit. Account. J. 2020, 33, 1143–1167. [Google Scholar] [CrossRef]
  44. Anderson, D.; Kelliher, C. Enforced remote working and the work-life interface during lockdown. Gend. Manag. Int. J. 2020, 35, 677–683. [Google Scholar] [CrossRef]
  45. Crosbie, T.; Moore, J. Work–life balance and working from home. Soc. Policy Soc. 2004, 3, 223–233. [Google Scholar] [CrossRef] [Green Version]
  46. Dima, A.-M.; Țuclea, C.-E.; Vrânceanu, D.-M.; Țigu, G. Sustainable Social and Individual Implications of Telework: A New Insight into the Romanian Labor Market. Sustainability 2019, 11, 3506. [Google Scholar] [CrossRef] [Green Version]
  47. Kroll, C.; Doebler, P.; Nüesch, S. Meta-analytic evidence of the effectiveness of stress management at work. Eur. J. Work Organ. Psychol. 2017, 26, 677–693. [Google Scholar] [CrossRef]
  48. Bellmann, L.; Hübler, O. Working from home, job satisfaction and work-life balance–robust or heterogeneous links. Int. J. Manpow. 2020, 41, 43–62. [Google Scholar] [CrossRef]
  49. Mallett, O.; Marks, A.; Skountridaki, L. Where does work belong anymore? The implications of intensive homebased working. Gend. Manag. 2020, 35, 657–665. [Google Scholar] [CrossRef]
  50. Wapshott, R.; Mallett, O. The spatial implications of homeworking: A Lefebvrian approach to the rewards and challenges of home-based work. Organization 2012, 19, 63–79. [Google Scholar] [CrossRef] [Green Version]
  51. Palumbo, R. Let me go to the office! An investigation into the side effects of working from home on work-life balance. Int. J. Public Sect. Manag. 2020, 33, 771–790. [Google Scholar] [CrossRef]
  52. Thulin, E.; Vilhelmson, B.; Johansson, M. New Telework, Time Pressure, and Time Use Control in Everyday Life. Sustainability 2019, 11, 3067. [Google Scholar] [CrossRef] [Green Version]
  53. Almarcha, M.; Balagué, N.; Torrents, C. Healthy Teleworking: Towards Personalized Exercise Recommendations. Sustainability 2021, 13, 3192. [Google Scholar] [CrossRef]
  54. Wong, A.H.K.; Cheung, J.O.; Chen, Z. Promoting effectiveness of “working from home”: Findings from Hong Kong working population under COVID-19. Asian Educ. Dev. Stud. 2021, 10, 1–19. [Google Scholar] [CrossRef]
  55. Belzunegui-Eraso, A.; Erro-Garcés, A. Teleworking in the Context of the Covid-19 Crisis. Sustainability 2020, 12, 3662. [Google Scholar] [CrossRef]
  56. López-Igual, P.; Rodríguez-Modroño, P. Who is Teleworking and Where from? Exploring the Main Determinants of Telework in Europe. Sustainability 2020, 12, 8797. [Google Scholar] [CrossRef]
  57. Ahmad, T. Corona Virus (Covid-19) Pandemic and Work from Home: Challenges of Cybercrimes and Cybersecurity. 2020. Available online: https://dx.doi.org/10.2139/ssrn.3568830 (accessed on 23 May 2021).
  58. Chesley, N. Information and communication technology use, work intensification and employee strain and distress. Work. Soc. 2014, 28, 589–610. [Google Scholar] [CrossRef]
  59. Cooper, C.; Lu, L. Excessive availability for work: Good or bad? Charting underlying motivations and searching for game changers. Hum. Resour. Manag. Rev. 2019, 29, 1–17. [Google Scholar] [CrossRef]
  60. Vial, G. Understanding digital transformation: A review and a research agenda. J. Strateg. Inf. Syst. 2019, 28, 118–144. [Google Scholar] [CrossRef]
  61. Anica-Popa, I.; Anica-Popa, L.; Radulescu, C.; Vrincianu, M. The Integration of Artificial Intelligence in Retail: Benefits, Challenges and a Dedicated Conceptual Framework. Amfiteatru Econ. 2021, 23, 120–136. [Google Scholar] [CrossRef]
  62. Stawicka, E. Sustainable Development in the Digital Age of Entrepreneurship. Sustainability 2021, 13, 4429. [Google Scholar] [CrossRef]
  63. Aytekin, P.; Virlanuta, F.O.; Guven, H.; Stanciu, S.; Bolakca, I. Consumers’ Perception of Risk Towards Artificial Intelligence Technologies Used in Trade: A Scale Development Study. Amfiteatru Econ. 2021, 23, 65–86. [Google Scholar] [CrossRef]
  64. Davidescu, A.A.; Apostu, S.-A.; Paul, A.; Casuneanu, I. Work Flexibility, Job Satisfaction, and Job Performance among Romanian Employees—Implications for Sustainable Human Resource Management. Sustainability 2020, 12, 6086. [Google Scholar] [CrossRef]
  65. Ciocoiu, C.N.; Prioteasa, A.L.; Colesca, S.E. Risk Management Implementation for Sustainable Development of Romanian SMEs: A Fuzzy Approach. Amfiteatru Econ. 2020, 22, 726–741. [Google Scholar] [CrossRef]
  66. Bratianu, C.; Neștian, A.Ș.; Tița, S.M.; Voda, A.I.; Guța, A.L. The Impact of Knowledge Risk on Sustainability of Firms. Amfiteatru Econ. 2020, 22, 639–652. [Google Scholar] [CrossRef]
  67. Unwin, T. Digital inequalities. In International Encyclopedia of Human Geography; Kobayashi, A., Ed.; Elsevier: New York, NY, USA, 2020; pp. 347–355. [Google Scholar]
  68. Fekete, A.; Rhyner, J. Sustainable Digital Transformation of Disaster Risk—Integrating New Types of Digital Social Vulnerability and Interdependencies with Critical Infrastructure. Sustainability 2020, 12, 9324. [Google Scholar] [CrossRef]
  69. Choi, J.J. The mediating effect of positive psychological capital between autonomous work environment and self-directed behavior: Evidence from South Korea. Hum. Resour. Dev. Int. 2020, 23, 46–65. [Google Scholar] [CrossRef]
  70. Saleem, F.; Salim, N.; Altalhi, H.A.; Ullah, Z.; AL-Ghamdi, A.A.-M.; Khan, Z.M. Assessing the effects of information and communication technologies on organizational development: Business values perspectives. Inf. Technol. Dev. 2017, 26, 54–88. [Google Scholar] [CrossRef]
  71. Tokarchuk, O.; Gabriele, R.; Neglia, G. Teleworking during the Covid-19 Crisis in Italy: Evidence and Tentative Interpretations. Sustainability 2021, 13, 2147. [Google Scholar] [CrossRef]
  72. Bologa, R.; Lupu, A.-R.; Boja, C.; Georgescu, T.M. Sustaining Employability: A Process for Introducing Cloud Computing, Big Data, Social Networks, Mobile Programming and Cybersecurity into Academic Curricula. Sustainability 2017, 9, 2235. [Google Scholar] [CrossRef] [Green Version]
  73. Loia, F.; Adinolfi, P. Teleworking as an Eco-Innovation for Sustainable Development: Assessing Collective Perceptions during COVID-19. Sustainability 2021, 13, 4823. [Google Scholar] [CrossRef]
  74. Vasiu, I.; Vasiu, L. Cybersecurity as an Essential Sustainable Economic Development Factor. Eur. J. Sustain. Dev. 2018, 7, 171–178. [Google Scholar] [CrossRef] [Green Version]
  75. Sadik, S.; Ahmed, M.; Sikos, L.F.; Islam, A.K.M.N. Toward a Sustainable Cybersecurity Ecosystem. Computers 2020, 9, 74. [Google Scholar] [CrossRef]
  76. Okereafor, K.; Manny, P. Understanding Cybersecurity Challenges of Telecommuting and Video Conferencing Applications in the COVID-19 Pandemic. Int. J. It Eng. 2020, 8, 13–23. [Google Scholar] [CrossRef]
  77. Vyas, L.; Butakhieo, N. The impact of working from home during COVID-19 on work and domains: An exploratory study on Hong Kong. Policy Des. Pract. 2021, 4, 59–76. [Google Scholar] [CrossRef]
  78. Lallie, H.S.; Shepherd, L.A.; Nurse, J.R.C.; Erola, A.; Epiphaniou, G.; Maple, C.; Bellekens, X. Cyber security in the age of COVID-19: A timeline and analysis of cyber-crime and cyber-attacks during the pandemic. Comput. Secur. 2021, 105, 102248. [Google Scholar] [CrossRef]
  79. Georgiadou, A.; Mouzakitis, S.; Askounis, D. Working from home during COVID-19 crisis: A cyber security culture assessment survey. Secur. J. 2021, 105, 102248. [Google Scholar] [CrossRef]
  80. Cunningham, E. Structural Equation Modelling Using AMOS; Statsline: Melbourne, Australia, 2008. [Google Scholar]
  81. Pearl, J. Causality: Models, Reasoning, and Inference; Cambridge University Press: Cambridge, UK, 2000. [Google Scholar]
  82. Hair, J.F.; Black, W.C.; Babin, B.J.; Anderson, R.E.; Tatham, R.L. Multivariate Data Analysis; Pearson Prentice Hall: Upper Saddle River, NJ, USA, 2006. [Google Scholar]
  83. Schreiber, J.B.; Stage, F.; King, J.; Nora, A.; Barlow, E.A. Reporting Structural Equation Modelling and Confirmatory Factor Analysis Results: A Review. J. Educ. Res. 2006, 99, 323–338. [Google Scholar] [CrossRef]
  84. Tabachnick, B.G.; Fidell, L.S. Using Multivariate Statistics, 5th ed.; Allyn and Bacon: New York, NY, USA, 2007. [Google Scholar]
  85. Statistical Office of Montenegro–Monstat. Available online: https://www.monstat.org/uploads/files/ARS/2020/ARS%20saopstenje_2020_cg.pdf (accessed on 23 May 2021).
  86. Steiger, J.H. Understanding the Limitations of Global Fit Assessment in Structural Equation Modeling. Personal. Individ. Differ. 2007, 42, 893–898. [Google Scholar] [CrossRef]
  87. Kline, R.B. Principles and Practice of Structural Equation Modelling, 2nd ed.; The Guilford Press: New York, NY, USA, 2005. [Google Scholar]
  88. Mello, J. Managing telework Programs Effectively. Empl. Responsib. Rights J. 2007, 19, 247–261. [Google Scholar] [CrossRef]
  89. Robertson, M.M.; Maynard, W.S.; Mcdevitt, J.R. Telecommuting: Managing the Safety of Workers in Home Office Environments. Prof. Saf. 2003, 48, 30–36. [Google Scholar]
  90. Grant, C.A.; Wallace, L.M.; Spurgeon, P.C.; Tramontano, C.; Charalampous, M. Construction and Initial Validation of the e-Work Life Scale to Measure remote e-Working. Empl. Relat. 2019, 41, 16–33. [Google Scholar] [CrossRef] [Green Version]
  91. Caulfield, B. Does it Pay to Work from Home? Examining the Factors Influencing Working from Home in the Greater Dublin Area. Case Stud. Transp. Policies 2015, 3, 206–214. [Google Scholar] [CrossRef]
  92. Baruch, Y.; Nicholson, N. Home, sweet work: Requirements for effective home working. J. Gen. Manag. 1997, 23, 15–30. [Google Scholar] [CrossRef]
  93. Collins, J.H.; Moschler, J.J. The Benefits and Limitations of Telecommuting. Def. Ar. J. 2009, 16, 55–66. [Google Scholar]
  94. Delanoeije, J.; Verbuggen, M. Beetween-Person and Within-Person Effects of Telework: A Quasi-Field Experiment. Eur. J. Work Organ. Psychol. 2020, 29, 795–808. [Google Scholar] [CrossRef]
  95. Bhat, S.K.; Pande, N.; Ahuja, V. Virtual Team Effectiveness: An Empirical Study Using SEM. Procedia Comput. Sci. 2017, 122, 33–41. [Google Scholar] [CrossRef]
  96. Toscano, F.; Zappalà, S. Social Isolation and Stress as Predictors of Productivity Perception and Remote Work Satisfaction during the COVID-19 Pandemic: The Role of Concern about the Virus in a Moderated Double Mediation. Sustainability 2020, 12, 9804. [Google Scholar] [CrossRef]
  97. Baz, M.; Alhakami, H.; Agrawal, A.; Baz, A.; Khan, R.A. Impact of COVID-19 Pandemic: A Cybersecurity Perspective. Intell. Autom. Soft Comput. 2021, 27, 641–652. [Google Scholar] [CrossRef]
  98. Pranggono, B.; Arabo, A. COVID-19 pandemic cybersecurity issues. Internet Technol. Lett. 2021, 4, e247. [Google Scholar] [CrossRef]
  99. Furnell, S.; Shah, J.N. Home working and cyber security–an outbreak of unpreparedness? Comput. Fraud Secur. 2020, 8, 6–12. [Google Scholar] [CrossRef]
  100. Hakak, S.; Khan, W.Z.; Imran, M.; Choo, K.K.R.; Shoaib, M. Have you been a victim of COVID-19 related cyber incidents? Survey, taxonomy, and mitigation strategies. IEEE Access 2020, 8, 124–144. [Google Scholar] [CrossRef]
  101. Malecki, F. Overcoming the security risks of remote working. Comput. Fraud Secur. 2020, 7, 10–12. [Google Scholar] [CrossRef]
  102. Dingel, J.I.; Neiman, B. How Many Jobs Can Be Done at Home? J. Public Econ. 2020, 189, 104235. [Google Scholar] [CrossRef]
  103. Raišienė, A.G.; Rapuano, V.; Varkulevičiūtė, K.; Stachová, K. Working form Home–Who is Happy? A Survey of Lithuania’s Employees during the COVID-19 Quarantine Period. Sustainability 2020, 12, 5332. [Google Scholar] [CrossRef]
  104. Eurofond, Sixth European Working Conditions Survey. 2015. Available online: https://www.eurofound.europa.eu/surveys/european-working-conditions-surveys/sixth-european-working-conditions-survey-2015 (accessed on 4 June 2021).
  105. Thorstensson, E. The Influence of Working from Home on Employees’ Productivity: Comparative Document Analysis between the Years 2000 and 2019–2020. Available online: http://urn.kb.se/resolve?urn=urn:nbn:se:kau:diva-78743</div> (accessed on 5 June 2021).
  106. Sostero, M.; Milasi, S.; Hurley, J.; Fernández-Macías, E.; Bisello, M. Teleworkability and the COVID-19 Crisis: A New Digital Divide? JRC121193; European Commission: Seville, Spain, 2020; Available online: https://ec.europa.eu/jrc/sites/jrcsh/files/jrc121193.pdf (accessed on 4 June 2021).
  107. Fana, M.; Tolan, S.; Torrejón, S.P.; Urzi Brancati, C.M.; Fernández-Macías, E. The COVID Confinement Measures and EU Labour Markets; Publications Office of the European Union: Luxembourg, 2020. [Google Scholar] [CrossRef]
  108. Milasi, S.; Bisello, M.; Hurley, J.; Sostero, M.; Fernández-Macías, E. The Potential for Teleworking in Europe and the Risk of a New Digital Divide. VOX/CEPR. 2020. Available online: https://voxeu.org/article/potential-teleworking-europe-and-risk-new-digital-divide (accessed on 6 June 2021).
  109. Frey, C.B.; Osborne, M.A. The future of employment: How susceptible are jobs to computerization? Technol. Soc. Chang. 2017, 114, 254–280. [Google Scholar] [CrossRef]
  110. Nagel, L. The influence of the COVID-19 pandemic on the digital transformation of work. Int. J. Sociol. Soc. Policy 2020, 40, 861–875. [Google Scholar] [CrossRef]
  111. Brakman, S.; Garretsen, H.; van Witteloostuijn, A. The turn from just-in-time to just-in- case globalization in and after times of COVID-19: An essay on the risk re-appraisal of borders and buffers. Soc. Sci. Humanit. Open 2020, 2, 1–24. [Google Scholar] [CrossRef]
  112. Tartavulea, C.V.; Albu, C.N.; Albu, N.; Dieaconescu, R.I.; Petre, S. Online Teaching Practices and the Effectiveness of the Educational Process in the Wake of the COVID-19 Pandemic. Amfiteatru Econ. 2020, 22, 920–936. [Google Scholar] [CrossRef]
  113. Tohănean, D.; Buzatu, A.I.; Baba, C.A.; Georgescu, B. Business Model Innovation Through the Use of Digital Technologies: Managing Risks and Creating Sustainability. Amfiteatru Econ. 2020, 22, 758–774. [Google Scholar] [CrossRef]
  114. Fan, Y.; Li, J.; Zhang, D.; Pi, J.; Song, J.; Zhao, G. Supporting Sustainable Maintenance of Substations under Cyber-Threats: An Evaluation Method of Cybersecurity Risk for Power CPS. Sustainability 2019, 11, 982. [Google Scholar] [CrossRef] [Green Version]
Figure 1. Path diagram of conceptual model of research. Source: Authors.
Figure 1. Path diagram of conceptual model of research. Source: Authors.
Sustainability 13 06750 g001
Table 1. Kayser–Meyer–Olkin (KMO) and Bartlett’s test of sphericity results.
Table 1. Kayser–Meyer–Olkin (KMO) and Bartlett’s test of sphericity results.
Kayser–Meyer–Olkin measure of sampling adequacy0.93
Bartlett’s test of sphericityApprox. Chi-square13,827
Df.44
Sig.0.001
Source: Authors’ calculation.
Table 2. Socio-demographic characteristics.
Table 2. Socio-demographic characteristics.
VariableVariable DefinitionN%
GenderMale54649.7
Female55450.3
AgeUp to 20 years353.2
21–3035932.6
31–4044340.2
41–5017215.6
51–60837.5
Aged 61 and older90.8
Work experienceUp to 5 years36232.9
6–10 years26924.4
11–15 years21319.3
16–20 years11210.2
Over 21 years14513.2
EducationElementary 70.6
Secondary15714.3
Post-secondary non-tertiary19818
Higher education73967.1
Type of organizationPublic sector50646
Private sector51446.7
NGO645.8
Political parties171.5
Size of the organizationSmall enterprise61756
Medium enterprise27725.2
Large enterprise20718.8
Teleworking before the Covid-19 pandemicNever52948
Almost never19217.5
Sometimes25323
Relatively often726.5
Often555
Teleworking during the Covid-19 pandemicNever22520.4
Almost never12511.4
Sometimes36733.3
Relatively often18917.2
Often19517.7
Source: Authors’ calculation.
Table 3. Variable measurement and descriptive statistics with reliability analysis.
Table 3. Variable measurement and descriptive statistics with reliability analysis.
Latent Variables CodeVariable DefinitionMeanS.D.Cronbach Alpha
SSector13.55.4-
Teleworking 0.61
T1Teleworking before the COVID-19 pandemic21.2
T2Teleworking during the COVID-19 pandemic31.3
Organizational Efficiency Perceptions 0.82
OEP1Impact of teleworking on the efficiency of organization before the COVID-19 pandemic2.11.1
OEP2Impact of teleworking on the efficiency of organization during the COVID-19 pandemic2.11.2
OEP3The ideal organization of work (regardless of the pandemic)2.21.0
Risks of Teleworking 0.9
ROT1Impossibility to protect communication on external networks2.81.2
ROT2Lower security of personal digital devices of employees, which makes it easier for cyber-criminals to access confidential data3.01.2
ROT3Employee devices can be infected with malware3.01.3
ROT4Phishing email scams and other forms of theft2.91.3
Cyber-Attack Changes 0.84
CC1Cyber-attacks have become more frequent2.31.1
CC2Cyber-attacks have become more sophisticated and dangerous in terms of negative consequences2.41.1
CC3Cyber-attacks are of the same type as during office work2.71.2
CC4Cyber-attacks have become less frequent2.41.1
CC5Cyber-attacks have become less sophisticated and dangerous in terms of negative consequences2.41.1
Cyber-Attack Response Capabilities 0.9
CRC1The capacity of organization to respond to a cyber-attack in the period before the pandemic2.61.3
CRC2The capacity of organization to respond to a cyber-attack during the Covid-19 pandemic2.71.3
CRC3Personal capacity (knowledge) to respond to a cyber-attack in the period before the pandemic2.41.3
CRC4Personal capacity (knowledge) to respond to a cyber-attack during the Covid-19 pandemic2.41.3
Key Challenges 0.92
KC1Lack of technical capacity2.81.3
KC2Lack of IT staff2.91.4
KC3Lack of financial resources2.81.4
KC4Lack of awareness of the seriousness of cyber risk3.01.4
KC5Lack of employee education on cyber-attack protection mechanisms3.21.4
The Most Vulnerable Entry Points 0.88
MVEP1Web server3.11.2
MVEP2Router2.91.1
MVEP3Cloud systems3.01.1
MVEP4PC and smart phone3.31.2
MVEP5Portable memory storage devices (USB, etc.)3.11.2
Information Exposure 0.96
IE1Personal data exposure 3.31.4
IE2Business secrets exposure and exposure of confidential information of the organization3.41.4
IE3Intellectual property exposure3.21.3
IE4Customer information exposure3.41.4
IE5Business correspondence exposure3.31.3
Disruption of Digital Information Security 0.92
DISD1External hacker attacks2.71.2
DISD2Operational errors2.71.2
DISD3Malicious insider2.71.2
DISD4Third party failure2.81.2
DISD5Inattention of employees2.91.2
Cyber Security 0.95
CS1Computer network protection3.61.3
CS2Endpoint Security3.51.2
CS3Application Security3.61.2
CS4Cyber Analytics3.41.2
CS5Remote Access3.41.2
Source: Authors’ calculation.
Table 4. The structural equation model (SEM): Fit statistics.
Table 4. The structural equation model (SEM): Fit statistics.
Fit StatisticsValue
Χ25345.402
Df889
RMSEA0.067
CFI (Comparative Fit Index)0.914
TFI (Tucker-Lewis Index)0.906
Source: Authors’ calculation.
Table 5. Estimation results of the structural equation model (SEM).
Table 5. Estimation results of the structural equation model (SEM).
Causal RelationshipNon-Normalized Path CoefficientS.E.pNormalized Path Coefficient
Organizational efficiency perceptions Teleworking0.4350.03800.572 ***
Organizational efficiency perceptions Sector0.5000.1780.0050.090 ***
Digital information security Teleworking0.0590.0450.1890.051
Digital information security Risks of teleworking1.000--0.068
Digital information security Cyber-attack changes0.8310.06500.530 ***
Digital information security Cyber-attack response capabilities−0.3530.0690−0.180 ***
Digital information security Key challenges1.2250.07900.699 ***
Digital information security Key challenges perceptions1.1760.07800.903 ***
Digital information security Sector0. 7900.2860.0060.093 ***
Key challenges perceptions The most vulnerable entry points1.000--0.853
Key challenges perceptions Information exposure1.2260.05500.835 ***
Key challenges perceptions Disruption of digital information security0.8950.04700.708 ***
Key challenges perceptions Cyber security0.9330.04900.663 ***
T T11.000--0.614
T T21.3250.11900.721 ***
OEP OEP11.000--0.867
OEP OEP21.0840.03800.896 ***
OEP OEP30.6080.03100.576 ***
ROT ROT11.000--0.772
ROT ROT21.1520.03800.858 ***
ROT ROT31.1920.03800.875 ***
ROT ROT41.1750.03900.850 ***
CC CC11.000--0.868
CC CC21.0200.03000.883 ***
CC CC30.6440.03500.532 ***
CC CC40.6050.03100.563 ***
CC CC50.6130.03100.574 ***
CRC CRC11.000--0.928
CRC CRC21.0200.02100.948 ***
CRC CRC30.6870.02600.669 ***
CRC CRC40.6860.02600.653 ***
KC KC11.000--0.842
KC KC21.0360.03000.851 ***
KC KC30.9720.03100.797 ***
KC KC41.0560.03100.841 ***
KC KC51.0720.03000.853 ***
MVEP MVEP11.000--0.804
MVEP MVEP20.7560.03100.688 ***
MVEP MVEP30.9340.03200.807 ***
MVEP MVEP41.0240.03400.828 ***
MVEP MVEP50.9070.03600.721 ***
IE IE11.000--0.860
IE IE21.0580.02400.924 ***
IE IE30.9810.02400.892 ***
IE IE41.0420.02300.926 ***
IE IE50.9980.02300.904 ***
DISD DISD11.000--0.841
DISD DISD20.9530.02700.854 ***
DISD DISD30.9770.02800.846 ***
DISD DISD40.9780.02600.881 ***
DISD DISD50.9200.03100.771 ***
CS CS11.000--0.901
CS CS20.9490.02000.913 ***
CS CS30.9710.02000.911 ***
CS CS40.8800.02000.871 ***
CS CS50.8680.02100.848 ***
Source: Authors’ calculation. Note: “***” indicates significance at the level of 1%.
Table 6. Estimation results of covariances of the structural equation model (SEM).
Table 6. Estimation results of covariances of the structural equation model (SEM).
VariablesNon-Normalized Path CoefficientS.E.pNormalized Path Coefficient
Organizational efficiency perceptions ⇔ Digital information security−0.0360.0220.098−0.059
Source: Authors’ calculation.
Table 7. ANOVA test results.
Table 7. ANOVA test results.
Sum of Squaresdf.Mean SquareFSig.
OEP1Between Groups147.114436.77833.3270.000
Within Groups1209.49310961.104
Total1356.6071100
OEP2Between Groups197.101449.27541.6820.000
Within Groups1295.64710961.182
Total1492.7481100
OEP3Between Groups131.819432.95535.9650.000
Within Groups1004.26310960.916
Total1136.0821100
CS1Between Groups75.714418.92811.8350.000
Within Groups1752.95910961.599
Total1828.6721100
CS2Between Groups64.885416.22111.5480.000
Within Groups1539.52010961.405
Total1604.4051100
CS3Between Groups61.778415.44510.4070.000
Within Groups1626.50110961.484
Total1688.2801100
CS4Between Groups38.15949.5407.0720.000
Within Groups1478.45710961.349
Total1516.6161100
CS5Between Groups47.251411.8138.5960.000
Within Groups1506.11410961.374
Total1553.3641100
Source: Authors’ calculation.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Mihailović, A.; Cerović Smolović, J.; Radević, I.; Rašović, N.; Martinović, N. COVID-19 and Beyond: Employee Perceptions of the Efficiency of Teleworking and Its Cybersecurity Implications. Sustainability 2021, 13, 6750. https://doi.org/10.3390/su13126750

AMA Style

Mihailović A, Cerović Smolović J, Radević I, Rašović N, Martinović N. COVID-19 and Beyond: Employee Perceptions of the Efficiency of Teleworking and Its Cybersecurity Implications. Sustainability. 2021; 13(12):6750. https://doi.org/10.3390/su13126750

Chicago/Turabian Style

Mihailović, Andreja, Julija Cerović Smolović, Ivan Radević, Neli Rašović, and Nikola Martinović. 2021. "COVID-19 and Beyond: Employee Perceptions of the Efficiency of Teleworking and Its Cybersecurity Implications" Sustainability 13, no. 12: 6750. https://doi.org/10.3390/su13126750

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop