Next Article in Journal
Biomimetic Synthesis, Characterization, and Evaluation of Fluorescence Resonance Energy Transfer, Photoluminescence, and Photocatalytic Activity of Zinc Oxide Nanoparticles
Previous Article in Journal
Does Economic Agglomeration Lead to Efficient Rural to Urban Land Conversion? An Examination of China’s Metropolitan Area Development Strategy
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Unobtrusive Continuous Stress Detection in Knowledge Work—Statistical Analysis on User Acceptance

by
Johanna Kallio
1,*,
Elena Vildjiounaite
1,
Julia Kantorovitch
2,
Atte Kinnula
1 and
Miguel Bordallo López
1,3
1
Knowledge Intensive Products and Services, VTT Technical Research Centre of Finland Ltd., Kaitoväylä 1, FI-90571 Oulu, Finland
2
Data Intensive Economy, VTT Technical Research Centre of Finland Ltd., Tekniikantie 21, FI-02150 Espoo, Finland
3
Faculty of Information Technology and Electrical Engineering, University of Oulu, Pentti Kaiteran katu 1, FI-90570 Oulu, Finland
*
Author to whom correspondence should be addressed.
Sustainability 2021, 13(4), 2003; https://doi.org/10.3390/su13042003
Submission received: 22 January 2021 / Revised: 7 February 2021 / Accepted: 8 February 2021 / Published: 12 February 2021
(This article belongs to the Section Health, Well-Being and Sustainability)

Abstract

:
Modern knowledge work is highly intense and demanding, exposing workers to long-term psychosocial stress. In order to address the problem, stress detection technologies have been developed, enabling the continuous assessment of personal stress based on multimodal sensor data. However, stakeholders lack insights into how employees perceive different monitoring technologies and whether they are willing to share stress-indicative data in order to sustain well-being at the individual, team, and organizational levels in the knowledge work context. To fill this research gap, we developed a theoretical model for knowledge workers’ interest in sharing their stress-indicative data collected with unobtrusive sensors and examined it empirically using structural equation modeling (SEM) with a survey of 181 European knowledge workers. The results did not show statistically significant privacy concerns regarding environmental sensors such as air quality, sound level, and motion sensors. On the other hand, concerns about more privacy-sensitive methods such as tracking personal device usage patterns did not prevent user acceptance nor intent to share data. Overall, knowledge workers were highly interested in employing stress monitoring technologies to measure their stress levels and receive information about their personal well-being. The results validate the willingness to accept the unobtrusive, continuous stress detection in the context of knowledge work.

1. Introduction

The amount of knowledge-intensive work has been continuously increasing in modern societies; up to 50% of workers are knowledge workers [1]. Knowledge workers can be defined as skilled and autonomous workers who create and apply knowledge in order to produce complex results [2]; however, their work is highly intensive, cognitive, and emotionally demanding, making them prone to psychosocial stress and fatigue [3]. The International Labor Organization (ILO) defines work-related stress as “the harmful physical and emotional response caused by an imbalance between the perceived demands and the perceived resources and abilities of individuals to cope with those demands” [4] (p. 2). Long-term stress is associated with various mental health problems (anxiety, insomnia, depression, fatigue, and concentration difficulties), cardiovascular diseases, poor immune function, and presenteeism [5]. The cost of work-related stress is hundreds of billions of euros annually worldwide [3].
The United Nations has defined two relevant sustainable development goals: (a) to ensure healthy lives and promote well-being for all at all ages, and (b) to promote sustained, inclusive and sustainable economic growth, full and productive employment, and decent work for all [6]. Correspondingly, employee well-being has emerged as a strategic priority in all organizations facing ongoing demographic and technological changes [7]. Healthy, skilled, and motivated employees are seen as the most important capital of knowledge-intensive organizations in the increasingly fierce global competition and pace of work, and with extended working life [4,8]. To maintain sustainable work, organizations invest in various physical and mental programs, but such programs lack the capabilities to support employees individually and measure the impact of well-being programs [9]. Instead of periodic surveys, organizations are looking for well-accepted solutions to continuously measure employee well-being, to minimize health risks, and to avoid adverse outcomes [7]. Novel sensor-based well-being technologies facilitate the accurate stress assessment of employees in real time [10], but personal well-being data are more privacy sensitive than many other types of data, and thus, continuous stress detection requires user acceptance before it can be applied to well-being at work.
This study aims to provide insights into how knowledge workers perceive different automatic stress-detection technologies and personal data sharing in the work context. The focus was specifically on measuring the employees via unobtrusive sensors embedded in the work environment (either discreetly or virtually), thereby enabling the passive extraction of data and freeing the employees to conduct their usual daily activities without disturbance from the measurement system itself (e.g., charging, wearing, loss of privacy). In order to deploy the continuous stress monitoring concept for broader adoption, it is essential to answer the following questions: (1) Will employees accept stress detection? (2) What is the overall level of interest in using the resulting well-being information? (3) Are there technologies that are more privacy-sensitive than others? and (4) How interested are the users to share personal data in exchange for added benefits? Most well-being monitoring acceptance studies in the work context have investigated the employees’ intentions to adopt wearable technologies [11,12,13]. However, to the best of our knowledge, there have not been any surveys concerning the knowledge workers’ perceptions of different stress monitoring technologies and their interest in sharing personal stress-indicative data in the work context in order to sustain well-being at the individual, team, and organizational levels.
The main contribution of this research is to provide a statistically valid and conclusive answer to the research questions above-mentioned in order to determine the feasibility of continuous stress monitoring in the knowledge work context. To this end, we developed a theoretical model for the willingness of knowledge workers to share data collected with unobtrusive sensors to sustain well-being and tested it empirically with structural equation modeling (SEM) and anonymous online survey data. Moreover, the perceptions of knowledge workers of different stress-detection technologies and their privacy sensitivity were studied via the conducted survey. The quantitative survey was conducted in spring 2020 and resulted in 181 responses from European knowledge-intensive organizations. Overall, the results validate the knowledge workers’ willingness to accept the unobtrusive, continuous stress detection and data sharing in order to promote well-being at work.

1.1. Unobtrusive Stress Detection

Stress is manifested in psychological, physiological, and behavioral responses in everyday life. Psychological responses are related to emotions and mental processes, whereas physiological responses refer to the activation of hypothalamic–pituitary–adrenal systems and autonomic nervous systems such as increased heart rate, respiration, and sweating [14]. Behavioral responses include, for instance, motion, postures, facial expressions, and the usage of digital devices, reflecting an individual’s emotions and cognition [15].
At present, work-related stress is typically assessed using either periodic or occasional surveys, mainly focusing on the employees’ perceived physiological responses such as emotions or mood (e.g., [16]). However, the major limitations of these surveys are their infrequency, the low number of measurements, and the high data collection and analysis effort. More frequent but less burdensome solutions to measuring work-related stress factors and supporting employee well-being promptly are required. Therefore, stress research using sensing, computing, and communications technologies suitable for continuous stress monitoring has become an active research area [10].
Wearable devices comprising physiological sensors have demonstrated a high potential for objective stress detection in laboratory studies [10], but disturbance induced by wearing and charging, and privacy risks affect the adoption of wearables in long-term use [17,18]. Moreover, when measurement devices are worn or otherwise attached to a person, real-world measurements typically produce imperfect output data [19]. To overcome the discomfort and data-loss challenges of wearable devices, continuous stress monitoring based on unobtrusive sensors and software (i.e., virtual sensors without a physical form) embedded in the work environment have been proposed as an additional data source or the only data source for long-term use [17,20].
Previous studies have collected behavioral data from computer, keystroke, and mouse dynamics such as interaction time, typing pressure, and mouse clicking, but mostly under laboratory conditions [21,22,23,24,25]. The majority of real-life stress-detection studies have been based on behavioral data gathered from smartphones [26,27,28,29,30,31,32]. The behavioral data collection approaches are convenient because they do not require any additional gadgets, but using data from personal devices can pose privacy concerns. However, when monitoring is focused on the usage patterns (e.g., writing tempo, motion velocity, program categories, duration) instead of content (e.g., what is written, what the user clicks on, what programs or applications are used), the methods have been evaluated as being notably less privacy threatening [10,33].
Computer vision is another well-studied behavioral stress-detection approach that focuses on analyzing facial expressions, postures, and eye movements [10,33,34]. Video cameras can be deployed to assess stress and emotional states relatively accurately in laboratory conditions; however, their major disadvantage is the lack of privacy, making them an undesirable and obtrusive option from a user perspective [33]. On the other hand, a depth sensor is a more privacy-safe type of computer vision for the reason that the monitored person is not readily identifiable from the depth image data. Moreover, the depth sensor can be positioned in office ceilings to have a side-view of the monitored persons and detect head trajectories (i.e., head motion) instead of pointing directly at faces [35].
In addition, earlier studies have recognized smart work environments as an option to collect behavioral data from employees [10]. Motion or postures extracted from passive infrared sensors and pressure-sensitive chair data can provide information about the workers’ stress levels [35,36]. Interestingly, data from low-cost in-office sensors such as environmental quality sensors installed in the walls or ceilings can also be indicative of stress levels [37]. Compared with smartphone-, computer-, or keyboard-usage-based stress detection, these environmental sensors can be considered less privacy threatening.
Previous studies have suggested that privacy perspectives are critical factors in adopting wearable devices [18], while cost-efficiency and easy deployment are essential in real-life stress detection implementations [33]. Thus, this study focused on unobtrusive stress monitoring methods embedded in the work environment that do not require user effort (e.g., wearing, charging) or attention (e.g., interfering with performance, privacy threat), and that can be applied in knowledge work over the long-term.

1.2. The Theoretical Context of Behavioral Intentions

Behavioral human sciences have introduced several decision-making theories in order to conceptualize and understand social behaviors, but predicting human intentions and actions (i.e., willingness to use technology and share data) is challenging, especially at an organizational level. Sociotechnical systems theory has approached organizational excellence and well-being by studying the interaction between humans and technology (or the environment) in workplaces [38]. According to Eason [38], sociotechnical systems can be defined as heterogeneous, consisting of social and technical components with divergent characteristics. Compared to technical components, humans are constantly aware of their environment and are capable of changing their behavior. Therefore, considering user perspectives is an integral part of technology development that includes human–technology interaction.
Structural decision-making models such as the theory of planned behavior (TPB) proposed by Ajzen [39] can be considered as a well-established basis for predicting an individual’s behavior. The TPB suggests that an individual’s behavior depends on the person’s intention to perform an action, indicated by the individual’s attitude, perception of subjective norms, and perceived behavioral control [39]. Earlier studies have successfully applied the TPB to predict data sharing intentions in different contexts including scientific research [40]. Following [39], the attitude is linked with an individual’s perceptions about the possible outcomes of sharing data, and the subjective norm is a person’s belief about other people’s expectations toward an action (i.e., data sharing). The perceived behavioral control is related to the individual’s perceptions of their personal ability to perform a given action.
The technology acceptance model (TAM) [41] and the unified theory of acceptance and use of technology (UTAUT) model [42,43] extend the TPB and provide explanations for user acceptance and the usage of technology. TAM explains a person’s intention to use technology as depending on their perceptions of usefulness and ease of use in regard to the technology in question. TAM and the UTAUT have been widely implemented and tested in wearable technology-related studies in diverse work contexts (e.g., [12,14,44]). Williams et al. [43] found performance expectancy in the UTAUT model to be the most vital factor in predicting technology’s actual use, meaning that people are more willing to use technology such as sensors and tracking software when they believe that the technology helps them.
Some technology acceptance models have been extended with concepts of trust and intrusiveness including privacy aspects (e.g., [13,18]). A theoretical basis for privacy concerns can be applied when considering continuous sensor-based stress monitoring and sharing personal data that is indicative of the employees’ stress levels. Two antecedents can define the perceived privacy concerns, namely perceived vulnerability and perceived ability to control information [45]. These two factors influence the employees’ privacy concerns when they decide whether to share the data collected on themselves. When individuals perceive that their data will not be used fairly and/or that there will be negative consequences, they will be less likely to employ sensors or tracking software while working [11,46]. In other words, individuals with serious concerns regarding their data’s misuse will seek to minimize their vulnerability by refusing data sharing to promote their well-being.
In summary, a person’s behavior is linked to the person’s motivation and intentions. More positive attitudes, more substantial positive social pressure, and greater perceived control will lead to stronger motivation and intentions. Therefore, we can assume that a positive attitude toward unobtrusive stress monitoring technology will positively influence their intentions to share data in order to support well-being. On the other hand, deploying sensor-based stress detection and sharing personal data requires trust, security, and privacy protection, especially in the work context. Although the TPB, TAM, and the UTAUT have successfully been applied in data sharing and well-being technology in diverse contexts, they have also been criticized for direct intention–behavior linkage and limited prediction value [47]. Thus, this study does not aim to test these models, but uses them as a basis for developing a general model for sharing personal well-being data collected with unobtrusive sensors in knowledge-intensive work.
The remaining part of this paper is structured as follows. Section 2 introduces the research hypothesis and describes the employed methods and empirical survey data. The empirical data analysis results are presented in Section 3, and the theoretical and empirical contributions of the study are discussed in Section 4. Finally, we summarize our conclusions and provide an outlook for future work in Section 5.

2. Materials and Methods

2.1. Research Model and Hypotheses

Based on the TPB, TAM, and theory of privacy concerns, a research model was developed to predict the intentions of knowledge workers to share their stress-indicative data in order to sustain well-being at individual, team, and organizational levels. The model determines the employees’ intention to share personal data in the work context by assessing their interest in employing unobtrusive stress monitoring technologies and their privacy concerns about data use (see Figure 1). The concepts of the research model were “Interest in employing environmental sensors” (concept code ENV), “Interest in employing tracking software” (concept code TRA), “Privacy concerns about the use of data” (concept code CON), and “Interest in sharing personal data” (concept code SHA). The TPB explains the motivation behind the employees’ data sharing intentions, and TAM establishes their intent to use novel stress detection technology (i.e., their motivational belief that sharing data and using technology will help them). Following this, it can also be assumed that a positive attitude toward stress detection technology is linked with an interest in sharing personal data in order to sustain well-being. Moreover, the theory of privacy concerns explains the underlying privacy factors affecting the employees’ willingness to employ stress monitoring and share personal data in the work context. Thus, the main hypotheses of this study are as follows:
Hypothesis 1 (H1).
Employee privacy concerns about using data negatively influence their interest in sharing stress-indicative personal data in order to sustain their well-being.
Hypothesis 2 (H2).
Employee interest in employing tracking software to monitor their stress positively influences their interest in sharing personal data in order to sustain their well-being.
Hypothesis 3 (H3).
Employee interest in employing environmental sensors for monitoring their stress positively influences their interest in sharing personal data in order to sustain their well-being.
Hypothesis 4 (H4).
Employee privacy concerns about using data negatively influence their interest in employing tracking software (a) and environmental sensors (b) in order to monitor their stress.
Figure 1 depicts the research model for knowledge workers’ interest in sharing data.

2.2. Empirical Data Collection

The empirical data about knowledge workers’ perceptions regarding sensor-based stress monitoring and well-being solutions in the work environment were collected anonymously in spring 2020 using the Internet and the Questback Inc. online survey tool. The survey was conducted by the VTT Technical Research Center of Finland Ltd., and the survey link was distributed on their online news page, and Twitter and LinkedIn channels, followed by a large number of knowledge workers. The idea was to reach a wide range of European knowledge workers; however, the distribution choice did not allow counting the response rate.
This study’s structural model is a second-order model. Hence, the statements in the survey questionnaire measured theoretical concepts (see Table 1). The researchers designed the questions related to the employees’ interest in sharing personal data, interest in using sensors and tracking software, and concerns about the use of data in the knowledge work context while considering the main features of the concepts in the research model based on existing theories. Continuous stress monitoring employing behavioral data from unobtrusive sensors and trackers is a relatively new research topic. Thus, operational measures (i.e., questions) were not directly available from the earlier research, although previous studies were used as a basis for them (e.g., [11]). The questions were measured on a four-point Likert scale (1 = not at all interested, 2 = not that interested, 3 = interested, 4 = very interested for Q1, 1 = strongly disagree, 2 = disagree, 3 = agree, 4 = strongly agree for Q3–Q6 and 1 = not at all concerned, 2 = not that concerned, 3 = concerned, 4 = very concerned for Q7) and included attitudinal statements.
Moreover, the respondents were asked two multiple-choice questions: Q2 and Q8. The options for Q2 were: stress level, workload, performance, concentration level, recovery, ergonomics, and heart rate/heart rate variability; and for Q8: A sports watch, an air quality sensor, a sound level sensor, a motion detector, a video camera, a pressure-sensitive chair, a keyboard, a mouse-usage tracker, a computer-usage tracker, and smartphone-usage tracker. In addition, the survey contained an open field for comments.

2.3. Statistical Analysis

Preliminary statistical analyses were conducted with SPSS Statistics 26 software. For advanced SEM analyses, the Mplus Version 8.4 Base Program was used. SEM is a statistical technique that can test and estimate the reliability and validity of theoretical constructs and their inferential relationships [48]. Thus, we chose SEM for explanatory purposes in this study. The estimates were calculated using the maximum likelihood method, based on a covariance matrix. The empirical modeling inputs were designed and selected based on their feasibility regarding unobtrusiveness (embedded and not noticeable); thus, the question of interest in using video cameras was not applied in the empirical model. In the next section, the proposed constructs and their relationships are empirically tested in the knowledge work context, and the operational measures of theoretical constructs are validated.

3. Results

3.1. Dataset Statistics

The conducted survey obtained a total of 181 responses from European knowledge workers living in 12 different counties. Table 1 presents all the survey questions and descriptive statistics including the mean and standard deviation (SD) of the four-point Likert scale responses and Table 2 shows the profile of the survey respondents. The survey data are available as a public dataset via Zenodo.
The Kolmogorov–Smirnov significance level was below 0.05 for all observed study variables (i.e., measures), which means that survey data were non-normal. The difference between the responses in each profile group (i.e., gender, age, knowledge field, and nationality) was compared using Kruskal–Wallis analyses. There were no statistically significant differences (using the criterion of p > 0.05) between responses, and it seems justifiable to conclude that the sample profile did not have a statistically significant effect on this study’s responses.

3.2. Perceptions toward Different Stress Monitoring Methods

To better understand people’s motivations, we asked (Q1) if the respondents were interested in receiving information about their well-being, measured during workdays, and (Q2) what kinds of well-being-related information they would be interested in receiving. Answers to Q1 revealed that the majority (81.8% ± 5.6% at 95% confidence leve*+8l) of the respondents (n = 181) were very interested or interested in receiving well-being related information. Less than a fifth of the respondents (18.2% ± 5.6%) stated that they were not that interested or not at all interested in receiving such information.
Regarding Q2, most of the respondents were interested in receiving information regarding their stress (75.1% ± 6.3% of the respondents were interested) or concentration (66.9% of the respondents were interested). Roughly 50 % (±7.3%) of the respondents were willing to know about their performance and ergonomics. Information about recovery/coping and workload were interesting topics for around 45 % (±7.3%) of the respondents. Heart rate or heart rate variability was found to be interesting among 39.8 % (±7.1%) of the respondents. A minority (2.7% ± 2.4%) were interested in another type of well-being information, but they did not specify it in more detail. Figure 2 illustrates the survey responses regarding the interesting well-being information types.
According to the answers to Q3–Q5, the respondents were most interested in using air quality sensors (mean = 3.47, SD = 0.66) or wearables (mean = 3.46, SD = 0.66) to monitor their stress level during workdays. Sound level sensors, a pressure-sensitive chair, a keyboard- or mouse-usage tracker and motion detectors, a computer-usage tracker, and a smartphone-usage tracker were also considered as interesting options. The respondents were most reluctant to use a video camera (mean = 1.95, SD = 0.85) for stress monitoring. Table 1 presents the descriptive statistics.
We were also eager to explore (using Q8) which stress monitoring methods were the most privacy sensitive (from the knowledge workers’ perspective) when used in the work context. A video camera was voted as the most privacy sensitive (i.e., intrusive method), gaining 82.3% ± 5.6% of the votes. Roughly 70 % (±6.7%) of the respondents also considered smartphone-usage and computer-usage trackers as privacy sensitive, whereas about 30 % (±6.8%) rated sports watches and mouse-usage trackers as privacy sensitive. The least sensitive methods were air quality sensors, a pressure-sensitive chair, a sound level sensor, and a motion detector. Figure 3 illustrates the response distribution between the different stress monitoring methods.

3.3. Modeling

We tested the research model for the knowledge workers’ interest in sharing their stress-indicative data in the work context with SEM. The empirical model projected an almost acceptable statistical fit (see Table 3). A root mean square error of approximation (RMSEA) value below 0.08 represents the good fit of the model [49], and Tucker–Lewis index (TLI) and comparative fit index (CFI) values above 0.90 indicate an acceptable fit between the hypothesized model and the observed data [50]. Moreover, a standardized root mean squared residual (SRMR) value below 0.08 supports the model’s good statistical fit [51]. However, the p-value of the χ2 test might not support the model fit, and the model contains some statistically insignificant constructs (see the Appendix A, Figure A1, for the empirical model). Furthermore, construct reliability (CR) should be 0.70 or greater, and the reliability value for average variance extraction (AVE) should be 0.50 or greater [52]. Thus, the empirical model was not valid as such, and we continued the analysis.
To further study the concepts, relationships, and constructs, we carried out the empirical analysis in an exploratory manner with the Mplus software. We produced an amended model, which is illustrated in Figure 4. In this model, the concern about the use of data demonstrates a negative relationship with the interest to share personal data (H1) and the interest to employ tracking software (H4a), as assumed in the theoretical model. However, there was no relationship between the concern about the use of data and the interest to employ environmental sensors for stress monitoring (H4b), which was not considered in the theoretical model.
The interest in employing tracking software showed a positive relationship with the interest in sharing personal data to improve well-being at the personal, team, and organizational levels (H2). In addition, the empirical data showed a positive relationship between the interest in employing environmental sensors and the interest in employing tracking software. Against our expectation, the interest in employing environmental sensors did not indicate a statistically significant relationship with the interest in sharing personal data (H3). However, the interest in employing environmental sensors had an indirect positive effect on the interest to share personal data, and that effect was mediated by the interest in employing tracking software.
The test statistics of the empirical model are presented in Table 4. The χ2 test showed an acceptable fit of the model, the p-value being 0.04. Similarly, RMSEA below 0.08, CFI and TLI above 0.90, and SRMR below 0.08 indicated a good fit for the model. Thus, based on these test values, the amended model was acceptable. Moreover, we evaluated each latent variable individually (see Table 4). The validity of the measures can be extrapolated from factor loadings [53], which are acceptable for the latent variables SHA, TRA, and ENV. However, in the amended model, CON had only two measures impairing the usability of its CR and AVE values. The weakness of these values can be explained by the fact that CON did not have the suggested three or more measures as well as by the somewhat high error terms. Nonetheless, a Cronbach’s alpha of 0.7 or higher supports the validity of CON’s measures.

4. Discussion

Managing stress is a critical aspect of the sustainable work–life well-being of individual employees, organizations, and society. Despite the amount of research on stress detection based on multimodal sensor data (e.g., [10,33]), the employees’ perceptions of employing unobtrusive stress monitoring and sharing personal data for well-being improvements in the work context are still not well established in the engineering discipline. The purpose of this study was to promote a sustainable work culture by adopting novel sensing technologies. In particular, the deployment of a data-driven approach to assessing stress and building up a supportive work environment calls for employee acceptance.
As a response to whether people would accept stress detection, the survey results revealed that the knowledge workers were highly interested in using unobtrusive stress monitoring technologies to monitor their stress levels during workdays. The different stress monitoring methods including environmental sensors, tracking software, and more obtrusive wearables were all ranked as attractive options. The high interest in wearables may be due to respondents having previous experience with wearables [11]. However, wearables require usage diligence from the user (e.g., charging and wearing) and some users consider them obtrusive; hence, a stress detection approach using sensors embedded in the environment may work better in the long-term. For instance, some respondents commented that “using in-office sensors for stress monitoring is ok because sensors do not require actions from the user.” Moreover, the overall level of interest in using the resulting well-being information was high (81.8% ± 5.6%); the most interesting topics were the stress level (75.1% ± 5.6% of the respondents) and concentration level (66.9% ± 6.9% of the respondents).
Regarding the question about the monitoring technologies’ privacy sensitivity, the respondents were most unwilling to use video camera data for stress monitoring, which is congruent with the evaluation results of Carneiro et al. [33]. For instance, several respondents commented that they were suspicious and felt insecure about using video camera data. Moreover, video cameras, smartphones, and computer-usage data-based monitoring methods were considered privacy threatening. This ranking is understandable because video stream, smartphone, and computer-usage data may expose the employees’ private and sensitive information, causing negative consequences. Instead, using environmental sensors such as air quality, sound level, and motion sensors may overcome privacy issues.
Concerning sharing personal stress information for the exchange to added benefits, we developed a theoretical model and tested it empirically. Although scholars have studied technology acceptance and employees’ willingness to use wearables at work (e.g., [11,13,44]), to the best of our knowledge, no one has investigated the interest of knowledge workers in sharing behavioral data that is indicative of stress in order to sustain well-being at work. Therefore, providing a workable second-order construct of the knowledge workers’ interest in sharing personal data in order to sustain well-being advances the literature on the behavioral intentions related to data sharing in work, well-being, and health contexts. The empirical analysis resulted in a statistically valid amended model, which is depicted in Figure 4. In addition, we validated the operational measures of the theoretical constructs. Based on the empirical model, people seemed most willing to share personal stress data when applied for health research and personal interventions. Those who had a more positive attitude toward employing usage pattern-based stress detection were also more willing to share their stress-indicative data.
Overall, the results confirmed the feasibility of a continuous and unobtrusive stress monitoring approach in a knowledge work context. Interestingly, based on the analysis results, privacy concerns did not affect the knowledge workers’ interest in using environmental sensors such as air quality, motion, and sound level sensors, indicating that environmental sensors are less intrusive and thus more acceptable when assessing work-related stress. This finding is significant and can partly solve the privacy issues related to continuous stress monitoring and personal data sharing. On the other hand, privacy concerns related to employing more privacy-sensitive methods such as tracking software for stress monitoring did not prevent data sharing intentions. However, our study confirms that privacy is an essential element when using employees’ well-being data in the work context, as pointed out earlier (e.g., [18]).
The General Data Protection Regulation (GDPR) governs the rights of EU citizens to data protection and personal-data processing confidentiality. Since the invocation of sensors and cloud-based data analytics is growing, it is crucial to investigate the GDPR directive regarding the design and implementation of data-driven solutions in order to minimize conflicts between GDPR and the deployment of sensors and tracking software-based well-being monitoring [54]. Nevertheless, despite privacy concerns, particularly regarding keyboard-, mouse- and smartphone-usage data, people are still willing to adopt the proposed technologies. This would imply that the associated benefit is considered significant enough to override the concerns.
Although this study provided theoretical and practical contributions, there are some limitations. The empirical data consisted of 181 responses among European knowledge-intensive organizations, where 89.9 % of the respondents were from Finland and Spain and only 10.1 % were from other countries. Thus, future work should include further empirical model coverage and a broader nationality scope, although gender, age, and nationality did not influence the observed variables in this study. Moreover, the resultant empirical model that examined the causal relations was a simplification of a specific view of the world and could be extended to cover other influencing factors at individual and organizational levels. Nevertheless, even in a simple form, the resultant model provides useful information for work-related well-being service designers to adopt.

5. Conclusions

The workforce’s mental health has become an increasing problem worldwide because of stress, depression, and anxiety. Particularly in knowledge-intensive work, employees’ mental health has emerged as a strategic priority in order to maintain workforce sustainability. Thus, new solutions that aim to mitigate stress-related risk factors and sustain work well-being at individual, team, and organizational levels are necessary. Accordingly, the goal of this study was to provide insights into how knowledge workers perceive different stress-detection technologies and personal data sharing in the work context.
This study has some considerable contributions to highlight. Theoretically, the study extends the related literature by proving a second-order construct of the knowledge workers’ interest in sharing personal data in order to improve well-being in the work context. The model was tested empirically using SEM and data collected from European knowledge-intensive organizations, which produced the statically valid amended model. Moreover, the operational measures for the theoretical constructs were validated. The quantitative analysis results revealed that privacy concerns did not apply to the willingness to use environmental sensors such as air quality, sound level, and motion sensors. On the other hand, the concerns about more privacy-sensitive stress detection methods did not prevent user acceptance nor intent to share data.
Moreover, the study showed that knowledge workers in Europe are eager to receive well-being-related information, especially regarding their stress and concentration levels. The respondents were also highly interested in using stress monitoring technologies such as environmental sensors, pressure-sensitive chairs, and keyboard- or mouse-usage trackers. Therefore, our study confirmed that employing a continuous and unobtrusive stress monitoring approach in a knowledge work context is feasible.
The future goal of personal-stress data sharing in a workplace context is to develop a secure and privacy-safe organizational barometer that aggregates employees’ data anonymously and provides employees with the means to make their discomfort visible to managers. In line with the United Nations’ Sustainable Development Goals, the ultimate aim is to better support employee health and facilitate both an empathic workplace culture and psychological safety in demanding knowledge-intensive work.

Author Contributions

Conceptualization, J.K. (Johanna Kallio), E.V., J.K. (Julia Kantorovitch), A.K., and M.B.L.; Methodology, J.K. (Johanna Kallio); Formal analysis, J.K. (Johanna Kallio); Writing—original draft, J.K. (Johanna Kallio); Writing—review and editing, J.K. (Johanna Kallio), E.V., J.K. (Julia Kantorovitch), A.K., and M.B.L.; Visualization, J.K. (Johanna Kallio); Supervision, M.B.L.; Project administration, A.K.; Funding acquisition, J.K. (Johanna Kallio), E.V., J.K. (Julia Kantorovitch), and A.K. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by Business Finland under ITEA 18033 Mad@Work, grant number 2991/31/2019.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Institutional Review Board of VTT Technical Research Center of Finland Ltd. (date of approval 5 December 2019).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are openly available via Zenodo at doi: 10.5281/zenodo.4457393.

Acknowledgments

We are thankful to all the survey respondents for their significant role in the study. We are grateful to Mari Juntunen and Jouni Juntunen for their comprehensive guidance on the theoretical background and quantitative analysis methods. We acknowledge our partners in collaboration and colleagues for sharing the questionnaire link in their networks. Aside from the above, we wish to thank Satu-Marja Mäkelä, Juha Häikiö, Panu Korpipää, and Marianne Kinnula for their helpful discussions.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Figure A1. The initial empirical model.
Figure A1. The initial empirical model.
Sustainability 13 02003 g0a1

References

  1. CEDEFOP. Jobs in Europe to Become More Knowledge and Skills-Intensive. 2010. Available online: https://op.europa.eu/en/publication-detail/-/publication/790089d6-fe6d-42ab-8d71-e3b60c5b56e3 (accessed on 4 February 2021).
  2. Bosch-Sijtsema, P.M.; Ruohomäki, V.; Vartiainen, M. Knowledge work productivity in distributed teams. J. Knowl. Manag. 2009, 13, 533–546. [Google Scholar] [CrossRef]
  3. EU-OSHA. Calculating the Cost of Work-Related Stress and Psychosocial Risks. 2014. Available online: https://www.healthy-workplaces.eu/es/tools-and-resources/publications (accessed on 4 February 2021).
  4. ILO. Workplace Stress: A collective challenge. 2016. Available online: https://www.ilo.org/global/topics/safety-and-health-at-work/resources-library/publications/WCMS_466547/lang--en/index.htm%0A (accessed on 4 February 2021).
  5. McEwen, B.S. Stress, adaptation, and disease allostasis and allostatic load. Ann. N. Y. Acad. Sci. 1998, 840, 33–44. [Google Scholar] [CrossRef] [PubMed]
  6. United Nations. Sustainable Development Goals. Available online: https://sdgs.un.org/goals (accessed on 4 February 2021).
  7. Deloitte. The Rise of the Social Enterprise: 2018 Deloitte Global Human Capital Trends. Hum. Cond. 2018, 104. Available online: https://www2.deloitte.com/content/dam/Deloitte/at/Documents/human-capital/at-deloitte-insights-the-rise-of-the-social-enterprise.pdf (accessed on 4 February 2021).
  8. Stewart, T.A. The Wealth of Knowledge: Intellectual Capital in the Twenty-Firs Century Organization. Harv. Bus. Rev. 2002, 80, 28. [Google Scholar]
  9. Aura, O.; Ahonen, G.; Ilmarinen, J. Strategic wellness management in Finland: The first national survey of the management of employee well-being. J. Occup. Environ. Med. 2010, 52, 1249–1254. [Google Scholar] [CrossRef]
  10. Alberdi, A.; Aztiria, A.; Basarab, A. Towards an automatic early stress recognition system for office environments based on multimodal measurements: A review. J. Biomed. Inform. 2016, 59, 49–75. [Google Scholar] [CrossRef] [PubMed]
  11. Jacobs, J.V.; Hettinger, L.J.; Huang, Y.-H.; Jeffries, S.; Lesch, M.F.; Simmons, L.A.; Verma, S.K.; Willetts, J.L. Employee acceptance of wearable technology in the workplace. Appl. Ergon. 2019, 78, 148–156. [Google Scholar] [CrossRef] [PubMed]
  12. Son, H.; Park, Y.; Kim, C.; Chou, J.-S. Toward an understanding of construction professionals’ acceptance of mobile computing devices in South Korea: An extension of the technology acceptance model. Autom. Constr. 2012, 28, 82–90. [Google Scholar] [CrossRef]
  13. Choi, B.; Hwang, S.; Lee, S. What drives construction workers’ acceptance of wearable technologies in the workplace? Indoor localization and wearable health devices for occupational safety and health. Autom. Constr. 2017, 84, 31–41. [Google Scholar] [CrossRef]
  14. Lovallo, W.R. Stress and Health: Biological and Psychological Interactions; SAGE Publications Inc.: Thousand Oaks, CA, USA, 2015. [Google Scholar]
  15. Zimmermann, P.; Guttormsen, S.; Danuser, B.; Gomez, P. Affective Computing—A Rationale for Measuring Mood With Mouse and Keyboard. Int. J. Occup. Saf. Ergon. 2003, 9, 539–551. [Google Scholar] [CrossRef]
  16. Siegrist, J.; Wege, N.; Pühlhofer, F.; Wahrendorf, M. A short generic measure of work stress in the era of globalization: Effort–reward imbalance. Int. Arch. Occup. Environ. Heal. 2009, 82, 1005–1013. [Google Scholar] [CrossRef]
  17. Sysoev, M.; Kos, A.; Pogačnik, M. Noninvasive stress recognition considering the current activity. Pers. Ubiquitous Comput. 2015, 19, 1045–1052. [Google Scholar] [CrossRef] [Green Version]
  18. Gao, Y.; Li, H.; Luo, Y. An empirical study of wearable technology acceptance in healthcare. Ind. Manag. Data Syst. 2015, 115, 1704–1723. [Google Scholar] [CrossRef]
  19. Plarre, K.; Raij, A.; Hossain, S.M.; Ali, A.A.; Nakajima, M.; Al’absi, M.; Ertin, E.; Kamarck, T.; Kumar, S.; Scott, M.; et al. Continuous inference of psychological stress from sensory measurements collected in the natural environment. In Proceedings of the 10th ACM/IEEE International Conference on Information Processing in Sensor Networks, IPSN’11, Chicago, IL, USA, 12–14 April 2011; pp. 97–108. [Google Scholar]
  20. Vildjiounaite, E.; Kallio, J.; Kantorovitch, J.; Kyllönen, V.; Räsänen, P.; Ronkainen, J. Towards Social Enterprise with Internet of Office Desks. In Human-Centric Computing in a Data-Driven Society; Springer International Publishing: Cham, Switzerland, 2020; pp. 361–374. [Google Scholar]
  21. Gunawardhane, S.D.W.; de Silva, P.M.; Kulathunga, D.S.B.; Arunatileka, S.M.K.D. Non invasive human stress detection using key stroke dynamics and pattern variations. In Proceedings of the International Conference on Advances in ICT for Emerging Regions, Colombo, Sri Lanka, 12–13 December 2013; pp. 240–247. [Google Scholar] [CrossRef]
  22. Hernandez, J.; Paredes, P.; Roseway, A.; Czerwinski, M. Under pressure: Sensing stress of computer users. In Proceedings of the 32nd annual ACM conference on Human factors in computing systems, Toronto, ON, Canada, 26 Apri–1 May 2014; pp. 51–60. [Google Scholar] [CrossRef]
  23. Eijckelhof, B.H.; Huysmans, M.A.; Blatter, B.M.; Leider, P.C.; Johnson, P.W.; Van Dieën, J.H.; Dennerlein, J.T.; Van Der Beek, A.J. Office workers’ computer use patterns are associated with workplace stressors. Appl. Ergon. 2014, 45, 1660–1667. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  24. Rodrigues, M.; Gonçalves, S.; Carneiro, D.; Novais, P.; Fdez-Riverola, F. Keystrokes and clicks: Measuring stress on E-learning students. In Advances in Intelligent Systems and Computing; Springer International Publishing: Cham, Switzerland, 2013; Volume 220, pp. 119–126. [Google Scholar] [CrossRef] [Green Version]
  25. Kolakowska, A. Towards detecting programmers’ stress on the basis of keystroke dynamics. In Proceedings of the 2016 Federated Conference on Computer Science and Information Systems, FedCSIS, Gdansk, Poland, 11–14 September 2016; pp. 1621–1626. [Google Scholar] [CrossRef] [Green Version]
  26. Bogomolov, A.; Lepri, B.; Ferron, M.; Pianesi, F.; Pentland, A.S. Pervasive stress recognition for sustainable living. In Proceedings of the Third IEEE International Workshop on Social Implications of Pervasive Computing, Budapest, Hungary, 24–28 March 2014; pp. 345–350. [Google Scholar] [CrossRef]
  27. Garcia-Ceja, E.; Osmani, V.; Mayora, O. Automatic Stress Detection in Working Environments From Smartphones’ Accelerometer Data: A First Step. IEEE J. Biomed. Heal. Inform. 2016, 20, 1053–1060. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  28. Gjoreski, M.; Gjoreski, H.; Lutrek, M.; Gams, M. Automatic Detection of Perceived Stress in Campus Students Using Smartphones. In Proceedings of the 2015 International Conference on Intelligent Environments, Prague, Czech Republic, 15–17 July 2015; pp. 132–135. [Google Scholar] [CrossRef]
  29. Maxhuni, A.; Hernandez-Leal, P.; Sucar, L.E.; Osmani, V.; Morales, E.F.; Mayora, O. Stress modelling and prediction in presence of scarce data. J. Biomed. Inform. 2016, 63, 344–356. [Google Scholar] [CrossRef]
  30. Ciman, M.; Wac, K. Individuals’ Stress Assessment Using Human-Smartphone Interaction Analysis. IEEE Trans. Affect. Comput. 2018, 9, 51–65. [Google Scholar] [CrossRef]
  31. Sano, A.; Picard, R.W. Stress Recognition Using Wearable Sensors and Mobile Phones. In Proceedings of the 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction, Geneva, Switzerland, 2–9 September 2013; pp. 671–676. [Google Scholar] [CrossRef]
  32. Tervonen, J.; Puttonen, S.; Sillanpää, M.J.; Hopsu, L.; Homorodi, Z.; Keränen, J.; Pajukanta, J.; Tolonen, A.; Lämsä, A.; Mäntyjärvi, J. Personalized mental stress detection with self-organizing map: From laboratory to the field. Comput. Biol. Med. 2020, 124, 103935. [Google Scholar] [CrossRef]
  33. Carneiro, D.; Novais, P.; Augusto, J.C.; Payne, N. New Methods for Stress Assessment and Monitoring at the Workplace. IEEE Trans. Affect. Comput. 2017, 10, 237–254. [Google Scholar] [CrossRef] [Green Version]
  34. Aigrain, J.; Dubuisson, S.; Detyniecki, M.; Chetouani, M. Person-specific behavioural features for automatic stress detection. In Proceedings of the 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG), Ljubljana, Slovenia, 4–8 May 2015. [Google Scholar] [CrossRef] [Green Version]
  35. Vildjiounaite, E.; Huotari, V.; Kallio, J.; Kyllönen, V.; Mäkelä, S.-M.; Gimel’Farb, G. Unobtrusive assessment of stress of office workers via analysis of their motion trajectories. Pervasive Mob. Comput. 2019, 58, 101028. [Google Scholar] [CrossRef]
  36. Arnrich, B.; Setz, C.; La Marca, R.; Tröster, G.; Ehlert, U. What Does Your Chair Know About Your Stress Level? IEEE Trans. Inf. Technol. Biomed. 2010, 14, 207–214. [Google Scholar] [CrossRef]
  37. Kallio, J.; Vildjiounaite, E.; Koivusaari, J.; Räsänen, P.; Similä, H.; Kyllönen, V.; Muuraiskangas, S.; Ronkainen, J.; Rehu, J.; Vehmas, K. Assessment of perceived indoor environmental quality, stress and productivity based on environmental sensor data and personality categorization. Build. Environ. 2020, 175, 106787. [Google Scholar] [CrossRef]
  38. Eason, K. Afterword: The past, present and future of sociotechnical systems theory. Appl. Ergon. 2014, 45, 213–220. [Google Scholar] [CrossRef]
  39. Ajzen, I. The theory of planned behavior. Organ. Behav. Hum. Decis. Process. 1991, 50, 179–211. [Google Scholar] [CrossRef]
  40. Kim, Y.; Stanton, J.M. Institutional and individual factors affecting scientists’ data-sharing behaviors: A multilevel analysis. J. Assoc. Inf. Sci. Technol. 2015, 67, 776–799. [Google Scholar] [CrossRef] [Green Version]
  41. Davis, F.D.; Bagozzi, R.P.; Warshaw, P.R. User Acceptance of Computer Technology: A Comparison of Two Theoretical Models. Manag. Sci. 1989, 35, 982–1003. [Google Scholar] [CrossRef] [Green Version]
  42. Venkatesh, V.; Morris, M.G.; Davis, G.B.; Davis, F.D. User acceptance of information technology: Toward a unified view. MIS Q. Manag. Inf. Syst. 2003, 27, 425–478. [Google Scholar] [CrossRef] [Green Version]
  43. Williams, M.D.; Rana, N.P.; Dwivedi, Y.K. The unified theory of acceptance and use of technology (UTAUT): A literature review. J. Enterp. Inf. Manag. 2015, 28, 443–488. [Google Scholar] [CrossRef] [Green Version]
  44. Kim, K.J.; Shin, D.-H. An acceptance model for smart watches. Internet Res. 2015, 25, 527–541. [Google Scholar] [CrossRef]
  45. Dinev, T.; Hart, P. Internet privacy concerns and their antecedents measurement validity and a regression model. Behav. Inf. Technol. 2004, 23, 413–422. [Google Scholar] [CrossRef]
  46. Schall, J.M.C.; Sesek, R.F.; Cavuoto, L.A. Barriers to the Adoption of Wearable Sensors in the Workplace: A Survey of Occupational Safety and Health Professionals. Hum. Factors: J. Hum. Factors Ergon. Soc. 2018, 60, 351–362. [Google Scholar] [CrossRef]
  47. Bagozzi, R.P. University of Michigan The Legacy of the Technology Acceptance Model and a Proposal for a Paradigm Shift. J. Assoc. Inf. Syst. 2007, 8, 244–254. [Google Scholar] [CrossRef]
  48. Rajalahti, T.; Kvalheim, O.M. Multivariate data analysis in pharmaceutics: A tutorial review. Int. J. Pharm. 2011, 417, 280–290. [Google Scholar] [CrossRef] [PubMed]
  49. Browne, M.W.; Cudeck, R. Alternative Ways of Assessing Model Fit. Sociol. Methods Res. 1992, 21, 230–258. [Google Scholar] [CrossRef]
  50. Hu, L.; Bentler, P.M. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Struct. Equ. Model. A Multidiscip. J. 1999, 6, 1–55. [Google Scholar] [CrossRef]
  51. Bagozzi, R.P.; Yi, Y. Specification, evaluation, and interpretation of structural equation models. J. Acad. Mark. Sci. 2012, 40, 8–34. [Google Scholar] [CrossRef]
  52. Garver, M.S.; Mentzer, J.T. Logistics Research Methods: Employing Structural Equation Modeling To Test for Construct Validity. J. Bus. Logist. 2018, 20, 33–57. [Google Scholar] [CrossRef]
  53. McDonald, R.P.; Bollen, K.A. Structural Equations with Latent Variables. J. Am. Stat. Assoc. 1990, 85, 1175. [Google Scholar] [CrossRef] [Green Version]
  54. Wachter, S. Normative challenges of identification in the Internet of Things: Privacy, profiling, discrimination, and the GDPR. Comput. Law Secur. Rev. 2018, 34, 436–449. [Google Scholar] [CrossRef]
Figure 1. The concepts and hypotheses of the study.
Figure 1. The concepts and hypotheses of the study.
Sustainability 13 02003 g001
Figure 2. Knowledge workers’ interest toward different well-being information with a confidence interval at the 95% confidence level.
Figure 2. Knowledge workers’ interest toward different well-being information with a confidence interval at the 95% confidence level.
Sustainability 13 02003 g002
Figure 3. Perceptions of the most privacy-sensitive stress monitoring methods with a confidence interval at the 95% confidence level.
Figure 3. Perceptions of the most privacy-sensitive stress monitoring methods with a confidence interval at the 95% confidence level.
Sustainability 13 02003 g003
Figure 4. The amended empirical model.
Figure 4. The amended empirical model.
Sustainability 13 02003 g004
Table 1. Constructs, their operational measures, and descriptive statistics.
Table 1. Constructs, their operational measures, and descriptive statistics.
ConstructOperational Measure in the QuestionnaireMeanSD
Q1. How interested would you be in receiving information about your well-being, measured with sensors during the working day, if the information is only in your use?3.120.78
Q2. What kind of measurable information related to your well-being and coping at work would you be interested in receiving?--
Q3. How interested would you be to employ a sports watch or other wearables in order to monitor your stress level during the workday if the data are only in your use? 3.460.62
ENVQ4. How interested would you be to employ the following sensors embedded in the work environment in order to monitor your stress level during the workday if the data are only in your use?
E1Air quality sensors 3.470.66
E2Sound level sensors3.300.81
E3Motion detectors3.050.81
E4A pressure-sensitive chair3.200.74
A video camera 11.950.85
TRAQ5. How interested would you be to employ software that tracks your way of using the following device to monitor your stress level during the workday if the data are only in your use?
T1A keyboard- or mouse-usage tracker3.150.89
T2A computer-usage tracker2.980.93
T3A smartphone-usage tracker2.870.95
SHAQ6. I would be interested in confidentially sharing data collected from myself during the workdays with related well-being service providers:
S1if the data would be used to help in identifying my personal health risks.3.150.88
S2if the data could be used to improve my own and my colleagues’ well-being and coping at work.2.960.85
S3if the data could be used to improve my organization’s work culture and leadership in a direction that supports well-being and coping at work.2.880.96
S4if the data would only be used for non-commercial scientific purposes.3.130.87
CONQ7. If your stress was monitored while you were working, how concerned would you be about the following things?
C1My employer, supervisor, or co-workers could use the data collected against me.2.740.86
C2My employer could get private or sensitive information about me.3.040.81
C3Someone who is not supposed to see my data could get access to my personal data.3.220.75
Q8. What do you consider to be the most privacy-sensitive stress monitoring methods?
1 Not applied in the empirical model because video camera was classified as obtrusive.
Table 2. Demographics of the survey respondents.
Table 2. Demographics of the survey respondents.
Profile CategoryPercentage
Gender
Female43.6
Male56.4
Age
20–24 years old1.7
25–34 years old25.4
35–44 years old42.0
45–54 years old20.4
55 or more years old10.5
Country of residence
Finland63.5
Spain26.4
Germany2.2
Other (including Canada, Italy, Mexico, the Netherlands, Norway, Luxemburg, Sweden, Switzerland, and the USA) 1 7.9
Knowledge field
Information and communication technology42.9
Engineering, manufacturing, and construction28.6
Natural sciences and mathematics10.7
Business, administration, and law 5.4
Health and welfare5.4
Education2.4
Services2.4
Other fields2.2
Work position
Specialist69.1
Manager17.1
Entrepreneur, self-employed 4.4
Assistant3.9
Other5.5
1 For these counties of residence with less than five responses, only the total percentage is reported due to privacy reasons.
Table 3. The test statistics of the initial empirical model.
Table 3. The test statistics of the initial empirical model.
Initial Empirical Model’s FitConstruct Reliabilities for Latent Variables
Chi-square129.63
(df. 71, p = 0.000)
SHACONTRAENV
RMSEA0.066AVE0.640.280.420.45
CFI0.928CR0.860.620.770.75
TLI0.908Cronbach’s
alpha
0.870.770.890.76
SRMR0.062
Table 4. The test statistics of the amended empirical model.
Table 4. The test statistics of the amended empirical model.
Amended Empirical Model’s FitConstruct Reliabilities for Latent Variables
Chi-square55.558
(df. 39, p = 0.04)
SHACONTRAENV
RMSEA0.048AVE0.640.330.590.52
CFI0.965CR0.870.500.780.76
TLI0.950Cronbach’s
alpha
0.870.840.740.76
SRMR0.057
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Kallio, J.; Vildjiounaite, E.; Kantorovitch, J.; Kinnula, A.; Bordallo López, M. Unobtrusive Continuous Stress Detection in Knowledge Work—Statistical Analysis on User Acceptance. Sustainability 2021, 13, 2003. https://doi.org/10.3390/su13042003

AMA Style

Kallio J, Vildjiounaite E, Kantorovitch J, Kinnula A, Bordallo López M. Unobtrusive Continuous Stress Detection in Knowledge Work—Statistical Analysis on User Acceptance. Sustainability. 2021; 13(4):2003. https://doi.org/10.3390/su13042003

Chicago/Turabian Style

Kallio, Johanna, Elena Vildjiounaite, Julia Kantorovitch, Atte Kinnula, and Miguel Bordallo López. 2021. "Unobtrusive Continuous Stress Detection in Knowledge Work—Statistical Analysis on User Acceptance" Sustainability 13, no. 4: 2003. https://doi.org/10.3390/su13042003

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop