Next Article in Journal
Engaging Youth and Young Adults in the COVID-19 Pandemic Response via the “It’s Our Turn” Crowdsourcing Contest
Previous Article in Journal
Oxidative Potential Characterization of Different PM2.5 Sources and Components in Beijing and the Surrounding Region
Previous Article in Special Issue
Academic Burnout of Polish Students: A Latent Profile Analysis
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
IJERPH
Volume 20
Issue 6
10.3390/ijerph20065111
ijerph-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

The Relationships of Human-Cobot Interaction Fluency with Job Performance and Job Satisfaction among Cobot Operators—The Moderating Role of Workload

by
Mateusz Paliga
Institute of Psychology, Faculty of Social Sciences, University of Silesia in Katowice, 40-007 Katowice, Poland
Int. J. Environ. Res. Public Health 2023, 20(6), 5111; https://doi.org/10.3390/ijerph20065111
Submission received: 13 February 2023 / Revised: 7 March 2023 / Accepted: 12 March 2023 / Published: 14 March 2023
(This article belongs to the Special Issue Well-Being and Mental Health of Employees)
Browse Figures
Versions Notes

Abstract

:
Modern factories are subject to rapid technological changes, including the advancement of robotics. A key manufacturing solution in the fourth industrial revolution is the introduction of collaborative robots (cobots), which cooperate directly with human operators while executing shared tasks. Although collaborative robotics has tangible benefits, cobots pose several challenges to human-robot interaction. Proximity, unpredictable robot behavior, and switching the operator’s role from a co-operant to a supervisor can negatively affect the operator’s cognitive, emotional, and behavioral responses, resulting in their lower well-being and decreased job performance. Therefore, proper actions are necessary to improve the interaction between the robot and its human counterpart. Specifically, exploring the concept of human-robot interaction (HRI) fluency shows promising perspectives. However, research on conditions affecting the relationships between HRI fluency and its outcomes is still in its infancy. Therefore, the aim of this cross-sectional survey study was twofold. First, the relationships of HRI fluency with job performance (i.e., task performance, organizational citizenship behavior, and creative performance) and job satisfaction were investigated. Second, the moderating role of the quantitative workload in these associations was verified. The analyses carried out on data from 200 male and female cobot operators working on the shop floor showed positive relationships between HRI fluency, job performance, and job satisfaction. Moreover, the study confirmed the moderating role of the quantitative workload in these relations. The results showed that the higher the workload, the lower the relationships between HRI fluency and its outcomes. The study findings are discussed within the theoretical framework of the Job Demands-Control-Support model.

1. Introduction

Contemporary manufacturing industry is subject to an evolution in which the interaction between humans and technology is fundamental. The emergence of advanced human-robot interaction (HRI) has modified the performance of tasks [1] to boost system productivity and efficiency [2]. Importantly, because workers play a strategic role in manufacturing activities [3], their abilities and skills are enhanced rather than replaced by robotic technology [4,5] in human-centric automation [6]. In order to empower operators, enabling technologies are implemented in the industry, among which are collaborative robots [7].
Collaborative robots (cobots) are designed for mutual and direct interaction with humans [8]. Because they are equipped with safety assurance mechanisms [9], cobots assist operators by delivering and handling objects [10] in a fenceless and confinement-free environment. Direct human-robot interaction aims at incorporating the unique advantages of humans [11] and collaborative robots [12] by combining the skills and abilities of both parties to achieve a common goal [13] in a temporospatial overlap [14]. Cobots take on strenuous and repetitive tasks [15,16] by providing stamina and strength [17] while human operators are responsible for handling unexpected events [11] due to their resources of flexibility and cognitive and soft skills [7]. Hence, human-cobot interaction results in a synergic combination of the capabilities of humans and their robotic counterparts [18].
Integrating cobots in manufacturing processes is viewed as significantly beneficial. Due to the increased job attractiveness through the means of human-robot interaction, organizations deploying collaborative robots can offset the shortage in the industry workforce and guarantee jobs at a certain site without the necessity to move the production elsewhere [19]. For operators, automated robotic systems can help prevent adverse health effects [16] during work in unsafe environments [20]. Generally, the surge of interest in collaborative robots stems from the fact that they are seen as technological solutions for improving performance [1,7,21]. More than that, however, scholars and practitioners suggest that cobots enhance operators’ well-being [1,22].
In the ongoing studies on the positive consequences of cobot implementation, researchers advocate for the need to consider human factors, as they are requisite conditions for human-robot interaction to be fruitful. Focusing on factors such as perceived safety, trust, anxiety, mental strain, stress [11,15,23], or robot acceptance [12] can help understand what makes operators feel comfortable and efficient [24,25]. Contrarily, the omission of these elements can result in operators’ frustration [7,24,26] and failure of human-robot system performance [14]. Hence, the first aim of this research is to verify the relationships of cognitive, emotional, and behavioral aspects of fluency in human-robot interaction with job performance (i.e., task performance, organizational citizenship behavior, and creative performance) and job satisfaction. Based on the literature search and to the author’s best knowledge, such an aim has not yet been realized in the empirical studies among cobot operators. The assumption behind this aim is that successful HRI is affected by humans’ cognitive and emotional processes [13] as well as behavior [27]. Therefore, subjectively perceived fluency in human-robot interaction can be an important factor for operators’ performance and attitudes during collaboration with a cobot.
The second aim of this study is the exploration of quantitative workload as a moderator in the relationships of HRI fluency with job performance and job satisfaction. The impetus for such exploration is the general notion that the direction and magnitude of the effects of robot deployment on operators are theoretically ambiguous and need further empirical verification [16]. Specifically, although the research on the positive impact of cobots on workers’ experiences has been prolific, the assumption that collaborative technology is exclusively advantageous would be biased. Although many studies suggest that cobots support humans in terms of physical and mental load [1,9,10,18], there are other empirical investigations showing that cobots increase workload [7,9,10,15,28]. The conflicting pattern of findings indicates that there is still a need to explore workload [22,24] as an essential individual factor in human-robot interaction [9]. In fact, the evaluation of workload in human-machine interaction is a crucial point when investigating satisfaction and performance [29], which is the general aim of the presented research.
The remainder of the paper unfolds as follows. Section 2 presents the theoretical background regarding human-robot interaction fluency, job performance, job satisfaction, and workload. Section 3 describes the current study aims, hypotheses, and their rationale. Next, the pool of participants and used measures are characterized in Section 4, followed by the description of statistical analyses in Section 5. Finally, in Section 6, the discussion of obtained results is presented with the identification of the strengths and limitations of the study. The paper ends with a concise conclusion in Section 7.

2. Theoretical Background

2.1. Human–Robot Interaction Fluency

Fluency in human-robot interaction describes a highly coordinated meshing of shared activities between the human and the robot [30]. To achieve fluency, the human and robotic agents must create a well-synchronized and synergic team and perform joint activities [31] at high levels of coordination and adaptation [32,33]. Continuous fluent interaction requires the team members to jointly understand the capabilities of the others [11] and is necessary to efficiently perform shared tasks [15,17] in an intelligent system [34].
Collaborative robots change the working system’s dynamics and increase efficiency [2]. However, bringing a robotic agent into the loop requires a new comprehension of human-robot team effectiveness and fluency as dependent on three sources [35]. The notion of three separate fluency agents, i.e., the operator, the robotic counterpart [32,36,37], and the human-robot team [38] with its fluidity [39] was used by [31], who described a three-dimensional approach to human-robot interaction fluency. The idea was further developed by [40], who described four HRI fluency perspectives: human contribution-oriented, human emotions-oriented, robot-oriented, and team-oriented fluency.
Regarding human contribution-oriented fluency, [4,10] point out that the variability and reliability of human behavior affect human–robot interaction in terms of safety, quality, and productivity. Similarly, [27] claim that the operator supports the technical system and production requirements, and [9] even argue that the human component influences the performance of the human-robot team more than the technological one. In essence, to maintain efficient and fluent HRI, human behavior should be considered [41] and investigated. Therefore, human contribution-oriented fluency reflects the operator’s performance of common tasks with the robot, engagement, and input to the human–robot interaction [40].
The human emotions-oriented fluency is based on the assumption that people interact with robots as they do with co-workers [10] or people [42] rather than tools due to their willingness to apply social characteristics to technology [43]. Precisely, this perspective reflects the cognitive-affective states evoked in humans during collaborating with a robot. Hence, the core of this fluency is the operator’s feelings about the robot’s commitment to the teamwork and his or her cognitive or affective trust toward the robot [31,40]. Trust is a major prerequisite and a crucial challenge to overcome for the success of human–robot teamwork [4,44]. As a human factor [35], it depends on the reliability [11] and predictability of the robotic agent’s performance [17], and the fulfillment of human expectations [45]. When high, trust leads to the operators increasing their reliance on robots and reducing supervision over them [46], but when low, it may encourage robot underutilization and drops in performance [13].
If the robot is to become a factual and co-responsible member of the human-robot team, its performance of joint tasks has to be visible and directable by the human [34]. Based on this, [31] introduced the idea of robot-oriented fluency, which refers to the operator’s perception and evaluation of the robot. While collaborating with the human, the robot realizes its part of the task and completes or corrects the operator [31], mainly through delivering and handling objects [10]. In general, the robotic member supports the effectiveness of the automated system [27] through device primitives and skills [47] to a similar extent that the operator does. This support, evaluated by the operator, is the core of robot-oriented fluency [40].
As noted by [34], the coordination across agents in the human-robot system is as important as their actions considered separately. Therefore, to directly capture team-oriented fluency [30], Paliga and Pollak [31] considered the team level of an automated system committed to fulfilling joint intentions [48] and performing together in a dyad [22] or team [17]. Specifically, effective team structure [11] and coordination [49] are the factors that facilitate fluent human-robot interactions [40]. Hence, team-oriented fluency refers to synchronous or sequential task performance [1] in a temporospatial overlap [14] by two (or more) mutually coordinated team members whose qualities should be utilized according to their advantages [50].

2.2. Job Satisfaction

Job satisfaction is the subjective well-being that workers experience at work [51,52]. Specifically, it is a work attitude that comprises multidimensional psychological responses to one’s job [53] with a cognitive component (knowledge, evaluative judgments, and opinions about the job), an affective component (emotions and feelings about the job), and a behavioral component (individual predispositions and manifestations of employee’s actions related to performed work) [54,55]. The subjective assessment of job satisfaction is typically arrayed along a negative-to-positive continuum [56].
For robot operators, as for other incumbents, the feeling of job satisfaction dissuades them from changing their job [52,57], making it relevant not only for the individuals but also for the stability of the automation-based manufacturing system. When considering the general perspective of job automatability, [58] found that its high level was related to lower job satisfaction; however, this was only when workers assessed their work as uninteresting and meaningless. This suggests that it is not automation of work itself but rather monotonicity and lack of task variety that relate to dissatisfaction. On the other hand, [52] argued that lower job satisfaction might stem from incumbents’ fear of being replaced by machines, which echoes the suggestion of [59] that autonomous technology threatens employees’ job security.
Among studies conducted with the use of a collaborative robot, the research by [23] showed that an autonomously operating cobot induced more adverse psychological and physiological reactions than a manually operated cobot. Such a result resonates with the notion that autonomous robots represent a realistic and symbolic threat to the operators’ well-being [60] and can evoke negative emotional and cognitive reactions by taking away the decision-making prerogative from humans [61]. Therefore, to be satisfied, operators should be able to retain the feeling of self-determination and control in human-robot interaction [19]. Finally, an optimistic premise for cobot deployment is the study by [62], who carried out an experiment on human-cobot collaboration and found that both adult and senior collaborators were highly satisfied with the interaction and accepting of the collaborative robot.

2.3. Job Performance

Many definitions of job performance have been proposed [63]. A widely accepted one was introduced by [64,65], who defined performance in terms of behaviors and actions presented by employees. In other words, performance refers to what employees do in their workstations [66]. However, this behavioral perspective requires several assumptions. First, because performance is a latent construct that cannot be measured directly [67], it is defined by judgmental and evaluative processes [66] referring to employees’ observable [68] and scalable actions in the workplace [63]. Second, not every action manifests as performance, but only behaviors relevant to organizational goals [64]. Finally, behavior that falls within the performance concept differs from its outcomes [65], such as productivity [67] or effectiveness [68] over which the employees might not have control [66]. Taking everything together, job performance can be defined as employees’ observable and scalable behavior, over which they have control and which is linked with and contributes to organizational goals.
Job performance is a multidimensional construct [64,68], with each dimension having indicators that can be measured directly [67]. The present research investigates three dimensions: task performance, organizational citizenship behavior, and creative performance. Task performance refers to workers’ proficiency in performing activities recognized formally as part of their jobs which contribute to the organization’s technical core [69]. Hence, activities subsumed under the task performance concept are described in the formal job description [70,71], and employees commit to fulfilling them when signing the contract [54].
Organizational citizenship behavior (OCB) is individual behavior that is discretionary, not directly or explicitly recognized by the formal reward system, and that promotes the effective functioning of groups [72] and the organization as a whole [63,73]. To achieve this, employees showing OCB help other organization members perform their jobs or show support for and conscientiousness toward the organization [74]. Examples of behaviors that exceed the formal job description include taking on extra tasks, showing initiative, or sharing knowledge and experience with other employees. Although voluntary, OCB is relevant for task performance (mandatory in its nature) because it shapes the organizational, social, and psychological context in which task activities are performed [69].
Creative performance refers to behavioral manifestations of creativity [67], that is, the creation of products, ideas, procedures, or processes produced by an individual in the organization [75,76]. Significantly, for performance to be creative, it needs to meet the standards of quality, utility, and novelty [75,77]. In the organizational context, employees perceive creativity requirement as the expectancy or need to generate work-related ideas. This perception refers to both explicit requirements and other cues [78].
In the research on human-robot interaction, task performance has been investigated with objective and subjective metrics. Examples of objective measures are: counting the number of parts assembled correctly by the operator [57], measuring task execution times [79], number of units produced per period, the resources consumption for a given output, or the number of defective items produced [7]. Subjective indicators include different scales used for measuring perceived assessment of task accomplishment in experimental studies (e.g., [62]), cross-sectional studies among students (e.g., [31]), or among cobot operators working on the shop floor (e.g., [40]). Regarding organizational citizenship behavior and creative performance, there is a dearth of evidence to rely upon, as these concepts of performance have been neglected in the studies on human-robot interaction. Hence, it has left a void and a need for empirical verification amid cobot operators, which the current study aims to fill.

2.4. Workload

Workload represents the volume of work required of an employee [80]. Specifically, quantitative workload pertains to the pace and amount of work an employee performs in a given time period [81,82]. As such, it differs from qualitative workload, which refers to incumbents’ skills and effort necessary to complete the task [83].
The quantitative workload is an objective work demand [82] that requires physical (e.g., motor) and psychological (e.g., cognitive) effort [83,84] from the employee to perform a high amount of work or fast-paced tasks. In the short term, a quantitative workload can have both negative and positive consequences. When faced with a low workload, under-stimulated incumbents can experience boredom and loss of concentration [83]. Contrarily, an overly high workload can leave the employees tense [83] and fatigued [82]. Moreover, [80] note that high workload levels can be followed by workers’ feelings of uncertainty and frustration due to the disruption of goal achievement. Therefore, [83] suggests that an inverted U-shaped relationship of workload with job performance and job attitudes exists. Accordingly, a moderate workload can have a positive effect on employees’ behavior and attitudes due to the optimal activation generated in a motivational process. In the long term, however, the consequences of workload are mostly harmful. Chronic overstimulation by job demands leads to stress [81,85], extreme tiredness and work-related fatigue [82], lower psychological well-being [84], and impaired performance and health [83].
Baumgartner, Kopp and Kinkel [19] point out that cobot implementation may lead to multifaceted changes in workload. In line with their notion, some studies suggested that cobots could relieve humans in terms of physical [9,10,18] and mental load [1], while other research examples showed that deploying cobots led to increased workload [7,9,10,15,28].

3. The Study Aims and Hypotheses

The aim of this study is twofold. The first goal is to verify the relationships of four perspectives of fluency in human-cobot interaction with three facets of employees’ job performance and job satisfaction. The assumption behind these relations is that high-quality and fluent HRI increases employee performance [1,24,30], productivity and efficiency of the human-machine system [10,15], and operators’ well-being [22]. Hence, fluency is considered a pertinent factor when investigating HRI [11]. Still, the empirical base of performance-related consequences and correlates of fluency in HRI remains thin, with few study examples having shown that fluency can lead to increased individual task performance [31,40,79] and team performance [30]. Regarding cobot operators’ well-being and satisfaction, the problem remains an open question due to the lack of evidence. However, some theoretical premises can be drawn from the Job Demands-Control-Support (JDCS) model of occupational stress [86,87]. In light of this model, [40] argued that working with a collaborative robot is an active job where high job demands meet high control stemming from psychological safety, predictability, and fluency of interaction with a cognitively and emotionally trustworthy robotic agent. According to [86], the highest job satisfaction occurs specifically with active jobs. Furthermore, cobots are thought to be co-workers rather than tools [10,40] and can therefore offer social support to their human operators, which is an important factor for work-related well-being and job satisfaction [86,88]. Based on the theoretical premise and empirical investigations, the following hypotheses were formulated:
Hypothesis 1. 
Fluency in human-cobot interaction (i.e., human contribution-oriented, human emotions-oriented, robot-oriented, and team-oriented fluency) will be positively related to employees’ job performance (i.e., task performance, organizational citizenship behavior, and creative performance).
Hypothesis 2. 
Fluency in human-cobot interaction (i.e., human contribution-oriented, human emotions-oriented, robot-oriented, and team-oriented fluency) will be positively related to employees’ job satisfaction.
The second aim of this study is to explore the moderating role of quantitative workload while interacting with a cobot in the relationships of HRI fluency with job performance and job satisfaction. The research on workload among robot operators has been ambiguous or even conflicting, with studies suggesting that robot deployment either decreases or increases workload. Generally, the increase in a cobot operator’s workload can be on-the-job physical or mental. The first phenomenon stems from the reduction of the work time cycle and the consequent requirement for operators to move faster [28]. The latter can be an effect of anxiety or lack of expertise and confidence in interacting with robots [15], the execution of time-sharing activities [21], switching the operator’s role from a co-operant to a supervisor [21,89], repeatability of the operator’s movements [10], or the lack of inclusion of participants’ preferences for the task shared with a robot [31,90].
The relationships of workload with job performance and job attitudes (e.g., job satisfaction) are suggested to be an inverted U-shape [83], which means that both low and high workload levels can have adverse effects on employees. Specifically, while under-stimulation can cause boredom and loss of concentration [83], a high workload may lead to tension, fatigue and tiredness, frustration, stress, and lower well-being and performance [80,81,82,83,84,85]. This holds true also for cobot operators [21]. Contrarily, a moderate workload can motivate operators by providing adequate stimulation for their resources and, thus, optimal activation [83]. The complex pattern of relations between workload and other work experiences begs the question of whether workload can moderate the relationship of fluency in HRI with job performance and job satisfaction. Therefore, the following hypotheses were formulated:
Hypothesis 3. 
Quantitative workload will moderate the relationship between overall fluency in human-cobot interaction and job performance (i.e., task performance, organizational citizenship behavior, and creative performance).
Hypothesis 4. 
Quantitative workload will moderate the relationship between overall fluency in human-cobot interaction and job satisfaction.
It is essential to verify the hypotheses and investigate how the integration of collaborative technology changes human workers’ experience [13,91]. In particular, there is a need to study human factors [11] and the psychophysical state of operators [9] since elements like emotions and cognitions can influence HRI and performance [13]. Therefore, the cognitive, emotional, and behavioral aspects of subjective HRI fluency should be analyzed in relation to such key topics as job performance [40], satisfaction [7,91,92], and workload [9,22,24,29], which require further investigation in light of the research on human factors.

4. Materials and Methods

4.1. Participants and Procedure

This online survey study was conducted among operators working daily with collaborative robots on the shop floor. All participants were informed about the aim of the study. Participation in the study was voluntary. Informed consent was obtained from all participants, and the data collected were anonymized and kept confidential. The institutional ethics committee of the University of Silesia in Katowice approved this research project (decision number KEUS 125/05.2021). The study was carried out according to the principles of the Declaration of Helsinki and the recommendations of the National Science Centre in Poland regarding studies involving human participation.
Two hundred professional cobot operators took part in the study (120 men and 80 women). The age of the respondents ranged from 23 to 55 years, averaging at 37.93 years (±6.26). Regarding participants’ education level, most of them (91%) held a higher education degree, 8.5% completed upper secondary education, and only 0.5% achieved a primary education level. The operators had diverse seniority in robot collaboration, which varied between 3 months and 35 years, with the average duration at 6.32 years (±5.46). Several different types of cobots were included in the study. Examples comprise robots produced by KUKA (HRC-compatible LBR intelligent industrial work assistant (iiwa) 7 R800, R800 CR, and 15 R820, Yamaguchi, Japan), Universal Robots (collaborative robot arms such as UR3/UR3e, UR5/UR5e, UR10/UR10e, Odense, Denmark), FANUC (the “Green robot” family of examples of CR-4iA, CR-7iA, CR-7iA/L, CR-14iA/L, CR-15iA, and CR-35iA as well as the CRX Collaborative Robot Series examples of CRX-10iA and CRX-10iA/L, Yamanashi, Japan), ABB (collaborative industrial robot YuMi, Zürich, Switzerland), Yaskawa (the human-collaborative robot arm MOTOMAN HC20DT, Fukuoka, Japan), Mitsubishi Electric Collaborative Robot (Melfa Assista, Tokyo, Japan), Kawasaki (dual-arm collaborative robot duAro, Tokyo, Japan), and collaborative robotic arms produced by Epson and OMRON.

4.2. Measures

The Fluency in Human–Robot Interaction The scale developed by [40] was used to measure four perspectives of fluent interaction between the operators and their robotic counterparts. The tool comprises 12 questions regarding human contribution (e.g., “I contributed to the fluency of the interaction”), human emotions (e.g., “I trusted the robot to do the right thing at the right time”), robot (e.g., “The robot did its part successfully”), and team-oriented fluency (e.g., “The human–robot team worked fluently together”). The respondents answered the questions on a seven-point Likert scale (1 = I strongly disagree to 7 = I strongly agree). The obtained data were used to confirm a second-order factor model with four perspectives of fluency in HRI as subscales and a general (overall) score. Results of confirmatory factor analysis (χ2 = 82.47; df = 50; p < 0.01; RMSEA = 0.06; 95% CI = 0.03–0.08; CFI = 0.98; NFI = 0.96; SRMR = 0.03) proved that the data fitted the model well [93]. Cronbach’s alphas ranged from 0.85 to 0.91 for the subscales, while the reliability of the whole scale was 0.96.
Task performance was measured using three items from [70] (e.g., “I fulfill all the requirements of the job’’) with a seven-point Likert response scale (1 = I strongly disagree to 7 = I strongly agree). The participants were instructed to specifically indicate their answers regarding performance during work with the cobot. The score was computed by averaging the responses in all three items. Cronbach’s α was 0.87.
Organizational citizenship behavior was assessed with three items from [94] (e.g., “I willingly share expertise, knowledge, and information to help improve the effectiveness of others in my work group”). The operators indicated their behavior using a seven-point Likert scale (1 = I strongly disagree to 7 = I strongly agree). An average score was used with Cronbach’s α = 0.86.
Creative performance was measured with the three items created by [75] (e.g., “At work with a robot, I am creative: I develop original ideas for my organization”). The respondents answered the questions on a seven-point Likert scale (1 = Not at all to 7 = To a great extent). An average score was calculated, and Cronbach’s α was 0.91.
The job satisfaction scale by [95] was used to measure operators’ judgments and opinions about their work with a cobot. The scale comprises five items (e.g., “I am satisfied with my work with the robot”) with a seven-point Likert response scale (1 = I strongly disagree to 7 = I strongly agree). The score was computed by averaging the responses in all five items. Cronbach’s α was 0.91.
The quantitative workload was indicated by the respondents using the Quantitative Workload Inventory [80]. The tool consists of 5 items (e.g., “How often does your job require you to work very fast”) with a five-point Likert response scale (1 = Less than once per month or never to 7 = Several times per day). An average score was computed from the answers to all five items. Cronbach’s α = 0.93.

5. Results

The statistical analyses (calculation of descriptive statistics, correlations, and regression models) were carried out in IBM® SPSS® Statistics (version 28.0.1.0) and moderation analysis was conducted in PROCESS macro (version 3.5) for IBM® SPSS® Statistics on the data from 200 respondents.

5.1. Descriptive Statistics

Descriptive statistics (shown in Table 1) indicate that the operators’ subjectively perceived fluency in human-robot interaction was moderately high to high. The same can be seen for different aspects of job performance: task performance, organizational citizenship behavior, and creative performance were rated as moderately high to high. A similar situation was found in the case of job satisfaction. Finally, the quantitative workload at work with a cobot was averagely assessed by the operators as moderately low to moderate.
The Kolmogorov–Smirnov normality test results were significant in all cases (Table 1). However, the values of skewness and kurtosis were low and did not exceed 0.89 and 0.47, respectively. Existing literature [96,97,98] suggests that in such cases, the obtained skewness and kurtosis prove normal univariate distribution. Hence, the assumptions of further analysis were not violated.

5.2. Correlation and Regression Analyses

Correlation and regression analyses were carried out to verify Hypotheses 1 and 2 concerning the relationships of fluency in human-robot interaction with job performance and job satisfaction. Table 2 shows the results of the correlation analysis.
The patterns of correlations are consistent with the theoretical assumptions and predictions made in this study. All perspectives of fluency in human-robot interaction, as well as overall fluency, correlate positively and strongly with all facets of job performance (i.e., task performance, organizational citizenship behavior, and creative performance) and job satisfaction. Furthermore, different types of performance are in positive and strong relations with job satisfaction.
Since all perspectives of fluency in HRI are correlated (see Table 2), hierarchical regression analysis was performed to further verify their relationships with job performance and job satisfaction. It was carried out to investigate the unique contribution of each perspective of fluency as a predictor [99,100]. The results are presented in Table 3.
Regarding task performance, it is predicted by human emotions-oriented, robot-oriented, and team-oriented fluency. All these perspectives of fluency are in positive relationships with task performance, and together they explain 60% of its variance. For organizational citizenship behavior and creative performance, the only significant and positive predictor is team-oriented performance, which allows for predicting 64% and 54% of the variance of the dependent variables, respectively. Lastly, job satisfaction can be predicted with human contribution-oriented, human emotions-oriented, and team-oriented performance. Together, these positive predictors account for 80% of the variance in job satisfaction.

5.3. Moderation Analysis

To test Hypotheses 3 and 4 about whether the qualitative workload moderates the relationships of fluency in human-robot interaction with three facets of job performance and job satisfaction, a series of moderation analyses were conducted. In each analysis, overall fluency in HRI was the predictor, the qualitative workload was the moderator, and either a facet of job performance or job satisfaction was the dependent variable. The analysis was carried out on standardized data using a bootstrap method with 10,000 replications, indicating 95% confidence intervals. The results of the moderation analysis are shown in Table 4.
For task performance, the overall model is statistically significant (F(3, 196) = 141.56, p < 0.001, R2 = 0.68). Overall fluency in HRI is positively related to task performance, but workload does not moderate its effect on task performance (the change in explained variance is insignificant). The insignificant interaction effect is depicted in Figure 1. The standardized slopes for the effect of overall fluency on task performance are significant and similar at low (β = 0.86), moderate (β = 0.81), and high (β = 0.76) levels of workload.
Regarding organizational citizenship behavior (OCB), the overall model is statistically significant (F(3, 196) = 123.52, p < 0.001, R2 = 0.65). Overall fluency in HRI is in a positive relation with OCB, and workload significantly moderates the effect of overall fluency. The interaction effect, presented in Figure 2, shows that the standardized slopes for the effect of overall fluency on OCB are significant at low (β = 0.91), moderate (β = 0.72), and high (β = 0.53) levels of workload, but the gradient becomes lower with the increased workload.
Concerning creative performance, the overall model is also statistically significant (F(3, 196) = 80.76, p < 0.001, R2 = 0.55). Overall fluency in HRI positively correlates with creative performance, and workload significantly moderates the effect. The interaction effect is shown in Figure 3. The standardized slopes for the effect of overall fluency on creative performance are significant at low (β = 0.85), moderate (β = 0.66), and high (β = 0.48) levels of workload, yet the gradient becomes lower with the increased workload.
Finally, for job satisfaction, the overall model is statistically significant (F(3, 196) = 283.89, p < 0.001, R2 = 0.81). Overall fluency in HRI is positively related to job satisfaction, and workload moderates the effect significantly. As depicted in Figure 4, the standardized slopes for the effect of overall fluency on satisfaction are significant at low (β = 0.98), moderate (β = 0.85), and high (β = 0.73) levels of workload, but again the gradient becomes lower with the increased workload.
To sum it up, as workload increases, the strength of the relationships of overall fluency in HRI with organizational citizenship behavior, creative performance, and job satisfaction decreases. However, the moderating effect is not observed for task performance as a dependent variable.

6. Discussion

This empirical study sought to investigate the relationships of fluency in human-robot interaction with three facets of job performance and job satisfaction. The second aim was to verify the moderating role of quantitative workload in these relationships. The presented research was a survey study conducted on a pool of 200 cobot operators who interact with collaborative robots on a daily basis.
The obtained results show that fluent human-robot interactions are positively related to employees’ task performance, organizational citizenship behavior, and creative performance. Specifically, the emotion of trust and feeling of the robot’s commitment, perception of the robot’s reliable task fulfillment, and team fluency are associated with operators’ proficiency in performing activities recognized as part of their jobs [69] at the workstations with a cobot. In other words, this suggests that task performance (i.e., behavior) is mostly related to operators’ emotions towards and judgments of the robot, as well as the coordinated fulfillment of joint tasks with a capable and supportive agent. Hence, the result resonates with the notion that HRI fluency is a job resource [40], and, as such, it has motivating properties and facilitates operators to present expected behavior. As for the discretionary behavior promoting the effective functioning of groups [72] and the organization [63,73] as well as the creation of new products, ideas, procedures, or processes [75,76], they are mostly related to team-oriented fluency, which reflects the synergy-driven simultaneous or sequential performance of joint tasks [1] by two equally important and capable teammates, one of which is robotic and the other is human. A probable explanation for this outcome is that a supportive cobot helps the operator in the simultaneous task fulfillment, which results in operators being less fatigued and thus able and willing to engage in activities other than the mandatory ones. The other activities may include citizenship behavior, e.g., helping others or shaping the work context, and creative performance. With regard to task performance, the study results are consistent with previous investigations that showed positive associations between fluency in HRI and individual performance [31,40,79] as well as with the general notion of academics and practitioners that deploying cobots in production systems is majorly beneficial for the efficiency of employees [1,7,21] and the productivity of the system [2], provided that the interaction is designed not to neglect the importance of human factors [24,25] such as cognitions and emotions [13]. As for organizational citizenship behavior and creative performance, to the author’s best knowledge, this is the first study that verified the relationships between these facets of employee behavior and fluency in HRI. Together, this slice of research indicates that well-orchestrated and well-tuned interaction of operators and cobots is important for individuals and organizations due to its effects on mandatory task completion and goal achievement, the shaping of the organizational, social and psychological context in which tasks are performed, and bottom-up innovation through operators’ creativity.
The analysis also revealed associations between four facets of fluency in HRI (i.e., the human contribution-oriented, the human emotions-oriented, the robot-oriented, and the team-oriented fluency) and job satisfaction. As predicted, cognitive, emotional, and behavioral aspects of HRI fluency positively relate to operators’ knowledge, evaluative judgments, and good opinions about the job [53]. Although cobots have been generally promoted as an example of enabling technology [7] that helps prevent adverse health effects of work [16] and promotes workers’ well-being [1,22], this might be the first study to empirically investigate such a relationship. As such, it gives evidence of the significance of coordinated cooperation between collaborative robots and their human counterparts for the job-related satisfaction of the latter. This result suggests that cobots do not pose a realistic or symbolic threat to surveyed operators [60] who do not fear being replaced by them [52,59]. Contrarily, cobots are associated with positive cognitive evaluations, which are beneficial for employees’ functioning at work and the stability of the organizational system due to higher effort presented by satisfied workers [52] and lower turnover rates among them [57].
Within the theoretical framework of the Job Demand-Control-Support model [86,87], the job of a cobot operator is viewed as an active job [40], where high job demands meet high resources (especially high levels of control). Based on the presented research results, fluency in interacting with a cobot is the operator’s means to subjectively feel control over the situation. The feeling of control comes from the operator’s hands-on engagement and reliable input in the task fulfillment [40], his or her trust in the robot due to its reliability in contribution to the tasks [11], predictability [17], and fulfillment of expectations [45], and the synergic cooperation possible through team structure [11] and coordination [49]. Control over the situation and social support received from the collaborative robot [10,42] help counteract the adverse or challenging job demands and may lead directly to job satisfaction [86,88] for operators working in automated jobs [19] and to job performance, either directly [86] or indirectly through the enhancement of a positive affective-cognitive state of work engagement [40].
The research was also set to verify the moderating role of workload in the relationships of HRI fluency with job performance and job satisfaction. As [83] noted, the quantitative workload is an important concern for workers’ well-being and performance. Speciically, the quantitative workload was chosen because it requires cognitive, emotional, and behavioral efforts [84], and, as such, it resonates with the cognitive, emotional, and behavioral aspects of fluency in human-robot interaction [31], which is a job resource for cobot operators [40]. The moderation analysis revealed that workload indeed moderated the associations of HRI fluency with organizational citizenship behaviors, creative performance, and job satisfaction. Precisely speaking, the higher the workload, the weaker the investigated relations. The obtained results suggest that cobot deployment should be done with caution and regard for human factors, as collaborative robots can bring both benefits and physical and mental demands to human operators. An appropriate workload that does not exceed operators’ resources can challenge them positively [83,86] and facilitate fluent human-robot interactions [11,101] with its consequences due to optimal activation generated in a motivational process [83]. At the same time, an excessive workload due to the fast job pace [28] and repeatability of movements [10], the necessity to execute time-sharing activities [21], or the introduction of more complex tasks [11] colliding with operators’ preferences [31,90] may be detrimental to workers’ performance [82,85] and job attitudes [83], including job satisfaction. The adverse effects of a high quantitative workload stem from the fact that it requires operators’ physical and mental efforts to cope with it, leading to them feeling tired (in a short-term perspective) and exhausted (in a long-term perspective). These are signs of workers’ low energy and fatigue, which may prevent them from being motivated, and from being cognitively, emotionally, and behaviorally involved in fluent human-robot interactions, or capable of taking full advantage of the interaction with a collaborative robot. Nevertheless, the moderation analysis did not confirm the moderating role of workload in the relationship between HRI fluency and task performance. Regardless of the level of qualitative workload, the association is strong and positive. This result resonates with previous studies [31,40] and further supports the importance of fluent and highly coordinated cooperation between humans and robots as a job resource that allows operators to feel control at work with a cobot and fulfill their mandatory tasks, no matter how high the pace and volume of work is.
The obtained results indicate different strategies that can be employed to maximize the positive consequences of fluent human-robot interactions. First, proper training sessions for cobot operators are paramount to building cognitive and affective trust towards the robots and consequent robot acceptance, followed by high performance and satisfaction. While cognitive trust stems from the knowledge about how the robot operates, affective trust is developed more spontaneously through anthropomorphizing the device [35]. Hence, granting the operators sufficient time to learn what the robot is and how it operates helps to ease further on-the-job interactions. Furthermore, because cobots are both subjects of interaction and objects of design and deployment, it is necessary to support cooperation and communication between professionals collaborating with them and those responsible for their effective functioning. Moreover, the operators’ states during interaction with the robots should be perpetually monitored. Such strategies include periodic (e.g., weekly or monthly) surveys regarding good and problematic events at the robot stations or experience-sharing sessions for the operators to build necessary competencies by exchanging knowledge and expertise. These interventions help keep the lights on as regards employees’ perceived satisfaction and subjective workload, thus allowing for a fast reaction in case problems arise.

Strengths and Limitations of the Study

The present study has some limitations and strengths that must be considered. First, due to the self-report design of the study, the investigated phenomena should be contemplated as subjectively perceived by the participants and may be susceptible to bias because of the respondents’ probable propensity for providing socially desirable responses. However, the study was conducted anonymously and kept confidential to mitigate this risk. Moreover, the measurement of human-robot interaction has often been done with self-report measures [102] with the notion that relying on employee’s knowledge of their behavior is valid [103] and accessible [104]. Nevertheless, future studies should aim to gather more objective data about different facets of job performance and work attitudes. Second, the study investigated the relationships of interest in a correlative design. For more robust results, future research should aim to gather data in a multi-wave and multi-source approach. Nevertheless, the study gathered data from a comparatively large group of operators [31] who interact with cobots daily, increasing the ecology and generalizability of the results. Lastly, decisions on facets of job performance, job satisfaction, and workload needed to be made to select the studied variables. However, there are other phenomena that are worth researching, such as counterproductive and adaptive employee behavior, job-related affective well-being or satisfaction, or qualitative workload. These are potentially valuable topics for subsequent studies.

7. Conclusions

The study, conducted among professional operators interacting with collaborative robots of several different brands, including KUKA, FANUC, Universal Robots, ABB, Kawasaki, ALVO, Yaskawa, OMRON, and Epson, identified positive relationships of cognitive, emotional, and behavioral aspects of fluency in human-robot interaction with employees’ behavior and attitudes. The empirical investigation also revealed that it is vital not to overload the cobot operators in order to take advantage of the fluent HRI and allow them to draw from it to shape their performance and satisfaction. The final take-home message is that the research on human-robot interaction should consider human factors and cognitive ergonomics to maximize the benefits and reduce the potential work- and health-related risks of cobot deployment among their human co-workers.

Funding

Publication co-financed by the funds granted under the Research Excellence Initiative of the University of Silesia in Katowice.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Institutional Ethics Committee of the University of Silesia in Katowice (decision number KEUS 125/05.2021).

Informed Consent Statement

A written informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are available on reasonable request from the corresponding author.

Conflicts of Interest

The author declares no conflict of interest.

References

  1. Chacón, A.; Ponsa, P.; Angulo, C. Cognitive Interaction Analysis in Human–Robot Collaboration Using an Assembly Task. Electronics 2021, 10, 1317. [Google Scholar] [CrossRef]
  2. Chromjakova, F.; Trentesaux, D.; Kwarteng, M.A. Human and Cobot Cooperation Ethics: The Process Management Concept of the Production Workplace. J. Compet. 2021, 13, 21–38. [Google Scholar] [CrossRef]
  3. Evjemo, L.D.; Gjerstad, T.; Grøtli, E.I.; Sziebig, G. Trends in smart manufacturing. Role of humans and industrial robots in smart factories. Curr. Robot. Rep. 2020, 1, 35–41. [Google Scholar] [CrossRef] [Green Version]
  4. Di Pasquale, V.; De Simone, V.; Salvatore, M.; Riemma, S. Smart operators: How Industry 4.0 is affecting the worker’s performance in manufacturing contexts. Procedia Comput. Sci. 2021, 180, 958–967. [Google Scholar] [CrossRef]
  5. Meindl, B.; Ayala, N.F.; Mendonça, J.; Frank, A.G. The four smarts of Industry 4.0: Evolution of ten years of research and future perspectives. Technol. Forecast. Soc. Chang. 2021, 168, 120784. [Google Scholar] [CrossRef]
  6. Romero, D.; Noran, O.; Stahre, J.; Bernus, P.; Fast-Berglund, Å. Towards a Human-Centred Reference Architecture for Next Generation Balanced Automation Systems: Human-Automation Symbiosis. In Advances in Production Management Systems: Innovative Production Management Towards Sustainable Growth; Umeda, S., Nakano, M., Mizuyama, H., Hibino, H., Kiritsis, D., von Cieminski, G., Eds.; Springer: Cham, Switzerland, 2015; Volume 460, pp. 556–566. [Google Scholar] [CrossRef] [Green Version]
  7. De Simone, V.; Di Pasquale, V.; Giubileo, V.; Miranda, S. Human-Robot Collaboration: An analysis of worker’s performance. Procedia Comput. Sci. 2022, 200, 1540–1549. [Google Scholar] [CrossRef]
  8. Bi, Z.M.; Luo, C.; Miao, Z.; Zhang, B.; Zhang, W.J.; Wang, L. Safety assurance mechanisms of collaborative robotic systems in manufacturing. Robot. Comput. Integr. Manuf. 2021, 67, 102022. [Google Scholar] [CrossRef]
  9. Di Pasquale, V.; De Simone, V.; Giubileo, V.; Miranda, S. A taxonomy of factors influencing worker’s performance in human–robot collaboration. IET Collab. Intell. Manuf. 2022, 5, e12069. [Google Scholar] [CrossRef]
  10. Borges, G.D.; Reis, A.M.; Neto, R.A.; de Mattos, D.L.; Cardoso, A.; Gonçalves, H.; Merino, E.; Colim, A.; Carneiro, P.; Arezes, P. Decision-Making Framework for Implementing Safer Human-Robot Collaboration Workstations: System Dynamics Modeling. Safety 2021, 7, 75. [Google Scholar] [CrossRef]
  11. Hopko, S.; Wang, J.; Mehta, R. Human Factors Considerations and Metrics in Shared Space Human-Robot Collaboration: A Systematic Review. Front. Robot. AI 2022, 9, 799522. [Google Scholar] [CrossRef]
  12. Yan, Y.; Jia, Y. A Review on Human Comfort Factors, Measurements, and Improvements in Human–Robot Collaboration. Sensors 2022, 22, 7431. [Google Scholar] [CrossRef]
  13. Gervasi, R.; Mastrogiacomo, L.; Franceschini, F. A conceptual framework to evaluate human-robot collaboration. Int. J. Adv. Manuf. Technol. 2020, 108, 841–865. [Google Scholar] [CrossRef]
  14. Colim, A.; Faria, C.; Cunha, J.; Oliveira, J.; Sousa, N.; Rocha, L.A. Physical Ergonomic Improvement and Safe Design of an Assembly Workstation through Collaborative Robotics. Safety 2021, 7, 14. [Google Scholar] [CrossRef]
  15. Chowdhury, A.; Ahtinen, A.; Pieters, R.; Väänänen, K. User Experience Goals for Designing Industrial Human-Cobot Collaboration: A Case Study of Franka Panda Robot. In Proceedings of the 11th Nordic Conference on Human-Computer Interaction: Shaping Experiences, Shaping Society (NordiCHI ’20), Tallin, Estonia, 25–29 October 2020; Association for Computing Machinery: New York, NY, USA, 2020; Volume 83, pp. 1–13. [Google Scholar] [CrossRef]
  16. Gihleb, R.; Giuntella, O.; Stella, L.; Wang, T. Industrial robots, Workers’ safety, and health. Labour Econ. 2022, 78, 102205. [Google Scholar] [CrossRef]
  17. Bergman, M.; de Joode, E.; de Geus, M.; Sturm, J. Human-cobot teams: Exploring design principles and behaviour models to facilitate the understanding of non-verbal communication from cobots. In Proceedings of the 3rd International Conference on Computer-Human Interaction Research and Applications (CHIRA’19), Vienna, Austria, 20–21 September 2019; SCITEPRESS—Science and Technology Publications: Setúbal, Portugal; Lda: Porto, Portugal, 2019; pp. 191–198. [Google Scholar] [CrossRef]
  18. Bettoni, A.; Montini, E.; Righi, M.; Villani, V.; Tsvetanov, R.; Borgia, S.; Secchi, C.; Carpanzano, E. Mutualistic and Adaptive Human-Machine Collaboration Based on Machine Learning in an Injection Moulding Manufacturing Line. Procedia CIRP 2020, 93, 395–400. [Google Scholar] [CrossRef]
  19. Baumgartner, M.; Kopp, T.; Kinkel, S. Analysing Factory Workers’ Acceptance of Collaborative Robots: A Web-Based Tool for Company Representatives. Electronics 2022, 11, 145. [Google Scholar] [CrossRef]
  20. Hancock, P.A.; Billings, D.R.; Schaefer, K.E.; Chen, J.Y.; Visser, E.D.; Parasuraman, R. Meta-analysis of factors affecting trust in human-robot interaction. Hum. Factors 2011, 16, 517–527. [Google Scholar] [CrossRef]
  21. Cardoso, A.; Colim, A.; Bicho, E.; Braga, A.C.; Menozzi, M.; Arezes, P. Ergonomics and Human Factors as a Requirement to Implement Safer Collaborative Robotic Workstations: A Literature Review. Safety 2021, 7, 71. [Google Scholar] [CrossRef]
  22. Storm, F.A.; Chiappini, M.; Dei, C.; Piazza, C.; André, E.; Reißner, N.; Brdar, I.; Delle Fave, A.; Gebhard, P.; Malosio, M.; et al. Physical and mental well-being of cobot workers: A scoping review using the Software-Hardware-Environment-Liveware-Liveware-Organization model. Hum. Factor Ergon. Man. 2022, 32, 419–435. [Google Scholar] [CrossRef]
  23. Pollak, A.; Paliga, M.; Pulopulos, M.M.; Kożusznik, B.; Kożusznik, M.W. Stress in manual and autonomous modes of collaboration with a cobot. Comput. Hum. Behav. 2020, 112, 106469. [Google Scholar] [CrossRef]
  24. Faccio, M.; Granata, I.; Menini, A.; Milanese, M.; Rossato, C.; Bottin, M.; Minto, R.; Pluchino, P.; Gamberini, L.; Boschetti, G.; et al. Human factors in cobot era: A review of modern production systems features. J. Intell. Manuf. 2022, 34, 85–106. [Google Scholar] [CrossRef]
  25. Kulic, D.; Croft, E.A. Anxiety detection during human-robot interaction. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, Edmonton, AB, Canada, 2–6 August 2005; pp. 616–621. [Google Scholar]
  26. Kinzel, H. Industry 4.0–where does this leave the human factor? J. Urban Cult. Res. 2017, 15, 70–83. [Google Scholar] [CrossRef]
  27. Wall, T.; Corbett, J.M.; Clegg, C.; Jackson, P.; Martin, R. Advanced manufacturing technology and work design: Towards a theoretical framework. J. Organ. Behav. 1990, 11, 201–219. [Google Scholar] [CrossRef]
  28. Mühlemeyer, C. Assessment and Design of Employees-Cobot-Interaction. In Human Interaction and Emerging Technologies; Ahram, T., Taiar, R., Colson, S., Choplin, A., Eds.; Springer: Cham, Switzerland, 2020; Volume 1018, p. 771776. [Google Scholar] [CrossRef]
  29. Rubio, S.; Díaz, E.; Martín, J.; Puente, J.M. Evaluation of Subjective Mental Workload: A Comparison of SWAT, NASA-TLX, and Workload Profile Methods. Appl. Psychol. 2004, 53, 61–86. [Google Scholar] [CrossRef]
  30. Hoffman, G. Evaluating fluency in human-robot collaboration. IEEE Trans. Hum. Mach. Syst. 2019, 49, 209–218. [Google Scholar] [CrossRef]
  31. Paliga, M.; Pollak, A. Development and validation of the fluency in human–robot interaction scale. a two-wave study on three perspectives of fluency. Int. J. Hum. Comput. Stud. 2021, 155, 102698. [Google Scholar] [CrossRef]
  32. Hoffman, G.; Breazeal, C. Effects of anticipatory perceptual simulation on practiced human–robot tasks. Auton. Robot. 2009, 28, 403–423. [Google Scholar] [CrossRef]
  33. Isaacson, S.; Rice, G.; Boerkoel, J.C. MAD-TN: A tool for measuring fluency in human-robot collaboration. arXiv 2019, arXiv:1909.06675. [Google Scholar]
  34. Christoffersen, K.; Woods, D.D. How to make automated systems team players. In Advances in Human Performance and Cognitive Engineering Research; Salas, E., Ed.; Emerald Group Publishing Limited: Bingley, UK, 2002; Volume 2, pp. 1–12. [Google Scholar]
  35. Kopp, T.; Baumgartner, M.; Kinkel, S. Success factors for introducing industrial human–robot interaction in practice: An empirically driven framework. Int. J. Adv. Manuf. Technol. 2021, 112, 685–704. [Google Scholar] [CrossRef]
  36. Hoffman, G.; Breazeal, C. Cost-based anticipatory action selection for human-robot fluency. IEEE Trans. Robot. 2007, 23, 952–961. [Google Scholar] [CrossRef]
  37. Hoffman, G.; Breazeal, C. Effects of anticipatory action on human–robot teamwork efficiency, fluency, and perception of team. In Proceedings of the ACM/IEEE International Conference on Human-Robot Interaction—HRI’07, Arlington, VA, USA, 10 March 2007; pp. 1–8. [Google Scholar] [CrossRef]
  38. You, S.; Robert, L. Teaming up with robots: An IMOI (Inputs-Mediators-Outputs-Inputs) framework of human-robot teamwork. Int. J. Robot. Eng. 2017, 1, 1–7. [Google Scholar] [CrossRef] [Green Version]
  39. Steinfeld, A.; Fong, T.; Kaber, D.; Lewis, M.; Scholtz, J.; Schultz, A.; Goodrich, M. Common metrics for human-robot interaction. In Proceedings of the 1st ACM SIGCHI/SIGART Conference on Human-Robot Interaction, Salt Lake City, UT, USA, 2–3 March 2006; ACM: New York, NY, USA, 2006; pp. 33–40. [Google Scholar] [CrossRef] [Green Version]
  40. Paliga, M. Human–cobot interaction fluency and cobot operators’ job performance. The mediating role of work engagement: A survey. Auton. Robot. 2022, 155, 403–423. [Google Scholar] [CrossRef]
  41. Hentout, A.; Aouache, M.; Maoudj, A.; Akli, I. Human–robot interaction in industrial collaborative robotics: A literature review of the decade 2008–2017. Adv. Robot. 2019, 33, 764–799. [Google Scholar] [CrossRef]
  42. Sauppé, A.; Mutlu, B. The social impact of a robot co-worker in industrial settings. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, Seoul, Republic of Korea, 18 April 2015; pp. 3613–3622. [Google Scholar]
  43. Beer, J.M.; Liles, K.R.; Wu, X.; Pakala, S.B. Affective Human–Robot Interaction. In Emotions and Affect in Human Factors and Human-Computer Interaction; Jeon, M., Ed.; Academic Press: Cambridge, MA, USA, 2017; pp. 359–381. [Google Scholar] [CrossRef]
  44. Broadbent, E. Interactions with robots: The truths we reveal about ourselves. Annu. Rev. Psychol. 2017, 3, 627–652. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  45. Savur, C.; Kumar, S.; Sahin, F. A framework for monitoring human physiological response during human robot collaborative task. In Proceedings of the 2019 IEEE International Conference on Systems, Man and Cybernetics (SMC), Bari, Italy, 6–9 October 2019; IEEE: Piscataway, NJ, USA; pp. 385–390. [Google Scholar]
  46. Charalambous, G.; Fletcher, S.; Webb, P. The Development of a Scale to Evaluate Trust in Industrial Human-robot Collaboration. Int. J. Soc. Robot. 2016, 8, 193–209. [Google Scholar] [CrossRef]
  47. Schou, C.; Andersen, R.S.; Chrysostomou, D.; Bøgh, S.; Madsen, O. Skill-based instruction of collaborative robots in industrial settings. Robot. Comput. Integr. Manuf. 2018, 53, 72–80. [Google Scholar] [CrossRef]
  48. Bauer, A.; Wollherr, D.; Buss, M. Human-robot collaboration: A survey. Int. J. Humanoid. Robot 2008, 5, 47–66. [Google Scholar] [CrossRef]
  49. Ji, H.; Yan, J. How team structure can enhance performance: Team longevity’s moderating effect and team coordination’s mediating effect. Front. Psychol. 2020, 11, 1–11. [Google Scholar] [CrossRef]
  50. Liu, H.; Wang, L. Collision-free human–robot collaboration based on context awareness. Robot. Comput. Integr. Manuf. 2021, 67, 101997. [Google Scholar] [CrossRef]
  51. Judge, T.A.; Klinger, R. Job satisfaction: Subjective well-beingat work. In The Science of Subjective Well-Being; Eid, M., Larsen, R.J., Eds.; Guilford Press: New York, NY, USA, 2008; pp. 393–413. [Google Scholar]
  52. Schwabe, H.; Castellacci, F. Automation, workers’ skills and job satisfaction. PLoS ONE 2020, 15, e0242929. [Google Scholar] [CrossRef]
  53. Hulin, C.; Judge, T. Job attitudes. In Handbook of Psychology: Industrial and Organizational Psychology; Borman, W., Ilgen, D., Klimoski, R., Eds.; Wiley: Hoboken, NJ, USA, 2003; pp. 255–276. [Google Scholar]
  54. Paliga, M. Satysfakcja z Pracy i Wydajność Pracowników. Relacja (Nie)Oczekiwana) [Job Satisfaction and Job Performance. The (Un)Expected Relationship]; Wydawnictwo Uniwersytetu Śląskiego: Katowice, Poland, 2021. [Google Scholar] [CrossRef]
  55. Paliga, M.; Kożusznik, B.; Pollak, A.; Sanecka, E. The relationships of psychological capital and influence regulation with job satisfaction and job performance. PLoS ONE 2022, 17, e0272412. [Google Scholar] [CrossRef] [PubMed]
  56. Judge, T.A.; Weiss, H.M.; Kammeyer-Mueller, J.D.; Hulin, C.L. Job attitudes, job satisfaction, and job affect: A century of continuity and of change. J. Appl. Psychol. 2017, 102, 356–374. [Google Scholar] [CrossRef]
  57. Mattsson, S.; Fast-Berglund, Å.; Thorvald, P. A relationship between operator performance and arousal in assembly. Procedia CIRP 2016, 44, 32–37. [Google Scholar] [CrossRef] [Green Version]
  58. Gorny, P.M.; Woodard, R.C. Don’t Fear the Robots: Automatability and Job Satisfaction. MPRA Pap. 2020, 103424. Available online: https://ideas.repec.org/p/pra/mprapa/103424.html (accessed on 15 December 2022).
  59. Stein, J.; Liebold, B.; Ohler, P. Stay back, clever thing! Linking situational control and human uniqueness concerns to the aversion against autonomous technology. Comput. Hum. Behav. 2019, 95, 73–82. [Google Scholar] [CrossRef]
  60. Złotowski, J.; Yogeeswaran, K.; Bartneck, C. Can we control it? Autonomous robots threaten human identity, uniqueness, safety, and resources. Int. J. Hum. Comput. Stud. 2017, 100, 48–54. [Google Scholar] [CrossRef]
  61. Gombolay, M.C.; Shah, J.A. Challenges in collaborative scheduling of human-robot teams. In Proceedings of the 2014 AAAI Fall Symposium Series on AI-HRI, Arlington, VA, USA, 13–15 November 2014; Association for the Advancement of Artificial Intelligence: Washington DC, USA, 2014; pp. 1–3. Available online: https://www.aaai.org/ocs/index.php/FSS/FSS14/paper/viewFile/9124/9148 (accessed on 15 December 2022).
  62. Rossato, C.; Pluchino, P.; Cellini, N.; Jacucci, G.; Spagnolli, A.; Gamberini, L. Facing with collaborative robots: The subjective experience in senior and younger workers. Cyberpsychol. Behav. Soc. Netw. 2021, 24, 349–356. [Google Scholar] [CrossRef]
  63. Viswesvaran, C.; Ones, D.S. Perspectives on models of job performance. Int. J. Sel. Assess. 2000, 8, 216–226. [Google Scholar] [CrossRef]
  64. Campbell, J.P. Modeling the performance prediction problem in industrial and organizational psychology. In Handbook of Industrial and Organizational Psychology. Volume 1; Dunnette, M., Hough, L.M., Eds.; Consulting Psychologists Press: Palo Alto, CA, USA, 1990; pp. 687–731. [Google Scholar]
  65. Campbell, J.P.; McCloy, R.A.; Oppler, S.H.; Sager, C.E. A theory of performance. In Personnel Selection in Organizations; Schmitt, N., Borman, W.C., Eds.; Jossey Bass: San Francisco, CA, USA, 1993; pp. 35–70. [Google Scholar]
  66. Sonnentag, S.; Frese, M. Performance Concepts and Performance Theory. In Psychological Management of Individual Performance; Sonnentag, S., Ed.; John Wiley & Sons, Ltd.: Chichester, UK, 2005; pp. 3–25. [Google Scholar]
  67. Koopmans, L.; Bernaards, C.M.; Hildebrandt, V.H.; Schaufeli, W.B.; de Vet, H.C.W.; van der Beek, A.J. Conceptual frameworks of individual work performance: A systematic review. J. Occup. Environ. Med. 2011, 53, 856–866. [Google Scholar] [CrossRef] [Green Version]
  68. Campbell, J.P. Behavior, Performance, and Effectiveness in the Twenty-first Century. In The Oxford Handbook of Organizational Psychology. Volume 1; Kozlowski, S., Ed.; Oxford University Press: New York, NY, USA, 2012; pp. 159–196. [Google Scholar]
  69. Borman, W.C.; Motowidlo, S.J. Expanding the criterion domain to include elements of contextual performance. In Personnel Selection in Organizations; Schmitt, N., Borman, W.C., Eds.; Jossey Bass: San Francisco, CA, USA, 1993; pp. 71–98. [Google Scholar]
  70. Goodman, S.A.; Svyantek, D.J. Person–Organization Fit and Contextual Performance: Do Shared Values Matter. J. Vocat. Behav. 1999, 55, 254–275. [Google Scholar] [CrossRef]
  71. Poropat, A. New Models of Work Performance and Their Implications for Employment Relations. In Proceedings of the Tenth Annual Conference of the International Employment Relations Association, Sydney, Australia, 6–9 July 2002. [Google Scholar]
  72. Podsakoff, P.M.; MacKenzie, S.B.; Paine, J.B.; Bachrach, D.G. Organizational Citizenship Behaviors: A Critical Review of the Theoretical and Empirical Literature and Suggestions for Future Research. J. Manag. 2000, 26, 513–563. [Google Scholar] [CrossRef]
  73. Organ, D.W. Organizational Citizenship Behavior; D.C. Heath: Lexington, MA, USA, 1988. [Google Scholar]
  74. Borman, W.C.; Penner, L.A.; Allen, T.D.; Motowidlo, S.J. Personality predictors of citizenship performance. Int. J. Sel. Assess. 2001, 9, 52–69. [Google Scholar] [CrossRef]
  75. Oldham, G.R.; Cummings, A. Employee creativity: Personal and Contextual Factors at Work. Acad. Manag. J. 1996, 39, 607–634. [Google Scholar] [CrossRef]
  76. Woodman, R.W.; Sawyer, J.E.; Griffin, R.W. Toward a theory of organizational creativity. Acad. Manag. Rev. 1993, 18, 293–321. [Google Scholar] [CrossRef]
  77. Eisenberger, R.; Armeli, S. Can Salient Reward Increase Creative Performance Without Reducing Intrinsic Creative Interest? J. Pers. Soc. Psychol. 1997, 72, 652–663. [Google Scholar] [CrossRef]
  78. Unsworth, K.L.; Wall, T.D.; Carter, A. Creative requirement: A neglected construct in the study of employee creativity? Group Organ. Manag. 2005, 30, 541–560. [Google Scholar] [CrossRef] [Green Version]
  79. Chao, C.; Thomaz, A. Timing in multimodal turn-taking interactions: Control and analysis using timed Petri nets. J. Hum. Robot. Interact. 2012, 1, 4–25. [Google Scholar] [CrossRef] [Green Version]
  80. Spector, P.E.; Jex, S.M. Development of four self-report measures of job stressors and strain: Interpersonal Conflict at Work Scale, Organizational Constraints Scale, Quantitative Workload Inventory, and Physical Symptoms Inventory. J. Occup. Health Psychol. 1998, 3, 356–367. [Google Scholar] [CrossRef]
  81. Baka, Ł.; Bazińska, R. Polish adaptation of three self-report measures of job stressors: The Interpersonal Conflict at Work Scale, the Quantitative Workload Inventory and the Organizational Constraints Scale. Int. J. Occup. Saf. Ergon. 2016, 22, 32–39. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  82. Liu, H.; Fan, J.; Fu, Y.; Liu, F. Intrinsic motivation as a mediator of the relationship between organizational support and quantitative workload and work-related fatigue. Hum. Factors Manuf. 2018, 28, 154–162. [Google Scholar] [CrossRef]
  83. van Veldhoven, M. Quantitative job demands. In An Introduction to Contemporary Work Psychology; Peeters, M.C.W., De Jonge, J., Taris, T.W., Eds.; Wiley Blackwell: Hoboken, NJ, USA, 2013; pp. 117–143. [Google Scholar]
  84. Konze, A.K.; Rivkin, W.; Schmidt, K.H. Is Job Control a Double-Edged Sword? A Cross-Lagged Panel Study on the Interplay of Quantitative Workload, Emotional Dissonance, and Job Control on Emotional Exhaustion. Int. J. Environ. Res. Public Health 2017, 14, 1608. [Google Scholar] [CrossRef] [Green Version]
  85. Hauck, E.L.; Snyder, L.A.; Cox-Fuenzalida, L.-E. Workload variability and social support: Effects on stress and performance. Curr. Psychol. 2008, 27, 112–125. [Google Scholar] [CrossRef]
  86. Karasek, R. Job demands, job decision latitude, and mental strain: Implications for job redesign. Adm. Sci. Q. 1979, 24, 285–306. [Google Scholar] [CrossRef]
  87. Karasek, R.; Theorell, T. Healthy Work. Stress, Productivity, and the Reconstruction of Working Life; Basic Books: New York, NY, USA, 1990. [Google Scholar]
  88. Van der Doef, M.; Maes, S. The job demand-control (-support) model and psychological well-being: A review of 20 years of empirical research. Work Stress 1999, 13, 87–114. [Google Scholar] [CrossRef]
  89. Brun, L.; Wiol, L. Prevention of occupational risks related to the humanrobot collaboration. In Advances in Intelligent Systems and Computing (AISC, vo. 1253), Proceedings of the 3rd International Conference on Human Interaction, Emerging Technologies, and Future Applications III; Paris, France, 27–29 August 2020, Ahram, T., Taiar, R., Langlois, K., Choplin, A., Eds.; Springer: Cham, Switzerland, 2021; pp. 441–446. [Google Scholar] [CrossRef]
  90. Gombolay, M.; Bair, A.; Huang, C.; Shah, J. Computational design of mixed-initiative human–robot teaming that considers human factors: Situational awareness, workload, and workflow preferences. Int. J. Rob. Res. 2017, 9, 597–617. [Google Scholar] [CrossRef] [Green Version]
  91. Welfare, K.S.; Hallowell, M.R.; Shah, J.A.; Riek, L.D. Consider the Human Work Experience When Integrating Robotics in the Workplace. In Proceedings of the 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI), Daegu, Republic of Korea, 11–14 March 2019; IEEE: Piscataway, NJ, USA; pp. 75–84. [Google Scholar] [CrossRef]
  92. Lambrechts, W.; Klaver, J.S.; Koudijzer, L.; Semeijn, J. Human Factors Influencing the Implementation of Cobots in High Volume Distribution Centres. Logistics 2021, 5, 32. [Google Scholar] [CrossRef]
  93. Hu, L.; Bentler, P.M. Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification. Psychol. Methods 1999, 3, 424–453. [Google Scholar] [CrossRef]
  94. MacKenzie, S.B.; Podsakoff, P.M.; Podsakoff, N.P. Challenge-oriented organizational citizenship behaviors and organizational effectiveness: Do challenge-oriented behaviors really have an impact on the organization’s bottom line? Pers. Psychol. 2011, 64, 559–592. [Google Scholar] [CrossRef]
  95. Zalewska, A.M. “The Satisfaction with Job Scale”—A measure of cognitive aspect of overall job satisfaction. Acta U. Lod. Folia Psychol. 2003, 7, 49–61. [Google Scholar]
  96. Brown, T.A. Confirmatory Factor Analysis for Applied Research; Guilford Press: New York, NY, USA, 2006. [Google Scholar]
  97. Griffin, M.; Steinbrecher, T.D. Large-scale datasets in special education research. Int. Rev. Res. Dev. Disa. 2013, 45, 155–183. [Google Scholar] [CrossRef]
  98. Kline, R.B. Principles and Practice Of Structural Equation Modeling; Guilford Press: New York, NY, USA, 2016. [Google Scholar]
  99. Hoyt, W.; Leierer, S.J.; Millington, M.J. Analysis and interpretation of findings using multiple regression techniques. Rehabil. Couns. Bull. 2006, 49, 223–233. [Google Scholar] [CrossRef]
  100. Pedhazur, E.J. Multiple Regression in Behavioral Research, 3rd ed.; Harcourt Brace: Orlando, FL, USA, 1997. [Google Scholar]
  101. Chiou, E.K.; Lee, J.D. Trusting Automation: Designing for Responsivity and Resilience. Hum. Factors 2021, 65, 137–165. [Google Scholar] [CrossRef]
  102. Nenna, F.; Orso, V.; Zanardi, D.; Gamberini, L. The virtualization of human–robot interactions: A user-centric workload assessment. Virtual Real. 2022, 1–9. [Google Scholar] [CrossRef]
  103. Spector, P.; Bauer, J.; Fox, S. Measurement artifacts in the assessment of counterproductive work behavior and organizational citizenship behavior: Do we know what we think we know? J. Appl. Psychol. 2010, 95, 781–790. [Google Scholar] [CrossRef]
  104. Koopmans, L.; Bernaards, C.; Hildebrandt, V.; van Buuren, S.; van der Beek, A.J.; de Vet, H.C.W. Development of an individual work performance questionnaire. Int. J. Product. Perform. 2013, 62, 6–28. [Google Scholar] [CrossRef]
Ijerph 20 05111 g001 550
Figure 1. Workload as a moderator between overall fluency in human-robot interaction and task performance.
Figure 1. Workload as a moderator between overall fluency in human-robot interaction and task performance.
Ijerph 20 05111 g001
Ijerph 20 05111 g002 550
Figure 2. Workload as a moderator between overall fluency in human-robot interaction and organizational citizenship behavior.
Figure 2. Workload as a moderator between overall fluency in human-robot interaction and organizational citizenship behavior.
Ijerph 20 05111 g002
Ijerph 20 05111 g003 550
Figure 3. Workload as a moderator between overall fluency in human-robot interaction and creative performance.
Figure 3. Workload as a moderator between overall fluency in human-robot interaction and creative performance.
Ijerph 20 05111 g003
Ijerph 20 05111 g004 550
Figure 4. Workload as a moderator between overall fluency in human-robot interaction and job satisfaction.
Figure 4. Workload as a moderator between overall fluency in human-robot interaction and job satisfaction.
Ijerph 20 05111 g004
Table
Table 1. Descriptive statistics for study variables.
Table 1. Descriptive statistics for study variables.
VariablesM(SD)Min-MaxSkewness
(SE = 0.17)		Kurtosis (SE = 0.34)K-S Test
Human contribution-oriented fluency5.56 (1.03)3.00–7.00−0.42−0.300.09 ***
Human emotions-oriented fluency5.55 (1.05)1.33–7.00−0.891.470.13 ***
Robot-oriented fluency5.70 (0.96)3.00–7.00−0.580.140.13 ***
Team-oriented fluency5.68 (1.01)2.67–7.00−0.660.190.11 ***
Overall human-robot interaction fluency5.62 (0.94)2.92–7.00−0.490.160.07 *
Task performance5.73 (0.94)2.67–7.00−0.570.100.11 ***
Organizational citizenship behavior5.45 (1.05)2.67–7.00−0.23−0.750.10 ***
Creative performance5.42 (1.12)2.33–7.00−0.60−0.330.13 ***
Job satisfaction5.54 (0.99)3.00–7.00−0.44−0.300.09 ***
Workload2.74 (1.03)1.00–5.00−0.03−0.850.08 **
Legend. M—Mean, SD—Standard Deviation, SE—Standard Error, K-S Test—Kolmogorov–Smirnov Test. Note. n = 200. * p < 0.05, ** p < 0.01, *** p < 0.001.
Table
Table 2. Pearson correlation analysis among human–robot interaction fluency, task performance, organizational citizenship behavior, creative performance, and job satisfaction.
Table 2. Pearson correlation analysis among human–robot interaction fluency, task performance, organizational citizenship behavior, creative performance, and job satisfaction.
Variables(1)(2)(3)(4)(5)(6)(7)(8)
(1) Human contribution-oriented fluency-
(2) Human emotions-oriented fluency0.84 ***-
(3) Robot-oriented fluency0.84 ***0.80 ***-
(4) Team-oriented fluency0.81 ***0.78 ***0.86 ***-
(5) Overall human-robot interaction fluency0.94 ***0.92 ***0.94 ***0.93 ***-
(6) Task performance0.74 ***0.75 ***0.79 ***0.80 ***0.83 ***-
(7) Organizational citizenship behavior0.71 ***0.69 ***0.73 ***0.79 ***0.78 ***0.78 ***-
(8) Creative performance0.66 ***0.65 ***0.66 ***0.73 ***0.72 ***0.69 ***0.82 ***-
(9) Job satisfaction0.84 ***0.81 ***0.81 ***0.85 ***0.89 ***0.82 ***0.83 ***0.80 ***
Note. n = 200. *** p < 0.001.
Table
Table 3. Hierarchical regression analysis of human-robot interaction fluency factors as predictors of task performance, organizational citizenship behavior, creative performance, and job satisfaction.
Table 3. Hierarchical regression analysis of human-robot interaction fluency factors as predictors of task performance, organizational citizenship behavior, creative performance, and job satisfaction.
VariablesTask PerformanceOrganizational Citizenship BehaviorCreative PerformanceJob Satisfaction
B(SE)βB(SE)βB(SE)βB(SE)β
Human contribution-oriented fluency0.08 (0.08)0.040.10 (0.10)0.090.14 (0.11)0.130.30 (0.07)0.31 ***
Human emotions-oriented fluency0.18 (0.07)0.21 **0.10 (0.08)0.100.12 (0.100.120.17(0.06)0.18 **
Robot-oriented fluency0.24 (0.09)0.25 **0.13 (0.11)0.12−0.02 (0.13)−0.020.06 (0.08)0.06
Team-oriented fluency0.37 (0.08)0.40 ***0.55 (0.10)0.53 ***0.61 (0.11)0.55 ***0.41 (0.07)0.42 ***
F111.95 *** 86.81 *** 59.72 *** 198.97 ***
R20.70 0.64 0.55 0.80
Adj. R20.69 0.63 0.54 0.80
Legend. B—unstandardized regression coefficient, SE—Standard Error, β—standardized regression coefficient. Note. n = 200. ** p < 0.01, *** p < 0.001.
Table
Table 4. Moderation analysis with overall fluency in human-robot interaction as a predictor, workload as a moderator, and task performance, organizational citizenship behavior, creative performance, and job satisfaction as dependent variables.
Table 4. Moderation analysis with overall fluency in human-robot interaction as a predictor, workload as a moderator, and task performance, organizational citizenship behavior, creative performance, and job satisfaction as dependent variables.
VariablesTask PerformanceOrganizational Citizenship BehaviorCreative PerformanceJob Satisfaction
β95% CItβ95% CItβ95% CItβ95% CIt
Constant0.00−0.08; 0.070.010.00−0.08; 0.080.040.00−0.09; 0.100.030.00−0.06; 0.060.03
Overall Fluency (predictor)0.81 ***0.73; 0.8918.960.72 ***0.64; 0.8116.170.66 ***0.56; 0.7613.050.85 ***0.79; 0.9225.91
Workload (moderator)0.02−0.07; 0.110.490.20 ***0.11; 0.294.270.16 **0.05; 0.262.960.14 ***0.08; 0.214.15
Interaction
Overall Fluency x Workload −0.05−0.14; 0.04−1.05−0.19 ***−0.29; −0.09−3.840.−19 **−0.30; −0.08−3.32−0.13 ***−0.19; −0.05−3.34
F141.56 *** 123.52 *** 80.76 *** 283.89 ***
ΔF1.11 14.75 *** 10.99 ** 11.18 ***
R20.68 0.65 0.55 0.81
ΔR20.00 0.03 0.03 0.01
Legend. CI—Confidence Interval, β—standardized regression coefficient. Note. n = 200. ** p < 0.01, *** p < 0.001.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Paliga, M. The Relationships of Human-Cobot Interaction Fluency with Job Performance and Job Satisfaction among Cobot Operators—The Moderating Role of Workload. Int. J. Environ. Res. Public Health 2023, 20, 5111. https://doi.org/10.3390/ijerph20065111

AMA Style

Paliga M. The Relationships of Human-Cobot Interaction Fluency with Job Performance and Job Satisfaction among Cobot Operators—The Moderating Role of Workload. International Journal of Environmental Research and Public Health. 2023; 20(6):5111. https://doi.org/10.3390/ijerph20065111

Chicago/Turabian Style

Paliga, Mateusz. 2023. "The Relationships of Human-Cobot Interaction Fluency with Job Performance and Job Satisfaction among Cobot Operators—The Moderating Role of Workload" International Journal of Environmental Research and Public Health 20, no. 6: 5111. https://doi.org/10.3390/ijerph20065111

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop