An Experimental Protocol for Human Stress Investigation in Manufacturing Contexts: Its Application in the NO-STRESS Project
Abstract
:1. Introduction
2. Research Background
2.1. Human-Centered Manufacturing Industry
2.2. Work-Related Stress Measurement in the Industrial Context
3. Taxonomy of Factors Shaping the Manufacturing Context and Theoretical Foundations for the Stress Measurement
3.1. Human–Task–Context Taxonomy
3.1.1. Human Characteristics
3.1.2. Task Characteristics
3.1.3. Context and Organizational Characteristics
3.2. Stress Measurement
3.2.1. Evaluation of Performance
3.2.2. Evaluation of the User through Physiological Monitoring
3.2.3. Evaluation of the User through a Stress Perception Questionnaire
3.2.4. Data Processing and Stress Ratio Calculation Overview
4. Experimental Protocol for Measuring Work-Related Stress in Manufacturing Industry
4.1. Recruitment and Ethical Principles
4.1.1. Participant Recruitment Strategies
- Project Description: Provide a concise overview of the project, including information about the organizing institution, objectives, scope, and project timeline. Clearly specify the date, time, and location of the event, along with instructions for accessing the venue. Communicate the conditions of participation and outline the expected tasks or activities for participants. If any filming, physiological monitoring, or observation will take place, it should be mentioned. Additionally, inform participants about any expenses involved and any incentives offered as part of their involvement. It is crucial to provide comprehensive contact details for the organizing institution. An adequate notice period should be provided, where a two-week timeframe is generally insufficient.
- Direct Contact: Reach out to potential participants by establishing direct contact with relevant industry associations, trade unions, or professional organizations associated with the industrial manufacturing sector.
- Detailed explanation: Ensure that the conditions of participation are explained in detail to potential participants. Ideally, provide a digital copy of the informed consent letter, allowing participants ample time to review and consider the terms. This enables individuals to make an informed decision and withdraw from the project if they choose to do so.
4.1.2. Obtaining Informed Consent
4.1.3. Confidentiality: Safeguarding the Shared Information
4.1.4. Behavior: Ethical Conduct and Considerations
- Audio and video recording: When conducting tests that involve recording, monitoring, or observation, it is imperative to inform participants of these activities during the recruitment phase and at the commencement of the interview. Participants should be made aware of how the recordings will be used and their consent to the use of such recordings should be clearly outlined in the consent form. Upon request, participants should be provided with a duplicate copy of the recorded material. Respecting participants’ wishes for identity concealment through pixelation or other technical means should be honored. For task-related research, focusing solely on the relevant body parts, such as the hands, or filming from behind the subject can help to address privacy concerns. Video and audio recordings of participants should be securely stored and not shared with third parties without proper consent.
- Sensitive issues: Qualitative research, due to its potentially intrusive nature, necessitates particular attention to the emotional well-being of participants. Researchers must maintain respect for individuals’ values and be mindful of any distress their questions may cause, regardless of the topic under examination. In terms of sensitivity, thematic areas can be categorized as follows: (1) topics universally deemed sensitive due to their inherent nature and (2) topics that may be sensitive for specific individuals based on their personal history. While precautions cannot be taken for the latter case before the interview, researchers can approach each case with sensitivity and individuality, providing respondents with a genuine opportunity to disengage if needed. It is important to recognize that any topic can be sensitive to someone. Respondents who perceive that their privacy and personal sensitivities are not acknowledged and respected may be less forthcoming in their responses, ultimately impacting the nature of their participation. Similarly, respondents who feel they have not been treated with honesty and openness may experience a sense of patronization, which can influence the quality of their responses. Therefore, it is crucial to uphold participant dignity, privacy, and trust throughout the research process.
4.1.5. Gender Considerations in Research Design and Reporting
4.1.6. Determining Optimal Sample Size
4.2. Test Execution
4.2.1. Experimental Procedure
- Pre-phase (before the task execution): The pre-phase is the initial stage of the protocol, where participants are introduced to the experiment and provided with essential information. Firstly, participants will receive a comprehensive overview of the test’s objectives, procedures, and potential risks, and they will be required to provide informed consent by signing a consent form. This ensures that the participants are fully aware of the study’s nature and willingly agree to participate. Furthermore, participants undergo a preparatory process, which includes clear instructions regarding the specific tasks they perform during the experiment. Additionally, physiological devices will be carefully fitted and calibrated to accurately collect relevant physiological data throughout the study.
- During the task execution: The task execution phase constitutes the core of the protocol, during which the participants carry out the assigned tasks while the researchers collect data. It is essential to maintain a controlled environment to minimize confounding factors and ensure the accuracy and reliability of the collected data. A controlled setting allows the researchers to isolate the effects of the tasks and investigate stress-related factors without interference from external variables. The experimental conditions are carefully monitored to guarantee the validity of the data obtained, enabling accurate analysis and interpretation.
- Post-phase (after the task execution): Following the completion of the tasks, the participants enter the post-phase, which involves the assessment of perceptual measures through the administration of a questionnaire. This questionnaire serves as a valuable tool for evaluating the participants’ subjective perceptions and experiences related to the performed tasks. By capturing the participants’ self-reported measures, the researchers can gain insights into their cognitive and emotional responses, aiding in the understanding of the stress-inducing factors within the manufacturing context. The post-phase contributes to the comprehensive analysis of the data collected, complementing the physiological measures obtained during task execution.
4.2.2. Before the Task Execution
- Consent: In any research study involving human participants, it is crucial to adhere to ethical standards and obtain informed consent prior to conducting any tests or collecting data. Informed consent entails a comprehensive process wherein participants are provided with complete information regarding the research study, including its purpose, procedures, potential risks and benefits, and the rights they possess as participants. Subsequently, participants voluntarily agree to take part in the study, making their informed consent an integral aspect of ethical research conduct. A fundamental component of obtaining informed consent is the utilization of a consent form. This document serves as a written record that delineates the essential details participants need to be aware of, along with their rights and responsibilities as research subjects. By affixing their signature to the consent form, participants acknowledge their comprehension of the provided information and express their voluntary consent to participate in the study.
- Socio-demographic questionnaire: The socio-demographic questionnaire constitutes a valuable tool for researchers as it enables the collection of pertinent information regarding participants’ backgrounds. By gathering data on various socio-demographic factors, such as age, gender, education, and occupation, researchers can gain insights into how these variables may influence participants’ responses to the primary test or study. For instance, demographic characteristics might impact cognitive functions, emotional responses, or perceptions, thereby potentially influencing the interpretation of research findings. Integrating a socio-demographic questionnaire into the research protocol enhances the comprehensiveness and depth of data collected, contributing to a more nuanced understanding of participant perspectives.
- Fitting and calibration of physiological devices: In studies involving physiological measurements, it is essential to appropriately fit and calibrate the physiological devices employed. This process ensures accurate and reliable data collection during the research study. Proper fitting involves ensuring that the devices are appropriately positioned and secured on the participants’ bodies to obtain precise measurements. Calibration, on the other hand, involves adjusting and verifying the accuracy of the physiological devices to guarantee optimal functioning. Adequate fitting and calibration procedures are crucial to maintain data integrity and minimize potential errors or inconsistencies in the collected physiological measurements.
- Provision of instructions to participants: Clear and concise instructions are imperative when conducting research with human participants. Participants need to be thoroughly informed about the tasks or activities they are expected to perform, as well as any specific guidelines or protocols they need to follow. Detailed instructions should be provided in a standardized manner to ensure consistency across participants and mitigate potential confounding factors that may influence their performance. By providing explicit instructions, researchers promote a standardized and controlled environment for data collection, thereby enhancing the validity and reliability of the study outcomes.
4.2.3. During Task Execution
- Designing the task: The design of tasks in research studies involving human participants is a crucial aspect that directly influences the quality and validity of the collected data. A well-designed task should align with the research objectives, provide a clear and structured framework for participant engagement, and effectively elicit the desired responses or behaviors of interest. Researchers need to define the scope and purpose of the task, considering the specific research questions to be addressed and the hypotheses to be tested. This clarity of purpose enables researchers to design tasks that align with the intended outcomes and facilitate the measurement of relevant variables. Researchers must carefully consider the task instructions, stimuli, and any materials or equipment required. Clear instructions are essential to ensure that participants understand the task requirements and objectives. In addition to considering the task content and instructions, researchers should also pay attention to the task format and presentation. The choice of task format, such as computer-based tasks, paper-based tasks, or real-world simulations, should be guided by the research objectives and the nature of the variables being investigated. The task format should be conducive to capturing the desired responses or behaviors and should be easily understood and engaging for participants. Pilot testing is an essential step in task design. Conducting pilot tests allows researchers to identify and address any issues or challenges with the task design before implementing it in the main study. Pilot testing enables researchers to refine task instructions, identify potential ambiguity or confusion, and ensure that the task effectively measures the desired variables. When designing tasks for research studies that involve human participants, several considerations should be taken into account to ensure the tasks are effective in eliciting meaningful feedback and capturing relevant information. Table 3 outlines key principles for designing tasks that align with the user’s goals and needs, are clearly defined, specific yet flexible, focused on testing usability aspects, and varied in difficulty level.
Principles for Designing the Tasks | Description |
---|---|
Realism and relevance to stressful situations | Tasks should simulate realistic and relevant stress-inducing situations. By recreating scenarios that evoke stress, participants can provide feedback that reflects their real experiences and the impact of stress on usability. |
Clear definition and comprehensibility | Tasks should be clearly defined and easy for participants to understand, even in stressful conditions. Ambiguity or confusion in task instructions can add to participants’ stress levels and affect their performance and feedback. Providing clear and concise instructions helps participants to focus on the task requirements. |
Specificity and flexibility | Tasks should be specific enough to elicit stress responses while allowing participants the flexibility to navigate through the tasks based on their coping mechanisms. Clear objectives should guide participants, but they should have some freedom in their actions to reflect real-life stress management approaches. |
Focus on stress-related usability aspects | Tasks should be designed to measure the impact of stress on specific usability aspects, such as decision-making, task completion time, or error rates. By focusing on these stress-related usability aspects, researchers can evaluate the system’s performance under stress and identify areas where stress may hinder usability. |
Variation in stress levels | Tasks should be designed to induce different levels of stress, accommodating participants with varying stress thresholds. This variation allows researchers to observe how the system performs under different stress levels and identify stress-related usability challenges across a range of user experiences. |
- Performance indicators: In the protocol, various performance indicators are considered to measure the participants’ task performance (Table 4).
Performance Indicator | Description |
---|---|
Task execution time | The task execution time measures the duration taken by participants to complete a given task and provides valuable insights into the efficiency and speed of task performance. |
Errors | This indicator captures the occurrence and frequency of errors made by participants during task execution. It helps to identify usability issues and areas where participants encounter difficulties or make mistakes. |
Variability in production times | This indicator assesses the variability in the time required to produce certain items or complete specific actions. It highlights consistency or inconsistency in performance and helps identify areas for improvement. |
Production rate | The production rate measures the rate at which pieces or preforms are produced within a specified time interval. It provides an indication of the productivity and efficiency in terms of output. |
- Physiological indicators: The measurement of work-related stress is a critical aspect of understanding the impact of occupational environments on individuals’ well-being. In recent years, there has been a growing interest in incorporating physiological indicators as a means of quantifying and evaluating work-related stress levels. In the specific case of the NO-STRESS project, we made the decision to utilize the EMG on the trapezius, forearm, and biceps muscles due to the task requirements. Additionally, we incorporated a band to measure the HR and HRV, an EEG helmet to capture brain activity, and a ring on one of the non-dominant hand’s fingers to measure the GSR. These sensor placements were chosen to comprehensively assess physiological responses relevant to stress evaluation in the study.
4.2.4. After the Task Execution
4.3. The Application of the Protocol
4.3.1. Application in the Automotive Industry
4.3.2. Application in Plastic Component Manufacturing
5. Discussion
5.1. Understanding and Addressing Stress in Future Manufacturing Industry
5.2. Flexibility and Adaptability in Experimental Design
5.3. Challenges and Considerations in Integrating Physiological Measurements in the Experimental Protocol
5.4. Selection and Adaptation of Questionnaires for Assessing Work-Related Stress
5.5. Potential Challenges and Mitigation Strategies
6. Conclusions
6.1. Contributions of this Study
6.2. Limitations of this Study
6.3. Future Research Directions
Author Contributions
Funding
Data Availability Statement
Conflicts of Interest
References
- Breque, M.; De Nul, L.; Pedritis, A. European Commision “Industry 5.0—Towards a Sustainable, Human-Centric and Resilient European Industry”. 2021. Available online: https://op.europa.eu/en/publication-detail/-/publication/468a892a-5097-11eb-b59f-01aa75ed71a1/ (accessed on 22 September 2022).
- Coronado, E.; Kiyokawa, T.; Ricardez, G.A.G.; Ramirez-Alpizar, I.G.; Venture, G.; Yamanobe, N. Evaluating quality in human-robot interaction: A systematic search and classification of performance and human-centered factors, measures and metrics towards an industry 5.0. J. Manuf. Syst. 2022, 63, 392–410. [Google Scholar] [CrossRef]
- Demir, K.A.; Döven, G.; Sezen, B. Industry 5.0 and Human-Robot Co-working. Procedia Comput. Sci. 2019, 158, 688–695. [Google Scholar] [CrossRef]
- Badri, A.; Boudreau-Trudel, B.; Souissi, A.S. Occupational health and safety in the industry 4.0 era: A cause for major concern? Saf. Sci. 2018, 109, 403–411. [Google Scholar] [CrossRef]
- Leso, V.; Fontana, L.; Iavicoli, I. The occupational health and safety dimension of Industry 4.0. Med. Lav. 2018, 109, 327. [Google Scholar] [CrossRef]
- Peruzzini, M.; Grandi, F.; Pellicciari, M. How to analyse the workers’ experience in integrated product-process design. J. Ind. Inf. Integr. 2018, 12, 31–46. [Google Scholar] [CrossRef]
- Hassard, J.; Cox, T.; Murawski, S.; De Meyer, S.; Muylaert, K.; Flintrop, J.; Podniece, Z. Mental Health Promotion in the Workplace–A Good Practice Report; Publications Office of the European Union: Luxembourg, 2011. [Google Scholar]
- De Neve, J.E.; Diener, E.; Tay, L.; Xuereb, C. The objective benefits of subjective well-being. In World Happiness Report; Centre for Economic Performance, London School of Economics and Political Science: London, UK, 2013. [Google Scholar]
- Holman, D.; Johnson, S.; O’Connor, E. Stress management interventions: Improving subjective psychological well-being in the workplace. In Handbook of Well-Being; DEF Publishers: Salt Lake City, UT, USA, 2018; Volume 2. [Google Scholar]
- Apolinário-Hagen, J.; Hennemann, S.; Kück, C.; Wodner, A.; Geibel, D.; Riebschläger, M.; Zeißler, M.; Breil, B. Exploring User-Related Drivers of the Early Acceptance of Certified Digital Stress Prevention Programs in Germany. Health Serv. Insights 2020, 13, 1–11. [Google Scholar] [CrossRef]
- Paganin, G.; Simbula, S. New Technologies in the Workplace: Can Personal and Organizational Variables Affect the Employees’ Intention to Use a Work-Stress Management App? Int. J. Environ. Res. Public Health 2021, 18, 9366. [Google Scholar] [CrossRef] [PubMed]
- Sucharitha, M.; Basha, S.A. A Study on Impact of Stress employee productivity and job performace Implications for Stress Measurement and Management. Ilkogr. Online—Elem. Educ. Online 2020, 19, 823–831. [Google Scholar] [CrossRef]
- Kêdoté, N.M.; Sopoh, G.E.; Tobada, S.B.; Darboux, A.J.; Fonton, P.; Lompo, M.S.S.; Fobil, J. Perceived Stress at Work and Associated Factors among E-Waste Workers in French-Speaking West Africa. Int. J. Environ. Res. Public Health 2022, 19, 851. [Google Scholar] [CrossRef]
- Selye, H. The general adaptation syndrome and the diseases of adaptation. J. Clin. Endocrinol. Metab. 1946, 6, 117–230. [Google Scholar] [CrossRef]
- Octavius, G.S.; Timotius, E. Stress at the Workplace and Its Impacts on Productivity: A Systematic Review from Industrial Engineering, Management, and Medical Perspective. Ind. Eng. Manag. Syst. 2022, 21, 192–205. [Google Scholar] [CrossRef]
- Brunner, B.; Igic, I.; Keller, A.C.; Wieser, S. Who gains the most from improving working conditions? Health-related absenteeism and presenteeism due to stress at work. Eur. J. Health Econ. 2019, 20, 1165–1180. [Google Scholar] [CrossRef]
- Blandino, G. How to Measure Stress in Smart and Intelligent Manufacturing Systems: A Systematic Review. Systems 2023, 11, 167. [Google Scholar] [CrossRef]
- Ngoc, H.N.; Lasa, G.; Iriarte, I. Human-centred design in industry 4.0: Case study review and opportunities for future research. J. Intell. Manuf. 2022, 33, 35–76. [Google Scholar] [CrossRef] [PubMed]
- Barata, J.; Kayser, I. Industry 5.0—Past, Present, and Near Future. Procedia Comput. Sci. 2023, 219, 778–788. [Google Scholar] [CrossRef]
- Modgil, S.; Singh, R.K.; Agrawal, S. Developing human capabilities for supply chains: An industry 5.0 perspective. Ann. Oper. Res. 2023, 1–31. [Google Scholar] [CrossRef]
- Aslam, F.; Aimin, W.; Li, M.; Rehman, K.U. Innovation in the Era of IoT and Industry 5.0: Absolute Innovation Management (AIM) Framework. Information 2020, 11, 124. [Google Scholar] [CrossRef]
- Romero, D.; Stahre, J.; Wuest, T.; Noran, O.; Bernus, P.; Fast-Berglund, Å.; Gorecky, D. Towards an operator 4.0 typology: A human-centric perspective on the fourth industrial revolution technologies. In Proceedings of the International Conference on Computers and Industrial Engineering (CIE46), Tianjin, China, 29–31 October 2016; pp. 1–11. [Google Scholar]
- Kaasinen, E.; Liinasuo, M.; Schmalfuss, F.; Koskinen, H.; Aromaa, S.; Heikkilä, P.; Honka, A.; Mach, S.; Malm, T. A worker-centric design and evaluation framework for operator 4.0 solutions that support work well-being. IFIP Adv. Inf. Commun. Technol. 2019, 544, 263–282. [Google Scholar] [CrossRef]
- Nahavandi, S. Industry 5.0—A human-centric solution. Sustainability 2019, 11, 4371. [Google Scholar] [CrossRef]
- Salanova, M.; Del Líbano, M.; Llorens, S.; Schaufeli, W.B. Engaged, workaholic, burned-out or just 9-to-5? Toward a typology of employee well-being. Stress Health 2014, 30, 71–81. [Google Scholar] [CrossRef]
- Buffet, M.A.; Gervais, R.L.; Liddle, M.; Eeckelaert, L. Well-Being at Work: Creating a Positive Work Environment; Literature Review; European Agency for Safety and Health at Work, EU-OSHA; Publications Office of the European Union: Luxembourg, 2013; Volume 20. [Google Scholar]
- Romero, D.; Mattsson, S.; Fast-Berglund, Å.; Wuest, T.; Gorecky, D.; Stahre, J. Digitalizing occupational health, safety and productivity for the operator 4.0. IFIP Adv. Inf. Commun. Technol. 2018, 536, 473–481. [Google Scholar] [CrossRef]
- Sun, S.; Zheng, X.; Gong, B.; Paredes, J.G.; Ordieres-Meré, J. Healthy Operator 4.0: A Human Cyber–Physical System Architecture for Smart Workplaces. Sensors 2020, 20, 2011. [Google Scholar] [CrossRef] [PubMed]
- Wijngaards, I.; King, O.C.; Burger, M.J.; van Exel, J. Worker Well-Being: What it Is, and how it Should Be Measured. Appl. Res. Qual. Life 2021, 17, 795–832. [Google Scholar] [CrossRef]
- Diener, E. Assessing subjective well-being: Progress and opportunities. Soc. Indic. Res. 1994, 31, 103–157. [Google Scholar] [CrossRef]
- Khamaisi, R.K.; Brunzini, A.; Grandi, F.; Peruzzini, M.; Pellicciari, M. UX assessment strategy to identify potential stressful conditions for workers. Robot. Comput. Integr. Manuf. 2022, 78, 102403. [Google Scholar] [CrossRef]
- Yahaya, A.; Yahaya, N.; Bon, A.T.; Ismail, S.; Ing, T.C. Stress level and its influencing factors among employees in a plastic manufacturing and the implication towards work performance. Elixir. Psychol. 2011, 41, 5932–5941. [Google Scholar]
- Mucci, N.; Giorgi, G.; Cupelli, V.; Gioffrè, P.A.; Rosati, M.V.; Tomei, F.; Tomei, G.; Breso-Esteve, E.; Arcangeli, G. Work-related stress assessment in a population of Italian workers. The Stress Questionnaire. Sci. Total Environ. 2015, 502, 673–679. [Google Scholar] [CrossRef]
- Colligan, T.W.; Higgins, E.M. Workplace Stress. Journal of Workplace Behavioral Health. 2008, 21, 89–97. [Google Scholar] [CrossRef]
- Rescio, G.; Manni, A.; Caroppo, A.; Ciccarelli, M.; Papetti, A.; Leone, A. Ambient and wearable system for workers’ stress evaluation. Comput. Ind. 2023, 148, 103905. [Google Scholar] [CrossRef]
- Setz, C.; Arnrich, B.; Schumm, J.; La Marca, R.; Tröster, G.; Ehlert, U. Discriminating stress from cognitive load using a wearable eda device. IEEE Trans. Inf. Technol. Biomed. 2010, 14, 410–417. [Google Scholar] [CrossRef]
- Papetti, A.; Rossi, M.; Menghi, R.; Germani, M. Human-centered design for improving the workplace in the footwear sector. Procedia CIRP 2020, 91, 295–300. [Google Scholar] [CrossRef]
- Ciccarelli, M.; Papetti, A.; Germani, M.; Leone, A.; Rescio, G. Human work sustainability tool. J. Manuf. Syst. 2022, 62, 76–86. [Google Scholar] [CrossRef]
- Sriramprakash, S.; Prasanna, V.D.; Murthy, O.V.R. Stress Detection in Working People. Procedia Comput. Sci. 2017, 115, 359–366. [Google Scholar] [CrossRef]
- Anusha, A.S.; Jose, J.; Preejith, S.P.; Jayaraj, J.; Mohanasankar, S. Physiological signal based work stress detection using unobtrusive sensors. Biomed. Phys. Eng. Express 2018, 4, 065001. [Google Scholar] [CrossRef]
- Vila, G.; Godin, C.; Charbonnier, S.; Labyt, E.; Sakri, O.; Campagne, A. Pressure-Specific Feature Selection for Acute Stress Detection from Physiological Recordings. In Proceedings of the 2018 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2018. Miyazaki, Japan, 7–10 October 2018; pp. 2341–2346. [Google Scholar] [CrossRef]
- Peruzzini, M.; Grandi, F.; Pellicciari, M. Exploring the potential of Operator 4.0 interface and monitoring. Comput. Ind. Eng. 2020, 139, 105600. [Google Scholar] [CrossRef]
- Kim, H.G.; Cheon, E.J.; Bai, D.S.; Lee, Y.H.; Koo, B.H. Stress and Heart Rate Variability: A Meta-Analysis and Review of the Literature. Psychiatry Investig. 2018, 15, 235. [Google Scholar] [CrossRef] [PubMed]
- Tran, T.-A.; Péntek, M.; Motahari-Nezhad, H.; Abonyi, J.; Kovács, L.; Gulácsi, L.; Eigner, G.; Zrubka, Z.; Ruppert, T. Heart Rate Variability Measurement to Assess Acute Work-Content-Related Stress of Workers in Industrial Manufacturing Environment—A Systematic Scoping Review. IEEE Trans. Syst. Man. Cybern. Syst. 2023, 1–8. [Google Scholar] [CrossRef]
- Zhang, J.; Wen, W.; Huang, F.; Liu, G. Recognition of real-scene stress in examination with heart rate features. In Proceedings of the 9th International Conference on Intelligent Human-Machine Systems and Cybernetics, IHMSC 2017, Hangzhou, China, 26–27 August 2017; Volume 1, pp. 26–29. [Google Scholar] [CrossRef]
- Eyam, A.T.; Mohammed, W.M.; Lastra, J.L.M. Emotion-Driven Analysis and Control of Human-Robot Interactions in Collaborative Applications. Sensors 2021, 21, 4626. [Google Scholar] [CrossRef]
- Arkouli, Z.; Michalos, G.; Makris, S. On the Selection of Ergonomics Evaluation Methods for Human Centric Manufacturing Tasks. Procedia CIRP 2022, 107, 89–94. [Google Scholar] [CrossRef]
- Mailliez, M.; Hosseini, S.; Battaiä, O.; Roy, R.N. Decision Support System-like Task to Investigate Operators’ Performance in Manufacturing Environments. IFAC-Pap. 2020, 53, 324–329. [Google Scholar] [CrossRef]
- Panchetti, T.; Pietrantoni, L.; Puzzo, G.; Gualtieri, L.; Fraboni, F. Assessing the Relationship between Cognitive Workload, Workstation Design, User Acceptance and Trust in Collaborative Robots. Appl. Sci. 2023, 13, 1720. [Google Scholar] [CrossRef]
- Caterino, M.; Rinaldi, M.; Fera, M. Digital ergonomics: An evaluation framework for the ergonomic risk assessment of heterogeneous workers. Int. J. Comput. Integr. Manuf. 2022, 36, 239–259. [Google Scholar] [CrossRef]
- Venkatesh, V.; Bala, H. Technology acceptance model 3 and a research agenda on interventions. Decis. Sci. 2008, 39, 273–315. [Google Scholar] [CrossRef]
- Meissner, A.; Trübswetter, A.; Conti-Kufner, A.S.; Schmidtler, J. Friend or Foe? Understanding Assembly Workers’ Acceptance of Human-robot Collaboration. ACM Trans. Hum. Robot. Interact. (THRI) 2020, 10, 1–30. [Google Scholar] [CrossRef]
- Chikszentmihalyi, M. Flow: The Psychology of Optimal Experience; Harper Perennial: New York, NY, USA, 1990. [Google Scholar]
- Apraiz, A.; Lasa, G.; Mazmela, M. Evaluating User Experience with Physiological monitoring: A Systematic Literature Review. DYNA New Technol. 2021, 8, 21. [Google Scholar] [CrossRef]
- Li, F.; Xu, P.; Zheng, S.; Chen, W.; Yan, Y.; Lu, S.; Liu, Z. Photoplethysmography based psychological stress detection with pulse rate variability feature differences and elastic net. Int. J. Distrib. Sens. Netw. 2018, 14, 1–14. [Google Scholar] [CrossRef]
- Virzi, R.A. Refining the Test Phase of Usability Evaluation: How Many Subjects Is Enough? Hum. Factors J. Hum. Factors Ergon. Soc. 1992, 34, 457–468. [Google Scholar] [CrossRef]
- Lewis, J.R. Sample sizes for usability studies: Additional considerations. Hum. Factors 1994, 36, 368–378. [Google Scholar] [CrossRef]
- Nielsen, J. Why You Only Need to Test with 5 Users; Nielsen Norman Group: Dover, DE, USA, 2000; Available online: https://www.nngroup.com/articles/why-you-only-need-to-test-with-5-users/ (accessed on 26 August 2023).
- Cazañas, A.; de San Miguel, A.; Parra, E. Estimación del tamaño de la muestra para pruebas de usabilidad. Enfoque UTE 2017, 8, 172–185. [Google Scholar] [CrossRef]
- Faulkner, L. Beyond the five-user assumption: Benefits of increased sample sizes in usability testing. In Behavior Research Methods, Instruments, and Computers; Psychonomic Society Inc.: Chicago, IL, USA, 2003; pp. 379–383. [Google Scholar] [CrossRef]
- Taylor, J.M. Psychometric analysis of the ten-item perceived stress scale. Psychol. Assess 2015, 27, 90–101. [Google Scholar] [CrossRef]
- Ramnath, B.V.; Kumar, C.S.; Mohamed, G.R.; Venkataraman, K.; Elanchezhian, C.; Sathish, S. Analysis of Occupational Safety and Health of Workers by Implementing Ergonomic Based Kitting Assembly System. Procedia Eng. 2014, 97, 1788–1797. [Google Scholar] [CrossRef]
- Banton, C. Assembly Line: Defining the Mass Production Process. 8 April 2022. Available online: https://www.investopedia.com/terms/a/assembly-line.asp-0 (accessed on 1 July 2023).
- Fletcher, R.; Mahindroo, A.; Jaju, M.; Plum, B.; Sawaya, M. Manufacturing Process Innovation for Industrials, McKinsey. 16 September 2021. Available online: https://www.mckinsey.com/industries/industrials-and-electronics/our-insights/manufacturing-process-innovation-for-industrials (accessed on 1 July 2023).
- Saralaya, S.; Saralaya, V.; D’Souza, R. Compliance Management in Business Processes. In Lecture Notes on Data Engineering and Communications Technologies; Springer: Cham, Switzerland, 2018; pp. 53–91. [Google Scholar] [CrossRef]
- Dekhne, A.; Hastings, G.; Murnane, H.; Neuhaus, F. Logistics Automation: Big Opportunity, Bigger Uncertainty, McKinsey. 24 April 2019. Available online: https://www.mckinsey.com/industries/travel-logistics-and-infrastructure/our-insights/automation-in-logistics-big-opportunity-bigger-uncertainty (accessed on 1 July 2023).
Device | Measured Metrics | Stress Association |
---|---|---|
Heart rate monitor | Heart rate variability (HRV) | HRV is impacted by stress and is used for the objective assessment of psychological health and stress [43]. |
Pulse rate | Increased pulse rate may indicate elevated stress [55]. | |
Blood pressure monitor | Blood pressure. | Increased blood pressure is linked to higher stress levels [55]. |
Heart rate (HR) | Elevated heart rate can indicate a stress response [55]. | |
Electrodermal activity Monitor/galvanic Skin response | Skin conductance level (SCL) | Increased SCL indicates higher stress arousal [55]. |
Electrodermal response (EDR) | Enhanced EDR is associated with greater stress response [55]. | |
Respiration monitor | Respiration rate | Increased respiration rate may indicate stress or anxiety [55]. |
Respiratory depth | Changes in breathing pattern reflect stress response [55]. | |
Electrocardiogram (ECG) monitor | Electrical activity of the heart | Irregularities in ECG may indicate heightened stress [55]. |
Heart rate variability (HRV) | HRV is impacted by stress and supports its use for the objective assessment of psychological health and stress [43]. | |
Electroencephalogram (EEG) | Brain activity | Theta waves are typically associated with relaxation, meditation, and creativity, while beta waves are associated with alertness, concentration, and cognitive processing [55]. |
Electromyogram (EMG) | Muscle activity | Increased muscle tension suggests higher stress levels [55]. |
Muscle tension | Elevated EMG readings indicate heightened stress response [55]. | |
Body temperature monitor | Core body temperature | Increased core body temperature may indicate stress response [55]. |
Point | Description |
---|---|
Transparency | Researchers must clearly communicate the intended use of collected data and inform participants about the handling of their personal information. |
Consent | Personal data should not be shared with third parties without obtaining prior consent from the participants. |
Secure storage | Video and audio recordings should be securely stored and sharing them with third parties should only be done with prior consent. |
Purpose limitation | Personal data should only be collected for specified and lawful purposes and should not be processed in ways inconsistent with those purposes. |
Data relevance | Collected personal data should be adequate, relevant, and not excessive for the stated purpose(s) of the research project. |
Data accuracy | Efforts should be made to ensure the accuracy of personal data, and mechanisms should be in place to update them when necessary. |
Data retention | Personal data should not be retained for longer than necessary unless there are legal or regulatory obligations to retain them. |
Data subject rights | Personal data should be processed in line with the rights of data subjects, granting individuals control over their personal information, as defined by the Data Protection Act. |
Security measures | Appropriate technical and organizational measures should be implemented to protect personal data from unauthorized or unlawful access, loss, destruction, or damage. |
International transfers | Personal data should not be transferred to countries outside the European Economic Area without ensuring an adequate level of protection for data subjects’ rights and freedoms. |
ID | Item |
---|---|
1 | During the task, how often did you feel nervous and stressed? |
2 | During the task, how often did you feel that things were going the way you wanted them to go? |
3 | During the task, how many times did you feel that you could not cope everything you had to do? |
4 | During the task, how often have you been able to control possible anger and irritation? |
5 | During the task, how often did you feel that you were on top of things? |
6 | During the task, how often did you get angry about thing that happened that were out of your control? |
7 | During the task, how often did you feel difficulties in reaching your goal? |
During the Task, How Often Did You Feel Nervous and Stressed? | ||||||
---|---|---|---|---|---|---|
Never | Sometimes | All the Time | ||||
1 | 2 | 3 | 4 | 5 | 6 | 7 |
Protocol Step | Data Collected | Data Collection Metrics | Output Metrics | Case Study 1 | Case Study 2 |
---|---|---|---|---|---|
Before | Consent | Form | Yes | Yes | |
Sociodemographic data | Questionnaire | Age | Yes | Yes | |
Gender | Yes | Yes | |||
Working years | Yes | Yes | |||
Working expertise | Yes | Yes | |||
Weight | Yes | Yes | |||
Height | Yes | Yes | |||
Handedness | Yes | Yes | |||
Health history | Yes | Yes | |||
Substance use | Yes | Yes | |||
During | Task | Environment | Full kitting | Quality assessment | |
Research variables | Time (against the clock) Noise level Temperature | Time (against the clock) Noise level Temperature | |||
Physiological data | HR and HRV | Heart rate Heart rate variability | Yes | Yes | |
GSR/EDA | Activation Impact | Yes | Yes | ||
EEG | Memorization Engagement Valence Attention | No | Yes | ||
EMG | The magnitude of the maximal voluntary isometrical contraction | Yes | No | ||
Voice | Participants’ voice | No | No | ||
Eye tracking | Gaze position | No | No | ||
Ergonomic data | Exoskeleton pre-screening | Task ergonomic risk Hazardous motions and postures Postural risk index per body part | No | No | |
Accelerometers | Energy expenditure Physical activity intensity | Yes | Yes | ||
Performance indicators | Time | Yes | Yes | ||
Errors | Yes | Yes | |||
Production | Yes | Yes | |||
After | Perceptual indicators | Questionnaire | Stress perception | Yes | Yes |
Protocol Step | Data Collected | Data Collection Technique | Output Metrics | Case Study 1 | Case Study 2 |
---|---|---|---|---|---|
Before | Consent | Form | Yes | Yes | |
Sociodemographic data | Questionnaire | Age | Yes | Yes | |
Gender | Yes | Yes | |||
Working years | Yes | Yes | |||
Weight | Yes | Yes | |||
Height | Yes | Yes | |||
Handedness | Yes | Yes | |||
Working expertise | Yes | Yes | |||
During | Task | Environment | Assembling | Quality assessment | |
Research variables | Time of the day | Time of the day | |||
Physiological data | HR and HRV | Heart rate Heart rate variability | Yes | Yes | |
GSR/EDA | Activation Impact | Yes | Yes | ||
EEG | Memorization Engagement Valence Attention | No | No | ||
EMG | The magnitude of the maximal voluntary isometrical contraction | Yes | Yes | ||
Voice | Participants’ voice | Yes | Yes | ||
Eye tracking | Gaze position | No | No | ||
Ergonomic data | Exoskeleton pre-screening | Task ergonomic risk Hazardous motions and postures Postural risk index per body part | Yes | Yes | |
Accelerometers | Energy expenditure Physical activity intensity | Yes | Yes | ||
After | Perceptual indicators | Questionnaire | Stress perception | Yes | Yes |
Potential Challenges | Mitigation Strategies |
---|---|
Participant compliance | Clear communication: Clearly communicate the purpose and benefits of the study to participants. Emphasize the importance of their contribution to improving worker well-being and the future manufacturing industry. Address any concerns or misconceptions they may have and encourage their active participation. |
Training and familiarization: Providing comprehensive training and guidance to participants is key for their understanding of the task and study requirements. By offering opportunities for participants to familiarize themselves with the devices used in the study, researchers can enhance participants’ confidence and competence in using the equipment during data collection. Additionally, researchers may consider assessing participants’ baseline knowledge or experience with the task through a sociodemographic questionnaire, which can help to determine the appropriate level of training needed for each participant. | |
Incentives and recognition: Implement incentive programs or recognition mechanisms to motivate participants and increase compliance. This can include rewards, acknowledgments, or participation certificates for their involvement in the study. | |
Technical issues with physiological devices | Pilot testing: Conduct thorough testing of the physiological devices and measurement systems before the actual data collection phase. Verify their functionality, accuracy, and compatibility with the manufacturing environment. Address any technical issues or limitations beforehand to minimize disruptions during the study. |
Redundancy and backup plans: Have backup devices or alternative measurement methods available in case of device failure or data loss. This ensures continuity in data collection and reduces the impact of technical issues on the study’s integrity. | |
Subjective bias in self-report measures | Anonymity and confidentiality: Assure participants of the anonymity and confidentiality of their responses. Emphasize that their honest and accurate feedback is crucial for the study’s success. Implement secure data management practices to protect participants’ privacy. |
Clear instructions: Provide clear instructions for completing self-report questionnaires, emphasizing the importance of honest and thoughtful responses. Include prompts or examples to guide participants in providing accurate information. | |
Misunderstanding—confusion in a specific question of the questionnaire | Momentum mitigation strategy: Ask participants whether they understood. |
The mitigation strategy for future case studies: review and revise questions to ensure they are easily understood. | |
Time estimations—difficulties in defining an average time estimation for users | Pilot testing: Conduct pilot tests with a small sample of participants to gather data on task durations. This preliminary data can help researchers refine their estimates and identify any significant variations in completion times. |
Expert opinion: Seek input from domain experts or individuals experienced in the specific tasks being studied. Their expertise can provide valuable insights into task complexities and potential time requirements, aiding in more accurate estimations. | |
Task analysis: Break down complex tasks into smaller sub-tasks or steps and estimate the time needed for each component. This detailed analysis allows for a more precise estimation of overall task duration. | |
Iterative refinement: Continuously refine and update time estimations based on ongoing observations and feedback from participants. Adjustments can be made to better align with participants’ actual performance and ensure more accurate time predictions. |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Apraiz, A.; Lasa, G.; Montagna, F.; Blandino, G.; Triviño-Tonato, E.; Dacal-Nieto, A. An Experimental Protocol for Human Stress Investigation in Manufacturing Contexts: Its Application in the NO-STRESS Project. Systems 2023, 11, 448. https://doi.org/10.3390/systems11090448
Apraiz A, Lasa G, Montagna F, Blandino G, Triviño-Tonato E, Dacal-Nieto A. An Experimental Protocol for Human Stress Investigation in Manufacturing Contexts: Its Application in the NO-STRESS Project. Systems. 2023; 11(9):448. https://doi.org/10.3390/systems11090448
Chicago/Turabian StyleApraiz, Ainhoa, Ganix Lasa, Francesca Montagna, Graziana Blandino, Erika Triviño-Tonato, and Angel Dacal-Nieto. 2023. "An Experimental Protocol for Human Stress Investigation in Manufacturing Contexts: Its Application in the NO-STRESS Project" Systems 11, no. 9: 448. https://doi.org/10.3390/systems11090448
APA StyleApraiz, A., Lasa, G., Montagna, F., Blandino, G., Triviño-Tonato, E., & Dacal-Nieto, A. (2023). An Experimental Protocol for Human Stress Investigation in Manufacturing Contexts: Its Application in the NO-STRESS Project. Systems, 11(9), 448. https://doi.org/10.3390/systems11090448