Next Article in Journal
SDC-Net: End-to-End Multitask Self-Driving Car Camera Cocoon IoT-Based System
Next Article in Special Issue
Digital Biomarkers of Gait and Balance in Diabetic Foot, Measurable by Wearable Inertial Measurement Units: A Mini Review
Previous Article in Journal
CFX: Contention-Free Channel Access for IEEE 802.11ax
Previous Article in Special Issue
Lower Limb Exoskeleton Sensors: State-of-the-Art
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Sensors
Volume 22
Issue 23
10.3390/s22239115
sensors-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Quantifying Cognitive Workload Using a Non-Contact Magnetocardiography (MCG) Wearable Sensor

by
Zitong Wang
1,†,
Keren Zhu
1,†,
Archana Kaur
2,
Robyn Recker
2,
Jingzhen Yang
2 and
Asimina Kiourti
1,*
1
ElectroScience Laboratory, Department of Electrical and Computer Engineering, The Ohio State University, Columbus, OH 43210, USA
2
Center for Injury Research and Policy, Abigail Wexner Research Institute at Nationwide Children’s Hospital, Columbus, OH 43215, USA
*
Author to whom correspondence should be addressed.
†
These authors contributed equally to this work.
Sensors 2022, 22(23), 9115; https://doi.org/10.3390/s22239115
Submission received: 31 October 2022 / Revised: 17 November 2022 / Accepted: 22 November 2022 / Published: 24 November 2022
(This article belongs to the Special Issue Applications of Body Worn Sensors and Wearables)
Browse Figures
Review Reports Versions Notes

Abstract

:
Quantifying cognitive workload, i.e., the level of mental effort put forth by an individual in response to a cognitive task, is relevant for healthcare, training and gaming applications. However, there is currently no technology available that can readily and reliably quantify the cognitive workload of an individual in a real-world environment at a seamless way and affordable price. In this work, we overcome these limitations and demonstrate the feasibility of a magnetocardiography (MCG) sensor to reliably classify high vs. low cognitive workload while being non-contact, fully passive and low-cost, with the potential to have a wearable form factor. The operating principle relies on measuring the naturally emanated magnetic fields from the heart and subsequently analyzing the heart rate variability (HRV) matrix in three time-domain parameters: standard deviation of RR intervals (SDRR); root mean square of successive differences between heartbeats (RMSSD); and mean values of adjacent R-peaks in the cardiac signals (MeanRR). A total of 13 participants were recruited, two of whom were excluded due to low signal quality. The results show that SDRR and RMSSD achieve a 100% success rate in classifying high vs. low cognitive workload, while MeanRR achieves a 91% success rate. Tests for the same individual yield an intra-subject classification accuracy of 100% for all three HRV parameters. Future studies should leverage machine learning and advanced digital signal processing to achieve automated classification of cognitive workload and reliable operation in a natural environment.

1. Introduction

Cognitive workload is defined as the level of mental effort put forth by an individual in response to a cognitive task [1]. For example, when considerable mental effort is exerted or the cognitive workload is high, the individual’s information-processing abilities may be slowed [2]. Quantifying the level of cognitive workload in real-time has real-world applications across several domains, such as preventing distracted driving [3], rating pilots’ performance [4] and providing individualized return-to-learn guidelines following mild traumatic brain injury [5]. Though questionnaire surveys and observation of human behavior can be used to estimate cognitive workload, such estimates are subjective (hence, subject to bias) and are not available on a continuous, real-time basis [6,7,8].
Extensive research in recent years has addressed the development of objective measures to quantify cognitive workload. These refer to measurements of various physiological signals from the human body that objectively reflect cognitive workload changes. For example, electroencephalography (EEG) has emerged as a promising technology in this regard, where brain oscillations in the alpha and theta bands are sensitive to the mental task difficulty level [9]. Specifically, as the task difficulty increases, the cognitive workload increases, so that alpha power decreases whereas theta power increases [10]. However, EEG devices are obtrusive, consisting of tens of electrodes placed around the scalp as well as heavy amplifiers and cable connections to recording devices [11]. As such, they are unsuitable for monitoring an individual’s cognitive workload in a natural environment. Though portable EEG headsets with a small number of channels have been used to combat this issue [12], the noise level prohibits highly accurate monitoring of cognitive workload in real-world scenarios. Furthermore, placing electrodes on the scalp takes time, and gel dehydration on the skin provides no guarantee for acceptable signal quality over long periods of time. As an alternative, previous research has explored pupillometry as a means of seamlessly quantifying cognitive workload via “smart” glasses that monitor pupil dilation [13]. However, ambient light and ambient noise act as a contaminating component that influences pupil dilation, and there are very few approaches available to reduce these factors [14,15]. In addition, given the abovementioned “smart” glasses are costly, they are unsuitable for day-to-day use by the general population. Facial thermography is another measure of cognitive workload that is non-invasive and non-intrusive [16]. However, the approach is restricted to constrained environments and requires line-of-sight with the participants’ faces. This limits the application of facial thermography in real-world environments as well as the participants’ degrees of freedom.
More recently, electrocardiography (ECG) has been shown to accurately classify workload based on cardiac measures and, specifically, heart rate variability (HRV) [17]. HRV quantifies the variation in the time interval between consecutive heartbeats and correlates to activities of both the autonomic nervous system (ANS) and the cardiovascular system [18,19]. Notably, HRV has been demonstrated to exhibit sensitivity to task load, conditions of event rate and task duration. For example, in [20,21], authors show that HRV extracted from ECG can successfully differentiate between different flight and driving phases. In [22], HRV achieved a classification accuracy of 93.4% in detecting high cognitive load and >90% in detecting real-life stress. In [23], both HRV and EEG were used to measure the effect of neurofeedback training in the sports domain based on their association with cognition. However, ECG sensors require direct electrode contact with the skin; this makes them cumbersome for daily wear, have low signal/contact quality when employed outside the clinical environment and prone to errors with underlying sweat and hair, possibly causing skin irritation and allergies (which, in turn, degrade signal quality). Though commercial wearables claim to derive HRV (e.g., smartwatches and fitness trackers), these metrics are known to be greatly inaccurate, particularly under dynamic conditions [24,25].
In this paper, we take a major step forward and demonstrate the feasibility of a magnetocardiography (MCG) sensor to accurately quantify cognitive workload while overcoming limitations in the state-of-the-art. MCG is the magnetic field equivalent of ECG: It measures the magnetic flux induced by the current flowing through the heart. Our recent work has demonstrated that an MCG sensor can capture the R-peaks of cardiac activity in real-time and in a non-contact manner, i.e., without any skin contact [26]. In brief, the sensor consists of an array of miniaturized coils that couple to the magnetic field of the heart when placed in proximity (e.g., upon the chest). Following extensive post-processing to denoise the collected signals (including averaging across the coils, filtering, etc.), the R-peaks can be retrieved. Our MCG sensor has no skin-contact-related issues described earlier for ECG and can be comfortably worn as part of a garment, making it a highly promising solution for real-world monitoring of cognitive workload [27]. An added advantage is that MCG signals are transparent to underlying tissues (tissues are non-magnetic), providing promise for an even higher level of accuracy as compared to ECG-based metrics. (Tissues are dielectric materials impacting the electric field.) Here, we report a proof-of-concept study to confirm our MCG sensor’s feasibility in this regard. We monitored the MCG-derived HRV parameters among 11 healthy adults of ages 20 to 35 as they performed low and high cognitive activities and demonstrated successful classification of the cognitive workload level at 91% to 100% accuracy for different HRV metrics and 100% accuracy for multiple repetitions on the same subject. To our knowledge, this is the first time that an MCG sensor is used for cognitive workload classification.

2. Methods

2.1. Study Participants

For this study, 13 healthy adults (6 females and 7 males) between the ages of 20 and 35 (M = 25.69 years; SD = 4.517 years) were recruited, as shown in Table 1. Data on sex were collected to confirm the sensor performance regardless of the presence of breast tissue. Height and weight data were collected, and the Body Mass Index (BMI) was calculated to serve as an indicator of the distance between the MCG sensor and the heart. Two participants (subject 12 and subject 13) were eliminated from subsequent processing due to low signal quality, i.e., clear R-peaks could not be identified in the MCG recordings of these two participants. We note that both eliminated subjects were female with thicker breast tissue, which may have contributed to the total absence of the R-peaks given the: (a) increased distance between the heart and the sensor and (b) the difficulty in identifying the optimal placement location. Other reasons include, but are not limited to, higher background noise being present during those times/days. The study and test protocol received Institutional Review Board (IRB) approval at The Ohio State University (IRB study #2019H0259). Our IRB protocol has an explicit inclusion criterion related to healthy BMI, so we excluded participants with high BMI to reduce the risk of poor signal quality due to the weak strength of the MCG signal reaching the sensor.

2.2. Experimental Setup

Our experimental setup is shown in Figure 1. Each participant was asked to sit on a zero-gravity chair with an MCG sensor wrapped around his/her chest. The chair was selected to provide comfort across the duration of the experiment and to reduce motion artifacts for this proof-of-concept study. The MCG sensor was designed based on our previous work [26,27] and consisted of an array of seven coils (each 11 mm in height and 15 mm in diameter), embedded within a circular 3D-printed fixture of 60 mm in diameter. The fixture with the embedded coils is shown in Figure 1 and was embedded in an elastic chest belt that wrapped around the participant’s torso. We counted from the clavicle and down to the space between the third and fourth ribs to identify the location of the heart and aligned the MCG sensor with this location [28]. Misplacement of the sensor can possibly reduce the MCG signal accuracy (to the extent of complete absence of R-peaks in the retrieved signal) but not the cognitive workload detection accuracy (as long as R-peaks are visible). However, this can only happen under extreme misplacement scenarios: Misalignment by a few centimeters does not affect the sensor’s ability to detect R-peaks. As long as the sensor is placed upon the breast area, research has shown that R-peaks can be still detected as MCG activity is present throughout the chest area [29]. Raw MCG signals were captured by the human heart, bandpass filtered, amplified, digitized via an Analog to Digital Converter (ADC) and sent to a laptop computer for post-processing. To collect “gold-standard” cardiac measures for comparison, a three-lead ECG sensor was attached to the participant’s skin. The ECG electrodes were placed on the abdominal area, left wrist, and right wrist, respectively. ECG data traveled from the leads to an acquisition circuit board and then eventually to the ADC and the laptop computer. The ADC sampling rate for both MCG and ECG was set to 5 kHz. To induce low and high cognitive workload, two screens were placed in front of the participant, as will be described in detail in Section 2.3.

2.3. Low and High Cognitive Workload Test Conditions

To mimic different levels of cognitive workload, two conditions (viz. high and low load) were carried out for each participant. The high workload task was designed as a dual task where the participants were instructed to (1) watch a relaxing video, depicting underwater sea life, on the screen placed in front of them and (2) provide answers to simple math problems of 2 digits ± 2 digits (i.e., addition or subtraction of 2-digit numbers). The low workload task was designed as a single task where the participants were instructed to only watch the relaxing video on the screen. Literature has indicated that the tasks of watching a relaxing video and answering math problems each induce a certain level of cognitive workload on the participant [30,31]. Literature has also shown that dual-task scenarios (i.e., combining tasks) increase the processing demands as compared to single-task scenarios, hence further increasing the cognitive workload [32]. Along these lines, the dual-task (math + video) scenario described here serves to induce an increased level of cognitive workload or high cognitive workload as compared to the single-task (video) scenario or low cognitive workload. The cognitive workload we aim to quantify entails the general level of mental effort at a time, hence the exact type of workload resources is relevant to this study. With the above in mind, we selected the video and math problem tasks as they: (a) are valid measures and easy to implement using just a personal computer and (b) can be completed with minimal body movement as needed to ensure success for the MCG data collection.
The math problems along with an answer were shown on a computer screen ~6 feet away from the participants to reduce possible large electronic interference, and a cell phone that was on airplane mode was placed in front of the participants to record the answer. The participants were instructed to tap “1” on a cell phone if they believed the answer was correct and “0” if it was incorrect. All math problems were machine-based and appeared automatically on the screen of a tablet one by one with an interval of 1.5 s. We purposely selected a short (1.5 s) interval to keep the participants truly engaged, noting that cognitive workload may increase not only due to the dual-task but also due to the potential time pressure. The participants’ responses were recorded in parallel to their MCG and ECG signal activity to confirm their level of engagement. In summary, a mental arithmetic task was used to differentiate between low and high cognitive workload, as based on the sensory intake/rejection hypothesis previously reported in the literature [33]. Each scenario, i.e., low cognitive workload or high cognitive workload, lasted for 5 min according to previous studies for ECG-based workload classification [34]. At the end of each test session, we asked each participant to report their perceived difficulty level of the math problems as difficult, not difficult nor easy, or easy to measure their efforts in completing high cognitive workload tasks.

2.4. Heart Rate Variability (HRV) Parameters

By monitoring the time intervals between consecutive R-peaks of the MCG and ECG signals, HRV parameters can be retrieved. As mentioned in Section 1, cardiovascular activity is known to relate to human cognitive function, and ECG-derived HRV parameters have previously been used to quantify the cognitive workload of drivers and pilots. In general, HRV can be analyzed either in the time domain or the frequency domain [35,36]. In this study, we pursued time domain analysis as it (1) facilitates translation from the ECG-derived metrics to the MCG-derived ones, (2) empowers evaluation with limited recording time and (3) has been widely used in prior works [37]. ECG-based frequency domain analysis [38] has found correlations between the oscillatory components within different ECG frequency bands and different levels of cognitive workload. However, these findings cannot be directly translated into the MCG-derived frequency domain parameters as MCG (estimated as the derivative of the corresponding ECG) is expected to have an added jω factor in each band of the frequency domain index. In addition, frequency domain analysis is strictly restricted by the duration of the recording time. Typically, recordings captured with less than 24 h of time duration cannot reliably access lower frequency components [39,40].
Based on the above, we pursued time-domain analysis and evaluated the following three metrics: (a) standard deviation of RR intervals (SDRR), (b) root mean square of successive RR interval differences (RMSSD) and (c) mean of RR intervals (MeanRR). To do so, Matlab was deployed to process both the recorded MCG and ECG data. Our R-peak detection algorithm entailed the use of the “findpeak” function in Matlab, with defined minimal distance between two neighboring peaks and defined minimal R peak level/strength. This algorithm was first used to detect the location (time) of all R peaks throughout the whole 5 min of recording time for both ECG and MCG. The distances between two neighboring R-peaks were then calculated and referred to as the RR intervals. In case of missing/duplicated R-peaks (large/small RR intervals)—typically due to motional artifacts in the recorded signal—those R-peaks and associated RR intervals were eliminated. As would be expected, missing or duplicate R-peaks will increase or decrease the RR intervals beyond the allowable values. Hence, we first calculated all the RR intervals based on the visible R-peaks and then excluded those intervals that were beyond the clinically allowable values. This process reduced the duration of all available MCG and ECG data to ~3 min (out of the 5-min test) to ensure consistency among all tests. The RR intervals were finally used to derive the HRV metrics, ensuring that they lay within the anticipated ranges as a sanity check for our algorithm (i.e., healthy ECG derived SDRR should be 15.39 to 93 ms; mean RR should be 800 to 1300 ms; and RMSSD should be 15 to 75 ms [41,42,43,44]).

3. Results

3.1. Validation of MCG Sensor Performance

As a first step, we validated the performance of the MCG sensor and its ability to accurately derive the target HRV parameters. We recruited one participant and collected synchronized MCG and ECG data for a total of ~5 min per Section 2.1, without specifically inducing low or high cognitive workload conditions. To ensure repeatability, we repeated this test seven different times. An example plot of MCG and ECG data is shown in Figure 2, confirming the intended correlation between the two plots. Here, the Matlab built-in bandpass filter (zero-phase) was used to correct the phase distortion due to filtering. We note that the two signals were not expected to be in perfect synchronization given that MCG is the derivative of ECG, but the number of R-peaks and, hence, the number of QRS complexes should be the same [45]. Using our R-peak detection algorithm, we identified the R-peaks and calculated the SDRR, RMSSD and MeanRR as summarized in Table 2. Notably, all HRV values were within the anticipated ranges outlined in Section 2.4, while the MCG-derived SDRR and MeanRR metrics were very close to those derived by “gold-standard” ECG [46]. The MCG-derived RMSSD metric aligned well with the ECG-derived value for most trials but was different as encountered in the last three trials. This might be due to noise and/or RMSSD being known to be more sensitive to the parasympathetic nervous system (PNS) as compared to SDRR and MeanRR. [47].

3.2. Confirmation of Engagement during the High Cognitive Workload Testing Conditions

We proceeded to record MCG and ECG data for the 11 participants presented in Table 3 during the low and high cognitive workload activities outlined in Section 2.3. Table 3 summarizes: (a) the difficulty level of the math problems as self-reported by the participants and (b) the participants’ performance to the math problems (i.e., percentage of the answers they got correct). As seen, all 11 subjects self-reported that the problems were “Difficult”, hence confirming that the participants’ efforts in completing these high cognitive workload tasks were at a relative high level. It is noted that the high cognitive workload in this study was not induced via the difficulty of the math problems but rather by adding a set of math problems as an additional task while watching a relaxing video. Also, all subjects achieved ≥90% accuracy (accuracy = [number of correct answers to math problems]/[total number of math problems] × 100(%)) in answering the math problems, hence confirming that they truly engaged throughout the high cognitive workload task.

3.3. Inter-Subject Classification Performance

HRV parameters derived using the MCG and ECG sensors are shown in Figure 3. Specifically, Figure 3a shows the SDRR metric; Figure 3b shows the RMSSD metric; and Figure 3c shows the MeanRR metric. The blue dashed line corresponds to the low cognitive workload condition, while the black solid line corresponds to the high cognitive workload condition. Referring to Figure 3, excellent performance was observed in distinguishing between high and low cognitive workload for the MCG and ECG sensors. Notably, the classification accuracy of MCG was identical to “gold standard” ECG, confirming once again its reliability to monitor HRV [48,49]. Specifically, SDRR achieved a 100% success rate in discerning low from high cognitive workload across the 11 subjects; RMSSD achieved a 100% success rate; and MeanRR achieved a 91% success rate (where success rate = [number of correctly classified high and low workload tests]/[total number of tests] × 100(%)). The non-optimal accuracy for the MeanRR metric was due to Subject 5 who showed a higher instead of lower MeanRR value for the high cognitive workload case as compared to the low cognitive workload case.

3.4. Intra-Subject Classification Performance

To confirm the intra-subject classification accuracy of the sensor, Subject 2 of Table 1 repeated the testing protocol eight times on eight different days. The participant assessed the difficulty level of the high-cognitive workload task as “difficult” for all eight trials. HRV results are summarized in Figure 4 for the MCG- and ECG-derived metrics under low (blue-dashed) and high (black-solid) workload conditions. Figure 4 once again validates the performance of MCG as compared to “gold-standard” ECG and shows a 100% success rate of workload classification for this single participant. By observing Figure 4, the signal appears to increase when the experiment is repeated. Nevertheless, all trials were performed on different times and days, meaning that they are independent from each other, and hence such a “trend” may just be a coincidence. More extensive studies will be pursued in this regard in the future. Despite such trend, a distinctive threshold can still be defined for all HRV parameters listed using the reported eight trials.

4. Discussion

In this work, we evaluated the feasibility of a novel MCG sensor to classify high vs. low cognitive workload among healthy adult participants. Our results confirmed excellent agreement of HRV metrics (SDRR, RMSSD, MeanRR) derived using the MCG sensor as compared to “gold-standard” ECG. Our results also confirmed the sensor’s ability to distinguish between high and low cognitive workload using these HRV metrics.
The reported MCG sensor operates in non-shielded environments, requires no skin contact and is low-cost, hence overcoming limitations of state-of-the-art technologies used to classify cognitive workload. Though the electronics associated with the MCG sensor are currently bulky, these can be readily miniaturized in the future to empower a wearable sensor form factor for operation in real-world environments.
Our in vivo studies demonstrated a 100% success rate in classifying high vs. low cognitive workload for the SDRR and RMSSD metrics and a 91% success rate for the MeanRR metric across 11 adult participants. One of the participants had an inconsistent trend in MeanRR value. Though environmental noise and respiratory frequency influences might have led to this erroneous result, the exact reason was unknown at this stage. An additional two participants were recruited (both female) but demonstrated high noise in the collected MCG data, likely due to the presence of breast tissue that increased the distance between the heart and the sensor. They were hence excluded from the analysis. As is well known, the PNS is a division of the ANS that directly influences the increasing and decreasing HRV parameters. The PNS will inhibit cardiac activities in response to increasing workload [50], hence it is expected that SDRR, RMSSD and MeanRR will drop when people have higher attentional workload demands. This was indeed confirmed by our results in Figure 3 and Figure 4.
Repeatability results for a single participant showed 100% classification accuracy of high vs. low cognitive workload for all three HRV metrics under consideration. Though not generalizable, these results also showed a clear threshold level for each of the HRV metrics for the participant. This suggests that a personalized threshold likely exists for each individual, though subject to change over the course of time.
In summary, the proposed MCG sensor shows high promise for cognitive workload classification in numerous applications, both inside and outside laboratory settings. Future work should focus on expanding upon additional HRV metrics, enhancing the participant pool, improving the sensor performance regardless of the presence of breast tissue, automating cognitive workload classification using artificial intelligence and quantifying more than two cognitive workload levels via the addition of math problems of varying difficulty. To our knowledge, this is the first study in which MCG is explored for quantifying cognitive workload in vivo. Our preliminary results could serve as a proof-of-concept, aiming to ultimately open a path forward towards future studies in the field. Specifically, our work quantified two distinct cognitive workload conditions, though, continuous cognitive workload assessment of multiple levels is needed in the future. To this end, future work should focus on refining the task design, exploring the specific type of workload elicited and adding more levels of workload conditions. Our study pool was also limited: We recruited 13 subjects with healthy BMIs and recorded acceptable MCG data from 11 of the 13 subjects recruited. Future studies with a larger study sample and broader demographics are needed to confirm our findings. The sensor hardware and software (algorithms) will also be optimized to ensure high accuracy across all participants. Finally, the study is conducted in a laboratory environment with minimum to no movement allowed by the participants. In the future, the system will be refined for operation in real-world environments where subjects move in a dynamic manner.

Author Contributions

Conceptualization, J.Y. and A.K. (Asimina Kiourti); methodology, Z.W., K.Z., R.R., A.K. (Archana Kaur), J.Y. and A.K. (Asimina Kiourti); validation, Z.W., K.Z., R.R. and A.K. (Archana Kaur); writing—original draft preparation, Z.W., K.Z. and A.K. (Asimina Kiourti); writing—review and editing, Z.W., K.Z., R.R., A.K. (Archana Kaur), J.Y. and A.K. (Asimina Kiourti); funding acquisition, J.Y. and A.K. (Asimina Kiourti). All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by The Ohio State University Chronic Brain Injury Discovery Theme.

Institutional Review Board Statement

The human study protocol was approved by the Institutional Review Board of The Ohio State University protocol #2019H0259.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are available on request from the corresponding author.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Peterson, L.; Peterson, M.J. Short-term retention of individual verbal items. J. Exp. Psychol. 1595, 58, 193. [Google Scholar] [CrossRef] [PubMed]
  2. Rozado, D.; Dunser, A. Combining EEG with pupillometry to improve cognitive workload detection. Computer 2015, 48, 425–438. [Google Scholar] [CrossRef]
  3. Mohammad, A.A.; Anh, H.D.; Wataru, K. Cognitive workload detection from raw EEG-signals of vehicle driver using deep learning. In Proceedings of the IEEE 2019 21st International Conference on Advanced Communication Technology (ICACT), PyeongChang, Korea, 17–20 February 2019. [Google Scholar]
  4. Dehais, F.; Duprès, A.; Blum, S.; Drougard, N.; Scannella, S.; Raphaëlle, N.R.; Lotte, F. Monitoring pilot’s mental workload using ERPs and spectral power with a six-dry-electrode EEG system in real flight conditions. Sensors 2019, 9, 1324. [Google Scholar] [CrossRef] [Green Version]
  5. Anthony, A.; Elizabeth, C.; Prithima, M.; Lukasz, M. Classification of EEG Features for Prediction of Working Memory Load. In Advances in The Human Side of Service Engineering; Ahram, T., Karwowski, W., Eds.; Springer: Cham, Switzerland, 2017; pp. 32–58. [Google Scholar]
  6. Zak, Y.; Parmet, Y.; Oron-Gilad, T. Subjective Workload assessment technique (SWAT) in real time: Affordable methodology to continuously assess human operators’ workload. In Proceedings of the IEEE 2020 IEEE International Conference on Systems, Man, and Cybernetics (SMC), Toronto, ON, Canada, 17–20 October 2020. [Google Scholar]
  7. Malagoli, A.; Corradini, M.; Corradini, P.; Shuett, T.; Fonda, S. Towards a method for the objective assessment of cognitiveworkload: A pilot study in vessel traffic service (VTS) of maritime domain. In Proceedings of the IEEE 2017 IEEE 3rd International Forum on Research and Technologies for Society and Industry (RTSI), Modena, Italy, 11–13 September 2017. [Google Scholar]
  8. Vidulich, M.A. The cognitive psychology of subjective mental workload. In Advances in Psychology; Peter, A.H., Najmedin, M., Eds.; Elsevier: Amsterdam, The Netherlands, 1988; pp. 219–229. [Google Scholar]
  9. Antonenko, P.; Paas, F.; Grabner, R.; Van Gog, T. Using electroencephalography to measure cognitive load. Educ. Psychol. Rev. 2010, 22, 425–438. [Google Scholar] [CrossRef]
  10. Mohanavelu, K.; Poonguzhali, S.; Ravi, D.; Singh, P.K.; Mahajabin, M.; Ramachandran, K.; Singh, U.K.; Jayaraman, S. Cognitive Workload Analysis of Fighter Aircraft Pilots in Flight Simulator Environment. Def. Sci. J. 2020, 70, 131–139. [Google Scholar] [CrossRef]
  11. Tao, D.; Tan, H.; Wang, H.; Zhang, X.; Qu, X.; Zhang, T. A systematic review of physiological measures of mental workload. Int. J. Environ. Res. Public Health 2019, 16, 2716. [Google Scholar] [CrossRef] [Green Version]
  12. Kim, J.; Lee, J.; Han, C.; Park, K. An instant donning multi-channel EEG headset (with comb-shaped dry electrodes) and BCI applications. Sensors 2019, 19, 1537. [Google Scholar] [CrossRef] [Green Version]
  13. Pignoni, G.; Komandur, S. Development of a quantitative evaluation tool of cognitive workload in field studies through eye tracking. In Proceedings of the International Conference on Human-Computer Interaction, Orlando, FL, USA, 26–31 July 2019. [Google Scholar]
  14. Pedrotti, M.; Mirzaei, M.A.; Tedesco, A.; Chardonnet, J.R.; Mérienne, F.; Benedetto, S.; Baccino, T. Automatic stress classification with pupil diameter analysis. Int. J. Hum.-Comput. Interact. 2014, 30, 220–236. [Google Scholar] [CrossRef] [Green Version]
  15. Domingos, C.; da Silva Caldeira, H.; Miranda, M.; Melício, F.; Rosa, A.C.; Pereira, J.G. The Influence of Noise in the Neurofeedback Training Sessions in Student Athletes. Int. J. Environ. Res. Public Health 2021, 18, 13223. [Google Scholar] [CrossRef]
  16. Marinescu, A.C.; Sharples, S.; Ritchie, A.C.; Sanchez Lopez, T.; McDowell, M.; Morvan, H.P. Physiological parameter response to variation of mental workload. Hum. Factors 2018, 60, 31–56. [Google Scholar] [CrossRef]
  17. Aeschbacher, S.; Bossard, M.; Ruperti Repilado, F.J.; Good, N.; Schoen, T.; Zimny, M.; Probst-Hensch, N.M.; Schmidt-Trucksäss, A.; Risch, M.; Risch, L.; et al. Healthy lifestyle and heart rate variability in young adults. Eur. J. Prev. Cardiol. 2016, 23, 1037–1044. [Google Scholar] [CrossRef]
  18. Shaffer, F.; McCraty, R.; Zerr, C.L. A healthy heart is not a metronome: An integrative review of the heart’s anatomy and heart rate variability. Front. Psychol. 2014, 5, 1040. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  19. Malliani, A.; Pagani, M.; Lombardi, F.; Cerutti, S. Cardiovascular neural regulation explored in the frequency domain. Circulation 1991, 84, 482–492. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  20. Mansikka, H.; Virtanen, K.; Harris, D.; Simola, P. Fighter pilots’ heart rate, heart rate variation and performance during an instrument flight rules proficiency test. Appl. Ergon. 2016, 56, 213–219. [Google Scholar] [CrossRef] [PubMed]
  21. Fujiwara, K.; Abe, E.; Kamata, K.; Nakayama, C.; Suzuki, Y.; Yamakawa, T.; Hiraoka, T.; Kano, M.; Sumi, Y.; Masuda, F.; et al. Heart rate variability-based driver drowsiness detection and its validation with EEG. IEEE Trans. Biomed. Eng. 2018, 66, 1769–1778. [Google Scholar] [CrossRef] [PubMed]
  22. Tjolleng, A.; Jung, K.; Hong, W.; Lee, W.; Lee, B.; You, H.; Son, J.; Park, S. Classification of a Driver’s cognitive workload levels using artificial neural network on ECG signals. Appl. Ergon. 2017, 59, 326–332. [Google Scholar] [CrossRef] [PubMed]
  23. Domingos, C.; Silva, C.M.D.; Antunes, A.; Prazeres, P.; Esteves, I.; Rosa, A.C. The influence of an alpha band neurofeedback training in heart rate variability in athletes. Int. J. Environ. Res. Public Health 2021, 18, 12579. [Google Scholar] [CrossRef]
  24. Kalevo, L.; Miettinen, T.; Leino, A.; Kainulainen, S.; Korkalainen, H.; Myllymaa, K.; Töyräs, J.; Leppänen, T.; Laitinen, T.; Myllymaa, S. Effect of sweating on electrode-skin contact impedances and artifacts in EEG recordings with various screen-printed Ag/Agcl electrodes. IEEE Access 2020, 8, 50934–50943. [Google Scholar] [CrossRef]
  25. Rodrigues, E.; Lima, D.; Barbosa, P.; Gonzaga, K.; Guerra, R.O.; Pimentel, M.; Barbosa, H.; Maciel, Á. HRV Monitoring Using Commercial Wearable Devices as a Health Indicator for Older Persons during the Pandemic. Sensors 2022, 22, 2001. [Google Scholar] [CrossRef]
  26. Zhu, K.; Kiourti, A. Detection of Extremely Weak and Wideband Bio-Magnetic Signals in Non-Shielded Environments Using Passive Coil Sensors. IEEE J. Electromagn. RF Microw. Med. Biol. 2022, 1–8. [Google Scholar] [CrossRef]
  27. Zhu, K.; Shah, A.M.; Berkow, J.; Kiourti, A. Miniature Coil Array for Passive Magnetocardiography in Non-Shielded Environments. IEEE J. Electromagn. RF Microw. Med. Biol. 2020, 5, 124–131. [Google Scholar] [CrossRef]
  28. Bauemschmitt, R.; Feuerstein, M.; Schirmbeck, E.U.; Traub, J.; Klinker, G.; Wildhirt, S.M.; Lange, R. Improved preoperative planning in robotic heart surgery. In Proceedings of the Computers in Cardiology, Chicago, IL, USA, 19–22 September 2004; pp. 773–776. [Google Scholar]
  29. Puurtinen, M.; Viik, J.; Hyttinen, J. Best electrode locations for a small bipolar ECG device: Signal strength analysis of clinical data. Ann. Biomed. Eng. 2009, 37, 331–336. [Google Scholar] [CrossRef] [PubMed]
  30. Costley, J.; Fanguy, M.; Lange, C.; Baldwin, M. The effects of video lecture viewing strategies on cognitive load. J. Comput. High. Educ. 2021, 33, 19–38. [Google Scholar] [CrossRef] [Green Version]
  31. Aalioui, L.; Gouzi, F.; Tricot, A. Reducing cognitive load during video lectures in physiology with eye movement modeling and pauses: A randomized controlled study. Adv. Physiol. Educ. 2022, 46, 288–296. [Google Scholar] [CrossRef] [PubMed]
  32. Rubio, S.; Diaz, E.; Martin, J.; Puente, J. Evaluation of Subjective Mental Workload: A Comparison of SWAT, NASA-TLX, and Workload Profile Methods. Appl. Psychol. 2004, 53, 61–86. [Google Scholar] [CrossRef]
  33. Turner, J.R.; Hewitt, J.K.; Morgan, R.K.; Sims, J.; Carroll, D.; Kelly, K.A. Graded mental arithmetic as an active psychological challenge. Int. J. Psychophysiol. Off. J. Int. Organ. Psychophysiol. 1986, 3, 307–309. [Google Scholar] [CrossRef]
  34. Novak, D. Biomechatronic applications of brain-computer interfaces. In Handbook of biomechatronics, 1st ed.; Jacob, S., Ed.; Academic Press: Cambridge, MA, USA, 2019; pp. 129–175. [Google Scholar]
  35. Evrengül, H.; Tanriverdi, H.; Dursunoglu, D.; Kaftan, A.; Kuru, O.; Unlu, U.; Kilic, M. Time and frequency domain analyses of heart rate variability in patients with epilepsy. Epilepsy Res. 2005, 63, 131–139. [Google Scholar] [CrossRef]
  36. Kurosaka, C.E.; Kuraoka, H.; Miyake, S. Poincaré Plot Indexes of Heart Rate Variability: Pattern II Responses and Mental Workload. In International Conference on Human-Computer Interaction; Springer: Cham, Switzerland, 2019; pp. 238–243. [Google Scholar]
  37. Kumar, P.; Das, A.K.; Halder, S. Time-domain HRV analysis of ECG signal under different body postures. Procedia Comput. Sci. 2020, 167, 1705–1710. [Google Scholar] [CrossRef]
  38. Wang, Y.; Zhang, C.; Chen, S.; Li, X.; Jin, H.; Du, J. Frequency domain indices of heart rate variability are useful for differentiating vasovagal syncope and postural tachycardia syndrome in children. J. Pediatrics 2019, 207, 59–63. [Google Scholar] [CrossRef]
  39. Baek, H.J.; Cho, C.H.; Cho, J.; Woo, J.M. Reliability of ultra-short-term analysis as a surrogate of standard 5-min analysis of heart rate variability. Telemed. E-Health 2015, 21, 404–414. [Google Scholar] [CrossRef]
  40. Castaldo, R.; Montesinos, L.; Melillo, P.; James, C.; Pecchia, L. Ultra-short term HRV features as surrogates of short term HRV: A case study on mental stress detection in real life. BMC Med. Inform. Decis. Mak. 2019, 19, 1–13. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  41. Friedman, B.H.; Allen, M.T.; Christie, I.C.; Santucci, A.K. Validity concerns of common heart-rate variability indices. IEEE Eng. Med. Biol. Mag. 2022, 21, 35–40. [Google Scholar] [CrossRef] [PubMed]
  42. Kim, G.M.; Woo, J.M. Determinants for heart rate variability in a normal Korean population. J. Korean Med. Sci. 2011, 26, 1293–1298. [Google Scholar] [CrossRef] [Green Version]
  43. Sammito, S.; Böckelmann, I. Reference values for time-and frequency-domain heart rate variability measures. Heart Rhythm 2016, 13, 1309–1316. [Google Scholar] [CrossRef]
  44. Ernst, G. Heart-rate variability—More than heart beats? Front. Public Health 2017, 5, 240. [Google Scholar] [CrossRef] [Green Version]
  45. Reermann, J.; Elzenheimer, E.; Schmidt, G. Real-time biomagnetic signal processing for uncooled magnetometers in cardiology. IEEE Sens. J. 2019, 519, 4237–4249. [Google Scholar] [CrossRef]
  46. Fan, X.; Zhao, C.; Zhang, X.; Luo, H.; Zhang, W. Assessment of mental workload based on multi-physiological signals. Technol. Health Care 2020, 28, 67–80. [Google Scholar] [CrossRef]
  47. Lanfranchi, P.A.; Somers, V.K. Cardiovascular physiology: Autonomic control in health and in sleep disorders. In Principles and Practice of Sleep Medicine, 5th ed.; Meir, H.K., Thomas, R., William, C.D., Eds.; Elsevier Inc.: Philadelphia, PA, USA, 2010; Volume 1, pp. 226–236. [Google Scholar]
  48. Aygun, A.; Nguyen, T.; Haga, Z.; Aeron, S.; Scheutz, M. Investigating Methods for Cognitive Workload Estimation for Assistive Robots. Sensors 2022, 22, 6834. [Google Scholar] [CrossRef]
  49. Matuz, A.; van der Linden, D.; Kisander, Z.; Hernádi, I.; Kazmer, K.; Csatho, A. Enhanc cariac vagal ton in mntal fatig: Analysis of hart rat variability in Tim-on-Task, rcovry, an ractivity. PLoS ONE 2021, 16, 0238670. [Google Scholar] [CrossRef]
  50. Goldberger, J.J.; Challapalli, S.; Tung, R.; Parker, M.A.; Kadish, A.H. Relationship of heart rate variability to parasympathetic effect. Circlation 2001, 103, 1977–1983. [Google Scholar] [CrossRef]
Sensors 22 09115 g001 550
Figure 1. Experimental setup employed in this study.
Figure 1. Experimental setup employed in this study.
Sensors 22 09115 g001
Sensors 22 09115 g002 550
Figure 2. Comparison of MCG and ECG signals recorded on a human participant for the same time duration.
Figure 2. Comparison of MCG and ECG signals recorded on a human participant for the same time duration.
Sensors 22 09115 g002
Sensors 22 09115 g003 550
Figure 3. Comparison of HRV parameters for 11 participants under low (blue-dashed) and high (black-solid) cognitive workload conditions: (a) SDRR, (b) RMSSD and (c) MeanRR. MCG-derived metrics are shown to the left, and ECG-derived metrics are shown to the right.
Figure 3. Comparison of HRV parameters for 11 participants under low (blue-dashed) and high (black-solid) cognitive workload conditions: (a) SDRR, (b) RMSSD and (c) MeanRR. MCG-derived metrics are shown to the left, and ECG-derived metrics are shown to the right.
Sensors 22 09115 g003
Sensors 22 09115 g004 550
Figure 4. Comparison of HRV parameters for a single participant repeating 8 sessions of low (blue-dashed) and high (black-solid) cognitive workload conditions: (a) SDRR, (b) RMSSD and (c) MeanRR.
Figure 4. Comparison of HRV parameters for a single participant repeating 8 sessions of low (blue-dashed) and high (black-solid) cognitive workload conditions: (a) SDRR, (b) RMSSD and (c) MeanRR.
Sensors 22 09115 g004
Table
Table 1. Participant details recruited for this study.
Table 1. Participant details recruited for this study.
IDAgeSexHeight (m)Weight (kg)BMI (kg/m2)
Subject 128Female1.6348.518.3
Subject 224Male1.705519.0
Subject 324Male1.655620.6
Subject 425Male1.758026.1
Subject 523Male1.786520.5
Subject 635Female1.6756.520.3
Subject 730Male1.768126.1
Subject 823Male1.928222.2
Subject 925Male 1.796420.0
Subject 1020 Female1.7550 17.3
Subject 1123Female1.6352.619.8
Subject 1220 Female1.7550 17.3
Subject 1323Female1.6352.619.8
Table
Table 2. MCG- and ECG-derived HRV parameters for a human participant across 7 trials.
Table 2. MCG- and ECG-derived HRV parameters for a human participant across 7 trials.
Trial NumberSignal TypeSDRR (ms)RMSSD (ms)MeanRR (ms)
1MCG34.400722.5954806.0518
ECG33.944221.0884806.051
2MCG35.204427.6404841.4077
ECG36.120126.0375842.4552
3MCG30.521731.3984877.2591
ECG34.79430.7943877.2374
4MCG32.231332.9698863.9058
ECG36.20231.8829863.9223
5MCG39.067439.0887848.5608
ECG39.948929.8374848.5273
6MCG41.310944.9424782.5284
ECG37.988031.5640783.4569
7MCG42.428442.5028868.6371
ECG44.887528.6951868.6302
Table
Table 3. Summary of the participants’ self-reported level of difficulty as well as math performance.
Table 3. Summary of the participants’ self-reported level of difficulty as well as math performance.
IDSelf-Reported Difficulty LevelMath Performance
Subject 1Difficult92.4%
Subject 2Difficult92.4%
Subject 3Difficult91.67%
Subject 4Difficult91.4%
Subject 5Difficult98.33%
Subject 6Difficult93.67%
Subject 7Difficult91.139%
Subject 8Difficult96.25%
Subject 9Difficult98.33%
Subject 10Difficult93.44%
Subject 11Difficult90.00%
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Wang, Z.; Zhu, K.; Kaur, A.; Recker, R.; Yang, J.; Kiourti, A. Quantifying Cognitive Workload Using a Non-Contact Magnetocardiography (MCG) Wearable Sensor. Sensors 2022, 22, 9115. https://doi.org/10.3390/s22239115

AMA Style

Wang Z, Zhu K, Kaur A, Recker R, Yang J, Kiourti A. Quantifying Cognitive Workload Using a Non-Contact Magnetocardiography (MCG) Wearable Sensor. Sensors. 2022; 22(23):9115. https://doi.org/10.3390/s22239115

Chicago/Turabian Style

Wang, Zitong, Keren Zhu, Archana Kaur, Robyn Recker, Jingzhen Yang, and Asimina Kiourti. 2022. "Quantifying Cognitive Workload Using a Non-Contact Magnetocardiography (MCG) Wearable Sensor" Sensors 22, no. 23: 9115. https://doi.org/10.3390/s22239115

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop