Next Article in Journal
Research on Detection of Ultra-Low Concentration Anthrax Protective Antigen Using Graphene Field-Effect Transistor Biosensor
Next Article in Special Issue
The Future of Stress Management: Integration of Smartwatches and HRV Technology
Previous Article in Journal
Exploiting the PIR Sensor Analog Behavior as Thermoreceptor: Movement Direction Classification Based on Spiking Neurons
Previous Article in Special Issue
Wearable Devices for Remote Monitoring of Heart Rate and Heart Rate Variability—What We Know and What Is Coming
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Signal Quality Analysis of Single-Arm Electrocardiography

1
Department of Biomedical Engineering, I-Shou University, Kaohsiung 84001, Taiwan
2
Department of Computer Science and Information Engineering, Chaoyang University of Technology, Taichung 413310, Taiwan
3
Division of Information Systems, School of Computer Science and Engineering, The University of Aizu, Aizu-Wakamatsu City 965-8580, Japan
4
Department of Cardiology, E-Da Hospital, Kaohsiung 84001, Taiwan
*
Author to whom correspondence should be addressed.
Sensors 2023, 23(13), 5818; https://doi.org/10.3390/s23135818
Submission received: 28 May 2023 / Revised: 15 June 2023 / Accepted: 21 June 2023 / Published: 22 June 2023

Abstract

:
The number of people experiencing mental stress or emotional dysfunction has increased since the onset of the COVID-19 pandemic, as many individuals have had to adapt their daily lives. Numerous studies have demonstrated that mental health disorders can pose a risk for certain diseases, and they are also closely associated with the problem of mental workload. Now, wearable devices and mobile health applications are being utilized to monitor and assess individuals’ mental health conditions on a daily basis using heart rate variability (HRV), typically measured by the R-to-R wave interval (RRI) of an electrocardiogram (ECG). However, portable or wearable ECG devices generally require two electrodes to perform bipolar limb leads, such as the Einthoven triangle. This study aims to develop a single-arm ECG measurement method, with lead I ECG serving as the gold standard. We conducted static and dynamic experiments to analyze the morphological performance and signal-to-noise ratio (SNR) of the single-arm ECG. Three morphological features were defined, RRI, the duration of the QRS complex wave, and the amplitude of the R wave. Thirty subjects participated in this study. The results indicated that RRI exhibited the highest cross-correlation (R = 0.9942) between the single-arm ECG and lead I ECG, while the duration of the QRS complex wave showed the weakest cross-correlation (R = 0.2201). The best SNR obtained was 26.1 ± 5.9 dB during the resting experiment, whereas the worst SNR was 12.5 ± 5.1 dB during the raising and lowering of the arm along the z-axis. This single-arm ECG measurement method offers easier operation compared to traditional ECG measurement techniques, making it applicable for HRV measurement and the detection of an irregular RRI.

1. Introduction

In contemporary society, job-related stress poses a significant issue due to its correlation with a substantial percentage (40–50%) of work absences [1]. Numerous previous studies have demonstrated that elevated levels of work-related stress can heighten the risk of various illnesses, including cardiovascular disease [2,3], neurodegenerative diseases [4], chronic aging-related ailments [5], and metabolic syndrome [6]. The concept of mental load acts as an intermediary between imposed demands and perceived demands. It also represents the disparity between the required capacities of the information processing system and the available capacities at any given time [1,7]. Evaluating mental workload has become essential to optimize work environments and enhance work performance [8]. Acker et al. have proposed a comprehensive framework that incorporates antecedent and moderating variables, as well as work-related consequences [9]. In this framework, the real-time measurement of individual physiological signals becomes crucial. Furthermore, by monitoring peoples’ mental conditions in real time, it is possible to identify and address unhealthy practices or poor working conditions to meet expectations [10,11].
While self-assessments such as the NASA-TLX questionnaire [12] can be used to evaluate mental workload, they are not without criticism [13]. In assessing mental workload through the physiological measurements, the methods such as pupillometry [14], electroencephalography [15], near-infrared spectroscopy [16], and heart rate monitoring [17] have gained popularity. With the universal use of wearable devices and mobile health applications (mHealth apps) in recent years, some tools have focused on objectively assessing mental health and neurological disorders in the home or work environment [11]. Additionally, the wearable devices have been developed to measure the various physiological signals, including electrocardiogram (ECG) patches [18,19], electromyogram (EMG) patches [20], pulse oxygen saturation (SpO2) [21], blood glucose [22], and light reflection rheogram (LRR) [23,24]. Among these, heart rate variability (HRV) has been found to have a strong correlation with mental activity, ease of acquisition [25], and sensitivity to changes in mental workload [26]. The R-to-R wave intervals (RRIs) of ECG can be applied to study the HRV. Liu et al. utilized a portable ECG device to measure real-time HRV for evaluating the mental workload of teachers in elementary schools [27,28]. However, current portable or wearable ECG devices require two electrodes to perform bipolar limb leads, such as the Einthoven triangle. This measurement setup can be challenging and uncomfortable for real-time HRV monitoring. The pulse rate variability (PRV) measured by the photoplethysmogram (PPG) has been studied in the last 10 years, and the PPG waveform is easily interfered with respiration, vascular characteristics, physical activity, and mental stress [29,30]. Thus, the PRV is an easy measurement indicator, but it cannot replace the HRV.
Traditionally, HRV has been viewed as a reflection of emotional response or stress. However, it is also an indicator of the body’s capacity to regulate internal and external demands. Various aspects of diet have been shown to have acute and long-term benefits for HRV. For instance, a Mediterranean diet, omega-3 fatty acids, B-vitamins, probiotics, polyphenols, and weight loss have all been associated with improved HRV. Conversely, dietary factors considered unfavorable, such as high intakes of saturated or trans fats and high glycemic carbohydrates, have been found to reduce HRV [31]. HRV has been found to be associated with levels of C-reactive protein (CRP) in the blood. CRP is produced by the liver in response to inflammation, with its levels increasing after the secretion of interleukin (IL)-6 from macrophages and T cells. Thus, Jarczok et al. have reported that the high-frequency (HF) component of HRV predicts the level of CRP [32]. Singh et al. have discovered a relationship between HRV and blood glucose levels [33]. The research literature has also explored the connection between HRV and micronutrients such as vitamins and minerals [34]. Thus, monitoring HRV in daily activities could be considered as the nutrient manager.
Therefore, daily HRV measurements are an important issue for self-care of mental health. To increase the measurement frequency, it is necessary to develop an ECG measurement method that is easily and comfortably used. The aim of this study was to develop a single-arm ECG measurement method, with the lead I ECG as the gold standard. We conducted an analysis of the morphological performance and signal-to-noise ratio (SNR) of the single-arm ECG under static and dynamic experiments. Three morphological features were defined: RRI, duration of QRS complex wave, and amplitude of the R wave. The static experiments included resting and Valsalva maneuver, while the dynamic experiments involved palm opening and clenching, forearm movement, horizontal arm movement along the y-axis, and raising and lowering of the arm along the x-axis and z-axis. A total of 30 subjects participated in the study. The results showed that RRI exhibited the highest cross-correlation (R = 0.9942) between the single-arm ECG and lead I ECG, whereas the duration of QRS complex wave showed the weakest cross-correlation (R = 0.2201). The best SNR was 26.1 ± 5.9 dB during the resting experiment, while the worst SNR was 12.5 ± 5.1 dB during the raising and lowering of the arm along the z-axis. Overall, the results indicated that RRI in the single-arm ECG had the strongest cross-correlation with the lead I ECG.

2. Materials and Methods

Figure 1 shows the framework of this study. A single-arm ECG measurement method was designed, and the obtained single-arm ECG morphology was compared with the lead I ECG being the golden standard under the static and dynamic experiments. The morphological parameters including the RRI, duration of QRS complex wave, and amplitude of the R wave were used to evaluate the performance of the QRS complex wave and SNR. The dynamic experiments consisted of five kinds of arm motions, while the static experiments contained the resting activity and Valsalva maneuver. In the study, the cross-correlation (R) and Bland–Altman plots were used to perform statistical analysis.

2.1. Single-Arm ECG

Figure 2 shows the block diagram of the single-arm ECG prototype. The averaged baseline of electrodes A and B were used to adjust the offset voltage of the instrument amplifier. The electrode C is the grounding with the power. The second-order inverting lowpass filter of the 3 Hz cutoff frequency extracted the baseline voltage to compensate the offset voltage of the instrument amplifier. The second-order high-pass filters of the 0.3 Hz cutoff frequency filtered the wandering baseline, the fourth-order low-pass filtered of the 40 Hz cutoff frequency filtered the high frequency noises, and the notch filter of the 60 Hz cutoff frequency filtered the noise of the power line. The total gain was 500 by the instrument amplifier and non-inverse amplifier. The instrumentation amplifier was AD620 (Analog Device, USA), and the operational amplifier was AD082 (Analog Device, Norwood city, OH, USA). All filters were implemented with the Butterworth structure. The noise of the single-arm ECG prototype was the output signal when the terminals of electrodes A and B were connected to the ground of this device. Then, the amplitudes of the R wave and noise were used to evaluate the SNR. The SNR of this prototype was 26.1 ± 5.1 dB. The data acquisition system was the Biopac MP150 (BioPack Systems Inc. MP150). The lead I ECG was measured using the ECG100C ECG amplifier module (BioPack Systems Inc., Goleta, CA, USA). The sampling frequency was 1 kHz.

2.2. Protocol of Experiment

This study recruited 30 young subjects (30 males) without cardiovascular disease or injured limbs. Their age was between 20 and 23 years (22.1 ± 0.9 years, mean ± standard deviation, SD), their weight was between 51 and 78 Kg (61.8 ± 9.2 Kg), and their height was between 161 and 182 cm (172.1 ± 8.9 cm). This experiment was approved by the Institutional Review Board of the E-DA Hospital, Kaohsiung, Taiwan (No. EMRP-111-013), and informed consent was acquired from each participant prior to initiation of the study.
Three electrodes of the single-arm ECG are put at the left upper arm near the shoulder, as shown in Figure 3. However, three electrodes of the lead I ECG were placed at the left and right hands and right leg, respectively. When the electrodes of the single-arm ECG were placed on the arm, EMG was the noise that interfered the most with such ECG. Thus, the experiments were designed to perform the arm motions in the x-axis, y-axis, z-axis, and forearm motion. Moreover, since the EMG noise did affect both genders, only the male subjects were recruited in this study. Then, the morphological performance and SNRs of the single-arm ECG were evaluated under the five dynamic and two static experiments. The static experiments included the resting activity and Valsalva maneuver. The dynamic experiments were the palm opening and clenching, forearm moving, arm horizontally moving along the y-axis, arm raising and lowering along the x-axis, and arm raising and lowering along the z-axis. These arm motions were related to the activities of many muscles. The major muscles comprise the trapezius, deltoid, pectoralis major, biceps brachii, and triceps brachii. Table 1 shows the seven experimental protocols. Figure 4 shows the schematic diagrams of the arm motions along the x-, y-, and z-axes. Figure 4a is the arm horizontally moving along the y-axis, Figure 4b the arm raising and lowering along the x-axis, and Figure 4c the arm raising and lowering along the z-axis.

2.3. Extraction of ECG Parameters

The single-arm ECG and lead I ECG signals were filtered to remove the wandering noise in baseline and the high frequency noise using a fourth-order Butterworth bandpass filter in which the lower and upper cutoff frequencies were 0.5 Hz and 40 Hz, respectively. To reduce the differences of phase lag among different signals, an eight-order all-pass filter was designed to equalize the group delay within the passband. The R waves of the single-arm ECG and lead I ECG were detected using the Pan–Tompkins method [35]. Figure 5 shows the single-arm ECG and Lead I ECG in the resting activity. The QRS complex waves have the larger distortion for the single-arm ECG than the lead I ECG. However, the R waves are clear and sharp for the two ECG signals. Figure 6 shows a one-beat waveform of the single-arm ECG with the lowest distortion. The P, Q, R, S and T waves are roughly marked. In this study, the interval of R-to-R waves (RRI), duration of QRS complex wave, and amplitude of R wave were used to evaluate the morphological performance of the single-arm ECG. The Q and S waves are the left- and right-first valleys of R wave, and the amplitude of R wave is the amplitude of the R to Q waves.

2.4. Statistical Analysis

The quantitative data are expressed as the mean ± standard deviation (SD). A two-tailed paired t-test is used to show the difference of two variables. A p-value of 0.05 or less is considered statistically significant. The cross-correlation coefficient, R, is the quantity that gives the quality of the least squares fitting to the original data:
R = [ n ( x y ) ( x ) ( y ) ] 2 [ n x 2 x 2 ] [ n y 2 ( y ) 2 ]
Furthermore, the precision and agreement between the single-arm ECG and lead I ECG are compared using a Bland–Altman plot.

3. Results

According to the static and dynamic experiments, we evaluated the SNRs of these single-arm ECG signals and compared them with the SNR under the resting experiment. The ECG noise was extracted from the T wave to the next p wave. The maximum amplitude in these intervals was defined as the noisy amplitude. Table 2 shows the SNRs under the seven experiments. In the dynamic experiment, the palm opening and clenching experiment has the maximum SNR, 23.5 ± 7.4 dB, and the arm raising and lowering along the z-axis experiment has the minimum SNR, 12.5 ± 5.1 dB. In the static experiments, these SNRs do not have significant a difference, 26.1 ± 5.9 dB (resting activity) vs. 23.0 ± 7.4 dB (Valsalva maneuver).
The RRIs of the single-arm ECG and lead I ECG were compared with cross-correlation under the seven experiments, as shown in Table 3. The numbers of RRI in the resting activity (30 s), palm opening and clenching (30 s), forearm moving (30 s), arm horizontally moving along the y-axis (30 s), arm raising and lowering along the x-axis (30 s), arm raising and lowering along the z-axis (30 s), and Valsalva maneuver (70 s) were 1174, 1138, 1147, 1150, 1149, 1129, and 2681, respectively. Therefore, the number of total RRIs was 9568. Figure 7 shows the cross-correlation of all RRIs between the two kinds of ECG signals, with a coefficient of 0.9942. In addition, the cross-correlation coefficients for all subjects under the seven experiments are almost greater than 0.970. Thus, a good linear relationship existed between RRIs extracted from the single-arm ECG and the lead I ECG. Figure 8 shows the Bland–Altman plot of all RRIs (9568 pairs). In the figure, the mean of difference between the two RRIs, respectively, extracted from the single-arm and lead I ECGs is found to be close to 0.0 ms, and the upper and lower limitations of agreement are 11.8 ms and −11.8 ms, respectively. Since 95.3% of the RRI pairs are within the agreement interval, it implies that a good agreement exists between the RRI pairs from these two ECG signals.
Moreover, the durations of the QRS complex waves from these two ECG signals were compared. Table 4 shows the cross-correlation coefficients under the seven different experiments. It was found that the best cross-correlation coefficient (0.239 ± 0.117) for the QRS durations was obtained in the resting activity, and the worst coefficient (0.172 ± 0.132) in the Valsalva maneuver activity. Figure 9 shows a cross-correlation coefficient of 0.2201 for all durations of the QRS complex waves in the seven experiments. Consequently, there was only a low relation between the duration of the QRS complex waves extracted from these two ECGs.
Finally, the amplitude of R wave for these two ECG signals were compared. Table 5 shows the cross-correlation coefficients under the seven experiments. The resting activity and the arm raising and lowering in the x-axis experiment results in the best and worst cross-correlation coefficients (0.5096 ± 0.2368, 0.2182 ± 0.1777). Figure 10 shows a cross-correlation coefficient of 0.4258 for all amplitudes of R waves extracted under the seven experiments. Accordingly, the amplitude of R wave from the single-arm ECG moderately correlates with that from the lead I ECG.

4. Discussion

In the study, the main needs for the development of a single-arm ECG measurement device include its ease of use, long-term monitoring, and wearability. In the lead I ECG configuration, two electrodes placed at two arms are used to measure a body surface’s half-cell potentials, and a third electrode placed at the right leg provides a low-impedance return path to the ground for noise reduction. A commercial ECG apparatus (ECG100C, BioPack Systems Inc., Goleta, CA, USA) was used to measure the single-arm ECG. Unfortunately, its signal owned very small amplitude and was interfered with by power-line noise and the motion artifacts. However, the proposed single-arm ECG device, as shown in Figure 2, amplifies the minute half-cell potentials, usually less than 0.1 mV, between the two electrodes on the upper arm. The average potential of two electrodes with high-resistance resistors (R1) was used as the neutral potential to shield the lead wires of two electrodes and the reference of instrument amplifier by the resistors (RG/2). This design could effectively reduce the difference between the two input commons. In addition, high-order low-pass filters were incorporated to filter the frequency components above the 40 Hz and then to increase the signal-to-noise ratio.
The quality of the single-arm ECG signal is lower compared to the lead I ECG, and this is influenced by the positioning of the electrodes. Figure 11a illustrates a single-arm ECG during the resting activity, where the single-arm ECG quality is relatively high. However, when the subject performs the horizontal arm movement along the y-axis, continuous contraction of the deltoid muscle results in a larger amount of EMG coupling with the ECG signal, as shown in Figure 11b. Consequently, the ECG quality becomes deteriorated. To address this issue, the electrode positions are adjusted based on the subject’s arm structure, such as the arm length, muscle size, and arm circumference. Figure 11c shows the single-arm ECG after electrode adjustment, where the R wave is clearly displayed. Table 2 shows that when subjects were practicing the arm moving horizontally along the y-axis, arm raising and lowering along the x-axis, and arm raising and lowering along the z-axis the SNRs are the lowest, measuring at 13.1 ± 3.8 dB, 12.6 ± 5.5 dB, and 12.5 ± 5.1 dB, respectively. In most subjects, their SNRs in the resting activity are significantly higher than those in the dynamic activities, while some subjects have lower SNRs in the resting activity than those in the dynamic activities, such as subjects 1 and 25. The major reason is that the half-cell potentials of the two electrodes are not close to drop the common-mode rejection ratio (CMRR) of the instrument amplifier. This problem will be overcome by the circuit design in the future when the single-arm ECG is developed as a fitness band.
In this study, the signal quality of the single-arm ECG was examined by evaluating three morphological parameters, including the RRI, duration of the QRS complex wave, and amplitude of the R wave. These parameters between the single-arm and lead I ECGs were compared, and their cross-correlation coefficients were found to be 0.9942, 0.2201, and 0.4258, respectively, as shown in Figure 7, Figure 9 and Figure 10. Figure 5 illustrates the waveform of the single-arm ECG, which exhibits a distinct R wave while lacking P and T waves. The Q and S waves are not clearly discernible. Consequently, the RRI demonstrates the highest cross-correlation coefficient of 0.9942, while the duration of the QRS complex wave displays the lowest cross-correlation coefficient of 0.2201. The error in RRI can be attributed to two reasons. Firstly, the single-arm ECG experiences greater baseline drift compared to the lead I ECG, as evident in Figure 12, when the subjects perform arm motions. Secondly, the nonlinear phase characteristics of Butterworth filters, used as high-pass (cutoff frequency: 0.5 Hz) and low-pass (cutoff frequency: 40 Hz) filters, and the infinite impulse response (IIR) filters contribute to this error. Moreover, the errors observed in the duration of the QRS complex wave and amplitude of the R wave are caused by the presence of coupled EMG, as shown in Figure 13. The Q and S waves, coupled with the EMG, lack a clear and well-defined waveform. Table 2 presents the SNRs of the single-arm ECG under different experiments. The greater the arm motion intensity, the lower the SNR of the single-arm ECG.
According to results of this study, the single-arm ECG shows promising potential for development as a wearable HRV device, primarily due to its high accuracy in measuring RRI. Furthermore, major technology companies like Apple and Google have recently introduced health applications such as Apple Health and Google Fit, which incorporate ECG measurement and arrhythmia detection based on RRI [36]. These applications are compatible with their respective smartwatches, where users are required to place their finger on the crown of the watch during ECG measurements [37]. However, their measurement method may not be comfortable or user-friendly for long-term monitoring. The traditional Holter ECG and modern ECG patch [19] are worn on the chest to continuously measure the ECG for the diagnosis of heart disease. When users are wearing or taking off it, their clothes must be removed. Moreover, the electrodes of the Holter monitors are arranged on the chest, in which motion artifacts are induced by respiration and cardiac beating. Obviously, both low frequency noise (<0.2 Hz) caused by the respiration activity and that (about 1.2 Hz) caused by the cardiac movement is superimposed on the Holter ECG waveform [38]. Now, the single-arm ECG device is a prototype. Thus, its wearing method could not easier than the Holter ECG and ECG patch. In the future, it has great potential to be developed as a fitness band worn on the arm to monitor regular and irregular heartbeats. Thus, its advantages will be that its wearing method could be more convenient than the Holter ECG and ECG patch, and its measuring time could be longer than the Apple watch.
The primary limitation of the single-arm ECG is the placement of electrodes only on the left arm. We have not investigated whether other electrode positions, such as the right hand or left leg, are suitable or not. Additionally, due to the presence of significant noise, such as EMG interference, the Q and S waves of the single-arm ECG do not exhibit clear and well-defined waveforms. It is only the RRI parameter that demonstrates high accuracy, thus restricting its broader application. To address this limitation, various digital signal-processing techniques can be employed to mitigate artifact noise in the ECG. Methods such as adaptive filtering [39], empirical mode decomposition [40], or principal component analysis [41] could be utilized to effectively remove unwanted noise.

5. Conclusions

In this study, we extracted RRI, duration of QRS complex wave, and amplitude of R wave from the single-arm ECG and compared them with the corresponding parameters obtained from the lead I ECG. The resulting cross-correlation coefficients were 0.9942, 0.2201, and 0.4258, respectively. The measurement method employed in this study offers a more straightforward operation compared to traditional ECG measurement methods, making it suitable for HRV measurement and for monitoring regular and irregular heartbeats. Now, the single-arm ECG in this study is only a prototype that needs lead cables. In the future, it could be designed as a fitness band, and several experiments related to daily activities will be performed to verify its performance.

Author Contributions

Conceptualization, J.-J.W.; methodology, J.-J.W. and C.-H.T.; software, C.-H.T. and I.M.; validation, J.-J.W., S.-H.L. and I.M.; writing—original draft preparation, J.-J.W. and S.-H.L.; writing—review and editing, J.-J.W., S.-H.L. and X.Z.; supervision: J.-J.W.; funding acquisition: J.-J.W. and S.-H.L.; data curation: C.-H.T. and T.-L.L. All authors have read and agreed to the published version of the manuscript.

Funding

This research was supported in part by the National Science and Technology Council, Taiwan, under grants NSTC 111-2221-E-214 -003 and NSTC 111-2221-E-324 -003 -MY3, I-Shou University, Taiwan, under grant ISU-112-IUC-01, and Chaoyang University of Technology, Taiwan, under grand TJ4-111J938.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki and approved by Institutional Review Board of the E-DA Hospital, (No. EMRP-111-013), Kaohsiung city, Taiwan.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Acknowledgments

The authors would like to acknowledge I-Shou University and Chaoyang University of Technology for the administrative support.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Taelman, J.; Vandeput, S.; Vlemincx, E.; Spaepen, A.; van Huffel, S. Instantaneous changes in heart rate regulation dueto mental load in simulated office work. Eur. J. Appl. Physiol. 2011, 111, 1497–1505. [Google Scholar] [CrossRef] [PubMed]
  2. Kivimaki, M. Work stress and risk of cardiovascular mortality: Prospective cohort study of industrial employees. Br. Med. J. 2002, 325, 857–860. [Google Scholar] [CrossRef] [Green Version]
  3. Esch, T.; Stefano, G.B.; Fricchione, G.L.; Benson, H. Stress in cardiovascular diseases. Med. Sci. Monit. 2002, 8, RA93–RA101. [Google Scholar] [PubMed]
  4. Esch, T.; Stefano, G.B.; Fricchione, G.L.; Benson, H. The role of stress in neurodegenerative diseases and mental disorders. Neuroendocrinol. Lett. 2002, 23, 199–208. [Google Scholar]
  5. Miller, G.E.; Chen, E.; Parker, K.J. Psychological stress in childhood and susceptibility to the chronic diseases of aging: Moving toward a model of behavioral and biological mechanisms. Psychol. Bull. 2011, 137, 959–997. [Google Scholar] [PubMed] [Green Version]
  6. Rosmond, R. Role of stress in the pathogenesis of the metabolic syndrome. Psychoneuroendocrinology 2005, 30, 1–10. [Google Scholar] [CrossRef]
  7. Bhatt, V.; Chakraborty, S.; Chakravorty, T.; Studies, E. Importance of digitech adoption for providing efficient healthcare services during COVID-19. Int. J. Emerg. Technol. 2020, 11, 1–13. [Google Scholar]
  8. Mach, S.; Storozynski, P.; Halama, J.; Krems, J.F. Assessing mental workload with wearable devices—Reliability and applicability of heart rate and motion measurements. Appl. Ergon. 2022, 105, 103855. [Google Scholar] [CrossRef]
  9. Van Acker, B.B.; Parmentier, D.D.; Vlerick, P.; Saldien, J. Understanding mental workload: From a clarifying concept analysis toward an implementable framework. Cogn. Technol. Work. 2018, 20, 351–365. [Google Scholar] [CrossRef] [Green Version]
  10. Putz, S.; Rick, V.; Mertens, A.; Nitsch, V. Using IoT devices for sensor-based monitoring of employees’ mental workload: Investigating managers’ expectations and concerns. Appl. Ergon. 2022, 102, 103739. [Google Scholar] [CrossRef]
  11. Behar, J.A.; Oster, J.; De Vos, M.; Clifford, G.D. Wearables and mHealth in mental health and neurological disorders. Physiol. Meas. 2019, 40, 070401. [Google Scholar] [CrossRef] [PubMed]
  12. Hart, S.G.; Staveland, L.E. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. Adv. Psychol. 1988, 52, 139–183. [Google Scholar]
  13. de Winter, J.C. Controversy in human factors constructs and the explosive use of the NASA-TLX: A measurement perspective. Cogn. Technol. Work. 2014, 16, 289–297. [Google Scholar] [CrossRef]
  14. Van Acker, B.B.; Bombeke, K.; Durnez, W.; Parmentier, D.D.; Mateus, J.C.; Biondi, A.; Saldien, J.; Vlerick, P. Mobile pupillometry in manual assembly: A pilot study exploring the wearability and external validity of a renowned mental workload lab measure. Int. J. Ind. Ergon. 2020, 75, 102891. [Google Scholar] [CrossRef]
  15. Vanneste, P.; Raes, A.; Morton, J.; Bombeke, K.; Van Acker, B.B.; Larmuseau, C.; Depaepe, F.; Van den Noortgate, W. Towards measuring cognitive load through multimodal physiological data. Cogn. Technol. Work 2021, 23, 567–585. [Google Scholar] [CrossRef]
  16. Herff, C.; Heger, D.; Fortmann, O.; Hennrich, J.; Putze, F.; Schultz, T. Mental workload during n-back task-quantified in the prefrontal cortex using fNIRS. Front. Hum. Neurosci. 2013, 7, 935. [Google Scholar] [CrossRef] [Green Version]
  17. Hankins, T.C.; Wilson, G.F. A comparison of heart rate, eye activity, EEG and subjective measures of pilot mental workload during flight. Aviat. Space Environ. Med. 1998, 69, 360–367. [Google Scholar]
  18. Lobodzinski, S.S.; Laks, M.M. New devices for very long-term ECG monitoring. Cardiol. J. 2012, 19, 210–214. [Google Scholar] [CrossRef]
  19. Liu, S.-H.; Wang, J.-J.; Su, C.-H.; Tan, T.-H. Development of a patch-type electrocardiographic monitor for real time heartbeat detection and heart rate variability analysis. J. Med. Biol. Eng. 2018, 38, 411–423. [Google Scholar] [CrossRef]
  20. Liu, S.-H.; Lin, C.-B.; Chen, Y.; Chen, W.; Huang, T.-S.; Hsu, C.-Y. An EMG patch for the real-time monitoring of muscle-fatigue conditions during exercise. Sensors 2019, 19, 3108. [Google Scholar] [CrossRef] [Green Version]
  21. Liu, S.-H.; Liu, H.-C.; Chen, W.; Tan, T.-H. Evaluating quality of photoplethymographic signal on wearable forehead pulse oximeter with supervised classification approaches. IEEE Access 2020, 8, 185121–185135. [Google Scholar]
  22. Rachim, V.P.; Chung, W.Y. Wearable-band type visible-near infrared optical biosensor for non-invasive blood glucose monitoring. Sens. Actuators B-Chem. 2019, 286, 173–180. [Google Scholar]
  23. Liu, S.-H.; Wang, J.-J.; Chen, W.; Pan, K.-L.; Su, C.-H. An examination system to detect deep vein thrombosis of a lower limb using light reflection rheography. Sensors 2021, 21, 2446. [Google Scholar] [PubMed]
  24. Liu, S.-H.; Chen, W.; Su, C.-H.; Pan, K.-L. Convolutional neural network-based detection of deep vein thrombosis in a low limb with light reflection rheography. Measurement 2022, 189, 110457. [Google Scholar]
  25. Gallardo, J.; Bellone, G.; Plano, S.; Vigo, D.; Risk, M. Heart rate variability: Influence of pre-processing methods in identifying single-night sleep-deprived subjects. J. Med. Biol. Eng. 2021, 41, 224–230. [Google Scholar]
  26. Tao, D.; Tan, H.; Wang, H.; Zhang, X.; Qu, X.; Zhang, T. A systematic review of physiological measures of mental workload. Int. J. Environ. Res. Public Health 2019, 16, 2716. [Google Scholar]
  27. Liu, S.-H.; Cheng, D.-C.; Wang, J.-J.; Lin, T.-H.; Chang, K.-M. Effects of moderate exercise on relieving mental load of elementary school teachers. Evid.-Based Complement. Altern. Med. 2015, 2015, 192680. [Google Scholar]
  28. Liu, S.-H.; Lin, T.-H.; Chang, K.-M. The physical effects of aromatherapy in alleviating work-related stress on elementary school teachers in Taiwan. Evid.-Based Complement. Altern. Med. 2013, 2013, 853809. [Google Scholar]
  29. Schäfer, A.; Vagedes, J. How accurate is pulse rate variability as an estimate of heart rate variability? A review on studies comparing photoplethysmographic technology with an electrocardiogram. Int. J. Cardiol. 2013, 166, 15–29. [Google Scholar]
  30. Mejía-Mejía, E.; May, J.M.; Torres, R.; Kyriacou, P.A. Pulse rate variability in cardiovascular health: A review on its applications and relationship with heart rate variability. Physiol. Meas. 2020, 41, 07TR01. [Google Scholar]
  31. Young, H.A.; Benton, D. Heart-rate variability: A biomarker to study the influence of nutrition on physiological and psychological health? Behav. Pharmacol. 2018, 29, 140–151. [Google Scholar] [CrossRef] [Green Version]
  32. Jarczok, M.N.; Koenig, J.; Mauss, D.; Fischer, J.E.; Thayer, J.F. Lower heart rate variability predicts increased level of C-reactive protein 4 years later in healthy, nonsmoking adults. J. Intern. Med. 2014, 276, 667–671. [Google Scholar] [CrossRef]
  33. Singh, J.P.; Larson, M.G.; O’Donnell, C.J.; Wilson, P.F.; Tsuji, H.; Lloyd-Jones, D.M.; Levy, D. Association of hyperglycemia with reduced heart rate variability. Am. J. Cardiol. 2000, 86, 309–312. [Google Scholar] [CrossRef] [PubMed]
  34. Lopresti, A.L. Association between micronutrients and heart rate variability: A review of human studies. Adv. Nutr. 2020, 11, 559–575. [Google Scholar] [CrossRef] [PubMed]
  35. Pan, J.; Tompkins, W.J. A real-time QRS detection algorithm. IEEE Trans. Biomed. Eng. 1985, 32, 230–236. [Google Scholar] [CrossRef]
  36. Apple, ResearchKit/ResearchKit: ResearchKit 1.5.3. Available online: https://www.apple.com/tw/researchkit/ (accessed on 1 May 2023).
  37. Take an ECG with the ECG App on Apple Watch. Available online: https://support.apple.com/en-us/HT208955 (accessed on 1 May 2023).
  38. Sharma, A.N.; Baranchuk, A. Ambulatory external electrocardiography monitoring: Holter, extended Holter, mobile cardiac telemetry monitoring. Card. Electrophysiol. Clin. Biol. 2021, 13, 427–438. [Google Scholar] [CrossRef] [PubMed]
  39. Liu, S.-H. Motion artifact reduction in electrocardiogram using adaptive filter. J. Med. Biol. Eng. 2011, 31, 67–72. [Google Scholar] [CrossRef]
  40. Chang, K.-M.; Liu, S.-H. Gaussian noise filtering from ECG by wiener filter and ensemble empirical mode decomposition. J. Signal Process. Syst. Signal Image Video Technol. 2011, 64, 249–264. [Google Scholar] [CrossRef]
  41. Schlink, B.R.; Nordin, A.D.; Ferris, D.P. Comparison of signal processing methods for reducing motion artifacts in high-density electromyography during human locomotion. IEEE Open J. Eng. Med. Biol. 2020, 1, 156–165. [Google Scholar] [CrossRef]
Figure 1. The framework of this study. The lead I ECG as the golden standard is used to evaluate performance of the single-arm ECG under dynamic and static experiments.
Figure 1. The framework of this study. The lead I ECG as the golden standard is used to evaluate performance of the single-arm ECG under dynamic and static experiments.
Sensors 23 05818 g001
Figure 2. Block diagrams of circuits for the single-arm ECG measurement.
Figure 2. Block diagrams of circuits for the single-arm ECG measurement.
Sensors 23 05818 g002
Figure 3. Position of the three electrodes in the single-arm ECG prototype. The electrodes in Figure 2 are placed at the shoulder, which are sorted by A, C, and B from right to left.
Figure 3. Position of the three electrodes in the single-arm ECG prototype. The electrodes in Figure 2 are placed at the shoulder, which are sorted by A, C, and B from right to left.
Sensors 23 05818 g003
Figure 4. The schematic diagrams of arm motions along the x-, y-, and z-axes, (a) arm horizon-tally moving along the y-axis, (b) arm raising and lowering along the x-axis, (c) arm raising and lowering along the z-axis.
Figure 4. The schematic diagrams of arm motions along the x-, y-, and z-axes, (a) arm horizon-tally moving along the y-axis, (b) arm raising and lowering along the x-axis, (c) arm raising and lowering along the z-axis.
Sensors 23 05818 g004
Figure 5. Subject is at resting activity, (a) single-arm ECG, (b) lead I ECG.
Figure 5. Subject is at resting activity, (a) single-arm ECG, (b) lead I ECG.
Sensors 23 05818 g005
Figure 6. One-beat waveform of the single-arm ECG.
Figure 6. One-beat waveform of the single-arm ECG.
Sensors 23 05818 g006
Figure 7. The cross-correlation of all RR intervals, respectively, extracted from the single-arm ECG and lead I ECG.
Figure 7. The cross-correlation of all RR intervals, respectively, extracted from the single-arm ECG and lead I ECG.
Sensors 23 05818 g007
Figure 8. Bland–Altman plot of all RRIs. The mean is close to 0.0 ms, and upper and lower limitations of agreement are 11.8 ms and −11.8 ms, respectively. There are 95.3% of RRIs within the agreement interval.
Figure 8. Bland–Altman plot of all RRIs. The mean is close to 0.0 ms, and upper and lower limitations of agreement are 11.8 ms and −11.8 ms, respectively. There are 95.3% of RRIs within the agreement interval.
Sensors 23 05818 g008
Figure 9. The cross-correlation of all durations of QRS complex waves, respectively, extracted from the single-arm ECG and lead I ECG.
Figure 9. The cross-correlation of all durations of QRS complex waves, respectively, extracted from the single-arm ECG and lead I ECG.
Sensors 23 05818 g009
Figure 10. The cross-correlation of all amplitudes of R waves, respectively, extracted from single-arm ECG and lead I ECG.
Figure 10. The cross-correlation of all amplitudes of R waves, respectively, extracted from single-arm ECG and lead I ECG.
Sensors 23 05818 g010
Figure 11. The single-arm ECG of one subject under the different experiments, (a) the resting activity, (b) the experiment conducted with the arm horizontally moving along the y-axis, (c) after electrodes adjustment, and the experiment conducted with the arm horizontally moving along the y-axis experiment.
Figure 11. The single-arm ECG of one subject under the different experiments, (a) the resting activity, (b) the experiment conducted with the arm horizontally moving along the y-axis, (c) after electrodes adjustment, and the experiment conducted with the arm horizontally moving along the y-axis experiment.
Sensors 23 05818 g011
Figure 12. The single-arm ECG exhibits baseline drift when the subject performs the arm movements.
Figure 12. The single-arm ECG exhibits baseline drift when the subject performs the arm movements.
Sensors 23 05818 g012
Figure 13. The single-arm ECG signal is affected by the EMG activity during arm movements.
Figure 13. The single-arm ECG signal is affected by the EMG activity during arm movements.
Sensors 23 05818 g013
Table 1. Seven experimental protocols.
Table 1. Seven experimental protocols.
No.ExperimentProtocol
1RestingSubjects in a sitting position were asked to take a rest at least three minutes to allow their hemodynamic status to become stable before the ECG measurement began. Subjects put their two arms on a table relaxedly. In the resting activity, 30 s single-arm and lead I ECGs were simultaneously registered.
2Palm opening and clenchingSubject were asked to put their arms on the table, stretch their arms, and continuously open and clench their left palm 10 times. Each opening and clenching of the palm lasted 3 s. Then, subjects were asked to take a rest for three minutes.
3Forearm movingSubject were asked to put their arms on the table, stretch their arms, and raise their left forearm from 0° to 90° and 90° to 0° 10 times. Each movement lasted 3 s. Then, subjects were asked to take a rest for three minutes.
4Arm horizontally moving along y-axisSubjects in a standing position were asked to raise their left arm to 90° and horizontally move their arm 10 times. The moving angle was 90°. Each movement lasted 3 s. Then, subjects were asked to take a rest for three minutes.
5Arm raising and lowering along x-axisSubjects in a standing position were asked to raise their left arm and lower their arm in the horizontal direction 10 times. The moving angle was 90°. Each movement lasted 3 s. Then, subjects were asked to take a rest for three minutes.
6Arm raising and lowering along z-axisSubjects in a standing position were asked to raise their left arm and lower their arm in the vertical direction 10 times. The moving angle was 90°. Each movement lasted 3 s. Then, subjects were asked to take a rest for three minutes.
7Valsalva maneuverSubjects performed the Valsalva maneuver by blowing into a rubber tube connected to a mercury column sphygmomanometer and maintaining a pressure of 50 mm Hg for 10 s. Then, subjects were asked to take a rest for three minutes.
Table 2. SNRs of the single-arm ECG recorded for 30 subjects under seven experiments.
Table 2. SNRs of the single-arm ECG recorded for 30 subjects under seven experiments.
Sub.RestingPalm Opening
and Clenching
Forearm MovingArm Horizontally Moving in y-AxisArm Raising and Lowering in x-AxisArm Raising and Lowering in z-AxisValsalva Maneuver
15.64.15.84.0534.0534.0236.120
211.014.48.83.7832.9182.78031.740
345.235.015.53.8054.2823.97624.733
423.638.67.83.6332.4162.19834.865
525.717.712.05.8125.3385.7268.203
623.819.56.42.4993.4662.67726.281
779.326.88.710.3512.0147.18512.603
817.328.616.55.0634.8925.60212.390
946.84.45.94.3583.9844.52019.101
1021.417.96.46.6477.1984.57428.793
1120.7166.121.23.8758.3434.30315.002
1224.58.310.6222.5912.7472.0228.545
1359.039.536.9218.53611.2096.96734.430
1434.27.46.9762.0492.2562.16217.363
1517.610.03.8935.4976.8294.8226.820
1620.715.85.7785.7549.9027.58613.984
1719.927.67.9137.45419.06652.99416.338
1816.16.310.9574.4331.8692.0956.386
1958.923.530.86013.0506.2464.91746.567
2010.142.811.6985.6285.0585.96012.646
2116.020.913.4086.2946.3066.42620.706
2213.39.88.1187.8154.1866.1097.315
2312.830.26.8697.8528.3197.89316.724
2410.912.13.1782.5212.7613.1139.533
259.525.74.7057.3366.9335.00820.319
2649.617.015.1973.2532.1722.62248.128
2724.312.97.8319.0146.2387.08918.459
2814.77.714.1245.3973.5504.79018.746
2956.067.031.9406.6124.9845.51334.386
3020.018.35.2854.4983.3122.40913.245
Mean ± SD (dB)26.1 ± 5.923.5 ± 7.418.3 ± 5.5 **13.1 ± 3.8 **12.6 ± 5.5 **12.5 ± 5.1 **23.0 ± 7.4
**: p < 0.001.
Table 3. Cross-correlation of RRI, respectively, extracted from the single-arm ECG and lead I ECG in 30 subjects under seven experiments.
Table 3. Cross-correlation of RRI, respectively, extracted from the single-arm ECG and lead I ECG in 30 subjects under seven experiments.
Sub.RestingPalm Opening
and Clenching
Forearm MovingArm Horizontally Moving in y-AxisArm Raising and Lowering in x-AxisArm Raising and Lowering in z-AxisValsalva Maneuver
10.99800.98810.99610.99190.99860.99710.9994
20.99920.99820.99830.99090.99440.99790.9996
30.99910.99640.99750.96990.96550.92220.9998
40.99830.99970.99770.98120.97600.89910.9599
50.94770.99200.99970.98630.99080.99920.9992
60.99940.99980.99860.88520.99540.99180.9199
70.96710.99970.99560.99830.95050.99910.9998
80.99640.99900.99870.98780.99770.98870.9997
90.99970.99800.99680.99700.99850.99740.9998
100.99890.99920.99770.99730.99870.99750.9995
110.99890.99850.99580.98650.97580.97120.9996
120.99980.99530.99740.95210.95440.95500.9599
130.99960.99780.97700.99340.98120.99890.9998
140.99940.99680.99670.85610.82070.80540.9957
150.99690.84310.88670.97640.98690.98290.9991
160.99980.99930.99660.98940.99870.99900.9997
170.99750.99970.99520.97960.95540.94380.9999
180.99940.98370.99810.99530.94130.91370.9918
190.99910.99480.99450.99810.97590.95270.9998
200.99700.99720.99780.97130.96330.99130.9948
210.99930.99620.99750.99780.99260.99450.9997
220.99980.99990.99910.99960.99850.99920.9994
230.99840.99860.99660.99970.99960.99870.9997
240.99950.99890.97530.98330.98360.99680.9799
250.99880.99910.99620.99730.99750.99600.9996
260.99960.99920.99940.99530.91980.96870.9995
270.99900.99870.99800.99820.94940.99170.9998
280.99960.99880.99940.98810.99410.93680.9997
290.99950.99770.99910.98980.98230.99970.9999
300.99970.99980.99970.99800.99840.99630.9996
Mean ± SD0.996 ± 0.0120.992 ± 0.0280.992 ± 0.02170.981 ± 0.0320.974 ± 0.0360.973 ± 0.0430.993 ± 0.017
Table 4. Cross-correlation of durations of QRS complex waves, respectively, extracted from the single-arm and lead I ECGs in 30 subjects under seven experiments.
Table 4. Cross-correlation of durations of QRS complex waves, respectively, extracted from the single-arm and lead I ECGs in 30 subjects under seven experiments.
Sub.RestingPalm Opening
and Clenching
Forearm MovingArm Horizontally Moving in y-AxisArm Raising and Lowering in x-AxisArm Raising and Lowering in z-AxisValsalva Maneuver
10.13750.32930.04000.22050.22800.13530.0283
20.21590.17290.06000.30590.14900.23070.0202
30.17320.01000.38690.26650.34370.11400.1389
40.21140.24900.01000.06630.07140.04690.1411
50.51190.40510.32000.48480.07940.03000.3074
60.12530.31760.12370.46010.07810.12570.1233
70.27910.09430.50010.00030.34900.25280.1371
80.31620.21490.17610.15520.08430.10490.3082
90.30300.37770.22580.28480.05570.14900.0975
100.15390.16760.12960.37090.17200.20120.0283
110.10680.27840.41560.44130.33380.37190.4030
120.33610.03740.03610.23900.09220.30530.1356
130.38970.23520.14590.10200.50390.12650.1552
140.21140.03610.06780.27980.18470.04690.3592
150.18720.22740.04470.12370.18170.23240.0959
160.38560.06080.14070.31580.07750.28280.0080
170.17070.30980.16340.00200.18840.09850.2583
180.12240.01410.14140.09170.15200.17000.0843
190.17120.39660.03740.02450.26550.08000.1153
200.20150.23150.32140.21400.23770.06080.0883
210.52170.05200.35810.02450.19100.56750.2561
220.17940.26150.41590.42870.09110.08940.1221
230.46430.12450.39410.21280.02830.43150.4845
240.29140.27460.39080.10580.01730.48870.0265
250.12810.08770.02240.02650.27820.05660.2364
260.13420.24580.33730.22850.45910.59930.1876
270.13320.52530.44380.62260.56570.48600.4874
280.23740.62270.26510.55420.36850.56310.1253
290.14560.05660.21840.44260.50310.33500.0412
300.22360.27420.05920.03000.04360.13960.1825
Mean ± SD 0.240 ± 0.1180.223 ± 0.1520.213 ± 0.1520.237 ± 0.1770.212 ± 0.1540.230 ± 0.1740.172 ± 0.132
Table 5. Cross-correlation of R-wave amplitudes, respectively, extracted from the single-arm ECG and lead I ECG in 30 subjects under seven experiments.
Table 5. Cross-correlation of R-wave amplitudes, respectively, extracted from the single-arm ECG and lead I ECG in 30 subjects under seven experiments.
Sub.RestingPalm Opening
and Clenching
Forearm MovingArm Horizontally Moving in y-AxisArm Raising and Lowering in x-AxisArm RAISING and lowering in z-AxisValsalva Maneuver
10.44880.19540.32680.32780.18410.20200.2666
20.12080.23090.10050.13040.12170.39130.2951
30.28180.28740.04240.00100.25080.25810.4268
40.66230.37130.07210.07000.03460.07810.7014
50.11790.62200.26830.12410.13670.05000.5119
60.67190.28880.28880.18220.08000.28600.7794
70.10820.70960.37470.38030.01000.33630.2293
80.30300.00210.28460.15490.03610.03740.5247
90.77520.56460.34290.04690.42040.61110.2121
100.30000.38220.31910.02450.31510.31460.3291
110.32880.13600.29190.03000.05660.17750.0938
120.56250.11960.10580.02240.00110.04120.7246
130.67380.85060.84760.15720.36850.32110.6346
140.18120.53580.45840.08250.05480.15520.3041
150.42520.44310.01000.28430.34530.36510.4535
160.19540.58150.33700.00120.47470.21770.6416
170.40040.38720.07210.16160.05290.29800.5500
180.75780.64940.70750.65670.31860.25220.6001
190.55250.84400.47090.18850.25550.33080.0141
200.72330.73940.81800.38210.24430.22890.4768
210.63510.73940.56170.52460.27070.08370.5607
220.67640.63930.28280.44980.13490.67540.0648
230.79280.16400.55040.44910.47920.50060.1241
240.85140.39660.23390.21210.20760.26440.1249
250.66570.77450.57120.63580.71250.50860.6938
260.46750.33670.22980.13670.11490.43000.4473
270.37840.13040.28350.16060.00120.05920.2400
280.80110.59600.74590.26100.15430.04360.9011
290.56020.58190.50590.09170.19310.30850.8012
300.86910.94870.63220.59820.51680.48120.8725
Mean ± SD0.509 ± 0.2360.475 ± 0.2530.371 ± 0.2300.230 ± 0.1950.218 ± 0.1770.276 ± 0.1710.453 ± 0.253
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Wang, J.-J.; Liu, S.-H.; Tsai, C.-H.; Manousakas, I.; Zhu, X.; Lee, T.-L. Signal Quality Analysis of Single-Arm Electrocardiography. Sensors 2023, 23, 5818. https://doi.org/10.3390/s23135818

AMA Style

Wang J-J, Liu S-H, Tsai C-H, Manousakas I, Zhu X, Lee T-L. Signal Quality Analysis of Single-Arm Electrocardiography. Sensors. 2023; 23(13):5818. https://doi.org/10.3390/s23135818

Chicago/Turabian Style

Wang, Jia-Jung, Shing-Hong Liu, Cheng-Hsien Tsai, Ioannis Manousakas, Xin Zhu, and Thung-Lip Lee. 2023. "Signal Quality Analysis of Single-Arm Electrocardiography" Sensors 23, no. 13: 5818. https://doi.org/10.3390/s23135818

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop