Next Article in Journal
Field-Based Optimal Placement of Antennas for Body-Worn Wireless Sensors
Next Article in Special Issue
Sleep Monitoring Based on a Tri-Axial Accelerometer and a Pressure Sensor
Previous Article in Journal
State of the Art in LP-WAN Solutions for Industrial IoT Services
Previous Article in Special Issue
Reliability of Sleep Measures from Four Personal Health Monitoring Devices Compared to Research-Based Actigraphy and Polysomnography
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Reduction of Motion Artifacts and Improvement of R Peak Detecting Accuracy Using Adjacent Non-Intrusive ECG Sensors

1
Department of Creative IT Engineering and Future IT Innovation Laboratory, Pohang University of Science and Technology (POSTECH), Pohang, Kyungbuk 790-784, Korea
2
Department of Electrical Engineering, Pohang University of Science and Technology (POSTECH), Pohang, Kyungbuk 790-784, Korea
*
Author to whom correspondence should be addressed.
Sensors 2016, 16(5), 715; https://doi.org/10.3390/s16050715
Submission received: 18 February 2016 / Revised: 5 May 2016 / Accepted: 11 May 2016 / Published: 17 May 2016
(This article belongs to the Special Issue Wearable Biomedical Sensors)

Abstract

:
Non-intrusive electrocardiogram (ECG) monitoring has many advantages: easy to measure and apply in daily life. However, motion noise in the measured signal is the major problem of non-intrusive measurement. This paper proposes a method to reduce the noise and to detect the R peaks of ECG in a stable manner in a sitting arrangement using non-intrusive sensors. The method utilizes two capacitive ECG sensors (cECGs) to measure ECG, and another two cECGs located adjacent to the sensors for ECG are added to obtain the information on motion. Then, active noise cancellation technique and the motion information are used to reduce motion noise. To verify the proposed method, ECG was measured indoors and during driving, and the accuracy of the detected R peaks was compared. After applying the method, the sum of sensitivity and positive predictivity increased 8.39% on average and 26.26% maximally in the data. Based on the results, it was confirmed that the motion noise was reduced and that more reliable R peak positions could be obtained by the proposed method. The robustness of the new ECG measurement method will elicit benefits to various health care systems that require noninvasive heart rate or heart rate variability measurements.

1. Introduction

The electrocardiogram (ECG) is a set of voltage signals that is generated by heart activity [1]. The R wave of ECG can be used to calculate the heart rate (HR) and its variability (HRV), which contain important information on the body’s physiological condition. This data can be used to diagnose diseases like multiple sclerosis, stroke, ischemic heart disease, and myocardial infarction, or can also be used to provide information on the autonomic nervous function [2,3]. Therefore, measuring HR or HRV in daily life can be beneficial to humans, because it can serve as a regular check of cardiac electrical activity. In addition, if an ECG system can measure the HR or HRV of a human in a vehicle during his driving route, it can detect abrupt possible cardiac abnormalities or physical changes in the driver, such as fatigue, drowsiness, and stress [4,5]. This can make driving safer and provide comfort to drivers by making it possible to take proper action in advance or by providing the necessary information when an abnormal condition is detected. However, the conventional ECG measurement method is not practical for use in daily life. It requires Ag-AgCl electrodes that must be attached to the body of the tested subjects directly. This method is rather uncomfortable and disturbs daily activities or driving.
Recently, based on advances in sensor technology and an increase in public interest in health care, a method measuring the ECG using non-intrusive electrodes was developed. This method uses capacitive ECG sensors (cECGs) as the electrodes for non-intrusive ECG measurements. The cECG measures ECG by sensing subtle changes in voltage using capacitive couplings near the human body. Therefore, this method does not require direct contact or resistive coupling with the skin. Many research projects that have applied the cECG in daily life have been conducted [6,7,8,9]. In addition, there have been some trials that used the cECG to measure ECG during driving [10,11]. The non-intrusive measurement method does not restrict a subject, so it is easy to measure the ECG and can be proven to be advantageous for long-term measurements [12]. The fact that there is no skin irritation is also one of its advantages [13]. However, the non-intrusive measurement method is very sensitive to the noise from motion. Much noise can be generated by the motion of a subject or by the swinging patterns of a vehicle when the measurement is conducted during driving. In addition to noise from motion, there can be many other noise sources in a measured ECG: baseline wander noise from respiration, power line noise, and electromyography noise from muscular movement. Among these, however, motion noise is the most difficult noise to remove because it occurs randomly and its amplitude is significant when compared with the original ECG.
Numerous studies have been conducted in order to study ways to reduce motion noise [14,15,16,17,18,19,20,21,22]. The simplest way is the application of a band-pass filter (BPF). However, the conventional BPF is not effective in reducing motion noise, because the noise has a frequency spectrum that overlaps with the ECG spectrum [14]. Wavelet transform-based methods can be used to reduce the noise in the ECG [15]. However, this transform also has a limitation owing to the large amplitude and irregular characteristics of motion noise. When several sensors are available, sensor fusion and independent component analysis (ICA)-based methods can be used [16,17]. The sensor fusion selects a sensor signal having the highest quality. However, the sensor fusion can not remove the noise itself. In case of ICA, high computational complexity is the shortcoming. Therefore, it is difficult to use ICA in a near-real-time system. Recently, the method using an injection signal was introduced [20]. It estimates the artifacts using the injection signal and the model of the capacitive system, but more investigation on real-life data seems to be needed. The extended Kalman filter (EKF) uses a nonlinear model of ECG signal and tries to apply the model to the Kalman filter that is modified to deal with nonlinear relations. EKF was studied to reduce the noise of conventional contact ECG in other papers, and it was also used for non-intrusive ECG [21,22]. Although it was useful for many cases, it can not be effective to reduce motion noise in non-intrusive ECG because of the model-based approach of EKF. In addition, some prior publications reported on the use of active noise cancellation (ANC), including adaptive filters, to reduce motion noise [18,19]. The adaptive filter can change its filter characteristics using feedback loops [23]. Therefore, it is suitable for dealing with motion noise that has time-variant characteristics. However, to reduce the noise effectively, the ANC needs a reference signal that is highly correlated with the noise and uncorrelated with the original ECG. A prior research used accelerometer data as the reference signal for the ANC, but the result was not effective [24]. The accelerometer data did not satisfy the condition needed in terms of the reference signal, whereby the correlation between the accelerometer data and the noise was not high.
A new method is proposed in this paper to overcome this problem and in an effort to obtain reliable R peak positions. The proposed method places additional cECGs adjacent to the cECGs used for ECG measurement. Then, the difference between the signals by the additional cECGs and the signals by the cECGs to measure ECG is used to construct a reference signal for ANC. For the weight updating algorithm of the adaptive filter in the ANC, affine projection algorithm (APA) is used. Post-processing is added to correct errors that can be caused by ANC in exceptional situations. In addition, the relationship of the proposed reference signal and motion noise is analyzed in the discussion section. To verify the effectiveness of the proposed method, the ECG is tested based on indoor measurements and measurements during driving. The R peak detecting rates of the ECGs before and after the application of the proposed method are then compared. The results will show that the R peaks can be detected in a more stable manner using the proposed method. Furthermore, because its computational complexity is not high, the near-real-time monitoring of HR or HRV by the detected R peaks is possible using this method.

2. Materials and Method

2.1. Measurement System

In conventional works, two or more cECGs were used as electrodes, and they were attached to a chair or a driver’s seat to measure the ECG during daily life activities or driving [25,26]. Furthermore, conductive fabric or an additional cECG was placed on the bottom of the seat for the reduction of the common noise component of the measured signals using a driven-right-leg circuit (DRL) [27].
Our measurement system is designed based on these prior designs. It has two cECGs attached to a seat without any covers, and the conductive fabric is placed on the bottom of the seat for the DRL. However, in our system, an additional cECG is added near the each cECG used to sense ECG as shown in Figure 1. This is to measure the motion information around the cECG for ECG measurement and to obtain a reference signal for ANC. In the figure, R and L are the right and left sensors for ECG measurement, and a R and a L are additional right and left sensors to get the motion information. The signals measured by the four cECGs are filtered using a low-pass filter with a 40 Hz cutoff frequency to remove high-frequency noise. They are then sampled to digital signals at 360 Hz through an NI 9205 from National Instruments using 16 bits for analog-digital conversion. Let the signal measured by cECG i be s i g i . The measured ECG ( E C G m ) is obtained using the limb lead 1 method as
E C G m = B P F [ s i g L s i g R ]
where B P F means the use of a BPF with a 0.05–35 Hz cutoff frequency [28]. In addition to these two signals, r L and r R are calculated as
r L = s i g L s i g a L
r R = s i g R s i g a R
They are used to construct the reference signal for ANC, and its detailed description will be presented in Section 2.3, which discusses the ANC using the reference signal.

2.2. Data Acquisition

Both indoor and outdoor experiments were conducted for data acquisition. In indoor experiment, our measurement system was installed in a chair where subjects sat to measure the ECG. The subjects were one 29-year-old, two 25-year-old, and one 28-year-old healthy males with no heart-related medical history. All subjects wore short sleeved t-shirts made of 100% cotton during the experiments. Five-minute ECG recordings were acquired, three times per subject. The subjects randomly moved their bodies to make a significant amount of artificial motion noise during the experiment. The reason for this motion noise is to verify the performance of our system in a severe environment. In addition to our measurement system, conventional contact electrodes were also used to obtain the true R peak position.
For the outdoor experiment, our system was integrated in the driving seat of a vehicle, and the ECG was measured for six people for a period of 15 min for each, during driving. The subjects were healthy males aged 27–32. Among them, subject 1, a male aged 29, and subject 6, a male aged 28, also participated in the indoor experiment as subject 1 and 4. The subjects wore same clothes used in the indoor experiment. The driving course was a road network that surrounds Pohang University of Science and Technology. Its total length is approximately 2 km, and it includes corners, an uphill grade of 311 m, downhill roads of 120 m, and eight speed bumps, in addition to straight lines. The subjects drove the course anticlockwise and repeatedly during the experiment at speeds lower than 50 km/h. The ECG was also recorded independently using conventional contact electrodes. This was to get the positions of the true R peaks, and detected peaks were inspected manually to correct any errors. The true R peaks were used to evaluate the accuracy of the tested R peaks.
All R peaks were detected by the Pan and Tompkins (PT) algorithm because it is simple and its performance has been well studied in many publications [29,30,31]. The PT algorithm uses a BPF of 5–15 Hz to remove unnecessary signal parts. Then, it applies derivative, squaring, and moving-average operations to the filtered signal. The R peaks are detected by a threshold-based method for the filtered and moving averaged signals at the algorithm.

2.3. ANC and Proposed Reference Signal

Figure 2 is the basic structure of ANC [32,33,34]. In this structure, ANC separates the noise signal n from d, the sum of the original signal s and noise n, using the adaptive filter and reference signal n . For this operation, it is assumed that n is correlated with n but uncorrelated with s. The difference between d and the output of the adaptive filter y can be expressed as the error signal e according to
e = d y = s + n y
If s and n are uncorrelated and n satisfies the former assumption, the mean square of e is as follows:
E [ e 2 ] = E [ ( s + n y ) 2 ] = E [ s 2 ] + E [ ( n y ) 2 ] + 2 · E [ s ( n y ) ] = E [ s 2 ] + E [ ( n y ) 2 ]
The adaptive filter updates its filter weights to minimize the value of E [ e 2 ] :
min { E [ e 2 ] } = min { E [ s 2 ] + E [ ( n y ) 2 ] } = E [ s 2 ] + min { E [ ( n y ) 2 ] }
The filter output y approximates the noise n, and the estimated s can be obtained from the value of e. In our case, s, n, and d represent the original ECG, motion noise, and E C G m , respectively. For this ANC scheme, it is important to design the proper reference signal. It must have a low correlation value with respect to the original ECG and a high correlation with motion noise.
To obtain the reference signal that has a high correlation with motion noise, r L and r R which are constructed by the difference of adjacent cECG signals are used. This is because it is assumed that there is little difference between the cECG signals when a subject is in a static condition, and that the difference increases when the subject is in motion. The verification of its suitability as the reference signal for ANC will be analyzed in Section 4.2. To use r L and r R in our method, the two signals are combined as a reference signal n . When the length of the weight vector or tap length for the adaptive filter is 2 · L , L elements in r L and r R are used for n , as shown in Figure 3. The tap length must be large enough to model relation between n and n , but too large tap length increases computational complexity. In the adaptive filter, the APA is used as the weight-updating algorithm because it converges faster than normalized least-mean-squares and it is less complex than the recursive-least-squares algorithm. Its weight vector updating equation is as follows [23]:
n k = [ r L ( k L + 1 ) . . . r L ( k ) r R ( k L + 1 ) . . . r R ( k ) ] T
U k = [ n k n k 1 . . . n k P + 1 ] T
d k = [ d ( k ) d ( k 1 ) . . . d ( k P + 1 ) ] T
w k + 1 = w k + η U k T ( ϵ I + U k U k T ) 1 [ d k U k w k ]
where η is the step size, ϵ is the regularization parameter, and I is a P × P unit matrix. η determines the convergence speed of the adaptive filter. A large η increases the convergence speed, but it also increases misalignment. ϵ is set to a small constant. Then, ϵ I becomes a diagonal matrix having ϵ as diagonal entries. It is used to prevent the case that the inverse of U k U k T does not exist in Equation (10). P is the projection order of APA, and it means the number of input vectors used to update the weight vector. P decides the convergence speed and complexity of the algorithm. A larger P can increase the convergence speed, but at the same time the complexity of the algorithm will be increased because the dimension of U k U k T is increased. In our method, P is set to 2. w k is the weight vector of the adaptive filter for the k t h sample, and it is updated recursively. Then, the k t h sample of y is calculated by w k and reference signal n k as follows:
y ( k ) = n k T · w k
For data having M samples, the output of ANC ( E C G A N C ) can be obtained as e,
e ( k ) = d ( k ) y ( k )
E C G A N C = e = [ e ( 1 ) e ( 2 ) . . . e ( M ) ]
The effect of ANC can be seen in Figure 4. The figure represents a part of the data from subject 5 of our outdoor experiment. In the figure, motion noise occurred from 2.7 to 4 s of E C G m , and the incorrect R peak was detected at approximately 2.7 s owing to the noise. If r L and r R include the motion information, the noise can be removed. In the example, r R was highly correlated with the motion noise. According to this, the noise could be reduced, and all R peaks could be detected well after ANC, as seen in the second graph in the figure.

2.4. Post-Processing

Even though the proposed reference signal is effective in most cases of motion noise, exceptional situations could happen under real circumstances. These phenomena mainly occur when the additional sensor includes a noise component that does not appear in the E C G m . That is, if a measurement or subtle motion noise occurs only at the additional sensors for the reference signal, the reference signal will contain a noise component that is uncorrelated with noise components in the E C G m . This could cause an error when ANC is conducted because the assumption of high correlation between the reference signal and a noise component in the E C G m is not satisfied. Figure 5 shows an example. In the figure, a noise that is not included in the E C G m was measured by r L at 0.5 s. By this noise component, a peak was wrongly detected after ANC, and the result became more erroneous than that of the E C G m . Therefore, for a robust and practical algorithm, this phenomenon must be prevented, and a post-processing is needed to correct the erroneous result. In our method, E C G A N C and E C G m are evaluated by two rules that are related to the change of peak interval and signal power. When E C G A N C is considered to be abnormal by the rules, E C G A N C is not used and is replaced by E C G m . This process can be considered as a selection process to decide whether E C G A N C is used or not.
To test two signals, the first rule checks the normality of detected R peaks. For this, the R peaks of each signal are detected by the PT algorithm mentioned in Section 2.2. Then, the validity of detected R peaks is tested by the standard to check whether the range of acceleration or deceleration of instantaneous HR is normal. The standard uses an inequality introduced in [35]:
2 · t i 2 t i + 1 + t i + 2 ( t i t i + 1 ) ( t i t i + 2 ) ( t i + 1 t i + 2 ) < 0 . 5
where t i , t i + 1 , t i + 2 are the temporal positions of the three successive R peaks. This is based on the band-limited characteristics of the variation of R peaks, and its effectiveness was verified by an open ECG database [35]. Using this standard, if the number of three peaks that satisfy the standard in E C G A N C is higher than that of E C G m , then E C G A N C is used as the output of our algorithm. This is because it can be considered that E C G A N C contains more valid information on R peaks than E C G m . As an example, only two groups of three R peaks satisfied the standard in E C G m , as shown in Figure 6. On the other hand, the number of three R peaks groups that satisfy the standard was three for E C G A N C by reduced noise. In this case, E C G A N C is selected as the output of the algorithm by the rule.
For cases that do not satisfy the first rule, the second rule is applied. The rule compares the change of signal power in 5–15 Hz after ANC. The range of 5–15 Hz is the frequency band of an R peak [29]. Therefore, if ANC operates effectively and motion noise is reduced, the power of the frequency band will be decreased. This is because ANC assumes that the measured signal contains an additive noise to an original signal, and ANC operates to cancel out the noise. On the other hand, the increased power of the frequency band can be considered as an abnormal operation of ANC. As seen in Figure 5, if the reference signal contains noise that is uncorrelated with E C G m , it can generate additional noise that can cause the incorrectly detected R peaks or a performance degradation in R peak detection. For this reason, E C G A N C is discarded and E C G m is used as the output of the proposed algorithm when this rule is satisfied:
P A N C > P m
where P A N C is the 5–15 Hz signal power of E C G A N C and P m is that of E C G m . For the rest of the cases, E C G A N C is used as the output of the algorithm.

3. Experimental Results

3.1. Performance Index

To represent the accuracy of the detected R peaks, two performance indices were used: a) the sensitivity ( S e ), and b) the positive predictivity ( P + ) index. The two indices are calculated as follows,
S e = T P T P + F N × 100
P + = T P T P + F P × 100
where TP is the number of correctly detected R peaks, FN is the number of undetected R peaks within searching windows based on true R peaks, and FP is the number of detected R peaks at the outside of the searching window. Conventionally, 150 ms of searching window is used and it has 54 sample points in our system with a 360 Hz sampling rate [36]. However, we used 15 sample points for the searching window to identify the correctly detected R peaks because the ECG measured in the non-intrusive manner is much noisy than the ECG by the contact electrodes. Figure 7 shows the necessity of the decreased searching window. In the figure, the third peak was incorrectly detected by noise, but the sample difference with the position of its true R peak was 42 samples. In this case, the peak can be considered as the correctly detected R peak by the 150 ms of searching window. To avoid the false classification, the decreased searching window was used.

3.2. Comparison of Results

To verify the effect of the proposed method, we applied the method to the experimental data. In this process, every 4.5 s block of recorded data were processed sequentially. We used the 4.5 s length because at least three R peaks were needed for our post-processing. More longer block can be used, but we did not enlarge the length considering near-real-time operation. Furthermore, short block length will be advantageous for the post-processing because signal can be evaluated more minutely. In the processed data, 1.5 s of data represented the overlapped data that were used in previous processing. The overlapped data were needed to detect a R peak occurred at the boundary of two processing windows stably. The step size and tap length of the adaptive filter were set to 0.01 and 360 experimentally.
A comparison of the results for the indoor and outdoor experiments is listed in Table 1 and Table 2. In the tables, S e and P + are presented for E C G m , E C G A N C , and the signal after post-processing. To show the difficulty of using a conventional ECG denoising method for the signal by a non-intrusive sensor, the performance indices of a wavelet-thresholding-based method were attached together [37]. In addition, the results by EKF were presented for comparison. In the table for the indoor experiment, data 1-1, 1-2, and 1-3 are the data from the subject 1. Likewise, data 2-1, 2-2, and 2-3, and data 3-1, 3-2, and 3-3, and data 4-1, 4-2, and 4-3 were measured from same subjects. d _ a c c is the difference of S e + P + between the tested signal and that of E C G m . That is, let S e and P + of E C G m be S e m and P m + , and those of the tested signal be S e t and P t + . Then, d _ a c c is as follows:
d _ a c c = ( S e t + P t + ) ( S e m + P m + )
This is calculated to compare the increase in R peak detecting accuracy by applied methods considering both S e and P + .
In Table 1, the effect of ANC could be identified. For most data, S e and P + were increased after ANC. However, the R peak detecting accuracy was lower than that of E C G m at data 3-3. This was because the reference signal of the data contained uncorrelated noise with the E C G m , as seen in Figure 5. This noise could happen by an electrical or measurement noise at the additional sensors used to construct the reference signal. Post-processing is added for cases like this. After post-processing, the accuracy of all data were higher than that of the E C G m . S e + P + increased 8.91% on average and 26.26% maximally at data 2-1. For the outdoor data, the proposed method likewise detected R peaks more accurately, as seen in Table 2. The proposed method increased S e + P + by 7.36% on average. However, ANC itself was not effective and the increase in accuracy was not significant after post-processing for outdoor data 1, 2, and 3. This was related to the characteristics of the data and will be discussed in the next section.
Post-processing increased the accuracy in most data. Its effect was noticeable at indoor data 3-3, and outdoor data 1, 2, and 3 having lower accuracy than E C G m after ANC. By the post-processing, the accuracy of the data was increased and it was higher than that of E C G m likewise other data. On the other hand, the R peak detecting accuracy of ANC decreased for indoor data 2-1, 3-2, and 4-2 after the post-processing. This was because the post-processing could not perfectly distinguish the signal having better accuracy in a certain processing window. It was hard to choose better signal when the signal contained a noisy or irregular component. However, the decreased accuracy was insignificant and it was lower than 0.5%. Furthermore, the accuracy increased for all outdoor data having longer data length than indoor data after the post-processing. This result shows an advantage of the post-processing for general cases.
In the results, the wavelet-based method had an effect on the indoor data 1-3, 2-2, 3-2, 4-2, and 4-3 and outdoor data 1, 2, and 6, but the accuracy was mostly lower than the original one. This was because of the large amplitude of motion noise. The wavelet-based method divides the signal into the signals of a certain frequency band, and it applies a threshold to remove noise components. Therefore, this method was not effective in the non-intrusive ECG because the ECG contained motion noise having a large amplitude. The EKF enhanced the R peak detecting accuracy of all data except for indoor data 1-1 and outdoor data 3. For indoor data 3-3 and 4-3, its accuracy was higher than that of ANC with post-processing. However, the increased accuracy was not significant for all data. This limitation comes from the model-based approach of EKF. It uses an ECG model to estimate the original ECG, but the used model will have a large error with a measured signal. This error can be generated by the low signal-to-noise ratio of the non-intrusive ECG signal itself and the motion noise having a significant amplitude. The increased S e + P + was maximum in indoor data 1-3 as 2.59% by the EKF. On the other hand, the effect of ANC was remarkable. Its accuracy was higher than other methods for most of the data, and its increased range was significant. Furthermore, it could improve the accuracy of all data with post-processing. The averaged rate of increase was 8.39% for all experimental data. Figure 8 shows one example that represents the advantage of ANC. The wavelet-based method and EKF were not effective to reduce motion noise in the figure. However, ANC could reduce the motion noise prominently and all R peaks were correctly detected. This effectiveness of ANC results from the proposed reference signal that contains information on the occurred motion noise.
In addition, the complexity of our method is not high. In our experiments, the measured ECG was processed by MATLAB and a personal computer having an Intel Core i7-3930k CPU and 16 GB of RAM. The processing time for the data divided into a 4.5 s length was 0.21 s on average and total processing time for the entire data including total indoor and outdoor data was 662.98 s. In the 4.5 s data, a 1.5 s length is overlapped data and 3 s is newly processed data. The 0.21 s is very short compared with the 3 s length of the new data. Therefore, our algorithm could be implemented in a near-real-time system.

4. Discussion

4.1. Analysis on Outdoor Data

In Table 2, ANC was less effective for outdoor data 1, 2, and 3 compared to indoor data. To investigate the reason, the outdoor data were analyzed in Table 3. In the table, S e + P + represents the sum of S e and P + for the each E C G m of outdoor data. S e + P + was high in outdoor data 1, 2, and 3 because the data had little noise. In this case, the application of ANC could not make much difference in R peak detecting accuracy because the signal was already clean and contained little noise. This can be one reason that the effect of ANC was not remarkable.
To know the characteristics of noise in the data, we divided the processing windows of each outdoor data into two groups. One is the windows having 100% of S e and P + . The windows can be considered signal parts having little noise, and the averaged signal power of the windows ( P c l e a n ) was calculated to compare it with noise power ( P n o i s e ) in each data. Windows in the other group can be considered as noisy signal parts because it contains R peak detecting error. P n o i s e was obtained as the averaged signal power of the windows in each data, and the relative amplitude of P n o i s e ( r _ P n o i s e ) for clean signal parts was calculated as
r _ P n o i s e = P n o i s e P c l e a n
r _ P n o i s e was extremely high in outdoor data 2 and 3 as seen in Table 3. This severe noise occurred when the body of subjects was totally detached and far away from the cECGs by the manipulation of the steering wheel in a corner, or by the sway of the vehicle owing to speed bumps. For this excessively severe noise, ANC was not effective. This is because additional cECGs could not measure the valid motion information that was related to the noise in E C G m . Furthermore, the characteristics of noise measured in the additional cECGs could be much different from the noise in E C G m . Outdoor data 2 and 3 included a small number of noisy windows, and the noise of the windows was severe. The use of ANC was not effective in the data by this reason. When the data were measured, the movement of subjects was restricted by the cautious behavior of subjects for the experiment and the use of contact ECG electrodes. This could make the data contain a few signal parts having the noise that can be effectively reduced by ANC. In real driving situations where the various movements of a subject occur, the effect of ANC will be more prominent as in the rest of the outdoor data.
In addition, the same problem with indoor data 3-3 occurred in some outdoor data as seen in Figure 9. This problem was caused by the motion information that is included in reference signal but uncorrelated with motion noise in E C G m . A measurement noise or electrical noise can be a reason for this phenomenon. However, these errors were corrected by post-processing. After ANC with the post-processing, R peak detecting accuracy was increased, and the increased accuracy outperformed those of other methods in all outdoor data.

4.2. Appropriateness of Proposed Reference Signal

This section analyzes the suitability of the proposed reference signal as a reference signal for ANC. First, to confirm the assumption that the reference signal and the R wave of the ECG are uncorrelated, the ECG with a 3-min length ( E C G c l e a n ) was measured in a stable condition to make it contain only the ECG itself with as little motion noise as possible. Then, E C G c l e a n passed through the BPF of 5–15 Hz to get R waves, and the correlation coefficients (CC) with r L and r R constructing the reference signal were calculated. For two representative signals X and Y, having M samples each, their correlation can be expressed by CC:
C C = i = 1 M ( X i X ¯ ) ( Y i Y ¯ ) i = 1 M ( X i X ¯ ) 2 i = 1 M ( Y i Y ¯ ) 2
where X ¯ and Y ¯ are the means of X and Y [38]. If the two signals have a low correlation, the value of CC will be close to 0. For signals that have a high correlation, the absolute value of CC will be close to 1. For the 5–15 Hz components of E C G c l e a n , calculated CC can be seen in Figure 10, and the same analysis was conducted for indoor data 2-1 in Figure 11 for comparison. The lower parts of two figures represent the 5–15 Hz signal power of each signal. The signal power was much higher in the indoor data 2-1 because it contained much motion noise. Looking at the results on CC, the absolute value of CC was lower than 0.15 when there was little motion noise and the signal was approximated to the R wave. Comparing this result with the CC of the noisy signal in Figure 11, it is obvious that the correlations between R wave and r L , r R are low. Therefore, it can be concluded that the correlation between the proposed reference signal and the R wave is low because the proposed reference signal consists of r L and r R .
From the former results, the correlation between motion noise and r L , r R could also be known because the absolute value of CC was increased when the motion noise occurred. To show a more generalized result, the E C G m of the indoor data and E C G c l e a n were filtered by a HPF of 1 Hz to reduce the effect of respiration. Let the filtered ECG be E C G H , the sum of absolute values of CCs between E C G H with r L and with r R ( C C L + R ) was calculated at every processing window unit. Then, C C L + R s were averaged for each indoor data and E C G c l e a n . That is, the averaged C C L + R ( a _ C C L + R ) is calculated as
C C L + R , i = a b s ( C C L , i ) + a b s ( C C R , i )
a _ C C L + R = 1 N i = 1 N C C L + R , i
where N is the number of processing windows in each data. C C L , i or C C R , i is the CC between the tested E C G H and r L or r R in the i t h processing window. The calculated a _ C C L + R is listed in Table 4. In all cases, a _ C C L + R of indoor data containing motion noise was higher than E C G c l e a n . This result reveals that the reference signal and the motion noise have a correlation because a _ C C L + R increased when the ECG contained the motion noise.
To validate the relation in more detail, all E C G c l e a n , indoor and outdoor data were filtered by the HPF of 1 Hz and the averaged signal power was calculated according to C C L + R . That is, C C L + R was divide into 0.05 interval and signal power in each interval was averaged in Figure 12. For the experiment, a processing window having signal power higher than a threshold was treated as a outlier and excluded. The threshold was set as 100 times P c l e a n for each data. P c l e a n is obtained as the averaged signal power of processing windows having 100% of S e and P + for each data as mentioned in the previous section. In the Figure 12, the degree of correlation between the reference signal and ECG was increased mostly in accordance with the increase in signal power or the occurrence of motion noise. This tendency can be considered as the evidence of a high correlation between the reference signal and the motion noise because the correlation is increased as the ratio of motion noise in ECG increased.

5. Conclusions

This study proposes a method to reduce motion noise and to accurately detect R peaks using non-intrusive sensors. It uses additional cECGs placed adjacent to the cECGs for ECG measurement. Then, a reference signal is constructed using the sensor signals, and it is utilized in ANC including an adaptive filter with an APA to reduce motion noise and enhance R peaks. Post-processing is added to prevent an incorrect result in exceptional situations and to make our method more practical. In experiments, the system was implemented in a chair and a driving seat. Based on the results, an increase in R peak detecting accuracy was verified when the proposed method was used. Then, the analysis of the proposed reference signal was conducted to show its suitability for theoretical assumptions.
The proposal for the new reference signal to denoise non-intrusive ECG is our original work. In addition, the effect of our method using the new reference signal could be shown numerically by our experimental results. Because of the advantages of our method, more accurate and stable HR or HRV values can be obtained by detected R peaks in non-intrusive measurements. In addition, the proposed method does not need high-computational complexity, and it can proceed in near-real-time. Therefore, our method can be used in applications that require real-time HR or HRV information and that use a device having a shape that is similar to a chair. One of the examples is a driver’s condition monitoring system.
To improve our system, an adaptive filter technique like variable step size algorithms or the combination of two adaptive filters can be used to deal with motion noise. Furthermore, post-processing can be modified to obtain better results and not to degrade the performance of ANC as pointed out at result section. In addition, just one additional cECG was used in our method to obtain motion information for each left and right side, because this research was conducted to investigate its availability. Therefore, research using more sensors can be performed to improve R peak detecting accuracy in the future. Moreover, the system was integrated with a chair and driving seat in our experiment. Research to apply our system to a wearable device can be conducted. This will expand the applicability of our method.

Acknowledgments

This research was supported by the MSIP(Ministry of Science, ICT and Future Planning), Korea, under the “ICT Consilience Creative Program” (IITP-2015-R0346-15-1007) supervised by the IITP(Institute for Information & communications Technology Promotion).

Author Contributions

Minho Choi wrote this paper and proposed the main idea of this research. Overall hardware and software systems were developed mainly by him. Jae Jin Jeong conducted the data analysis and simulation of adaptive filter. Seung Hun Kim designed and performed the experiments. Sang Woo Kim managed the whole process and assisted the development of the proposed method and data analysis.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Webster, J. Medical Instrumentation: Application and Design, 4th ed.; John Wiley & Sons: Hoboken, NJ, USA, 2009. [Google Scholar]
  2. Kleiger, R.E.; Stein, P.K.; Bigger, J.T. Heart rate variability: Measurement and clinical utility. Ann. Noninvasive Electrocardiol. 2005, 10, 88–101. [Google Scholar] [CrossRef] [PubMed]
  3. Malik, M. Heart rate variability standards of measurement, physiological interpretation, and clinical use. Eur. Heart J. 1996, 17, 354–381. [Google Scholar] [CrossRef]
  4. Patel, M.; Lal, S.K.L.; Kavanagh, D.; Rossiter, P. Applying neural network analysis on heart rate variability data to assess driver fatigue. Expert Syst. Appl. 2011, 38, 7235–7242. [Google Scholar] [CrossRef]
  5. Vicente, J.; Laguna, P.; Bartra, A.; Bailón, R. Drowsiness detection using heart rate variability. Med. Biol. Eng. Comput. 2016, 1, 1–11. [Google Scholar] [CrossRef] [PubMed]
  6. Lee, J.S.; Heo, J.; Lee, W.K.; Lim, Y.G.; Kim, Y.H.; Park, K.S. Flexible capacitive electrodes for minimizing motion artifacts in ambulatory electrocardiograms. Sensors 2014, 14, 14732–14743. [Google Scholar] [CrossRef] [PubMed]
  7. Pirbhulal, S.; Zhang, H.; Mukhopadhyay, S.C.; Li, C.; Wang, Y.; Li, G.; Wu, W.; Zhang, Y.-T. An efficient biometric-based algorithm using heart rate variability for securing body sensor networks. Sensors 2015, 15, 15067–15089. [Google Scholar] [CrossRef] [PubMed]
  8. Lee, H.J.; Hwang, S.H.; Yoon, H.N.; Lee, W.K.; Park, K.S. Heart rate variability monitoring during sleep based on capacitively coupled textile electrodes on a bed. Sensors 2015, 15, 11295–11311. [Google Scholar] [CrossRef] [PubMed]
  9. Fong, E.-M.; Chung, W.-Y. Mobile cloud-computing-based healthcare service by noncontact ecg monitoring. Sensors 2013, 13, 16451–16473. [Google Scholar] [CrossRef] [PubMed]
  10. Sun, Y.; Yu, X.B. An innovative nonintrusive driver assistance system for vital signal monitoring. IEEE J. Biomed. Health Inform. 2014, 18, 1932–1939. [Google Scholar] [CrossRef] [PubMed]
  11. Wartzek, T.; Eilebrecht, B.; Lem, J.; Lindner, H.-J.; Leonhardt, S.; Walter, M. Ecg on the road: Robust and unobtrusive estimation of heart rate. IEEE Trans. Biomed. Eng. 2011, 58, 3112–3120. [Google Scholar] [CrossRef] [PubMed]
  12. Nemati, E.; Deen, M.J.; Mondal, T. A wireless wearable ecg sensor for long-term applications. IEEE Commun. Mag. 2012, 50, 36–43. [Google Scholar] [CrossRef]
  13. Wartzek, T.; Lammersen, T.; Eilebrecht, B.; Walter, M.; Leonhardt, S. Triboelectricity in capacitive biopotential measurements. IEEE Trans. Biomed. Eng. 2011, 58, 1268–1277. [Google Scholar] [CrossRef] [PubMed]
  14. Tong, D.A.; Bartels, K.A.; Honeyager, K.S. Adaptive reduction of motion artifact in the electrocardiogram. In Proceedings of the 24th Annual Conference and the Annual Fall Meeting of the Biomedical Engineering Society EMBS/BMES Conference, Houston, TX, USA, 23–26 October 2002; pp. 1403–1404.
  15. Chen, S.-W.; Chen, Y.-H. Hardware design and implementation of a wavelet de-noising procedure for medical signal preprocessing. Sensors 2015, 15, 26396–26414. [Google Scholar] [CrossRef] [PubMed]
  16. Wartzek, T.; Bruser, C.; Walter, M.; Leonhardt, S. Robust sensor fusion of unobtrusively measured heart rate. IEEE J. Biomed. Health Inform. 2014, 18, 654–660. [Google Scholar] [CrossRef] [PubMed]
  17. Romero, I. Pca and ica applied to noise reduction in multi-lead ecg. In Proceedings of the Computing in Cardiology, Hangzhou, China, 18–21 September 2011; pp. 613–616.
  18. Thakor, N.V.; Zhu, Y.-S. Applications of adaptive filtering to ecg analysis: Noise cancellation and arrhythmia detection. IEEE Trans. Biomed. Eng. 1991, 38, 785–794. [Google Scholar] [CrossRef] [PubMed]
  19. Yelderman, M.; Widrow, B.; Cioffi, J.M.; Hesler, E.; Leddy, J.A. Ecg enhancement by adaptive cancellation of electrosurgical interference. IEEE Trans. Biomed. Eng. 1983, 7, 392–398. [Google Scholar] [CrossRef]
  20. Serteyn, A.; Vullings, R.; Meftah, M.; Bergmans, J.W.M. Motion artifacts in capacitive ecg measurements: Reducing the combined effect of dc voltages and capacitance changes using an injection signal. IEEE Trans. Biomed. Eng. 2015, 62, 264–273. [Google Scholar] [CrossRef] [PubMed]
  21. Sameni, R.; Shamsollahi, M.B.; Jutten, C.; Babaie-Zadeh, M. Filtering noisy ecg signals using the extended kalman filter based on a modified dynamic ecg model. In Proceedings of the Computers in Cardiology, Lyon, France, 25–28 September 2005; pp. 1017–1020.
  22. Rachim, V.P.; Kang, S.-C.; Chung, W.-Y.; Kwon, T.-H. Implementation of extended kalman filter for real-time noncontact ecg signal acquisition in android-based mobile monitoring system. J. Sens. Sci. Technol. 2014, 23, 7–14. [Google Scholar] [CrossRef]
  23. Sayed, A.H. Fundamentals of Adaptive Filtering, 1st ed.; John Wiley & Sons: Hoboken, NJ, USA, 2003. [Google Scholar]
  24. Eilebrecht, B.; Wartzek, T.; Willkomm, J.; Schommartz, A.; Walter, M.; Leonhardt, S. Motion artifact removal from capacitive ecg measurements by means of adaptive filtering. In Proceedings of the 5th European Conference of the International Federation for Medical and Biological Engineering, Budapest, Hungary, 14–18 September 2012; pp. 902–905.
  25. Leonhardt, S.; Aleksandrowicz, A. Non-contact ecg monitoring for automotive application. In Proceedings of the 5th International Summer School and Symposium on Medical Devices and Biosensors, Hong Kong, China, 1–3 June 2008; pp. 183–185.
  26. Wartzek, T.; Weber, H.; Walter, M.; Eilebrecht, B.; Leonhardt, S. Automatic electrode selection in unobtrusive capacitive ecg measurements. In Proceedings of the 25th International Symposium on Computer-Based Medical Systems (CBMS), Ribeirão Preto, Brazil, 22–25 June 2012; pp. 1–4.
  27. Winter, B.B.; Webster, J.G. Driven-right-leg circuit design. IEEE Trans. Biomed. Eng. 1983, 1, 62–66. [Google Scholar] [CrossRef]
  28. Clifford, G.D.; Azuaje, F.; McSharry, P. Advanced Methods and Tools for ECG Data Analysis; Artech House, Inc.: Norwood, MA, USA, 2006. [Google Scholar]
  29. Pan, J.; Tompkins, W.J. A real-time qrs detection algorithm. IEEE Trans. Biomed. Eng. 1985, 3, 230–236. [Google Scholar] [CrossRef] [PubMed]
  30. Aquino-Santos, R.; Martinez-Castro, D.; Edwards-Block, A.; Murillo-Piedrahita, A.F. Wireless sensor networks for ambient assisted living. Sensors 2013, 13, 16384–16405. [Google Scholar] [CrossRef] [PubMed]
  31. Feldhege, F.; Mau-Moeller, A.; Lindner, T.; Hein, A.; Markschies, A.; Zettl, U.K.; Bader, R. Accuracy of a custom physical activity and knee angle measurement sensor system for patients with neuromuscular disorders and gait abnormalities. Sensors 2015, 15, 10734–10752. [Google Scholar] [CrossRef] [PubMed]
  32. Alzahrani, A.; Hu, S.; Azorin-Peris, V.; Barrett, L.; Esliger, D.; Hayes, M.; Akbare, S.; Achart, J.; Kuoch, S. A multi-channel opto-electronic sensor to accurately monitor heart rate against motion artefact during exercise. Sensors 2015, 15, 25681–25702. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  33. Al-Kadi, M.I.; Ibne Reaz, M.B.; Mohd Ali, M.A. Evolution of electroencephalogram signal analysis techniques during anesthesia. Sensors 2013, 13, 6605–6635. [Google Scholar] [CrossRef] [PubMed]
  34. Widrow, B.; Glover, J.R., Jr.; McCool, J.M.; Kaunitz, J.; Williams, C.S.; Hearn, R.H.; Zeidler, J.R.; Dong, E., Jr.; Goodlin, R.C. Adaptive noise cancelling: Principles and applications. Proc. IEEE 1975, 63, 1692–1716. [Google Scholar] [CrossRef]
  35. Mateo, J.; Laguna, P. Analysis of heart rate variability in the presence of ectopic beats using the heart timing signal. IEEE Trans. Biomed. Eng. 2003, 50, 334–343. [Google Scholar] [CrossRef] [PubMed]
  36. Winokur, E.S.; Delano, M.K.; Sodini, C.G. A wearable cardiac monitor for long-term data acquisition and analysis. IEEE Trans. Biomed. Eng. 2013, 60, 189–192. [Google Scholar] [CrossRef] [PubMed]
  37. Poornachandra, S. Wavelet-based denoising using subband dependent threshold for ecg signals. Digit. Signal Process. 2008, 18, 49–55. [Google Scholar] [CrossRef]
  38. James, G.; Witten, D.; Hastie, T.; Tibshirani, R. An Introduction to Statistical Learning, 1st ed.; Springer: New York, NY, USA, 2013. [Google Scholar]
Figure 1. Schematic diagram of ECG measurement system placed in a seat.
Figure 1. Schematic diagram of ECG measurement system placed in a seat.
Sensors 16 00715 g001
Figure 2. Structure of ANC used to reduce motion noise n in the measured ECG d.
Figure 2. Structure of ANC used to reduce motion noise n in the measured ECG d.
Sensors 16 00715 g002
Figure 3. Reference signal n k , and weight vector w k of the adaptive filter used to process the k t h sample of ECG.
Figure 3. Reference signal n k , and weight vector w k of the adaptive filter used to process the k t h sample of ECG.
Sensors 16 00715 g003
Figure 4. Effect of ANC, including noise reduction and the enhancement of R wave. Green circles are the true R peak positions detected by the contact ECG, and red stars are detected R peaks in each signal.
Figure 4. Effect of ANC, including noise reduction and the enhancement of R wave. Green circles are the true R peak positions detected by the contact ECG, and red stars are detected R peaks in each signal.
Sensors 16 00715 g004
Figure 5. Example of the case where ANC is not effective.
Figure 5. Example of the case where ANC is not effective.
Sensors 16 00715 g005
Figure 6. Evaluation of E C G A N C and E C G m using the inequality related to the normality of instantaneous HR.
Figure 6. Evaluation of E C G A N C and E C G m using the inequality related to the normality of instantaneous HR.
Sensors 16 00715 g006
Figure 7. Detected R peaks in ECG measured by cECG. The numbers on the detected R peaks represent the sample difference with each true R peak positions.
Figure 7. Detected R peaks in ECG measured by cECG. The numbers on the detected R peaks represent the sample difference with each true R peak positions.
Sensors 16 00715 g007
Figure 8. Comparison of ANC with other methods for a signal part in outdoor data 5.
Figure 8. Comparison of ANC with other methods for a signal part in outdoor data 5.
Sensors 16 00715 g008
Figure 9. Erroneous case of ANC for a signal part in outdoor data 1.
Figure 9. Erroneous case of ANC for a signal part in outdoor data 1.
Sensors 16 00715 g009
Figure 10. (Top) CCs between the 5–15 Hz components of E C G c l e a n and r L , r R ; (Bottom) 5–15 Hz signal power of E C G c l e a n at each processing window.
Figure 10. (Top) CCs between the 5–15 Hz components of E C G c l e a n and r L , r R ; (Bottom) 5–15 Hz signal power of E C G c l e a n at each processing window.
Sensors 16 00715 g010
Figure 11. (Top) CCs between the 5–15 Hz components of indoor data 2-1 and r L , r R ; (Bottom) 5–15 Hz signal power of indoor data 2-1 at each processing window.
Figure 11. (Top) CCs between the 5–15 Hz components of indoor data 2-1 and r L , r R ; (Bottom) 5–15 Hz signal power of indoor data 2-1 at each processing window.
Sensors 16 00715 g011
Figure 12. Relation between C C L + R and averaged signal power.
Figure 12. Relation between C C L + R and averaged signal power.
Sensors 16 00715 g012
Table 1. Comparison results of R peak detecting accuracy for indoor data having severe motion noise.
Table 1. Comparison results of R peak detecting accuracy for indoor data having severe motion noise.
Data ECG m Wavelet EKF ANC After Post-Processing
S e P + S e P + d _ a c c S e P + d _ a c c S e P + d _ a c c S e P + d _ a c c
1-166.4151.83 65.6351.12−1.49 66.4151.10−0.73 74.2258.2814.27 75.0058.9015.66
1-288.5172.84 87.5373.36−0.45 88.2673.080.00 88.2674.431.35 88.7575.002.41
1-384.0672.96 83.8273.360.16 85.0274.582.59 84.5475.272.80 85.5175.974.46
2-153.1845.63 50.3841.86−6.57 54.4546.622.26 68.9656.5826.72 68.7056.3726.26
2-265.5958.89 66.0961.813.41 66.0960.682.29 72.5266.4414.48 72.7766.3714.66
2-365.5158.41 64.0256.95−2.94 67.2558.531.86 69.7360.175.98 69.9861.177.23
3-184.8472.59 84.1172.73−0.60 85.8273.281.66 90.9580.8714.39 90.9581.4014.92
3-289.3978.32 89.3978.490.17 89.1479.150.58 92.1779.523.98 91.6779.613.56
3-393.3585.61 93.0984.95−0.92 94.1586.551.74 92.8285.12−1.02 93.0986.420.54
4-186.3972.56 85.1571.97−1.83 87.1374.112.29 86.8875.163.10 87.8775.854.78
4-264.5754.33 64.3255.050.47 66.3354.321.75 71.6159.2511.95 71.6158.8811.59
4-392.3381.73 92.5982.350.88 93.3982.481.80 91.8082.420.16 92.8682.010.81
Average77.8467.14 77.1867.00−0.81 78.6267.871.51 82.0471.138.18 82.4071.498.91
Table 2. Comparison results of R peak detecting accuracy for outdoor experiment.
Table 2. Comparison results of R peak detecting accuracy for outdoor experiment.
Data ECG m Wavelet EKF ANC After Post-Processing
S e P + S e P + d _ a c c S e P + d _ a c c S e P + d _ a c c S e P + d _ a c c
194.2787.52 94.1988.070.48 94.8187.640.66 92.7485.37−3.67 94.2788.210.69
290.1488.65 90.1488.790.14 91.1789.882.26 89.7487.37−1.68 91.4989.562.26
396.5992.86 96.5092.86−0.09 96.5092.70−0.24 96.1692.45−0.84 96.5993.170.31
492.5077.96 91.9878.490.00 93.1379.892.55 94.6986.2410.47 95.3185.8310.68
578.0165.12 77.0465.47−0.62 79.6864.811.35 87.0773.9917.93 87.0774.4918.43
684.5278.50 84.4578.690.12 85.4278.631.03 90.1281.408.50 90.9583.8811.80
Average89.3481.77 89.0582.060.00 90.1282.261.27 91.7584.475.12 92.6185.867.36
Table 3. Signal quality and noise power analysis for outdoor data.
Table 3. Signal quality and noise power analysis for outdoor data.
Data123456
S e + P + 181.79178.79189.45170.46143.14136.02
r _ P n o i s e 3.2567.9365.484.359.267.41
Table 4. Averaged sum of absolute values of CCs between the E C G H with r L and with r R for the indoor data and E C G c l e a n .
Table 4. Averaged sum of absolute values of CCs between the E C G H with r L and with r R for the indoor data and E C G c l e a n .
Data1-11-21-32-12-22-33-13-23-34-14-24-3 E C G c l e a n
a _ C C L + R 0.380.330.400.650.430.660.360.300.310.430.330.330.17

Share and Cite

MDPI and ACS Style

Choi, M.; Jeong, J.J.; Kim, S.H.; Kim, S.W. Reduction of Motion Artifacts and Improvement of R Peak Detecting Accuracy Using Adjacent Non-Intrusive ECG Sensors. Sensors 2016, 16, 715. https://doi.org/10.3390/s16050715

AMA Style

Choi M, Jeong JJ, Kim SH, Kim SW. Reduction of Motion Artifacts and Improvement of R Peak Detecting Accuracy Using Adjacent Non-Intrusive ECG Sensors. Sensors. 2016; 16(5):715. https://doi.org/10.3390/s16050715

Chicago/Turabian Style

Choi, Minho, Jae Jin Jeong, Seung Hun Kim, and Sang Woo Kim. 2016. "Reduction of Motion Artifacts and Improvement of R Peak Detecting Accuracy Using Adjacent Non-Intrusive ECG Sensors" Sensors 16, no. 5: 715. https://doi.org/10.3390/s16050715

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop