Next Article in Journal
Machine Learning Approach to Analyze the Heavy Quark Diffusion Coefficient in Relativistic Heavy Ion Collisions
Next Article in Special Issue
Use of Intrinsic Entropy to Assess the Instantaneous Complexity of Thoracoabdominal Movement Patterns to Indicate the Effect of the Iso-Volume Maneuver Trial on the Performance of the Step Test
Previous Article in Journal
Non-Linear Measures of Postural Control in Response to Painful and Non-Painful Visual Stimuli
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Multiscale Cumulative Residual Dispersion Entropy with Applications to Cardiovascular Signals

Department of Electronics and Communications Engineering, Kwangwoon University, Seoul 01897, Republic of Korea
*
Author to whom correspondence should be addressed.
Entropy 2023, 25(11), 1562; https://doi.org/10.3390/e25111562
Submission received: 22 October 2023 / Revised: 14 November 2023 / Accepted: 16 November 2023 / Published: 20 November 2023
(This article belongs to the Special Issue Entropy in Biomedical Engineering II)

Abstract

:
Heart rate variability (HRV) is used as an index reflecting the adaptability of the autonomic nervous system to external stimuli and can be used to detect various heart diseases. Since HRVs are the time series signal with nonlinear property, entropy has been an attractive analysis method. Among the various entropy methods, dispersion entropy (DE) has been preferred due to its ability to quantify the time series’ underlying complexity with low computational cost. However, the order between patterns is not considered in the probability distribution of dispersion patterns for computing the DE value. Here, a multiscale cumulative residual dispersion entropy (MCRDE), which employs a cumulative residual entropy and DE estimation in multiple temporal scales, is presented. Thus, a generalized and fast estimation of complexity in temporal structures is inherited in the proposed MCRDE. To verify the performance of the proposed MCRDE, the complexity of inter-beat interval obtained from ECG signals of congestive heart failure (CHF), atrial fibrillation (AF), and the healthy group was compared. The experimental results show that MCRDE is more capable of quantifying physiological conditions than preceding multiscale entropy methods in that MCRDE achieves more statistically significant cases in terms of p-value from the Mann–Whitney test.

1. Introduction

The physiological system is regulated by systems interacting across multiple spatial and temporal scales. Such systems generate complex variations with information related to dynamic systems [1]. The complexity of physiological systems has a property of dynamic models reflecting the ability to respond and adapt to the ever-changing environment. Thus, quantifying a system’s complexity is a prospective tool for analyzing physiological systems with non-static, nonlinear, and complex behaviors [2,3,4,5]. Such complexity analysis of physiological signals can help to extract primary information about the dynamic relationship of systems in changes related to human statuses, such as aging, emotions, and diseases. Moreover, it becomes essential to quantify physiological signals in clinical diagnosis and prognosis cases for medical devices and healthcare, which have recently received increasing attention.
Entropy has been broadly used as a measure to prove the existence of deterministic chaos from data [6,7]. Richman et al. devised sample entropy (SampEn) which analyzes the degree of self-similarity of the signals [8]. SampEn has been utilized in analyzing various types of signals [9,10]. Despite SampEn’s capability, it is vulnerable to short-length signals and is not feasible for real-time applications due to computational complexity, especially for long signals. Another widely used entropy has been permutation entropy (PE), which captures the order relations between values of a time series and extracts a probability distribution of the ordinal patterns. Although PE is computationally simple and fast [11,12], it does not consider the amplitude of information, such as the mean value of amplitudes and differences between amplitudes values.
As an alternative entropy measure, dispersion entropy (DE), which uses symbolic patterns and Shannon entropy to quantify the uncertainty of time series, has been introduced [13]. DE generates symbolic patterns, named dispersion patterns, transforming an original time series into a new signal with only a few constituents. As a result, some specific information may be lost, but certain invariant and robust features may be preserved [14,15,16]. Unlike PE, DE does not need to calculate every distance between two composite delay vectors consisting of embedding dimensions m and m + 1, so DE gains a lower complexity cost. In addition, DE is more capable of capturing features of changing amplitude, frequency, and bandwidth of time series. Thus, DE can be a more suitable method than SampEn and PE for real-time processing applications such as medical diagnosis.
Despite these strengths of DE, it also has drawbacks. DE does not consider the order of each pattern in the probability distribution of the dispersion pattern. For example, suppose there are four dispersion patterns for any two signals. The probability of each dispersion pattern of one signal is P 1 = 0.4 ,   0.3 ,   0.2 ,   0.1 and the other one is P 2 = { 0.1 ,   0.2 ,   0.3 ,   0.4 } . The DE values for these two distributions are equal because each entropy value is calculated with only each probability without considering the order of patterns. However, those two probability distributions are different, so the ability to distinguish between the signals forming those two distributions is not sufficient. This could make distinguishing between a biological signal with a high distribution of dispersion patterns corresponding to a low amplitude and one with a high distribution of dispersion patterns relating to a high amplitude challenging. As a result, reliable clinical diagnosis may be difficult. A cumulative residual entropy (CRE) has been used to solve this problem [17]. CRE uses a cumulative distribution function instead of a probability density function to identify the information for continuous variables. The probability distribution function in CRE results in more generality and universal properties than the conventional Shannon entropy [17,18]. CRE has been utilized in a variety of applications in this regard, including image signal processing and pattern recognition [16,17,19,20]. Several studies have shown that considering the order of the patterns improves the analysis of physiological and clinical signals [21,22]. However, the entropy methods mentioned above measure the irregularity of the time series, yielding that it may fail to capture the complexity of the time series. To solve this issue, Costa et al. [23,24] have developed a multiscale entropy analysis that characterizes the complexity of a time series over multiple scales of time. This multiscale entropy analysis has effectively represented the dynamical characteristics of an underlying time series.
Here, a multiscale cumulative residual dispersion entropy (MCRDE), which computes the cumulative residual dispersion entropy (CRDE) over multiple temporal scales, is presented. Combining three entropy algorithms for the first time, the suggested method inherits the benefits of DE, CRE, and multiscale entropy. As a result, the proposed MCRDE improves the capability for quantifying the temporal dynamics of the underlying time series. To validate the capability of the proposed MCRDE, we first compare the performance of MCRDE with the conventional multiscale SampEn (MSE) and multiscale DE (MDE) using synthetic signals, i.e., the white Gaussian noise (WGN) and 1/f noise. Next, the proposed MCRDE is applied to inter-beat (RR) intervals extracted from the ECG signals of congestive heart failure (CHF) patients, atrial fibrillation (AF) patients, and healthy subjects. Through experiments, using public ECG datasets, the proposed MCRDE leads to an improved capability for quantifying physiological status compared to the conventional multiscale entropy methods regardless of the length of inter-beat intervals.
The remainder of this paper is organized as follows: DE, CRE, and the proposed MCRDE are introduced in Section 2. In Section 3, the results using synthetic signal and ECG datasets are presented to verify the effectiveness of the proposed MCRDE. Then, discussions for the results are described in Section 4. Finally, Section 5 presents the conclusions.

2. Materials and Methods

2.1. Dispersion Entropy (DE)

Assume we have a signal of length N: x = { x 1 ,   x 2 ,   ,   x N } ; DE algorithm is composed of the following four steps as follows [13]:
(1)
First, x i ( i = 1 ,   2 , ,   N ) are mapped to c classes labeled from 1 to c. In the mapping process, there are various linear and nonlinear mapping techniques. Although the linear mapping algorithm is computationally fast, if the maximum or minimum values of a signal are much larger or smaller than the mean or median value of the signal, the majority of x i is biased only toward few classes. Here, the normal cumulative distribution function (NCDF) for mapping x into y = { y 1 ,   y 2 ,   ,   y N } from 0 to 1 is used. Each embedding vector u i m , c is made with embedding dimension m and time delay d according to u i m , c = u i c ,   u i + d c ,   , u i + m 1 d c ,   i = 1 ,   2 , ,   N m 1 d . Each time series u i m , c is mapped to a dispersion pattern π v 0 ,   v 1 ,   , v m 1   , where u i c = v 0 , u i + d c = v 1 ,   ,   u i + m 1 d c = v m 1 . The number of available dispersion patterns can be assigned to each vector u i m , c which is equal to c m because the signal is made up of m members and each can be one of the integers from 1 to c.
(2)
For each of c m possible dispersion patterns π v 0 ,   v 1 ,   , v m 1   , relative frequency is computed as follows:
p π v 0 ,   , v m 1   = # { i | i N m 1 d ,   u i m , c   h a s   t y p e   π v 0 ,   , v m 1   }   N m 1 d
where # denotes cardinality. In fact, p π v 0 ,   , v m 1   denotes the number of dispersion patterns π v 0 ,   v 1 ,   , v m 1 that are assigned to u i m , c divided by the whole number of embedded signals with embedding dimension m.
(3)
Lastly, DE is obtained using the Shannon entropy approach [25] as follows:
D E x , m , c , d = π = 1 c m p π v 0 ,   , v m 1   · ln p π v 0 ,   , v m 1    
For example, x = { 0.1   2   3   2.2   3.5   5.7   2.5   3.4   7.3   1 } is considered and shown on the top left of Figure 1. DE of x with d = 1, m = 2, and c = 3 is computed in Table 1 and Figure 1. Table 1 shows the dispersion patterns and their probability. Figure 1 shows the time series x, classified series z, potential dispersion patterns and probability of each potential dispersion pattern.
Next, a window with length 2, which is an embedding dimension, is moved along the time series and the number of each of the corresponding dispersion patterns is counted. Finally, using Equation (2), DE value of x is calculated as D E ( x , 2 ,   3 ,   1 ) = p π ln p π = 1.0297 . It is noted that if all potential patterns occur equally, the value of DE will be the largest. On the other hand, if only certain patterns happen regularly, the value of DE will be the smallest.

2.2. Cumulative Residual Entropy (CRE)

Cumulative residual entropy (CRE) is more applicable and generable than traditional Shannon entropy since it is plausible for continuous distributions [17,18]. For a given random vector x = { x 1 ,   x 2 ,   ,   x N } R N , CRE is obtained as follows:
C R E x = R + N   P x > λ log P x > λ d λ
where λ = ( λ 1 , λ 2 , , λ N ) , x > λ represents | x i | > λ i and R + N = x i R N ; x i 0 .
Next, CRE computation is applicable for a discrete version. For independent and identical distributed discrete random variables, F x is the cumulative density function and F n x = 1 n i = 1 n I { x x i } is empirical distribution function corresponding to each random variable, where I { x x i } is the indicative function. CRE is obtained using
CRE ( x ) = 0 1 F n x log 1 F n x d x = 1 n i = 1 n 1 n n i l o g n n i ( x i + 1 x i )
Here, it is assumed that x is order statistics. In addition, the empirical distribution function is obtained using
F n x = 0 ,                                 x < x 1 *       k n ,           x k *   x < x k + 1 * 1 ,                             x   x N *
where x 1 *   x 2 * x N * are ascending order statistics.
CRE possesses the following properties: (1) Although both continuous and discrete variables have valid definitions, estimating the empirical distribution for differential entropy of continuous variables is difficult. (2) CRE has nonnegative values. (3) CRE eventually converges.

2.3. Cumulative Residual Dispersion Entropy (CRDE)

For an N possible dispersion patterns, the entropy of s is obtained with k = 1 N P { s k } · l o g ( P s k ) based on classical Shannon entropy [25]. Here, P { s k } means the probability of occurrence of the dispersion pattern s k . Assume that two distinct signals have four dispersion patterns s = s 1 ,   s 2 , s 3 ,   s 4 . As mentioned in the introduction, DE does not consider the order between each dispersion pattern while calculating the entropy value.
This study addresses the above shortcoming of DE by integrating CRE, thus yielding cumulative residual dispersion entropy (CRDE). The proposed CRDE is computed as follows: First, the probability distribution for possible dispersion patterns was computed as DE. Second, we calculate the cumulative density function for the probability distribution of dispersion patterns. Finally, CRDE is obtained with
C R D E x = j = 1 K 1 i = 1 j P s i · l o g 1 i = 1 j P s i  
where K is the total number of dispersion patterns, and P s i is the probability of occurrence of a dispersion pattern s i . Since forming the dispersion pattern is the same as DE, CRDE can maintain the property of DE that is sensitive to amplitude values and bandwidth of time series.

2.4. Multiscale Analysis of CRDE

To make CRDE applicable to the multiscale analysis of time series, a coarse-graining procedure is integrated to generate multiple sets of time series with different time scales. For a given original time series x = { x 1 ,   x 2 ,   ,   x N } of length N is divided into non-overlapping windows according to the time scale factor s. Then, a consecutive coarse-grained time series y s = { y 1 s ,   y 2 s ,   ,   y N / s s } is developed, which consist of multiple y j s . It is obtained with
y j s = 1 s i = j 1 s + 1 j · s x i ,             ( 1 j N s )
For the scale factor s = 1 , the coarse-grained time series y 1 = { y 1 1 ,   y 2 1 ,   ,   y N 1 } is identical with the original time series x . In general, the length of the time series after coarse-graining is equal to N of the original time series divided by the scale factor s. This multiscale analysis allows the assessment of the dynamic complexity associated with the ability of physiological systems to adapt to changing environments. Finally, we calculate multiscale CRDE (MCRDE) on the coarse-grained time series as follows:
M C R D E x , s = C R D E y s .

2.5. Synthetic Data and Real ECG Data

The synthetic data used in this work are 1/f noise and White noise. 1/f noise is also called pink noise. It is one of the most common behaviors of biological systems. This noise possesses a long-range autocorrelation property in which the power spectral density is inversely proportional to the frequency of a signal. In contrast with White noise, it has a constant power spectral density at different frequencies. Figure 2a,b depict examples of 1/f noise and WGN, respectively.
Real ECG datasets, i.e., BIDMC CHF, MIT-BIH AF, and Fantasia are obtained in PhysioNet [26]. Specifically, BIMD CHF contains ECG records of 15 patients with CHF, consisting of eleven men aged 22–47 years and four women aged 54–63 years. Each recording is approximately 20 h in duration with a sampling frequency of 250 Hz. MIT-BIH AF database includes 25 long-term (10 h) ECG recordings of twenty-three paroxysmal and two persistent. The Fantasia dataset contains 20 healthy subjects aged 21–34 years and 20 elderly subjects aged 68–85 years. Each recording is approximately 2 h in duration and sampled at 250 Hz. RR intervals with lengths of N = 1000 were randomly extracted from ECG recordings. Recording an ECG signal typically involves placing electrodes on the skin at specific locations to capture the electrical activity of the heart. Then, the ECG lead that gives the clearest R waves is chosen, followed by the detection of QRS waves. The R and QRS waves are extracted using the Pan-Tompkins algorithm [27]. Then, the RR interval on the ECG signal is obtained as the time between consecutive R waves, which are the prominent upward spikes seen on an ECG trace. The representative RR interval time series of CHF patient, AF patient, and healthy subject are shown in Figure 3a–c. For analyzing ECG signals, MATLAB 2020b version was used.

2.6. Statical Analysis Method

We performed the Mann–Whitney U test, also known as the Wilcoxon rank-sum test, to verify whether a distinction using the proposed MCRDE between different groups is statistically significant. The Mann–Whitney U test is a non-parametric statistical test that is used to determine whether there is a difference between two independent samples. It is often used when the data are not normally distributed or when the sample sizes are small. In this test, the null hypothesis was that the two groups are indifferent, and the significance probability p -value was the probability of an observed result assuming that the null hypothesis is true. Generally, if the p -value is less than 0.05 or 5%, the results are considered “statistically significant”. This implies that the observed data or results are unlikely to be due to chance, suggesting a high likelihood of a meaningful difference between the entropy values of different groups.

3. Results

3.1. Simulations Using Synthetic Data

In order to compare the performance of the proposed MCRDE to that of the conventional MDE, the simulations using two synthetic signals, i.e., 1/f noise and WGN were conducted. In this simulation, the predefined parameters for DE as the number of classes c = 3 and the embedding dimension m = 3 were used.
Figure 4 shows the probability density function (PDF) of possible dispersion patterns which are presented with normalized values and corresponding cumulative distribution curves of the probability distribution for the possible dispersion patterns. The histogram of the dispersion pattern for WGN is roughly a normal distribution shown in Figure 4a. However, 1/f noise has a left-skewed distribution. As can be seen, 1/f noise has a steeper accumulation rate, resulting in relatively higher complexity than WGN.
Figure 5a,b demonstrate the entropy values of MDE and MCRDE consisted of 50 different 1/f noise and WGN with the length of N = 1000, respectively. It has been known that 1/f noise has a higher complexity than WGN [26,27]. The results of MDE in Figure 5a show two folds: First, at small scale factors less than 5, MDE values of WGN are higher than those of 1/f noise. Second, as the scale factor increases, MDE values of 1/f noise remain nearly constant, while MDE values of WGN monotonically decrease. The results of MCRDE in Figure 5b shows that MCRDE values of 1/f noise computed remain almost constant. In addition, the entropy values of WGN by MCRDE are less than those of 1/f noise by MCRDE on all scale factors and decrease as the scale factors increase. These results imply that the proposed MCRDE is more capable of discriminating complexity in underlying synthetic signals compared to MDE.

3.2. Experimental Results of ECG Dataset

3.2.1. Comparison of Entropy Measures for Distinct Cardiovascular Signals

Using the ECG database, the RR interval time series extracted from the ECG signals were analyzed using MSE, MDE, and the proposed MCRDE. The Mann–Whitney U test was used to verify the statistical difference among the three groups. Here, we set the significance level of the hypothesis test decision to 0.05; thus, statistical significance is accepted in cases of p < 0.05 .
Figure 6a–c depict the histograms for dispersion patterns and corresponding cumulative distribution curves for the RR interval time series of three groups, respectively. As can be seen, the slope of the cumulative distribution curve decreases in the order of CHF patient, AF patient, and healthy subject. As shown in Figure 6, the variation in RR intervals of CHF patients is the smallest among the three groups. In addition, the occurrence of the dispersion patterns is concentrated on low values, and the slope of the cumulative distribution curve is the highest among the three groups. In the case of AF patients, the RR interval shows more diverse dispersion patterns, and the slope of the cumulative distribution curve is smaller than that of CHF. Lastly, the RR interval of the healthy subject shows the most significant variation among the three groups, implying that more diverse dispersion patterns occur, and thus, its slope of the cumulative distribution curve is the lowest.
The results of MSE, MDE, and MCRDE for RR interval time series for lengths of N = 100 and 1000 are shown in Figure 7a–c and Figure 7d–f, respectively. Here, to compare the quantification capability of the complexity of short and relatively sufficient lengths of RR intervals, N = 100, 250, 500, and 1000 were chosen. In Figure 7a, MSE values are not defined on most scales, highlighting the limitation of MSE in analyzing short-term RR interval time series. In Figure 7b, the MDE values in the case of N = 100 exhibit a decreasing trend as the scale factor increases due to the insufficient length of a coarse-grained RR interval. In addition, distinguishing the complexity of the three groups appears to be complicated.
The results of MSE, MDE, and MCRDE for RR Interval time series for lengths of N = 100 and 1000 are shown in Figure 7a–c and Figure 7d–f, respectively. Here, to compare the quantification capability of the complexity of short and relatively sufficient lengths of RR intervals, N = 100, 250, 500, and 1000 were chosen. In Figure 7a, MSE values are not defined on most scales, highlighting the limitation of MSE in analyzing short-term RR interval time series. In Figure 7b, the MDE values in the case of N = 100 exhibit a decreasing trend as the scale factor increases due to the insufficient length of a coarse-grained RR interval. In addition, distinguishing the complexity of the three groups appears to be complicated. On the other hand, as illustrated in Figure 7c, the MCRDE values for RR interval time series of length N = 100 are defined across all scales. In addition, MCRDE can capture the complexity difference between the three groups.
Figure 7d shows the results of MSE for RR interval with N = 250 . Although the MSE computation is available on small scale factors, MSE values are not defined on large scale factors. In Figure 7e, MDE values for RR interval with N = 250 show that MDE does not easily reflect the complexity difference between CHF, AF, and healthy groups. Figure 7f exhibits the results of MCRDE. As shown in the figure, MCRDE is not only well defined on all scales but also discriminates the complexity of three groups in order of CHF, AF, and healthy subjects.
Figure 7g–i show results of MSE, MDE, and MCRDE for RR interval with N = 500 , respectively. In Figure 7g, MSE values are obtained, but it is hard to discriminate the complexity of three groups. In Fiigure 7h, MDE values are not able to differentiate three groups. On the other hand, MCRDE in Figure 7i shows the difference in complexity between the three groups more effectively compared to N = 100 and 250 .
In Figure 7j, the result of the MSE values is defined across most scale factors when the time series is sufficiently long as N = 1000. The MSE values of the healthy group are distinguishable from other groups. However, the gap between MSE values from CHF and AF patients is inconsistent across the scale factors. It may lead to an incapability to discriminate the complexities between the three groups. In Figure 7e, the MDE value for N = 1000 represents an improved capability for differentiating the entropy values from the three groups compared to the results of MDE for N = 100. Although the results of MDE show more discriminative trends than those of MSE, it is possible to distinguish three groups only at the scale factor s = 3 ,   4 , and 6. In Figure 7f, MCRDE results represent a more significant improvement in discriminating the complexities of the three groups. The larger the scale factor, the more apparent the difference in the MCRDE values. Moreover, the statistical analysis also shows that the use of MCRDE leads to a significant difference between the three groups at most scale factors above s = 10 .
The cumulative distribution of healthy group reaches one more slowly than other groups, implying a broader dispersion pattern. On the contrary, the cumulative distribution of CHF patients rises to one most rapidly due to the significant skewness of its dispersion pattern. The slower the cumulative distribution reaches one, the lower the MCRDE value is.

3.2.2. Comparison of Entropy Measures for Healthy Young and Elderly Groups

We compared the entropy values for the RR interval time series of healthy young and elderly subjects. We chose the length of RR interval of N = 100, 250, 500, and N = 1000.
Figure 8a–c depict the results of MSE, MDE, and MCRDE for RR interval time series of two groups for N = 100. In Figure 8a, MSE values are not obtained at large scale factors and at small scale factors less than 4, MSE values of two groups are statistically different. In Figure 8b, MDE values of two groups are nearly indistinguishable, thus suffering from statistically discriminating two groups. On the contrary, the MCRDE results in Figure 8c demonstrate its ability to differentiate the complexity between two groups even for short RR interval time series, especially at scale factors less than 13.
In Figure 8d–f, the results of MSE, MDE, and MCRDE for RR interval time series of two groups for N = 250 are shown. In Figure 8d, MSE values at large scale factors such as s = 24 and 25 are not defined for young subject, and MSE is capable of differentiating two groups at the scale factors 5 or less. In Figure 8e, MDE values of two groups exhibit similar behavior and it shows statistical difference at the scale factors s = 1 , 2, 9, and 15. Figure 8f shows that MCRDE is capable of discriminating two groups over all scale factors.
Figure 8g–i shows results of MSE, MDE, and MCRDE for RR interval with N = 500 , respectively. The MSE results in Figure 8g show that two groups has statistically different complexity at small scale factors. The MDE results in Figure 8h indicate that MDE values of young subjects are higher than those of old subjects at the scale factors s = 4 or less, but the opposite trend is shown for the scale factors above 6. In addition, at several scale factors, it is possible to discriminate two groups using MDE values. In Figure 8i, the MCRDE values of old subjects are consistently higher than those of young subjects over all scale factors. Moreover, using MCRDE values leads to significant differentiation between two groups.
For sufficient long RR interval time series of N = 1000, MSE values are computed over all scale factors and can capture statistical differences at small scale factors, which is shown in Figure 8d. In Figure 8e, MDE values from two groups are differentiable, except for the scale factor between 4–9 and 21. This result implies that MDE is more capable of discriminating two groups than MSE. Finally, the results of MCRDE shown in Figure 8f demonstrate that MCRDE has a superior capability in discriminating the complexity of two groups across all scale factors. Through comparison results in Figure 8, it is clear that MCRDE is suitable for quantifying age-dependent cardiological complexity.

3.2.3. Statistical Analysis of Entropy Measures

In order to evaluate the effectiveness of capturing the difference of complexity in RR interval using MSE, MDE, and MCRDE with various lengths of time series, a statistical analysis was carried out. In addition to empirical comparison in previous sections, the Mann–Whitney U test was utilized to verify whether two healthy groups, i.e., healthy young and elderly groups, can be discriminated. Here, statistical significance is accepted if the p-value is less than 0.05 and those p-values are marked as gray in Table 2, Table 3, Table 4 and Table 5.
Table 2 depicts the p-values in which the MSE values of paired comparison between CHF patients, AF patients, and the healthy group in cases of N = 100, 500, and 1000. For N = 100, it is not able to compute MSE values over most scale factors due to the shortage of the length of a coarse-grained RR interval. For N = 500 and 1000, it is clear that p-value computation is available, and there are increased cases of statistically significant difference. However, it still lacks in distinguishing CHF and AF patients using MSE values.
Table 3 shows the comparison results of MDE. As can be seen, the use of MDE yields an improved capability for distinguishing complexities of different physiological groups than MSE. For N = 100, it is possible to compute MDE values for more scale factors and increase the statistically significant cases compared to MSE. In addition, for sufficient long RR intervals as N = 500 and 1000, the use of MDE results in a more statistically significant difference than MSE.
In Table 4, the results of MCRDE N = 100, 500, and 1000 are shown. For N = 100, MCRDE values are computed over all scale factors and yield a much more statistically significant difference, especially between CHF and AF patients as well as AF patients and the healthy group. In addition, the statistical results of MDE in Table 3 show that for sufficient long lengths of RR interval, i.e., N = 500 and 1000, the difference utilizing MCRDE values across three groups is statistically significant and better than MSE and MDE. Through comparison between Table 2 and Table 4, the proposed MCRDE shows a superior capability for distinguishing three groups regardless of the length of RR interval.
Lastly, we conducted a statistical analysis to compare the healthy young and healthy elderly subjects. In Table 5, MCRDE exhibits superior discrimination performance with much more statistically significant differences for all lengths of RR interval (N = 100, 500, and 1000) compared to conventional MSE and MDE.

4. Discussion

This work presents a multiscale version of DE utilizing cumulative distribution with application to the analysis of the cardiovascular signal, i.e., ECG recordings. Various entropy measures play an important role in representing the complexity of neurophysiological signals. Although entropy estimation of neurophysiological signals can to represent the complexity of underlying neural systems to some extent, the relationship between entropy and complexity remains controversial.
The popular entropy measure, i.e., MSE, provides a solution to address inconsistency with complexity [23]. Due to the capability of MSE, it has been widely used in diverse applications including biomedical environments [28,29,30,31,32,33]. Unlike other applications, there are certain things to consider when utilizing cardiovascular signals [34,35]. The ability to accurately and quantitatively determine the meaning of a signal in a short amount of time is essential. This can diagnose various serious cardiovascular diseases, monitor prognosis, and more. The need for entropy methods that employ multiscale techniques has increased due to the inaccurate entropy estimation or invalid calculation of short-length signals with conventional MSE methods [3,4,30]. MSE has certain limitations when it is applied to short-length signals. As the scale factor increases, the length of the coarse-grained time series decreases (original length divided by a scale factor). For short-length signals, this results in extremely short coarse-grained time series at higher scales. Sample Entropy (SampEn) calculation involves counting the occurrences of similar patterns within the time series. Short time series may not contain enough data points to accurately identify and count the recurrence of similar patterns, especially at larger scales. MSE is not defined in this situation, as shown in Figure 7 and Figure 8. In addition, as reported in [36], the coarse-grained time series of MSE is identical to the results of a simple moving average; thus, it may lead to inevitable issues.
In this context, we have shown that the proposed MCRDE can bridge the mismatch between entropy and complexity through simulation using synthetic signals. It shows that the MCRDE values of 1/f are higher than those of WGN over multiple temporal scales. The quantification provided by MCRDE is more consistent than that of MDE because it can tell the difference between 1/f and WGN at all scales, while MDE cannot do that at some scales.
By applying traditional multiscale entropy measures and the proposed MCRDE to the analysis of RR intervals extracted from ECG signals, we aim to differentiate the distinct physiological statuses of subjects. Specifically, it needs to be available for short-length RR intervals as well as for RR intervals with sufficient length.
In the case of discriminating RR intervals from distinct cardiovascular systems such as CHF, AF, and healthy subjects, MCRDE is more competent than its predecessors for two reasons. First, for short-length RR intervals, MCRDE values are not only valid but also exhibit similar patterns compared to the results of sufficient length. Thus, MCRDE values of different physiological statuses are differentiated regardless of the length of RR intervals. However, MSE suffers from the invalid computation of entropy value in the case of short-length RR intervals, as known previously [31]. The computation of MDE is available for short-length RR intervals, but it cannot discriminate physiological status by quantifying complexity compared to MCRDE.
Following the experiment using young and old subjects’ ECG recordings, similar results from the previous experiment are observed: MCRDE performs better than MSE and MDE irrespective of the length of RR intervals.
Statistical results using the Mann–Whitney U test suggest the following: First, MCRDE is capable of discriminating the complexity between CHF and AF subjects as well as between AF and healthy subjects with short-length RR intervals, while MSE and MDE cannot be computed at high scale factors, and MDE can discriminate different statuses at less scale factors than MCRDE. Second, for longer lengths of RR intervals, MCRDE has a better capacity for discriminating between CHF and healthy subjects. In addition, MDE performs better in discriminating between AF and healthy subjects at small scale factors, while MCRDE shows better performance over higher scale factors. It suggests that MDE and MCRDE can be combined to distinguish between AF and healthy subjects.
Statistical analysis using ECG recordings of healthy subjects shows that MCRDE is a better indicator using short-length and sufficient lengths of RR intervals; thus, MCRDE might play a role in representing subtle changes in cardiovascular signals.
The early diagnosis of diseases from ECG signals often requires detailed analysis of various cardiac intervals besides the RR interval. These intervals include the QRS duration, PR interval, JT interval, QT interval, and segments like the ST segment [37,38]. For example, the QRS duration is able to indicate bundle branch block or ventricular hypertrophy. In addition, the portion of the ECG between the QRS complex and the T wave is the ST segment. Elevation or depression in the ST segment can indicate myocardial infarction, ischemia, or other forms of heart stress. Thus, the complexity analysis for subtle cardiac intervals would play a pivotal role in providing effective tools for diagnosing cardiac diseases. Beyond the RR interval analysis, it is notable that reflecting correlations between ECG parameters would highlight the emergence of complicated dynamical processes in the cardiovascular system throughout the load by the external stimuli and recovery processes [39].
By analyzing the MCRDE values of ECG signals, it can detect subtle changes that may not be apparent through traditional ECG analysis. Thus, this methodology might play a pivotal role in various clinical applications: early detection of cardiac diseases, monitoring chronic conditions, risk stratification in patients, researching the effects of various drugs or treatments on heart function, and telemedicine and remote monitoring.
Finally, since MCRDE is effective in quantifying dynamic complexity depending on temporal scales, it can be applied to the quantification of other physiological signals such as electroencephalography (EEG), electromyography (EMG), and so on.

5. Conclusions

This paper has presented an improved multiscale entropy measure, named MCRDE, by utilizing the cumulative distribution of time series and dispersion entropy in multiple temporal scales. The resultant MCRDE preserves generality and efficient computation of the complexity of underlying cardiovascular signals. Through simulations using synthetic signals and cardiological signals, i.e., RR intervals from ECG signals, the proposed MCRDE is shown to be effective in quantifying and distinguishing different complexity compared to conventional multiscale entropy measures such as MSE and MDE regardless of the length of time series. Based on the advantageous properties of MCRDE, it may provide a promising measure for recognizing various physiological dynamics in biomedical applications. Future works include diverse analyses of ECG signals from other cardiovascular diseases. This work shows that the proposed MCRDE might be a solution for computer-aided diagnosis of cardiovascular diseases.

Author Contributions

Y.K. and Y.-S.C. conceived and designed the methodology. All authors were responsible for analyzing and writing the paper. All authors have read and agreed to the published version of the manuscript.

Funding

This work was partly supported by Institute of Information & communications Technology Planning & Evaluation (IITP) grant funded by the Korea government (MSIT) (No.2021-0-00034, Clustering technologies of fragmented data for time-based data analysis) and partly conducted by the Research Grant of Kwangwoon University in 2021.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The ECG dataset used for this study is publicly available on https://www.physionet.org/ (accessed on 15 November 2023).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Kaplan Berkaya, S.; Uysal, A.K.; Sora Gunal, E.; Ergin, S.; Gunal, S.; Gulmezoglu, M.B. A Survey on ECG Analysis. Biomed. Signal Process. Control 2018, 43, 216–235. [Google Scholar] [CrossRef]
  2. Babloyantz, A.; Destexhe, A. Is the Normal Heart a Periodic Oscillator? Biol. Cybern. 1988, 58, 203–211. [Google Scholar] [CrossRef] [PubMed]
  3. Lee, D.-Y.; Choi, Y.-S. Multiscale Distribution Entropy Analysis of Heart Rate Variability Using Differential Inter-Beat Intervals. IEEE Access 2020, 8, 48761–48773. [Google Scholar] [CrossRef]
  4. Lee, D.-Y.; Choi, Y.-S. Multiscale Distribution Entropy Analysis of Short-Term Heart Rate Variability. Entropy 2018, 20, 952. [Google Scholar] [CrossRef] [PubMed]
  5. Mao, X.; Shang, P.; Yang, A.C.; Peng, C.-K. Multiscale Cumulative Residual Distribution Entropy and Its Applications on Heart Rate Time Series. Nonlinear Dyn. 2020, 101, 2357–2368. [Google Scholar] [CrossRef]
  6. Yong, K.N. A New Kernel-Width Adaptation Method for Minimum Error Entropy. J. Korean Inst. Commun. Inf. Sci. 2021, 46, 1131–1137. [Google Scholar] [CrossRef]
  7. Zbilut, J.P.; Mayer-Kress, G.; Geist, K. Dimensional Analysis of Heart Rate Variability in Heart Transplant Recipients. Math. Biosci. 1988, 90, 49–70. [Google Scholar] [CrossRef]
  8. Richman, J.S.; Moorman, J.R. Physiological Time-Series Analysis Using Approximate Entropy and Sample Entropy. Am. J. Physiol.-Heart Circ. Physiol. 2000, 278, H2039–H2049. [Google Scholar] [CrossRef]
  9. Holzinger, A.; Hörtenhuber, M.; Mayer, C.; Bachler, M.; Wassertheurer, S.; Pinho, A.J.; Koslicki, D. On Entropy-Based Data Mining. In Interactive Knowledge Discovery and Data Mining in Biomedical Informatics: State-of-the-Art and Future Challenges; Holzinger, A., Jurisica, I., Eds.; Lecture Notes in Computer Science; Springer: Berlin/Heidelberg, Germany, 2014; pp. 209–226. ISBN 978-3-662-43968-5. [Google Scholar]
  10. Chen, W.; Zhuang, J.; Yu, W.; Wang, Z. Measuring Complexity Using FuzzyEn, ApEn, and SampEn. Med. Eng. Phys. 2009, 31, 61–68. [Google Scholar] [CrossRef]
  11. Zanin, M.; Zunino, L.; Rosso, O.A.; Papo, D. Permutation Entropy and Its Main Biomedical and Econophysics Applications: A Review. Entropy 2012, 14, 1553–1577. [Google Scholar] [CrossRef]
  12. Bandt, C.; Pompe, B. Permutation Entropy: A Natural Complexity Measure for Time Series. Phys. Rev. Lett. 2002, 88, 174102. [Google Scholar] [CrossRef] [PubMed]
  13. Rostaghi, M.; Azami, H. Dispersion Entropy: A Measure for Time-Series Analysis. IEEE Signal Process. Lett. 2016, 23, 610–614. [Google Scholar] [CrossRef]
  14. Kurths, J.; Voss, A.; Saparin, P.; Witt, A.; Kleiner, H.J.; Wessel, N. Quantitative Analysis of Heart Rate Variability. Chaos 1995, 5, 88–94. [Google Scholar] [CrossRef]
  15. Hao, B. Symbolic Dynamics and Characterization of Complexity. Phys. D Nonlinear Phenom. 1991, 51, 161–176. [Google Scholar] [CrossRef]
  16. Voss, A.; Kurths, J.; Kleiner, H.J.; Witt, A.; Wessel, N. Improved Analysis of Heart Rate Variability by Methods of Nonlinear Dynamics. J. Electrocardiol. 1995, 28, 81–88. [Google Scholar] [CrossRef]
  17. Rao, M.; Chen, Y.; Vemuri, B.C.; Wang, F. Cumulative Residual Entropy: A New Measure of Information. IEEE Trans. Inf. Theory 2004, 50, 1220–1228. [Google Scholar] [CrossRef]
  18. Asadi, M.; Zohrevand, Y. On the Dynamic Cumulative Residual Entropy. J. Stat. Plan. Inference 2007, 137, 1931–1941. [Google Scholar] [CrossRef]
  19. Wang, F.; Vemuri, B.C. Non-Rigid Multi-Modal Image Registration Using Cross-Cumulative Residual Entropy. Int. J. Comput. Vis. 2007, 74, 201–215. [Google Scholar] [CrossRef]
  20. Pickering, M.R.; Xiao, Y.; Jia, X. Registration of Multi-Sensor Remote Sensing Imagery by Gradient-Based Optimization of Cross-Cumulative Residual Entropy. In Proceedings of the Algorithms and Technologies for Multispectral, Hyperspectral, and Ultraspectral Imagery XIV, Orlando, FL, USA, 17–19 March 2008; Volume 6966, pp. 194–203. [Google Scholar]
  21. Ma, Z.; Chu, T. The BCG Signal Feature Extraction and Recognition Based on the Cumulative Residual Entropy. In Proceedings of the 2013 2nd International Symposium on Instrumentation and Measurement, Sensor Network and Automation (IMSNA), Toronto, ON, Canada, 23–24 December 2013; pp. 526–528. [Google Scholar]
  22. Shi, J.; Cai, Y.; Zhu, J.; Zhong, J.; Wang, F. SEMG-Based Hand Motion Recognition Using Cumulative Residual Entropy and Extreme Learning Machine. Med. Biol. Eng. Comput. 2013, 51, 417–427. [Google Scholar] [CrossRef]
  23. Costa, M.; Goldberger, A.L.; Peng, C.-K. Multiscale Entropy Analysis of Complex Physiologic Time Series. Phys. Rev. Lett. 2002, 89, 068102. [Google Scholar] [CrossRef]
  24. Costa, M.; Goldberger, A.L.; Peng, C.-K. Multiscale Entropy Analysis of Biological Signals. Phys. Rev. E Stat. Nonlin. Soft. Matter Phys. 2005, 71, 021906. [Google Scholar] [CrossRef] [PubMed]
  25. Shannon, C.E. A Mathematical Theory of Communication. Bell Syst. Tech. J. 1948, 27, 379–423. [Google Scholar] [CrossRef]
  26. Goldberger, A.L.; Amaral, L.A.; Glass, L.; Hausdorff, J.M.; Ivanov, P.C.; Mark, R.G.; Mietus, J.E.; Moody, G.B.; Peng, C.K.; Stanley, H.E. PhysioBank, PhysioToolkit, and PhysioNet: Components of a New Research Resource for Complex Physiologic Signals. Circulation 2000, 101, E215–E220. [Google Scholar] [CrossRef]
  27. Pan, J.; Tompkins, W.J. A Real-Time QRS Detection Algorithm. IEEE Trans. Biomed. Eng. 1985, 3, 230–236. [Google Scholar] [CrossRef]
  28. Zhang, L.; Xiong, G.; Liu, H.; Zou, H.; Guo, W. Bearing Fault Diagnosis Using Multi-Scale Entropy and Adaptive Neuro-Fuzzy Inference. Expert Syst. Appl. 2010, 37, 6077–6085. [Google Scholar] [CrossRef]
  29. Ahmed, M.U.; Mandic, D.P. Multivariate Multiscale Entropy: A Tool for Complexity Analysis of Multichannel Data. Phys. Rev. E 2011, 84, 061918. [Google Scholar] [CrossRef] [PubMed]
  30. Wu, S.-D.; Wu, C.-W.; Lee, K.-Y.; Lin, S.-G. Modified Multiscale Entropy for Short-Term Time Series Analysis. Phys. A Stat. Mech. Its Appl. 2013, 392, 5865–5873. [Google Scholar] [CrossRef]
  31. Gow, B.J.; Peng, C.-K.; Wayne, P.M.; Ahn, A.C. Multiscale Entropy Analysis of Center-of-Pressure Dynamics in Human Postural Control: Methodological Considerations. Entropy 2015, 17, 7926–7947. [Google Scholar] [CrossRef]
  32. Ahmed, M.U.; Chanwimalueang, T.; Thayyil, S.; Mandic, D.P. A Multivariate Multiscale Fuzzy Entropy Algorithm with Application to Uterine EMG Complexity Analysis. Entropy 2016, 19, 2. [Google Scholar] [CrossRef]
  33. Azami, H.; Abásolo, D.; Simons, S.; Escudero, J. Univariate and Multivariate Generalized Multiscale Entropy to Characterise EEG Signals in Alzheimer’s Disease. Entropy 2017, 19, 31. [Google Scholar] [CrossRef]
  34. Valenza, G.; Faes, L.; Toschi, N.; Barbieri, R. Advanced Computation in Cardiovascular Physiology: New Challenges and Opportunities. Phil. Trans. R. Soc. A 2021, 379, 20200265. [Google Scholar] [CrossRef] [PubMed]
  35. Hagiwara, Y.; Fujita, H.; Oh, S.L.; Tan, J.H.; Tan, R.S.; Ciaccio, E.J.; Acharya, U.R. Computer-Aided Diagnosis of Atrial Fibrillation Based on ECG Signals: A Review. Inf. Sci. 2018, 467, 99–114. [Google Scholar] [CrossRef]
  36. Petrauskiene, V.; Ragulskiene, J.; Zhu, H.; Wang, J.; Cao, M. The Discriminant Statistic Based on MPE-MWPE Relationship and Non-Uniform Embedding. J. Meas. Eng. 2022, 10, 150–163. [Google Scholar] [CrossRef]
  37. Kligfield, P.; Gettes, L.S.; Bailey, J.J.; Childers, R.; Deal, B.J.; Hancock, E.W.; van Herpen, G.; Kors, J.A.; Macfarlane, P.; Mirvis, D.M.; et al. Recommendations for the Standardization and Interpretation of the Electrocardiogram. Circulation 2007, 115, 1306–1324. [Google Scholar] [CrossRef] [PubMed]
  38. Bazett, H.C. An Analysis of the Time-Relations of Electrocardiograms. Ann. Noninvasive Electrocardiol. 1997, 2, 177–194. [Google Scholar] [CrossRef]
  39. Ziaukas, P.; Alabdulgader, A.; Vainoras, A.; Navickas, Z.; Ragulskis, M. New Approach for Visualization of Relationships between RR and JT Intervals. PLoS ONE 2017, 12, e0174279. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Examples of the DE algorithm using series x = 0.1   2   3   2.2   3.5   5.7   2.5   3.4   7.3   1 with c = 3 ,   m = 2 ,   τ = 1 .
Figure 1. Examples of the DE algorithm using series x = 0.1   2   3   2.2   3.5   5.7   2.5   3.4   7.3   1 with c = 3 ,   m = 2 ,   τ = 1 .
Entropy 25 01562 g001
Figure 2. Examples of synthetic signals: (a) 1/f noise and (b) WGN.
Figure 2. Examples of synthetic signals: (a) 1/f noise and (b) WGN.
Entropy 25 01562 g002
Figure 3. Representative inter-beat (RR) intervals extracted from the electrocardiogram (ECG) dataset: (a) congestive heart failure (CHF) group, (b) atrial fibrillation (AF) group, (c) healthy group.
Figure 3. Representative inter-beat (RR) intervals extracted from the electrocardiogram (ECG) dataset: (a) congestive heart failure (CHF) group, (b) atrial fibrillation (AF) group, (c) healthy group.
Entropy 25 01562 g003
Figure 4. The histogram for possible dispersion patterns and cumulative distribution curves (the solid red line) for synthetic signals: (a) WGN, N = 1000 and (b) 1/f noise, N = 1000.
Figure 4. The histogram for possible dispersion patterns and cumulative distribution curves (the solid red line) for synthetic signals: (a) WGN, N = 1000 and (b) 1/f noise, N = 1000.
Entropy 25 01562 g004
Figure 5. Entropy values for synthetic signals: (a) results of MDE for N = 1000; (b) results of MCRDE for N = 1000; scale range of 1–25 are used, and the value at each scale represents a mean ± standard deviation.
Figure 5. Entropy values for synthetic signals: (a) results of MDE for N = 1000; (b) results of MCRDE for N = 1000; scale range of 1–25 are used, and the value at each scale represents a mean ± standard deviation.
Entropy 25 01562 g005
Figure 6. The histogram for possible dispersion patterns and cumulative distribution curves (the solid red line) for RR intervals of three groups: (a) CHF patient, (b) AF patient, and (c) healthy subject.
Figure 6. The histogram for possible dispersion patterns and cumulative distribution curves (the solid red line) for RR intervals of three groups: (a) CHF patient, (b) AF patient, and (c) healthy subject.
Entropy 25 01562 g006
Figure 7. MSE, MDE, and MCRDE results of RR intervals for CHF patients, AF patients and healthy group: (a) MSE for N = 100; (b) MDE for N = 100; (c) MCRDE for N = 100; (d) MSE for N = 250; (e) MDE for N = 250; (f) MCRDE for N = 250; (g) MSE for N = 500; (h) MDE for N = 500; (i) MCRDE for N = 500; (j) MSE for N = 100; (k) MDE for N = 500; (l) MCRDE for N = 500. The scale factor ranges from 1 to 25. The entropy value at each scale factor represents a mean ± standard deviation. The asterisks indicate a significant difference between groups obtained via Mann–Whitney U test (p < 0.05).
Figure 7. MSE, MDE, and MCRDE results of RR intervals for CHF patients, AF patients and healthy group: (a) MSE for N = 100; (b) MDE for N = 100; (c) MCRDE for N = 100; (d) MSE for N = 250; (e) MDE for N = 250; (f) MCRDE for N = 250; (g) MSE for N = 500; (h) MDE for N = 500; (i) MCRDE for N = 500; (j) MSE for N = 100; (k) MDE for N = 500; (l) MCRDE for N = 500. The scale factor ranges from 1 to 25. The entropy value at each scale factor represents a mean ± standard deviation. The asterisks indicate a significant difference between groups obtained via Mann–Whitney U test (p < 0.05).
Entropy 25 01562 g007aEntropy 25 01562 g007b
Figure 8. MSE, MDE, and MCRDE results of RR intervals for healthy and old group: (a) MSE for N = 100; (b) MDE for N = 100; (c) MCRD for N = 100; (d) MSE for N = 250; (e) MDE for N = 250; (f) MCRDE for N = 250; (g) MSE for N = 500; (h) MDE for N = 500; (i) MCRDE for N = 500; (j) MSE for N = 100; (k) MDE for N = 500; (l) MCRDE for N = 500. The scale factor ranges from 1 to 25. The entropy value at each scale factor represents a mean ± standard deviation. The asterisks indicate a significant difference between groups obtained via the Mann–Whitney U test (p < 0.05).
Figure 8. MSE, MDE, and MCRDE results of RR intervals for healthy and old group: (a) MSE for N = 100; (b) MDE for N = 100; (c) MCRD for N = 100; (d) MSE for N = 250; (e) MDE for N = 250; (f) MCRDE for N = 250; (g) MSE for N = 500; (h) MDE for N = 500; (i) MCRDE for N = 500; (j) MSE for N = 100; (k) MDE for N = 500; (l) MCRDE for N = 500. The scale factor ranges from 1 to 25. The entropy value at each scale factor represents a mean ± standard deviation. The asterisks indicate a significant difference between groups obtained via the Mann–Whitney U test (p < 0.05).
Entropy 25 01562 g008aEntropy 25 01562 g008b
Table 1. Dispersion patterns and the probability of each corresponding dispersion pattern.
Table 1. Dispersion patterns and the probability of each corresponding dispersion pattern.
z z 1 2,3 z 2 2,3 z 3 2,3 z 4 2,3 z 5 2,3 z 6 2,3 z 7 2,3 z 8 2,3 z 9 2,3
Dispersion Pattern{1,1}{1,2}{2,2}{2,2}{2,3}{3,2}{2,2}{2,3}{3,1}
π π 11 π 12 π 22 π 22 π 23 π 32 π 22 π 23 π 31
P 1 9 1 9 3 9 3 9 2 9 1 9 3 9 2 9 1 9
Table 2. Statistical analysis results of MSE for RR interval of CHF patients, AF patients, and healthy groups. The shadows indicate that the distinction between the groups is significant. C, A, and H represent CHF, atrial fibrillation, and healthy group, respectively. s denotes scale factor and N/A denotes ‘Not Available’.
Table 2. Statistical analysis results of MSE for RR interval of CHF patients, AF patients, and healthy groups. The shadows indicate that the distinction between the groups is significant. C, A, and H represent CHF, atrial fibrillation, and healthy group, respectively. s denotes scale factor and N/A denotes ‘Not Available’.
MSE Statistical Results for RR Interval Time Series
sp-Value
N = 100N = 500N = 1000
C–AC–HA–HC–AC–HA–HC–AC–HA–H
10.06290.88430.78700.14780.01340.91720.02039.50 × 10−40.9834
20.66250.04830.19040.08490.00110.28910.04098.5507 × 10−50.1006
30.69610.03960.15150.03662.7538 × 10−40.07730.04092.4494 × 10−50.0358
40.62950.01500.01880.06951.6847 × 10−40.02100.12376.4704 × 10−60.0235
50.9817N/AN/A0.05085.1825 × 10−40.02350.14782.9429 × 10−50.0083
60.6961N/AN/A0.32320.00200.0210 0.26031.2042 × 10−40.0150
7N/AN/A0.04150.76520.00570.04830.39532.3416 × 10−40.0150
8N/AN/AN/A0.87220.01060.05860.32321.6847 × 10−40.0210
90.3559N/AN/A0.98170.00650.01500.62596.0454 × 10−40.0261
10N/AN/AN/A0.94510.03230.10950.59720.00260.0643
11N/AN/AN/A0.98170.05320.08450.53510.00300.0483
12N/AN/AN/A0.66250.04380.03230.66250.00340.0235
13N/AN/AN/A0.69610.27060.19040.80050.00440.0438
14N/AN/AN/A0.50530.32860.12920.99960.02610.0643
15N/AN/AN/A0.76520.19040.07060.98170.01340.0586
16N/AN/AN/A0.47630.37140.09230.66250.01190.0168
17N/AN/AN/A0.20640.85160.10950.53510.07730.0483
18N/AN/AN/A0.22340.75520.08450.62590.09230.0532
19N/AN/AN/A0.28020.72380.16370.39530.25300.0586
20N/AN/AN/A0.09350.98340.12920.34620.41760.0845
21N/AN/AN/A0.05080.98340.04380.39530.28910.0483
22N/AN/AN/A0.13540.98340.05860.17530.57470.0050
23N/AN/AN/A0.09810.41760.17670.17530.66250.0261
24N/AN/AN/A0.07680.72380.23610.37030.98340.4176
25N/AN/AN/A0.12370.66230.20480.19040.96680.0532
Table 3. Statistical analysis results of MDE for RR interval of CHF patients, AF patients, and healthy groups. The shadows indicate that the distinction between the groups is significant. C, A, and H represent CHF, atrial fibrillation, and healthy group, respectively. In addition, s denotes scale factor and N/A denotes ‘Not Available’.
Table 3. Statistical analysis results of MDE for RR interval of CHF patients, AF patients, and healthy groups. The shadows indicate that the distinction between the groups is significant. C, A, and H represent CHF, atrial fibrillation, and healthy group, respectively. In addition, s denotes scale factor and N/A denotes ‘Not Available’.
MDE Statistical Results for RR Interval Time Series
sp-Value
N = 100N = 500N = 1000
C–AC–HA–HC–AC–HA–HC–AC–HA–H
10.07690.41760.34960.01590.00130.75520.01230.00130.5747
20.64580.47970.91720.02919.502 × 10−40.16370.02295.182 × 10−40.0706
30.98170.01110.00930.03665.183 × 10−40.05860.01234.227 × 10−50.0119
40.78230.0150.00360.0182.035 × 10−50.01190.03661.398 × 10−50.0323
50.85280.10670.19430.08490.00110.0020.05085.054 × 10−50.0034
60.40950.24080.87540.06281.016 × 10−40.00340.04561.688 × 10−50.0039
70.70410.00250.00220.22340.0030.00340.11293.53 × 10−50.0323
80.53860.00740.04290.09350.00160.03960.16114.227 × 10−50.0065
90.83630.06270.05040.28020.0030.03230.17532.943 × 10−50.0083
100.65730.44730.190.59720.07730.22010.19040.00130.0738
1110.81110.81110.94510.02910.10060.26033.79 × 10−40.0188
120.59830.01120.00470.80050.004370.34960.28028.551 × 10−50.0261
130.73010.24430.47230.96330.00680.0220.43470.00150.0773
140.57740.13610.31620.20610.41740.06130.50530.00340.0483
150.65280.13610.06020.62890.26990.28870.50520.0020.0807
160.3531N/A0.31620.39390.91710.20410.46210.0020.0234
170.3531N/A0.31620.11740.83510.08420.76520.0150.1141
18N/AN/AN/A0.35710.26050.67920.03580.1291
19N/AN/AN/A0.42070.28790.05010.90850.01990.0248
20N/AN/AN/A0.32070.41240.06450.56570.10050.0188
21N/AN/AN/A0.08740.96650.03010.56570.18330.0323
22N/AN/AN/A0.00580.59510.01050.37010.19010.0806
23N/AN/AN/A0.05170.45990.10340.40960.40450.0321
24N/AN/AN/A0.24810.89960.20990.53510.57460.0844
25N/AN/AN/A0.03570.43850.07990.26020.78690.1094
Table 4. Statistical analysis results of MCRDE for RR interval of CHF patients, AF patients, and healthy groups. The shadows indicate that the distinction between the groups is significant. C, A, and H represent CHF, atrial fibrillation, and healthy group, respectively. In addition, s denotes scale factor and N/A denotes ‘Not Available’.
Table 4. Statistical analysis results of MCRDE for RR interval of CHF patients, AF patients, and healthy groups. The shadows indicate that the distinction between the groups is significant. C, A, and H represent CHF, atrial fibrillation, and healthy group, respectively. In addition, s denotes scale factor and N/A denotes ‘Not Available’.
MCRDE Statistical Results for RR Interval Time Series
sp-Value
N = 100N = 500N = 1000
C–AC–HA–HC–AC–HA–HC–AC–HA–H
10.12370.66250.10060.66250.39410.34960.37030.03960.0643
20.06280.51940.07060.16110.07730.72380.13540.00730.1292
30.06280.23610.12920.12370.02350.49280.11290.00440.1292
40.01590.27060.07060.17530.04830.41760.11290.00390.0706
50.02030.12920.06430.10290.00650.27060.06950.00260.0845
60.03660.34960.05860.10290.01060.34960.06280.00150.0643
70.0180.63260.02610.06950.00570.22010.04090.00130.0532
80.02580.32860.10060.03660.00440.32860.03660.00150.119
90.01230.51940.03230.09350.00830.34960.05080.00150.0643
100.01080.69290.02910.05080.00200.20480.02914.44 × 10−40.0358
110.00940.30850.0210.04560.00390.30850.04098.186 × 10−40.0586
120.00410.46690.00440.05650.00200.19040.04095.183 × 10−40.0358
130.0180.63260.03580.07690.00260.19040.04568.186 × 10−40.0532
140.02290.91720.01340.05080.00170.23610.04566.045 × 10−40.0235
150.04560.75520.00730.02030.00260.15150.02297.04 × 10−40.0261
160.1680.98340.10060.02910.00200.22010.03666.045 × 10−40.0643
170.11290.49280.03230.04560.00200.20480.03264.44 × 10−40.015
180.13510.49270.01990.07690.00830.39410.02585.18 × 10−40.0358
190.10290.91720.04380.05650.00390.11900.03664.44 × 10−40.0291
200.13530.75520.08070.02030.00130.23610.02296.045 × 10−40.0261
210.03840.42930.00470.07690.00570.49280.02582.754 × 10−40.0188
220.20610.17640.03060.03267.04 × 10−40.23610.02584.436 × 10−40.0358
230.31180.10480.01590.02030.00260.46690.02033.233 × 10−40.0106
240.8180.26140.12910.02290.00220.28910.01594.44 × 10−40.0065
250.59620.83520.25260.02290.00220.37140.03261.988 × 10−40.0073
Table 5. Statistical analysis results for RR interval of healthy young and elderly groups. The shadows indicate that the distinction between the groups is significant. In addition, s denotes scale factor and N/A denotes ‘Not Available’.
Table 5. Statistical analysis results for RR interval of healthy young and elderly groups. The shadows indicate that the distinction between the groups is significant. In addition, s denotes scale factor and N/A denotes ‘Not Available’.
Statistical Results for RR Interval Time Series of Healthy Young and Elderly Groups
sp-Value
MSEMDEMCRDE
N = 100N = 500N = 1000N = 100N = 500N = 1000N = 100N = 500N = 1000
13.0786 × 10−45.7598 × 10−45.7598 × 10−40.00165.7598 × 10−44.9369 × 10−40.00420.00280.0028
20.0090.00210.00190.20512.6217 × 10−43.6093 × 10−40.00161.3564 × 10−40.0011
30.02020.00620.00320.11310.02510.00210.00191.1457 × 10−43.6093 × 10−4
40.07440.01280.00620.76750.26280.2290.00374.8063 × 10−54.2247 × 10−4
50.0680.01440.00900.74510.61870.48070.0892.329 × 10−51.6033 × 10−4
60.26250.05120.01280.00570.39510.38370.00281.1457 × 10−47.8021 × 10−4
70.38350.04650.01810.36140.09710.17110.00214.02 × 10−59.0585 × 10−4
8N/A0.11500.03810.35540.06490.11500.03443.3568 × 10−50.0014
90.18960.09710.02250.11460.01520.21330.00621.0922 × 10−50.0037
100.39190.12490.056410.06190.02510.05644.8063 × 10−57.8021 × 10−4
11N/A0.14660.05640.57650.07090.00210.02793.0786 × 10−46.709 × 10−4
12N/A0.13540.068010.08890.01010.04655.7371 × 10−50.0032
13N/A0.25440.0512N/N0.00360.01910.74003.3568 × 10−50.0014
14N/A0.14660.08900.35060.30930.07440.45510.00110.0032
15N/A0.38370.11500.35060.00390.00420.31920.00160.0079
16N/A0.15850.14660.35060.03260.0020.56144.9369 × 10−40.0016
17N/A0.19850.0971N/A0.00500.00480.03601.1457 × 10−40.0025
18N/A0.22900.0421N/A0.01700.01810.54576.709 × 10−40.0016
19N/A0.36150.1249N/A0.03230.02370.05299.0585 × 10−40.0037
20N/A0.15850.0815N/A0.07700.03990.08816.709 × 10−40.0062
21N/A0.83570.0971N/A0.03170.0512N/A0.00110.0048
22N/A0.22900.1249N/A0.18950.0037N/A9.0585 × 10−40.0128
23N/A0.15850.0680N/A0.02670.0026N/A3.0786 × 10−40.0019
24N/A0.44280.1249N/A0.04140.0101N/A0.00370.0114
25N/A0.24550.1249N/A0.11710.0034N/A0.00160.0114
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Kim, Y.; Choi, Y.-S. Multiscale Cumulative Residual Dispersion Entropy with Applications to Cardiovascular Signals. Entropy 2023, 25, 1562. https://doi.org/10.3390/e25111562

AMA Style

Kim Y, Choi Y-S. Multiscale Cumulative Residual Dispersion Entropy with Applications to Cardiovascular Signals. Entropy. 2023; 25(11):1562. https://doi.org/10.3390/e25111562

Chicago/Turabian Style

Kim, Youngjun, and Young-Seok Choi. 2023. "Multiscale Cumulative Residual Dispersion Entropy with Applications to Cardiovascular Signals" Entropy 25, no. 11: 1562. https://doi.org/10.3390/e25111562

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop