Open Access
This article is

- freely available
- re-usable

*Entropy*
**2017**,
*19*(4),
177;
https://doi.org/10.3390/e19040177

Article

Entropy in Natural Time and the Associated Complexity Measures

Section of Solid State Physics and Solid Earth Physics Institute, Department of Physics, National and Kapodistrian University of Athens, Panepistimiopolis, Zografos 157 84, Athens, Greece

Academic Editor:
Gunnar Pruessner

Received: 29 March 2017 / Accepted: 18 April 2017 / Published: 20 April 2017

## Abstract

**:**

Natural time is a new time domain introduced in 2001. The analysis of time series associated with a complex system in natural time may provide useful information and may reveal properties that are usually hidden when studying the system in conventional time. In this new time domain, an entropy has been defined, and complexity measures based on this entropy, as well as its value under time-reversal have been introduced and found applications in various complex systems. Here, we review these applications in the electric signals that precede rupture, e.g., earthquakes, in the analysis of electrocardiograms, as well as in global atmospheric phenomena, like the El Niño/La Niña Southern Oscillation.

Keywords:

entropy; natural time; complexity measures; seismic electric signals; Olami–Feder–Christensen model; electrocardiograms; El Niño/La Niña Southern Oscillation## 1. Introduction

Non-equilibrium dynamics is the key for understanding self-organization [1]. Self-organization is the main characteristic of complex systems that usually arise in physics, chemistry and mostly in biological sciences. The notion of self-organized criticality (SOC) introduced by Bak et al. [2] firstly provided a unifying picture [3,4,5] for the ubiquitous presence of power laws in various complex systems that definitely operate far from thermodynamic equilibrium. SOC reconciles non-equilibrium dynamics with the critical behavior obtained in equilibrium systems [6] without the necessity of a fine-tuned parameter, such as temperature or pressure in equilibrium. The mechanism behind this phenomenon is that the complex system self-organizes in a state for which power (or approximately power) laws appear naturally. Of course, not all complex systems or all self-organized systems give rise to power laws. A typical example of such a complex self-organized system is a living system [7]. The physiological time series resulting from such a system do not exhibit huge, power law-like variations, but they rather vary within a well-defined range, which is necessary for life to be sustained. Yet, the (multi-)fractal behavior arises, and it is altered with disease or aging [7]. Moreover, since physiological signals may contain both stochastic and deterministic components, the concept of entropy is also suitable for their study.

Within these lines of providing a general framework for the study of time series resulting from complex systems and focusing on the identification of forthcoming extreme events, our group [8,9,10] introduced natural time analysis (NTA) almost fifteen years ago. NTA enables the identification of novel dynamical features hidden behind the time series resulting from complex systems. The first applications of NTA have been reviewed by Varotsos et al. [11]. In natural time, one can define a quantity reminiscent of the excessive “entropy” (see [12], pp. 26–28), called [8,13] entropy in natural time S.

In the present work, we focus on the applications of natural time entropy to various complex systems in physics, geophysics, seismology, atmospheric sciences and cardiology. The paper is organized as follows: In Section 2, we present the necessary background of the analysis in natural time and introduce the entropy S, as well as the corresponding complexity measures in Section 2.2 and Section 2.3, respectively. Section 3 focuses on the related applications to the electric and magnetic signals that precede rupture (see Section 3.1), the penetration of magnetic flux avalanches in type II superconductors (which is a typical SOC system; in Section 3.2), the Olami–Feder–Christensen (OFC) [14] earthquake model (Section 3.3), the preparatory processes before the occurrence of strong earthquakes (Section 3.4), the study of electrocardiograms (ECG), summarized in Section 3.5, and atmospheric physics in Section 3.6. These applications, as well as the future perspectives for new ones are discussed in Section 4. Section 5 accounts for various technical, though very important for real life, details on the aforementioned applications. Finally, the conclusions are presented in Section 6.

## 2. Natural Time and Natural Time Entropy

#### 2.1. Analysis of Complex Time Series in Natural Time

In a time series of individual events resulting from a complex system, the natural time [8,9,10,11] associated with the k-th event is given by ${\chi}_{k}=k/N$, where N is the total number of events included in the time series. In NTA [8,9,10,11], the pair $({\chi}_{k},{Q}_{k})$ is studied where ${Q}_{k}$ is a quantity proportional to the energy emitted by the k-th event. This is made by considering the distribution:
where ${p}_{k}$ is the normalized energy for the k-th event. Since the positive ${p}_{k}$ for $k=1,\dots N$ sum up to unity, they can be considered as probabilities (for more details, see [15]), and hence, the function [8,9,10,11,15]:
may provide information about the distribution ${p}_{k}$ when $\omega \to 0$. Expanding Equation (2) around $\omega =0$, we obtain that:
where ${\kappa}_{1}$ stands for the variance of natural time:
with respect to the distribution ${p}_{k}$. For a simple system, such as a classical gas in thermal equilibrium in a vessel where ${Q}_{k}$ might be considered as the energy of the particles that consecutively collide with the walls of the vessel, ${Q}_{k}$ are independent and identically-distributed random variables leading to ${p}_{k}\to 1/N$. This is the case of the so-called [11,13,16] “uniform” distribution leading to a value of ${\kappa}_{1}$ equal to ${\kappa}_{u}=1/12\approx 0.083$. For critical systems, where one can assume that $p\left(\chi \right)$ varies algebraically as a power law, Varotsos et al. [17] have shown that:
for a variety of systems approaching criticality. Thus, ${\kappa}_{1}$ reaches the value of 0.070 for a critical system or 0.083 for a system exhibiting a stationary or quasi-periodic behavior.

$${p}_{k}=\frac{{Q}_{k}}{{\sum}_{n=1}^{N}{Q}_{n}},$$

$$\mathrm{\Pi}\left(\omega \right)={\left|\sum _{k=1}^{N}{p}_{k}exp\left(i\omega \frac{k}{N}\right)\right|}^{2}$$

$$\mathrm{\Pi}\left(\omega \right)=1-{\kappa}_{1}{\omega}^{2}+\dots ,$$

$${\kappa}_{1}\equiv \sum _{k=1}^{N}{\chi}_{k}^{2}{p}_{k}-{\left(\sum _{k=1}^{N}{\chi}_{k}{p}_{k}\right)}^{2},$$

$${\kappa}_{1}\approx 0.07$$

Figure 1 depicts how a time series from a variety of complex systems can be read in natural time.

#### 2.2. Entropy in Natural Time

Apart from ${\kappa}_{1}$, another useful quantity in NTA [11] is the entropy S given by [8,13,22]:
where the brackets $\langle \dots \rangle \left(\equiv {\sum}_{k=1}^{N}\dots {p}_{k}\right)$ denote averages with respect to the distribution ${p}_{k}$.

$$S=\langle \chi ln\chi \rangle -\langle \chi \rangle ln\langle \chi \rangle ,$$

The entropy S is a dynamic entropy that exhibits [23] positivity, concavity and Lesche [24,25] experimental stability. When ${Q}_{k}$ are independent and identically-distributed random variables, S reaches [22] the value ${S}_{u}\equiv \frac{ln2}{2}-\frac{1}{4}\approx 0.0966$ that corresponds to the aforementioned “uniform” distribution.

Moreover, upon reversing the time arrow and hence applying time reversal $\mathcal{T}$, i.e., $\mathcal{T}{p}_{k}={p}_{N-k+1}$, the value of S changes to a value ${S}_{-}$; see Figure 2. Hence, the entropy S in natural time does satisfy the condition to be “causal”. As the concept of entropy is equally applicable to deterministic, as well as stochastic processes, the natural time entropies S and ${S}_{-}$ may provide a useful tool [11,22,26,27,28,29] for the analysis of physiological time series (cf. the latter in most cases is due to processes involving both stochastic and deterministic components).

It is worthwhile to mention that natural time entropy S has a particularly simple physical meaning since it may capture small trends existing in ${Q}_{k}$. For example, when considering a small increasing trend $\u03f5(>0)$ for ${p}_{k}$ versus k by studying the parametric family $p(\chi ;\u03f5)\equiv 1+\u03f5\left(\chi -1/2\right)$ of continuous distributions for ${p}_{k}$, one can show [27], using the definition of Equation (6), that:
Expanding the last term of Equation (7) around $\u03f5=0$, we obtain that:
Since for this family of continuous distributions, ${S}_{-}\left(\u03f5\right)$ simply equals $S(-\u03f5)$, we observe that an increasing trend in $p(\chi ;\u03f5)$, i.e., $\u03f5>0$, corresponds to ${S}_{-}\left(\u03f5\right)$ values higher than $S\left(\u03f5\right)$. This result indicates that if we study the change of the entropy in natural time under time reversal:
increasing or decreasing trends transform to negative or positive values of $\mathrm{\Delta}S$, respectively. Finally, since $S\left(\u03f5\right)$ in Equation (7) is a nonlinear function of $\u03f5$, we observe that the change of the entropy under time reversal $\mathrm{\Delta}S$ is a nonlinear tool capturing alternations in the dynamics of the complex system.

$$S\left(\u03f5\right)\equiv {\int}_{0}^{1}p(\chi ;\u03f5)\chi ln\chi d\chi -\left[{\int}_{0}^{1}p(\chi ;\u03f5)\chi d\chi \right]ln\left[{\int}_{0}^{1}p(\chi ;\u03f5)\chi d\chi \right]=-\frac{1}{4}+\frac{\u03f5}{72}-\left(\frac{1}{2}+\frac{\u03f5}{12}\right)ln\left(\frac{1}{2}+\frac{\u03f5}{12}\right).$$

$$S\left(\u03f5\right)={S}_{u}+\left(\frac{6ln2-5}{72}\right)\u03f5+O\left({\u03f5}^{2}\right).$$

$$\mathrm{\Delta}S\equiv S-{S}_{-}$$

Using S and $\mathrm{\Delta}S$ within a specified natural time window of length l, one can study time series resulting from complex systems by constructing the corresponding time series of S and $\mathrm{\Delta}S$ obtained upon estimating these two quantities every l events as the natural time window of length l slides along the time series [30]. This inspires the introduction of complexity measures that quantify the fluctuations of the entropy S and of the quantity $\mathrm{\Delta}S$ upon changing the length scale, as well as the extent to which these quantities are affected when randomly shuffling the consecutive events.

#### 2.3. Complexity Measures Based on the Entropy in Natural Time

Complexity measures quantifying the variability of S and $\mathrm{\Delta}S$ upon changing either the (natural time window) length scale or shuffling the consecutive events randomly are classified into two categories depending on whether they make use of either S or the change $\mathrm{\Delta}S$ of the entropy in natural time under time reversal [22,26,27,29,31].

#### 2.3.1. Complexity Measures Based on S

As a measure of the natural time entropy fluctuations, we consider the standard deviation $\delta S$ when we calculate the value of S for a number of consecutive events and study how S varies when sweeping this time window (each time by one pulse) through the whole time series. The following complexity measures based on $\delta S$ have been suggested [22,26,31]:

When the natural time window length changes from a short value, e.g., five events, to a shorter one, e.g., three events, the corresponding $\delta S$ value also changes. This variation in the short(s) range is quantified by the measure ${\lambda}_{s}=\frac{\delta {S}_{5}}{\delta {S}_{3}},$ where the subscript in $\delta S$ denotes the time window length chosen. If a longer (L) range, e.g., 60 events, changes to a short one, e.g., three pulses (events), the corresponding variation is quantified by another measure ${\lambda}_{L}=\frac{\delta {S}_{60}}{\delta {S}_{3}}.$ Hence, one can in general quantify the effect of changing the natural time scale from three events to l events by considering the complexity measure:

$${\lambda}_{l}=\frac{\delta {S}_{l}}{\delta {S}_{3}}.$$

Considering now the data obtained by randomly shuffling the durations ${Q}_{k}$ of consecutive events, we can define the measure $\nu $ as:
where $\delta S$ and $\delta {S}_{shuf}$ denote the value of $\delta S$ calculated when a natural time window of length l is sweeping through the original and the shuffled time series, respectively. The following ratios have been investigated [22]: ${\nu}_{s}$ and ${\nu}_{L}$ for the following natural time window lengths: 3–4 events from small scales and 50–70 events for the larger scales, respectively. It is clear that the quantity $\nu $ captures the extent to which the sequential order of events regulates the natural time entropy fluctuations.

$$\nu \equiv \frac{\delta {S}_{shuf}}{\delta S},$$

#### 2.3.2. Complexity Measures Based on $\mathrm{\Delta}S$

Complexity measures $\mathrm{\Lambda}$ and N can be defined [27,29], in a similar fashion with the measures $\lambda $ and $\nu $ defined above, by using the time series of $\mathrm{\Delta}{S}_{l}$ obtained for a sliding natural time window l and considering its standard deviation $\sigma \left[\mathrm{\Delta}{S}_{l}\right]$ instead of $\delta S$. For example, we can define [27] the measure:
or apply [29] the complexity measure:

$${N}_{l}\equiv \frac{\sigma [\mathrm{\Delta}{S}_{l}^{shuf}]}{\sigma \left[\mathrm{\Delta}{S}_{l}\right]},$$

$${\mathrm{\Lambda}}_{l}=\frac{\sigma \left(\mathrm{\Delta}{S}_{l}\right)}{\sigma \left(\mathrm{\Delta}{S}_{3}\right)}.$$

The measure ${N}_{l}$ quantifies the extend to which the ordering of the events contributes to the $\mathrm{\Delta}{S}_{l}$ values being equal to unity for a random process, whereas ${\mathrm{\Lambda}}_{l}$ quantifies the variable effect of time reversal upon changing scale.

## 3. Applications of the Natural Time Entropy in Various Complex Systems

In this section, we will briefly present the various applications of S and $\mathrm{\Delta}S$ in different complex systems.

#### 3.1. Results for the Electric and Magnetic Signals that Precede Rupture

Seismic electric signals (SES) [12,32,33,34,35] are low-frequency (≤1 Hz) variations of the electric field of the Earth that have been found in Greece [36,37,38,39,40] and Japan [41,42,43,44,45] to precede earthquakes. Many SES recorded within a relatively short time are termed SES activities and usually exhibit a dichotomous behavior; see Figure 1a. They are recorded at certain sites of the Earth’s surface (sensitive sites) by using a multitude of measuring dipoles [33]. SES exhibit the so-called selectivity phenomenon according to which SES related with earthquakes of a given earthquake mechanism from a given seismic area are recorded only at a given sensitive site(s) [33,35,46,47,48,49,50]. This enables the determination of the epicentral area based on the sensitive site that has recorded the SES. The experimental study of SES started [51] more than thirty five years ago in Greece, and the continuous collection of data enabled the construction of selectivity maps for several sensitive sites. When an SES is recorded at a sensitive site, the measured electric field variations are compared with previous SES recorded at the same site, and information on the epicentral area of the forthcoming earthquake can be obtained (for a recent review, see [11], Chapter 1). For SES registered at a given sensitive site and originating from a given seismic area (and earthquake mechanism), their amplitude expressed as $\mathrm{\Delta}V/L$ (for a measuring dipole of length L with a given orientation) scales with the expected magnitude M of the impending earthquake according to the relation ${log}_{10}(\mathrm{\Delta}V/L)=(0.34-0.37)\mathrm{M}+\beta $, where $\beta $ is a constant depending on the dipole-seismic area and earthquake mechanism pair. The latter equation reflects that when the magnitude M increases by one-unit, the SES amplitude becomes almost double. All of the above properties can be understood [35,47,52,53,54] on the basis of the SES transmission model suggested by Varotsos and Alexopoulos [12]. The lead time of SES activities may vary [11,40] from three weeks to five and a half months, with an average around three months or so. For strong earthquakes, SES are accompanied by detectable magnetic field variations [55,56,57]. Hence, it is of major importance to be able experimentally to distinguish the electric and magnetic field variations that precede the earthquake rupture from other similar-looking signals.

In this direction, Equation (5), which holds for critical systems, has been applied (e.g., see [9,13,16]) together with S and ${S}_{-}$. In particular, both entropies S and ${S}_{-}$ have been experimentally found [13,58,59] to be smaller than ${S}_{u}$ for the electric signals that precede rupture:

$$S,{S}_{-}\stackrel{<}{\sim}{S}_{u}.$$

On the other hand, electrical noises that resemble in shape SES (they are of a dichotomous nature as shown in Figure 1a) violate in general one of the two conditions implied by the inequality (14). Table 4.6 of [11] presents an extensive list of recorded SES and noises for which Equation (5) and the above relations (14) can be used for a secure distinction between these two kinds of electric signals. Relations (14) have been also found to be valid [60] for long duration SES activities, such the one depicted in Figure 1e, although a more complicated analysis is necessary for this case (see Section 5). It is important to mention that S together with ${\kappa}_{1}$ have been also found to obey Equation (5) and Inequality (14) for the electric field variations that were recorded at Mexico [61] and preceded the magnitude M = 6.6 earthquake on 24 October 1993 and the M = 7.4 of the Guerrero earthquake on 14 September 1995.

As suggested by Varotsos [62], the experimental results on the electromagnetic (EM) precursory signals detected before earthquakes, as well as the ground-based ultra low frequency (ULF) magnetic field measurements (e.g., see [63,64,65,66] for such phenomena observed before the $M=9$ Tohoku mega-earthquake on 11 March 2011) show that the main characteristics (e.g., amplitude, frequency range, lead time) of these precursory changes are similar to those discussed above for SES (which, as mentioned, for strong impending earthquakes are accompanied by detectable magnetic field variations). This observation has prompted the application [67] of the aforementioned criteria (Equation (5) and Relations (14)) to the pre-fracture EM emissions that preceded the 7 September 1999 Athens, Greece, $M=5.9$ earthquake. The results show [67] that these criteria hold. The latter criteria have been also shown [68,69,70] to be valid for other EM emissions that preceded the strong earthquakes of 12 October 2013, 26 January 2014 and 3 February 2014 in Greece and the 2013 $M=6.3$ earthquake at Kobe, Japan.

#### 3.2. Results for the Penetration of Magnetic Flux Avalanches in Type II Superconductors

As first pointed out by de Gennes [71], when a type II superconductor is put in a slowly-ramped external magnetic field, magnetic vortices start to penetrate the sample from its edges. These vortices get pinned by crystallographic defects (e.g., dislocations), leading to the build-up of a flux gradient that is only marginally stable in a similar fashion as is the slope in a slowly-growing sand pile. Hence, it can happen that small changes in the applied field can result in large rearrangements of flux in the sample, known as flux avalanches [72,73,74]. Thus, the system is very close to the original sand pile models suggested [2] as prototype for SOC. Natural time analysis of such magnetic flux avalanches have been performed [75,76] on the basis of the detailed measurements reported by Aegerter et al. [77] for thin films of YBa${}_{2}$Cu${}_{3}$O${}_{7-x}$. It has been shown [76] that both S and ${S}_{-}$ satisfy the inequalities (14), although one cannot decide which of the two is larger than the other.

Moreover, these results, which correspond to a complex system at SOC, have been compared [76] with those obtained from 3D rice piles getting [19,20] progressively closer to SOC. The rice piles also resemble the prototype sand pile model of SOC, e.g., see [19,20,78,79], and the comparison has been made on the basis of the well-controlled experiments performed [19,20] on 3D rice piles. A typical example of such experiments is shown in Figure 1c. The results of Figure 2 of [76] indicate that both Equation (5), as well as Relation (14) hold in a fashion similar to that observed in the analysis of SES. This fact probably indicates that the system is entering a critical stage. Here, it is worthwhile to mention that similar results have been obtained [75,76] when analyzing the avalanches produced by a simple deterministic self-organized critical system introduced [80] to describe avalanches in stick-slip phenomena. Detailed simulations of this model have demonstrated [81] that SOC itself can spontaneously generate both critical avalanche statistics and long-range temporal correlations between avalanches in the presence of a slow temporarily-uniform external drive. It has been found [75,76] that Equation (5) holds together with $S<{S}_{u}$ as this system approaches SOC. When SOC is reached, the relations (14) hold only marginally [76].

#### 3.3. Olami–Feder–Christensen Earthquake Model

The OFC earthquake model [14] is probably [82] the most studied non-conservative, supposedly, SOC model. It was conceived as a simplification of the Burridge–Knopoff spring-block model [83] for earthquakes by mapping it into a non-conservative cellular automaton. The OFC model introduced dissipation in the family of SOC systems. The spring-block model consists of a two-dimensional array of blocks arranged in a flat surface with friction. Each block is connected (by elastic springs) with its first neighbors and in the vertical direction to a driving plate that moves horizontally with velocity v. When the force acting on a block overcomes the static friction with the surface, the block slips (cf. [84,85] for important precursor dynamics before the transition to sliding). In the OFC model, the force on a block is stored in a site of a square lattice, and the static friction threshold is assumed to have the same value over all blocks. If energy input occurs in discrete steps instead of continuous and if thresholds are random, but not quenched, quasiperiodicity emerges combined with power-laws [82]. The OFC model [14] runs as follows: we assign a continuous random variable ${z}_{ij}\in (0,1)$ to each site of a square lattice, which represents the local “energy”. Starting with a random initial configuration taken from a uniform distribution in the segment (0,1), the value ${z}_{ij}$ of all sites is simultaneously increased at a uniform loading rate until a site $ij$ reaches the threshold value ${z}_{thres}$ = 1 (i.e., the loading $\mathrm{\Delta}f$ is such that ${\left({z}_{ij}\right)}_{max}+\mathrm{\Delta}f=1$). This site then topples, which means that ${z}_{ij}$ is reset to zero, and an “energy” $\alpha {z}_{ij}$ is passed to every nearest neighbor. If this causes a neighbor to exceed the threshold, the neighbor topples also, and the avalanche continues until all ${z}_{kl}<1$. Then, the uniform loading increase resumes. The number of topplings defines the size s of an avalanche or “earthquake”. The quantity $f=\sum \left(\mathrm{\Delta}f\right)$ represents the total increase of ${z}_{ij}$ due to the external force loading in each site. Since the loading rate is assumed uniform in time, f plays a role analogous to that of the conventional time $T\equiv f$. The coupling parameter $\alpha $ can take values from 0–0.25. Smaller $\alpha $ means more dissipation, and $\alpha $ = 0.25 corresponds to the conservative case. The parameter $\alpha $ is the only parameter of the model apart from the system size L, the edge length of the square lattice. The model can be supplemented by open boundary conditions in which the sites at the boundary distribute energy to the outer sites, which cannot topple; thus, energy is removed at the boundary. Another possibility is to use free boundary conditions: in this case, $\alpha $ varies locally:
where ${n}_{ij}$ is the actual number of nearest neighbors of the site $ij$. For sites in the bulk ${n}_{ij}$ = 4; for sites at the edges ${n}_{ij}$ = 3; and for the four sites at the corners ${n}_{ij}$ = 2. The symbol K denotes the elastic constant of the upper leaf springs measured relative to that of the other springs between blocks [86]. Obviously, the OFC model is non-conservative for $K>0$ for which ${\alpha}_{ij}<0.25$.

$${\alpha}_{ij}=\frac{1}{{n}_{ij}+K}$$

The criticality of the OFC model has been debated [87,88]. Furthermore, the SOC behavior of the model is destroyed upon introducing some small changes in the rules of the model, e.g., replacing open boundary condition with periodic boundary conditions [89], introducing frozen noise in the local degree of dissipation [90] or in its threshold value [91], including lattice defects [92] (which should not be confused with the intrinsic lattice defects in solids [93], e.g., Schottky [94,95] or Frenkel [96,97] defects). Despite these findings, as well as others that show [98] that it is insufficient to account for certain aspects of the spatiotemporal clustering of seismicity, the OFC model appears to show many features found in real earthquakes. As far as earthquake predictability [99] or Omori’s law [86,100] are concerned, the OFC models appear to be closer to reality than others [101]. The predictability of the OFC model has been attributed to the occurrence of “foreshocks” (as well as “aftershocks”) in the non-conservative case of the model [100]. In addition, for certain values of the local degree “$\alpha $” of dissipation (i.e., if “$\alpha $” is chosen above 0.17), the OFC model exhibits an avalanche size distribution that agrees well [102] with the Gutenberg–Richter (GR) law [103], which states that the (cumulative) number of earthquakes with magnitude greater than or equal to M is given by:
where b is a constant, which varies only slightly from region to region in the range $0.8\le b\le 1.2$ [104]. Considering that the seismic energy E released during an earthquake is related [105] to the magnitude through $E\sim {10}^{cm}$, where c is around 1.5, Equation (16) turns into:
where $\gamma =1+b/1.5$. Hence, $b\approx 1$ means that the exponent $\gamma $ is around $\gamma $ = 1.6–1.7. The above are some of the reasons why the OFC model is considered to be the prime example [106] for a supposedly SOC system for earthquakes, but the question of whether real earthquakes are described or not by SOC models of this type, or whether other kinds of mechanisms, e.g., [107,108,109], need to be involved, still remains unsolved [82,86,100,110,111,112,113,114].

$$N(\ge M)\sim {10}^{-bM}$$

$$P\left(E\right)\sim {E}^{-\gamma}$$

In the NTA of the OFC model [115], the size s was the quantity used as ${Q}_{k}$ in Equation (1), and the difference of the entropy in natural time under time reversal $\mathrm{\Delta}S$ of Equation (9) has been evaluated for the time series of avalanches that preceded a large avalanche (e.g., one with $s\ge 1000$ as in Figure 3). The values of $\mathrm{\Delta}S$ have been stacked for a large number of such time series, and the results indicate (Figure 3; see also Figure 1 of [115] where a definition of $\mathrm{\Delta}S$ opposite to that of Equation (9) has been used, or Figure 8.12 of [11]) a well-defined minimum of $\mathrm{\Delta}S$ of Equation (9) exists that indicates that in the OFC model, there exists a time arrow as the system evolves towards a large avalanche. This can be interpreted as the existence of foreshocks or in general as an indication of the predictability of the OFC model.

#### 3.4. Earthquakes

The most important power law for earthquakes is the GR law of Equation (16), which reflects that the seismic energy is emitted in the form of the power law of Equation (17). Both the entropy S and the entropy under time-reversal ${S}_{-}$ have been used for the determination of the occurrence time of an impending mainshock. This has been done [59,116,117,118] in a variety of cases in Greece where SES have been identified. The procedure followed is that upon the recording of the SES, a candidate area for suffering a strong earthquake can be selected, and hence, the seismicity due to the small earthquakes occurring there can be studied in natural time as described in Section 5. Thus, upon the occurrence of each small earthquake, we can estimate the parameters ${\kappa}_{1}$, S and ${S}_{-}$. Experience has shown that a few days before the occurrence of the strong earthquake that gave rise to the recorded SES, Equation (5) as well as Condition (14) are valid. This has been independently verified before strong earthquakes in Greece [119,120] and Japan [44]. As an example, we present in Figure 4 the analysis of the seismicity in the area N${}_{36.0}^{38.6}$E${}_{20.0}^{22.5}$ estimated by [121] based on an SES recorded on 14 January 2008 (see Figure 2(c) of [122]). This figure reveals that after the 56th event that occurred on 5 February 2008, both Equation (5), as well as Condition (14) have been continuously satisfied until the last event shown in this figure that occurred on 10 February 2008. This behavior has led to the public warning for an imminent strong earthquake in the aforementioned region that was announced on the 10 February 2008 issue of the Greek newspaper Ethnos (see the related discussion in Section 21.4 of Lazaridou-Varotsos [40], as well as [38,39]). Four days later, the strongest earthquake (${M}_{w}\left(USGS\right)=6.9$) in Southern Greece for the last 30 years occurred at 10:09 UT on 14 February 2008.

#### 3.5. Electrocardiograms

Physiological time series are best suited for NTA based on complexity measures based on the entropy S. This is so because usually, such time series give rise to ${\kappa}_{1}$ very close to ${\kappa}_{u}$, as well as S close to ${S}_{u}$ due to the quasi-periodic behavior they exhibit. Hence, for the study of time series coming from ECG recordings, one should construct the corresponding time series of S or $\mathrm{\Delta}S$ obtained for certain scales l of the length of the natural time sliding window. The ECG analyzed come from publicly-available databases [123] (for more details as well as the defitinitions of the RR, NN, QRS, and QT intervals that will be mentioned below see Section 5), and the following key results have been obtained [11,22,26,27,28,29]:

- When analyzing the RR and QRS intervals of the ECG in natural time, the subjects suffering from sudden cardiac death (SCD) violate [22] one or more of the four healthy limits related to ${\nu}_{s}\left(RR\right)$, ${\nu}_{L}\left(RR\right)$, ${\nu}_{s}\left(QRS\right)$ and ${\nu}_{L}\left(QRS\right)$.
- When analyzing the QT intervals of the ECG in natural time $\delta {S}_{l}\left(QT\right)$ for $l=3$–8 heartbeats, the SCD subjects exhibit [26] almost one order of magnitude larger fluctuations than those of the healthy ones.
- When employing $\mathrm{\Delta}S$ in the analysis of the RR and NN intervals of long duration ECG of SCD patients, the fluctuations of $\mathrm{\Delta}{S}_{7}$ appear to maximize [27] during the last three hours before the ventricular fibrillation.
- When employing $\mathrm{\Delta}S$ in the analysis of the RR and NN intervals of long-duration ECG, N${}_{3}\left(\mathrm{RR}\right)$, N${}_{3}\left(\mathrm{NN}\right)$ together with $\mathrm{\Delta}{S}_{7}$(RR) and $\mathrm{\Delta}{S}_{7}$(NN) may allow the separation [27] of individuals into four classes: healthy, SCD, congestive heart failure (CHF) and atrial fibrillation (AF) individuals.
- The analysis suggested in the previous point is also valid [28] for models of healthy or patient heart dynamics.
- When analyzing the NN intervals of long-duration ECG recordings, the combination of $\sigma \left[\mathrm{\Delta}{S}_{7}\right]$ with ${\mathrm{\Lambda}}_{7}$ and ${\mathrm{\Lambda}}_{49}$ enables (see Table 1 of [29]) the ternary distinction in healthy, SCD and CHF individuals.

#### 3.6. Atmospheric Physics

Use of natural time entropy has been also made in atmospheric physics.

#### 3.6.1. Ozone Hole Dynamics over Antarctica

Varotsos and Tzanis [124] applied S and ${S}_{-}$ in the time series of the maximum daily ozone hole area over Antarctica for each year during the period 1979–2009. The results obtained show that S for scales 3–7 years and ${S}_{-}$ for all scales (3–15 years) almost stabilizes during the last several years. On the other hand, characteristic features are found before the unprecedented event of the major sudden stratospheric warming and the subsequent break-up of the Antarctic ozone hole into two holes in September 2002. In particular, the following precursory changes have been identified [124]: First, for scales larger than eight years, S exhibits a gradual increase after around 1999. Second, from 2000 to 2001, ${S}_{-}$ shows an increase for all scales (3–15 years) except for the scale of 13 years. Third, the values of $\mathrm{\Delta}S$ almost coincide at 2000 for the short scales 3–7 years and then decrease. Finally, the analysis in the natural time domain was also applied [124] on the eddy heat flux, which is proportional to the vertically propagating wave activity affecting the ozone hole over Antarctica, and the results drawn confirm those deduced from the ozone hole area diagnostics.

#### 3.6.2. Forecasting the Intensity of El Niño/La Niña Southern Oscillation

Varotsos et al. [125] have identified that when analyzing the monthly SOI values in natural time (see Section 5), the time series of the change of the entropy in natural time under time reversal estimated for periods of 20 months, i.e., $\mathrm{\Delta}{S}_{20}$, may act as a predictor for the intensity of the El Niño/La Niña Southern Oscillation (ENSO) events (see also [126]). They suggested that when $\mathrm{\Delta}{S}_{20}$ exceeds a threshold $\mathrm{\Delta}{S}_{thres}$, an El Niño event is expected to occur. In other words, the time series of $\mathrm{\Delta}{S}_{20}$ captures the dynamics of ENSO and exhibits clear precursory signals before strong El Niño events. Within this frame, the successful prediction that the 2015–2016 El Niño event would be rather a “moderate to strong” or even a “strong” event and not “one of the strongest on record”, as that of 1997–1998, has been made [127].

More specifically, in Figure 5, we depict the $\mathrm{\Delta}{S}_{20}$ and Southern Oscillation Index (SOI) values’ time series and indicate by a vertical arrow the data available at the time at which it was decided that the ongoing 2015–2016 El Niño event will not evolve into one of the strongest events ever recorded, i.e., October 2015 (the paper was initially submitted [127,128] on 13 November 2015). As is also shown in this figure, the subsequent values of SOI never left the green colored region that corresponds to the minimum values of SOI for “weak, weak to moderate, moderate, moderate to strong” El Niño events validating the aforementioned prediction. The latter has been based on the data presented in Figure 6 where the probability density function (PDF) of $\mathrm{\Delta}{S}_{20}$ is shown (for details on its determination, see [127]) and compared with the extreme $\mathrm{\Delta}{S}_{20}$ values measured during very strong El Niño events. An inspection of this figure together with Figure 5 reveals that indeed, the $\mathrm{\Delta}{S}_{20}$ values up to October 2015 never exceeded the extreme values measured before or during the strongest El Niño events ever recorded.

## 4. Discussion and Perspectives

As we can see from the results presented in the previous section, natural time entropy S, as well as its value ${S}_{-}$ obtained under time-reversal is useful for identifying when a system approaches a critical stage, as is for example the case of electric signals before rupture (see Section 3.1), SOC systems (such as those studied in Section 3.2) or the seismicity before a strong earthquake (see Section 3.4). In all of the cases mentioned above, the validity of the inequalities (14) characterizes (together with other conditions, e.g., see [118,129]) the approach to criticality.

Apart from this application, the study of the time series of the difference $\mathrm{\Delta}S$ of the entropy in natural time under time reversal may reveal useful information concerning the evolution of the system towards an extreme event. This has been discussed here in Section 3.3 for the OFC earthquake model and in the two cases in atmospheric physics of Section 3.6. Such applications may be very fruitful in the future as the kind of the complex system studied may vary. Hence, the use of $\mathrm{\Delta}S$ time series for different complex systems is strongly encouraged.

Finally, for complex systems exhibiting quasi-periodic behavior, such as the case of heart rate variability (see Section 3.5), one should better study complexity measures based on the time series of S and $\mathrm{\Delta}S$ such as those defined in Section 2.3. These can reveal the interplay between the various scales that are involved in the regulation of the behavior of the complex system (cf. regulation is a prerequisite of quasi-periodic behavior) and may be useful for the identification of severe situations (such as SCD), although the system may look to operate normally. Application of the results obtained in Section 3.5 to a wider range of individuals, as well as the possibilities of their practical use in the medical practice are currently under study.

## 5. Materials and Methods

For the analysis of dichotomous electric signals that precede rupture (e.g., SES activities [9,13,16]), we first convert the experimentally-recorded signal into its dichotomous representation (0 = no signal, 1 = signal), and then, we can easily obtain the power (see the middle panel of Figure 1a) and, hence, the energy emitted during each pulse, which is proportional to the duration of the pulse. As shown in the lower panel of Figure 1a, in NTA, we consider as ${Q}_{k}$ the duration of the k-th pulse.

In the case of earthquakes, instead of the earthquake magnitude M usually reported for each earthquake in conventional time (see the upper panel of Figure 1b), in NTA, we consider as ${Q}_{k}$ the seismic energy emitted during an earthquake, which is given by [105] $E={10}^{1.5{M}_{w}+11.8}$ erg, where ${M}_{w}$ is the moment magnitude. For the case of the earthquakes shown in the upper panel of Figure 1b, appropriate conversion relations between M and ${M}_{w}$ suggested by Tanaka et al. [130] have been used to obtain the values of ${Q}_{k}$ depicted in the lower panel. In the latter panel, the quantity $\epsilon $ corresponds to the seismic energy emitted by an $M=3.5$ earthquake.

For the case of 3D rice piles, e.g., see the upper panel of Figure 1c, which comes from the detailed experiments of Lőrincz [20] (see Figure 5.1 there), in natural time we consider as ${Q}_{k}$ the size of the k-th avalanche, as shown in the lower panel of Figure 1c.

In the case of the analysis of ECG, where traditionally the turning points are labeled by the letters P, Q, R, S and T (see the upper panel of Figure 1d), various durations (intervals) corresponding to the time elapsed between these points, such as the QT interval shown in the lower panel of Figure 1d, have been considered as ${Q}_{k}$ in NTA. For example, the RR interval which is the duration between two successive R turning points has been also considered as ${Q}_{k}$ in NTA. Other intervals that have been also used for the same purpose are the NN intervals, which are the durations between consecutive normal beats and intervals between pairs of normal beats surrounding an ectopic beat are discarded (see also [29] and references therein), and the QRS intervals that correspond to the duration of the QRS complex in a cardiac cycle of the ECG (see the upper panel of Figure 1d). Moreover, the ECG data analyzed in natural time so far (e.g., see [131]) come from various databases available at physiobank [123]. As mentioned in Section 3.5, for the analysis of such ECG intervals in natural time, the time series of S and ${S}_{-}$ should be calculated when using a natural time window of length l. This window slides each time by one interval (event) in the ECG interval time series, so that when starting from the ${m}_{0}$-th event, we have:
where ${\langle \chi ln\chi \rangle}_{w}={\sum}_{k=1}^{l}{p}_{k,w}{\chi}_{k,w}ln{\chi}_{k,w},$ ${\langle \chi \rangle}_{w}={\sum}_{k=1}^{l}{p}_{k,w}{\chi}_{k,w}$ with:
and ${\chi}_{k,w}=k/l$. Similarly, ${S}_{-}({m}_{0},l)$ is calculated by Equation (18) when ${p}_{k,w}$ of Equation (19) is substituted by:
The $\mathrm{\Delta}{S}_{l}$ time series is obtained by the differences $\mathrm{\Delta}{S}_{l}\left({m}_{0}\right)\equiv S({m}_{0},l)-{S}_{-}({m}_{0},l)$, ${m}_{0}=1,2,\dots ,N-l$.

$$S({m}_{0},l)={\langle \chi ln\chi \rangle}_{w}-{\langle \chi \rangle}_{w}ln{\langle \chi \rangle}_{w}$$

$${p}_{k,w}=\frac{{Q}_{{m}_{0}-1+k}}{{\sum}_{n=1}^{l}{Q}_{{m}_{0}-1+n}}$$

$$\widehat{T}{p}_{k,w}=\frac{{Q}_{{m}_{0}+l-k}}{{\sum}_{n=1}^{l}{Q}_{{m}_{0}+l-n}}.$$

For a not (obviously) dichotomous signal, such as the electric signal depicted in the upper panel of Figure 1e that preceded [60] the ${M}_{w}$6.4 earthquake at 38.0${}^{\circ}$ N 21.5${}^{\circ}$ E on 8 June 2008, the analysis in natural time is made in two steps: First, we estimate the “instantaneous” power in the sense that we use data at the shortest time interval available from our (assumed even) sampling and construct the time series ${P}_{i}$, e.g., see the middle panel of Figure 1e. Then, by selecting a threshold ${P}_{thres}$ (see the horizontal line in the same panel), we add every consecutive ${P}_{i}$ that is larger then ${P}_{thres}$ to estimate the energy emitted during an event. When ${P}_{i}$ falls below ${P}_{thres}$, the event ends, and a new event starts when for the first time ${P}_{i}$ becomes larger than ${P}_{thres}$ again. This way, we obtain a representation of the signal in natural time as that shown in the lower panel of Figure 1e. By varying the threshold within a reasonable range, which can be determined by the distribution of ${P}_{i}$, e.g., see Figure 6 of [60], we can obtain secure conclusions concerning the values of ${\kappa}_{1}$, S and ${S}_{-}$ of the signal in natural time.

Finally, for data such as those usually collected in atmospheric physics involving hourly, daily or even monthly observations, which may acquire both positive and negative values, such as Troup [21] SOI, depicted in the upper panel of Figure 1f, the NTA can be performed [125,127] by adding an appropriate constant so that all values become non-negative, as shown for example in the lower panel of Figure 1f, and then proceed to the study of the resulting time series by $\mathrm{\Delta}{S}_{l}$.

## 6. Conclusions

Here, we reviewed the applications of the natural time entropy S, its value under time reversal ${S}_{-}$ and the related complexity measures in a variety of complex systems. As an outlook for the future, one could propose the study of S and ${S}_{-}$ in systems that may approach criticality, the study of the $\mathrm{\Delta}S$ time series as a general tool for the identification of precursory to extreme event phenomena and the use of complexity measures for the characterization of complex systems exhibiting quasi-periodic behavior.

## Acknowledgments

We express our sincere thanks to Rinke J. Wijngaarden for sending us the YBa${}_{2}$Cu${}_{3}$O${}_{7-x}$ data and to Kinga A. Lőrincz for kindly providing the rice pile data analyzed.

## Conflicts of Interest

The author declares no conflict of interest.

## Abbreviations

The following abbreviations are used in this manuscript:

3D | 3-dimensional |

AF | Atrial fibrillation |

CHF | Congestive heart failure |

ECG | Electrocardiograms |

EM | Electromagnetic |

ENSO | El Niño/La Niña Southern Oscillation |

EQ | Earthquake |

GR | Gutenberg–Richter |

OFC | Olami–Feder–Christensen |

NTA | Natural time analysis |

Probability density function | |

SCD | Sudden cardiac death |

SES | Seismic electric signals |

SOC | Self-organized criticality |

SOI | Southern Oscillation Index |

ULF | Ultra-low frequency |

## References

- Nicolis, G.; Prigogine, I. Self-Organization in Nonequilibrium Systems: From Dissipative Structures to Order Through Fluctuations; Wiley: New York, NY, USA, 1977. [Google Scholar]
- Bak, P.; Tang, C.; Wiesenfeld, K. Self-organized criticality: An explanation of the 1/f noise. Phys. Rev. Lett.
**1987**, 59, 381–384. [Google Scholar] [CrossRef] [PubMed] - Bak, P. How Nature Works: The Science of Self-Organized Criticality; Springer: New York, NY, USA, 1996. [Google Scholar]
- Jensen, H.J. Self-Organized Criticality: Emergent Complex Behavior in Physical and Biological Systems; Cambridge University Press: Cambridge, UK, 1998. [Google Scholar]
- Pruessner, G. Self-Organised Criticality Theory, Models and Characterisation; Cambridge University Press: Cambridge, UK, 2012. [Google Scholar]
- Stanley, H.E. Scaling, universality, and renormalization: Three pillars of modern critical phenomena. Rev. Mod. Phys.
**1999**, 71, S358–S366. [Google Scholar] [CrossRef] - Goldberger, A.L.; Amaral, L.A.N.; Hausdorff, J.M.; Ivanov, P.C.; Peng, C.K.; Stanley, H.E. Fractal dynamics in physiology: Alterations with disease and aging. Proc. Natl. Acad. Sci. USA
**2002**, 99, 2466–2472. [Google Scholar] [CrossRef] [PubMed] - Varotsos, P.A.; Sarlis, N.V.; Skordas, E.S. Spatio-Temporal complexity aspects on the interrelation between Seismic Electric Signals and Seismicity. Practica of Athens Academy
**2001**, 76, 294–321. [Google Scholar] - Varotsos, P.A.; Sarlis, N.V.; Skordas, E.S. Long-range correlations in the electric signals that precede rupture. Phys. Rev. E
**2002**, 66, 011902. [Google Scholar] [CrossRef] [PubMed] - Varotsos, P.A.; Sarlis, N.V.; Skordas, E.S. Seismic Electric Signals and Seismicity: On a tentative interrelation between their spectral content. Acta Geophys. Pol.
**2002**, 50, 337–354. [Google Scholar] - Varotsos, P.A.; Sarlis, N.V.; Skordas, E.S. Natural Time Analysis: The New View of Time. Precursory Seismic Electric Signals, Earthquakes and other Complex Time-Series; Springer: Berlin/Heidelberg, Germany, 2011. [Google Scholar]
- Varotsos, P.; Alexopoulos, K. Thermodynamics of Point Defects and Their Relation with Bulk Properties; North Holland: Amsterdam, The Netherlands, 1986. [Google Scholar]
- Varotsos, P.A.; Sarlis, N.V.; Skordas, E.S. Attempt to distinguish electric signals of a dichotomous nature. Phys. Rev. E
**2003**, 68, 031106. [Google Scholar] [CrossRef] [PubMed] - Olami, Z.; Feder, H.J.S.; Christensen, K. Self-organized criticality in a continuous, nonconservative cellular automaton modeling earthquakes. Phys. Rev. Lett.
**1992**, 68, 1244–1247. [Google Scholar] [CrossRef] [PubMed] - Varotsos, P.; Sarlis, N.; Skordas, E. On the Motivation and Foundation of Natural Time Analysis: Useful Remarks. Acta Geophys.
**2016**, 64, 841–852. [Google Scholar] [CrossRef] - Varotsos, P.A.; Sarlis, N.V.; Skordas, E.S. Long-range correlations in the electric signals the precede rupture: Further investigations. Phys. Rev. E
**2003**, 67, 021109. [Google Scholar] [CrossRef] [PubMed] - Varotsos, P.; Sarlis, N.V.; Skordas, E.S.; Uyeda, S.; Kamogawa, M. Natural time analysis of critical phenomena. Proc. Natl. Acad. Sci. USA
**2011**, 108, 11361–11364. [Google Scholar] [CrossRef] [PubMed] - Sarlis, N.V.; Skordas, E.S.; Varotsos, P.A.; Nagao, T.; Kamogawa, M.; Uyeda, S. Spatiotemporal variations of seismicity before major earthquakes in the Japanese area and their relation with the epicentral locations. Proc. Natl. Acad. Sci. USA
**2015**, 112, 986–989. [Google Scholar] [CrossRef] [PubMed] - Lőrincz, K.A.; Wijngaarden, R.J. Edge effect on the power law distribution of granular avalanches. Phys. Rev. E
**2007**, 76, 040301. [Google Scholar] [CrossRef] [PubMed] - Lőrincz, K.A. Avalanche Dynamics in a Three-Dimensional Pile of Rice. Ph.D. Thesis, Vrije Universiteit, Amsterdam, The Netherlands, 2008. [Google Scholar]
- Troup, A.J. The ‘southern oscillation’. Q. J. R. Meteorol. Soc.
**1965**, 91, 490–506. [Google Scholar] [CrossRef] - Varotsos, P.A.; Sarlis, N.V.; Skordas, E.S.; Lazaridou, M.S. Entropy in the natural time domain. Phys. Rev. E
**2004**, 70, 011106. [Google Scholar] [CrossRef] [PubMed] - Varotsos, P.A.; Sarlis, N.V.; Tanaka, H.K.; Skordas, E.S. Some properties of the entropy in the natural time. Phys. Rev. E
**2005**, 71, 032102. [Google Scholar] [CrossRef] [PubMed] - Lesche, B. Instabilities of Renyi entropies. J. Stat. Phys.
**1982**, 27, 419–422. [Google Scholar] [CrossRef] - Lesche, B. Renyi entropies and observables. Phys. Rev. E
**2004**, 70, 017102. [Google Scholar] [CrossRef] [PubMed] - Varotsos, P.A.; Sarlis, N.V.; Skordas, E.S.; Lazaridou, M.S. Natural entropy fluctuations discriminate similar-looking electric signals emitted from systems of different dynamics. Phys. Rev. E
**2005**, 71, 011110. [Google Scholar] [CrossRef] [PubMed] - Varotsos, P.A.; Sarlis, N.V.; Skordas, E.S.; Lazaridou, M.S. Identifying sudden cardiac death risk and specifying its occurrence time by analyzing electrocardiograms in natural time. Appl. Phys. Lett.
**2007**, 91, 064106. [Google Scholar] [CrossRef] - Sarlis, N.V.; Skordas, E.S.; Varotsos, P.A. Heart rate variability in natural time and 1/f “noise”. EPL
**2009**, 87, 18003. [Google Scholar] [CrossRef] - Sarlis, N.V.; Christopoulos, S.R.G.; Bemplidaki, M.M. Change ΔS of the entropy in natural time under time reversal: Complexity measures upon change of scale. EPL
**2015**, 109, 18002. [Google Scholar] [CrossRef] - Varotsos, P.; Sarlis, N.; Skordas, E. Scale-specific order parameter fluctuations of seismicity in natural time before mainshocks. EPL
**2011**, 96, 59002. [Google Scholar] [CrossRef] - Varotsos, P.A.; Sarlis, N.V.; Skordas, E.S.; Lazaridou, M.S. The use of the Entropy in the natural time-domain to distinguish electric signals. Practica of Athens Academy
**2003**, 78, 281–298. [Google Scholar] - Varotsos, P.; Alexopoulos, K. Physical Properties of the variations of the electric field of the earth preceding earthquakes, I. Tectonophysics
**1984**, 110, 73–98. [Google Scholar] [CrossRef] - Varotsos, P.; Lazaridou, M. Latest aspects of earthquake prediction in Greece based on Seismic Electric Signals. Tectonophysics
**1991**, 188, 321–347. [Google Scholar] [CrossRef] - Varotsos, P.; Alexopoulos, K.; Lazaridou, M. Latest aspects of earthquake prediction in Greece based on Seismic Electric Signals, II. Tectonophysics
**1993**, 224, 1–37. [Google Scholar] [CrossRef] - Varotsos, P. The Physics of Seismic Electric Signals; TERRAPUB: Tokyo, Japan, 2005. [Google Scholar]
- Varotsos, P.; Alexopoulos, K.; Lazaridou-Varotsou, M.; Nagao, T. Earthquake predictions issued in Greece by seismic electric signals since February 6, 1990. Tectonophysics
**1993**, 224, 269–288. [Google Scholar] [CrossRef] - Varotsos, P.; Eftaxias, K.; Lazaridou, M.; Nomicos, K.; Sarlis, N.; Bogris, N.; Makris, J.; Antonopoulos, G.; Kopanas, J. Recent earthquake prediction results in Greece based on the observation of Seismic Electric Signals. Acta Geophys. Pol.
**1996**, 44, 301–327. [Google Scholar] - Uyeda, S.; Kamogawa, M. The Prediction of Two Large Earthquakes in Greece. Eos Trans. Am. Geophys. Union
**2008**, 89, 362–363. [Google Scholar] [CrossRef] - Uyeda, S.; Kamogawa, M. Comment on ‘The Prediction of Two Large Earthquakes in Greece’. Eos Trans. Am. Geophys. Union
**2010**, 91, 162–163. [Google Scholar] [CrossRef] - Lazaridou-Varotsos, M.S. Earthquake Prediction by Seismic Electric Signals: The Success of the VAN Method Over Thirty Years; Springer Praxis Books: Berlin/Heidelberg, Germany, 2013. [Google Scholar]
- Uyeda, S.; Nagao, T.; Orihara, Y.; Yamaguchi, T.; Takahashi, I. Geoelectric potential changes: Possible precursors to earthquakes in Japan. Proc. Natl. Acad. Sci. USA
**2000**, 97, 4561–4566. [Google Scholar] [CrossRef] [PubMed] - Uyeda, S.; Hayakawa, M.; Nagao, T.; Molchanov, O.; Hattori, K.; Orihara, Y.; Gotoh, K.; Akinaga, Y.; Tanaka, H. Electric and magnetic phenomena observed before the volcano-seismic activity in 2000 in the Izu Island Region, Japan. Proc. Natl. Acad. Sci. USA
**2002**, 99, 7352–7355. [Google Scholar] [CrossRef] [PubMed] - Orihara, Y.; Kamogawa, M.; Nagao, T.; Uyeda, S. Independent component analysis of geoelectric field data in the northern Nagano, Japan. Proc. Jpn. Acad. Ser. B Phys. Biol. Sci.
**2009**, 85, 435–442. [Google Scholar] [CrossRef] [PubMed] - Uyeda, S.; Kamogawa, M.; Tanaka, H. Analysis of electrical activity and seismicity in the natural time domain for the volcanic-seismic swarm activity in 2000 in the Izu Island region, Japan. J. Geophys. Res.
**2009**, 114. [Google Scholar] [CrossRef] - Orihara, Y.; Kamogawa, M.; Nagao, T.; Uyeda, S. Preseismic anomalous telluric current signals observed in Kozu-shima Island, Japan. Proc. Natl. Acad. Sci. USA
**2012**, 109, 19125–19128. [Google Scholar] [CrossRef] [PubMed] - Uyeda, S.; Al-Damegh, E.; Dologlou, E.; Nagao, T. Some relationship between VAN seismic electric signals (SES) and earthquake parameters. Tectonophysics
**1999**, 304, 41–55. [Google Scholar] [CrossRef] - Sarlis, N.; Lazaridou, M.; Kapiris, P.; Varotsos, P. Numerical Model of the Selectivity Effect and ΔV/L criterion. Geophys. Res. Lett.
**1999**, 26, 3245–3248. [Google Scholar] [CrossRef] - Kondo, S.; Uyeda, S.; Nagao, T. The selectivity of the Ioannina VAN station. J. Geodyn.
**2002**, 33, 433–461. [Google Scholar] [CrossRef] - Orihara, Y.; Noda, Y.; Nagao, T.; Uyeda, S. A possible case of SES selectivity at Kozu-shima Island. J. Geodyn.
**2002**, 33, 425–432. [Google Scholar] [CrossRef] - Huang, Q.; Lin, Y. Selectivity of seismic electric signal (SES) of the 2000 Izu earthquake swarm: A 3D FEM numerical simulation model. Proc. Jpn. Acad. Ser. B Phys. Biol. Sci.
**2010**, 86, 257–264. [Google Scholar] [CrossRef] [PubMed] - Varotsos, P.; Alexopoulos, K.; Nomicos, K. Seismic Electric Currents. Practica of Athens Academy
**1981**, 56, 277–286. [Google Scholar] - Varotsos, P.; Sarlis, N.; Lazaridou, M.; Kapiris, P. Transmission of stress induced electric signals in dielectric media. J. Appl. Phys.
**1998**, 83, 60–70. [Google Scholar] [CrossRef] - Varotsos, P.; Sarlis, N.; Lazaridou, M. Transmission of stress induced electric signals in dielectric media. Part II. Acta Geophys. Pol.
**2000**, 48, 141–177. [Google Scholar] - Varotsos, P.; Sarlis, N.; Skordas, E. Transmission of stress induced electric signals in dielectric media. Part III. Acta Geophys. Pol.
**2000**, 48, 263–297. [Google Scholar] - Varotsos, P.V.; Sarlis, N.V.; Skordas, E.S. Electric Fields that “arrive” before the time derivative of the magnetic field prior to major earthquakes. Phys. Rev. Lett.
**2003**, 91, 148501. [Google Scholar] [CrossRef] [PubMed] - Sarlis, N.; Varotsos, P. Magnetic field near the outcrop of an almost horizontal conductive sheet. J. Geodyn.
**2002**, 33, 463–476. [Google Scholar] [CrossRef] - Skordas, E.; Sarlis, N. On the anomalous changes of seismicity and geomagnetic field prior to the 2011 9.0 Tohoku earthquake. J. Asian Earth Sci.
**2014**, 80, 161–164. [Google Scholar] [CrossRef] - Varotsos, P.; Sarlis, N.; Skordas, S.; Lazaridou, M. Additional evidence on some relationship between Seismic Electric Signals(SES) and earthquake focal mechanism. Tectonophysics
**2006**, 412, 279–288. [Google Scholar] [CrossRef] - Varotsos, P.A.; Sarlis, N.V.; Skordas, E.S.; Tanaka, H.K.; Lazaridou, M.S. Entropy of seismic electric signals: Analysis in the natural time under time reversal. Phys. Rev. E
**2006**, 73, 031114. [Google Scholar] [CrossRef] [PubMed] - Varotsos, P.A.; Sarlis, N.V.; Skordas, E.S. Detrended fluctuation analysis of the magnetic and electric field variations that precede rupture. Chaos
**2009**, 19, 023114. [Google Scholar] [CrossRef] [PubMed] - Ramírez-Rojas, A.; Telesca, L.; Angulo-Brown, F. Entropy of geoelectrical time series in the natural time domain. Nat. Hazards Earth Syst. Sci.
**2011**, 11, 219–225. [Google Scholar] [CrossRef] - Varotsos, P. A review and analysis of electromagnetic precursory phenomena. Acta Geophys. Pol.
**2001**, 49, 1–42. [Google Scholar] - Xu, G.; Han, P.; Huang, Q.; Hattori, K.; Febriani, F.; Yamaguchi, H. Anomalous behaviors of geomagnetic diurnal variations prior to the 2011 off the Pacific coast of Tohoku earthquake (Mw9.0). J. Asian Earth Sci.
**2013**, 77, 59–65. [Google Scholar] [CrossRef] - Han, P.; Hattori, K.; Xu, G.; Ashida, R.; Chen, C.H.; Febriani, F.; Yamaguchi, H. Further investigations of geomagnetic diurnal variations associated with the 2011 off the Pacific coast of Tohoku earthquake (Mw 9.0). J. Asian Earth Sci.
**2015**, 114, 321–326. [Google Scholar] [CrossRef] - Han, P.; Hattori, K.; Huang, Q.; Hirooka, S.; Yoshino, C. Spatiotemporal characteristics of the geomagnetic diurnal variation anomalies prior to the 2011 Tohoku earthquake (Mw 9.0) and the possible coupling of multiple pre-earthquake phenomena. J. Asian Earth Sci.
**2016**, 129, 13–21. [Google Scholar] [CrossRef] - Hayakawa, M.; Schekotov, A.; Potirakis, S.; Eftaxias, K. Criticality features in ULF magnetic fields prior to the 2011 Tohoku earthquake. Proc. Jpn. Acad. Ser. B Phys. Biol. Sci.
**2015**, 91, 25–30. [Google Scholar] [CrossRef] [PubMed] - Potirakis, S.M.; Karadimitrakis, A.; Eftaxias, K. Natural time analysis of critical phenomena: The case of pre-fracture electromagnetic emissions. Chaos
**2013**, 23, 023117. [Google Scholar] [CrossRef] [PubMed] - Potirakis, S.M.; Contoyiannis, Y.; Eftaxias, K.; Koulouras, G.; Nomicos, C. Recent Field Observations Indicating an Earth System in Critical Condition Before the Occurrence of a Significant Earthquake. IEEE Geosci. Remote Sens. Lett.
**2015**, 12, 631–635. [Google Scholar] [CrossRef] - Potirakis, S.M.; Contoyiannis, Y.; Melis, N.S.; Kopanas, J.; Antonopoulos, G.; Balasis, G.; Kontoes, C.; Nomicos, C.; Eftaxias, K. Recent seismic activity at Cephalonia (Greece): A study through candidate electromagnetic precursors in terms of non-linear dynamics. Nonlinear Process. Geophys.
**2016**, 23, 223–240. [Google Scholar] [CrossRef] - Potirakis, S.; Eftaxias, K.; Schekotov, A.; Yamaguchi, H.; Hayakawa, M. Criticality features in ultra-low frequency magnetic fields prior to the 2013 M6.3 Kobe earthquake. Ann. Geophys.
**2016**, 59, S0317. [Google Scholar] - De Gennes, P.G. Superconductivity of Metals and Alloys; Addison-Wesley: New York, NY, USA, 1966. [Google Scholar]
- Campbell, A.M.; Evetts, J.E. Flux vortices and transport currents in type II superconductors. Adv. Phys.
**2001**, 50, 1249. [Google Scholar] [CrossRef] - Altshuler, E.; Johansen, T.H. Colloquium: Experiments in vortex avalanches. Rev. Mod. Phys.
**2004**, 76, 471. [Google Scholar] [CrossRef] - Welling, M.S.; Aegerter, C.M.; Wijngaarden, R.J. Self-organized criticality induced by quenched disorder: Experiments on flux avalanches in NbH
_{x}films. Phys. Rev. B**2005**, 71, 104515. [Google Scholar] [CrossRef] - Sarlis, N.V.; Varotsos, P.A.; Skordas, E.S. Flux avalanches in YBa
_{2}Cu_{3}O_{7-x}films and rice piles: Natural time domain analysis. Phys. Rev. B**2006**, 73, 054504. [Google Scholar] [CrossRef] - Sarlis, N.; Skordas, E.; Varotsos, P. Similarity of fluctuations in systems exhibiting Self-Organized Criticality. EPL
**2011**, 96, 28006. [Google Scholar] [CrossRef] - Aegerter, C.M.; Welling, M.S.; Wijngaarden, R.J. Self-organized criticality in the Bean state in YBa
_{2}Cu_{3}O_{7-x}thin films. Europhys. Lett.**2004**, 65, 753. [Google Scholar] [CrossRef] - Aegerter, C.M.; Gunther, R.; Wijngaarden, R.J. Avalanche dynamics, surface roughening, and self-organized criticality: Experiments on a three-dimensional pile of rice. Phys. Rev. E
**2003**, 67, 051306. [Google Scholar] [CrossRef] [PubMed] - Aegerter, C.M.; Lőrincz, K.A.; Welling, M.S.; Wijngaarden, R.J. Extremal dynamics and the approach to the critical state: Experiments on a three dimensional pile of rice. Phys. Rev. Lett.
**2004**, 92, 058702. [Google Scholar] [CrossRef] [PubMed] - De Sousa Vieira, M. Simple deterministic self-organized critical system. Phys. Rev. E
**2000**, 61, R6056–R6059. [Google Scholar] [CrossRef] - Davidsen, J.; Schuster, H.G. Simple model for 1/f
^{α}noise. Phys. Rev. E**2002**, 65, 026120. [Google Scholar] [CrossRef] [PubMed] - Ramos, O.; Altshuler, E.; Måløy, K.J. Quasiperiodic Events in an Earthquake Model. Phys. Rev. Lett.
**2006**, 96, 098501. [Google Scholar] [CrossRef] [PubMed] - Burridge, R.; Knopoff, L. Model and theoretical seismicity. Bull. Seismol. Soc. Am.
**1967**, 57, 341–371. [Google Scholar] - Braun, O.M.; Barel, I.; Urbakh, M. Dynamics of Transition from Static to Kinetic Friction. Phys. Rev. Lett.
**2009**, 103, 194301. [Google Scholar] [CrossRef] [PubMed] - Ben-David, O.; Rubinstein, S.M.; Fineberg, J. Slip-stick and the evolution of frictional strength. Nature
**2010**, 463, 76–79. [Google Scholar] [CrossRef] [PubMed] - Helmstetter, A.; Hergarten, S.; Sornette, D. Properties of foreshocks and aftershocks of the nonconservative self-organized critical Olami–Feder–Christensen model. Phys. Rev. E
**2004**, 70, 046120. [Google Scholar] [CrossRef] [PubMed] - De Carvalho, J.X.; Prado, C.P.C. Self-Organized Criticality in the Olami–Feder–Christensen Model. Phys. Rev. Lett.
**2000**, 84, 4006–4009. [Google Scholar] [CrossRef] [PubMed] - Miller, G.; Boulter, C.J. Measurements of criticality in the Olami–Feder–Christensen model. Phys. Rev. E
**2002**, 66, 016123. [Google Scholar] [CrossRef] [PubMed] - Pérez, C.J.; Corral, A.; Díaz-Guilera, A.; Christensen, K.; Arenas, A. On Self-Organized Criticality and Synchronization in Lattice Models of Coupled Dynamical Systems. Int. J. Mod. Phys. B
**1996**, 10, 1111–1151. [Google Scholar] [CrossRef] - Mousseau, N. Synchronization by Disorder in Coupled Systems. Phys. Rev. Lett.
**1996**, 77, 968–971. [Google Scholar] [CrossRef] [PubMed] - Jánosia, I.M.; Kertész, J. Self-organized criticality with and without conservation. Physica A
**1993**, 200, 179–188. [Google Scholar] [CrossRef] - Ceva, H. Influence of defects in a coupled map lattice modeling earthquakes. Phys. Rev. E
**1995**, 52, 154–158. [Google Scholar] [CrossRef] - Varotsos, P.; Alexopoulos, K. Current Methods of Lattice Defect Analysis Using Dilatometry and Self-Diffusion. Critical Review and Proposals. Physica Status Solidi (b)
**1982**, 110, 9–31. [Google Scholar] [CrossRef] - Varotsos, P.; Alexopoulos, K. Calculation of the migration volume of vacancies in ionic solids from macroscopic parameters. Physica Status Solidi (a)
**1978**, 47, 133–136. [Google Scholar] [CrossRef] - Kostopoulos, D.; Varotsos, P.; Mourikis, S. The conductivity of crystalline NaI. Can. J. Phys.
**1975**, 53, 1318–1320. [Google Scholar] [CrossRef] - Varotsos, P. Point defect parameters in β-PbF
_{2}revisited. Solid State Ionics**2008**, 179, 438–441. [Google Scholar] [CrossRef] - Varotsos, P.; Alexopoulos, K.; Nomicos, K. Comments on the pressure variation of the Gibbs energy for bound and unbound defects. Physica Status Solidi (b)
**1982**, 111, 581–590. [Google Scholar] [CrossRef] - Peixoto, T.P.; Davidsen, J. Network of recurrent events for the Olami–Feder–Christensen model. Phys. Rev. E
**2008**, 77, 066107. [Google Scholar] [CrossRef] [PubMed] - Pepke, S.L.; Carlson, J.M. Predictability of self-organizing systems. Phys. Rev. E
**1994**, 50, 236–242. [Google Scholar] [CrossRef] - Hergarten, S.; Neugebauer, H.J. Foreshocks and Aftershocks in the Olami–Feder–Christensen Model. Phys. Rev. Lett.
**2002**, 88, 238501. [Google Scholar] [CrossRef] [PubMed] - Wissel, F.; Drossel, B. Transient and stationary behavior of the Olami–Feder–Christensen model. Phys. Rev. E
**2006**, 74, 066109. [Google Scholar] [CrossRef] [PubMed] - Lise, S.; Paczuski, M. Self-organized criticality and universality in a nonconservative earthquake model. Phys. Rev. E
**2001**, 63, 036111. [Google Scholar] [CrossRef] [PubMed] - Gutenberg, B.; Richter, C.F. Magnitude and energy of earthquakes. Ann. Geophys.
**1956**, 9, 1–15. [Google Scholar] - Rundle, J.B.; Turcotte, D.L.; Shcherbakov, R.; Klein, W.; Sammis, C. Statistical physics approach to understanding the multiscale dynamics of earthquake fault systems. Rev. Geophys.
**2003**, 41, 1019. [Google Scholar] [CrossRef] - Kanamori, H. Quantification of Earthquakes. Nature
**1978**, 271, 411–414. [Google Scholar] [CrossRef] - Bach, M.; Wissel, F.; Drossel, B. Olami–Feder–Christensen model with quenched disorder. Phys. Rev. E
**2008**, 77, 067101. [Google Scholar] [CrossRef] [PubMed] - Lippiello, E.; Godano, C.; de Arcangelis, L. Dynamical Scaling in Branching Models for Seismicity. Phys. Rev. Lett.
**2007**, 98, 098501. [Google Scholar] [CrossRef] [PubMed] - Lippiello, E.; de Arcangelis, L.; Godano, C. Influence of Time and Space Correlations on Earthquake Magnitude. Phys. Rev. Lett.
**2008**, 100, 038501. [Google Scholar] [CrossRef] [PubMed] - Bottiglieri, M.; de Arcangelis, L.; Godano, C.; Lippiello, E. Multiple-Time Scaling and Universal Behavior of the Earthquake Interevent Time Distribution. Phys. Rev. Lett.
**2010**, 104, 158501. [Google Scholar] [CrossRef] [PubMed] - Lippiello, E.; Godano, C.; de Arcangelis, L. The earthquake magnitude is influenced by previous seismicity. Geophys. Res. Lett.
**2012**, 39, L05309. [Google Scholar] [CrossRef] - Lennartz, S.; Bunde, A.; Turcotte, D.L. Modelling seismic catalogues by cascade models: Do we need long-term magnitude correlations? Geophys. J. Int.
**2011**, 184, 1214–1222. [Google Scholar] [CrossRef] - Hergarten, S.; Krenn, R. Synchronization and desynchronization in the Olami–Feder–Christensen earthquake model and potential implications for real seismicity. Nonlinear Process. Geophys.
**2011**, 18, 635–642. [Google Scholar] [CrossRef] - Bonachela, J.A.; Mũnoz, M.A. Self-organization without conservation: True or just apparent scale-invariance? J. Stat. Mech. Theory Exp.
**2009**, 2009, P09009. [Google Scholar] [CrossRef] - Yang, X.; Du, S.; Ma, J. Do Earthquakes Exhibit Self-Organized Criticality? Phys. Rev. Lett.
**2004**, 92, 228501. [Google Scholar] [CrossRef] [PubMed] - Sarlis, N.; Skordas, E.; Varotsos, P. The change of the entropy in natural time under time-reversal in the Olami–Feder–Christensen earthquake model. Tectonophysics
**2011**, 513, 49–53. [Google Scholar] [CrossRef] - Varotsos, P.A.; Sarlis, N.V.; Skordas, E.S.; Tanaka, H.K.; Lazaridou, M.S. Attempt to distinguish long-range temporal correlations from the statistics of the increments by natural time analysis. Phys. Rev. E
**2006**, 74, 021123. [Google Scholar] [CrossRef] [PubMed] - Varotsos, P.A. What happened before the last five strong earthquakes in Greece. Proc. Jpn. Acad. Ser. B Phys. Biol. Sci.
**2006**, 82, 86–91. [Google Scholar] [CrossRef] [PubMed] - Varotsos, P.A.; Sarlis, N.V.; Skordas, E.S.; Lazaridou, M.S. Fluctuations, under time reversal, of the natural time and the entropy distinguish similar looking electric signals of different dynamics. J. Appl. Phys.
**2008**, 103, 014906. [Google Scholar] [CrossRef] - Vallianatos, F.; Michas, G.; Papadakis, G. Non-extensive and natural time analysis of seismicity before the Mw6.4, October 12, 2013 earthquake in the South West segment of the Hellenic Arc. Physica A
**2014**, 414, 163–173. [Google Scholar] [CrossRef] - Vallianatos, F.; Michas, G.; Hloupis, G. Multiresolution wavelets and natural time analysis before the January–February 2014 Cephalonia (Mw6.1 & 6.0) sequence of strong earthquake events. Phys. Chem. Earth Parts A/B/C
**2015**, 85–86, 201–209. [Google Scholar] - Varotsos, P.A.; Sarlis, N.V.; Skordas, E.S. Seismic Electric Signals and 1/f noise in natural time. arXiv, 2007; arXiv:0711.3766v3. [Google Scholar]
- Sarlis, N.V.; Skordas, E.S.; Lazaridou, M.S.; Varotsos, P.A. Investigation of seismicity after the initiation of a Seismic Electric Signal activity until the main shock. Proc. Jpn. Acad. Ser. B Phys. Biol. Sci.
**2008**, 84, 331–343. [Google Scholar] [CrossRef] [PubMed] - Goldberger, A.L.; Amaral, L.A.N.; Glass, L.; Hausdorff, J.M.; Ivanov, P.C.; Mark, R.G.; Mictus, J.E.; Moody, G.B.; Peng, C.K.; Stanley, H.E. PhysioBank, PhysioToolkit, and PhysioNet—Components of a new research resource for complex physiologic signals. Circulation
**2000**, 101, E215. [Google Scholar] [CrossRef] [PubMed] - Varotsos, C.; Tzanis, C. A new tool for the study of the ozone hole dynamics over Antarctica. Atmos. Environ.
**2012**, 47, 428–434. [Google Scholar] [CrossRef] - Varotsos, C.A.; Tzanis, C.; Cracknell, A.P. Precursory signals of the major El Niño Southern Oscillation events. Theor. Appl. Climatol.
**2016**, 124, 903–912. [Google Scholar] [CrossRef] - Varotsos, C.; Tzanis, C. A new El Niño-Southern Oscillation forecasting tool based on Southern Oscillation Index. Atmos. Chem. Phys. Discuss.
**2012**, 12, 17443–17463. [Google Scholar] [CrossRef] - Varotsos, C.A.; Tzanis, C.G.; Sarlis, N.V. On the progress of the 2015–2016 El Niño event. Atmos. Chem. Phys.
**2016**, 16, 2007–2011. [Google Scholar] [CrossRef] - Varotsos, C.A.; Tzanis, C.G.; Sarlis, N.V. On the progress of the 2015–2016 El Niño event. Atmos. Chem. Phys. Discuss.
**2015**, 15, 35787–35797. [Google Scholar] [CrossRef] - Varotsos, P.A.; Sarlis, N.V.; Skordas, E.S.; Lazaridou, M.S. Seismic Electric Signals: An additional fact showing their physical interconnection with seismicity. Tectonophysics
**2013**, 589, 116–125. [Google Scholar] [CrossRef] - Tanaka, H.K.; Varotsos, P.A.; Sarlis, N.V.; Skordas, E.S. A plausible universal behaviour of earthquakes in the natural time-domain. Proc. Jpn. Acad. Ser. B Phys. Biol. Sci.
**2004**, 80, 283–289. [Google Scholar] [CrossRef] - Papasimakis, N.; Pallikari, F. Correlated and uncorrelated heart rate fluctuations during relaxing visualization. EPL
**2010**, 90, 48003. [Google Scholar] [CrossRef]

**Figure 1.**How a time series of (

**a**) dichotomous (e.g., zero or one) electric signals, (

**b**) earthquakes [18], (

**c**) avalanches in 3D rice piles [19,20], (

**d**) an ECG (for the so-called QT intervals), (

**e**) a not obviously dichotomous electric (or magnetic) signal and (

**f**) monthly Southern Oscillation Index (SOI) [21] values can be visualized in natural time. The meaning of the symbols, as well as the mathematical details for each case are discussed in Section 5.

**Figure 2.**Important properties of the entropy in natural time S and the entropy in natural time under time reversal ${S}_{-}$: in both panels, a signal consisting of 84 pulses is analyzed in natural time; the green and blue lines indicate the values (left scale) of S (green) and ${S}_{-}$ (blue) obtained for each $N(=10,11,12,\dots ,84)$. The signal is composed from 80 pulses of equal energy and four pulses, which are ten-times stronger (right scale, arbitrary units). In the upper panel, the stronger pulses are emitted periodically, while in the lower panel, consecutively in the middle of the process. Although the Shannon entropies for both panels are equal, the entropies in natural time S are different in each panel. Moreover, when using the entropy in natural time under time reversal ${S}_{-}$, we obtain values that are in general different from those of S.

**Figure 3.**Results from averaging the last 1000 events before a large avalanche ($s\ge $ 1000, occurring at ${T}_{0}$) in the Olami–Feder–Christensen (OFC) model with $L=$100 and $K=2$: the change $\mathrm{\Delta}S$ (left scale) of the entropy in natural time under time reversal and the mean energy $\zeta \equiv {\sum}_{i=1}^{L}{\sum}_{j=1}^{L}{z}_{ij}/{L}^{2}$ (right scale) as a function of the “time” (${T}_{0}-T$) to the large avalanche. Note that $\mathrm{\Delta}S$ minimizes before the occurrence time ${T}_{0}$ of the large avalanche and changes sign when $\zeta $ starts to increase.

**Figure 4.**The values (left scale) of ${\kappa}_{1}$ (red circles), S (blue lines) and ${S}_{-}$ (cyan lines) obtained from the study of seismicity within the region N${}_{36.0}^{38.6}$E${}_{20.0}^{22.5}$, estimated on 1 February 2008 by [121] that it will suffer a strong earthquake based on a seismic electric signal (SES) recorded on 14 January 2008 (see Figure 2(c) of [122]), after discarding the two events (earthquakes) that were related to another SES activity [122]. The black sticks correspond to the magnitude ${M}_{L}\left(ATH\right)$ (right scale) reported by the Geodynamical Institute of the National Observatory of Athens for each small earthquake. The horizontal red and blue lines correspond to 0.07 and ${S}_{u}$, respectively.

**Figure 5.**The entropy change $\mathrm{\Delta}{S}_{20}$ in natural time for the window length l = 20 months (red line, left scale) along with SOI monthly values (blue line, right scale) for the period January 2014–March 2016. The alarm is set on (black line) when $\mathrm{\Delta}{S}_{20}$ exceeds the threshold value $\mathrm{\Delta}{S}_{thres}=0.0035$ (red horizontal line). The selection of the threshold can be seen in Figure 2 of [127] and has been made as a compromise between the costs of false positive and false negative predictions. The two colored horizontal stripes represent the mean minimum negative values of SOI along with the one standard deviation bands for the two cases of “weak, weak to moderate, moderate, moderate to strong” (green band) and “strong, very strong” (yellow band) El Niño events [127].

**Figure 6.**PDF of $\mathrm{\Delta}{S}_{20}$ (blue curve, left scale) together with the corresponding histogram (red bars, left scale) obtained from the time series of $\mathrm{\Delta}{S}_{20}$, which is also plotted versus time (green crosses, right scale) along the vertical axis. The arrows indicate when $\mathrm{\Delta}{S}_{20}$ exceeds 0.0205 and are labeled by the corresponding ongoing strong El Niño events. Taken from [127].

© 2017 by the author. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).