This section initially presents the equations for Lorenz’s error growth models and analyze both nonlinear and linear relative growth rates. This section proceeds to discuss the CDIC within the logistic ODE and showcase chaotic solutions using the logistic map. Furthermore, this section derives relationships between the logistic ODE and the non-dissipative Lorenz model and evaluate the solutions of a variant of the logistic ODE aimed at establishing a finite predictability horizon.
2.1. Lorenz’s Error Growth Models
Here, this subsection provides a brief summary of Lorenz’s error growth models proposed in 1969 (Lorenz 1969a [
1] ). The first and most popular of these models is a first-order ODE featuring a linear term and a quadratic term, presented as follows:
Traditionally, the dependent variable
u represents the root mean square (RMS) difference or errors (Lorenz 1982 [
7]). The above equation is indeed the logistic ODE. Give the initial condition (IC)
, the corresponding solution to Equation (
1) is:
which is known as the S-shaped sigmoid function.
Figure 1 displays the sigmoid function. To facilitate discussions,
and
are used.
By comparison, the second of Lorenz’s error growth models incorporates a cubic term, instead of a quadratic term, which can be expressed as follows:
A major difference between Equations (
1) and (
3) is that the number of critical points is different. Their discrete versions (i.e., quadratic and cubic maps) may produce different results, which is beyond the scope of this study (Shen et al., 2023 [
21]). However, by choosing
it can be shown that Equation (
3) can be transformed into the same form as Equation (
1). This analysis indicates the mathematical relationship between the error growth models with quadratic and cubic hypotheses. However, a direct comparison of Equations (
1) and (
3) indicates the same saturated value but different initial relative growth rates. If one would like to have the same initial relative growth rate for both the quadratic and cubic hypotheses, two different saturated values should be used. Below, this report focuses on the analysis of the logistic ODE, its solutions, linear and nonlinear growth rates, and its relationship to the logistic map and the non-dissipative Lorenz 1963 model.
2.2. Nonlinear and Linear Relative Growth Rates
Predictability horizons have been a key area of study in real-world weather and climate forecasts and nonlinear chaotic dynamics. Common methods for assessing predictability horizons include (1) analyzing growth rates, (2) performing stability analysis of critical points, and (3) calculating Lyapunov exponents (e.g., Shen 2014, 2019 [
22,
23]), which indicate the long-term average rate of divergence among nearby trajectories. Here, leveraging its analytical solution, differences between nonlinear and linear growth rates and discuss their connections to Lyapunov exponents are illustrated. The growth rate from Equation (
1) can be computed as follows:
The left hand side of Equation (
5) defines a relative growth rate. By substituting the analytical solution of Equation (
2) into the right-hand side of Equation (
5), the temporal evolution of growth rates is depicted in
Figure 2a. Here, a numerical solution of growth rates using a finite difference method is also provided for comparison. Both analytical and numerical calculations show good agreement.
Starting from small positive initial values, the evolution of growth rates unfolds through three distinct phases:
- (1)
An initial linear increase driven by the equation’s linear term;
- (2)
A reduction in growth rate moderated by the equation’s nonlinear component as the error expands; and
- (3)
A leveling off at a constant error level.
These stages—linear increase, moderated growth, and saturation—are consistently observed in various real-world and idealized models (e.g., Shen 2020 [
3]). Both initial growth rates (e.g., doubling times) and saturated RMS errors are utilized to determine predictability horizons (e.g., Lorenz 1969a [
1]; Zhang et al., 2019 [
11]). The results are referred to as nonlinear growth rates.
Below, to contrast with the nonlinear growth rates, this report presents the linear growth rates. Initially, the variation equation is written as follows:
which describes how perturbations evolve along a trajectory. The above equation leads to the following expression for the linear growth rate:
Similar to the method used for calculating nonlinear growth rates, by inserting the analytical solution from Equation (
2) into the right-hand side of Equation (
7), this entry displays the temporal evolution of linear growth rates in
Figure 2b. Here, results display a transition from an unstable point with local, positive, nearly constant growth rates to a stable point with local, negative, nearly constant growth rates (Paxson and Shen 2022 [
13]). The observed dynamics, characterized by what is known as heteroclinic behavior (e.g., Balmforth, 1995 [
24]), align with the stability analysis of the two critical points at
and
. As discussed below in the context of the relationship between the logistic ODE and the non-dissipative Lorenz model, this characteristic is indeed associated with a homoclinic orbit that connects unstable and stable manifolds within a two-dimensional phase space.
The linear growth rates discussed above are compared by calculations using two nearby trajectories. From the analytical solution in Equation (
2), this study computes two solutions, designated as control and parallel runs:
subject to the initial conditions
and
, respectively. Hence, the parallel run represents the solution to the system with a tiny initial perturbation (
) from the control run. Therefore, the growth rates can be computed using the following formula:
As shown in
Figure 2b, these numerical results align with those obtained using the variation equation in Equation (
7), confirming that Equation (
7) accurately represents the local divergence rate of two nearby trajectories. Consequently, the long-term average of the linear growth rates is negative, consistent with the calculation of the Lyapunov exponent.
This section discusses both nonlinear and linear growth rates within the logistic ODE framework. Initially, their time evolutions are similar during the linear phase, yet differ during the nonlinear phase. A thorough analysis comparing these two types of growth rates and their impact on predictability estimates is outside the scope of this report. Readers interested in this subject may refer to the works of Chen et al. (2006) [
25], Ding and Li (2007) [
26], and Ding et al. (2017) [
27].
2.3. The Logistic ODE and Continuous Dependence on ICs (CDIC)
A chaotic system is characterized by two key features: one or more positive (global) Lyapunov exponents (LE) and solution boundedness. The global Lyapunov exponent represents the long-term average of local growth rates. Upon calculating an initial growth rate (for a linear system) and the Lyapunov exponent (for a nonlinear system), predictability horizons can be estimated using the following ODE:
In this equation, X denotes error, and represents either the initial color red relative growth rate or LE.
As illustrated in Strogatz (2015) [
28] on page 330, the formula for estimating predictability is expressed as:
where
denotes the deviation between two initially nearby trajectories,
is the initial discrepancy, and
is the Lyapunov exponent. This is a solution to Equation (
11). Assuming
as the threshold beyond which predictions are deemed unreliable, the time scale of predictability (
) is effectively inverse to the Lyapunov exponent:
However, global, finite-time, and local Lyapunov exponents exhibit differences, which have been extensively explored in our papers since 2011 (e.g., Shen 2014, 2019 [
21,
22]). As emphasized by Shen et al. (2021) [
29] and supported by other references, a global positive exponent may correlate with time-varying local Lyapunov exponents (i.e., time-varying local growth rates), indicating the dependence of distinct predictability limits on initial conditions (Slingo and Palmer 2011 [
30]; Nese 1989 [
31]; Zeng et al., 1993 [
32]). As a result, while the presence of a global Lyapunov exponent may suggest finite predictability in chaotic systems, its averaged properties cannot effectively establish an upper bound on predictability.
As a result, since Equation (
11) with
does not account for time-varying growth rates (i.e., sensitive dependence of solutions on initial condition, SDIC), results produced by the system should be interpreted with caution. This interpretation is supported by personal communication via emails with Prof. Strogatz on 3 February 2022 [
33].
It is important to note that the above solution (and its corresponding ODE, Equation (
11)) includes an unstable asymptotic value at
, meaning
when
. As discussed in
Section 2.6, this characteristic suggests a continuous increase in the predictability horizon by reducing initial errors. Therefore, the validity of Equation (
11) in demonstrating finite predictability is questionable.
Although an in-depth discussion of the above method for chaotic systems exceeds the scope of this study, our focus remains on the application of the logistic ODE to estimate predictability horizons.
The solution to the logistic equation is an S-shaped sigmoid function. The zero state (backward in time) and saturation value (forward in time) are only asymptotically reachable. Such a feature suggests that predictability horizons can be extended continuously by reducing initial errors or applying larger thresholds. A simple illustration is provided here.
In
Figure 1, four points,
A,
B,
C, and
D, indicate locations for the values of
0.001, 0.1, 0.9, and 0.999, respectively. Points
A and
B can be considered as initial conditions for errors, while points
C and
D may serve as upper thresholds. Consequently, the time span between an initial value and a threshold defines a predictability horizon.
Given the same initial error at point
A (or
B), the durations to reach points
C and
D vary, illustrating how predictability horizons depend on chosen thresholds. Conversely, with the same threshold at point
C (or
D), the intervals from
A to
C and from
B to
C are different, indicating that predictability horizons also depend on the magnitude of the initial conditions. This characteristic relates to the continuous dependence of solutions on the initial condition (CDIC). Therefore, in scenarios using either Equation (
1) or the simplified ODE in Equation (
11), the CDIC feature implies that predictability horizons may be incrementally extended through continual refinement of initial conditions.
2.4. The Logistic Map and Chaotic Solutions
While the Logistic ODE generates regular solutions, its discrete counterpart has yielded intriguing outcomes (Lorenz 1964 [
14]; May 1976 [
16]; Li and Yorke 1975 [
17]). The following discussions explore the relationship between the continuous and discrete versions. By employing a forward finite difference scheme, one can transform Equation (
1) into:
yielding:
By defining a new variable and a new parameter
Equation (
13) becomes:
which is the logistic map.
Table 1 lists both the logistic ODE and logistic map.
Figure 3 presents solutions for three different values of
1.8, 2.0, and 2.6 using Equation (
13). While the steady-state solution in the first panel is also reflected by the continuous version of the logistic equation, the periodic and irregular solutions observed in the second and third panels are absent from the logistic ODE. The appearance of the periodic solution in the second panel is termed period doubling. As the parameter increases up to 3, period doubling recurs repeatedly. At
2.56994567 (i.e.,
3.56994567), the period doublings become infinite, yielding a chaotic solution (Wikipedia:
https://en.wikipedia.org/wiki/Logistic_map#Period-doubling_route_to_chaos (accessed on 1 May 2024) ).
2.5. The Logistic ODE and the Non-Dissipative Lorenz Model (NLM)
As previously mentioned, the solution to the logistic ODE is the sigmoid function, which starts at zero and approaches a saturated value (namely, the one in this case). By examining the relationship between the sigmoid function and the hyperbolic tangent function, and revealing the derivative of the hyperbolic tangent function as a solitary wave solution, this study explores the derivation of the Z-component of the non-dissipative Lorenz 1963 model from the logistic ODE (Shen 2018; 2020 [
2,
3]).
Squaring a term on the right-hand side of Equation (
1) yields:
The above equation suggests that the introduction of the following new variable
leads to
It can be shown that the solution to the above equation is a hyperbolic tangent function:
Second, based on Equation (
18), one can define a variable
Z as the derivative of the solution
w:
which is a hyperbolic secant squared function. Through straightforward derivations, a second-order ODE for
Z can be obtained, as follows:
which can be rewritten as follows:
The above is mathematically identical to the KdV-SIR equation (e.g., Equation (
17) of Paxson and Shen 2022 [
13]), producing a solitary wave solution with an amplitude maximum of
. From Equation (
17)b of Paxson and Shen (2022) [
13], the solution to Equation (
22) is written as follows:
A solitary wave is described by one peak with long tails, indicated by:
Figure 4 displays the solitary wave solution in Equation (
23) and its relationship to the hyperbolic tangent and sigmoid functions. The above establishes a connection between the S-shaped solution in the logistic ODE and the solitary/homoclinic solutions within the non-dissipative Lorenz model. Note that the non-dissipative Lorenz model, with additional constants different from the constraint conditions in Equation (
24), includes two types of oscillatory solutions and two homoclinic orbits (Shen 2018, 2020 [
2,
3]). Currently, the study has not made efforts to derive an error growth model for all of the solutions within the non-dissipative Lorenz model.
In
Table 2, various second-order ODEs contain common features, including a second derivative, a linear term, and a quadratic term characterized by two coefficients (such as
a and
b with
). As these equations involve one independent variable and one dependent variable, systems with such coefficient pairings can be transformed to become equivalent. As a result, Equation (
22) is precisely equivalent to the
Z-component of the non-dissipative Lorenz 1963 model. It is observed that the
X-component of the non-dissipative Lorenz 1963 model, which includes a cubic term, is mathematically identical to the inviscid Pedlosky model (Pedlosky 1971 [
34]). By introducing a new variable
Q (where
), the inviscid Pedlosky model can be transformed to match the form of Equation (
21).
Table 1 provides a summary of the logistic ODE, logistic map, and the non-dissipative Lorenz 1963 model.
2.6. A Variant of the Logistic ODE for a Finite Predictability Horizon
From the original logistic ODE in Equation (
1), two critical points at
and
indicate two asymptotic values: an unstable asymptotic value at
and a stable asymptotic value at
. As a result of the asymptotic features, approaching the zero value (backward in time) and the saturated value (forward in time), it is evident that the predictability horizon can be continuously extended by reducing the initial errors or adjusting the thresholds. Thus, how can one construct an error growth model to reveal a finite interval between the initial errors and the thresholds? To do so, both values must be chosen differently from the asymptotic values. For example, from
Figure 1, a threshold value of 0.6 can be selected, which is away from the stable asymptotic value of 1. Additionally, as shown in
Figure 4, the unstable asymptotic value can be shifted to a negative value, ensuring that zero error occurs at a finite time. This concept is further discussed below.
Consider the following ODE (Dalcher and Kalnay, 1987 [
36]; Kalnay 2003) [
10]:
subject to the initial condition
where
,
b, and
are constants. Relative to Equation (
1), Equation (
25) introduces an additional parameter
b, which is essential for establishing a finite predictability horizon, as detailed below. As discussed below, the above ODE introduces a new term
b that not only changes growth rates but also shifts the unstable asymptotic value to become negative.
The solution to the above ODE and initial condition is written as follows:
where
The solution possesses the following features:
- (1)
When , . This is a stable asymptotic value.
- (2)
When , . This represents an unstable asymptotic value, which is less than zero.
- (3)
When
,
. This solution is the same as Equation (
2) within the original logistic ODE.
These results are also consistent with the critical point analysis, showing critical points at
and
. Based on the discussion for the logistic ODE in
Section 2.2, the variation equation for the revised logistic ODE indicates local growth rate of
and
near the critical points
and
, respectively.
The above results are also presented in
Figure 5 under the initial condition
.
Figure 5a shows solutions for three different values of
b:
,
, and
. The solution with
closely aligns with the solution in Equation (
2). From the figure and the solution in Equation (
27), the parameter affects growth rates. Additionally, the parameter
b alters the unstable asymptotic value. Consequently, the time intervals between the initial value
and
vary, with larger values of
b resulting in shorter time intervals (
Figure 5b). This indicates that the revised logistic ODE in Equation (
25) with a non-zero
b can effectively illustrate the finite time interval.