1. Introduction
Our research delves into a specific type of second-order initial value problem (IVP), characterized by the following equation:
where
Notably,
does not appear explicitly in (
1).
The Numerov method is a well-established numerical technique for advancing the solution from
to
. Its formula is given by the following:
where
with
.
Pioneers such as Hairer [
1], Cash [
2], and Chawla [
3] introduced hybrid implicit Numerov-type methods approximately 40–45 years ago. These methods utilized off-grid points and addressed the challenge of P-stability, which is crucial for stiff oscillatory problems. Later, Chawla [
4] proposed a modified explicit Numerov scheme:
where
h is the constant step size:
The vectors
approximate
, respectively, while the stages
represent the function evaluations used by the method. We leverage the information at the grid:
Given that is calculated in the previous step, only and need to be evaluated at each step, resulting in just two function evaluations per step.
Following this, Tsitouras developed a technique drawing inspiration from Runge–Kutta–Nyström (RKN) methods [
5], which significantly reduced computational overhead. As a result, only four steps are required to construct a sixth-order method, whereas earlier approaches necessitated six function evaluations (see [
6]). Building upon this progress, our research group has extensively explored this topic. Tsitouras developed eighth-order methods that require nine steps per iteration in [
7], and concurrently, a team of Spanish researchers conducted notable studies on similar problems [
8,
9,
10].
A distinction must be made between the term “second-order initial value problem”, which signifies the presence of , and the algebraic order of a numerical scheme, which defines its degree of precision.
Despite these advancements, current numerical methods often struggle with efficiency when applied to differential equations with oscillatory behavior. Our work addresses this limitation by optimizing the step-length adjustment in a ninth-order Numerov-type method, thereby considerably enhancing computational performance.
Here, we present a ninth-order Numerov-type approach that uniquely integrates a variable step-length algorithm, substantially improving computational efficiency for solving second-order IVPs with oscillatory behavior. This study aims to introduce a novel method specifically designed to better handle problems with periodic solutions. Traditionally, various characteristics of a basic test equation are utilized for this purpose; our innovation involves fine-tuning the free parameters across a broad range of relevant problems. Differential evolution is employed for this optimization, and we anticipate that this strategy will yield a method exceptionally well-suited for oscillatory challenges.
The main contributions of this work are as follows:
The construction of a ninth-order two-step method with variable step lengths, tailored for second-order oscillatory problems;
The development of an embedded error estimation mechanism enabling efficient step-size control through symbolic interpolation;
A detailed Mathematica implementation that facilitates symbolic order verification and adaptive logic; and (iv) numerical evidence demonstrating the method’s practical advantages in terms of accuracy and computational efficiency on classical orbital problems such as the Kepler and Arenstorf systems.
2. Derivation of Hybrid Numerov Methods
To address the given problem via advanced algebraic methodologies, we first express the independent parameter
t as a component of
. Consequently, without any loss of generality, we concentrate on the autonomous formulation:
A blended Numerov algorithm utilizing
s stages (as delineated in [
7]) is formulated as follows:
where
denotes the identity matrix, and
,
, and
signify the coefficient matrices of the approach, with the following:
To delineate these coefficients, we employ the Butcher tableau [
11,
12]:
Since the function assessments are conducted in a sequential manner, these techniques are explicit, implying that
A is a strictly lower triangular matrix. For the scenario where
, the matrices assume the following configuration:
Since we assumed the following above:
the associated matrices take the following form:
and
Since
is derived from the preceding iteration, only seven function evaluations are required per step. To attain an algebraic order of eight, it is crucial to eliminate the corresponding truncation error components (refer to [
13]).
The proposed technique comprises a total of 34 parameters. As previously highlighted, there exist 27 coefficients associated with the matrix
A, explicitly:
Furthermore, 4 coefficients correspond to the vector
b, while 3 components belong to the vector
c. The total number of order conditions at different accuracy levels aligns with those of Runge–Kutta–Nyström techniques, as illustrated in
Table 1. To obtain ninth-order precision, a total of
equations must be fulfilled. Conditions extending to the ninth order can be found in several tables within [
13].
Since the number of available parameters is insufficient to match the number of governing equations—a difficulty similar to that encountered in the formulation of Runge–Kutta (RK) schemes—specific simplifying assumptions must be imposed. These reductions decrease the number of constraints, thereby minimizing the number of coefficients. Frequently employed simplifications include the following:
where
and
For indices satisfying
, the notation
is employed.
The additional order constraints are compiled in
Table 2. Within this table, the notation “*” represents element-wise multiplication:
This operation has lower precedence, meaning that parentheses, exponentiation, and dot products are always evaluated before applying “*”.
Thus, we arrive at a nonlinear system consisting of 23 equations involving 23 unknown coefficients. For an in-depth discussion on deriving truncation error coefficients, the extensive review in [
13] provides valuable insights. Coleman [
14] highlighted the significance of the B2 series framework in analyzing the local truncation error, establishing links with T2 rooted tree structures.
To tackle this challenge, we adopt the differential evolution algorithm [
15,
16]. Differential evolution operates as an iterative optimization strategy where, at each iteration—termed generation
—a “population” of candidate solutions is maintained, denoted as
, for
, with
N representing the population size. Initially, a starting population
, for
, is randomly generated. The fitness function used for evaluation is defined as follows:
which quantifies the residuals for the 23 governing equations listed in
Table 2. Each candidate in the initial population is assessed based on this function, with the objective of minimizing its value.
Every iteration g involves a structured three-step process to refine each candidate solution. These phases include the following:
Mutation (Differentiation): Generating a new potential candidate based on variations within the existing population.
Crossover: Recombining individuals to introduce diversity.
Selection: Retaining the fittest individuals for the subsequent generation.
For implementation, we employed the DeMat software [
17] within the MATLAB environment [
18], which incorporates this evolutionary strategy. Since a single execution does not guarantee optimal results, we conducted several hundred runs of the optimization process to ensure convergence to a viable solution. The obtained result was then further refined to greater accuracy using multi-precision arithmetic, employing the
NMinimize function in
Mathematica [
19].
3. Variable Step Implementation
To establish a variable step-size algorithm, it is necessary to devise an error estimator. A similar strategy was used for 8th-order methods [
21]. Here, we introduce an auxiliary vector
with the aim of determining its coefficients so that the solution is approximated locally with sixth-order accuracy, i.e., with an error of
. Consequently, the following order conditions must be satisfied:
We have obtained a solution for these coefficients, which is provided in the method’s implementation in
Appendix A. Notably, no additional order conditions are required since the row-simplifying assumption (
4) allows the other conditions to be eliminated.
The resulting, cost-free sixth-order approximation is given by the following:
Thus, we obtain two approximations—one of order nine and one of order six—without any extra cost. By subtracting these approximations, we derive an
estimate of the local error:
We set a tolerance
and keep the step unchanged if
. If
, we double the step for the next interval. In this way, using the available data
and
, we can compute the subsequent approximation as follows:
Proper adjustments in the indices are applied; see
Figure 1 for a graphical illustration.
If instead
, we reject the trial step
and instead compute the solution at
, where
is the halved step used for advancing the solution. We then use
and suitable approximations for
to apply methods of the form (
3), after adjusting indices appropriately (see
Figure 2 for details).
A local
approximation for
and
is necessary to prevent order reduction due to error propagation. Such approximations can be obtained by applying the interpolation theory as introduced in [
22]. Specifically, we add four additional stages
and
:
and
This yields the following:
where the approximations (i.e., big
O notation) are considered locally.
It is evident that rejecting a step incurs a cost of 12 function evaluations compared to the 8 evaluations used in a conventional step—namely, the usual seven stages , , plus the extra stages and the evaluation of . Stage remains unchanged and is reused.
The set of new coefficients, i.e.,
, and the enhanced matrix,
, containing original matrix
A and
, have to fulfill a modified set of 151 order conditions. This set has the form shown in
Table 3 (see [
22]). Here, we set
to properly approximate
.
All coefficients are provided in the Mathematica listing in the appendix. It can also be retrieved from
http://users.uoa.gr/~tsitourasc/NumerovSol9var.m (accessed on 5 March 2025), where we have implemented the method in Mathematica format. In that file, we also include, in a separate section, the verification of the given coefficients over the 151 equations of the condition for the interpolatory approximation of
described above.
4. Numerical Tests
The innovative variable step method is designated as NumerovSol9var, reflecting its connection to Numerov, its 9th-order accuracy, and its variable step capability. It is compared with a method labeled as
Num8s9 in [
20] which is the underlying method here when the step is kept constant. This comparison is justified because
Num8s9 has demonstrated superior performance over other methods of similar or lower orders, as evidenced in [
20].
Initially, we implement the new method with various tolerance settings, documenting the number of stages used alongside the precision achieved for approximations of at the endpoint. Subsequently, at a comparable computational cost (i.e., the total number of stages utilized in the variable step implementation), we execute the constant step method Num9s8 and also record the precision at the endpoint. The results are presented in efficiency curves. All tests were conducted using Mathematica.
The problems on which the methods were evaluated are as follows.
4.1. The Two-Body Problem
At the outset, we select the well-known two-body problem (a.k.a., Kepler problem), characterized by eccentricity
e:
The Kepler problem, a fundamental issue in celestial mechanics, entails determining the trajectory of a planet or another celestial object influenced by a central gravitational force. Within the framework of this paper, the Kepler problem acts as a crucial test case for assessing the efficacy of the variable step-size implementation of the ninth-order hybrid Numerov-type method. Its significance in this research stems from its oscillatory characteristics and well-established periodic solutions, which offer a stringent evaluation of the new numerical technique’s effectiveness. By applying this method to such a classical problem, we can showcase its robustness and potential for wider applications in both theoretical and practical contexts involving differential equations with oscillatory dynamics.
Refer to [
23] for the theoretical solution. It is important to note that in this problem’s definition, the indices correspond to the coordinates of
. We solved the aforementioned equation over the interval
.
We examined three scenarios for eccentricities
(problem D3 of DETEST as outlined in [
23]),
(problem D4 of DETEST), and
(problem D5 of DETEST), with results documented in
Figure 3,
Figure 4, and
Figure 5, respectively. These findings demonstrate that utilizing the variable step algorithm provides a distinct advantage.
In the context of an elliptical solution (i.e., when ), the significant gain in precision is evident for NumerovSol9var across all scenarios. However, when applying an eccentricity of , the difference becomes pronounced. Although the proposed ninth-order Numerov-type method with variable step lengths offers considerable efficiency enhancements, its benefits may be less pronounced for problems that do not necessitate frequent step adjustments, such as the Kepler problem with zero eccentricity. Conversely, when rapidly changing dynamics are present (e.g., Kepler with high eccentricity), the ability to adjust the step size is of paramount importance.
4.2. The Arenstorf Problem
The Arenstorf orbit is a stable orbit between Earth and Moon [
24]. In form (
1), it reads [
25], (p. 296).
with initial values:
and end point
.
The solution at end–point is as follows:
and the corresponding efficiency curves are shown in
Figure 6.
Here, the results are really astonishing in favor of NumerovSol9var since the behavior of the solution requires many rapid and significant changes in the step size.
5. Conclusions
In this work, we introduced a novel ninth-order explicit two-step method equipped with a variable step-size mechanism specifically tailored for second-order initial value problems with oscillatory characteristics. The main contribution lies in the combination of high-order accuracy with a computationally efficient step-size control strategy, which employs error estimation through embedded methods and local interpolation to manage step doubling and halving.
We demonstrated the method’s performance across several challenging test problems, including the Kepler and Arenstorf orbits, where the proposed approach showed significant improvements in both accuracy and efficiency compared to fixed-step counterparts. The robustness of the method in handling stiff and rapidly varying dynamics underscores its potential for a wide range of scientific and engineering applications.
Moreover, the implementation in Mathematica, including symbolic verification of order conditions and adaptive control logic, enhances reproducibility and encourages further exploration by the research community.
Future work could investigate more flexible step-size control policies beyond binary step changes (doubling or halving), potentially guided by continuous error estimators. Additionally, extending the method to systems with variable coefficients, discontinuities, or multiphysics coupling would broaden its scope. The optimization of method parameters for specific subclasses of differential equations remains a promising direction for ongoing research.