1. Introduction
The first-order initial value problem stands as the fundamental model for Ordinary Differential Equations (ODEs), and is given by:
where the function
.
Runge–Kutta (RK) schemes are among the most widely utilized single-step numerical techniques for approximating solutions to (
1). These approaches do not rely on previously computed solution values. If
denotes an approximation to
, then an RK method updates the approximation at the next point
by the rule:
where
This formulation describes an
s-stage Runge–Kutta method. We focus on explicit methods where
whenever
. The associated coefficients are conveniently organized in the Butcher tableau [
1,
2]:
and equivalently in compact matrix notation as
where
,
, and
.
This structure allows the successive and explicit computation of the function evaluations , for .
Runge–Kutta (RK) methods represent a fundamental family of numerical schemes for solving initial value problems (IVPs) of ordinary differential equations (ODEs). A practical extension of these methods involves the construction of so-called RK pairs. These pairs consist of two methods of the same stage number but differing algebraic orders—typically denoted as RK
p(
q), where
p is the order of the primary method and
is the order of the embedded method. Both methods share the same set of intermediate function evaluations (or “stages”), which makes the additional computation cost negligible while providing valuable error estimation for adaptive step-size control [
3,
4].
Such embedded pairs are widely used in practice due to their efficiency and robustness. The idea is to obtain two approximations of the solution at each step: one of higher order and one of lower order. The difference between these two approximations provides a local estimate of the truncation error. Based on this estimate, the algorithm can dynamically adjust the step size to meet a user-defined accuracy tolerance. If the estimated error is too large, the step is rejected and retried with a smaller step size; if the error is sufficiently small, the step can be accepted and potentially followed by a larger one.
Some of the most widely adopted embedded RK pairs include RK5(4) [
5], RK6(5) [
6,
7], RK8(7) [
8,
9], and RK9(8) [
10,
11] or even RK7(5) [
12]. In these pairs the first number indicates the order of the primary method and the second the order of the embedded one. These methods strike a balance between computational cost and accuracy, making them suitable for stiff and non-stiff problems alike, as well as for problems with rapidly changing solutions where fine step control is crucial.
In applications where high precision is required—such as in orbital mechanics, computational physics, and control theory—higher order RK pairs like RK8(7) and RK9(8) are particularly advantageous. They allow for larger step sizes while still satisfying stringent accuracy requirements, significantly reducing the total number of steps and function evaluations compared to lower-order methods.
While standard numerical integrators such as ode78 and ode15s exhibit robust convergence characteristics for a wide class of well-posed initial value problems, their application to singular differential equations is fundamentally constrained at the origin. The necessity of initiating these solvers at a displaced point to avoid the singularity introduces a non-trivial initialization error and can lead to a significant increase in the number of function evaluations during the first few steps. Our analysis does not suggest a general deficiency in these established methods but rather highlights a specific failure to resolve the solution directly from without auxiliary analytical intervention or artificial shifting.
The continued development and refinement of RK pairs remain a significant area of research in numerical analysis, especially in conjunction with modern error estimation techniques and high-performance computing environments.
This study explores an alternative approach to explicit Runge–Kutta schemes where the initial derivative value, specifically , is defined as for a non-zero constant and step size . This deviates from the conventional Runge–Kutta (RK) method, where the trivial row simplifying condition () is typically enforced. The methods developed in this paper are termed Runge–Kutta-Oliver (RKO) methods, revisiting an underdeveloped framework where this condition is not imposed ().
Specifically, this paper focuses on developing a novel sixth-order RKO scheme that utilizes eight stages per step. This new method, designated as Oliver6, introduces certain conditions, such as satisfying the first-row simplifying condition () only for indices beyond the first (due to ), demanding for those same indices, and imposing to streamline the order conditions. Additionally, it incorporates the column simplification condition given by . This novel method demonstrates superior efficiency compared to traditional Runge–Kutta pairs of orders 6(5) and even 8(7), especially for applications involving initial singularities, such as the Lane–Emden equation.
The proposed eighth-stage method is designed as a specialized startup integrator specifically tailored to address the ill-posedness of the first step in singular initial value problems. By focusing on the rigorous resolution of the solution at the origin, this work provides the end-to-end validation necessary for a consistent initialization phase, while the current framework establishes the theoretical and numerical viability of the scheme for fixed-step startup; it serves as the requisite foundation for future extensions into fully adaptive, long-range integration suites, where the removal of the initial singularity is a prerequisite for global stability.
2. Runge–Kutta Order Conditions
The derivation of Runge–Kutta (RK) methods typically relies on satisfying the so-called trivial row simplifying condition:
which, in matrix notation, becomes
, where
.
Oliver, in his foundational study [
13] investigated RK schemes without enforcing this simplification. His findings demonstrated that no four-stage method of order four can be built under this relaxed setting. Since then, this particular avenue of RK theory has remained largely unexplored, especially concerning higher-order methods that omit the above condition.
In this study, we revisit this underdeveloped framework and explicitly consider the case:
We will show that such methods become viable and even competitive when focusing on constructing fifth-order schemes using six stages. To distinguish this generalized framework from the classical RK formulation, we introduce the terminology Runge–Kutta–Oliver (RKO) methods. Clearly, standard RK methods form a special subset of the RKO family in which the row simplification is imposed.
Especially in the present work we will consider sixth order methods with Butcher tableau as shown in
Table 1:
Applying an RKO method to the initial value problem (
1), the analytical Taylor expansion of the solution around
yields [
4]:
where the various partial derivatives are given by
and all of them are evaluated at the point
. It is important to emphasize that when
for
, these expressions involve Fréchet derivatives rather than simple scalar differentials.
Simultaneously, the internal stages
of the RKO scheme are also expanded around
using Taylor series. For instance,
with all quantities again evaluated at
.
Accordingly, we obtain the following representation:
where the constants
are entirely determined by the coefficients
.
Subtracting Equation (
4) from the Taylor expansion in (
3), we obtain the local discretization error:
A method is said to possess algebraic order
p when its local error is of order
. This implies that the coefficients in the series expansion above must vanish for all powers of
less than or equal to
p. Therefore, achieving order
p necessitates satisfying a collection of algebraic conditions, commonly referred to as order conditions. For instance, demanding
yields a first-order accurate scheme.
To achieve second-order accuracy, the following constraints must be met:
In general, for a method of order p, the coefficient of is referred to as its principal local error term.
In traditional Runge–Kutta theory (where ), the concept of rooted trees was employed to encode the order conditions. For the broader class of RKO methods, we extend this idea using rooted trees with two types of leaves, marked by two distinct symbols—white (∘) and black (•). A rooted tree of order n consists of n interconnected nodes with these two colors, structured such that the root (a white node) initiates the branching and no reconnections are allowed. Importantly, only white nodes (∘) are permitted to have offspring. Under this framework, the root corresponds to the coefficient vector b, the white nodes represent matrix A, and the black nodes are associated with the vector c.
![Symmetry 18 00539 i001 Symmetry 18 00539 i001]() |
Each rooted tree with two-colored terminal nodes corresponds to a unique order condition, a relationship that becomes evident when the tree is dissected. Specifically, we separate its branches at the root. The following naming convention is adopted: a tree is denoted by , where the first index i indicates the total number of vertices, and the second index j labels the individual trees within the family of trees containing i nodes. The simplest case, the single-node tree •, is assigned , while the isolated leaf ∘ corresponds to . The complete collection of trees with two nodes is as follows:
Notice that the single prominent upper vertex is consistently represented as white. Below are the five distinct rooted trees composed of three nodes:
Observe again that the upper large nodes are white. Only and remain after assumption .
A rooted tree containing p vertices can be constructed by attaching, to a newly introduced root node, a collection of smaller trees whose total order is . Consequently, we can represent such a structure as , where and denote the constituent subtrees joined at the new root. In cases where an identical subtree (such as ) appears g times in this attachment process, we can abbreviate the repetition using the notation . For instance, . It is also important to note that the sequence in which the subtrees are listed has no bearing on the overall structure. That is; for example, .
Referring back to the diagram mentioned earlier, the corresponding tree can be described as
, where
all components are collectively joined (attached) to form a new root node.
Several mappings are introduced over the trees examined in this context. Following the approach outlined in ([
14], p. 164), we may likewise define:
- ⋄
- ⋄
- ⋄
- ⋄
- ⋄
Elementary differentials
:
We define
,
,
,
, and
, where the symbol ⊙ signifies the element-wise multiplication of vectors. Namely, Hadamard product. That is,
This type of product has lower precedence than standard operations such as parentheses, exponentiation, and dot products. For instance, we observe that
Expression (
5) is structured as
where
denotes the collection of rooted trees with two-colored leaves of total order
i. The mappings
and
assign integer values to each tree
. The function
is derived entirely from
and is uniquely determined by the structure of
. The term
represents the corresponding elementary differential.
Accordingly, a Runge–Kutta–Oliver (RKO) method is said to achieve accuracy of order
p if and only if
for every
, with
. This equation characterizes the order conditions, linking them directly to rooted trees bearing two types of colored leaves.
We now proceed to derive the order conditions corresponding to different algebraic accuracies.
It is worth noting that no order constraint is linked to , namely the tree ∘. This is the sole configuration that is exempt from any associated condition. This exclusion is necessary, as the trivial tree ∘ cannot possess any successors. As a result, all trees of higher complexity can appropriately be treated as offspring of those arising at second order.
2nd order
2nd order
At the third order, a total of five distinct trees can be identified. The process can be systematically extended to derive the complete set of order constraints required for a RKO scheme to attain accuracy of order p.
Table 2 presents a summary of the order conditions up to third order, alongside their linkage to the respective rooted trees. The tree
illustrated earlier corresponds to the error expression
Thus, the upper large white circle corresponds to b, the line between two white circles corresponds to A, the line from white to black circle corresponds to c and the lower-most white circles correspond to e.
We may proceed following the approach outlined in [
15]. Beginning with the two second-order trees (
and
), the remaining structure proceeds in much the same fashion. Characteristics such as the order, symmetry, density, integer decompositions, generating functions, and overall tree proliferation continue to obey similar combinatorial patterns.
Table 3 presents the number of order conditions associated with each value of
p. These quantities are consistent with those documented in [
16], except for the case
, as
does not correspond to any order condition. An asymptotic approximation for the total number of conditions was provided by V. Kotesovec in [
17], and is expressed as:
Hence, to construct a RKO method of order four, one must fulfill independent order constraints.
In contrast, a classical Runge–Kutta method of the same order requires only
conditions to be satisfied. This highlights a notable disadvantage of RKO schemes. In [
18], we also presented the order conditions for algebraic orders four and five in Mathematica [
19] notation. Here, in
Table 4, we present the sixth order conditions in the same notation. The package introduced in [
18] was used for delivering them.
There are various publications focusing on symbolic tools for order condition derivation along with contemporary progress in Runge–Kutta pair development, see [
20].
4. Numerical Experiments
To implement the Oliver6 scheme, the user evaluates the first stage at
with
, effectively bypassing the singularity at
. The remaining stages
for
are computed via the standard explicit relation:
The solution is updated using the formula:
where
as per the method’s construction.
4.1. Lane–Emden Problem
The Lane–Emden equation [
21,
22], describes the behavior of gases governed by classical thermodynamic principles. For this reason, we selected this single-parameter family of problems to evaluate the performance of the newly proposed method. The differential equation is defined as:
subject to the initial conditions
and
.
It is well known that traditional explicit Runge–Kutta methods encounter difficulties at the starting point of integration, particularly at . A practical workaround involves initiating the numerical solution slightly to the right of the origin. Although this technique proves effective—as we will later demonstrate—it still falls short compared to our proposed strategy.
Conventionally, the numerical integration of singular initial value problems requires the analytical determination of
via L’Hôpital’s rule to resolve the indeterminate form
as
. For Equation (
9), this substitution yields the relation
, from which
is derived to construct a starting Taylor series. This expansion is typically utilized to approximate the solution at a small displacement
, effectively shifting the initial point to
to avoid the
indeterminacy at the origin. In contrast, the Oliver6 method bypasses this analytical preprocessing by evaluating the first stage at
. Since
, the denominator in the governing equation remains non-vanishing, allowing the solver to proceed directly from
without the need for manual Taylor series initialization or the explicit calculation of higher-order derivatives.
We implemented the new scheme in
MATLAB R2022b [
23] available at Nat. Kapodistrian University of Athens. For benchmarking, we used the well-known Runge–Kutta pair of orders 6(5), known as PD6(5), introduced by Prince and Dormand [
9]. This method also utilizes eight stages per step, consistent with the structure adopted by Oliver6. In addition, we considered a higher-accuracy Runge–Kutta pair denoted
, implemented as
ode78 in MATLAB—a widely adopted solver within contemporary Runge–Kutta frameworks [
10]. This scheme requires 13 stages per integration step.
Since our investigation centers on the initial phase of the integration process, we evaluated the results after just a single step. The step sizes examined were , , and . Simultaneously, different integer values for were considered. Given that only is of physical relevance, we chose .
Closed-form solutions are available for only three cases, namely
, and 5:
respectively. For
, we generated reference values using highly accurate numerical solvers within Mathematica. These outcomes are summarized in
Table 7.
It is worth noting that sixth-order methods tend to offer optimal performance when moderate precision is sufficient—typically in the range of 6 to 8 significant digits. For problems requiring higher accuracy, methods of elevated order are more appropriate. Conversely, for rough tolerances, lower-order integrators are preferable. This explains the motivation behind the development of a variety of schemes and method pairs across different orders.
The outcomes for all schemes following a single integration step are presented in
Table 8,
Table 9,
Table 10,
Table 11,
Table 12 and
Table 13. For PD6(5) and
ode78, the integration began at
to circumvent potential issues associated with evaluating
. In cases where the exact solution is available, employing it directly offers limited insight—particularly in trivial scenarios such as
, then (using
)
Thus, we may verify the rightmost lower figure from
Table 8, writing:
>> sol=ode78(@(x,y) [y(2);-2*y(2)/x-1],[1e-15 .01],[1 0]’, …
odeset(’MaxStep’,1,’Initialstep’,.01,’abstol’,1e30,’reltol’,1e30));
>> sol.stats.nsteps
ans =
1
>> log10(abs(sol.y(1,end)-(1-0.01^2/6)))
ans =
-4.4842
rounded to
for the presentation. The corresponding run for the new method can be retrieved from
http://users.uoa.gr/~tsitourasc/oliver6.m (accessed on 29 January 2026) in MATLAB format. Also, the coefficients for Oliver6 method can be found there. Observe that if the correct starting point 0 is put in the above run instead of
1e-15, then the method fails completely to start. Conventional Runge–Kutta pairs may give competitive accuracies at a very high cost. Thus, in the following run we may achieve an interesting accuracy at hundredfold cost.
>> sol=ode78(@(x,y) [y(2);-2*y(2)/x-1],[1e-15 .01],[1 0]’, …
odeset(’abstol’,1e-13,’reltol’,1e-13));
>> log10(abs(sol.y(1,end)-(1-0.01^2/6)))
ans =
-15.9546
>> sol.stats
ans =
struct with fields:
nsteps: 28
nfailed: 32
nfevals: 860
The proposed scheme delivers an accuracy improvement ranging from to digits when compared to PD6(5) and ode78. On average, it achieves roughly 6 additional correct digits. This constitutes a substantial enhancement, especially given that all methods share the same algebraic order and utilize an equal number of stages. Note that when , Oliver6 achieves maximum accuracy, effectively reaching machine precision—approximately according to log10(eps). Higher accuracies are practically of no meaning in double precision and MATLAB.
A practical assessment of the convergence rate via Runge’s rule is omitted for these problems because the Lipschitz condition is violated at the left endpoint, rendering classical algebraic order analysis inapplicable for the initial integration step.
Implicit Runge–Kutta pairs may handle better initial point evaluations and deliver accurate results, but at a very high cost. Implicit Euler (where
) is able to deliver 10–11 digits of accuracy after spending millions of function evaluations. Methods radau5 and radau9 [
24] cannot start from
even if
for them also. This is due to internal evaluation of
for initial residuals, estimation of the initial Jacobian, step size estimation, and Newton iteration.
Notably, the method also performs well for non-integer values of
. For instance, considering
, we have the approximations:
with the corresponding numerical outcomes presented in
Table 14.
The proposed method appears to surpass the performance of both PD6(5) and
ode78, even when applied to alternative formulations of the Lane–Emden problem. One such example is the equation modeling isothermal gas spheres:
An approximate analytical expression for the solution, as reported in [
25], is given by:
This degree of precision is adequate for our comparative evaluation within the framework of double-precision floating-point arithmetic. The corresponding numerical outcomes are presented in
Table 15.
No improved results were observed when using other well-known classical Runge–Kutta pairs. Their performance remained comparable to that of PD6(5) and ode78.
4.2. The Rational Smooth Transition
This problem represents a class of equations where the singularity is “removable” if and only if the initial condition is chosen precisely to suppress the divergent homogeneous solution. It has the form
and exact solution:
.
In physical systems, this structure often appears in spherical growth models. Consider a substance diffusing into a sphere where the concentration y depends on the radius x. The term (or its first-order reduction) accounts for the geometric “crowding” as one moves toward the center (), while the equation is singular at the origin, the physical reality requires the concentration to be finite and smooth at the center.
The general solution is . Any choice of would result in an infinite concentration at the center, which is physically impossible. Thus, nature “chooses” the path.
We again tested various step lengths under the assumption that the exact solution is unknown, setting
for PD6(5) and
ode78. The corresponding results are reported in
Table 16. Notably, the proposed method achieves accuracy close to machine precision, whereas the other methods fail to produce meaningful results.
4.3. The Exponential Balancer
The Exponential Balancer is a more complex test case where both the coefficient and the forcing term are singular, but their Taylor series expansions perfectly align to allow a bounded solution. It is given by
with exact solution:
This equation models radiative transport or heat generation within a cylinder or sphere where the source term () is non-linear. The singularity at is a coordinate singularity, not a physical one.
To see why
, we examine the Taylor expansion of the solution:
As , and . This demonstrates that despite the terms, the physical quantity y (such as temperature or pressure) transitions smoothly through the origin.
We repeated the experiments setting again
for PD6(5) and
ode78 and using different step lengths. The associated results are reported in
Table 17. Notably, the proposed method demonstrates consistently strong performance, while the remaining methods exhibit comparatively poor results.
The conventional methods may furnish better results. Indeed, after using especially
we may get the results shown in
Table 18. Of course, selecting an optimal
is not a straightforward task; moreover, using the solution (
12) to initiate the procedure presents an additional challenge. Even this constitutes an unfair comparison for Oliver 6; nevertheless, the latter method, which uses standard initials from (
11), again yields superior results.
4.4. The Thomas–Fermi Model as a Singular IVP
The Thomas–Fermi model remains one of the most significant semi-classical descriptions of the electron distribution in heavy atoms [
26,
27]. Mathematically, it is formulated as a second-order, nonlinear ordinary differential equation (ODE) that relates the dimensionless electrostatic potential
y to the radial distance
x.
The governing equation and boundary conditions for the Thomas–Fermi equation are given by:
The left boundary represents the location of the nucleus. At this point, the screening effect of the electron cloud is zero, leading to the first initial condition: .
To determine the unique solution for a neutral atom, a second condition is imposed at infinity, requiring the potential to vanish:
. This boundary value problem is typically converted into an Initial Value Problem (IVP) by determining the specific initial slope
B:
Standard Taylor series expansions fail at the origin because the second derivative
diverges as
due to the
term. Instead, the solution must be expressed as a Puiseux series, commonly referred to as the Baker series. This expansion incorporates fractional powers to accommodate the singular behavior:
The presence of the term indicates that while the function and its first derivative are finite at the origin, the second derivative is non-analytic. This series is essential for initializing numerical solvers, as it allows for an accurate transition from the singular point to a small displacement where standard integration techniques, such as the Runge–Kutta method, become stable.
The constant
B is a fundamental parameter of the model. Physically, it represents the initial rate of screening. If
is smaller than the critical value, the solution eventually diverges, representing a “compressed” atom. Conversely, if
is larger, the solution reaches
at a finite radius, which is used to model positive ions. The neutral atom solution exists precisely on the separatrix between these two regimes. We repeated the experiments using different step lengths, and the associated results are reported in
Table 19. The other methods started at
. The behavior of PD6(5) and
ode78 are clearly out of order. Not only are they exploding for large steps, but they also move to the imaginary axis, furnishing complex results.
In case we admit heavy use of known results,
and move right to
, then PD6(5) and
ode78 may present acceptable results as we see in
Table 20. Once again, determining an optimal
and employing (
15) are not tasks that are easy to accomplish. This comparison remains biased against Oliver 6; however, the latter method, once more initialized at standard
, still produces superior results.