1. Introduction to Extrapolation with Cost-Functionals
The current study considers herein finding properties of power laws emerging in the limit of large enough values of variables from truncations at comparably small values of variables, giving particular attention to the resolution of cases when there are multiple solutions to the optimization problems. The technical side of the approach is based on iterated roots. The roots have an explicit shape with a power law at infinity, which remains formally the same in each order.
In the process of resummation with cost-functionals dependent only on amplitudes, developed in Refs. [
1,
2], it is expedient to follow some guiding symmetry. The cost-functionals developed in Ref. [
2] happen to satisfy the scaling of all amplitudes with the same multiplication factor.
Although extensively used, the Tikhonov-ridge regularization [
1] appears to violate such scaling in a decisive “hard” way by means of the quadratic term in the optimization parameter. In the current paper, yet another extended family of cost-functionals is considered, which arises from the scale-invariant collar functional [
2]. In such an approach, scaling violations are straightforwardly quantified by parametrizing them in such a way that violations of symmetry are introduced continuously in a “smooth” manner.
It is also of general interest to lift the property of differentiability pertinent to cost-functionals of Refs. [
1,
2]. Considering non-differentiable cost-functionals may lead to the discovery of remarkable properties of the optimum. The optimum may even become a catastrophe [
3]. Surely, the accuracy of the ensuing cost-functionals needs to be confirmed against their differentiable counterparts. The current paper is dedicated to finding accurate, unique, and robust extrapolants by defining a proper cost-functional.
Consider the case when the real solution
to some physical problem, dependent on the real variable
x, is given in the form of a truncated asymptotic expansion as
[
4,
5]:
From the truncation (
1), one needs to reconstruct
at
. In condensed matter and field theories, it can be considered to be the most intriguing case. In such a limit, the function
behaves as a power law:
Sometimes, through additional arguments, one can calculate the index
. The task then is to find the (critical) amplitude
B with known
[
6].
Because of the assumed asymptotic character of the truncations (
1), such a problem requires some form of transformation to be applied to the original truncations (
1). Generalized Borel transformations
were defined in Refs. [
4,
7] as a generalization of the known Borel summation [
8] to the case of a real
p.
here is the gamma function.
The transformed coefficients are expressed through the original coefficients as . The latter expression demonstrates how the real parameter p connects the original with the transformed coefficients .
Thus, instead of the original truncations, the consideration here confronts with another truncation . It is expected that to be more amenable to summation. Moreover, it now includes some control parameter p.
The summation procedure for a Borel transform
(
3) is accomplished by means of iterated root approximants [
7,
9], which stem from the following recursion:
where
and
, and
is known.
For
, one arrives at
For
, one finds that
and for arbitrary
k,
with all parameters
defined in a closed form by requiring asymptotic equivalence of the
k-th-order Taylor expansion of Formula (
5) with the truncation of the type (
3).
The behavior of the function (
5) as
is expressed as a power law with the index
at infinity. The amplitude
B is approximated after the inverse to Equation (
3) transformation [
4,
7] by the following formula:
where
In order to find
p, let us consider optimization conditions with respect to the amplitudes
defined for large values of variables. By analogy to that in Refs. [
1,
10], one can write down the minimal difference condition and the minimal derivative condition with respect to the control parameter
p. Thus, there are at least two possible solutions to optimization. The problem of non-uniqueness of solutions arises from the application of highly nonlinear optimal conditions. Generalities of such an approach can be found in the papers [
11,
12]. Multiplicity of solutions is a source of indeterminism in classical physics and equivalent problems [
13].
Instead of finding all solutions to the minimal derivative and minimal difference conditions, one can proceed with penalties. A penalty term can be introduced into optimization problems to avoid a non-uniqueness of solutions altogether [
1,
14,
15,
16,
17]. The problem now is how to construct a concrete cost-functional to be minimized with respect to the control parameter
p.
Let us require that the results of a continuous iterative summation with arbitrary real
p have to be minimally deviating from the directly calculated Borel summation
. Technically, such an objective is achieved through adding a corresponding penalty term, which takes into account such deviations, i.e.,
The case
is considered throughout this paper. Actually, different weights can be assigned to the different terms in the cost-functional when some additional information on the sought-after function is given a priori. When no such information is available, one can assume equal weights, as is performed in this paper. The parameter
is retained here and below for generalizing the presentation.
In addition, in the case of discrete
p, let us also consider the following comparably simple approximation for the sought-after amplitudes, as developed in Ref. [
7]:
where
. Let us also require that the amplitudes found using summation with real
p deviate minimally from the results (
8) of the discrete iterations. Such an objective is met through adding a corresponding penalty term to
, i.e.,
And let us set in the expression (
9) the following:
,
,
,
, and
. Then, let us compare the accuracy only of such special cases. For
, one returns to the collar cost functional
introduced in Ref. [
2].
The cost-functional
is constructed in such a manner that it depends actually only on amplitudes. The cost-functional
and alike are homogeneous functions of the second order with respect to the scaling of all amplitudes (
,
,
), with the same multiplicative factor
, so that
But non-homogenous cost-functionals with
do violate scaling. One can consider a weak violation of scaling when
or
, with differentiable
and
. But one can also consider a strong violation of scaling when
or
, with continuous and non-differentiable
and
. The latter cost-functionals contain an essential singularity in their first derivatives.
It is possible to envisage some straightforward extensions to the cost-functionals (
7) and (
9). For instance, in place of the simplest expected value
, one can employ some average approximations for the expected value of amplitudes
arising from averaging over approximants with varying
k in two neighboring orders [
18]. Such averaging can be viewed as just a Cesaro average and can be generalized along the lines of Cesaro averaging to more complicated expressions, including even lower orders.
Correspondingly, with a simple replacement, one arrives at two more cost-functionals:
and
The optimal control parameters
minimize the cost-functionals
, including
,
,
, and
, so that
When
is found from any of the cost-functionals introduced, the sequence of amplitudes
arises. Typically, when the sequence behaves monotonously, the last value of the sequence is chosen. However, sometimes monotonicity persists only to some smaller number. In exceptional cases when there is no solution to Equation (
14), one resorts to the minimal sensitivity condition by finding the optimum from the condition
As a rule, only the results obtained in the highest possible order for each of the problems are presented.
The cost-functionals
,
,
, and
are to be compared with the Tikhonov-type ridge cost-functional
introduced in Ref. [
2] following the consideration of Ref. [
1]. The functional (
17) combines additively the minimal difference and minimal derivative conditions. The ridge-type penalty is introduced into expression (
17) to select the unique solution to the optimization of the same type as Equation (
14). The solution is expected to deviate minimally from the Borel solution for the amplitude. Without the last term, it is a homogeneous function of the second order. However, the last term in the cost-functional
violates homogeneity and, corresponding to it, scaling invariance.
2. Examples
Let us now consider various physical examples from field theory, quantum mechanics, and statistical physics. The coefficients pertinent to such examples demonstrate various behaviors, including fast growth, fast decay, and even seemingly irregular behaviors. The study is searching for a robust extrapolation scheme able to cover as many various problems as possible while keeping the error of extrapolation at a tolerable level of, for instance, , in terms of relative error.
The cost-functionals
are applied and optimized with various values of the parameter
p for various values of
m. Due to the one-dimensional character of the arising optimization problems, one can find optimums with relative ease. The results are tabulated, and the most instructive cases are illustrated and explained in
Section 2 below.
When the original truncation is transformed to inverse physical quantities. Surely, in order to approximate the sought-after quantities, one has to take an inverse again.
To summarize and find an estimate for the amplitude B, one should follow the following steps. Transform coefficients according to the Borel-type transformation to the coefficients . Then apply the iterated root approximants. The parameters of the iterated roots are expressed uniquely in analytical form through the transformed coefficients using asymptotic equivalence of the approximants and transformed polynomial expressions. Write down the expression for amplitudes analytically. Substitute expressions for amplitudes into the cost-functional and minimize the cost-functional with respect to parameter p numerically using, for example, Mathematica. From the found , find the amplitude from the formula for amplitudes. Analyze the convergence of the sequence of amplitudes dependent on the discrete parameter k and select the final member from the condition of monotonicity.
2.1. Schwinger Model: Critical Amplitude
The ground-state energy
E of the Schwinger model can be expanded in terms of the inverse coupling constant
x [
19,
20,
21,
22,
23,
24,
25]. Only two non-trivial terms are known in the formal expansion as
. In the different limit of
, the ground-state energy behaves as a power law of the type (
2), with
,
.
The results of calculations using different methods with
are shown in
Table 1. Although the best result,
, is good enough, one cannot conclude much about the numerical convergence of the results. From the cost-functional (
17), one finds significantly worse results,
.
The amplitude
B can also be found in the third order
, assuming that
. The results of calculations by different methods with
are shown in
Table 2. Compared with Table
1, Table
2 shows a systematic improvement of the results, and only due to the addition of the relatively small, third-order coefficient.
Optimization according to
,
gives
corresponding to
. However, the approximations leading to the best result
behave non-monotonously.
Optimization according to
,
gives
corresponding to
. The approximations behave monotonously, although the final results are somewhat worse than those found with
. From the cost-functional (
17) in the case of
, one finds
.
The behavior of cost-functionals
,
is illustrated in
Figure 1. The catastrophic behaviors for
and
are different qualitatively from the monotonous behaviors found for
and
.
2.2. Anomalous Dimension
The cusp anomalous dimension
of a light-like Wilson loop in the
supersymmetric Yang–Mills theory depends only on the coupling
g [
26]. Only three non-trivial terms are known in the formal expansion as
. In the strong coupling limit
, where
,
takes the form of a power law (
2), with
and
.
The results of calculations for the amplitude
B by different methods for
are shown in
Table 3.
Optimization according to
,
gives
corresponding to
. From the cost-functional (
17) in the case of
, one finds
[
2].
The behavior of cost-functionals
,
, is illustrated in
Figure 2. In this case, catastrophic behavior is superseded by monotonous behavior, creating a global minimum.
2.3. Bose Temperature Shift
Atomic interactions are known to stabilize the Bose gas. The shift
in the Bose–Einstein condensation temperature
of a non-ideal Bose system compared with the Bose–Einstein condensation temperature
of the ideal uniform Bose gas [
27,
28] emerges and needs to be calculated.
The shift is quantified by the parameter
in the following manner:
for
, where
is a gas parameter dependent on atomic scattering length and on gas density. In order to calculate
, it is expedient to first calculate an auxiliary function
[
29,
30,
31]. The latter quantity is given as an expansion in terms of the effective coupling parameter
g as
, in the fifth order. Eventually,
corresponds to
Monte Carlo simulations [
32,
33,
34] give
.
The results of calculations with different cost-functionals are presented in
Table 4. The iterated roots employed in the course of calculations correspond to
.
Optimization according to
,
, gives
corresponding to
. The approximations converge monotonously.
From the cost-functional (
17) in the case of
, one finds
[
2]. The behavior of cost-functionals
,
, is illustrated in
Figure 3. In this case, catastrophic behavior is suppressed by monotonous behavior.
For the
field theory, the corresponding expansion for the auxiliary function was obtained by Boris Kastening as well [
29,
30,
31]. The Monte Carlo simulations give
. The results of calculations by different methods are shown in
Table 5.
Optimization according to
,
, gives
corresponding to
. The approximations converge monotonously. From the cost-functional (
17),
is found.
For the
field theory, the fourth-order truncation was obtained by Kastening as well [
29,
30,
31]. The Monte Carlo simulations give
. The results of calculations by different methods are shown in
Table 6.
Optimization according to
,
, gives
corresponding to
. The approximations converge monotonously. From the cost-functional (
17), one finds
.
2.4. Two-Dimensional Polymer
The swelling factor
of the two-dimensional polymer was found perturbatively [
35]. The asymptotic expansions of
are found in terms of the dimensionless coupling parameter
g. The latter parameter measures the strength of the repulsive interaction between the segments of the polymer chain [
35,
36]. As
, the swelling factor can be represented as a fourth-order truncation of the type of expression (
1). As
, the swelling factor behaves as a power law of the type (
2), with the exact index at infinity
[
37,
38]. The amplitude
B is of the order of unity.
The results of calculations by different methods are shown in
Table 7.
Optimization according to
,
, gives
corresponding to
. The approximations converge monotonously to the third member of the sequence
. From the cost-functional (
17),
is obtained.
2.5. Three-Dimensional Harmonic Trap
Quantum characteristics of Bose-condensed atoms in a spherically symmetric harmonic trap are modeled by the stationary nonlinear Schrödinger equation [
27]. The ground-state energy
E of the Bose condensate in such a trap is approximated for weak trappings
by the fourth-order truncation. For quite strong trapping
, the energy behaves as the power law (
2), with the amplitude at infinity
, and the index
[
27].
The results of calculations for
by different methods are shown in
Table 8.
Optimization according to
,
, gives
corresponding to
. The approximations converge monotonously to the last member of the sequence given by
. From the cost-functional (
17), one finds
.
The behavior of cost-functionals
,
, is illustrated in
Figure 4. In this case, the catastrophic approach to the minimum is much more pronounced, while competing minima are almost suppressed.
2.6. Three-Dimensional Polymer
Just as in the example in
Section 2.4, the expansion factor
of a three-dimensional polymer can be represented as a truncated series in a single dimensionless interaction parameter
g [
35,
36]. The expansion factor at small
g can be presented as the sixth-order truncation. The strong coupling behavior of the expansion factor, as
, is a power law with
and
[
36]. The results of calculations by different methods are shown in
Table 9.
All methods presented in
Table 9 give reasonable estimates for the amplitude. Optimization according to
,
, gives
corresponding to
. The approximations converge monotonously to the last member of the sequence given by
. From the cost-functional (
17), one finds
[
2].
2.7. Pressure of a Two-Dimensional Membrane
For a two-dimensional membrane, it is essential to calculate its pressure. The wall stiffness is quantified by the dimensionless parameter
g [
39]. By means of perturbation theory, the expansion for the pressure at small
g was found by Kastening in the sixth order of perturbation theory [
39]. At infinite
g, or in the so-called rigid-wall limit, Monte Carlo simulations [
40] give the following estimate for the amplitude
while the critical index at infinity is
. The results of calculations for
by different methods are shown in
Table 10.
Optimization according to
,
, gives
corresponding to
. The approximations converge monotonously to the fifth member of the sequence given by
.
From the cost-functional (
17), one finds considerably inferior results,
[
2]. Also, the somewhat inferior results for
,
,
,
, and
are found from the minimal sensitivity condition (
16).
2.8. One-Dimensional Bose Gas
The ground-state energy
of the one-dimensional Bose gas with contact interactions depends only on the dimensionless coupling parameter
g [
41]. The energy was found perturbatively in the eighth order as an expansion in terms of the variable
x, where
[
42]. In the limit of strong coupling, as
, the exact result
is due to Lewi Tonks [
43] and Marvin Girardeau [
44]. Formally,
is also set. In this case, one has to apply resummation to the inverse of the original truncations in order to avoid poles in the expression for amplitudes.
The results of calculations for
by different techniques are shown in
Table 11. In such a case, all approximations give quite suitable results independent of finer details of the cost-functional construction.
Optimization according to
,
, gives
corresponding to
. The approximations converge monotonously to the sixth member of the sequence given by
. From the cost-functional (
17), one finds considerably inferior results,
[
2].
2.9. Gaussian Polymer: Debye–Hukel Function
The correlation function of the Gaussian polymer [
37] is known in the following form:
and it is called the Debye–Hukel function. Consider for simplicity the inverse of the correlation function
For relatively small
,
can be expanded into a Taylor series with quite rapidly decaying by magnitude coefficients. As
,
behaves as a power law of the type (
2), with
,
.
The results of calculations for
are shown in
Table 12. All methods give quite suitable results.
Optimization according to
,
, gives
corresponding to
. The approximations converge almost monotonously with insignificantly weak oscillations to
. From the cost-functional (
17), one finds considerably worse results,
. The latter result is close enough to “plain” Borel summation with iterated roots [
1].
2.10. Schwinger Model: Energy Gap
The energy gaps
for the bound states of the Schwinger model can be presented as rather long asymptotic expansions at relatively small values of the parameter
, where
a stands for lattice spacing and
g is a coupling parameter [
19]. In the continuous limit of
, the gap for the scalar state behaves as a power law of the type of (
2) [
19],
with
,
.
The results of calculations for
with different penalties are shown in
Table 13.
Optimization according to
with
gives
corresponding to
. The above approximations converge to
. From the cost-functional (
17), one finds
[
2]. The latter result is quite close to “plain” Borel summation with iterated roots [
1].
2.11. Quantum Quartic Oscillator
The quantum anharmonic oscillator is described by the model Hamiltonian with a quartic term. The latter term is quantified through a positive anharmonicity parameter
g [
45]. Perturbation theory for the ground-state energy
produces a long expansion of the type (
1), as shown in the seminal paper [
45]. The coefficients
are rapidly growing in magnitude with increasing
n. The strong coupling limit case of
as
is given by the power law (
2), with the critical amplitude
and index
.
The results of calculations for
with different cost-functionals and corresponding penalties are shown in
Table 14.
Optimization according to
,
, gives
corresponding to
. The approximations converge numerically to
. From the cost-functional (
17), one finds rather close results,
[
2]. The latter result is also quite close to “plain” Borel summation with iterated roots [
1].
The best results,
, in the 10-th order of perturbation theory were found in Ref. [
46] by means of fractional Borel summation. In the 11-th order, an even better estimate,
, can be found along the same lines.
3. Conclusions
The calculation of amplitudes emergent at quite large values of variable from the truncated series obtained for relatively small values of variable is performed by means of the cost-functional technique. In the five cases considered, the functionals, including essential singularities in the first derivatives, are found to perform better than functionals without it. One can conclude that there is definite value in considering such a catastrophic way of approaching optimum.
Most robust results are found with
,
, and
. For better comparison, those results from
Table 1,
Table 2,
Table 3,
Table 4,
Table 5,
Table 6,
Table 7,
Table 8,
Table 9,
Table 10,
Table 11,
Table 12,
Table 13 and
Table 14 are compiled in
Table 15. The functional
is a homogeneous function of the second order and, therefore, respects the scaling of all amplitudes with the same multiplicative factor. The other two cost functionals are non-homogenous and violate scaling. The cost-functional
even allows for a catastrophic, “crash landing” approach to the optimum [
3]. Cost-functional
performs a little better than the other two compared to the tolerance level of
in relative error.
Figure 1,
Figure 2,
Figure 3 and
Figure 4 show various patterns of competition between “cusps” induced by penalty terms and “folds” originating from the rest of the terms. Is it possible to establish a more detailed correspondence with Thom’s theory of catastrophes [
3]?
None of the approaches can consistently produce the best results for each and every problem. Most often, the best results are demonstrated by some other method than only the one mentioned just above. Being robust and being the best method simultaneously seems not attainable.
The approach applied here to the summation of asymptotic series in application to critical properties parallels current understanding of complex systems in their most general features. Certainly, the point is only about certain convergences of considerations from the two fields and not about deliberate developments.
In particular, criticality and power laws were considered in the limit of comparably large values of variables as emergent phenomena, since the underlying expansion at comparably small values of variables has rather different polynomial forms. Emergence and complexity are not equivalent but often related [
47,
48].
In addition, the study is concerned with cases when there are multiple solutions to the optimization problems, while the complex systems are understood to exist on the boundary or edge of chaos [
49], when uncertainty in their behavior arises but predictability still exists [
50]. Non-uniqueness of solutions may be seen as a manifestation of inherent chaos embedded into extrapolation with asymptotic truncated series, which could be overcome by imposing constraints through transformations, approximants, asymptotic conditions, and cost-functionals.
Finally, the iterated roots positioned at the core of the approach to extrapolation and criticality may be seen as self-referential constructs [
51,
52], with their shape remaining formally the same in each order and the parameters passed from the lower orders to higher orders or vice versa, as can be seen from Equation (
4).
One can think that the parallels outlined above arise because asymptotic series are implicitly considered as an imprint left by the complex physical system and should be treated as such when a patently complicated problem of assigning meaningful values to asymptotic series at infinity is considered [
53].