Abstract
In this article, we present generalized conditions of three-step iterative schemes for solving nonlinear equations. The convergence order is shown using Taylor series, but the existence of high-order derivatives is assumed. However, only the first derivative appears on these schemes. Therefore, the hypotheses limit the utilization of the schemes to operators that are at least nine times differentiable, although the schemes may converge. To the best of our knowledge, no semi-local convergence has been given in the setting of a Banach space. Our goal is to extend the applicability of these schemes in both the local and semi-local convergence cases. Moreover, we use our idea of recurrent functions and conditions only on the derivative or divided differences of order one that appear in these schemes. This idea can be applied to extend other high convergence multipoint and multistep schemes. Numerical applications where the convergence criteria are tested complement this article.
MSC:
49M15; 47H17; 65J15; 65G99; 41A25
1. Introduction
Let M and denote Banach spaces, D stand for an open set and be a continuous operator.
We denote by a solution of the nonlinear equation
Iterative schemes are utilized for solving the nonlinear Equation (1). A plethora of iterative schemes have been employed for approximating [1,2].
In this article, we study the generalized three-step iterative schemes defined for by
where and
This scheme generalizes numerous others already in the literature [3,4,5]. If, e.g.,
or
or
then Newton–Traub-type methods are obtained.
The convergence order of the specialized schemes was shown to be three, five, and eight, respectively, using Taylor expansions. In the case of order three, the fourth derivative is used. Hence, the assumptions on the ninth derivative reduce the applicability of these schemes [2,4,5,6]. In particular, even a simple scalar equation cannot be handled with the existing results.
For example: Let Define scalar function on D by
Notice that solves equation and the third derivative is given by
Obviously, is not bounded on Therefore, the convergence of the scheme (2) is not guaranteed by the previous analyses in [2,4,5,6,7,8]. A plethora of other choices can be found in [4,5,6,7,8]. Therefore, it is important to study the local as well as the semi-local convergence under unifying convergence and weaker than before criteria.
There are two important types of convergence: The semi-local and the local. The semi-local is based on the information about an initial guess to provide criteria guaranteeing the convergence of the scheme; while the local one is based on the information around a solution to find estimates of the radii of the convergence balls.
The local convergence results are important, although the solution is generally unknown since the convergence order of the scheme can be determined. This type of result also demonstrates the degree of difficulty in choosing initial guesses. There are cases when the radius of convergence of the scheme can be found without knowing the solution.
As an example, let Suppose that function F satisfies an autonomous differential [4,6] equation of the form
where S is a continuous function. Notice that or In the case of , we can choose (see also the numerical section).
Moreover, the local results can apply to projection schemes such as Arnoldi’s, the generalized minimum residual scheme (GMRES), the generalized conjugate scheme (GCS) for combined Newton/finite projection schemes, and in relation to the mesh independence principle to develop the cheapest and most efficient mesh refinement techniques [5,7,9].
In this article, we introduce a majorant sequence and also use our idea of recurrent functions to extend the applicability of the scheme (2). Our analysis includes error bounds and results on the uniqueness of based on computable Lipschitz constants not given before in [2,4,5,6,7,8] and in other similar studies using the Taylor series. Our idea is very general. Therefore, it applies to other schemes too [9,10,11,12,13,14].
The rest of the article is set up as follows: In Section 2, we present the results of the local analysis. Section 3 contains the semi-local analysis, whereas in Section 4, special cases are discussed. The numerical experiments are presented in Section 5. Concluding remarks are given in the last Section 6.
2. Local Analysis
Let and be given positive constants. Define function on the interval by
Notice that solves equation Set Moreover, define function on the interval by
Then, and as Denote by the minimal root of function guaranteed to exist by the intermediate value theorem on the interval Furthermore, define function on the interval by
for It follows that and as Denote by the minimal root of function in the interval
We then show that r defined by
is a radius of convergence for scheme (2). Set It then follows that for all
and
hold.
Denote by the open ball with center and of radius Moreover, the ball denotes the closure of the ball Furthermore, by , we denote the Fréchet derivative of operator
The following conditions are needed to show the local convergence of scheme (2). Suppose:
- (A1)
- There exists a simple solution of equation
- (A2)
- for all and some Set
- (A3)
- for all and some
- (A4)
- for all and some constant
- (A5)
- for all and some constant
- (A6)
The main local convergence result follows for scheme (2).
Theorem 1.
Proof.
Mathematical induction is employed to show assertions (11)–(13). Let Using (A1) and (A2), we obtain
It follows by (7) and the Banach lemma on invertible operators [2] that and
In particular, iterate is well defined by the first substep of method (2) and (14) for Then, we can write by this substep
Then, in view of estimate (15) (for ), conditions (A1), (A2), (A3), and identity (15), we get
where we also used identity
since
and
and the triangle inequality. It follows from (16), that iterate and (11) holds for Then, using condition (A4),
That is
and iterate exists by the second substep of method (2) for Then, similarly to the derivation of identity (15), we can also write by this substep
Hence, iterate and (12) holds for Then, by using (A5), we obtain
The uniqueness of the solution’s result follows.
Proposition 1.
Suppose that there exists a simple solution of equation and (A3) holds. Set Then, element is the only solution of equation in region
Proof.
Consider with Define the linear operator Then, by applying condition (A3)
It follows that the linear operator Q is invertible. Then, the approximation gives Hence, we conclude that □
Remark 1.
A similar result was given in ([15], Theorem 1) in the special case when and However, this non-affine invariant form result is not correct, since it corresponds to the (11) estimate which is
but which is not implied by (A2). Hence, the proof of Theorem 1 in [15] breaks down at this point. Notice also that in [15] they used and
3. Semi-Local Analysis
The semi-local analysis of iterative scheme (2) is based on some Lipschitz-type conditions relating operators and linear operators to some parameters. Moreover, sequence is majorized by some scalar sequences depending on some parameters. Suppose:
- (H1)
- There exist such that and
- (H2)
- for all and some Set
- (H3)
- where for all and are taken from method (26) (or for all ), and and are positive constants depending on operators and
- (H4)
- for some to be given later.
As can be seen by the proof of Theorem 2 that follows the iterates, lies in the set which is a more accurate domain than since This way, at least as tight constants are obtained than if conditions (H3) and (H4) hold only in D (see also the numerical section).
We chose the last two conditions in (H3) this way. However, other choices are also possible [1,2,3,4]. Notice that if and then respectively, and even smaller constants “a” are obtained, if replaces
Moreover, we define the scalar sequence by
This sequence shall be shown to be majorizing for scheme in Theorem 2. However, first, a convergence result for it is needed.
We then develop results on the convergence of sequence
Lemma 1.
Suppose
hold for all Then, sequence is such that and
Proof.
It follows from (26) and (27) that sequence is nondecreasing, bounded from above by and as such it converges to its unique least upper bound
□
The semi-local convergence of method (2) follows next.
Theorem 2.
Under conditions (H1)–(H4), further suppose: conditions of Lemma 1 hold and in (H4). Then, the sequence generated by method (2) exists in stays in and converges to a solution of equation Moreover, the following estimates hold
and
Proof.
Mathematical induction is used to show (29)–(31). Using (H1) and (27)
so iterate and (56) holds for Let It then follows from (H3) that
That is,
and iterate is well defined by the second substep of method (26) for By the first substep of method (2)
and
Hence, (29) holds for and
Therefore, iterate, As in (31), we obtain
By the second substep of method (2), we can write
Consequently
Then, we obtain
and
That is, iterate and (31) holds for Moreover, we can write
and
so and (29) holds for Simply revisit the preceding estimations with replacing respectively, to terminate the induction for items (29)–(31). Sequence is complete as convergent. In view of (29)–(31), sequence is also complete and as such, it converges to some By letting in the estimate
and using the continuity of we conclude that □
A uniqueness result follows.
Proposition 2.
Under the conditions of Theorem 2, further suppose that there exists such that
Set Then, the element is the only solution of equation in the region
Proof.
Let be such that Then, as in Proposition 1, we obtain
Therefore, we deduce that □
4. Special Cases
Let and Then, method (2) reduces to
This is Newton’s three-step method also called by some Traub’s extended three-step method. It seems to be the most interesting special case of method (2) to consider as an application. Moreover, the semi-local convergence of it uses our new idea of recurrent functions, and the resulting convergence criteria are weaker than those in earlier works for method (32) using the Kantorovich condition [2,4,7,8] (as can also be seen in Example 5.2). Moreover, the error bounds are tighter and the information on the location of the solution is more precise than in the aforementioned works. Finally, in Lemma 2, we gave even weaker convergence criteria for method (32). Hence, this is clearly a most revealing special case to consider, since it can also be connected to earlier works and improve them too.
The following conditions are used.
Suppose:
- (H1)
- There exists such that and
- (H2)
- for all and some Set
- (H3)
- For eachfor all and (or all ) and some
- (H4)
- for some to be given later.
Notice that condition (H3) was used for all and constants [2,4,7,8] as well as for all with constant K [1,3]. That is:
- (M1)
- For each
- (M2)
- For eachIt follows by these definitions thatHence, any analysis using L improves earlier ones using or K (see also the numerical section). The sequence defined byshall be shown to be majorizing for method (32). However, first we need some convergence results for it.
Notice that the corresponding sequences are
We assume that Otherwise, replace K by in sequence (35). If follows from (34) and these definitions that
and
(if these limits exist). Hence, the new majorizing sequence is more precise. The convergence criteria for sequences (35) [1,3] and (36) [2,4,7,8] are:
and
respectively. However, the convergence criterion for sequence (34) is
Notice that
Condition (40) is weakened further in Lemma 3. It is worth noticing that these benefits are obtained under the same computational cost, since in practice, the computation of the Lipschitz constant requires that of and L as special cases. Notice that criterion (39) is due to Kantorovich [2].
Then, two convergence results for sequence (34) are presented.
Lemma 2.
Suppose
Then, sequence is such that and
Proof.
See Lemma 1. □
Next, some stronger conditions than (42) are given but are easier to show. However, first, we define polynomials on the interval by
and parameter by
Notice that whereas the other two roots of p are negative by the Descarte’s rule of signs. Define the parameters
Then, we show:
Lemma 3.
Suppose that
Then, the sequence generated by (34) is nondecreasing, bounded from above by and converges to its unique least upper bound Moreover, the following items hold
and
Proof.
Induction is utilized for items
and
These estimates hold for by (34) and (43). Suppose they hold for all integers smaller or equal to Then, we obtain
similarly,
Then, evidently, (47) holds if
or
By the definition of we can find a relationship between two consecutive functions:
In particular, by the definition of p, we obtain
Let function
It follows by the definition of and (54) that
Consequently, assertion (51) holds if
which is true by the right hand side of inequality (43). Similarly, to show (48)
or
This time, we also have
and for
at Moreover, (49) holds if
or
However, we have
so
That is, (55) holds if However, again, we obtain
Therefore, assertion (55) holds again by (45). Furthermore, (50) holds by (34) and (47)–(49). The induction for items (47)–(50) is completed. Hence, we deduce and □
5. Numerical Example
We verify convergence criteria using method (32). Moreover, we compare Lipschitz constants and In particular, the first example is used to show that the ratio can be arbitrarily small.
Example 1.
Let Define function
where are fixed parameters. Then, clearly for large and small, can be (arbitrarily) small, so that
The parameters and are computed in the next example. Moreover, the convergence criteria (46)–(48) and those of Lemma 3 are compared.
Example 2.
Let Let us consider a scalar function F defined on the set for by
Choose Then, we obtain the estimates
for all so
for all and so
for all and
Notice that for all
Next, set Then, we have
Define function on the interval by
Then, we obtain by this definition that
where is the critical point of function Notice that It follows that this function is decreasing on the interval and increasing on the interval since and So, we can set
and
However, if then
where and for all Then, criterion (39) is not satisfied for all Hence, there is no guarantee that scheme (34) converges to Moreover, our earlier criterion (38) holds for Furthermore, the new criterion by solving becomes
where This condition holds for Clearly, the new results extend the range of values q for which scheme (34) converges.
This range can be extended even further if we apply Lemma 2. Indeed, choose , and we have the following Table 1, showing that the conditions of Lemma 2 are satisfied.
Table 1.
Sequence (32).
Example 3.
Consider and Then, the boundary value problem (BVP) [4]
can be also given as
where σ is a constant and is the Green’s function
Consider as
Let us set and Then, clearly since If Then, conditions (H1)–(H4) are satisfied for
Hence,
The next two examples concern the local convergence of method (34) and the radii were computed using Formula (6) and the functions
Example 4.
If is equipped with the max-norm, consider given as
We obtain
Then, since conditions (A1)–(A5) hold provided that Then, the radii are:
Example 5.
Consider the motion system
with Let Let , , Let function on D for given as
The Fréchet derivative is given by
Notice that Let with Moreover, the nor for is
We need to verify conditions (A1)–(A5). To achieve this, we study on We have hence and
so Then, This time we obtain
where
Then, we have for
Moreover,
where We can set
Then, the radii are:
In the last example, we revisit the motivational example given in the introduction, where we apply scheme (32).
6. Conclusions
Conditions for the convergence of generalized three-step schemes are presented for both the local as well as semi-local case. The sequences generated by these schemes approximate solutions of equation that are locally unique. The convergence conditions depend on the divided difference of the order of one or the derivative, which appears on the schemes. However, this is not the case with earlier articles utilizing high-order derivatives, which do not appear in the schemes. Moreover, the error analysis is tighter because we show that the iterates remain in a stricter domain than in earlier articles. Hence, the utilization of these schemes is extended with the same or even weaker conditions. Our process does not depend on these schemes. Therefore, it can be employed similarly to extend the usage of the other schemes [9,10,15,16,17,18].
Author Contributions
Conceptualization, S.R., I.K.A., S.G. and C.I.A.; methodology, S.R., I.K.A., S.G. and C.I.A.; software, S.R., I.K.A., S.G. and C.I.A.; validation, S.R., I.K.A., S.G. and C.I.A.; formal analysis, S.R., I.K.A., S.G. and C.I.A.; investigation, S.R., I.K.A., S.G. and C.I.A.; resources, S.R., I.K.A., S.G. and C.I.A.; data curation, S.R., I.K.A., S.G. and C.I.A.; writing—original draft preparation, S.R., I.K.A., S.G. and C.I.A.; writing—review and editing, S.R., I.K.A., S.G. and C.I.A.; visualization, S.R., I.K.A., S.G. and C.I.A.; supervision, S.R., I.K.A., S.G. and C.I.A.; project administration, S.R., I.K.A., S.G. and C.I.A.; funding acquisition, S.R., I.K.A., S.G. and C.I.A. All authors have read and agreed to the published version of the manuscript.
Funding
This research received no external funding.
Institutional Review Board Statement
Not applicable.
Informed Consent Statement
Not applicable.
Data Availability Statement
Not applicable.
Acknowledgments
We would like to express our gratitude to the reviewers for the constructive criticism of this article.
Conflicts of Interest
The authors declare no conflict of interest.
References
- Argyros, I.K.; Hilout, S. Weaker conditions for the convergence of Newton’s method. J. Complex. 2012, 28, 364–387. [Google Scholar] [CrossRef] [Scilit]
- Cordero, A.; Torregrosa, J.R. Variants of Newton’s method using fifth-order quadrature formulas. Appl. Math. Comput. 2007, 190, 686–698. [Google Scholar] [CrossRef] [Scilit]
- Argyros, I.K. Unified Convergence Criteria for Iterative Banach Space Valued Methods with Applications. Mathematics 2021, 9, 1942. [Google Scholar] [CrossRef] [Scilit]
- Argyros, I.K. The Theory and Applications of Iteration Methods, 2nd ed.; Engineering Series; CRC Press, Taylor and Francis Group: Boca Raton, FL, USA, 2022. [Google Scholar]
- Kou, J.; Wang, X.; Li, Y. Some eight order root finding three-step methods, Commun. Nonlinear Sci. Numer. Simulat. 2010, 15, 536–544. [Google Scholar] [CrossRef] [Scilit]
- Argyros, I.K.; Magrenan, A.A. A Contemporary Study of Iterative Methods; Elsevier (Academic Press): New York, NY, USA, 2018. [Google Scholar]
- Grau-Sanchez, M.; Grau, A.; Noguera, M. Ostrowski type methods for solving system of nonlinear equations. Appl. Math. Comput. 2011, 218, 2377–2385. [Google Scholar] [CrossRef] [Scilit]
- Homeier, H.H.H. A modified Newton method with cubic convergence: The multivariate case. J. Comput. Appl. Math. 2004, 169, 161–169. [Google Scholar] [CrossRef] [Scilit]
- Kantorovich, L.V.; Akilov, G.P. Functional Analysis; Pergamon Press: Oxford, UK, 1982. [Google Scholar]
- Proinov, P.D. New general convergence theory for iterative processes and its applications to Newton–Kantorovich type theorems. J. Complex. 2010, 26, 3–42. [Google Scholar] [CrossRef] [Scilit]
- Sharma, J.R.; Arora, H. Efficient derivative - free numerical methods for solving systems of nonlinear equations. Comp. Appl. Math. 2016, 35, 269–284. [Google Scholar] [CrossRef] [Scilit]
- Xiao, X.; Yin, H. Achieving higher order of convergence for solving systems of nonlinear equations. Appl. Math. Comput. 2017, 311, 251–261. [Google Scholar] [CrossRef] [Scilit]
- Noor, M.A.; Waseem, M. Some iterative methods for solving a system of nonlinear equations. Comput. Math. Appl. 2009, 57, 101–106. [Google Scholar] [CrossRef] [Scilit]
- Traub, J.F. Iterative Methods for the Solution of Equations; Prentice Hall: Englewood Cliffs, NJ, USA, 1964. [Google Scholar]
- Ezquerro, J.A.; Hernandez, M.A. Newton’s Method: An Updated Approach of Kantorovich’s Theory; Birkhãuser: Cham, Switzerland, 2018. [Google Scholar]
- Nashed, M.Z.; Chen, X. Convergence of Newton-like methods for singular operator equations using outer inverses. Numer. Math. 1993, 66, 235–257. [Google Scholar] [CrossRef] [Scilit]
- Shakhno, S.M.; Gnatyshyn, O.P. On an iterative Method of order 1.839... for solving nonlinear least squares problems. Appl. Math. Appl. 2005, 161, 253–264. [Google Scholar]
- Verma, R. New Trends in Fractional Programming; Nova Science Publisher: New York, NY, USA, 2019. [Google Scholar]
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).