Abstract
The aim of this paper is to present a new semi-local convergence analysis for Newton’s method in a Banach space setting. The novelty of this paper is that by using more precise Lipschitz constants than in earlier studies and our new idea of restricted convergence domains, we extend the applicability of Newton’s method as follows: The convergence domain is extended; the error estimates are tighter and the information on the location of the solution is at least as precise as before. These advantages are obtained using the same information as before, since new Lipschitz constant are tighter and special cases of the ones used before. Numerical examples and applications are used to test favorable the theoretical results to earlier ones.
1. Introduction
In this study we are concerned with the problem of approximating a locally unique solution of equation
where G is a Fréchet-differentiable operator defined on a nonempty, open convex subset D of a Banach space with values in a Banach space .
Many problems in Computational disciplines such us Applied Mathematics, Optimization, Mathematical Biology, Chemistry, Economics, Medicine, Physics, Engineering and other disciplines can be solved by means of finding the solutions of equations in a form like Equation (1) using Mathematical Modelling [,,,,,,]. The solutions of this kind of equations are rarely found in closed form. That is why most solutions of these equations are given using iterative methods. A very important problem in the study of iterative procedures is the convergence region. In general this convergence region is small. Therefore, it is important to enlarge the convergence region without additional hypotheses.
The study of convergence of iterative algorithms is usually centered into two categories: Semi-local and local convergence analysis. The semi-local convergence is based on the information around an initial point, to obtain conditions ensuring the convergence of theses algorithms while the local convergence is based on the information around a solution to find estimates of the computed radii of the convergence balls.
Newton’s method defined for all by
is undoubtedly the most popular method for generating a sequence approximating , where is an initial point. There is a plethora of convergence results for Newton’s method [,,,,,,,,,,,]. We shall increase the convergence region by finding a more precise domain where the iterates lie leading to smaller Lipschitz constants which in turn lead to a tighter convergence analysis for Newton’s method than before. This technique can apply to improve the convergence domain of other iterative methods in an analogous way.
Let us consider the conditions:
There exist and such that
There exists such that the Lipschitz condition
holds for all .
Then, the sufficient convergence condition for Newton’s method is given by the famous for its simplicity and clarity Kantorovich sufficient convergence criterion for Newton’s method
Let us consider a motivational and academic example to show that this condition is not satisfied. Choose , , , and define function G on D by
Then, we have . Then, the Kantorovich condition is not satisfied, since for all . We set to be the set of point satisfying Equation (3). Hence, there is no guarantee that Newton’s sequence starting at converges to .
2. Semi-Local Convergence Analysis
We need an auxiliary result on majorizing sequences for Newton’s method.
Lemma 1.
Let , , , and be parameters. Suppose that:
where
and
holds. Then, scalar sequence given by
is well defined, increasing, bounded from above by
and converges to its unique least upper bound which satisfies
where . Moreover, the following estimates hold:
and
Proof.
By induction, we show that
holds for all . Estimate Equation (10) is true for by Equation (4). Then, we have by Equation (5)
and for
Assume that Equation (10) holds for all natural integers . Then, we get by Equations (5) and (10) that
and
Estimate Equation (11) motivates us to define recurrent functions on by
We need a relationship between two consecutive functions . We get that
Therefore, we deduce that
Estimate Equation (11) is satisfied, if
Using Equation (12) we obtain that
Let us now define function on by
Then, we have by Equation (14) and the choice of that
Hence, Equation (13) is satisfied, if
Using Equation (11) we get that
Let , stand, respectively for the open and closed ball in with center and of radius .
The conditions for the semi-local convergence are:
- is Fréchet differentiable and there exist , such that and
- There exists such that for all
- and there exists such thatfor all .
- There exists such thatwhere .
- There exists such that for all
Notice that . Clearly, we have that
and can be arbitrarily large []. It is worth noticing that – are not additional to hypotheses, since in practice the computation of Lipschitz constant T requires the computation of the other constants as special cases.
Next, first we present a semi-local convergence result relating majorizing sequence with Newton’s method and hypotheses .
Theorem 1.
Suppose that hypotheses , hypotheses of Lemma 1 and hold, where is given in Lemma 1. Then, sequence generated by Newton’s method is well defined, remains in and converges to a solution of equation . Moreover, the following estimates hold
and
where sequence is given in Lemma 1. Furthermore, if there exists such that
then, the solution of equation is unique in .
Proof.
We use mathematical induction to prove that
and
Let .
Then, we obtain that
which implies . Note also that
Hence, estimates Equations (20) and (21) hold for . Suppose these estimates hold for . Then, we have that
and
for all . Using Lemma 1 and the induction hypotheses, we get in turn that
where
It follows from Equation (22) and the Banach lemma on invertible operators that exists and
Using iteration of Newton’s method, we obtain the approximation
Moreover, by iteration of Newton’s method, Equations (23) and (25) and the induction hypotheses we get that
That is, we showed Equation (20) holds for all . Furthermore, let . Then, we have that
That is, . The induction for Equations (20) and (21) is now completed. Lemma 1 implies that sequence is a complete sequence. It follows from Equations (20) and (21) that is also a complete sequence in a Banach space and as such it converges to some (since is a closed set). By letting in Equation (25) we get . Estimate Equation (19) is obtained from Equation (18) (cf. [,,]) by using standard majorization techniques. The proof for the uniqueness part has been given in []. □
The sufficient convergence criteria for Newton’s method using the conditions , constants and given in affine invariant form are:
- Kantorovich []
- Argyros []
- Argyros []
- Argyros []
Conditions Equations (31) show by how many times (at most) the better condition improves the less better condition.
Remark 1.
- (a)
- The majorizing sequence , , given in [] under conditions and Equation (29) is defined byUsing a simple inductive argument and Equation (32) we get for thatandEstimates for Equations (5)–(7) show the new error bounds are more precise than the old ones and the information on the location of the solution is at least as precise as already claimed in the abstract of this study (see also the numerical examples). Clearly the new majorizing sequence is more precise than the corresponding ones associated with other conditions.
- (b)
- Condition can be replaced by (or ). In this case condition holds for all (or ).
- (c)
- If , then, we have that , since .
3. Numerical Examples
Example 1.
Returning back to the motivational example, we have .
We are now going to consider such an initial point which previous conditions cannot be satisfied but our new criteria are satisfied. That is, the improvement that we get with our new weaker criteria.
We get that
Using this values we obtain that condition Equation (4) is satisfied for , However, must also have that
which is satisfied for . That is, we must have , so there exist numerous values of p for which the previous conditions cannot guarantee the convergence but our new ones can. Notice that we have
Hence, the interval of convergence cannot be improved further under these conditions. Notice that the convergence criterion is even weaker than the corresponding one for the modified Newton’s method given in [] by .
For example, we choose different values of p and we see in Table 1.
Table 1.
Convergence of Newton’s method choosing , for different values of p.
Example 2.
Consider . Let , such that and G defined on as
where is a given function, λ is a real constant and the kernel μ is the Green function. In this case, for all , is a linear operator defined on by the following expression:
If we choose , it follows
Hence, if
is defined and
Consider , we get
and
By these values we conclude that conditions (26)–(29) are not satisfied, since
but condition (2.27) and condition (4) are satisfied, since
and
Hence, Newton’s method converges by Theorem 1.
4. Application: Planck’s Radiation Law Problem
We consider the following problem []:
which calculates the energy density within an isothermal blackbody. The maxima for occurs when density . From (36), we get
that is when
After using the change of variable and reordering terms, we obtain
As a consequence, we need to find the roots of Equation (39).
We consider and we obtain
and
So are satisfied. Moreover, as , then
which satisfies
and that means that conditions of Lemmal 1 are also satisfied. Finally, we obtain that
Hence, Newton’s method converges to the solution by Theorem 1.
Author Contributions
All authors have contributed in a similar way.
Funding
This research was supported in part by Programa de Apoyo a la investigación de la fundación Séneca-Agencia de Ciencia y Tecnología de la Región de Murcia 19374/PI/14, by the project MTM2014-52016-C2-1-P of the Spanish Ministry of Science and Innovation.
Conflicts of Interest
The authors declare no conflict of interest.
References
- Amat, S.; Busquier, S.; Gutiérrez, J.M. Geometric constructions of iterative functions to solve nonlinear equations. J. Comput. Appl. Math. 2003, 157, 197–205. [Google Scholar] [CrossRef]
- Amat, S.; Busquier, S. Third-order iterative methods under Kantorovich conditions. J. Math. Anal. Appl. 2007, 336, 243–261. [Google Scholar] [CrossRef]
- Argyros, I.K. A semi-local convergence analysis for directional Newton methods. Math. Comput. 2011, 80, 327–343. [Google Scholar] [CrossRef]
- Argyros, I.K.; Magreñán, Á.A. Iterative Methods and Their Dynamics with Applications: A Contemporary Study; CRC Press: Bocaratón, FL, USA, 2017. [Google Scholar]
- Farhane, N.; Boumhidi, I.; Boumhidi, J. Smart Algorithms to Control a Variable Speed Wind Turbine. Int. J. Interact. Multimed. Artif. Intell. 2017, 4, 88–95. [Google Scholar] [CrossRef]
- Kantorovich, L.V.; Akilov, G.P. Functional Analysis; Pergamon Press: Oxford, UK, 1982. [Google Scholar]
- Kaur, R.; Arora, S. Nature Inspired Range Based Wireless Sensor Node Localization Algorithms. Int. J. Interact. Multimed. Artif. Intell. 2017, 4, 7–17. [Google Scholar] [CrossRef]
- Amat, S.; Busquier, S.; Negra, M. Adaptive approximation of nonlinear operators. Numer. Funct. Anal. Optim. 2004, 25, 397–405. [Google Scholar] [CrossRef]
- Argyros, I.K. On the Newton-Kantorovich hypothesis for solving equations. J. Comput. Math. 2004, 169, 315–332. [Google Scholar] [CrossRef]
- Argyros, I.K.; González, D. Extending the applicability of Newton’s method for k-Fréchet differentiable operators in Banach spaces. Appl. Math. Comput. 2014, 234, 167–178. [Google Scholar] [CrossRef]
- Argyros, I.K.; Hilout, S. Weaker conditions for the convergence of Newton’s method. J. Complex. 2012, 28, 364–387. [Google Scholar] [CrossRef]
- Argyros, I.K.; Hilout, S. On an improved convergence analysis of Newton’s method. Appl. Math. Comput. 2013, 225, 372–386. [Google Scholar] [CrossRef]
- Ezquerro, J.A.; Hernández, M.A. How to improve the domain of parameters for Newton’s method. Appl. Math. Lett. 2015, 48, 91–101. [Google Scholar] [CrossRef]
- Gutiérrez, J.M.; Magreñán, Á.A.; Romero, N. On the semi-local convergence of Newton-Kantorovich method under center-Lipschitz conditions. Appl. Math. Comput. 2013, 221, 79–88. [Google Scholar]
- Divya, J. Families of Newton-like methods with fourth-order convergence. Int. J. Comput. Math. 2013, 90, 1072–1082. [Google Scholar]
© 2019 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).