Abstract
This paper is devoted to the semilocal convergence, using centered hypotheses, of a third order Newton-type method in a Banach space setting. The method is free of bilinear operators and then interesting for the solution of systems of equations. Without imposing any type of Fréchet differentiability on the operator, a variant using divided differences is also analyzed. A variant of the method using only divided differences is also presented.
1. Introduction
For the approximation of a solution of a nonlinear equation , Newton-type methods are the first option. Under some regularity assumptions, the methods are at least second order convergent. The classical third order schemes, such as Halley or Chebyshev methods, evaluate second order Fréchet derivatives [1,2,3]. These evaluations are very time-consuming for systems of equations. Indeed, let us observe that for a nonlinear system of m equations and m unknowns, the first Fréchet derivative is a matrix with entries, while the second Fréchet derivative has entries. This implies a huge amount of operations in order to evaluate every iteration. In particular, these methods are hardly used in practice.
In this paper we study the following two-step method [4,5] that improves the order of Newton’s method up to third order, but without evaluating any second Fréchet derivative:
The basic advantage of this method is that, as the matrix that appears at each iteration is the same, only one decomposition is computed. In most real problems, the computational cost of solving a linear system is more expensive than some extra evaluations of the operator. Moreover, from a dynamical point of view [6] the method seem better than the classical two-point Newton method, that is
since the regions of non convergence are reduced.
The main assumption for obtaining convergence of third order iterative methods [2,7,8], is a Lipschitz condition in the second Fréchet derivatives,
With this hypothesis, and by choosing an initial guess such that exists and is sufficiently close to zero, cubic convergence is obtained. The Lipschitz condition (3) can be relaxed to a p-Hölder condition
or even to some ω-condition
where is a nondecreasing continuous function.
By means of this type of conditions we can ensure the convergence of the scheme (1).
Alternatively, since the scheme (1) only uses first derivatives, we could also consider the possibility of obtaining convergence by assuming the main condition just in the first derivatives, instead of in the second derivatives. There are many theories on the local and semilocal convergence of Newton’s type methods, see for instance [9,10,11,12,13,14,15,16,17,18].
Following [19,20,21,22], in [5] the semilocal convergence of (1) under ω-conditioned divided differences was analyzed. Remember that a continuous bounded linear operator associated to a nonlinear operator , is called a divided difference of first order for the operator F on the points x and y if . If F is Fréchet differentiable, then for all . Moreover, a divided difference satisfies an ω-condition if
where is a continuous function, which is nondecreasing in both variables.
In this paper, following [23], we expand the applicability of (1) relaxing the hypotheses of convergence. We also analyze a modification of scheme (1) using divided differences:
Here, the parameters can be considered as a control of the good approximation to the first Fréchet derivative. For this method we are able to obtain convergence without assuming any Fréchet differentiability in the operator F.
Other higher order methods, in some cases with a better behavior in the real case, have been proposed during the last few years [24,25,26,27]. The main advantage of the schemes studied in this paper is that it is not necessary to evaluate any bilinear operator (second order Fréchet derivatives or their approximations using divided differences).
The rest of the paper includes the semilocal convergence of both schemes using centered hypotheses expanding their applicability.
2. Semilocal Convergence Using Centered Hypotheses
Convergence theorems for Newton-type methods establish sufficient conditions on the operator and the first approximation to the solution in order to ensure that the sequence of iterates converges to a solution of the equation. In some works such as [19,20,21,22,28], convergence is established by assuming as a main hypothesis that the divided difference satisfies an ω-condition (6). In [5] we extend this theory to the method (1). Now we expand the applicability using centered hypotheses.
As pointed out in [5], we observe that this type of strategies to derive convergence are not applicable to the scheme (1) directly. The problem is the sign ‘+’ in the first step. In general, the iteration is not closer to the solution than . In order to obtain convergence, we rewrite the scheme as a Newton-secant type method of one step, instead of the original two steps version of the scheme.
By using the definition of divided differences and the original form of the method
we obtain the following Newton-secant formula:
We will use the following notations:
Theorem 1 Let be two Banach spaces. Let B be a convex open subset of X, and suppose that there exists a first order divided difference of the Fréchet differentiable operator satisfying
and
where are continuous functions, nondecreasing in both variables, such that and . By definition .
Let . Assume that
(1) .
(2) .
(3) The equation
has a smallest positive root R, where .
If and , then and the method (9) is well defined, it remains in and converges to the unique solution of in .
Proof.
From the initial hypothesis, it follows that is well defined and
Thus, .
Since is a nondecreasing function, we have
Hence, is well defined and
In particular, and are well defined.
Similarly,
Hence, is well defined and
By the definition of the method (9) and of the divided differences, we get
Thus,
Now, we need to bound the first two terms adequately.
- A bound forFromwe obtain
- A bound forFirst, note thatBesides, we haveThus, we getandFinallyand thereforeOn the other hand, the relationis equivalent toBy definition thenMoreoversinceTherefore,Then, using and , we obtainThus, .
By using the same arguments together with an induction strategy we can prove the following facts:
- that is,
- From the estimatewe conclude that is a Cauchy sequence, and hence it converges to some .
- Sinceand when , we obtain that . Let us remark that, by ,Moreover, if is another solution of in , we haveTherefore, the operator is invertible. In particular, we have .
The main restriction in the theorem replaces the original restriction used in [5] that writes .
We can find simple numerical examples where only the centered hypotheses are satisfied, see for instance [23].
3. A Variant Using Only Divided Differences
For applications involving not Fréchet differentiable operators, we can consider a modification of the proposed method by using divided differences. Specifically, we will consider
where is computed in practice to satisfy
Here, is related to the computer precision and is a free parameter for the user, see [20,29].
By using a similar strategy to the one in Section 2, we can derive its semilocal convergence, but in this case without assuming any differentiability of the operator.
A possible theorem should be:
Theorem 2 Let be two Banach spaces. Let B be a convex open subset of X, and suppose that there exists a first order divided difference of the operator satisfying
and
where are continuous functions, nondecreasing in both variables, such that and . By definition .
Let . Assume that
(1) .
(2) .
(3) The equation
has a smallest positive root R, where .
If and , then and the method (14) is well defined, it remains in and converges to the unique solution of in .
4. Numerical Example
We consider
where and the kernel G is the Green function in .
We use a discretization process and transform Equation (18) into a finite dimensional problem and we obtain the following system of nonlinear equations:
where
We use the divided difference of first order of F as , where with .
If we choose the starting points and , method (9)) with the max-norm, we obtain , ,
and
The solutions of Equation (12) are
Then, by denoting it is easy to see that the following condition is verified
and
So, all the conditions of Theorem 1 are satisfied and a consequence we can ensure the convergence of method (9).
Acknowledgments
This activity has been partially supported by the grant SENECA 19374/PI/14, by the project MTM2014-52016-C2-1-P of the Spanish Ministry of Economy and Competitiveness and by the Universidad Internacional de La Rioja (UNIR), under the Plan Propio de Investigación, Desarrollo e Innovación (2013–2015). Research group: Matemática aplicada al mundo real (MAMUR).
Author Contributions
The contributions of the four authors have been similar. All authors have worked together to develop the present manuscript.
Conflicts of Interest
The authors declare no conflict of interest.
References
- Amat, S.; Busquier, S.; Gutiérrez, J.M. Geometric constructions of iterative functions to solve nonlinear equations. J. Comput. Appl. Math. 2003, 157, 197–205. [Google Scholar] [CrossRef]
- Amat, S.; Busquier, S. Third-order iterative methods under Kantorovich conditions. J. Math. Anal. Appl. 2007, 336, 243–261. [Google Scholar] [CrossRef]
- Ezquerro, J.A.; Hernández, M.A. Halley’s method for operators with unbounded second derivative. Appl. Numer. Math. 2007, 57, 354–360. [Google Scholar] [CrossRef]
- Kou, J.; Li, Y.; Wang, X. A modification of Newton’s method with third-order convergence. Appl. Math. Comput. 2007, 181, 1106–1111. [Google Scholar] [CrossRef]
- Amat, S.; Bermúdez, C.; Busquier, S.; Plaza, S. On a third-order Newton-type method free of bilinear operators. Numer. Linear Algebra Appl. 2010, 17, 639–653. [Google Scholar] [CrossRef]
- Amat, S.; Bermúdez, C.; Busquier, S.; Plaza, S. On two families of high order Newton type methods Original Research Article. Appl. Math. Lett. 2012, 25, 2209–2217. [Google Scholar] [CrossRef]
- Hernández, M.A.; Romero, N. On a characterization of some Newton-like methods of R-order at least three. J. Comput. Appl. Math. 2005, 183, 53–66. [Google Scholar] [CrossRef]
- Hernández, M.A.; Romero, N. General study of iterative processes of R-order at least three under weak convergence conditions. J. Optim. Theor. Appl. 2007, 133, 163–177. [Google Scholar] [CrossRef]
- Amat, S.; Busquier, S.; Gutiérrez, J.M. On the local convergence of secant-type methods. Int. J. Comput. Math. 2004, 81, 1153–1161. [Google Scholar] [CrossRef]
- Argyros, I.K. Improved error bounds for Newton-like iterations under Chen-Yamamoto assumptions. Appl. Math. Lett. 1992, 10, 97–100. [Google Scholar] [CrossRef]
- Argyros, I.K. A Newton-Kantorovich theorem for equations involving m-Fréchet differentiable operators and applications in radiative transfer. J. Comput. Appl. Math. 2001, 131, 149–159. [Google Scholar] [CrossRef]
- Argyros, I.K.; Szidarovszky, F. Theory and Applications of Iterative Methods; CRC-Press Inc.: Boca Raton, FL, USA, 1993. [Google Scholar]
- Brown, P.N. A local convergence theory for combined inexact-Newton finite-difference projection methods. SIAM J. Numer. Anal. 1987, 24, 402–434. [Google Scholar] [CrossRef]
- Gutiérrez, J.M. A new semi-local convergence theorem for Newton’s method. J. Comput. Appl. Math. 1997, 79, 131–145. [Google Scholar] [CrossRef]
- Kantorovich, L.V.; Akilov, G.P. Functional Analysis; Pergamon Press: Oxford, UK, 1982. [Google Scholar]
- Magreñán, Á.A. Estudio de la Dinámica del método de Newton Amortiguado. Ph.D. Thesis, The Universidad de La Rioja, La Rioja, Spain, 2013. [Google Scholar]
- Rheinboldt, W.C. An Adaptice Continuation Process for Solving Systems of Nonlinear Equations; Polish Academy of Sciences, Banach Center Publications: Greifswald, Germany, 1977; Volume 3, pp. 129–142. [Google Scholar]
- Ypma, T.J. Local convergence of inexact Newton’s method. SIAM J. Numer. Anal. 1984, 21, 583–590. [Google Scholar] [CrossRef]
- Amat, S.; Busquier, S. A modified secant method for semismooth equations. Appl. Math. Lett. 2003, 16, 877–881. [Google Scholar] [CrossRef]
- Amat, S.; Busquier, S. Convergence and numerical analysis of a family of two-step Steffensen’s methods. Comput. Math. Appl. 2005, 49, 13–22. [Google Scholar] [CrossRef]
- Hernández, M.A.; Rubio, M.J. A uniparametric family of iterative processes for solving nondifferentiable equations. J. Math. Anal. Appl. 2002, 275, 821–834. [Google Scholar] [CrossRef]
- Hernández, M.A.; Rubio, M.J. Semilocal convergence of the secant method under mild convergence conditions of differentiability. Comput. Math. Appl. 2002, 44, 277–285. [Google Scholar] [CrossRef]
- Argyros, I.K.; Hilout, S. Extending the Newton-Kantorovich hypothesis for solving equations. J. Comput. Appl. Math. 2010, 234, 2993–3006. [Google Scholar] [CrossRef]
- Kou, J. Some new sixth-order methods for solving non-linear equations. Appl. Math. Comput. 2007, 189, 647–651. [Google Scholar] [CrossRef]
- Kou, J.; Li, Y. A family of modified super-Halley methods with fourth-order convergence. Appl. Math. Comput. 2007, 189, 366–370. [Google Scholar]
- Kou, J.; Wang, X. Some variants of Chebyshev-Halley methods for solving nonlinear equations. Appl. Math. Comput. 2007, 189, 1839–1843. [Google Scholar] [CrossRef]
- Chun, C. Construction of third-order modifications of Newton’s method. Appl. Math. Comput. 2007, 189, 662–668. [Google Scholar] [CrossRef]
- Argyros, I.K.; Hilout, S. Weaker conditions for the convergence of Newton’s method. J. Complexity 2012, 28, 364–387. [Google Scholar] [CrossRef]
- Amat, S.; Busquier, S.; Candela, V.F. A class of quasi-Newton Generalized Steffensen’s methods on Banach spaces. J. Comput. Appl. Math. 2002, 149, 397–406. [Google Scholar] [CrossRef]
© 2015 by the authors; licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution license (http://creativecommons.org/licenses/by/4.0/).