A Family of Newton Type Iterative Methods for Solving Nonlinear Equations

In this paper, a general family of n-point Newton type iterative methods for solving nonlinear equations is constructed by using direct Hermite interpolation. The order of convergence of the new n-point iterative methods without memory is 2 requiring the evaluations of n functions and one first-order derivative in per full iteration, which implies that this family is optimal according to Kung and Traub’s conjecture (1974). Its error equations and asymptotic convergence constants are obtained. The n-point iterative methods with memory are obtained by using a self-accelerating parameter, which achieve much faster convergence than the corresponding n-point methods without memory. The increase of convergence order is attained without any additional calculations so that the n-point Newton type iterative methods with memory possess a very high computational efficiency. Numerical examples are demonstrated to confirm theoretical results.


Introduction
Solving nonlinear equations by iterative methods have been of great interest to numerical analysts.
The most famous one-point iterative method is probably Newton's Equation [1]: x k+1 = x k − f (x k )/f (x k ), which converges quadratically.However, the condition f (x) = 0 in a neighborhood of the required root is severe indeed for convergence of Newton method, which restricts its applications in practical.For resolving this problem, Wu in [2] proposed the following one-point iterative method where λ ∈ R, 0 < |λ| < +∞ and λ is chosen such that the corresponding function values λf (x k ) and f (x k ) have the same signs.This method converges quadratically under the condition λf (x k ) + f (x k ) = 0, while f (x k ) = 0 in some points is permitted.Wang and Zhang in [3] obtained the error equation of the Equation (1) as follows where e k = x k − a, c k = (1/k!)f (k) (a)/f (a), k = 2, 3, • • • and a is the root of the nonlinear equation f (x) = 0.
The convergence order and computational efficiency of the one-point iterative methods are lower than multipoint iterative methods.Multipoint iterative methods can overcome theoretical limits of one-point methods concerning the convergence order and computational efficiency.In recent years, many multipoint iterative methods have been proposed for solving nonlinear equations, see [4][5][6][7][8][9][10][11][12][13][14][15][16][17][18].Wang and Liu in [4] developed the following eighth-order iterative method without memory by Hermite interpolation methods where Using the same strategy, Kou in [5] presented a family of eighth-order iterative method without memory.The Equation ( 3) is a special case of the Kou's method.Petković in [6] claimed a general class of optimal n-point methods without memory by Hermite interpolation methods, which have the order of convergence 2 n and require evaluations of n functions and one first-order derivative.The Equation ( 3) is a special case of the Petković's n-point Method for n = 3.But, the Petković's n-point method gives no specific iterative scheme and error relation for n ≥ 4. In this paper, we construct a class of n-point iterative methods with and without memory by Hermite interpolation methods and give the specific iterative scheme and error relation for all n ≥ 2.
This paper is organized as follows.In Section 2, based on Wu's Equation [2] and Petković's n-point Equation [6], we derive a family of n-point iterative methods without memory for solving nonlinear equations.We prove that the order of convergence of the n-point methods without memory is 2 n requiring the evaluations of n functions and one first-order derivative in per full iteration.Kung and Traub in [7] conjectured that a multipoint iteration without memory based on n functional evaluations could achieve an optimal convergence of order 2 n−1 .The new methods without memory agree with the conjecture.Further accelerations of convergence speed are attained in Section 3. A family of n-point iterative methods with memory is obtained by using a self-accelerating parameter in per full iteration.This self-accelerating parameter is calculated using information available from the current and previous iterations.Numerical examples are given in Section 4 to confirm theoretical results.

The Optimal Fourth-, Eighth-and 2 n th Order Iterative Methods
Based on Wu's Equation [2] and Petković's n-point methods [6], we derive a general optimal 2 n th order family and write it in the following form: where is a constant and k being the iteration index.The entries y k,0 , • • • y k,n are approximations with the associated error e k,j = y k,j − a (j = 0, 1, Using the Taylor series and symbolic computation in the programming package Mathematica, we can find the order of convergence and the asymptotic error constant (AEC) of the n-point methods Equation (4) for n = 1, n = 2 and n = 3, respectively.For simplicity, we sometimes omit the iteration index n and write e instead of e k .The approximation x k+1 to the root a will be denoted by x.Regarding Equation (4), let us define The following abbreviations are used in the program. Out Out We obtain the asymptotic error constants of n-point methods Equation ( 4) with n = 1, 2, 3. Altogether, we can state the following theorem.
Theorem 1.Let I be an open interval and a ∈ I a simple zero point of a sufficiently differentiable function f : I → R. Then the new method defined by Equation (4) (n = 2)is fourth order, and satisfies the error equation the Equation (4) (n = 3) is eighth-order and satisfies the error equation where . The order of the convergence of the Equation ( 4) is analyzed in the following theorem.4) converges with at least 2 n th order and satisfies the error relation where Proof.We prove the theorem by induction.For n = 3, the theorem is valid by Theorem 1.Let us assume that Equation ( 10) is true for the intermediate error relations, then the intermediate error relations are of the form where Using Equations ( 4) and (11) and noting that e k,0 e k,0 e k,1 e k,2 Hence, by induction, we conclude that the error relations can be written in the following form

New Families of Iterative Methods with Memory
In this section we will improve the convergence order of the family Equation ( 4).We observe from Equation ( 13) that the order of convergence of the family Equation ( 4) is ), it can be proved that the order of the family Equation ( 4) would exceed 2 n .However, the exact values of f (a) and f (a) are not available in practice and such acceleration of convergence can not be realized.But we could approximate the parameter λ by λ k .The parameter λ k can be computed by using information available from the current and previous iterations and satisfies lim k→∞ λ k = −c 2 = −f (a)/(2f (a)), such that the 2 n th order asymptotic convergence constant to be zero in Equation (13).We consider the following three methods for λ k : where where where The parameter λ k is recursively calculated as the iteration proceeds using Equations ( 14)-( 16) in Equation (4).Substituting λ k instead of λ in Equation ( 4), we can obtain the following iterative method with memory where ), and the parameterλ k is calculated by using one of the Equations ( 14)-( 16) and depends on the data available from the current and the previous iterations.
Lemma 1.Let H m be the Hermite interpolating polynomial of the degree m that interpolates a function f at m distinct interpolation nodes and Proof.The error of the Hermite interpolation can be expressed as follows Differentiating Equation (20) at the point x = y k,0 , we obtain Taylor's series of derivatives of f at the point y k,0 ∈ I and ξ ∈ I about the zero a of f give where e ξ = ξ − a. Substituting Equations ( 24) and (25) into Equation ( 22), we have and The concept of the R-order of convergence [1] and the following assertion (see [8]) will be applied to estimate the convergence order of the iterative method with memory Equation ( 17).Now we can state the following convergence theorem for iterative method with memory Equation (17).Theorem 3. Let the varying parameter λ k in the iterative Equation ( 17) be calculated by Equation (14).If an initial approximation x 0 is sufficiently close to a simple zero a of f (x), then the R-order of convergence of the n-point Equation (17) with memory is at least 2 n + 2 n−3 for n ≥ 3 and at least (5 + √ 17)/2 ≈ 4.5616 for n = 2.
Proof.First, let us consider the case n ≥ 3 and assume that the iterative sequences {y k,n } and {y k,n−1 } have the R-order r and q, respectively, we have where D k,j (j ∈ R) tends to the asymptotic error constant D j when k → ∞.From Equation ( 13), we obtain the following error relations Using the Lemma 1 for m = 2, we obtain Substituting Equation (32) into Equations ( 30) and (31) instead of λ, we have By comparing exponents of e k−1 appearing in two pairs of relations Equations ( 29)-(33) and Equations ( 28)-(34), we get the following system of equations The solution of the system Equation ( 35) is given by r = 2 n + 2 n−3 and q = 2 n−1 + 2 n−4 .Therefore, the R-order of the methods with memory Equation ( 17) is at least r = 2 n + 2 n−3 for n ≥ 3.For example, the R-order of the three-point family Equation ( 17) is at least 9, the four-point family has the R-order at least 18, assuming that λ k is calculated by Equation (14).
The case n = 2 differs from the previous analysis; Hermit's interpolating polynomial is constructed at the nodes y k,0 , y k−1,1 .Substituting Equation (32) into Equation (2) and Equation ( 8) instead of λ, we have By comparing exponents of e k−1 appearing in two pairs of relations Equations ( 29)-(36) and Equations ( 28)-(37), we get the following system of equations Positive solution of the system Equation ( 38) is given by r = (5 + √ 17)/2 and q = (1 + √ 17)/2.Therefore, the R-order of the methods with memory Equations ( 17) with ( 14) is at least (5 + √ 17)/2 ≈ 4.5616 for n = 2. Theorem 4. Let the varying parameter λ k in the iterative Equation (17) be calculated by Equation (15).If an initial approximation x 0 is sufficiently close to a simple zero a of f (x), then the R-order of convergence of the n-point methods Equation (17) with memory is at least 2 n + 2 n−3 + 2 n−4 for n ≥ 4, at least 5 + √ 21 ≈ 9.5826 for n = 3 and at least Proof.The proof is similar to the Theorem 3.
Theorem 5. Let the varying parameter λ k in the iterative Equation ( 17) be calculated by Equation (16).If an initial approximation x 0 is sufficiently close to a simple zero a of f (x), then the R-order of convergence of the n-point Equation (17) with memory is at least 2 n + 2 n−3 + 2 n−4 + 2 n−5 for n ≥ 5, at least 10 + √ 92 ≈ 19.5917 for n = 4 and at least 5 + √ 23 ≈ 9.7958 for n = 3.
Proof.The proof is similar to the Theorem 3.

Numerical Results
Now, the new family Equation ( 4) without memory and the corresponding family Equation ( 17) with memory are employed to solve some nonlinear equations and compared with several known iterative methods.All algorithms are implemented using Symbolic Math Toolbox of MATLAB 7.0.For demonstration, we have selected three methods displayed below.
Petković-Ilić-Džunić method with memory ( PD, see [12] ) where z n = x n − γ n f (x n ).The parameterγ n can be calculated by the following three formulas: The absolute errors|x k − a|in the first four iterations are given in Tables 1-4, where a is the exact root computed with 2400 significant digits.The computational order of convergence ρ is defined by [19]: The iterative processes of the Equations ( 4) and ( 17) are given in Figure 1, where Equation (4) (n=1) is one-point method.The parameters of the Equations ( 4) and ( 17) are λ = λ 0 = 1.0.The initial value is x 0 = −1.3.The stopping criterium is |f (x)| < 10 −150 .We will call f (x) the nonlinear residual or residual.The Figure 1 is a semilog plot of residual history, the norm of the nonlinear residual against the iteration number.
Following test functions are used:

Conclusions
Figure 1 shows that the convergence speed of the multipoint iterative method is faster than the one-point iterative method.As shown in Tables 1 and 2, the results obtained with our methods without memory are better than the other methods without memory.From the results displayed in Tables 3 and 4, it can be concluded that the convergence of the tested multipoint Equation (17) with memory is remarkably fast.The R-order of convergence of the family Equation (17) with memory is increased by applying a self-accelerating parameter given by Equations ( 14)-( 16).In addition, above all, the increase of convergence order is obtained without any additional function evaluations, which indicates a very high computational efficiency of our methods with memory.

Theorem 2 .
Let I be an open interval and a ∈ I a simple zero point of a sufficiently differentiable function f : I → R. Then the n-point family Equation (

Figure 1 .
Figure 1.Iterative processes of different methods for the function f 1 (x).

Table 1 .
Numerical results for f 1 (x) by the methods without memory.

Table 2 .
Numerical results for f 2 (x) by the methods without memory.

Table 3 .
Numerical results for f 1 (x) by the methods with memory.

Table 4 .
Numerical results for f 2 (x)by the methods with memory.