Abstract
A plethora of higher order iterative methods, involving derivatives in algorithms, are available in the literature for finding multiple roots. Contrary to this fact, the higher order methods without derivatives in the iteration are difficult to construct, and hence, such methods are almost non-existent. This motivated us to explore a derivative-free iterative scheme with optimal fourth order convergence. The applicability of the new scheme is shown by testing on different functions, which illustrates the excellent convergence. Moreover, the comparison of the performance shows that the new technique is a good competitor to existing optimal fourth order Newton-like techniques.
MSC:
65H05; 41A25; 49M15
1. Introduction
Approximating the solution of nonlinear equations by iterative methods is an important problem in numerical analysis and applied sciences [,,]. In this study, we aim to explore derivative-free iterative methods for finding a multiple root of equation with multiplicity m, i.e., and .
Numerous higher order methods, either independent or based on the modified Newton’s method []:
have been studied in the literature (see, for example, [,,,,,,,,,,,,]). Such techniques require the information of either first order derivatives or both first and second order derivatives. On the contrary, higher order derivative-free methods to handle the case of multiple zeros are seldom explored in the literature. These methods are important in cases where the derivative of is expensive to compute. One such method is the Traub–Steffensen iteration [], which uses:
or
for the derivative in Newton Formula (1). Here, and is the first order divided difference. Then, the Newton method (1) takes the form of the modified Traub–Steffensen scheme:
Very recently, Kumar et al. [] and Sharma et al. in [,] proposed one-point, two-point, and three-point derivative-free methods with second, fourth, and eighth order convergence, respectively, to compute the multiple zeros. The number of function evaluations corresponding to second, fourth, and eighth order methods is two, three, and four, and so, as per the Kung–Traub hypothesis, these methods possess optimal convergence []. The main goal of this work is to construct derivative-free multiple root numerical methods of good computational efficiency, which means the iterative methods of high convergence order with the minimum number of function evaluations. This leads us to develop a two-step derivative-free scheme with fourth order convergence. The proposed scheme consumes only three function evaluations per full iteration, and hence, it is optimal in the sense of the Kung–Traub hypothesis []. The procedure is based on the classical Traub–Steffensen iteration (2) in the first step and the Traub–Steffensen-type iteration in the second step.
2. Development of the Scheme
In what follows, we develop an iterative scheme to compute a multiple root of equation with multiplicity . Let us consider the following two-step scheme based on (2):
where , , , are unknown parameters and . Observe that this scheme uses the first step as the Traub–Steffensen iteration (2) and the next step as the Traub–Steffensen-like iteration.
We consider principal analytic branches of since it is a one-to-m multi-valued function. Hence, it is convenient to treat it as the principal root. For example, the principal root is given by , with for ; this convention of for agrees with that of the command of Mathematica [] to be employed later in the sections of basins of attraction and numerical experiments.
For the sake of clarity, we prove the results separately for different cases depending on the multiplicity m. Firstly, we consider the case and prove the following result:
Theorem 1.
Let the mapping be analytic in a domain containing a multiple zero (say, α) having multiplicity . Suppose that the starter is sufficiently close to α, then the formula (3) has the convergence order four, provided that , , and .
Proof.
Let the error at the iteration be . Developing about by Taylor’s expansion and taking into account that , and , we obtain:
where for .
Furthermore, Taylor’s expansion of about yields:
where
Then, the first step of (3) yields:
Expanding about , it follows that:
We can obtain at least fourth order convergence by setting the coefficients of and simultaneously equal to zero. The resulting equations imply that:
Consequently, the above error equation reduces to:
This establishes the fourth order convergence. □
Theorem 2.
Using the assumptions of Theorem 1, the convergence order of Scheme (3) for the case is at least four, if and .
Proof.
Taking into account that , , and , the Taylor series development of about gives:
where for .
Similarly, the expansion of about yields:
where .
The expansion of about is:
It is clear that the fourth order convergence is achieved if we set the coefficients of and equal to zero. Then, some simple calculations yield:
Now, the error Equation (16) is given by:
Therefore, the theorem is established. □
We state the following theorems for the cases (without proof).
Theorem 3.
Using the conditions of Theorem 1, the order of convergence of Formula (3) when is at least four, if and . Moreover, the scheme satisfies the error equation:
where for .
Theorem 4.
Using the conditions of Theorem 1, the order of convergence of Formula (3) when is at least four, if and . Moreover, the scheme satisfies the error equation:
where for .
Theorem 5.
Using the conditions of Theorem 1, the order of convergence of Formula (3) when is at least four, if and . Moreover, the scheme satisfies the error equation:
where for .
Remark 1.
Observing the error equation of each of the above cases, we see that the parameter β does not appear in the equations for . This leads to the notion: when , the error equation in each such case would not contain the β term. We shall prove this fact in the next section.
3. Generalization of the Method
Based on the previous ideas for the case , we prove the fourth order convergence of Formula (3) by the following theorem:
Theorem 6.
Using the conditions of Theorem 1, the order of convergence of Formula (3) for the case is at least four, if , , . Moreover, the error equation in the scheme is given by:
where for .
Proof.
Taking into account that and , then Taylor’s series of about is:
Similarly, the expansion of about is:
where .
From the first step of Equation (3):
The expansion of around yields:
Make the coefficients of and simultaneously equal to zero to obtain fourth order convergence. The resulting equations yield:
As a result, the error equation is given by:
Thus, the theorem is proven. □
Remark 2.
Remark 3.
The parameter β used in the expression of appears only in the error expressions of the cases and not for (see Equation (25)). However, for the case , we have seen that this parameter is included in the coefficient of and in the higher order terms. These terms are lengthy to evaluate in general. Moreover, we do not need these in order to show the desired fourth order convergence.
Remark 4.
For future reference, the proposed method (3) is written as:
wherein we have considered . This iterative scheme satisfies the common conditions of Theorems 1, 2, and 6.
4. Basins of Attraction
Our point here is to analyze the new technique by a geometrical tool, namely the basins of attraction of the zeros of a polynomial function in the Argand plane. The examination of the basins of attraction of roots by the iterative scheme gives a significant idea about the convergence of the scheme. This thought was presented in [,,,,,,,]. In order to assess the basins, we take as the stopping condition for convergence, but to a maximum of 25 iterations. If this tolerance is not achieved in the required iterations, the procedure is dismissed with the result showing the divergence of the iteration function starting from . While drawing the basins, the following criterion is adopted: a color is allotted to every initial guess in the attraction basin of a zero. If the iterative formula beginning at the point converges, then it forms the basins of attraction with that assigned color, and if the formula fails to converge in the required number of iterations, then it is painted with black color.
We discuss the basins of attraction by applying the method (26) (choosing ) on the following two polynomials:
Problem 1.
In this example, we consider the polynomial , which has zeros with multiplicity two. For this situation, we utilize a square shape of size and allot the shading of yellow and blue to each underlying point in the attraction basin of zero “” and “”. The basins obtained for the method appear in Figure 1 for the parameter values . Observing the behavior of Method (3), we see that the basins become more qualitative as parameter β accepts small values.
Figure 1.
Basins of the new method for .
Problem 2.
Let us take the polynomial having zeros with multiplicity three. To see the dynamical view, we consider a square with shades of orange, yellow, and blue to each underlying point in the basins of attraction of zero “”, “”, and “”. Basins for proposed method (3) appear in Figure 2 corresponding to parameter values . Analyzing the shape of the basins, we see that the basins become enlarged with smaller values of parameter β.
Figure 2.
Basins of the new method for .
It is clear that the attraction basins show the convergence behavior and suitability of an iterative scheme relying on the conditions. In the event that we pick a starter in a zone where different basins of attraction meet one another, it is difficult to foresee which root will be attained by the method that starts in . Thus, the selection of in such a zone is not a wise decision. The graphics show that the dark zones and the zones with various hues are not appropriate to speculate about when we need to accomplish a specific root. The most alluring pictures show up when we have extremely perplexing wildernesses between basins of attraction. We close this segment with a comment that the nature of the proposed technique relies on the estimation of parameter . The smaller the estimation of , the better the convergence of the method.
5. Numerical Results
In order to check the performance and validity of the theoretical results, we apply the new method (NM) to solve some nonlinear problems. The theoretical fourth order of convergence is verified by using the formula of the approximate computational order of convergence (ACOC; see []):
The performance of NM is compared with some existing well-known optimal fourth order methods with and without derivative evaluations. For example, we consider the methods by Li-Liao-Cheng [], Li-Cheng-Neta [], Sharma-Sharma [], Zhou-Chen-Song [], Soleymani-Babajee-Lotfi [], Kansal-Kanwar-Bhatia [], and Sharma-Kumar-Jäntschi []. The methods are expressed as follows:
Li-Liao-Cheng method (LM-1):
Li-Cheng-Neta method (LM-2):
where
Sharma-Sharma method (SSM):
Zhou-Chen-Song method (ZM):
Soleymani-Babajee-Lotfi method (SM):
where
Kansal-Kanwar-Bhatia method (KM):
where
Sharma-Kumar-Jäntschi method (SM-1):
Sharma-Kumar-Jäntschi method (SM-2):
where .
The calculations were executed in the programmable package of the Mathematica software [] with higher precision. The results of the new method were obtained by choosing a value of for the parameter . The numerical results shown in Table 1, Table 2, Table 3 and Table 4 include: (i) the number of iterations that are needed to converge to the required solution such that , (ii) the estimated error in the first three iterations, (iii) the approximated computational order of convergence (ACOC) using Formula (27), and (iv) the elapsed CPU time to run the program measured by the Mathematica command “TimeUsed[ ]”.
Table 1.
Numerical results of the methods for . ACOC, approximate computational order of convergence; LM-1, Li-Liao-Cheng method; LM-2, Li-Cheng-Neta method; SSM, Sharma-Sharma method; ZM, Zhou-Chen-Song method; SM, Soleymani-Babajee-Lotfi method; KM, Kansal-Kanwar-Bhatia method; SM-1, Sharma-Kumar-Jäntschi method; SM-2, Sharma-Kumar-Jäntschi method; NM, new method.
Table 2.
Numerical results of the methods for .
Table 3.
Numerical results of the methods for .
Table 4.
Numerical results of the methods for .
The following numerical examples were selected for testing:
Example 1.
Consider the van der Waals equation:
which shows the nature of a real gas by the inclusion of parameters and in the ideal gas equation. The volume V in terms of the remaining parameters can be found by the equation:
For a given a set of values of and of a particular gas, one can find values of n, P, and T, so that the equation has three roots. For a particular set of values, we have:
This function has three zeros: one is a simple zero and the other is a repeated zero of multiplicity two. The methods were tested for initial guess to find the desired zero . The computed results are given in Table 1.
Example 2.
Let λ, c, T, k, and h be wavelength of the radiation, the speed of light, the absolute temperature of the black body, Boltzmann’s constant, and Planck’s constant, respectively. Then, the Planck law of radiation [] to find the energy density in a black body is given as:
One wants to determine the wavelength λ corresponding to the maximum energy density . From Equation (28), it follows that:
A maximum for ϕ will occur for , that is if:
Setting , the above equation assumes the form:
The following function can be obtained by considering the above case three times:
The trivial zero is not taken for discussion. The non-trivial zero can be guessed somewhere near , since for , the left-hand side of (29) is zero and the right-hand side is . In fact the expected root is obtained with the starter . Thereby, the wavelength (λ) for the maximum energy density is:
The numerical results are displayed in Table 2.
Example 3.
The problem of isentropic supersonic flow around a sharp expansion corner is considered. The mathematical expression between the Mach number before the corner (i.e., ) and after the corner (i.e., ) is defined by (see []):
where , γ being the specific heat ratio of the gas.
Given that , and , we solve the equation for . This case results in:
where .
Let us consider this equation four times, and so, the required function is:
This function possesses zero with multiplicity four. The required zero is calculated using starter . The results obtained by the methods are displayed in Table 3.
Example 4.
Lastly, the standard test function defined by:
is considered. The function has multiple imaginary zero of multiplicity five. We select the initial value to obtain the required zero of the function. The numerical results so produced are shown in Table 4.
It can be seen from the numerical results displayed in Table 1, Table 2, Table 3 and Table 4 that the proposed method supported the theoretical results proven in Section 2 and Section 3 and, like existing methods, possessed consistent convergence. Moreover, the CPU time consumed by the methods as shown in the tables proved computationally efficient nature of the new technique as compared to the CPU time of the considered existing methods of the same order. The main aim of applying the new derivative-free method on different nonlinear equations was purely to show its accuracy and consistency. Similar numerical testing, carried out for a number of problems of different types, confirmed the above conclusions to a good extent.
6. Conclusions
In the study, we proposed a derivative-free numerical method with optimal fourth order convergence for approximating the repeated roots of nonlinear equations. The analysis of the convergence under standard hypotheses proved the convergence order four. The method was employed to solve nonlinear problems including those arising from real-world applications. The performance was compared with existing techniques (with and without derivatives) of the same order. The testing of the numerical results showed the presented derivative-free method as a good competitor of the already established fourth order techniques that use derivative information in the algorithm. We conclude this work with a remark: the derivative-free method presented here can be a better choice compared to existing Newton-type schemes in the cases where derivatives are difficult to obtain or expensive to compute.
Author Contributions
Methodology and writing, original draft preparation, S.K. and D.K.; conceptualization and writing, review and editing, J.R.S. and D.K.; software, C.C.; formal analysis, P.A.; investigation, Y.-M.C. All authors read and agreed to the published version of the manuscript.
Funding
This work was supported by the Natural Science Foundation of China (Grant Nos. 61673169, 11701176, 11626101, 11601485).
Acknowledgments
The authors would like to thanks the worthy referees and editor for their valuable suggestions for our paper in Mathematics. This work was supported by the Yu-Ming Chu research grants under the Natural Science Foundation of China (Grant Nos. 61673169,11701176, 11626101, 11601485). Praveen Agarwal was very thankful to the SERB (project TAR/2018/000001), DST(project DST/INT/DAAD/P-21/2019, and INT/RUS/RFBR/308) for their necessary support.
Conflicts of Interest
The authors declare no conflict of interest.
References
- Tetsuro, Y. Historical Developments in Convergence Analysis for Newton’s and Newton-Like Methods. In Numerical Analysis: Historical Developments in the 20th Century; Brezinski, C., Wuytack, L., Eds.; Elsevier: Amsterdam, The Netherlands, 2001; pp. 241–263. [Google Scholar]
- Kantorovich, L.V. On Newton’s Method. In Collected Works on Approximation Analysis of the Leningrad Branch of the Institute; Trudy Mat. Inst. Steklov.; Academy of Sciences of the Soviet Union: Moscow, Russia, 1949; pp. 104–144. [Google Scholar]
- Argyros, I.K. Convergence and Applications of Newton-Type Iterations; Springer: New York, NY, USA, 2008. [Google Scholar]
- Schröder, E. Über unendlich viele Algorithmen zur Auflösung der Gleichungen. Math. Ann. 1870, 2, 317–365. [Google Scholar] [CrossRef]
- Hansen, E.; Patrick, M. A family of root finding methods. Numer. Math. 1977, 27, 257–269. [Google Scholar] [CrossRef]
- Dong, C. A family of multipoint iterative functions for finding multiple roots of equations. Int. J. Comput. Math. 1987, 21, 363–367. [Google Scholar] [CrossRef]
- Li, S.; Liao, X.; Cheng, L. A new fourth-order iterative method for finding multiple roots of nonlinear equations. Appl. Math. Comput. 2009, 215, 1288–1292. [Google Scholar]
- Li, S.G.; Cheng, L.Z.; Neta, B. Some fourth-order nonlinear solvers with closed formulae for multiple roots. Comput. Math. Appl. 2010, 59, 126–135. [Google Scholar] [CrossRef]
- Sharma, J.R.; Sharma, R. Modified Jarratt method for computing multiple roots. Appl. Math. Comput. 2010, 217, 878–881. [Google Scholar] [CrossRef]
- Zhou, X.; Chen, X.; Song, Y. Constructing higher-order methods for obtaining the multiple roots of nonlinear equations. J. Comput. Appl. Math. 2011, 235, 4199–4206. [Google Scholar] [CrossRef]
- Sharifi, M.; Babajee, D.K.R.; Soleymani, F. Finding the solution of nonlinear equations by a class of optimal methods. Comput. Math. Appl. 2012, 63, 764–774. [Google Scholar] [CrossRef]
- Soleymani, F.; Babajee, D.K.R.; Lotfi, T. On a numerical technique for finding multiple zeros and its dynamics. J. Egypt. Math. Soc. 2013, 21, 346–353. [Google Scholar] [CrossRef]
- Geum, Y.H.; Kim, Y.I.; Neta, B. A class of two-point sixth-order multiple-zero finders of modified double-Newton type and their dynamics. Appl. Math. Comput. 2015, 270, 387–400. [Google Scholar] [CrossRef]
- Geum, Y.H.; Kim, Y.I.; Neta, B. Constructing a family of optimal eighth-order modified Newton-type multiple-zero finders along with the dynamics behind their purely imaginary extraneous fixed points. J. Comp. Appl. Math. 2018, 333, 131–156. [Google Scholar] [CrossRef]
- Kansal, M.; Kanwar, V.; Bhatia, S. On some optimal multiple root-finding methods and their dynamics. Appl. Appl. Math. 2015, 10, 349–367. [Google Scholar]
- Behl, R.; Alsolami, A.J.; Pansera, B.A.; Al-Hamdan, W.M.; Salimi, M.; Ferrara, M. A new optimal family of Schrder’s method for multiple zeros. Mathematics 2019, 7, 1076. [Google Scholar] [CrossRef]
- Behl, R.; Salimi, M.; Ferrara, M.; Sharifi, S.; Alharbi, S.K. Some real-life applications of a newly constructed derivative free iterative scheme. Symmetry 2019, 11, 239. [Google Scholar] [CrossRef]
- Traub, J.F. Iterative Methods for the Solution of Equations; Chelsea Publishing Company: New York, NY, USA, 1982. [Google Scholar]
- Kumar, D.; Sharma, J.R.; Argyros, I.K. Optimal one-point iterative function free from derivatives for multiple roots. Mathematics 2020, 8, 709. [Google Scholar] [CrossRef]
- Sharma, J.R.; Kumar, S.; Jäntschi, L. On a class of optimal fourth order multiple root solvers without using derivatives. Symmetry 2019, 11, 1452. [Google Scholar] [CrossRef]
- Sharma, J.R.; Kumar, S.; Argyros, I.K. Development of optimal eighth order derivative-free methods for multiple roots of nonlinear equations. Symmetry 2019, 11, 766. [Google Scholar] [CrossRef]
- Kung, H.T.; Traub, J.F. Optimal order of one-point and multipoint iteration. J. Assoc. Comput. Mach. 1974, 21, 643–651. [Google Scholar] [CrossRef]
- Wolfram, S. The Mathematica Book, 5th ed.; Wolfram Media: Champaign, IL, USA, 2003. [Google Scholar]
- Vrscay, E.R.; Gilbert, W.J. Extraneous fixed points, basin boundaries and chaotic dynamics for Schröder and König rational iteration functions. Numer. Math. 1988, 52, 1–16. [Google Scholar] [CrossRef]
- Varona, J.L. Graphic and numerical comparison between iterative methods. Math. Intell. 2002, 24, 37–46. [Google Scholar] [CrossRef]
- Jézéquel, F. Dynamical Control of Approximation Methods; Habilitationa diriger des recherches, Universit Pierre et Marie Curie: Paris, France, 2005. [Google Scholar]
- Chand, P.B.; Chicharro, F.I.; Jain, P. Optimal fourth-order Weerakoon-Fernando-type methods for multiple roots and their dynamics. Mediterr. J. Math. 2019, 16, 67. [Google Scholar] [CrossRef]
- Geum, Y.H.; Kim, Y.I.; Magreñán, Á.A. A study of dynamics via Möbius conjugacy map on a family of sixth-order modified Newton-like multiple-zero finders with bivariate polynomial weight functions. J. Comput. Appl. Math. 2018, 344, 608–623. [Google Scholar] [CrossRef]
- Behl, R.; Cordero, A.; Motsa, S.; Torregrosa, J.R. On developing fourth-order optimal families of methods for multiple roots and their dynamics. Appl. Math. Comput. 2018, 265, 520–532. [Google Scholar] [CrossRef]
- Sidorov, N.; Sidorov, D.; Li, Y. Basins of attraction and stability of nonlinear systems’ equilibrium points. Differ. Equ. Dyn. Syst. 2019. [Google Scholar] [CrossRef]
- Neta, B.; Scott, M.; Chun, C. Basin attractors for various methods for multiple roots. App. Math. Comp. 2012, 218, 5043–5066. [Google Scholar] [CrossRef]
- Cordero, A.; Torregrosa, J.R. Variants of Newtons method using fifth order quadrature formulas. Appl. Math. Comput. 2007, 190, 686–698. [Google Scholar]
- Bradie, B. A Friendly Introduction to Numerical Analysis; Pearson Education Inc.: New Delhi, India, 2006. [Google Scholar]
- Hoffman, J.D. Numerical Methods for Engineers and Scientists; McGraw-Hill Book Company: New York, NY, USA, 1992. [Google Scholar]
© 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).