Abstract
In this study, we present a new higher-order scheme without memory for simple zeros which has two major advantages. The first one is that each member of our scheme is derivative free and the second one is that the present scheme is capable of producing many new optimal family of eighth-order methods from every 4-order optimal derivative free scheme (available in the literature) whose first substep employs a Steffensen or a Steffensen-like method. In addition, the theoretical and computational properties of the present scheme are fully investigated along with the main theorem, which demonstrates the convergence order and asymptotic error constant. Moreover, the effectiveness of our scheme is tested on several real-life problems like Van der Waal’s, fractional transformation in a chemical reactor, chemical engineering, adiabatic flame temperature, etc. In comparison with the existing robust techniques, the iterative methods in the new family perform better in the considered test examples. The study of dynamics on the proposed iterative methods also confirms this fact via basins of attraction applied to a number of test functions.
1. Introduction
In the last few years, several scholars introduced the concept of how to remove derivatives from the iteration functions. The main practical difficulty associated with iterative methods involving derivatives is to calculate first and/or high-order derivatives at each step, which is quite difficult and time-consuming. Computing derivatives of standard nonlinear equations (which are generally considered for academic purposes) is an easy task. On the other hand, in regard to practical problems of calculating the derivatives of functions, it is either very expensive or requires a huge amount of time. Therefore, we need derivative free methods, software or tools which are capable of generating derivatives automatically (for a detailed explanation, please see [1]).
There is no doubt that optimal 8-order multi-point derivative free methods are one of the important classes of iterative methods. They have faster convergence towards the required root and a better efficiency index as compared to Newton/Steffensen’s method. In addition, one can easily attain the desired accuracy of any specific number of digits within a small number of iterations with the help of these iterative methods.
In recent years, many scholars have proposed a big number of 8-order derivative free schemes in their research articles [2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18]. However, most of these eighth-order methods are the extensions or modifications of particularly well-known or unknown existing optimal fourth-order derivative free methods; for detailed explanations, please see [5,6,14,16,17]. However, there is no optimal derivative free scheme in a general way that is capable of producing optimal eighth-order convergence from every optimal fourth-order derivative free scheme to date, according to our knowledge.
In this paper, we present a new optimal scheme that doesn’t require any derivative. In addition, the proposed scheme is capable of generating new optimal 8-order methods from the earlier optimal fourth-order schemes whose first substep employs Steffensen’s or a Steffensen-type method. In this way, our scheme is giving the flexibility in the choice of a second-step to the scholars who can pick any existing optimal derivative free fourth-order method (available in the literature) unlike the earlier studies. The construction of the presented scheme is based on a technique similar to Sharma et al. [19] along with some modifications that can be seen in the next section. We tested the applicability of a newly proposed scheme on a good variety of numerical examples. The obtained results confirm that our methods are more efficient and faster as compared to existing methods in terms of minimum residual error, least asymptotic error constants, minimum error between two consecutive iterations, etc. Moreover, we investigate their dynamic behavior in the complex plane adopting basins of attraction. Dynamic behavior provides knowledge about convergence, and stability of the mentioned methods also supports the theoretical aspects.
2. Construction of the Proposed Scheme
This section is devoted to 8-order derivative free schemes for nonlinear equations. In order to obtain this scheme, we consider a general fourth-order method in the following way:
where and are the first-order finite difference. We can simply obtain eighth-order convergence by applying the classical Newton’s technique, which is given by
The above scheme is non optimal because it does not satisfy the Kung–Traub conjecture [7]. Thus, we have to reduce the number of evaluations of functions or their derivatives. In this regard, we some approximation of the first-order derivative For this purpose, we need a suitable approximation approach of functions that can approximate the derivatives. Therefore, we choose the following rational functional approach
where are free parameters. This approach is similar to Sharma et al. [19] along with some modifications. We can determine these disposable parameters by adopting the following tangency constraints
The number of tangency conditions depends on the number of undetermined parameters. If we increase the number of undetermined parameters in the above rational function, then we can also attain high-order convergence (for the detailed explanation, please see Jarratt and Nudds [20]).
By imposing the first tangency condition, we have
The last three tangency conditions provide us with the following three linear equations:
with three unknowns and .
After some simplification, we further yield
where and are the finite difference of first order. Now, we differentiate the expression (3) with respect to x at the point , which further provides
Finally, by using the expressions (1), (2) and (8), we have
where and was already explained earlier in the same section. Now, we demonstrate in the next Theorem 1 how a rational function of the form (2) plays an important role in the development of a new derivative free technique. In addition, we confirm the eighth-order of convergence of (9) without considering any extra functional evaluation/s.
3. Convergence Analysis
Theorem 1.
We assume that the function is analytic in the neighborhood of simple zero ξ. In addition, we consider that is any 4-order optimal derivative free iteration function and initial guess is close enough to the required zero ξ for the ensured convergence. The scheme (9) reaches an eighth-order convergence.
Proof.
We assume that is the error at point. We expand the function around the point by adopting Taylor’s series expansion. Then, we have
where for .
By using the above expression (10), we further obtain
Again, we have the following expansion of by adopting the Taylor’s series expansion
where .
Once again, the Taylor’s series expansion of about provide
With the help of of expressions (10)–(14), we further obtain
and
where and are the constant functions of some constants and .
Since we assumed earlier that is any 4-order optimal derivative free scheme, it is therefore undeniable that it will satisfy the error equation of the following form
where and are asymptotic error constants which may depend on some constants and .
Now, we obtain the following expansion of about
It is straightforward to say from the expression (21) that the scheme (9) has 8-order convergence. Since the scheme (9) uses only four values of function (viz. and ) per step, this is therefore an optimal scheme according to the Kung–Traub conjecture. A single coefficient from occurs in the above error equation and also plays an important role in the development of our scheme. Hence, this completes the proof. □
Remark 1.
In general, it is quite obvious that one thinks that the asymptotic error constant in the error equation of scheme (9) may rely on some other constants λ, and . There is no doubt that the expression (21) confirms that the asymptotic error constant is dependent only on λ, and . This clearly demonstrates that our current rational function approach with the tangency constraints contributes a significant role in the construction of a new scheme with 8-order convergence.
4. Numerical Examples
Here, we checked the effectiveness, convergence behavior and efficiency of our schemes with the other existing optimal eighth-order schemes without derivatives. Therefore, we assume that, out of five problems, four of them are from real-life problems, e.g., a fractional conversion problem of the chemical reactor, Van der Waal’s problem, the chemical engineering problem and the adiabatic flame temperature problem. The fifth one is a standard nonlinear problem of a piecewise continuous function, which is displayed in the following Examples (1)–(5). The desired solutions are available up to many significant digits (minimum thousand), but, due to the page restriction, only 30 significant places are also listed in the corresponding example.
For comparison purposes, we require the second sub-step in the presented technique. We can choose any optimal derivative free method from the available literature whose first sub-step employs Steffensen’s or a Steffensen-type method. Now, we assume some special cases of our scheme that are given as below:
- We choose an optimal derivative free fourth-order method (6) suggested by Cordero and Torregrosa [3]. Then, we havewhere such that and . We consider and in expression (26) for checking the computational behavior, denoted by .
- We consider another 4-order optimal method (11) presented by Liu et al. in [8]. Then, we obtain the following new optimal 8-order derivative free schemeLet us call the above expression for computational experimentation.
- Once again, we pick expression (12) from a scheme given by Ren et al. in [10]. Then, we obtain another interesting familywhere . We choose in (30), known as .
- Now, we assume another 4-order optimal method (12), given by Zheng et al. in [18], which further produceswhere . We choose and in (31), called .
Now, we compare them with iterative methods presented by Kung–Traub [7]. Out of these, we considered an optimal eighth-order method, called . We also compare them with a derivative free optimal family of 8-order iterative functions given by Kansal et al. [5]. We have picked expression (23) out of them, known as . Finally, we contrast them with the optimal derivative free family of 8-order methods suggested by Soleymani and Vanani [14], out of which we have chosen the expression (21), denoted by .
We compare our methods with existing methods on the basis of approximated zeros , absolute residual error , error difference between two consecutive iterations , , asymptotic error constant and computational convergence order , where (for the details, please see Cordero and Torregrosa [21]) and the results are mentioned in Table 1, Table 2, Table 3, Table 4 and Table 5.
Table 1.
Convergence performance of distinct 8-order optimal derivative free methods for .
Table 2.
Convergence performance of distinct 8-order optimal derivative free methods for .
Table 3.
Convergence performance of distinct 8-order optimal derivative free methods for .
Table 4.
Convergence performance of distinct 8-order optimal derivative free methods for .
Table 5.
Convergence performance of distinct 8-order optimal derivative free methods for .
The values of all above-mentioned parameters are available for many significant digits (with a minimum of a thousand digits), but, due to the page restrictions, results are displayed for some significant digits (for the details, please see Table 1, Table 2, Table 3, Table 4 and Table 5 ). The values of all these parameters have been calculated by adopting programming package for multiple precision arithmetic. Finally, the meaning of is in the following Table 1, Table 2, Table 3, Table 4 and Table 5.
Example 1.
Chemical reactor problem:
In regard to fraction transformation in a chemical reactor, we consider
where the variable x denotes a fractional transformation of a particular species A in the chemical reactor problem (for a detailed explanation, please have a look at [22]). It is important to note that, if , then the expression (26) has no physical meaning. Hence, this expression has only a bounded region , but its derivative is approaching zero in the vicinity of this region. Therefore, we have to take care of these facts while choosing required zero and initial approximations, which we consider as and , respectively:
Example 2.
Van der Waal’s equation:
The above expression interprets real and ideal gas behavior with variables and , respectively. For calculating the gas volume V, we can rewrite the above expression (27) in the following way:
By considering the particular values of parameters, namely and , and T, we can easily get the following nonlinear function:
The function has three zeros and our required zero is . In addition, we consider the initial guess as .
Example 3.
If we convert the fraction of nitrogen–hydrogen to ammonia, then we obtain the following mathematical expression (for more details, please see [23,24])
The has four zeros and our required zero is In addition, we consider the initial guess as .
Example 4.
Let us assume an adiabatic flame temperature equation, which is given by
where and . For the details of this function, please see the research articles [24,25]. This function has a simple zero and assumes the initial approximation is for this problem.
Example 5.
Finally, we assume a piece-wise continuous function [5], which is defined as follows:
The above function has a simple zero with an initial guess being .
5. Graphical Comparison by Means of Attraction Basins
It is known that a good selection of initial guesses plays a definitive role in iterative methods—in other words, that all methods converge if the initial estimation is chosen suitably. We numerically approximate the domain of attraction of the zeros as a qualitative measure of how demanding the method on the initial approximation of the root is. In order to graphically compare by means of attraction basins, we investigate the dynamics of the new methods , , and and compare them with available methods from the literature, namely , and . For more details and many other examples of the study of the dynamic behavior for iterative methods, one can consult [26,27,28,29].
Let be a rational map on the complex plane. For , we define its orbit as the set . A point is called a periodic point with minimal period m if , where m is the smallest positive integer with this property (and thus is a cycle). The point having minimal period 1 is known as a fixed point. In addition, the point is called repelling if , attracting if , and neutral otherwise. The Julia set of a nonlinear map , denoted by , is the closure of the set of its repelling periodic points. The complement of is the Fatou set .
In our case, the methods , , and and , and provide the iterative rational maps when they are applied to find the roots of complex polynomials . In particular, we are interested in the basins of attraction of the roots of the polynomials where the basin of attraction of a root is the complex set . It is well known that the basins of attraction of the different roots lie in the Fatou set . The Julia set is, in general, a fractal and, in it, the rational map Q is unstable.
For a graphical point of view, we take a grid of the square and assign a color to each point according to the simple root to which the corresponding orbit of the iterative method starting from converges, and we mark the point as black if the orbit does not converge to a root in the sense that, after at most 15 iterations, it has a distance to any of the roots that is larger than . We have used only 15 iterations because we are using eighth-order methods. Therefore, if the method converges, it is usually very fast. In this way, we distinguish the attraction basins by their color.
Different colors are used for different roots. In the basins of attraction, the number of iterations needed to achieve the root is shown by the brightness. Brighter color means less iteration steps. Note that black color denotes lack of convergence to any of the roots. This happens, in particular, when the method converges to a fixed point that is not a root or if it ends in a periodic cycle or at infinity. Actually and although we have not done it in this paper, infinity can be considered an ordinary point if we consider the Riemann sphere instead of the complex plane. In this case, we can assign a new “ordinary color” for the basin of attraction of infinity. Details for this idea can be found in [30].
We have tested several different examples, and the results on the performance of the tested methods were similar. Therefore, we merely report the general observation here for two test problems in the following Table 6.
Table 6.
Test problems and and their roots.
From Figure 1 and Figure 2, we conclude that our methods, namely, and , are showing less chaotic behavior and have less non-convergent points as compared to the existing methods, namely and . In addition, our methods, namely, and , have almost similar basins of attraction to . On the other hand, Figure 3 and Figure 4 confirm that our methods, namely, and , have less divergent points as compared to the existing methods, namely and . There is no doubt that the behavior is better than all other mentioned methods, namely, and in problem in terms of chaos.
Figure 1.
The dynamical behavior of our methods namely, , , and , respectively, from left to right for test problem .
Figure 2.
The dynamical behavior of methods , and , respectively, from left to right for test problem .
Figure 3.
The dynamical behavior of our methods namely, , , and , respectively, from left to right for test problem .
Figure 4.
The dynamical behavior of methods , and , respectively from left to right for test problem .
6. Conclusions
In this study, we present a new technique of eighth-order in a general way. The main advantages of our technique are that is a derivative free scheme, there is a choice of flexibility at the second substep, and it is capable of generating new 8-order derivative free schemes from every optimal 4-order method employing Steffensen’s or Steffensen-type methods. Every member of (9) is an optimal method according to Kung–Traub conjecture. It is clear from the obtained results in Table 1, Table 2, Table 3, Table 4 and Table 5 that our methods have minimum residual error , the difference between two consecutive iterations , and stable computational convergence order as compared to existing methods, namely, , and . The dynamic study of our methods also confirms that they perform better than existing ones of similar order.
It is important to note that we are not claiming that our methods will always be superior to these methods. One may obtain different results when they rest them on distinct nonlinear functions because the computational results depend on several constraints, including initial approximation, body structure of the iterative method, the considered test problem, configuration of the used system and programming softwares, etc. In future work, we will try to obtain a new family of high-order optimal derivative free iteration functions that depend on the rational functional approach.
Author Contributions
All the authors have equal contribution to this study.
Funding
No funding for this paper.
Conflicts of Interest
The authors declare no conflict of interest.
References
- Griewank, A.; Walther, A. Evaluating Derivatives: Principles and Techniques of Algorithmic Differentiation, 2nd ed.; SIAM: Philadelphia, PA, USA, 2008. [Google Scholar]
- Behl, R.; Maroju, P.; Motsa, S.S. A family of second derivative free fourth order continuation method for solving nonlinear equations. J. Comut. Appl. Math. 2017, 318, 38–46. [Google Scholar] [CrossRef]
- Cordero, A.; Torregrosa, J.R. A class of Steffensen type methods with optimal order of convergence. Appl. Math. Comput. 2011, 217, 7653–7659. [Google Scholar] [CrossRef]
- Cordero, A.; Hueso, J.L.; Martínez, E.; Torregrosa, J.R. Steffensen type methods for solving nonlinear equations. Appl. Math. Comput. 2012, 236, 3058–3064. [Google Scholar] [CrossRef]
- Kansal, M.; Kanwar, V.; Bhatia, S. An optimal eighth-order derivative-free family of Potra-Pták’s method. Algorithms 2015, 8, 309–320. [Google Scholar] [CrossRef]
- Khattri, S.K.; Steihaug, T. Algorithm for forming derivative-free optimal methods. Numer. Algor. 2014, 65, 809–824. [Google Scholar] [CrossRef]
- Kung, H.T.; Traub, J.F. Optimal order of one-point and multi-point iteration. J. ACM 1974, 21, 643–651. [Google Scholar] [CrossRef]
- Liu, Z.; Zheng, Q.; Zhao, P. A variant of Steffensen’s method of fourth-order convergence and its applications. Appl. Math. Comput. 2010, 216, 1978–1983. [Google Scholar] [CrossRef]
- Matthies, G.; Salimi, M.; Sharifi, S.; Varona, J.L. An optimal eighth-order iterative method with its dynamics. Jpn. J. Ind. Appl. Math. 2016, 33, 751–766. [Google Scholar] [CrossRef]
- Ren, H.; Wu, Q.; Bi, W. A class of two-step Steffensen type methods with fourth-order convergence. Appl. Math. Comput. 2009, 209, 206–210. [Google Scholar] [CrossRef]
- Salimi, M.; Lotfi, T.; Sharifi, S.; Siegmund, S. Optimal Newton-Secant like methods without memory for solving nonlinear equations with its dynamics. Int. J. Comput. Math. 2017, 94, 1759–1777. [Google Scholar] [CrossRef]
- Salimi, M.; Nik Long, N.M.A.; Sharifi, S.; Pansera, B.A. A multi-point iterative method for solving nonlinear equations with optimal order of convergence. Jpn. J. Ind. Appl. Math. 2018, 35, 497–509. [Google Scholar] [CrossRef]
- Sharifi, S.; Salimi, M.; Siegmund, S.; Lotfi, T. A new class of optimal four-point methods with convergence order 16 for solving nonlinear equations. Math. Comput. Simul. 2016, 119, 69–90. [Google Scholar] [CrossRef]
- Soleymani, F.; Vanani, S.K. Optimal Steffensen-type methods with eighth order of convergence. Comput. Math. Appl. 2011, 62, 4619–4626. [Google Scholar] [CrossRef]
- Traub, J.F. Iterative Methods for the Solution of Equations; Prentice-Hall, Englewood Cliffs: Upper Saddle River, NJ, USA, 1964. [Google Scholar]
- Thukral, R. Eighth-order iterative methods without derivatives for solving nonlinear equations. Int. Sch. Res. Net. Appl. Math. 2011, 2011, 693787. [Google Scholar] [CrossRef]
- Zheng, Q.; Li, J.; Huang, F. An optimal Steffensen-type family for solving nonlinear equations. Appl. Math. Comput. 2011, 217, 9592–9597. [Google Scholar] [CrossRef]
- Zheng, Q.; Zhao, P.; Huang, F. A family of fourth-order Steffensen-type methods with the applications on solving nonlinear ODEs. Appl. Math. Comput. 2011, 217, 8196–8203. [Google Scholar] [CrossRef]
- Sharma, J.R.; Guhaa, R.K.; Gupta, P. Improved King’s methods with optimal order of convergence based on rational approximations. Appl. Math. Lett. 2013, 26, 473–480. [Google Scholar] [CrossRef]
- Jarratt, P.; Nudds, D. The use of rational functions in the iterative solution of equations on a digital computer. Comput. J. 1965, 8, 62–65. [Google Scholar] [CrossRef]
- Cordero, A.; Torregrosa, J.R. Variants of Newton’s method using fifth-order quadrature formulas. Appl. Math. Comput. 2007, 190, 686–698. [Google Scholar] [CrossRef]
- Shacham, M. Numerical solution of constrained nonlinear algebraic equations. Int. J. Numer. Method Eng. 1986, 23, 1455–1481. [Google Scholar] [CrossRef]
- Balaji, G.V.; Seader, J.D. Application of interval Newton’s method to chemical engineering problems. Reliab. Comput. 1995, 1, 215–223. [Google Scholar] [CrossRef]
- Shacham, M. An improved memory method for the solution of a nonlinear equation. Chem. Eng. Sci. 1989, 44, 1495–1501. [Google Scholar] [CrossRef]
- Shacham, M.; Kehat, E. Converging interval methods for the iterative solution of nonlinear equations. Chem. Eng. Sci. 1973, 28, 2187–2193. [Google Scholar] [CrossRef]
- Ezquerro, J.A.; Hernández, M.A. An optimization of Chebyshev’s method. J. Complex. 2009, 25, 343–361. [Google Scholar] [CrossRef]
- Ferrara, M.; Sharifi, S.; Salimi, M. Computing multiple zeros by using a parameter in Newton-Secant method. SeMA J. 2017, 74, 361–369. [Google Scholar] [CrossRef]
- Stewart, B.D. Attractor Basins of Various Root-Finding Methods. Master’s Thesis, Naval Postgraduate School, Monterey, CA, USA, 2001. [Google Scholar]
- Varona, J.L. Graphic and numerical comparison between iterative methods. Math. Intell. 2002, 24, 37–46. [Google Scholar] [CrossRef]
- Hernández-Paricio, L.J.; Marañón-Grandes, M.; Rivas-Rodríguez, M.T. Plotting basins of end points of rational maps with Sage. Tbil. Math. J. 2012, 5, 71–99. [Google Scholar]
© 2019 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).