Abstract
A new generalised Taylor-like explicit method for stiff ordinary differential equations (ODEs) is proposed. The algorithm is presented in its component and vector forms. The error and stability analysis of the method are developed showing that it has an arbitrary high order of convergence and the L-stability property. Moreover, it is verified that several integration schemes are special cases of the new general form. The method is applied on stiff problems and the numerical solutions are compared with those of the classical Taylor-like integration schemes. The results show that the proposed method is accurate and overcomes the shortcoming of the classical Taylor-like schemes in their component and vector forms.
1. Introduction
Most of the mathematical models describing real-world phenomena are often stiff ordinary differential equations (SODEs). Such problems involve a wide range of temporal scales and solving these SODEs requires careful treatment. Efficient numerical and semi-analytical numerical methods for solving stiff problems must have good accuracy, wide region of stability and low computational effort. It is well known that explicit linear multistep methods are not absolutely stable. In addition, most of the implicit methods are absolutely stable and work adequately with SODEs, but they involve a higher computational load per step than the explicit methods [1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22] Wu and Xia [9,10,11] presented a vector form for A-stable explicit one step Taylor-like method for solving stiff ODE systems. Wu and Xia [9] proposed a vector form for the two low accuracy methods [5] to be applied on stiff ODE systems. Wu and Xia [10] proposed a vector form for the sixth-order Taylor-like explicit method [7] to be applied on stiff ODE systems. Wu and Xia [9,10] showed the superiority of the Taylor-like methods when formulated in vector form compared to their component form. More recently, Wu and Xia [11] derived a general form of the Taylor-like explicit method and derived its corresponding vector form. One of the main advantages of using Taylor-like methods is that the approximate solution is given as an arbitrary order piecewise analytical function defended on the sub-intervals of the whole integration interval. This property offers different facility for adaptive error control [19,20]. Moreover, the Taylor-like method [11] is an arbitrary high order A-stable method that avoids extremely small stepsizes during the integration procedure. To avoid the analytical computation of the successive derivatives involved in the Taylor-like methods, numerical differentiation [21,22], automatic differentiation [23], differential transformation [24,25,26] and Infinity Computer with a new numeral system [27,28,29,30,31,32] can be used. In fact, Taylor-like explicit methods [5,7,9,10,11] have computational drawbacks with zero-component derivative or zero-vector norm in their component or vector forms, respectively. Moreover, the computational errors due to the round-off, particularly in the case of long time intervals or large time-step sizes, may lead to very small values of the derivatives or very large values of the derivatives’ ratio at some grid points. Consequently, poor results are obtained. To overcome these limitations a new generalised Taylor-like explicit method for SODEs and stiff ODE systems is present. The method is developed both in its component and vector forms. The error and stability analysis of the method are presented. It is shown that the new method has an arbitrary order of convergence and the L-stability property. Indeed, many other integration schemes are essentially special cases of the proposed general form method. The method is applied on stiff test problems and the numerical results are compared with those in the literature. The results show that the proposed method is accurate and avoids the shortcoming of the classical Taylor-like explicit methods both in their component and vector forms.
2. Generalised Taylor-Like Method
Consider the initial-value problem given by:
where and . The interval is divided into sub-intervals with , such that h is the time-step size. Assume that the solution of (1) can be approximated by
where and are unknowns and determined later from the local truncation error and stability analysis of the method. By considering Taylor’s expansions of and about , we have:
where and
The approximation in (2) is constructed so that and agree and their derivatives up to order , that is
Equating the coefficients of the same powers of , , in (5) by zero, results in the following system of nonlinear equations
Solving the first and last equations in (6) results in
Consequently, solving the remaining equations in (6) results in
2.1. Local Truncation Error
The local truncation error is readily obtained from subtracting (9) from the Taylor series expansion in (3) and collecting terms in h
It is clear that relation (9) has at least order of accuracy.
2.2. Stability Analysis
In order to examine the integration scheme (9) for the stability, let us consider the differential equation,
where is a complex constant and . For this equation, Equation (9) results in
For , Equation (11) results in
Setting in the above equation, the amplification factor is given by
and thus we have obtained the following A-stable and L-stable method with at least order of accuracy
where .
The local truncation error of (12) is given by
2.3. Consistency
Subtracting from both sides of (12) and dividing the result by h leads to
Taking the limit as h tends to zero, on both sides of (14), yields
showing that the method defined in (12) is consistent.
Thus we have the following theorem:
Theorem 1.
The generalised Taylor-like explicit method (12) is L-stable and convergent with at least order of accuracy.
For a fixed value of m and different values of k ( …, ) the method formulated in (12) results in L-stable different integration schemes with the same order of accuracy .
Remark 1.
Remark 2.
Remark 3.
Remark 4.
Remark 5.
3. Extension to Vector Form
The method (12) can also be extended directly to systems of ODEs by using the new definitions of vector product and quotient defined in [9,12] as
where and .
The vector version of the proposed method is of the form
where .
The local truncation error of (25) is given by
where is a vector and . The error in (26) is derived in a similar way as in [9,10]. The case can be found in [11].
It is clear that the new method can overcome the restrictions in the classical Taylor-like explicit method in its component applicable form (i.e., ) and in its vector applicable form (i.e., ). With the proposed method, the value of k can be adapted automatically to use any arbitrary pairs , or , …, , while maintaining the order of convergence and the L-stability property.
4. Numerical Results
In this section, we provide six numerical experiments to illustrate the theoretical results obtained in Section 2 and Section 3. All numerical experiments are carried out using Matlab 8.3. The test problems were collected from the literature and the results are compared in the follow-up.
Problem 1.
Problem 1 is solved numerically using the generalised Taylor-like method (GTL) in its component form. The results are shown in Table 1, Table 2 and Table 3. Table 1 compares the solution error presented in [8] using the seventh order Sin and Explicit Taylor-like methods (STL7 and ETL7) with one given by the new method of seventh order (GTL7) having and . The results show that the GTL7 leads to a more accurate solution than the STL7 and ETL7. Table 2 lists the maximum solution error using the time-step size at different values of m and k, . The results show that as the order , or the value of k, increases, the solution error decreases. Moreover, increasing k is more effective than increasing m for improving the solution accuracy, and setting leads to more accurate results. Table 3 shows the computed order of convergence at different values of m and k using two different step sizes . The results confirm that the order of convergence depends only on the value of m for all values of .
Figure 1 shows the exact and numerical solutions of Problem 1 at . Figure 2 shows the behaviour of the solution error of different-order GTL component form at .
Table 1.
Comparison of the solution error for the STL7, ETL7 and GTL7 in the solution of Problem 1.
Table 2.
Maximum solution error for different values of m and k, .
Table 3.
Computed order of convergence for different values of m and k, .
Figure 1.
Exact and numerical solutions of Problem 1.
Figure 2.
Solution error of different-order generalised Taylor-like method (GTL) in solving Problem 1 at .
Problem 2.
Consider the oscillating SODE [17]:
where ε is a parameter controlling the stiffness.
The theoretical solution is given by
From the theoretical point of view, we have , which results in the computational overflow when adopting the high order classical ETL method. Problem 2 is solved numerically at using the GTL component form with forth, fifth and sixth orders (i.e., the GTL4, GTL5, GTL6). The solution error, maximum solution error and the computed order of convergence are listed in Table 4. The results show that the GTL is not only stable and accurate but also overcomes the overflow in computation at by reducing the value of k from 6 to 2, without losing the convergence order and the L-stability property. Figure 3 shows the exact and numerical solutions at . Figure 4 depicts the solution error of different-order GTL component form at .
In fact, since the GTL overcomes the overflow in computations by reducing the value of k, the accuracy may be little decreased while the order of convergence remains constant. Being that the effect occurs more in the component than in the vector form, we conclude that the component form GTL is more suitable for scalar stiff problems than for stiff ODE systems where the GTL vector form can be applied.
Table 4.
Numerical results for problem 2 using the component form of GTL4, GTL5 and GTL6.
Figure 3.
Exact and numerical solutions of Problem 2.
Figure 4.
Solution error of different-order GTL in solving Problem 2 at .
Problem 3.
Consider the following stiff ODE system [7,10,16]:
The theoretical solution is given by
Due to the round-off error in computations, the ratio between and , may be very large at some grid points and the classical component form of the ETL6 [7,10] results in low accuracy, or even in an overflow, as shown in Table 5. On the other hand, the present component form of the GTL6 can overcome this drawback easily by reducing the value of k from 6 to 5 for at , respectively. Table 6 reveals that the vector forms of the ETL6 and GTL6 can overcome the overflow in computations with the component form of the ETL6 at and both of them have accurate results since there are no vectors with zero norms. Figure 5 depicts the exact and numerical solutions at . Figure 6 and Figure 7 show the solution error of different-order vector form GTL at and respectively.
Table 5.
Numerical results for Problem 3 using the component forms of the ETL6 and GTL6.
Table 6.
Numerical results for Problem 3 using the vector forms of the ETL6 and GTL6 methods.
Figure 5.
Exact and numerical solutions of Problem 3.
Figure 6.
Solution error of different-order GTL in solving Problem 2 at .
Figure 7.
Solution error of different-order GTL in solving Problem 2 at .
Problem 4.
Consider the following stiff ODE system [2,13,15].
The theoretical solution is given by
Problem 4 is solved using both the component and vector forms of the ETL6 and GTL6. The numerical results are listed in Table 7 and Table 8. Table 7 shows that the component form GTL6 results in more accurate results than the ETL6 for . Furthermore, the GTL6 can overcome the overflow in computations for by reducing the value of k from 6 to 5 at . Table 8 shows that the vector form GTL6 leads to the same results as ETL6 for due to the absence of zero-vector norms. For , ETL6 exhibits an overflow while GTL6 overcomes this overflow by reducing the value of k from 6 to 5 at . Figure 8 shows the exact and numerical solutions at . Figure 9, Figure 10 and Figure 11 illustrate the solution error of different-order vector form GTL at and , respectively.
Table 7.
Numerical results for Problem 4 using the component form of the ETL6 and GTL6.
Table 8.
Numerical results for Problem 4 using the vector form of the ETL6 and GTL6 methods.
Figure 8.
Exact and numerical solutions of Problem 4.
Figure 9.
Solution error of different-order GTL in solving Problem 4 at .
Figure 10.
Solution error of different-order GTL in solving Problem 4 at .
Figure 11.
Solution error of different-order GTL method in solving Problem 4 at .
Problem 5.
Consider the following nonlinear stiff ODE system [10]:
The theoretical solution is given by
Table 9 and Table 10 compare the results achieved by ETL6 [7,10] with those obtained by GTL6. From the theoretical point of view, at and so, as shown in Table 9, the component form ETL6 results in computational overflow, while THE GTL6 overcomes the overflow in computations at zero derivative component by changing the value of k from 6 to 5 at . Table 10 shows that both the ETL6 and GTL6 have the same accurate results in their vector forms due to the absence of zero-vector norms. Figure 12 shows the exact and numerical solutions at . Figure 13 depicts the solution error of different-order vector form GTL at .
Table 9.
Numerical results for Problem 5 using the component forms of the ETL6 and GTL6 methods.
Table 10.
Numerical results for Problem 5 using the vector forms of the ETL6 and GTL6 methods.
Figure 12.
Exact and numerical solutions of Problem 5.
Figure 13.
Solution error of different-order GTL in solving Problem 5 at .
Problem 6.
Consider the following nonlinear chemical reaction system involving eight reactants [1]:
with initial conditions .
This problem has no known analytical solution, and therefore, a numerical approximate solution using the built in BVP4C MATLAB solver [33,34,35] is taken as the reference solution for comparison. The problem is solved using different-order vector form GTL at and the solution error is represented in Figure 14 at . The same results are obtained using the ETL due to the absence of zero derivatives or zero vectors. Moreover, the exact and numerical solutions are illustrated in Figure 15.
Figure 14.
Solution error of different-order GTL in solving Problem 6 at .
Figure 15.
Exact and numerical solutions of Problem 6.
5. Conclusions
This paper presented a new generalised Taylor-like explicit method for SODEs and stiff ODE systems. The new method was formulated in its general component and vector applicable forms. The error and stability analysis of the method were discussed showing that it has at least () order of convergence and the L-stability property. It was shown that several other integration schemes are essentially special cases of the proposed method.The algorithm is applied to six stiff test problems and the results are analyzed in several figures and tables and compared with those obtained by means of the classical Taylor-like methods. The results show that the new method is not only stable and accurate but also overcomes the shortcomings of the classical Taylor-like explicit methods in their component and vector forms by adapting the value of k during the computations without losing the convergence order and the L-stability property.
Author Contributions
Conceptualization, E.R.E.-Z. and J.T.M.; methodology, E.R.E.-Z.; software, E.R.E.-Z.; validation, E.R.E.-Z., J.T.M. and A.E.; formal analysis, E.R.E.-Z.; investigation, E.R.E.-Z.; resources, J.T.M.; data curation, A.E.; writing—original draft preparation, E.R.E.-Z.; writing—review and editing, E.R.E.-Z. and J.T.M.; visualization, J.T.M.; supervision, E.R.E.-Z. and J.T.M.; project administration, E.R.E.-Z.; funding acquisition, E.R.E.-Z.
Funding
This project was supported by the Deanship of Scientific Research at Prince Sattam Bin Abdulaziz University under the research project No. 2019/1/10067.
Conflicts of Interest
The author declares no conflict of interest.
References
- Hairer, E.; Wanner, G. Solving Ordinary Differential Equations II, second revised ed.; Springer: Berlin/Heidelberg, Germany, 2002. [Google Scholar]
- Lambert, J.D. Computational Methods in Ordinary Differential Equation; John Wiley and Sons: New York, NY, USA, 1991. [Google Scholar]
- Costa, R.P., Jr.; de Oliveira, M.L. Analysis of the performance of numerical integration methods for the tracking of ultra-high energy cosmic rays. J. Comput. Phys. 2019, 392, 432–443. [Google Scholar] [CrossRef]
- Machado, J.A.; Galhano, A.M. Evaluation of manipulator direct dynamics using customized Rung-Kutta Methods. Syst. Anal. Model. Simuln. 1995, 17, 229–239. [Google Scholar]
- Wu, X.Y. Exact exponentially fitted method for solving stiff ordinary differential equations. J. Naijing Univ. (Natural Sci.) 1997, 33, 1–6. [Google Scholar]
- Ebady, A.M.; Habib, H.M.; El-Zahar, E.R. A Fourth Order A-Stable Explicit One-Step Method for Solving Stiff Differential Systems Arising in Chemical Reactions. Int. J. Pure Appl. Math. 2012, 81, 803–812. [Google Scholar]
- Wu, X.Y. A sixth-order A-stable explicit one-step method for stiff systems. Comput. Math. Appl. 1998, 35, 59–64. [Google Scholar] [CrossRef]
- Ahmad, R.R.; Yaacob, N.; Mohd Murid, A.H. Explicit methods in solving stiff ordinary differential equations. Int. J. Comput. Math. 2004, 81, 1407–1415. [Google Scholar] [CrossRef]
- Wu, X.Y.; Xia, J.L. Two low accuracy methods for stiff systems. Appl. Math. Comput. 2001, 123, 141–153. [Google Scholar] [CrossRef]
- Wu, X.Y.; Xia, J.L. The vector form of a sixth-order A-stable explicit one-step method for stiff problems. Comput. Math. Appl. 2001, 39, 247–257. [Google Scholar] [CrossRef]
- Wu, X.Y.; Xia, J.L. Study of general Taylor-like explicit methods in solving stiff ordinary differential equations. Int. J. Comput. Math. 2007, 84, 1795–1803. [Google Scholar] [CrossRef]
- Wu, X.Y.; Xia, J.L. New vector forms of elemental functions with Taylor series. Appl. Math. Comput. 2003, 141, 307–312. [Google Scholar] [CrossRef]
- Álvarez, J.; Rojo, J. An improved class of generalized Runge–Kutta methods for stiff problems. Part I: The scalar case. Appl. Math. Comput. 2002, 130, 537–560. [Google Scholar] [CrossRef]
- Lepik, Ü.; Hein, H. Haar Wavelets: With Applications; Springer Science and Business Media: Berlin, Germany, 2014. [Google Scholar]
- Yatim, S.A.M.; Ibrahim, Z.B.; Othman, K.I.; Suleiman, M.B. A numerical algorithm for solving stiff ordinary differential equations. Math. Probl. Eng. 2013, 2013. [Google Scholar] [CrossRef]
- Wu, X.Y.; Xia, J.L. An explicit two-step method exact for the scalar test equation y′ = λy. Comput. Math. Appl. 2000, 39, 249–257. [Google Scholar] [CrossRef]
- Kushnir, D.; Rokhlin, V. A highly accurate solver for stiff ordinary differential equations. SIAM J. Sci. Comput. 2012, 34, A1296–A1315. [Google Scholar] [CrossRef][Green Version]
- Butusov, D.; Karimov, A.; Tutueva, A.; Kaplun, D.; Nepomuceno, E.G. The effects of Padé numerical integration in simulation of conservative chaotic systems. Entropy 2019, 21, 362. [Google Scholar] [CrossRef]
- Miletics, E.; Molnarka, G. Taylor series method with numerical derivatives for initial value problems. J. Comput. Methods Sci. Eng. 2004, 4, 105–114. [Google Scholar] [CrossRef]
- Jorba, A.; Zou, M. A software package for the numerical integration of ODEs by means of high-order Taylor methods. Exp. Math. 2005, 14, 99–117. [Google Scholar] [CrossRef]
- Miletics, E.; Molnarka, G. Taylor Series Method with Numerical Derivatives for Numerical Solution of ODE Initial Values Problems. 2003, pp. 1–16. Available online: http: //heja.szif.hu/ANM/ANM-030110-B/anm030110b.pdf (accessed on 2 October 2019).
- Miletics, E.; Molnarka, G. Implicit extension of Taylor series method with numerical derivatives for initial value problems. Comput. Math. Appl. 2005, 50, 1167–1177. [Google Scholar] [CrossRef]
- Schwarz, D.E.; Lamour, E. Projector based integration of DAEs with the Taylor series method using automatic differentiation. J. Comput. Math. Appl. 2014, 262, 62–72. [Google Scholar] [CrossRef]
- El-Zahar, E.R. Piecewise approximate analytical solutions of high order singular perturbation problems with a discontinuous source term. Int. J. Differ. Equ. 2016. [Google Scholar] [CrossRef]
- El-Zahar, E.R.; Habib, H.M.; Rashidi, M.M.; El-Desoky, I.M. A Comparison of Explicit Semi-Analytical Numerical Methods for Solving Stiff ODE Systems. Am. J. Appl. Sci. 2015, 12, 304–320. [Google Scholar] [CrossRef]
- Momani, S.; Odibat, Z. A novel method for nonlinear fractional partial differential equations: Combination of DTM and generalized Taylor’s formula. J. Comput. Appl. Math. 2008, 220, 85–95. [Google Scholar] [CrossRef]
- Amodio, P.; Iavernaro, F.; Mazzia, F.; Mukhametzhanov, M.S.; Sergeyev, Y.D. A generalized Taylor method of order three for the solution of initial value problems in standard and infinity floating-point arithmetic. Math. Comput. Simul. 2017, 141, 24–39. [Google Scholar] [CrossRef]
- Toutounian, F.; Nasabzadeh, H. A new method based on generalized Taylor expansion for computing a series solution of the linear systems. Appl. Math. Comput. 2014, 248, 602–609. [Google Scholar] [CrossRef]
- Sergeyev, Y.D. Arithmetic of Infinity, 2nd ed.; Edizioni Orizzonti Meridionali: Cosenza, Italy, 2003. [Google Scholar]
- Sergeyev, Y.D. Infinity computer and calculus. AIP Conf. Proc. 2007, 936, 23–26. [Google Scholar]
- Sergeyev, Y.D. Lagrange Lecture: Methodology of numerical computations with infinities and infinitesimals. Rend. Semin. Mat. Univ. Politec. Torino 2010, 68, 95–113. [Google Scholar]
- Sergeyev, Y.D. Numerical computations with infinite and infinitesimal numbers: Theory and applications. In Dynamics of Information Systems: Algorithmic Approaches; Springer: New York, NY, USA, 2013; pp. 1–66. [Google Scholar]
- Shampine, L.F.; Kierzenka, J.; Reichelt, M.W. Solving Boundary Value Problems for Ordinary Differential Equations in MATLAB with bvp4c. Tutorial Notes. 2000, pp. 1–27. Available online: https://classes.engineering.wustl.edu/che512/bvp_paper.pdf (accessed on 3 October 2019).
- Shampine, L.; (Southern Methodist University, Dallas, TX, USA). Solving a hard BVP with bvp4c. Private communication, 2004. [Google Scholar]
- Gokhan, F.S.; Yilmaz, G. Numerical solution of Brillouin and Raman fiber amplifiers using bvp6c. COMPEL Int. J. Comput. Math. Electr. Electron. Eng. 2010, 29, 824–839. [Google Scholar] [CrossRef]
© 2019 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).