Abstract
Recently, block backward differentiation formulas (BBDFs) are used successfully for solving stiff differential equations. In this article, a class of hybrid block backward differentiation formulas (HBBDFs) methods that possessed –stability are constructed by reformulating the BBDFs for the numerical solution of stiff ordinary differential equations (ODEs). The stability and convergence of the new method are investigated. The methods are found to be zero-stable and consistent, hence the method is convergent. Comparisons between the proposed method with exact solutions and existing methods of similar type show that the new extension of the BBDFs improved the stability with acceptable degree of accuracy.
1. Introduction
The aim of this paper is to develop a class hybrid multistep block method based on block backward differentiation formulas (BBDFs) for the numerical solution of first order ordinary differential equations (ODEs) of the form:
where is continuous and second variable Lipschitzian over its existence domain, so that the existence of Solution (1) is guaranteed.
Equation (1) frequently arise in many applications in science and engineering. Many of these applications often results to stiff ODEs. Stiff systems are found in description of atmospheric phenomena, chemical reactions occurring in living species, chemical kinetics (e.g., explosions), engineering control systems, electronic circuits, lasers, mechanics, and molecular dynamics [,,]. Several other examples are given in []. There is no unique definition of stiffness. Various definition describing stiffness are given in the literature [,,]. The first identification of stiff equations as a special class of problems is due to a chemist []. He states that stiff equations are equations where certain implicit methods, in particular BDF, perform better, usually tremendously better, than explicit ones [] and systems containing very fast components as well as very slow components while [] states that “stiff problems are problems for which explicit methods don’t work”.
In many practical applications, the difficulty associated with stiff ODEs is in choosing an efficient integration scheme since the choice of numerical methods is imposed by numerical stability. Besides numerical stability, the efficiency of numerical methods also depends on whether the method is explicit or implicit. Explicit schemes require the least amount of computation per time step but the allowable time step is severely restricted by the stability requirements, see []. Furthermore, the implementation of implicit method can be very costly in terms of computer time since solvers for stiff equations require the evaluation of the Jacobian, .
The most widely used method to numerically solve (1) which is stiff are the backward differentiation formulas (BDFs) which is popularly known as the Gear method, see [,]. Recently, a great deal of effort has been proposed in the literature in the development of block methods for solving (1). The block methods are extensively discussed by [,,,,,] and are proven to be efficient in improving the accuracy and reduced the number of function evaluation. This approach is extended to various type by increasing the order, varies the step size and orders with extended stability region. All the methods, mentioned above, produced solutions at multiple points simultaneously at single iteration. Independent solution at selected grid points was generated using block method without overlapping. Despite the success of the block approach, there has been no guidance or recommendation on the choice of the most suitable numbers of interpolation points or the suitable order in improving the accuracy with lesser computational time when solving a very stiff problem. In deriving a good numerical method, the challenge is to increase the stability region while maintaining or even improving efficiency. Therefore, our objective is to construct a new class of hybrid methods by extending the existing block methods by [] to address the setbacks associated with solving stiff ODEs. The improvement is obtained by considering [] with a suitable hybrid points to find numerical solutions of (1).
The paper is organized as follows: in Section 2, we present the formulation of the hybrid method by presenting a review of classical block methods and hybrid block methods from the literature; Section 3 includes the analysis of the new method in terms of order, zero stability, and region of stability. Implementation of the method is discussed in Section 4. In Section 5 numerical tests are performed on first-order differential equation problems possessing stiffness and comparisons with MATLAB solvers are applied in providing numerical solutions for initial value problems of ordinary differential equations. Finally, conclusions are presented in Section 6.
2. Derivation of the Method
Various attempts have been proposed for solving (1) using block methods ranging from constant step size to variable step size, fully implicit and then to diagonally implicit methods, see [,,]. We will illustrate the idea of computation in block by reviewing the theory of block methods available in the literature as follows.
2.1. Review of Block Methods
The idea of using block methods for solving ODEs was initially developed by [,] followed by []. Later, [] proposed block methods in the form of predictor-corrector for solving special second-order ODEs of type non-stiff while [] proposed parallel solution of solving (1). Adopting the definition by [], the general form of a block method can be expressed as follows:
Definition 1.
A—block,—point block method is a matrix of finite difference equation of the form
whereandare defined by. All theandare properly chosenmatrix coefficients andrepresent the block number, andis the first step number of theth block andis the block size.
The method derived in the form of (2) has the advantage of producing —point solutions simultaneously at each application. Lagrange Interpolation was adopted by some authors to generate continuous linear multistep method, among them are [,,].
2.2. Hybrid Block Method
Recently many authors have extended existing block method by adding hybrid points which is also referred as off-step points to find numerical solutions for (1). Some of the works on hybrid methods when solving (1) has been developed by see [,,,]. From [], the focus is on the construction of explicit hybrid methods with nonnegative coefficients, which are a class of multistep methods incorporating a function evaluation at an off-step point. In [], researchers derived a two-step hybrid methods for , with oscillatory or periodic solutions, through the usage of the exponential fitting technique. Recently, [] proposed a method by considering two intermediate points and the approximation of the true solution by an adequate polynomial and imposing collocation conditions. However, there are some drawbacks ranging from choosing the suitable order of the method and the number of off-step points to be included as hybrid methods.
2.3. Formulation of Hybrid Block
The method derived in this section is a hybrid block multistep method. The formulation is based on the existing BBDFs by adding off-step points in the formula that possessed –stability property can be generated. The formulas are commonly derived by using an integrated form of the ODEs and replacing the integrals with interpolating polynomial. We consider the grid points, and with and three off-step-points and as illustrated in Figure 1.
Figure 1.
Hybrid block method with three off-step points.
The basic idea to formulate hybrid block backward differentiation formulas (HBBDF) is to replace in (1) by an interpolating polynomial of degree Assume the solution to (1) is approximated by the polynomial :
The polynomial associated with interpolating points , , , and is given by:
Substituting in (4), we obtain:
Generally, if we differentiate (3), yields the following:
In our case, we differentiate (5) once with respect to at the point gives the following:
Upon substituting respectively into (7) we obtained the coefficients for the HBBDF method as follows:
3. Analysis of the Proposed Method
In this section our objective is directed towards the discussion of the properties of the HBBDF method which includes order of the new method, zero stability and consistency which are the necessary conditions for convergence of the method. Region of absolute stability of the HBBDF will also be studied to determine its suitability of solving stiff ODEs.
3.1. Order
We start by defining the order and error constant as given in [].
Definition 2.
(Order)
The linear multistep method associated with the linear difference operator are said to be of order if and .
Definition 3.
(Error constant)
The termis called the error constant and it implies that the local truncation error is given by:
In order to check the consistency of the method, first, we will determine the order of the method. By rearranging the equation in (8), we get the following equation:
Based on the matrix form of Equation (2), Equation (9) can be written as follows:
with
We defined the linear difference operator associated with the hybrid BBDFs method in Equation (2) which is given by [] as:
where and are constants. Expanding and in Equation (10) using Taylor series at and collecting the coefficients of , we obtained:
By letting the collected terms of in (11) as where we can determine the order of the method and the error constant of the method:
We obtained , hence the HBBDF is of order 5. Since the HBBDF method is of order it is consistent by definition. The error constant is just above.
3.2. Convergence of the Derived Method
In this section we investigate the convergence of the HBBDFs. The convergence of a numerical method is generally determined by analysing consistency and zero stability given in the following theorem.
Theorem 1.
(Convergence):
The necessary and sufficient conditions for the linear multistep method to be convergent are that it be both consistent and zero-stable.
Proof of Theorem 1.
See [].
In order to check the consistency of the method, we use the following definition given by []. □
Definition 4.
(Consistent)
The linear multistep method is said to be consistent if it has the order of.
Hence, HBBDF in (8) is consistent. Next, we discuss the zero stability associated with HBBDFs.
Definition 5.
(Zero stable)
The block method is zero stable provided the rootsof the first characteristics polynomialspecified as:
This satisfiesand for those roots withthe multiplicity must not exceed two.
We find the stability polynomial of HBBDF by applying linear test problem
into Equation (8) yields,
Next, we transformed Equation (14) into matrix form as below:
with
and which is equivalent to .
Denote the associated stability polynomial, of the HBBDF method is obtained by computing ,
Substitute into (15) to find the roots of the stability polynomial,
Next, we solve for as follows:
This yields the roots and . All of the roots have modulus less than one which satisfied the zero stable conditions given in definition 5. Thus, we conclude that HBBDF is zero stable. We have shown that the HBBDF method is consistent and zero stable. From Theorem 1, we conclude the HBBDF converged.
3.3. Stability of Mathematical Components
Before we construct the region of absolute stability of the HBBDF method derived in Section 2, we give some definitions adopt from [].
Definition 6.
(–stable)
A numerical method is said to be –stable if the left-hand half-plane with , , is contained by the absolute stability regions of the method used. This means that the stability region covers the entire negative left half plane.
Definition 7.
stable)
A method is said to be stable if it is stable for all such that The boundary of the stability region is given by the set of points determined by for which . Note that the set of values of for which the method is stable is called the stability domain. Below we present the stability region which corresponds to the HBBDF method drawn in the plane. The region of absolute stability is shown in Figure 2.
Figure 2.
The region of absolute stability for the fifth order hybrid block backward differentiation formulas (HBBDF).
The shaded region represents the set of points for which . Evidently, from Figure 2, this region of stability includes all the negative real axis which corresponds to an –stable method. Next, we make comparison of stability region of HBBDF with the existing BBDF of the same order. The region for both methods are presented in Figure 3.
Figure 3.
Comparison of stability regions between HBBDF and block backward differentiation formulas (BBDF, 5).
Looking at the stability regions in Figure 3, we see that the HBBDF is –stable while the BBDF(5) is stable. The absolute instability interval of both methods is tabulated in Table 1.
Table 1.
Instability boundaries for HBBDF versus BBDF (5).
From Table 1, the interval of instability for HBBDF is smaller than BBDF (5).
4. Implementation of HBBDF Method
In this section, we discussed the application of Newton’s method in the implementation of the HBBDF method for integrating stiff ODEs. Let denote the iteration, denote the iterative value of and denote as the differences between and iteration values of as follows:
Newton’s iteration for the HBBDF takes the following form,
where
, and are the back-values as follows,
Therefore, from Equations (16) and (17), we get the following equation to calculate the approximation,
and the matrix form of Equation (19) becomes,
The code developed will be using the PECE (predict–evaluate–correct–evaluate) mode. denote the predicted value of For example, to approximate point using PECE mode, a predictor equation for is denoted as which can be expressed as follows,
5. Numerical Results and Discussion
In this section, we present some numerical results in order to illustrate the performance of the new method in solving stiff ODEs. Three sets of stiff problems are tested under various step sizes and The numerical results will be compared with stiff solver ode15s in MATLAB and with the existing BBDF by [] of the same order. For error calculations, the error formula is given by:
In (20), is the exact solution for the problem considered and is the computed solution.
Problem 1.
Source []
Exact Solution:.
Problem 2.
Source []
Exact Solution:.
Problem 3.
Source []
Exact Solution:
The evaluation of maximum error, MAXE is computed as follows,
with is the number of equations, and is the total number of step. The results obtained by HBBDF are summarized in the following Table 2, Table 3, Table 4, Table 5, Table 6 and Table 7 and Figure 4, Figure 5, Figure 6, Figure 7, Figure 8, Figure 9 and Figure 10.
Table 2.
Numerical results for Problem 1.
Table 3.
Solutions for Problem 1.
Table 4.
Numerical results for Problem 2.
Table 5.
Approximated solutions for Problem 2.
Table 6.
Numerical results for Problem 3.
Table 7.
Approximated solutions for Problem 3.
Figure 4.
Accuracy curves for Problem 1.
Figure 5.
The graph of exact and approximated solutions for Problem 1.
Figure 6.
Accuracy curves for Problem 2.
Figure 7.
The graph of exact and approximated solutions for Problem 2.
Figure 8.
Accuracy curves for Problem 3.
Figure 9.
The graph of exact and approximated solutions for Problem 3 of .
Figure 10.
The graph of exact and approximated solutions for Problem 3 of .
Table 3, Table 5 and Table 7 gives the comparison of numerical solution at ten points equally spaced in the interval of integration to exact solution when .
Here we observe that the graph of the approximated solution and the graph of the exact solution coincide with each other.
6. Conclusions
In this paper we have derived a class of hybrid BBDF for the numerical integration of stiff ordinary differential equations. By restricting the method to three off-step points, the results presented in show that the stability region for the HBBDF with three off-step points are larger than the stability of the BBDF method without the off-step points even though both methods are of the same order. We also establish the convergence of the new method by investigate the zero-stability and consistency which are the necessary conditions for convergence. Our numerical experiments support the conclusion that HBBDF solve the problem with acceptable efficiency when compared to MATLAB solver, ode15s, especially when we are integrating at smaller step sizes. It is recommended to extend the HBBDF to a variable step size variable order, VSVO code.
Author Contributions
Conceptualization, Z.B.I.; methodology, Z.B.I., A.A.N.; validation, Z.B.I., and A.A.N.; writing—original draft preparation, Z.B.I., A.A.N.; writing—review and editing, Z.B.I., A.A.N.; supervision, Z.B.I.; project administration, Z.B.I.; funding acquisition, U.P.M. All authors have read and agreed to the published version of the manuscript.
Funding
This research was funded by UNIVERSITI PUTRA MALAYSIA, grant number IPS/2018/9624600.
Acknowledgments
The authors are thankful to the referees for their valuable comments.
Conflicts of Interest
The authors declare no conflict of interests regarding the publication of this paper.
Abbreviations
| HBBDF | Hybrid Block Backward Differentiation Formula of order 5 |
| BBDF(5) | Fifth Order Block Backward Differentiation Formula by [] |
| ode15s | Variable order solver based on numerical differentiation formulas, NDFs. |
| h | Step size |
| MAXE | Maximum global error |
References
- Aiken, R. (Ed.) Stiff Computation; Oxford University Press: New York, NY, USA, 1985. [Google Scholar]
- Sandu, A.; Verwer, J.G.; Blom, J.G.; Spee, E.J.; Carmichael, G.R.; Potra, F.A. Benchmarking Stiff ODE Solvers for Atmospheric Chemistry Problems II: Rosenbrock Solvers. Atmos. Environ. 1997, 31, 3459–3479. [Google Scholar] [CrossRef]
- Kin, J.; Cho, S.Y. Computational Accuracy and Efficiency of the Time-Splitting Method in Solving Atmospheric Transport/Chemistry Equations. Atmos. Environ. 1997, 31, 2215–2224. [Google Scholar] [CrossRef]
- Hairer, E.; Wanner, G. Solving Ordinary Differential Equations II: Stiff Differential-Algebraic Problems, 2nd ed.; Springer: Berlin/Heidelberg, Germany, 1996. [Google Scholar]
- Curtiss, C.F.; Hirschfelder, J.O. Integration of Stiff Equations. Proc. Natl. Acad. Sci. USA 1952, 38, 235–243. [Google Scholar] [CrossRef]
- Dahlquist, G. Ake Bj orck. Numerical Methods; Prentice-Hall: Upper Saddle River, NJ, USA, 1974. [Google Scholar]
- Tokman, M. Efficient integration of large stiff systems of ODEs with exponential propagation iterative (EPI) methods. J. Comput. Phys. 2006, 213, 748–776. [Google Scholar] [CrossRef]
- Gear, C.W. The Automatic Integration of Stiff Ordinary Differential Equations; Morrell, A.J.H., Ed.; IFIP Congress: Edinburgh, UK; North-Holland/Amsterdam, The Netherlands, 1968; pp. 187–193. [Google Scholar]
- Gear, C.W. The automatic integration of ordinary differential equations. Comm. ACM 1971, 14, 176–179. [Google Scholar] [CrossRef]
- Ibrahim, Z.B.; Othman, K.I.; Suleiman, M. Implicit r-point block backward differentiation formula for solving first-order stiff ODEs. Appl. Math. Comput. 2007, 186, 558–565. [Google Scholar] [CrossRef]
- Majid, Z.; Suleiman, M.B. Implementation of four-point fully implicit block method for solving ordinary differential equations. Appl. Math. Comput. 2007, 184, 514–522. [Google Scholar] [CrossRef]
- Yatim, S.A.M.; Ibrahim, Z.B.; Othman, K.I.; Suleiman, M.B. A Quantitative Comparison of Numerical Method for Solving Stiff Ordinary Differential Equations. Math. Probl. Eng. 2011, 2011. [Google Scholar] [CrossRef]
- Zawawi, I.S.M.; Ibrahim, Z.B.; Ismail, F.; Majid, Z.A. Diagonally Implicit Block Backward Differentiation Formulas for Solving Ordinary Differential Equations. Int. J. Math. Math. Sci. 2012, 2012, 767328. [Google Scholar] [CrossRef]
- Milne, W.E. Numerical Solution of Differential Equations; John Wiley & Sons: New York, NY, USA, 1953. [Google Scholar]
- Rosser, J.B. A Runge Kutta for All Seasons. SIAM Rev. 1967, 9, 417–452. [Google Scholar] [CrossRef]
- Shampine, L.F.; Watts, H.A. Block Implicit One-step Methods. Math. Comp. 1969, 23, 731–740. [Google Scholar] [CrossRef]
- Fatunla, S.O. Block Methods for Second Order ODEs. Intern. J. Comput. Math. 1991, 41, 55–63. [Google Scholar] [CrossRef]
- Chu, M.T.; Hamilton, H. Parallel Solution of ODE’s by Multi-block Methods. SIAM J. Sci. Stat. Comput. 1987, 8, 342–353. [Google Scholar] [CrossRef]
- Gragg, W.B.; Stetter, H.J. Generalized Multistep Predictor-Corrector Methods. J. Assoc. Comput. Mach. 1964, 11, 188–209. [Google Scholar] [CrossRef]
- Abasi, N.; Suleiman, M.; Abasi, N.; Musa, H. 2-point block BDF method with off-step points for solving stiff ODEs. J. Soft Comput. Appl. 2014, 2014, 1–15. [Google Scholar] [CrossRef][Green Version]
- Okuonghae, R.I.; Ikhile, M.N.O. On the construction of high order A—(α) stable hybrid linear multistep methods for stiff IVPs in ODEs. Numer. Anal. Appl. 2012, 5, 231–241. [Google Scholar] [CrossRef]
- D’Ambrosio, R.; Esposito, E.; Paternoster, B. Exponentially fitted two-step hybrid methods for y”=f(x,y). J. Comput. Appl. Math. 2011, 235, 4888–4897. [Google Scholar] [CrossRef]
- Ramos, H.; Singh, G. A tenth order of A-stable two-step hybrid block method for solving initial value problems of ODEs. Appl. Math. Comput. 2017, 310, 75–88. [Google Scholar] [CrossRef]
- Lambert, J.D. Numerical Methods for Ordinary Differential Equations: The Initial Value Problems; John Wiley & Sons: Hoboken, NJ, USA, 1991. [Google Scholar]
- Dahlquist, G.G. A special stability problem for linear multistep methods. Bit Numer. Math. 1963, 3, 27–43. [Google Scholar] [CrossRef]
- Nasir, N.A.A.M.; Ibrahim, Z.B.; Suleiman, M.B.; Othman, K.I. Fifth Order Two-point Block Backward Differentiation Formulas for Solving Ordinary Differential Equations. Appl. Math. Sci. 2011, 5, 3505–3518. [Google Scholar]
- Burden, R.L.; Faires, J.D. Numerical Analysis; Brooks/Cole: Belmont, CA, USA, 2001. [Google Scholar]
- Huang, S.J.Y. Implementation of General Linear Methods for Stiff Ordinary Differential Equations; Department of Mathematics, Auckland University: Auckland, New Zealand, 2005; p. 30. [Google Scholar]
© 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).