Abstract
In this research, a six-order, fully implicit Block Backward Differentiation Formula with two off-step points (BBDFO(6)), for the integration of first-order ordinary differential equations (ODEs) that exhibit stiffness, is proposed. The order, consistency and stability properties of the method are discussed, and the method is found to be zero stable and consistent. Hence, the method is convergent. The numerical comparisons with the existing methods of a similar type are given to demonstrate the accuracy of the derived method.
1. Introduction
In this paper, we consider the numerical solution of the first order initial value problem (IVP) of ordinary differential equations (ODEs) in the form of
where and Equation (1) is said to be linear if where is a constant matrix and is a d-dimensional vector assumed to be continuously differentiable, and if it satisfies the Lipschitz conditions as given in [1], which guarantees the existence and uniqueness of the solution of Equation (1).
The development of numerical methods for the solution of Equation (1) is influenced by the types of ODEs, such as linear or non-linear ODEs, or stiff or non-stiff ODEs. Note that using the wrong type of method for a model can produce slow and/or inaccurate results. Generally, the problems in the form of Equation (1) can be classified into two types. The first type is non-stiff ODEs, for which all of the components evolve simultaneously and on comparable time-scales. Non-stiff problems are often solved by using explicit methods with some error control. The second type is stiff ODEs. The first appearance of the term “stiff” is in the paper by [2] on the problems in chemical kinetics. There are various definitions of stiffness given in the literature since there is no universally accepted definition. The problem in Equation (1) is said to be describing the stiff problem if:
- It contains widely varying time scales, i.e., some components of the solution decay much more rapidly than others [3];
- The step size is dictated by the stability requirements rather than the accuracy requirements [3];
- Explicit methods do not work, or work only extremely slowly [4];
- All of its eigenvalues have negative real parts, and the stiffness ratio (the ratio of the magnitudes of the real parts of the largest and smallest eigenvalues) is large [3];
- No solution component is unstable (no eigenvalue of the Jacobian matrix has a real part which is at all large and positive) and at least some components are very stable (at least one eigenvalue has a real part which is large and negative) [5].
For this article, we consider the definition of stiffness to be that given by [6] which stated that the linear system of Equation (1) is said to be stiff if,
- (i)
- and
- (ii)
- where are the eigenvalues of A and the ratio is called the stiffness ratio as a measure of stiffness.
The consideration of stability properties is particularly important when developing methods for solving stiff ODEs, and implicit methods which possess an A-stable region are preferred. Several numerical methods of various types have been proposed for the integration of both types of problems in Equation (1). Among the most popular and widely used methods for the solution of the stiff systems in Equation (1) are the Backward Differentiation Formulas (BDFs) proposed by [7]. In MATLAB, Gear’s methods are implemented in the stiff solver ode15s.
For many years, the development of more advanced and efficient methods for the solution of ordinary differential equations (ODEs) has been an active research area. Most of the developments have been based on block methods. These block methods generate multiple solutions simultaneously and in single iterations. As noted by [8,9,10,11,12,13,14,15,16,17,18], these methods are effective for solving the problems in Equation (1). The block methods not only reduce the computational time but also require a smaller number of function evaluations per step. These block methods include the variable order Adams methods, the Runge–Kutta methods and Backward Differentiation Formulas. Inspired by Gear’s method, [11,12,13,14,15,16,17,18] developed Block Backward Differentiation Formulas (BBDFs) which are proven to be efficient in solving stiff ODEs. For a detailed study on the theory and development of BBDFs, one can refer to [19]. Recently, the method that incorporated a BBDF proposed by [11] has been modified and extended, and it is now an improved method due to its enhancements in reducing the total number of integration steps and computational time, and in providing better accuracy of the approximation—see [12,20]. Therefore, in this paper, we formulate a new method called the Block Backward Differentiation Formula with two off-step points (BBDFO(6)) which is extended from the BBDF method developed by [14] by adding off-step points. These block methods with off-steps were studied by [21]. A closely related method with off-step points was described by [22,23,24]. A similar approach is adapted from [25,26] in adjusting the selection of the most suitable off-step points. We extend the theory to [11] and establish new coefficients of stability which is an improvement on the work of [21]. We shall restrict our discussion to solving stiff ODEs.
This paper is organized as follows: in Section 2, we present the derivation of the coefficients of the new method; Section 3 includes the order, zero stability, and region of stability of the proposed method. In Section 4, numerical tests are performed on the first-order differential equation problems possessing stiffness and are compared to related works. Finally, the conclusions are presented in Section 5.
2. Derivation of BBDF with Off-Step Points, BBDFO
In this section, a detailed discussion of the derivation of the proposed method for the solution of Equation (1) will be presented. We considered the three points of equal step size h given by as the starting values and the two off-step points as and with half the step size, as illustrated in Figure 1.
Figure 1.
Block method with off-step points.
In a 2-point block method (refer to Figure 1), the interval is divided into a series of blocks. In this case, the values at the points in the previous block are used to compute the solution of Equation (1) at and simultaneously. The class of methods we aim to consider is the general step linear multistep method (LMM) in the form
where is the step size, and are unknown constants which are uniquely determined and is the step number. Note that is the numerical solution for the exact solution , and is the grid index.
In order to construct the new method, we need to extend the LMM in Equation (2) by introducing the off-step points. The extension of an LMM which involves evaluated at an off-step point that takes the following general form
Equation (3) is expanded to generate the block method.
Therefore, the approximation at the point is given as follows
To obtain the first formula for , we substitute into Equation (4), and then, to remove the arbitrariness of the coefficients, we normalize the value of , which yields
Equation (5) can also be interpreted as an exact relation between the approximated values of the equation by replacing the equation as follows
The expansions of and using Taylor’s series about in Equation (6) are given below
By substituting Equation (7) into Equation (6), we obtain
Next, we collect all the coefficients of in Equation (8) by factorizing. Then, is defined as the collected coefficients where and, as mentioned before, , which yields
where
By solving Equation (9) simultaneously, the coefficients of the method are obtained.
By substituting all the values of and obtained into Equation (5), we get
We rearrange Equation (11) to form the solution value of ,
Similarly, the procedures are repeated to obtain the next solution values by substituting and for and for and and for .
Hence, the BBDFO formulas are given by
In the following sections, the order, zero stability, region of stability and convergence of the new BBDFO method will be discussed.
3. Order, Convergence and Stability of the Method
This section is concerned with the order, convergence and stability of the proposed method. The following definitions, as stated in [6], give the meanings of order, consistency, zero stable and A-stability by relating them to the definition of convergence.
Definition 3.1.
(Convergence)
The necessary sufficient conditions for a linear multistep method to be convergent are that it must be consistent and zero-stable.
Definition 3.2.
(Order)
Linear multistep methods associated with the linear difference operator are said to be order if and .
Definition 3.3.
(Consistent)
The linear multistep method Equation (2) is said to be consistent if it has order .
Definition 3.4.
(Zero stable)
The linear multistep method Equation (2) is said to be zero stable if no root of the first characteristics of the polynomial has a modulus greater than one, and if every root with modulus one is simple.
Definition 3.5.
(A-stable)
If a method is stable for all in the left-half plane , then the method is said to be A-stable. This means the stability region covers the entire negative left-half plane.
3.1. Order of the Method
The formula in Equation (12) can be rewritten as follows
We expressed Equation (13) by the following matrix form
Let
By letting the collected terms of in Equation (16) as where we can determine the order of the method and the error constant of the method.
CThe associated linear difference operator, the order and error constants for the method in Equation (12), can be defined by extending the corresponding definitions for a linear multistep method.
Expanding on Equation (14) with Taylor’s series of expansions of and about the terms can be collected to obtain
We have
This yields the error constant
which shows that the order of the method is six. Next, we examine the consistency of the method.
In accordance with Definition 3.3., the BBDFO(6) method is consistent since the order is greater than one.
3.2. Zero Stability of the Method
Next, we will discuss the zero stability of the method which is one of the criteria for the method to be convergent. The stability of the method in Equation (3) is determined using the linear test equation proposed by [27] as
where is a complex constant with . The substitution of Equation (17) into Equation (12) leads to the following
Equation (18) can be rewritten in the following matrix form
The matrices and are given by
By inputting , the stability polynomial associated with the method in Equation (3) is determined by the location of the roots by solving the characteristic equation .
From the stability polynomial in Equation (19), it follows that its zero stability is determined by substituting into Equation (19), yielding
Solving , leads to the roots and .
Since all the roots lie within , we can conclude that the method for BBDFO(6) is zero stable. In the next subsection, we determine the absolute stability region for the BBDFO(6) method.
3.3. Stability Region of the Method
In this subsection, we plot the stability region of the method from the stability polynomial given in Equation (19). The boundary of the stability region is given by the set of points determined by , . It is necessary to test the root condition ( of the stability polynomial at numerous grid points in the stability space to obtain the boundary of the stability region. The region of absolute stability for the method in Equation (12) is as shown in Figure 2.
Figure 2.
Stability region of the sixth order Block Backward Differentiation Formula with two off-step points (BBDFO(6)).
Figure 2 shows the stability region which corresponds to the BBDFO(6) method. The stable region lies outside the closed region and it covers the entire left-half plane. From Definition 3.5, we can conclude that the BBDFO(6) method is A-stable.
3.4. Stability Comparison
The following figure shows the stability region of the new BBDFO(6) as compared to the existing stability region of the order six Block Backward Differentiation Formula without the off-step points, denoted as BBDF(6). For further discussion of the BBDF(6) method, see [28]. Figure 3 shows the region of both methods, i.e., the BBDFO(6) and the BBDF(6) in the complex plane.
Figure 3.
Comparison of the stability regions between the BBDFO(6) and the Block Backward Differentiation Formula without the off-step points (BBDF(6)).
Next, we compare the interval of instability of the new BBDFO(6) with the BBDF(6) by [28].
It is clear, from Table 1, that the derived BBDFO(6) has a larger stability region.
Table 1.
Comparison of instability interval BBDFO(6) versus BBDF(6).
4. Numerical Results
In this section, the three problems that exhibit stiffness, given by , will be tested by using the proposed method with the step sizes and The efficiency of the method is compared to the exact solutions to illustrate the accuracy of the method.
Problem 1.
(See [29]).
Exact solution: .
Problem 2.
(See [13]).
Exact solution:
Problem 3.
(See [19]).
Exact solution:
For error calculations, the error formula is given by
where is the exact solution and is the computed solution.
The MATLAB solver ode15 s was chosen to compare the methods since it is the most popular code for solving stiff problems. It is a variable order solver which is based on the numerical differentiation formulas (NDFs) and optionally comes with the backward differentiation formulas (BDFs), also known as Gears’ method. The numerical results are presented in Table 2, Table 3 and Table 4.
Table 2.
Numerical comparison for Problem 1.
Table 3.
Numerical comparison for Problem 2.
Table 4.
Numerical comparison for Problem 3.
Figure 4, Figure 5 and Figure 6 are the graphs showing the accuracy of the BBDFO(6) compared with the BBDF(6) and the ode15 s at different time steps, h.
Figure 4.
Graph of versus for Problem 1.
Figure 5.
Graph of versus for Problem 2.
Figure 6.
Graph of versus for Problem 3.
5. Conclusions
In conclusion, a new method with off-step points, the BBDFO of order six, is introduced as the numerical solution of stiff initial-value problems. The stability analysis of the BBDFO indicates that the method is consistent and zero stable; therefore, the BBDFO(6) is convergent. The developed method is suitable to solve stiff ODEs since it possesses an A-stability property. The interval of instability for the BBDFO(6) is smaller than that of the BBDF(6) proposed by [28]. The numerical results obtained using the BBDFO(6) were compared with existing methods of a similar type and performed with the MATLAB solver ode15s. The BBDFO(6) is found to be more efficient at certain step sizes. Hence, we can conclude that the BBDFO(6) could be a compatible alternative solver for stiff ODEs.
Author Contributions
Conceptualization, Z.B.I.; methodology, Z.B.I., A.A.N.; validation, Z.B.I., A.A.N., and H.R.; writing—original draft preparation, Z.B.I., A.A.N.; writing—review and editing, Z.B.I., A.A.N.; supervision, Z.B.I.; project administration, Z.B.I.; funding acquisition, UPM. All authors have read and agreed to the published version of the manuscript.
Funding
This research was funded by UNIVERSITI PUTRA MALAYSIA, under the Putra-IPS Grant (project no.:GP-IPS/2018/9624600).
Acknowledgments
The authors are thankful to the referees for their valuable comments.
Conflicts of Interest
The authors declare no conflict of interests regarding the publication of this paper.
Abbreviations
| BBDFO(6) | New Block Backward Differentiation Formula with off-step points of order 6 |
| BBDF(6) | 2-point Block Backward Differentiation Formula of order 6 in [28] |
| ode15s | Variable order Backward Differentiation Formula [7]. |
| NS | Number of steps |
| Step size | |
| MAXE | Maximum error |
References
- Henrici, P. Discrete Variable Methods in Ordinary Differential Equations; John Wiley & Sons Inc.: Hoboken, NJ, USA, 1969. [Google Scholar]
- Curtiss, C.F.; Hirschfelder, J.O. Integration of stiff equations. Proc. Natl. Acad. Sci. USA 1952, 38, 235–243. [Google Scholar] [CrossRef] [PubMed]
- Lambert, J.D. Numerical Methods for Ordinary Differential Systems: The Initial Value Problem; John Wiley & Sons, Inc.: Hoboken, NJ, USA, 1991. [Google Scholar]
- Wanner, G.; Hairer, E. Solving Ordinary Differential Equations II; Springer: Berlin/Heidelberg, Germany, 1996; p. 2. [Google Scholar]
- Butcher, J.C. Numerical Methods for Ordinary Differential Equations; John Wiley & Sons: Hoboken, NJ, USA, 2016. [Google Scholar]
- Lambert, J.D. Computational Methods in Ordinary Differential Equations; John Wiley & Sons: Hoboken, NJ, USA, 1973; pp. 22–23, 231–233. [Google Scholar]
- Gear, C.W. Numerical Initial Value Problems in Ordinary Differential Equations; Prentice-Hall: Englewood Cliffs, NJ, USA, 1971; ISBN 013-626606-1. [Google Scholar]
- Rosser, J.B. A Runge-Kutta for all seasons. Siam Rev. 1967, 9, 417–452. [Google Scholar] [CrossRef]
- Shampine, L.F.; Watts, H.A. Block implicit one-step methods. Math. Comput. 1969, 23, 731–740. [Google Scholar] [CrossRef]
- Majid, Z.A.; Suleiman, M.B.; Omar, Z. 3-point implicit block method for solving ordinary differential equations. Bull. Malays. Math. Sci. Soc. Second Ser. 2006, 29, 23–31. [Google Scholar]
- Ibrahim, Z.B.; Othman, K.I.; Suleiman, M. Implicit r-point block backward differentiation formula for solving first-order stiff ODEs. Appl. Math. Comput. 2007, 186, 558–565. [Google Scholar] [CrossRef]
- Ibrahim, Z.B.; Othman, K.I.; Suleiman, M. 2-point block predictor-corrector of backward differentiation formulas for solving second order ordinary differential equations directly. Chiang Mai J. Sci. 2012, 39, 502–510. [Google Scholar]
- Musa, H.; Suleiman, M.B.; Senu, N. Fully implicit 3-point block extended backward differentiation formula for stiff initial value problems. Appl. Math. Sci. 2012, 6, 4211–4228. [Google Scholar]
- Nasir, N.A.A.M.; Ibrahim, Z.B.; Othman, K.I.; Suleiman, M. Numerical solution of first order stiff ordinary differential equations using fifth order block backward differentiation formulas. Sains Malays. 2012, 41, 489–492. [Google Scholar]
- Musa, H.; Suleiman, M.B.; Ismail, F.; Senu, N.; Ibrahim, Z.B. An improved 2–point block backward differentiation formula for solving stiff initial value problems. Aip. Conf. Proc. Am. Inst. Phys. 2013, 1522, 211–220. [Google Scholar]
- Jator, S.N.; Agyingi, E. Block Hybrid-Step Backward Differentiation Formulas for Large Stiff Systems. Int. J. Comput. Math. 2014, 2014, 1–8. [Google Scholar] [CrossRef]
- Jana Aksah, S.; Ibrahim, Z.B.; Zawawi, M.; Shah, I. Stability analysis of singly diagonally implicit block backward differentiation formulas for stiff ordinary differential equations. Mathematics 2019, 7, 211. [Google Scholar] [CrossRef]
- Ola Fatunla, S. Block methods for second order ODEs. Int. J. Comput. Math. 1991, 41, 55–63. [Google Scholar] [CrossRef]
- Ibrahim, Z.B. Block Multistep Methods for Solving Ordinary Differential Equations. Ph.D. Thesis, Universiti Putra Malaysia, Putrajaya, Malaysia, 2006. [Google Scholar]
- Musa, H.; Suleiman, M.B.; Ismail, F.; Senu, N.; Ibrahim, Z.B. An accurate block solver for stiff IVPs. ISRN Appl. Math. 2013, 7, 61–67. [Google Scholar]
- Abasi, N.; Suleiman, M.; Abasi, N.; Musa, H. 2-point block BDF method with off-step points for solving stiff ODEs. J. Soft Comput. Appl. 2014, 1–15. [Google Scholar] [CrossRef][Green Version]
- Yap, L.K.; Ismail, F. Block Methods with Off-Steps Points for Solving First Order Ordinary Differential Equations. In International Conference on Mathematical Sciences and Statistics 2013; Springer: Singapore, 2013; pp. 275–284. [Google Scholar]
- Babangida, B.; Musa, H. Diagonally Implicit Super Class of Block Backward Differentiation Formula with Off-Step Points for Solving Stiff Initial Value Problems. J. Appl. Comput. Math. 2016, 5, 1–7. [Google Scholar]
- Ra’ft Abdelrahim, Z.O.; Kuboye, J.O. New Hybrid Block Method with Three Off-Step Points for Solving First Order Ordinary Differential Equations. Am. J. Appl. Sci. 2016, 13, 209–212. [Google Scholar] [CrossRef]
- Ajileye, G.; Amoo, S.A.; Ogwumu, O.D. Hybrid Block Method Algorithms for Solution of First Order Initial Value Problems in Ordinary Differential Equations. J. Appl. Comput. Math. 2019, 7, 2. [Google Scholar]
- Agarwal, P.; Ibrahim, I.H. A new type OF hybrid multistep multiderivative formula for solving stiff IVPs. Adv. Differ. Equ. 2019, 2019, 1–14. [Google Scholar] [CrossRef]
- Dahlquist, G.G. A special stability problem for linear multistep methods. BIT Numer. Math. 1963, 3, 27–43. [Google Scholar] [CrossRef]
- Nasir, N.A.A.M. Parallel Multiblock Backward Differentiation Formulae for Solving First Order Ordinary Differential Equations. Master’s Thesis, Universiti Putra Malaysia, Putrajaya, Malaysia, 2012. [Google Scholar]
- Othman, K.I.; Ibrahim, Z.B.; Suleiman, M.; Majid, Z. Automatic intervalwise block partitioning using Adams type method and backward differentiation formula for solving ODEs. Appl. Math. Comput. 2007, 188, 1642–1646. [Google Scholar] [CrossRef]
© 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).