Abstract
Variable order block backward differentiation formulae (VOHOBBDF) method is employed for treating numerically higher order Ordinary Differential Equations (ODEs). In this respect, the purpose of this research is to treat initial value problem (IVP) of higher order stiff ODEs directly. BBDF method is symmetrical to BDF method but it has the advantage of producing more than one solutions simultaneously. Order three, four, and five of VOHOBBDF are developed and implemented as a single code by applying adaptive order approach to enhance the computational efficiency. This approach enables the selection of the least computed LTE among the three orders of VOHOBBDF and switch the code to the method that produces the least LTE for the next step. A few numerical experiments on the focused problem were performed to investigate the numerical efficiency of implementing VOHOBBDF methods in a single code. The analysis of the experimental results reveals the numerical efficiency of this approach as it yielded better performances with less computational effort when compared with built-in stiff Matlab codes. The superior performances demonstrated by the application of adaptive orders selection in a single code thus indicate its reliability as a direct solver for higher order stiff ODEs.
1. Introduction
Real world problems from various applications in science and engineering can often be modeled into ordinary differential equations (ODEs). Some of the problems are modeled in the form of higher order ODEs [1] in such a way that ODE will describe the behavior of the problems. The main focus of this paper is on the linear third-order stiff initial value problems (IVPs). The linear third order ODEs is categorized as higher order ODE. Define the third-order ODE with its initial conditions as
where , a is the starting point and z is the end point.
Numerical approximations are introduced to solve problems that are impossible to find the actual solution for. We found that a number of methods in the literature can provide approximate solutions for higher order ODEs. Commonly, the higher order ODE is converted into its equivalent system of first order before it is solved. Then, the first-order methods are used to find the approximate solutions. However, this approach leads to complicated execution work and lengthy computation time [2]. It is therefore significant to overcome this drawback by introducing a more efficient method that can solve the higher order problems directly. For that reason, solving higher order problems directly eases the execution work where the proof of direct solutions give advantages in speed and accuracy [3].
To date, the direct solutions that have been proposed to numerically approximate the third-order ODEs include new hybrid block method [4], new linear block method [5] and four-point block hybrid collocation method with two off-step points [2]. However, some of these methods are able to solve non-stiff ODEs. Besides, fourth-order improved Runge–Kutta method is proposed for solving special third-order ODEs [6].
Stiffness is one of the issues in ODE. Explicit methods, however, are not suitable to be applied since small step sizes and a large number of integration steps are required. Thus, implicit methods will take over the explicit methods to provide better performances. In the literature, we found that various methods have been introduced for finding stiff solutions. The pioneering and most well-known method, backward differentiation formula (BDF), was introduced by Gear [7]. In addition, backward Euler method [8], second-derivative general linear methods (SGLMs) [9], high order block implicit multistep [10] and new fourth-order, four-stage parallel Rosenbrock method (NPROS4) [11] have also been proven to be reliable in solving stiffness.
Further innovation on BDF saw the block method being associated with BDF method, also known as block backward differentiation formula (BBDF). The innovation is made at which BBDF is capable to approximate several points instead of one point only at the same time. BBDF has shown its excellent success as this method is capable of providing better approximations and reducing the computational effort for solving the first- and second-order stiff ODE problems [12,13,14,15,16]. In this paper, we develop constant step size of order three, four and five VOHOBBDF and fit the three methods in a single code by applying an adaptive order approach. This approach can enhance the computational efficiency for the direct approximations of the problem in Equation (1) such as minimize computational cost as compared to the BBDF while maintaining its accuracy. Due to the advantages, VOHOBBDF can produce more accurate results, manage to reduce the total number of steps and less time is needed to compute the solutions.
This paper is organized as follows. The formulae for VOHOBBDF are developed based on procedure stated in the second section followed by the detailed explanation on how to implement three different orders of VOHOBBDF methods in a single code. Then, we compute the solutions of the higher order ODEs by applying the proposed code to demonstrate its efficiency, which is followed by a discussion on the performances. Lastly, the final part concludes the advantages of applying the approach to VOHOBBDF methods for treating higher order ODEs.
2. Procedure on Developing Variable Order Block Backward Differentiation Formulae
VOHOBBDF methods consist of methods from order three up to order five with uniform step size. In this section, VOHOBBDF is developed from Lagrange polynomial using MAPLE software for which six, seven, and eight points are interpolated according to the order of VOHOBBDF. This method numerically approximates the solutions at two new points whereby the development of the formulae for each order goes through a similar procedure.
Thus, the procedure to develop the first and second points of the VOHOBBDF methods is briefly explained in the following lines:
- Firstly, we obtain Lagrange polynomials for order three, four and five VOHOBBDF by taking k = 5, 6 and 7.where
- Finally, the resulting formulae for two new points for each order can be formulated into general formulations below:
- Order 3 VOHOBBDF
- Order 4 VOHOBBDF
- Order 5 VOHOBBDFwhere and represent the approximated solutions for first and second point while and represent the function for first and second point.
According to these formulae, we can see that VOHOBBDF methods are implicit scheme. Regarding this matter, predictor methods are needed to compute the functions of and .
The coefficients for each order are listed in the following Table 1 and Table 2 based on the formulae yield in Equations (5)–(7).
Table 1.
Coefficients for first point of VOHOBBDF.
Table 2.
Coefficients for second point of VOHOBBDF.
3. Implementation of VOHOBBDF
3.1. Performing Newton’s Iteration
VOHOBBDF method is implemented in Newton’s iteration form. Based on this idea, Equations (5)–(7) for each point are expressed in Newton’s iteration form. Details explanation can be found in [14]. The updated formulae can then be simplified as a linear system:
where
Notice that , , , are coefficients for and of first derivative while , , , are the coefficients for and of second derivative.
3.2. Suitable Order Selection
This approach aims to fit the different orders of VOHOBBDF in single code. In this way, the code is started to run the lowest order method first (third-order VOHOBBDF) followed by the higher order VOHOBBDF. With such strategy, the most accurate solutions of two future points among the three orders can be selected. Consequently, the best approximations at each step will be the two new values in the current block.
The steps for selecting the appropriate order are explained below.
Step 1: Begin the computation of the linear system in Equation (8) with the lowest order VOHOBBDF (order three) first, followed by computation of order four and five VOHOBBDF to find the approximate solutions for two new points, and .
Step 2: Compare the LTE produced by the three orders of VOHOBBDF.
Step 3: Hence, switch the code to the method with the least LTE to proceed for the next step.
The code is written in C language programme.
4. Numerical Experiments and Discussion
Three different problems were solved directly using the developed method by applying the variable order approach. To analyze the efficiency of applying this approach, the results were compared with two built-in stiff Matlab codes, ode15s and ode23s, which were designed to solve the stiff problems. However, to solve these problems using the Matlab codes, they need to be reduced into their equivalent systems of first order. The accuracy and efficiency of the methods are given in Table 3, Table 4 and Table 5 for comparison purposes. Figure 1, Figure 2 and Figure 3 illustrate the results in Table 3, Table 4 and Table 5.
Table 3.
Numerical results for Problem 1.
Table 4.
Numerical results for Problem 2.
Table 5.
Numerical results for Problem 3.
Figure 1.
Efficiency graph for Problem 1.
Figure 2.
Efficiency graph for Problem 2.
Figure 3.
Efficiency graph for Problem 3.
Let E be the error,
Therefore, the average error (AE) and maximum error (ME) are defined as
where TS is the total steps and n is the number of equations.
The general form for equivalent system of first order ODE is as follows.
Refer to the general form of third order ODE in Equation (1) and its equivalent form of first order in Equation (4). The problems to be tested are as follows.
Problem 1
Exact solution:
Initial conditions:
Interval:
Equivalent system of first order
Exact solutions:
Initial conditions:
Problem 2
Exact solution:
Initial conditions:
Interval:
Equivalent system of first order
Exact solutions:
Initial conditions:
Problem 3
Exact solution:
Initial conditions:
Interval:
Equivalent system of first order
Exact solutions:
Initial conditions:
5. Discussion
As evident from the results in Table 3, Table 4 and Table 5 and Figure 1, Figure 2 and Figure 3, the proposed method could improve the accuracy of all the test problems. The results also show that VOHOBBDF obtained the smallest maximum errors at different value of step sizes. Furthermore, the errors are also within the tolerance value. As shown in the results, VOHOBBDF successfully achieved less computational cost compared to both Matlab codes. It is clearly observed that the number of total steps was reduced to half and the method also sped up the execution time at all step sizes. Therefore, less time is needed to compute the solutions. This is due to the benefit of block method, where VOHOBBDF managed to produce two numerical approximations simultaneously at each step and approximate the solutions directly, thus decreasing the computational time.
6. Conclusions
This research demonstrates that the adaptive order approach applied to VOHOBBDF methods is significantly advantageous as it yields better performances over the built-in stiff Matlab codes. The approximate results of all the problems are better in accuracy as the results obtained lower maximum errors than both Matlab codes. The method also reduces computation time since the higher order problems can be solved directly. Hence, VOHOBBDF has proven its superior performances and reliability to be served as a direct solver for higher order stiff ODEs.
Author Contributions
Conceptualization, A.I.A.; Funding acquisition, S.A.M.Y.; Methodology, A.I.A.; Resources, Z.B.I.; Supervision, S.A.M.Y.; Validation, S.A.M.Y. and Z.B.I.; Writing—original draft, A.I.A.; Writing—review and editing, A.I.A. and S.A.M.Y.
Funding
This research was funded by Fundamental Research Grant Scheme (FRGS), 203/PJJAUH/671168.
Conflicts of Interest
The authors declare no conflict of interest.
Abbreviations
The following abbreviations are used in this manuscript:
| ME | Maximum error |
| AE | Average error |
| h | Step size |
| ET(s) | Execution time in seconds |
References
- Suleiman, M.B.; Ibrahim, Z.B.; Rasedee, A.F.N.B. Solution of higher-order ODEs using backward difference method. Math. Probl. Eng. 2011, 2011, 810324. [Google Scholar] [CrossRef]
- Yap, L.K.; Ismail, F. Four point block hybrid collocation method for direct solution of third order ordinary differential equations. In Proceedings of the 25th National Symposium on Mathematical Sciences, Kuantan, Malaysia, 27–29 August 2017; AIP Publishing: Melville, NY, USA, 2018; pp. 1–9. [Google Scholar]
- Gear, C.W. The numerical integration of ordinary differential equations. In Mathematics of Computation; American Mathematical Society: Providence, RI, USA, 1967; pp. 21, 146–156. [Google Scholar]
- Hijazi, M.; Abdelrahim, R. The Numerical Computation of three step hybrid block method for directly solving third order ordinary differential equations. Glob. J. Pure Appl. Math. 2017, 13, 89–103. [Google Scholar]
- Adeyeye, O.; Omar, Z. New linear block method for third order ordinary differential Equations. J. Eng. Appl. Sci. 2018, 13, 4913. [Google Scholar]
- Hussain, K.A.; Ismail, F.; Senu, N.; Rabiei, F. Fourth-order improved Runge–Kutta method for directly solving special third-order ordinary differential equations. Iran. J. Sci. Technol. 2017, 41, 429–437. [Google Scholar] [CrossRef]
- Gear, C.W. The automatic integration of stiff ordinary differential equations. In Proceedings of IFIP Congress; North Holand Publishing Company: Amsterdam, The Netherlands, 1969; pp. 187–193. [Google Scholar]
- Sumithra, B. Numerical solution of stiff system by backward euler method. Appl. Math. Sci. 2015, 9, 3303–3311. [Google Scholar] [CrossRef]
- Abdi, A. Construction of high-order quadratically stable second-derivative general linear methods for the numerical integration of stiff ODEs. J. Comput. Appl. Math. 2016, 303, 218–228. [Google Scholar] [CrossRef]
- Chollom, J.P.; Kumleng, G.M.; Longwap, S. High order block implicit multi-step (HOBIM) methods for the solution of stiff ordinary differential equations. Int. J. Pure Appl. Math. 2014, 96, 483–505. [Google Scholar] [CrossRef][Green Version]
- Ponalagusamy, R.; Ponnammal, K. A parallel fourth order rosenbrock method: Construction, analysis and numerical comparison. Int. J. Appl. Comput. Math. 2015, 1, 45–68. [Google Scholar] [CrossRef][Green Version]
- Suleiman, M.B.; Musa, H.; Ismail, F.; Senu, N. A new variable step size block backward differentiation formula for solving stiff IVPs. Int. J. Comput. Math. 2013, 90, 2391–2408. [Google Scholar] [CrossRef]
- Zainuddin, N.; Ibrahim, Z.B.; Othman, K.I.; Suleiman, M.B. Direct fifth order block backward differentation formulas for solving second order ordinary differential equations. Chiang Mai J. Sci. 2016, 43, 1171–1181. [Google Scholar]
- Ibrahim, Z.B.; Mohd Nasir, N.A.A.; Othman, K.I.; Zainuddin, N. Adaptive order of block backward differentiation formulas for stiff ODEs. Numer. Algebr. Control Optim. 2017, 7, 95–106. [Google Scholar] [CrossRef]
- Asnor, A.I.; Yatim, S.A.M.; Ibrahim, Z.B. Algorithm of modified variable step block backward differentiation formulae for solving first order stiff ODEs. In Proceedings of the 25th National Symposium on Mathematical Sciences, Kuantan, Malaysia, 27–29 August 2017; AIP Publishing: Melville, NY, USA, 2018; pp. 1–11. [Google Scholar]
- Ibrahim, Z.B.; Noor, N.M.; Othman, K.I. Fixed coefficient a(α) stable block backward differentiation formulas for stiff ordinary differential equations. Symmetry 2019, 11, 846. [Google Scholar] [CrossRef]
© 2019 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).