Abstract
For the discretized linear systems of the spatial fractional diffusion equations, we construct a class of a modified DTS iteration method and give its asymptotic convergence conditions. Then, we design a fast modified DTS preconditioner by replacing Toeplitz matrix with the matrix to accelerate the convergence rates of GMRES method. Theoretically, we show that the spectrum of fast modified DTS preconditioned matrix is clustered around one. Numerical experiments verify the validity of the constructed fast modified DTS preconditioner for GMRES method.
MSC:
65Fxx; 65F08; 65F10
1. Introduction
We consider the following spatial fractional diffusion equations
where is a prescribed nonnegative function. and are the left and right Riemann–Liouville fractional derivatives [1,2], respectively, with the order being , that is,
where is the Gamma function. is a given source term.
Compared with the traditional integer order differential equations, the fractional diffusion equations can provide an adequate and accurate description for abnormal diffusion phenomenon, which is applied in many fields such as biology [3], physics [4,5,6], finance [7], etc. Since the closed-form analytical solutions of the spatial fractional diffusion Equation (1) are usually not available, numerical methods are proposed to get the numerical solutions.
A proper finite difference discretization of Equation (1) leads to a system of linear equations of the coefficient matrix at every temporal step, where is a non-negative diagonal matrix and is a Hermitian positive definite Toeplitz matrix, with being the number of grid point number. In order to solve this kind of linear system and reduce computation, the Krylov subspace method, such as GMRES, CG, etc., becomes a good choice [8]. Hence, it is important to find an appropriate preconditioner to accelerate the convergence speeds of the Krylov subspace methods. An approximate inverse circulant plus diagonal (AICD) preconditioner was constructed by Ng and Pan [9], but with certain requirements for the elements of matrices and . To overcome the shortcomings of the AICD preconditioners, Bai, Lu and Pan [10] propose the diagonal and Toeplitz splitting (DTS) iteration method and build the diagonal and circulant splitting (DCS) preconditioner by replace the Toeplitz matrix with a circulant matrix. For the ill-conditioned Toeplitz matrices, sine-transform-based preconditioners as matrix are superior to circulant preconditioners [11,12]. Based on the DTS iteration method, Xin, Fang and Sun [13] replace the Toeplitz matrix by matrix and obtained the sine-transform-based splitting preconditioner.
In this paper, based on the DTS iteration method, we designed a modified DTS (MDTS) iteration method, and analyzed its convergence. Then, we developed the matrix to replace the Toeplitz matrix as a fast MDTS (FMDTS) preconditioner, and discuss the aggregation of eigenvalues of the preconditioned matrix theoretically.
The outline of this paper is as follows. In Section 2, we obtain the linear system by discretize the spatial fractional diffusion Equation (1). In Section 3, we construct MDTS iteration method and analyze its convergence. In Section 4, FMDTS preconditioner is proposed and analyzed. In Section 5, numerical results are shown. In Section 6, we draw conclusions to end the paper.
2. The Discrete Linear System
We denote being the transpose of a matrix or vector in real space or the conjugate transpose of complex space. Without loss of generality, we make that and . Let the spatial grids with isometric step size and the temporal grids with the isometric step size .
Discretizing Equation (1) by using the shifted finite-difference formula of the Grünwald–Letnikov type [2,14]
where represents the floor of the corresponding real number which is the largest integer not larger than that real number, , is the fractional binomial coefficient, which is
By denoting , , , as discretized in [10], we can get the linear system as the following form:
where , , is a nonnegative diagonal matrix,
is a Toeplitz matrix, where
is the Toeplitz matrix of lower Hessenberg form.
3. The MDTS Iteration Methods
For convenience, we abbreviate (2) as
We split the coefficient matrix as follows:
On this basis, we construct the modified DTS (MDTS) iteration method, which is described as follows.
The MDTS iteration method. Given an initial guess , for until the iteration sequence converges, compute the next iterate according to the following procedure:
where is a prescribed positive constant.
The MDTS iteration (5) can be written in the following standard form:
where
and
The iteration matrix of the MDTS iteration method is
The MDTS iteration method is convergent if and only if the spectral radius of its iteration matrix defined by (8) is less than 1.
Let denote the Euclidean norm of the vector or the matrix, and denote the eigenvalue and the spectral radius of the matrix, respectively.
Theorem 1.
Let and be the minimal and maximal elements of , respectively. and represent the minimal and maximal eigenvalues of the Toeplitz matrix , respectively. For any initial vector , the MDTS iteration method (5) sequence converges to the unique solution of the linear system (4) when the parameter meets one of the following two conditions:
(a) If , then can be any positive number;
(b) If , then .
Proof.
The iteration matrix in (8) is similar to
then, it is clearly
By straightforward computations, we have
and
It follows that when , to make
which clearly established.
When , to make
Through straightforward computations, it can be obtained that parameter should meet the following conditions
If , then the above formula obviously holds.
If , then .
The proof is completed. □
4. The MDTS Preconditioner
The MDTS iteration method naturally leads to a preconditioner. We use the matrix as the preconditioning matrix to accelerate the rate of convergence of Krylov subspace method. For convenience, we denote . is defined as (6). However, since the inverse of matrix is hard to calculate in the operation of inverse, Toeplitz matrix is replaced by matrix in order to reduce the amount of calculation and storage and speed up the rate of convergence, then, the FMDTS preconditioner is obtained as follows
where
where is the Hankel matrix [15] whose antidiagonals are constant and equal to
and the matrix can be diagonalized as follows
clearly, is symmetric and orthogonal matrix, are the eigenvalues of , which are determined by its first column and can be depicted as
is the first column of .
Lemma 1.
(see [13], Theorem 5) The matrix is defined in (10). Then, for any , there exists and such that for all ,
where , and .
Lemma 2.
(see [13], Lemma 8) The Toeplitz matrix and matrix are defined in (3) and (10), respectively. Denote
Then, for , we can get
and
Theorem 2.
Let , where is a non-negative diagonal matrix and is a Hermitian positive definite Toeplitz matrix. Suppose that the conditions in Theorem 1 hold, the matrices and are defined in Equations (6) and (9), respectively. Then, for any, there exists and such that for all ,
where rank , and .
Proof.
According to Lemma 1, for any , there exists and such that for all ,
where , and .
We consider the following form
We analyze firstly. Based on Equations (6) and (9), we have
Consequently,
where and .
Next we analyze the range of . The matrix as defined by (7), we know that the coefficient matrix can be written as , so we have
By using Lemma 2, there are
When the conditions in Theorem 1 hold, by some calculations, we get
It can be seen from Lemma 2 that
hence, for any , there exists and such that for all , it holds
and
Theorem 2 is proved. □
According to Theorem 2, the eigenvalues of the FMDTS preconditioned matrix gather near the eigenvalues of matrix . Further, according to Theorem 1, under the condition of MDTS iteration method convergence, the eigenvalues of the matrix are clustered on the complex disk with 1 as the center and as the radius.
5. Numerical Results
In this section, we give two numerical examples to verify the effectiveness of the FMDTS preconditioner. We denote “DCS-GMRES” as the GMRES method with DCS preconditioner [10], “-GMRES” as the GMRES method with sine-transform-based splitting preconditioner [13], and “FMDTS-GMRES” as GMRES method with FMDTS preconditioner. As comparisons, we use the three methods mentioned above to solve the discrete linear system (4), respectively.
In the table, is the number of grid points, and we take . The IT represents the average number of iteration steps over all time layers, CPU represents the sum of iteration time in seconds over all time layers. We set the fractional order as and , respectively. At each time layer, is the initial guess, the criterion for iteration termination is that the residual error satisfies the condition . The parameters in the experiment are the experimentally computed optimal values.
The numerical examples are run on MATLAB (version R2016a) on machine with 16.00 GB memory, windows 10 system and central processing unit with 2.50 GHz (Intel(R) Core (TM) i5-10300H CPU).
Example 1.
We consider Equation (1) with , and , in which ,
and the source term is
This kind of equations can be applied to the particle diffusion phenomenon in physics [4].
In Table 1, the IT and CPU of the DCS-GMRES, -GMRES and FMDTS-GMRES methods are presented. It can be seen that compared with the DCS-GMRES and -GMRES methods, both IT and CPU of the FMDTS-GMRES method are significantly reduced. When , with the increase of , the number of iteration steps of FMDTS-GMRES remains in a very stable state. When , with the increase of , the IT of DCS-GMRES decreases slowly, while the IT of FMDTS-GMRES is significantly reduced. The IT and CPU of FMDTS-GMRES are reduced to nearly half of that of DCS-GMRES and -GMRES, which also proves the effectiveness of new method.
Table 1.
Numerical results for solving Example 1.
Figure 1 plot the distribution of the eigenvalues of the matrix , DCS preconditioned matrix, preconditioned matrix and FMDTS preconditioned matrix of example 1 at and . In Figure 1, we can see that the spectral radius of the FMDTS preconditioned matrix has dropped significantly by nearly 20,000 times, eigenvalues of the matrix are clustered within 30,000, and the eigenvalues of the FMDTS preconditioned matrix are clustered within 1.5. The spectral radius of the FMDTS preconditioned matrix is more clustered than that of the DCS preconditioned matrix and preconditioned matrix, which exhibit good clustering characteristics around 1.
Figure 1.
The eigenvalues of the matrix (a), DCS preconditioned matrix (b), preconditioned matrix (c) and FMDTS preconditioned matrix (d) of Example 1.
Example 2.
Considering Equation (1) on , the coefficient function is , the initial condition is and the source term .
In Table 2, we give the results of the DCS-GMRES, -GMRES and FMDTS-GMRES methods. It can be seen that compared with the first two methods, the FMDTS-GMRES method has significantly improvement of the number of iteration steps and the time of iteration. When , the number of iteration steps and the time of iteration of FMDTS-GMRES are half of those of DCS-GMRES and -GMRES. When , with the increase of , the number of iteration steps of DCS-GMRES and -GMRES are kept at a stable value, while the iteration steps of FMDTS-GMRES gradually decrease. The results of the example prove that the FMDTS preconditioner is numerically more effective than the DCS preconditioner and preconditioner.
Table 2.
Numerical results for solving Example 2.
Figure 2 plot the distribution of the eigenvalues of the matrix , DCS preconditioned matrix, preconditioned matrix and FMDTS preconditioned matrix of Example 2 at order and . In Figure 2, we can see that the spectral radius of the FMDTS preconditioned matrix has dropped significantly by nearly 20 times, eigenvalues of the matrix are clustered within 30, and the eigenvalues of the FMDTS preconditioned matrix are clustered within 1.5. The spectral radius of the FMDTS preconditioned matrix is more clustered than that of the DCS preconditioned matrix and preconditioned matrix.

Figure 2.
The eigenvalues of the matrix (a), DCS preconditioned matrix (b), preconditioned matrix (c) and FMDTS preconditioned matrix (d) of Example 2.
6. Conclusions
We construct the MDTS iteration method to solve the discretized linear system of spatial fractional diffusion equations and analyze its convergence. Then, the Toeplitz matrix is replaced by the matrix, and the FMDTS preconditioner is proposed. We theoretically analyze the effect of preconditioned matrix, and the effectiveness of our method is verified by numerical experiments. Finding an effective method to calculate the optimal value of the parameters for the preconditioned GMRES method is worth our further study.
Author Contributions
Conceptualization, X.-H.S. and C.-B.K.; methodology, X.-H.S. and C.-B.K.; software, C.-B.K.; validation, X.-H.S.; formal analysis, X.-H.S. and C.-B.K.; investigation, X.-H.S. and C.-B.K.; resources, X.-H.S.; data curation, C.-B.K.; writing—original draft preparation, X.-H.S. and C.-B.K.; writing—review and editing, X.-H.S. and C.-B.K.; visualization, X.-H.S.; supervision, X.-H.S.; project administration, X.-H.S.; funding acquisition, X.-H.S. All authors have read and agreed to the published version of the manuscript.
Funding
Project supported by the Fundamental Research Funds for the Central Universities (N2224005-1).
Data Availability Statement
Not applicable.
Conflicts of Interest
The authors declare no conflict of interest.
References
- Samko, S.; Kilbas, A.; Marichev, O. Fractional Integrals and Derivatives: Theory and Applications; Gordon and Breach Science Publishers: Yverdon, Switzerland, 1993. [Google Scholar]
- Podlubny, I. Fractional Differential Equations (Mathematics in Science and Engineering); Academic Press: San Diego, CA, USA, 1999. [Google Scholar]
- Upadhyay, R.; Mondal, A. Dynamics of fractional order modified Morris-Lecar neural model. Netw. Biol. 2015, 5, 113–136. [Google Scholar]
- Benson, D.; Wheatcraft, S.; Meerschaert, M. The fractional-order governing equation of Levy motion. Water Resour. Res. 2000, 36, 1413–1423. [Google Scholar] [CrossRef]
- Kundu, S. Suspension concentration distribution in turbulent flows: An analytical study using fractional advection-diffusion equation. Phys. A 2018, 506, 135–155. [Google Scholar] [CrossRef]
- Wang, W.; Cherstvy, A.; Liu, X.; Metzler, R. Anomalous diffusion and nonergodicity for heterogeneous diffusion processes with fractional Gaussian noise. Phys. Rev. E 2020, 102, 012146. [Google Scholar] [CrossRef]
- Meerschaert, M.; Scalas, E. Coupled continuous time random walks in finance. Phys. A 2006, 390, 114–118. [Google Scholar] [CrossRef]
- Saad, Y. Iterative Methods for Sparse Linear Systems, 2nd ed.; Society for Industrial and Applied Mathematics (SIAM): Philadelphia, PA, USA, 2003. [Google Scholar]
- Ng, M.; Pan, J.-Y. Approximate inverse circulant-plus-diagonal preconditioners for Toeplitz-plus-diagonal matrices. SIAM J. Sci. Comput. 2010, 32, 1442–1464. [Google Scholar] [CrossRef]
- Bai, Z.-Z.; Lu, K.-Y.; Pan, J.-Y. Diagonal and Toeplitz splitting iteration methods for diagonal-plus-Toeplitz linear systems from spatial fractional diffusion equations. Numer. Linear Algebra Appl. 2017, 24, e2093. [Google Scholar] [CrossRef]
- Benedetto, F. Analysis of preconditioning techniques for ill-conditioned Toeplitz matrices. SIAM J. Sci. Comput. 1995, 16, 682–697. [Google Scholar] [CrossRef]
- Stefano, S. Toeplitz preconditioners constructed from linear approximation processes. SIAM J. Matrix Anal. Appl. 1998, 20, 446–465. [Google Scholar]
- Lu, X.; Fang, Z.-W.; Sun, H.-W. Splitting preconditioning based on sine transform for time- dependent Riesz space fractional diffusion equations. J. Appl. Math. Comput. 2021, 66, 673–700. [Google Scholar] [CrossRef]
- Meerschaert, M.; Tadjeran, C. Finite difference approximations for fractional advection- dispersion flow equations. J. Comput. Appl. Math. 2004, 172, 65–77. [Google Scholar] [CrossRef]
- Bini, D.; Benedetto, F. A New Preconditioner for the Parallel Solution of Positive Definite Toeplitz Systems; ACM: New York, NY, USA, 1990. [Google Scholar]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).