Next Article in Journal
Ab Initio Molecular Dynamics Study of Methanol-Water Mixtures under External Electric Fields
Next Article in Special Issue
Effects of Foam Microbubbles on Electrical Resistivity and Capillary Pressure of Partially Saturated Porous Media
Previous Article in Journal
Electrospinning Ag-TiO2 Nanorod-Loaded Air Treatment Filters and Their Applications in Air Purification
Previous Article in Special Issue
A Novel Approach to Improve Acid Diversion in Carbonate Rocks Using Thermochemical Fluids: Experimental and Numerical Study
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:

Analysis of the Stochastic Quarter-Five Spot Problem Using Polynomial Chaos

Engineering Mathematics and Physics Department, Engineering Faculty, Cairo University, Giza 12613, Egypt
Mathematics Department, Science Faculty, Tabuk University, Tabuk 71491, Saudi Arabia
Author to whom correspondence should be addressed.
Molecules 2020, 25(15), 3370;
Received: 26 May 2020 / Revised: 4 July 2020 / Accepted: 13 July 2020 / Published: 24 July 2020
(This article belongs to the Special Issue Fluids in Porous Media)


Analysis of fluids in porous media is of great importance in many applications. There are many mathematical models that can be used in the analysis. More realistic models should account for the stochastic variations of the model parameters due to the nature of the porous material and/or the properties of the fluid. In this paper, the standard porous media problem with random permeability is considered. Both the deterministic and stochastic problems are analyzed using the finite volume technique. The solution statistics of the stochastic problem are computed using both Polynomial Chaos Expansion (PCE) and the Karhunen-Loeve (KL) decomposition with an exponential correlation function. The results of both techniques are compared with the Monte Carlo sampling to verify the efficiency. Results have shown that PCE with first order polynomials provides higher accuracy for lower (less than 20%) permeability variance. For higher permeability variance, using higher-order PCE considerably improves the accuracy of the solution. The PCE is also combined with KL decomposition and faster convergence is achieved. The KL-PCE combination should carefully choose the number of KL decomposition terms based on the correlation length of the random permeability. The suggested techniques are successfully applied to the quarter-five spot problem.

1. Introduction

Fluid flow in porous media is a subject of great interest due to its wide range of applications such as water/oil flow in underground reservoirs, modeling the underground spreading of toxic, and biological applications such as the transport in lungs and arteries [1]. When dealing with porous media, such as geological formations, we do not have complete information about their properties, such as permeability and porosity. This leads to uncertainty about the values of the formation properties and, in turn, in calculating flow in such formations [2]. For evaluating such uncertainties, a probabilistic framework is to be used. The input data are considered as random quantities, which are described in terms of stochastic processes.
Uncertainty quantification (UQ) methods are used for analyzing the system using a model by the parameterization of the uncertain input data (such as permeability) using a set of independent random variables. Then, the model is solved to determine the response of the system to the given random input data [3].
Most of the numerical models used for uncertainty quantification are based on the Monte Carlo (MC) sampling method [4,5,6,7,8,9]. This method is known for the simplicity of its implementation; however, it requires a large number of iterations of the numerical model in order to provide reliable results and therefore may be not feasible for complex simulators. In order to overcome these limitations, other variants to the standard MC method were developed such as the multilevel Monte Carlo method (MLMC) [4], Sequential Monte Carlo (SMC) Methods [5], and quasi-Monte Carlo methods [6]. In addition to the MC method and its variations, other approaches including analytical models [7] and reduced-order models [8,9] were introduced. The Karhunen-Loève (KL) expansion is an order reduction method that can be used to provide a low-dimensional representation for a Gaussian random field by performing a projection of the original system with respect to a set of spatially dependent basis and a set of independent standard normal random coefficients, where the eigenvalues and eigenvectors of the autocorrelation function of the Gaussian field are utilized in the expansion [8,9,10].
Another method is the polynomial chaos expansion (PCE) [11], where the random variables are expanded using polynomial chaos basis, then a set of equations are solved using the Galerkin technique to determine the expansion coefficients [12]. For the classical polynomial chaos expansion, the polynomial chaos basis is the Hermite polynomials, and the random variables are Gaussian. Theoretically, convergence is achieved for any L 2 functionals in the random space [13]; however, only Gaussian and near-Gaussian random fields achieve optimal convergence rate. A more general approach, the generalized polynomial chaos (gPC), was proposed in [14], where the random variables are not restricted to Gaussian random variables and the expansion is in terms of polynomials chosen from the hypergeometric polynomials of the Askey scheme [15]. However, gPC can be used only when the input pdf is known in order to choose the proper basis functions, which is not the case in many applications [16]. To overcome this issue, the arbitrary polynomial chaos (aPC) technique was proposed [16,17], where in aPC, the polynomial chaos expansion is based on the moments of the random data instead of the PDF.
When dealing with Gaussian processes, the convergence of the KL expansion is optimal [18], however, the convergence rate may be much slower for other types of processes where optimal convergence is achieved based on the particular choice, made a priori, of the basis functions used in the expansion. Therefore, PCE and KL become less accurate for nonlinear dynamics and long-time integrations due to the fixed basis and the increasing complexity with the time. To overcome that issue, the dynamically-orthogonal (DO) [19] and the bi-orthogonal (BO) [20] techniques were introduced to allow for time-dependent basis, and therefore, more accurate for long time intervals. In both techniques, the stochastic coefficients and the spatial basis evolve according to the stochastic partial differential equation (SPDE) while preserving an orthonormality conditions for the basis functions.
The purpose of this paper is to solve one of the standard porous media problems, namely, the quarter-five spot problem after imposing uncertainty to the problem. The quarter five sport problem is used to model the case when a regular set of injection and production wells is present in the reservoir; as this problem already illustrates the features and difficulties of the general problem [21]. The problem is solved using both PCE and KL techniques and the results are compared with the MC method to verify the efficiency of each technique.
The remainder of this paper is organized as follows. First, in Section 2, the mathematical model is introduced, then the details of the problem are given in Section 3. Finally, in Section 4, results and conclusions are discussed.

2. Mathematical Statement of the Quarter-Five Spot Problem

2.1. The Deterministic Problem

Consider the problem of fluid flow in porous medium for a single-phase flow with an incompressible rock and fluid under isothermal conditions [22].
The problem is presented by the following partial differential equation (PDE):
. [ K μ ( p + ρ g z ) ] = q ρ   ,
where ρ denotes the density of the fluid, q denotes sources and sinks (out flow and in flow of fluid per unit volume), K denotes the permeability, z is the vertical coordinate, and μ is the fluid viscosity.
Let G = g z denote the downward force for gravity. Equation (1) can be expressed as
. ( ( K μ P x , K μ P y ) + ( ρ G x , ρ G y ) ) = q ρ   ,
As gravity forces are approximately constant inside a reservoir domain, we get
G x = G y = 0 ,
. ( K P x , K P y ) = q ρ   ,
where we assumed constant viscosity   μ .
If we assume water phase with ρ = 1 , we get Equation (1) in the form
K 2 P x 2 K 2 P y 2 K x P x K y P y = q ,
or in compact form,
.   v = q ,   v = ( K p ) ,
where v is the macroscopic Darcy velocity.
Equation (6) is a second order linear PDE. Additionally, Equation (6) is elliptic as the eigenvalues of its coefficient matrix are all negative.

2.2. The Stochastic Problem

Due to our incomplete knowledge about the medium properties, subsurface flow involves some degree of uncertainty, and therefore we need a stochastic description of the medium properties [23]. We can impose uncertainty to the quarter-five spot problem by considering the hydraulic conductivity (permeability) as a random field   K = K ( x ,   ω ) , where x   is the spatial coordinate and ω is the random outcome on a given probability space   Ω . This, in turn, makes the solution P a random field. In our model, the boundary conditions and the source term are kept deterministic.
Thus, Equation (6) becomes an SPDE stated as
·   ( K ( x ; ω ) p ( x ; ω ) ) = q ,
The PCE method can be used to represent a second order process f L 2 ( Ω ) , where L 2 ( Ω ) is the space of square integrable L 2   functions, such that a random field u ( x ; ω ) can be expressed as [24]
  u ( x ; ω ) = u 0 ( x ) + i 1 = 1 u i 1 ( x ) φ 1 ( ξ i 1 ( ω ) )  
+ i 1 = 1 i 2 = 1 i 1 u i 1 i 2 ( x ) φ 2 ( ξ i 1 ( ω ) , ξ i 2 ( ω ) )
+ i 1 = 1 i 2 = 1 i 1 i 3 = 1 i 2 u i 1 i 2 ( x ) φ 2 ( ξ i 1 ( ω ) , ξ i 2 ( ω ) , ξ i 3 ( ω ) ) + ,
To simplify writing the equations, we can eliminate the arguments when there is no ambiguity. φ n ( ξ i 1 , ξ i 2 , , ξ i n ) denotes the orthogonal polynomial of degree n with respect to the multidimensional random variables ξ = ( ξ i 1 ,   , ξ i n , ) .
If ξ i 1 , ξ i 2 , , ξ i n are independent standard Gaussian random variables, then φ n ( ξ i 1 , ξ i 2 , , ξ i n ) represent the multidimensional Hermite Polynomials of degree n expressed as
φ n ( ξ i 1 , , ξ i n ) = ( 1 ) n e 1 2 ξ T ξ n ξ i 1 ξ i n [ e 1 2 ξ T ξ ]
For Gaussian random variables, Hermite polynomials are the most suitable orthogonal basis [11]. For other distributions, the basis polynomials are selected to optimize the convergence rate. This generalization is commonly known as gPC [25].
For computational purposes, if we have a random vector ξ of dimension   N , then Equation (8) can be written in terms of a finite number of Hermite polynomials as
u ( x ; ω ) = i = 0 P u i ( x ) ψ i ( ξ ) ,
where the total number of expansion terms   P + 1 is determined by the random vector dimension N and the order d of the PCE [23].
P + 1 = ( N + d ) ! N ! d ! ,
The functions ψ i   construct orthogonal basis in L 2 ( Ω ) with the orthogonality relation [24]
ψ i , ψ j = ψ i 2 δ i j ,
where δ i j is the Kronecker delta and . , . is the ensemble average, that is, the inner product in the Hilbert space of the variables ξ defined by
f ( ξ ) , g ( ξ ) = Ω f ( ξ ) g ( ξ ) W ( ξ ) d ξ ,
where W ( ξ ) is the weighting function corresponding to the polynomial chaos basis ψ i .
In case that the polynomial chaos basis are the Hermite polynomials, W ( ξ ) is given by
W ( ξ ) = 1 ( 2 π ) N e 1 2 ξ T ξ ,
where N is the number of independent Gaussian random variables.
The mean square error of the truncated PCE expansion,   u ( x ; ω ) , is expressed as
  e ( x ) = E [ u ( x ; ω ) u e ( x ; ω ) ] 2 ,
where u e ( x ,   ω ) is the exact solution and E is the expectation operator.
For the case of univariate Gaussian stochastic germ, the following theorem provides an error bound.
Theorem 1 [25]. Given u e ( x ,   ω ) L 2 , being k times continuously differentiable, the convergence rate
u e ( x ,   ω ) i = 0 P u i ( x ) W i ( ξ )   1 i = 0 k 1 ( n i + 1 ) u ( k ) ,
is obtained for an approximation of u e ( x ,   ω ) by a finite number of Hermite polynomials { W i } i = 0 P , where the norm . is induced by the inner product (14).
The KL expansion can be viewed as a special case of the PCE where only first-order polynomials have non-zero coefficients [26]. The KL expansion involves the spectral expansion of the correlation function of the process under consideration and is used to reduce the dimensionality of the random space [24]. Consider a second-order process Z ( x ; ω ) with a correlation function   C ( x , y ) . The correlation function should be real, symmetric, and positive definite [14].
We can represent Z ( x ; ω ) as
Z ( x ; ω ) = E [ Z ( x , . ) ] + i = 1 λ i ϕ i ( x )   ξ i ( ω ) ,
where Z ( x , . ) : Ω R is a random variable, E [ Z ( x , . ) ] is mean of the process, ξ i ( ω ) a set of uncorrelated random variables, λ i and ϕ i ( x ) are the eigenvalues and eigenfunctions of the correlation function, respectively, i.e.,
Ω C ( x , y ) ϕ i ( y ) d y = λ i ϕ i ( x ) ,
The KL expansion is effective when the correlation function is known, as it is characterized by an optimal convergence in the mean square sense [25]. However, the correlation function might not be known in some cases, which is a limitation of the KL expansion method.

3. Solution Implementation

3.1. The Deterministic Problem

Recall Equation (6):
. v = q ,   v = ( K p ) ,
To have a complete solution, we need to specify the boundary conditions. Closed flow systems where there is no fluid flow across the external boundaries are modeled by specifying homogeneous Neumann boundary conditions:
v . n = 0 ,   f o r   x Ω ,
where n is the normal at the boundary Ω of the computational domain and x is any spatial point that exists on the domain’s boundary   Ω .
There are several numerical methods used to solve (4), three of these methods were discussed in [22]. The first method is a cell-centered finite-volume method called the two-point flux-approximation (TPFA) scheme that is widely used in the oil industry. The TPFA scheme uses two cells pressure averages to approximate the flux v i , k across each face of the cell. In some cases, the orientation of the computational grid will affects the results of the TPFA scheme; thus, another finite-volume method called the multi-point flux-approximation (MPFA) scheme is used to overcome the inconsistencies of the TPFA scheme. Instead of using only two points such as the TPFA, the MPFA scheme utilizes each of the neighboring cell averages to approximate the flux. Another alternative to the MPFA scheme is the mixed finite-element method where the fluxes over cell edges are considered as unknowns in addition to the pressure values. However, due to the simplicity and computational speed of the TPFA, we will restrict our attention to this method. First, we write Equation (17) in the integral form inside a cell Ω i as the control volume.
Ω i   v . n ds = Ω i   q dV ,
To compute the flux v i , k across each face of the cell we use Darcy’s law,
v i , k = Γ i , k   v . n ds , Γ i , k = Ω i Ω Ω k ,
where Γ i , k Is the interface between the two cells’ boundaries Ω i   and   Ω k with an area   A i , k and a normal vector   n i , k , Γ i , k is the opposite interface and has identical area   A i , k = A k , i but opposite normal vector   n i , k = n k , i .
The integral can be approximated as
v i , k A i , k ( K i p i , k ) . n i , k ,
where p i , k   is the pressure gradient at the centroid of the interface   Γ i , k . Finite difference is used to approximate p i , k using the pressure p i , k ˜ at the interface’s centroid and the average pressure p i   inside the cell   Ω i ,
v i , k A i , k K i ( p i p i , k ˜ ) x i , k x i , k 2 . n i , k = T i , k ( p i p i , k ˜ ) ,
where x i , k   is the position vector between the center of the cell   Ω i and the centroid of the interface   Γ i , k , and T i , k is the one-sided transmissibility associated with the cell   Ω i . Therefore, we have for cell   Ω i the relation
T i , k 1 v i , k = ( p i p i , k ˜ ) ,
Similarly, we have for cell   Ω k the relation
T k , i 1 v k , i = ( p k p k , i ˜ ) ,
By imposing the continuity of fluxes, we have v i , k = v k , i = v i k and   p i , k ˜ = p k , i ˜ = p i k ˜ , and after eliminating   p i k ˜ we get
  v i k = [ T i , k 1 + T k , i 1 ] 1 ( p i   p k ) = T i k ( p i   p k ) ,
where T i k is the transmissibility associated with the connection between the two cells Ω i   and   Ω k . Therefore, TPFA uses the cell averages p i and p k , to approximate the flux across the interface Γ i , k between the cells   Ω i   and   Ω k .
Finally, when substituting v i k in Equation (19) we get the following system of equations,
k T i k ( p i   p k ) = q i ,
T i k = 2 Δ y [ Δ x i K i + Δ x k K k ] 1 ,
Therefore we get the following system of equations,
A u = f ,
where A is a sparse, penta-diagonal symmetric matrix. Moreover, when dealing with a homogenous permeability field, A is a Toeplitz matrix. The system is made positive definite, which can be effectively solved using the Cholesky decomposition algorithm [27].

Numerical Example

Equation (4) is solved on a   32 × 32   uniform Cartesian grid covering a 500 × 500   m 2 area with a homogeneous isotropic permeability K = 100   m d with porosity of 0.2   for all points in the grid. There is an injection well at the origin with a flow rate of 1 m 3 / d a y and 4 production wells with flow rate of −1 m 3 / d a y at the points   ( ± 1 ,   ± 1 ) . We use the homogeneous Neumann boundary conditions. The flow in the five-spot is symmetric about both the coordinate axes. Therefore, the domain can be reduced to a quarter of its size. This problem is called the quarter-five spot problem. Figure 1 shows the pressure distribution on the grid while illustrating the position of the injection and production wells on the bottom left and top right corners of the grid, respectively. The area of largest pressure’s value is the immediate zone surrounding the injection well (shown in red), then the pressure decreases gradually till it reaches its lowest value at the production well. In order to obtain a better view of the flow field, Pollock’s method [28] for semi-analytical tracing of streamlines is used to track the path of flow of the particles as they move from cell to cell through the cells’ centers. Additionally, traces are used, which are particles that flow with the fluid without changing the characteristics of the fluid.
The concentration of a tracer is given by a continuity equation
( ϕ C ) t + . ( v C ) = q C ,
where C is the concentration, q C is the inflow rate per unit volume for the tracer, and ϕ is the rock porosity. In the case of steady state flow, with tracers whose concentration do not change with fluid compression or expansion and with concentration equal to one at the inflow boundary, we get the simplified equation
. ( v C ) = q C C i n f l o w = 1 ,
We define the time-of-flight   τ as the time required by a fluid particle to travel a given distance along a streamline. τ is given by the differential equation
v . τ = ϕ .
Applying the time flight to a tracer, the communication patterns of the reservoir can be studied effectively. Therefore, in order to estimate the speed of flow inside the reservoir, we solve equation (6) subject to τ = 0 at the inflow to get the forward time-of-flight from inflow point and into the reservoir, and backward time-of-flight from outflow points and backwards into the reservoir. The sum of forward and backward times gives the total time required by a particle to enter the reservoir from inflow and travel through until it exits through the outflow. Figure 2 shows total travel time to illustrate the areas of high speed flow and those of stagnant flow.

3.2. The Stochastic Quarter-Five Spot Problem

We now proceed to solve Equation (7) while considering the uncertainty of the permeability field K ( x ; ω ) . The problem is first solved using only PCE, and then we will use KL expansion to reduce the dimension of the input space then apply PCE. For both scenarios, the pressure solution statistics are presented and the results are compared with the MC solution with a sample size of 10,000.
  • First: Using PCE
Let permeability tensor K be a random field with a Gaussian distribution of mean 100   m d and variance   0.5   m d . Consequently, the pressure vector p and velocity vector v become stochastic processes. In order to apply PCE, we express K as a series of orthogonal basis functions ψ i (Hermite polynomials) and expansion coefficients k i
K ( x ; ω ) = i = 0 P k i ( x ) ψ i ( ξ )   ,
p ( x ; ω ) = i = 0 P p i ( x ) ψ i ( ξ )   ,
q ( x ; ω ) = i = 0 P q i ( x ) ψ i ( ξ )   ,
substituting into Equation (7) and eliminating the arguments for brevity, we get
. [ i = 0 P k i ψ i ( j = 0 P p j ψ j   ) ] = i = 0 P q I ψ I ,
Which can be simplified to become
i = 0 P j = 0 P [ k i 2 p j + k i . p j ] ψ i ψ j = i = 0 P q i ψ j .
Applying inner product . , . with each polynomial ψ k ,   k = 0 , , P , and utilizing the orthogonality relation to get a set of P + 1   deterministic equations of the form
i = 0 P j = 0 P [ k i 2 p j + k i . p j ] e i j k = q K ψ k 2 ,
where e i j k = ψ i ψ j ψ k , which can be computed and stored priori [29]. We can apply the TPFA numerical scheme for this set of deterministic equations and obtain the pressure components p i ( x ) .
  • Second: Using KL expansion
As the realizations of a Gaussian distribution may take negative values, it is more practical to assume a log normal distribution for   K . For that purpose, first we define a Gaussian process Z ( x ; ω )   with the KL expansion,
Z ( x ; ω ) = E [ Z ( x , . ) ] + i = 1 M λ i ϕ i   ξ i ,
where E [ Z ( x , . ) ] is the mean, and λ i and ϕ i ( x ) are the eigenvalues and eigenfunctions of the exponential correlation function C ( x , y ) , respectively. The correlation C ( x , y ) is of the form [30,31]
C ( x , y ) = σ 2 z exp ( x y l ) , x , y   ϵ D ,
where l denotes the spatial correlation length and σ 2 z   is the process variance.
The permeability   K and   Z are related such that K is the exponential of Z and the PCE of K would be
K ( x ; ω ) = e Z ( x ; ω ) = i = 0 P k i ( x ) ψ i ( ξ )  
To obtain the coefficients k i ( x ) , we use the formula
k i ( x ) = ψ i ( η ) ψ i 2 exp [ E [ Z ( x , . ) ] + σ 2 z 2 ] ,   η j = ξ j z j   ,
with   ψ i ( η ) given in Table 1.
After computing the coefficients k i ( x ) , we apply PCE to we get the following set of deterministic equations to be solved to get the pressure components using the TPFA scheme,
i = 0 P j = 0 P [ k i 2 p j + k i . p j ] e i j k   = q K ψ k 2 ,
where e i j k = ψ i ψ j ψ k .

4. Results

4.1. Case of PCE Only

We compare the differences in solutions obtained using MC and PCE methods. Figure 3 represents the normalized pressure mean solution produced by MC method (left) and the absolute error between the MC mean solution and the PCE mean solution (right). There was no considerable error between the two solutions (less than 0.02%) when assuming PCE with order d = 2 , which proves the efficiency of the method for linear problems even when taking a low order expansion.
Figure 4 shows variances in pressure solutions of MC and PCE methods when eliminating one of the PCE coefficients of the input random field K . It has been observed that the elimination has an insignificant impact on the accuracy of the solution. However, using more PCE coefficients tends to minimize the error between MC and PCE solutions. These results illustrate the fast convergence of the PCE solution for PDE (8), as assuming a higher-order PCE had a negligible effect on the accuracy of the solution.
Table 2 illustrates the percentage of the difference between MC and PCE solutions when eliminating the first PCE coefficient, i.e., k 1 = 0 , then the second PCE coefficient k 2 = 0 , then without elimination. The minimum percentage of error results when using all PCE coefficients, while using only the second PCE coefficient. k 1 = 0   resulted in more accurate results than when k 2 = 0 .

4.2. Case of KL with PCE

In the second case, we apply the KL expansion to the input, in order to reduce the dimension of the input space and then use PCE. The permeability field K is of log-normal distribution in this case. The MC method used for validation is modified by utilizing the KL expansion on a Gaussian field Z and constructing K by taking the exponential of Z in every iteration.
First, we compare the convergence of the eigenvalues of the correlation function C ( x , y ) for different spatial correlation lengths. Figure 5 shows that as the correlation length decreases, the convergence would require more expansion terms. This can be further illustrated in Table 3, where the minimum number of KL terms required for convergence is provided for four different correlation lengths. We compared the solutions resulting from using PCE only and those resulting from using KL then PCE (KL-PCE) using different correlation lengths, where the results are compared against the MC solution. It has been noticed that there are no considerable differences in the mean solutions for all methods. However, the variance solution differs considerably based on the used method and the parameters σ 2 and l of the correlation function   C ( x , y ) .
The problem is solved using PCE of order d = 1 , and PCE of order d = 2 after applying KL. The results show that PCE of order d = 1 provides accurate results for low variance σ 2 values (less than 0.5). Even for highly heterogeneous mediums where we can set
[32], PCE with first-order polynomials provides acceptable accuracy (less than 1% error when compared to MC) with no much need for higher-order PCE. However, for σ 2 > 1 , using higher-order PCE is recommended for more accurate results. Therefore, we can apply KL in our problem before applying PCE as this leads to a faster convergence. It should be noted that when using KL the correlation length must be taken into consideration, as using higher correlation length would significantly reduce the accuracy of the solution if the minimum number of KL terms required for the eigenvalues convergence is not used. This can be observed in Table 4, where we compare the mean square error (MSE) percentages between MC and KL/PCE variance solutions.

5. Conclusions

In this paper, we studied the quarter-five spot problem. We solved both the deterministic problem and the stochastic problem after imposing uncertainty to the problem. We considered two cases for the stochastic problem: The first case is solved using both MC and PCE methods and the results are compared. It was shown that for the given problem, assuming a PCE with order d = 2 produces an error in the mean solution less than 0.02%, while reducing the computational time to at least 30% of the time needed by the MC method. In the second case, we compared the effect of applying the KL expansion with different correlation function parameters before applying the PCE. It has been shown that for systems with low heterogeneity (low values of process variance σ 2 ), PCE with first-order polynomials provides accurate results (less than 1% error). Even for a highly heterogeneous medium with σ 2 = 1 , PCE with first-order polynomials provides acceptable accuracy in most cases. However, if the value of σ 2 increases, higher-order PCE may be required, and the KL expansion can be applied for better convergence of the PCE. When using the KL expansion, the correlation length of the correlation function should be taken into consideration before choosing the number of KL expansion terms. It was observed that a correlation function with a higher correlation length may require using the full number of KL expansion terms needed for the convergence of the eigenvalues of the correlation function. This study can be extended to predict the expected behavior of the general case when there is a system of a reservoir with injection/production wells with uncertain parameters and/or boundary conditions.

Author Contributions

H.A. was responsible for the computations, documentation and literature review. A.A.-J. was responsible for administration, supervising and reviewing the manuscript. M.E.-B. was responsible for the scientific content, novelty and analysis of the results. All authors have read and agreed to the published version of the manuscript.


This research received no external funding.

Conflicts of Interest

The authors declare no conflict of interest.


  1. Shenoy, A.V. Non-Newtonian Fluid Heat Transfer in Porous Media. In Advances in Heat Transfer; Hartnett, J.P., Irvine, T.F., Cho, Y.I., Eds.; Elsevier: Amsterdam, The Netherlands, 1994; Volume 24, pp. 101–190. [Google Scholar]
  2. El-Beltagy, M.A. A practical comparison between the spectral techniques in solving the SDEs. Eng. Comput. 2019, 36, 2369–2402. [Google Scholar]
  3. Le Maître, O.; Knio, O. Spectral Methods for Uncertainty Quantification: With Applications to Computational Fluid Dynamics; Springer Science & Business Media: Berlin/Heidelberg, Germany, 2010. [Google Scholar]
  4. Giles, M.B. Multilevel Monte Carlo Path Simulation. Op. Res. 2008, 56, 607–617. [Google Scholar] [CrossRef]
  5. Doucet, A.; de Freitas, N.; Gordon, N. An Introduction to Sequential Monte Carlo Methods. In Sequential Monte Carlo Methods in Practice; Doucet, A., de Freitas, N., Gordon, N., Eds.; Springer: New York, NY, USA, 2001; pp. 3–14. [Google Scholar]
  6. Caflisch, R.E. Monte Carlo and quasi-Monte Carlo methods. Acta Numer. 1998, 7, 1–49. [Google Scholar] [CrossRef][Green Version]
  7. Gelhar, L.W. Stochastic subsurface hydrology from theory to applications. Water Resour. Res. 1986, 22, 135S–145S. [Google Scholar] [CrossRef]
  8. Ketabchi, H.; Ataie-Ashtiani, B. Review: Coastal groundwater optimization—advances, challenges, and practical solutions. Hydrogeol. J. 2015, 23, 1129–1154. [Google Scholar] [CrossRef]
  9. Razavi, S.; Tolson, B.A.; Burn, D.H. Review of surrogate modeling in water resources. Water Resour. Res. 2012, 48, W07401. [Google Scholar] [CrossRef]
  10. Frangos, M.; Marzouk, Y.; Willcox, K.; van Bloemen Waanders, B. Surrogate and Reduced-Order Modeling: A Comparison of Approaches for Large-Scale Statistical Inverse Problems. In Computational Methods for Large-Scale Inverse Problems and Quantification of Uncertainty; John Wiley & Sons: Hoboken, NJ, USA, 2010; pp. 123–149. [Google Scholar]
  11. Ghanem, R. Ingredients for a general purpose stochastic finite elements implementation. Comput. Methods Appl. Mech. Eng. 1999, 168, 19–34. [Google Scholar] [CrossRef]
  12. Xiu, D.; Em Karniadakis, G. Modeling uncertainty in steady state diffusion problems via generalized polynomial chaos. Comput. Methods Appl. Mech. Eng. 2002, 191, 4927–4948. [Google Scholar] [CrossRef]
  13. Cameron, R.H.; Martin, W.T. The Orthogonal Development of Non-Linear Functionals in Series of Fourier-Hermite Functionals. Ann. Math. 1947, 48, 385–392. [Google Scholar] [CrossRef]
  14. Xiu, D.; Karniadakis, G.E. The Wiener-Askey Polynomial Chaos for Stochastic Differential Equations. SIAM J. Sci. Comput. 2002, 24, 619–644. [Google Scholar] [CrossRef]
  15. Askey, R.; Wilson, J. Some basic hypergeometric orthogonal polynomials that generalize Jacobi polynomials. Mem. Am. Math. Soc. 1985, 54, 1–63. [Google Scholar] [CrossRef]
  16. Paulson, J.; Buehler, E.; Mesbah, A. Arbitrary Polynomial Chaos for Uncertainty Propagation of Correlated Random Variables in Dynamic Systems. IFAC PapersOnLine 2017, 50, 3548–3553. [Google Scholar] [CrossRef]
  17. Oladyshkin, S.; Nowak, W. Data-driven uncertainty quantification using the arbitrary polynomial chaos expansion. Reliab. Eng. Syst. Saf. 2012, 106, 179–190. [Google Scholar] [CrossRef]
  18. Loève, M. Probability Theory I; Springer: Berlin/Heidelberg, Germany, 1987. [Google Scholar]
  19. Sapsis, T.P.; Lermusiaux, P.F.J. Dynamically orthogonal field equations for continuous stochastic dynamical systems. Phys. D Nonlinear Phenom. 2009, 238, 2347–2360. [Google Scholar] [CrossRef]
  20. Cheng, M.; Hou, T.Y.; Zhang, Z. A dynamically bi-orthogonal method for time-dependent stochastic partial differential equations I: Derivation and algorithms. J. Comput. Phys. 2013, 242, 843–868. [Google Scholar] [CrossRef][Green Version]
  21. Chavent, G.; Jaffre, J. Mathematical Models and Finite Elements in Reservoir Simulation; Elsevier: Amsterdam, The Netherlands, 1986. [Google Scholar]
  22. Hasle, G.; Lie, K.; Quak, E. Geometric Modelling, Numerical Simulation, and Optimization: Applied Mathematics at SINTEF; Springer: Heidelberg, Germany, 2007. [Google Scholar]
  23. Zhang, D. Stochastic Methods for Flow in Porous Media: Coping with Uncertainties; Academic Press: San Diego, CA, USA, 2001. [Google Scholar]
  24. El-Beltagy, M.A.; Wafa, M.I. Stochastic 2D incompressible Navier-Stokes solver using the vorticity-stream function formulation. J. Appl. Math. 2013, 2013, 14. [Google Scholar] [CrossRef][Green Version]
  25. Augustin, F.; Gilg, A.; Paffrath, M.; Rentrop, P.; Wever, U. Polynomial chaos for the approximation of uncertainties: Chances and limits. Eur. J. Appl. Math. 2008, 19, 149–190. [Google Scholar] [CrossRef]
  26. Gentle, J.E. Numerical Linear Algebra for Applications in Statistics; Springer: Berlin/Heidelberg, Germany, 1998. [Google Scholar]
  27. Lie, K.-A. An Introduction to Reservoir Simulation Using MATLAB; Cambridge University Press: Cambridge, UK, 2015. [Google Scholar]
  28. Pollock, D.W. Semianalytical Computation of Path Lines for Finite-Difference Models. Groundwater 1988, 26, 743–750. [Google Scholar] [CrossRef]
  29. Noor, A.; Barnawi, A.; Nour, R.; Assiri, A.; El-Beltagy, M. Analysis of the Stochastic Population Model with Random Parameters. Entropy 2020, 22, 562. [Google Scholar] [CrossRef]
  30. Paleologos, E.K.; Avanidou, T.; Mylopoulos, N. Stochastic analysis and prioritization of the influence of parameter uncertainty on the predicted pressure profile in heterogeneous, unsaturated soils. J. Hazard. Mater. 2006, 136, 137–143. [Google Scholar] [CrossRef]
  31. Kourakos, G.; Harter, T. Parallel simulation of groundwater non-point source pollution using algebraic multigrid preconditioners. Comput. Geosci. 2014, 18, 851–867. [Google Scholar] [CrossRef]
  32. Crevillén-García, D.; Leung, P.K.; Rodchanarowan, A.; Shah, A.A. Uncertainty Quantification for Flow and Transport in Highly Heterogeneous Porous Media Based on Simultaneous Stochastic Model Dimensionality Reduction. Transp. Porous Media 2019, 126, 79–95. [Google Scholar] [CrossRef] [PubMed][Green Version]
Figure 1. Solution of the quarter-five spot problem on a 32 × 32   uniform grid. The plot shows the pressure distribution on each point in the grid, where the highest pressure values are in the bottom left corner and the pressure decreases gradually until it reaches the lowest value at the top right corner.
Figure 1. Solution of the quarter-five spot problem on a 32 × 32   uniform grid. The plot shows the pressure distribution on each point in the grid, where the highest pressure values are in the bottom left corner and the pressure decreases gradually until it reaches the lowest value at the top right corner.
Molecules 25 03370 g001
Figure 2. Total travel time to illustrate the areas of high speed flow and those of stagnant flow.
Figure 2. Total travel time to illustrate the areas of high speed flow and those of stagnant flow.
Molecules 25 03370 g002
Figure 3. (a) The pressure mean solution using MC method. (b) The percentage of difference of solutions between MC and PCE methods.
Figure 3. (a) The pressure mean solution using MC method. (b) The percentage of difference of solutions between MC and PCE methods.
Molecules 25 03370 g003
Figure 4. Comparing the pressure standard deviation resulting from MC and PCE methods.
Figure 4. Comparing the pressure standard deviation resulting from MC and PCE methods.
Molecules 25 03370 g004
Figure 5. Comparing Eigenvalues convergence rate for l = 0.1   and l = 0.3 .
Figure 5. Comparing Eigenvalues convergence rate for l = 0.1   and l = 0.3 .
Molecules 25 03370 g005
Table 1.   ψ i ( η ) used to evaluate the PC coefficients k i ( x ) [11].
Table 1.   ψ i ( η ) used to evaluate the PC coefficients k i ( x ) [11].
ψ i ( ξ ) ψ i ( η ) ψ i ( η )
ξ i η i + z i z i
ξ i ξ j δ i j ( η i + z i ) ( η j + z j ) _ δ i j z i z j
ξ i ξ j ξ k ξ i δ j k ξ j δ i k ξ k δ i j ( η i + z i ) ( η j + z j ) ( η j + z j ) _ z i δ j k z j δ i k z k δ i j z i z j z k
Table 2. PCE vs. MC solution statistics.
Table 2. PCE vs. MC solution statistics.
k 1 = 0 k 2 = 0 k 1 & k 2   n o n   z e r o
Mean difference percentage0.00350.00390.0031
Variance difference percentage2.562.612.52
Table 3. PCE vs. MC solution statistics.
Table 3. PCE vs. MC solution statistics.
Correlation   Length   l l = 0.1 l = 0.3 l = 0.5 l = 1
Number of terms for convergence > 12 1285
Table 4. PCE vs MC variances MSE.
Table 4. PCE vs MC variances MSE.
Method MSE %   at   σ = 0.1 MSE %   at   σ = 0.5 MSE %   at   σ = 1
PCE 0.02 0.41
KL-PCE l = 0.1
KL-PCE l = 0.3
KL-PCE l = 0.5 0.10.84

Share and Cite

MDPI and ACS Style

AbdelFattah, H.; Al-Johani, A.; El-Beltagy, M. Analysis of the Stochastic Quarter-Five Spot Problem Using Polynomial Chaos. Molecules 2020, 25, 3370.

AMA Style

AbdelFattah H, Al-Johani A, El-Beltagy M. Analysis of the Stochastic Quarter-Five Spot Problem Using Polynomial Chaos. Molecules. 2020; 25(15):3370.

Chicago/Turabian Style

AbdelFattah, Hesham, Amnah Al-Johani, and Mohamed El-Beltagy. 2020. "Analysis of the Stochastic Quarter-Five Spot Problem Using Polynomial Chaos" Molecules 25, no. 15: 3370.

Article Metrics

Back to TopTop