1. Introduction
For hyperbolic differential equations, problems with Cauchy data on non-spatial surfaces began to be studied by F. John (1960, 1961 [
1,
2]).
In the study of many practical problems, the Cauchy problem for hyperbolic equations occurs, and the Cauchy problem for the acoustic wave equation has been investigated in many works by Douglas (1960, [
3]) and Cannon (1964, 1965 [
4,
5]).
According to Hadamard [
6,
7], the solution to the Cauchy problem for an acoustic wave equation is ill-posed, and it exists when we impose smoothness conditions or strong compatibility on the initial data. Hadamard showed that a global solution cannot exist unless a certain compatibility relation is established among the Cauchy data. Further, he showed that even if the data are such, a classical solution exists, and it does not continuously depend on the data. According to Hadamard, these problems are well known to be ill-posed, and from various aspects, many investigations have been attempted, such as regularization, existence–uniqueness theorems, and least squares methods by Payne (1975, [
8]), for such problems have been discussed. The problem and its applications were then investigated in [
9,
10,
11,
12,
13,
14,
15,
16,
17].
Inverse and ill-posed problems for three-dimensional acoustic waves in the time domain have been studied theoretically with a number of methods of different hyperbolic equations [
16,
18,
19,
20]: hyperbolic systems [
21], the Green function approach, and wave splitting [
22,
23].
The method of scales and the Banach spaces of analytic functions were developed in some of the variables to study the Cauchy problem, and used to solve the inverse problem of determining the potential in the hyperbolic equation by V. Romanov (1996, [
24,
25]).
Helsing et al. (2011, [
26]) rewrote the Cauchy problem as an operator equation using the Dirichlet-to-Neumann map on the boundary.
The singular values of the operator of continuation problems were investigated, and a comparative analysis of numerical methods was presented [
27,
28,
29,
30].
To model wave propagation in medicine, geophysics, and engineering, among others [
31], the acoustic wave equation has been widely used with a non-zero point source function. Imaging these waves in the field of medicine was shown to provide very objective information about the biological tissue being examined. Acoustic wave equations arise widely in various applications such as seabed exploration and underground imaging.
Causon et al. (2010, [
32]) provided an introduction to the finite difference method (FDM) to solve partial differential equations (PDEs) and the theory of Jacobi, Gauss–Seidel, and successive over-relaxation (SOR) iterative solution methods.
Due to simple implementation and high accuracy, finite difference methods have attracted great interest from many researchers from various areas of science and engineering over the past several decades. Alford et al. (1974, [
33]), Tam et al. (1993, [
34]), and Yang et al. (2012, [
35]) introduced many FDMs that have been developed to solve the acoustic wave equations.
The FDM is a powerful tool for acoustic or seismic wave simulations due to its high accuracy, low memory, and fast computing speed, especially for models with complex geological structures studied by Liao et al. (2011, [
36]), Finkelstein et al. (2017, [
37]), and Zapata et al. (2018, [
38]).
Alexandre et al. (2014, [
39]) studied an explicit finite difference method to solve the acoustic wave equation using locally adjustable time steps; by considering stability, the time step size is initially determined by the medium with higher wave speed propagation, resulting in the fact that, in the whole domain, the higher the speed, the lower the time step needs to be to ensure stability.
Liu et al. (2009, 2010, [
40,
41,
42]) and Liang et al. (2013, [
43]) investigated the numerical solution of acoustics with a vertical axis of symmetry (VTI) modeling and a new time–space domain dispersion relation-based finite difference scheme of the acoustic wave equation and an implicit staggered grid finite difference method for seismic modeling, which plays an important role in seismic wave propagation, seismic imaging, and full waveform inversion.
Liao et al. (2018, [
44]) proposed a compact high-order FDM using a novel algebraic manipulation of finite difference operators for 2D acoustic wave equations with variable velocity.
Young (1971, [
45]) found an iterative solution of large linear systems using the SOR iterative method. Dancis (1991, [
46]) used the SOR iteration method to solve linear equations of large sparse systems and to approximate many of the PDEs that arise in engineering and showed that, using a polynomial acceleration together with a suboptimal relaxation factor, a smaller average spectral radius can be achieved.
Rigal (1979, [
47]) applied the successive over-relaxation method to non-symmetric linear systems to give the convergence domain of this method with the SOR algorithm to find the best relaxation factor in this domain.
Hadjidimos (2000, [
48]) studied the theory of SOR method and some of its properties and mentioned the role of SOR and symmetric SOR methods as preconditioners for the class of semi-iterative methods.
Britt et al. (2018, [
49]) introduced an energy method to derive the stability condition for the variable coefficient case using a finite difference scheme of high-order compact time–space for the wave equation.
Additionally, we can see some generalized finite difference schemes, for example, in [
50], incompressible two-phase fluid flows, i.e., a conservative Allen–Cahn–Navier–Stokes system solved using a new numerical scheme based on the first-order time-splitting approach, and it has been applied to deal with the time variable.
Qu et al. (2018, [
51]) solved the inhomogeneous modified Helmholtz equation using Krylov-deferred correction (KDC) and generalized FDM for a highly accurate solution of transient heat conduction problems; in [
52], a hybrid numerical method for 3D heat conduction in functionally graded materials is developed that integrates the advantages of general FDM and KDC techniques.
Belonosov et al. (2019, [
53]) solved the continuation problem for the 1D parabolic equation with the data given on the boundary part through comparative analysis of numerical methods.
Chung et al. (2021, [
54]) investigated a least squares formulation for inverse ill-posed problems. The existence and uniqueness of an inverse solution and the continuity of the inverse solution were established for noisy data in
.
Desiderio et al. (2023, [
55]) solved the 2D time-domain damped wave equation using a boundary element method (BEM) and a curved virtual element method (CVEM) for the simulation of scattered wave fields by obstacles immersed in infinite homogeneous media.
Bzeih et al. (2023, [
56]) studied the 2D linear wave equation with dynamical control on the boundary using the finite element method.
The backward parabolic problem was investigated [
57], and the error estimates of the method were proved with respect to the noise levels.
Using a space–time discontinuous Galerkin method, the unique continuation problem was solved for the heat equation by Burman et al. (2023, [
58]), and the consistency error and discrete inf-sup stability were established, and it led to a priori estimates on the residual.
Dahmen et al. (2023, [
59]) solved ill-posed PDEs that are conditionally stable concerning the design and analysis of least squares solvers, and in view of the conditional stability assumption, a general error bound was established.
Helin (2024, [
60]) studied the statistical inverse learning theory with the classical regularization strategy of applying finite-dimensional projections and derived probabilistic convergence rates for the reconstruction error of the estimator of maximum likelihood (ML).
Epperly (2024, [
61]) solved overdetermined linear least squares problems using iterative sketching and sketch-and-precondition randomized algorithms and showed that, for large problem instances, iterative sketching is stable and faster than QR-based solvers.
Qu et al. (2024, [
62]) introduced a numerical framework with stability over long time intervals by addressing dynamic crack problems, spatial and temporal discretizations through the meshless generalized finite difference method, and the arbitrary order KDC method to numerically simulate the system of spatial PDEs generated at each time node.
Li (2025, [
63]) proposed a novel iterative method, termed the Projected Newton method (PNT), to solve large-scale Bayesian linear inverse problems; this method can update the solution step and the regularization parameter simultaneously without decompositions and expensive matrix inversions.
Bakanov et al. (2025, [
64]) proposed the Jacobi numerical method to solve the 3D continuation problem for a wave equation based on FDM.
In addition, for three-dimensional problems in the time domain, it usually results in sparse and large linear systems, so at each time step, that needs an iteration. In this work, we extend the formulation of the Jacobi, Gauss–Seidel, and SOR iterative methods to solve the linear systems. The conclusion of this study finds that all three iterative methods are accurate; however, the SOR iterative method is more efficient in terms of fewer iterations and fewer execution times and faster convergence compared with the other two iterative methods.
This paper is organized as follows: The three-dimensional acoustic wave equation in the time domain is formulated in
Section 2. We give a problem formulation and an overview of the three different iterative schemes, followed by the convergence analysis. In
Section 3, finite difference approximations can be described based on the seven-point centered formula that is applied to discretize the three-dimensional acoustic wave equation with difference schemes.
Section 4 present the applicability of the proposed schemes by performing some numerical experiments. In
Section 5, we discuss the results. Finally, we give our conclusions and remarks in
Section 6.
3. Finite Difference Method
The basic idea of FDM is to discretize the partial differential equation by replacing the partial derivatives with their approximations, which are finite differences (see [
80]). We illustrate the scheme with an acoustic wave equation. The effectiveness of this method is tested for some acoustic wave equations with a known analytical solution using MATLAB software, and the derived numerical results show that the method produces accurate results. In real-world systems, numerical methods can be used to provide precise results.
A three-dimensional region can be divided into small regions with increments in the
, and
z directions with time
t given as
, and
, and
is the time interval for time discretization, as shown in the figure mentioned above. Each nodal point is designed by a numbering scheme
,
k, and
n, where
i indicates an increase
x and
j indicates an increase
y,
k indicates an increase
z, and
n indicates an increase
t, as shown in
Figure 1. Through the case study, the temperature at each nodal point
is the average temperature of the surrounding hatched region in the temperature distribution. A suitable finite difference equation can be obtained for the interior nodes of a steady three-dimensional system by considering the acoustic wave equation at the nodal point
with the current time index
t as
The second-order central difference scheme at the nodal point
can be approximated as
The finite difference approximation of acoustic wave equation for interior regions can be expressed as
Let
. We can write Equation (
36) as
In the same way, higher-order approximations with more accuracy for the boundary and interior nodes are also obtained.
The purpose of this paper is to develop numerical methods and investigate regularization techniques to solve certain ill-posed problems for the 3D acoustic wave equation.
3.1. Reducing to Cube Domains
We first discretize BVP (
1)–(
5), (
7) in all three
dimensions on a uniform grid with grid points
, for which we consider a cube domain where
. If
, then we can separate our region into subintervals
and
along the
x,
y, and
z axes with the current time frame
t. The goal is to approximate all the solutions,
, where
, and
As we have seen from Equation (
37), any point
in the region is related to the six points surrounding it. Consider a sketch of a region where
, and
. Here, the cross sections of our cube can be viewed at different
z values. Note that many of the values in this region are already defined. From the boundary conditions, it is known that
, and
. The remaining
points will be approximated by building a linear system of equations. We will create a system of equations
, one for each solution at an internal point of our cube by iterating through all possible values of
i,
j, and
k, where
, and
.
Corollary 2. We use the forward finite difference with respect to time t to solve the problem in (1)–(5), (7) in finite difference approximation (37), as follows: Corollary 3. We use the forward finite difference with respect to time t to solve the problem in (1)–(5), (7) in finite difference approximation (37), as follows: For example, if we work with the
, and
subintervals, the system of linear equations can be written in corresponding matrices and vectors as
where
is the vector of approximate solutions at each point in the domain,
A is the coefficient matrix of these solutions,
is the boundary and initial condition vector at these points, and
is the vector of the source function. Although Equation (
38) is the same as for the two-dimensional case, the coefficient matrix
A and the boundary and initial condition vector
will have some different patterns.
3.2. Time Adaptivity
Time increments are used by time-adaptivity algorithms depending upon the medium in which they are adjusted, and by employing intermediate time steps, stability limits can be satisfied on each subregion of the domain. Depending on the algorithm used, these intermediate intervals of time can be chosen. According to [
81], with the lowest propagation velocity, the discretization value
ensures stability for the subregion.
3.3. Direct or Iterative Solution
For a system of small unknowns
, the direct Gaussian elimination method can be used to solve the above system of equations. Iterative methods achieve a better result for large linear systems. According to [
82], the accuracy of the numerical results greatly depends on the computational grid for all numerical methods based on the grid. For accuracy, a grid-converged solution would be preferred (i.e., the solution does not change significantly when more grid points are used as one approaches a tolerance point). For this work, three different iterative techniques are proposed to be used. Details of each iterative technique are provided in the following.
If we apply Equation (
28) or (
29) to solve the system of finite difference equations for the 3D acoustic wave equation, we obtain the Jacobi iteration formula (see [
32]), as follows
The superscript
n is an iterative index. To produce
, we set the initial iterative guess at
, and based on the iteration, it improves successively. From Equation (
39), we find the next iteration
for each point in the grid
across all points in the grid in the horizontal rows. In the interior grid for all points when the iteration is completed, the difference between the vectors of the next iteration
and the previous iteration
is calculated. We set the predefined condition (tolerance) for the iteration to converge, and once the tolerance is met, the iteration ends and the solution to (
39) is
; otherwise, the iterations continue, i.e.,
If we apply Equation (
31) or (
32) to solve the system of finite difference equations for the 3D acoustic wave equation, we obtain the Gauss–Seidel iteration formula (see [
82]), as follows:
as can be seen in Equation (
40), the values
and
are already updated as one moves through the grids to reach the grid point
. The implementation of this iteration method follows the Jacobi method.
The most widely used iteration method is the SOR
method and is integrated into the Gauss–Seidel method. With the aim of speedy convergence, a relaxation parameter
is included in the Gauss–Seidel iteration method. Using (
33) or (
34), we obtain the SOR
iteration formula (see [
83]), as follows:
the relaxation parameter is in the range
. The implementation of the SOR
method follows the first two iteration methods.
To solve Equation (
9) using an iterative method, performing a matrix vector product
is the main cost. However, in practice, making this a matrix-free method, the matrix
A is never generated or stored. To produce the action of
A on
q, a MATLAB code can be created using the finite difference algorithm.
MATLAB programs are developed for all three iterative techniques using the finite difference method with Dirichlet and Neumann boundary conditions that are applied at the boundary of the domain. The results of our discretization and iterative approximations for the sample problem can be examined with a larger mesh size in different time frames. Our Jacobi, Gauss–Seidel, and SOR iterations will use an RMS residual tolerance of , for the values of , and in different time frames, the time interval used for the Jacobi, Gauss–Seidel, and SOR iterative methods for stability. For the values of and in different time frames, the time interval used for the SOR iterative method for stability in test problem 1.
We compare the exact solution with the continuous problem with the solution of the discretized problem computed using iteration techniques.
5. Discussion
In this paper, using an explicit finite difference method in the time domain, we find the numerical solution of the 3D-acoustic wave equation in a cube through three different iterative techniques. We compared our numerical results with the known analytical solution through numerical experiments, checked the results for stability with larger grid size, and also found the better iterative technique among three.
From
Table 2 and
Table 3, we compare the numerical performances of Jacobi, Gauss–Seidel, and SOR
iterative methods in three dimensions to solve the acoustic wave equation in different time periods for test problem 1. We observe that all three iterative methods are accurate; however, the Jacobi iterative method is much slower than the other two iterative methods and does not converge in a reasonable amount of time for the higher values of
,
, and
; we checked the numerical results of the Gauss–Seidel iterative method for the same values of
,
, and
. Compared with the Jacobi iterative method, the Gauss–Seidel iterative method requires about more than half of the iterations and fewer execution times than the Jacobi iterative method. However, the number of iterations required for this method is unacceptable for a larger grid size.
The SOR
iterative method can solve large linear systems in a faster way than Jacobi, and the Gauss–Seidel methods and convergence for the higher values of
,
, and
are significantly faster than the other two iterative methods. We saw that the SOR
method has a much lower iteration count and shorter runtime with relaxation parameter
than the Jacobi and Gauss–Seidel methods. Specifically, for
,
, and
, at time
, the Gauss–Seidel method took 10891 iterations and the execution time is 405.187567 s versus the SOR
method, which took only 647 iterations and only 24.908182 s with the relaxation parameter
. We checked the SOR
method at several values of the relaxation parameter
at time
(see
Table 4) and observed that, at
(see
Table 2), this method requires fewer iterations and fewer execution times.
From
Table 6, we checked the difference in error between the analytical and numerical solutions at different time periods for the Jacobi, Gauss–Seidel, and SOR
iterative schemes for test problem 1. We saw slightly less error difference at time
compared with the other time periods that we checked in the problem between the analytical and numerical solutions for the three iterative schemes.
From
Table 7 and
Table 8, we checked the numerical performance of the SOR
iterative method in three dimensions in solving the acoustic wave equation in different time periods for test problem 2. From
Table 9, we checked the difference in error between the analytical and numerical solutions at different time periods for the SOR
iterative scheme for test problem 2. We saw slightly less error difference at time
compared with the other time periods that we checked in the problem between the analytical and numerical solutions for the SOR
iterative scheme.
In this work, we presented numerical results in the cubic domain and also checked numerical results for other geometric domains through MATLAB software and saw the efficiency of this method. Based on our numerical results, the finite difference method is relatively simple to implement for other geometric domains.
The finite difference method (FDM) has some limitations related to complex geometries, boundary conditions, and accuracy. Accuracy depends on grid spacing and time step, while complex shapes and non-straight boundaries are difficult to represent.