Next Article in Journal
Analysis of Ice Phenology of Middle and Large Lakes on the Tibetan Plateau
Next Article in Special Issue
Compressive Sensing Imaging Spectrometer for UV-Vis Stellar Spectroscopy: Instrumental Concept and Performance Analysis
Previous Article in Journal
Infrared Small Target Detection Based on Multiscale Kurtosis Map Fusion and Optical Flow Method
Previous Article in Special Issue
Learning to Sense for Coded Diffraction Imaging
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Nyquist Sampling Conditions of Some Diffraction Algorithms with Adjustable Magnification

Tsinghua Shenzhen International Graduate School, Tsinghua University, Shenzhen 518055, China
*
Author to whom correspondence should be addressed.
Sensors 2023, 23(3), 1662; https://doi.org/10.3390/s23031662
Submission received: 18 November 2022 / Revised: 18 January 2023 / Accepted: 29 January 2023 / Published: 2 February 2023
(This article belongs to the Special Issue Computational Imaging and Sensing Technology)

Abstract

:
Diffraction algorithms with adjustable magnification are dominant in holographic projection and imaging. However, the algorithms are limited by the Nyquist sampling conditions, and simulation results with inappropriate parameters sometimes appear with aliasing. At present, many diffraction algorithms have been proposed and improved, but there is a need for an overall analysis of their sampling conditions. In this paper, some classical diffraction algorithms with adjustable magnification are summarized, and their sampling conditions in the case of plane wave or spherical wave illumination are analyzed and compared, which helps to select the appropriate diffraction algorithm according to the specific parameter conditions of the simulation to avoid aliasing.

1. Introduction

In the applications of large field of view diffraction projection, such as advanced vehicle front-lighting [1], holographic projection [2,3], and 3D sensing [4], the generation of holograms is a key problem [5]. This process inevitably requires the simulation of the forward and backward diffraction processes of light between the initial plane and the diffraction plane; therefore, a diffraction algorithm with adjustable magnification is necessary.
Figure 1 shows a typical diffraction process. The complex amplitude distribution of the light field on the initial plane is denoted as U0(x0, y0, 0). The complex amplitude distribution at the diffraction distance ∆z on the diffraction plane is denoted as U(x, y, ∆z). The diffraction process can be described by two equations [6].
(1)
The angular spectrum diffraction equation:
U x , y , Δ z = F 1 F U 0 x 0 , y 0 , 0 exp i 2 π λ Δ z 1 λ f x 0 2 λ f y 0 2   .
(2)
When the divergence angle of the light field is small enough, Equation (1) can be converted to the following two equations under the paraxial approximation:
U x , y , Δ z = exp i k Δ z i λ Δ z × + U 0 x 0 , y 0 , 0 exp i k 2 Δ z x x 0 2 + y y 0 2 d x 0 d y 0 ,
U x , y , Δ z = exp i k Δ z i λ Δ z exp i k 2 Δ z x 2 + y 2 × + U 0 x 0 , y 0 , 0 exp i k 2 Δ z x 0 2 + y 0 2 × exp i 2 π x 0 x λ Δ z + y 0 y λ Δ z d x 0 d y 0 .
Since the Fourier transform can be calculated via fast Fourier transform (FFT) [6], Equation (3) is widely used in the study of diffraction problems. The single fast Fourier transform (S-FFT) [7] is a classical method for calculation of the diffraction process using FFT. This method uses FFT once to calculate the diffraction process. If we want to obtain diffraction results satisfying the sampling theorem, the number of sampling points, N, the initial plane size, L0, the diffraction plane size, L, the sampling interval, ∆x0, and the scaling factor, m, of L relative to L0 should satisfy the following condition:
L = λ Δ z N L 0 m Δ x 0 2 N = λ Δ z   .
When the diffraction distance is small, the target plane size L will be close to 0. In order to ensure that L is not too small under the premise that L0 is fixed, a large number of sampling points, N, is necessary, which will increase the amount of calculations. However, in a large field of view diffraction projection system, the initial plane size is often much smaller than the diffraction plane size, and the use of S-FFT has great limitations. Therefore, some more flexible numerical algorithms have been developed to break the limit and make flexible calculations with adjustable magnification between the sizes of the initial plane and the diffraction plane.
One of them is the double Fresnel transform (DBFT) algorithm, which was proposed by Fucai Zhang et al. for the reconstruction of recorded digital holograms [8]. Later, an improved algorithm with similar principles was also proposed [9]. The algorithm involves two reconstruction steps implemented by conventional S-FFT, such that the magnification between the sizes of the initial plane and the diffraction plane can be adjusted flexibly by adjusting the diffraction distances of the two steps.
In the book Numerical Simulation of Optical Wave Propagation, the author Jason D. Schmidt mentioned an algorithm containing a scaling factor [10] (scaled angular spectrum method, SASM). Furthermore, Richard P. Muffletto et al. proposed the shifted Fresnel diffraction algorithm [11] (SFD), which can compute the Fresnel propagation of light between parallel planes with different sampling intervals. The common feature of the two algorithms is that the magnification between the sampling intervals of the initial plane and the diffraction plane can be set independently before simulation.
Although the first three diffraction algorithms are improved compared with the ordinary S-FFT in terms of sampling conditions, they are still limited. If all algorithms are not applicable to the set simulation parameters, the algorithms [12,13,14] with relatively smaller sampling limit can also be used at the expense of computing efficiency. Their mathematical principle is similar to nonuniform fast Fourier transform (NUFFT) in signal processing theory [15]. One of them is the matrix product angular spectrum method (MPASM). This algorithm was proposed by Wanli Zhao et al. in 2020 [14]. In this method, a DFT calculation based on the matrix product is realized.
The ideas of these four algorithms to break the sampling limit of S-FFT are classical and representative. Therefore, their specific sampling conditions are further analyzed in this paper. Our conclusion can also be referred to when analyzing other algorithms with similar ideas.
In simulations of the diffraction process of the light field, the Nyquist sampling condition needs to be considered. That is, the condition that the sampling frequency is not less than twice of the maximum spatial frequency in the light field distribution needs to be satisfied, otherwise aliasing will occur.
Generally, there are two kinds of aliasing results. One is that the image is divided into several parts. The other is the appearance of horizontal and vertical high brightness stripes. They darken the whole image due to brightness normalization, which is also one of the bases for judging whether the image is aliased. These two different aliasing phenomena are caused by the failure of different steps in the calculation to meet the sampling conditions.
In most diffraction algorithms, the maximum spatial frequency of the light field generally depends on the phase factors in the diffraction equation, especially the quadratic phase factors. The spatial frequency of the amplitude is generally much smaller than that of the phase, which is often not considered [6]. In the general quadratic phase factors, the spatial frequency becomes larger upon approaching the field edge. Therefore, when analyzing the sampling frequency, the spatial frequency of the phase distribution at the four corners of the rectangular field is generally taken as the maximum spatial frequency for analysis, so as to ensure that every 2π change in the phase will pass through at least two sampling points. Different diffraction algorithms involve different phase factors; therefore, their sampling conditions are also different. There is an urgent need for overall analysis of their sampling conditions.
Compared with the S-FFT algorithm with a simple calculation process, the calculation processes of these algorithms are more complex. Therefore, each step of the calculation process needs to be analyzed when analyzing the sampling conditions, and the mutual influence between the sampling limits of different parts should also be considered. In addition, compared with simple plane wave illumination, spherical wave illumination with an additional quadratic phase factor also makes the analysis of sampling conditions more complex.
Four classical diffraction algorithms are summarized in this paper: the double Fresnel transform [8] (DBFT), the scaled angular spectrum method [10] (SASM), the shifted Fresnel diffraction [11] (SFD), and the matrix product angular spectrum method [14] (MPASM). Their sampling conditions are analyzed and compared, which is helpful when selecting the appropriate diffraction algorithm according to specific simulation conditions to avoid aliasing. As a result, when using them, people often encounter aliasing due to inappropriate parameters, but do not know where and how to adjust them. Next, this paper briefly introduces the principles and analyzes the sampling conditions for each algorithm, and finally summarizes and compares them to provide important references.

2. Methods

Generally, in the diffraction equation, if the phase factors in the Fourier transform term do not satisfy the sampling conditions, the amplitude distribution of the simulated diffraction result will be aliased, and if the phase factors outside the Fourier transform term do not satisfy the sampling conditions, the phase distribution of the simulated diffraction result will be aliased. In display applications, while only the amplitude distribution of the diffracted result is considered, the phase factors outside the Fourier transform term are often ignored. Yet, for a specific diffraction algorithm, it is also necessary to specifically analyze which phase factors are related to the amplitude and which are related to the phase in the target plane before making a choice.
When the initial plane is illuminated by a spherical wave, a quadratic phase factor is introduced into it. The phase factor is related to the distance from the point light source to the initial plane. Generally, the phase factor is similar to the phase factors in the diffraction equation; thus, it can be combined with them to form new phase factors. Then, it is necessary to analyze the sampling conditions of the combined new phase factor. The results obtained by analyzing these phase factors separately and then taking their intersection are inaccurate.
On the basis of the discussions above, we briefly introduction the four algorithms and discuss their sampling conditions separately.

2.1. SFD

The SFD algorithm considers the condition that the center of the initial plane and the center of the diffraction plane are not coaxial and the sampling intervals of the two sampling planes are different. Taking the center point as a relative reference, each sampling point can be written as:
x 0 = x 0 c + 1 2 + p 0 Δ x 0 , y 0 = y 0 c + 1 2 + q 0 Δ y 0 ,
x = x c + 1 2 + p Δ x , y = y c + 1 2 + q Δ y ,
where p0, q0, p, and q are within [−N/2, N/2 − 1] and N is the number of horizontal (vertical) sampling points. Only the case where the two sampling planes are square is considered here, and the sampling points of the two planes are the same. Then, according to Equation (3), we obtain:
U p , q = C p 0 q 0 a p 0 , q 0 b p p 0 , q q 0   ,
where
C = exp ( i k Δ z ) i λ Δ z exp i k 2 Δ z x 2 + y 2 exp i 2 π λ Δ z p x 0 c Δ x + q y 0 c Δ y exp i 2 π λ Δ z 1 2 p Δ x 0 Δ x + 1 2 q Δ y 0 Δ y exp i π λ Δ z p 2 Δ x 0 Δ x + q 2 Δ y 0 Δ y a ( p 0 , q 0 ) = U 0 ( p 0 , q 0 ) exp i k 2 Δ z x 0 2 + y 0 2 exp i 2 π λ Δ z x 0 x c + y 0 y c exp i 2 π λ Δ z 1 2 p 0 Δ x 0 Δ x + 1 2 q 0 Δ y 0 Δ y exp i π λ Δ z p 0 2 Δ x 0 Δ x + q 0 2 Δ y 0 Δ y b ( p 0 , q 0 ) = exp i π λ Δ z p 0 2 Δ x 0 Δ x + q 0 2 Δ y 0 Δ y .
Equation (7) contains a convolution operation and can be converted into a Fourier transform operation:
U p , q = C F 1 F a p 0 , q 0 F b p 0 , q 0   .
Then, FFT can be used, and the calculation speed will be greatly accelerated. A total of three FFT operations are required. This algorithm has been used in holographic projections without lenses [16] and 3D holography [17].
In addition, Tomoyoshi Shimobaba’s group further proposed an improved algorithm ARSS (aliasing reduced Fresnel diffraction with scale and shift operations) to address the drawback of SFD that aliasing will occur with a short diffraction distance [18]. By introducing a rectangular window, the algorithm eliminates the aliasing phenomenon with a short diffraction distance. They used the ARSS in a virtual converged spherical wave computer-generated holographic system [19], in which the method of cyclic iteration was used to improve the clarity of the reconstructed hologram. However, in order to facilitate comparison with other algorithms, only sampling conditions of the basic algorithm are analyzed.
SFD determines the scaling factor before deriving the diffraction process, and then extracts the convolution operation, so that FFT can be used for fast calculation.
The quadratic phase factors of a(p0, q0) and b(p0, q0) in Equation (9) are mainly analyzed. Here, in order to keep the simulation conditions consistent with other algorithms, only the case where the centers of the initial plane and diffraction plane are coaxial is considered. The scaling factor is still assumed to be m. Next, as shown in Figure 1, we consider the phase factor introduced by the spherical wave for illumination, which will also affect the sampling conditions.
The phase factor introduced by the illumination spherical wave Pdiv is expressed as:
P d i v = exp i ϕ d i v = exp i k x 0 2   +   y 0 2 2 r .
It should be noted that the spherical wave here is not necessarily a divergent spherical wave illuminated by a point light source. This is only true when r is > 0. When r is < 0, the spherical wave is convergent. When r tends to +∞, the incident light tends to the plane wave. Here, we only analyze the case where r is > 0 or r tends to +∞.
In order to satisfy the sampling theorem, the sampling frequency should be higher than twice the maximum spatial frequency. Generally, the phase frequency is much higher than the amplitude frequency. Therefore, only the phase factor in the diffraction equation is considered. Given that the maximum spatial frequency is located at the edge, where the sampling frequency shall satisfy the sampling theorem, for a(p0, q0), we have:
Δ x 0 Δ z r λ L 0 ( r m r + Δ z )   .
The analysis of the quadratic phase factor in b(p0, q0) shows that:
Δ x 0 Δ z λ m L 0   .
Next, further analysis is conducted to observe the results of {a(p0, q0)}, {b(p0, q0)}, and {a(p0, q0)}{b(p0, q0)}. Here, taking ∆z = 500 mm as an example, the analysis process is shown in Figure 2.
In Figure 2, the aliasing phenomenon occurs at the edge of {b(p0, q0)}, but the final diffraction result is normal, because there is an invalid blank area around {a(p0, q0)}. In addition, in the process of multiplying {b(p0, q0)}, the aliased part in {b(p0, q0)} does not affect the effective area at the center of {a(p0, q0)}; hence, it does not affect the final result. According to this discussion, the analysis of the quadratic phase factor in b(p0, q0) can be adjusted. It is not necessary to satisfy the sampling conditions at the farthest edge of the field, as long as the sampling conditions are satisfied at the edge of the effective area of {a(p0, q0)}.
Therefore, we need to calculate the range of the effective area in {a(p0, q0)}. From the form of a(p0, q0), we can get that {a(p0, q0)} is actually the propagation result of the initial plane illuminated by a spherical wave of radius r through the distance ∆z/(1 − m), which will scale the size of image by [r(m − 1) − ∆z]/[r(m − 1)] times. In addition, after a single FFT calculation, the sampling range is scaled by [Nx02(m − 1)]/(λz) times. Given these two scales, the scale of the range of the effective area relative to the original image should be Nx02[r(m − −1) − ∆z]/(λrz), according to which we can scale N in the sampling conditions obtained from the analysis of the quadratic phase factor in b(p0, q0) to obtain a new sampling condition. It should be noted here that, in order to ensure that the amplitude of {b(p0, q0)} does not appear aliasing at the boundary of the effective area, b(p0, q0) is required to satisfy the sampling conditions in the diagonal direction at the corners of the effective area, and its sampling interval is 2 times of the horizontal or vertical interval. Then, we obtain:
Δ x 0 Δ z λ L 0 r 2 m ( m r r Δ z )   .
Next, we analyze the phase factor in {a(p0, q0)}{b(p0, q0)}. U(p0, q0) and the linear phase factor in a(p0, q0) have little influence on {a(p0, q0)}; thus, they can be ignored. Then, the phase factor of a(p0, q0) can be regarded as exp{iπ[(1 − m)r + ∆z](x02 + y02)/(λrz)}, and the phase factor of {a(p0, q0)} can be calculated as exp{iπ(λrz)(fx2 + fy2)/[(m − 1)r − ∆z]}. Meanwhile, the phase factor in {b(p0, q0)} can be calculated as exp{−iπλz(fx2 + fy2)/m}. Multiplying the two phase factors, we obtain exp{iπλz(r/[(m − 1)r − ∆z] − 1/m)(fx2 + fy2)}, which meets the sampling conditions at the boundary of the effective area. Then, we obtain:
Δ z ( m 1 ) r   .
Since Equation (13) is more restrictive than Equation (11), the final adjusted sampling conditions are:
Δ x 0 Δ z λ L 0 r 2 m ( m r r Δ z )   , Δ z ( m 1 ) r   .
Next, we performed simulations to verify this sampling condition for the SFD algorithm. Two verifications were performed. One is to adjust the propagation distance ∆z with other parameters fixed, and the other is to adjust ∆x0 and N with other parameters and initial plane size (L0 = Nx0) fixed. For the first verification, the simulation parameters are set as shown in Table 1. According to Equation (15) and the simulation parameters, the sampling condition is satisfied when 450 mm ≤ ∆z ≤ 750 mm.
Figure 3 shows the amplitude distributions on the diffraction plane with different ∆z. It can be seen that the calculated sampling range is consistent with the simulation results. There is a hologram on the initial plane. In theory, with the condition of r = 150 mm given in Table 1, a clear image in focus will be obtained on the diffraction plane 600 mm behind it. All verifications in this paper use the hologram as the initial plane. When ∆z decreases to 450 mm, horizontal and vertical bright stripes begin to appear in the middle of the image, and the image brightness starts to decrease. With a further decrease in ∆z, the phenomenon of aliasing becomes more serious. Multiple images overlap and interlace, and the image brightness lowers. When ∆z increases to 750 mm, bright stripes parallel to the edges begin to appear around the image, and the image brightness starts to decrease. With the further increase in ∆z, the aliasing becomes more serious, and the image brightness lowers.
For the second verification, the simulation parameters are set as shown in Table 2. According to Equation (15) and the simulation parameters, the sampling condition is satisfied when ∆x0 ≤ 15.086 μm.
Figure 4 shows the amplitude distributions on the diffraction plane with different ∆x0 and N. The calculated sampling range is also consistent with the simulation results. When ∆x0 increases to 15.086 μm, multiple images overlap and interlace, horizontal and vertical bright stripes begin to appear, and the image brightness starts to decrease. With the further increase in ∆x0, the phenomenon of aliasing becomes more serious, and the image becomes illegible. The results prove that the sampling conditions are correct from another perspective. In addition, this sampling condition is also applicable to the Fresnel–Bluestein algorithm, the mathematical essence of which is similar to that of SFD [20].

2.2. SASM

In the book Numerical Simulation of Optical Wave Propagation [10], the author Jason D. Schmidt mentioned an algorithm, which assumes that both sides are coaxial, and also introduces the scaling factor m, but uses FFT once less than SFD. The author uses angular spectrum propagation to define this method because its calculation form is similar to the angular spectrum form of the Fresnel diffraction integral. This method still uses a paraxial approximation, so it is not strictly equivalent to the true angular spectrum form.
In order to simplify the derivation process of SASM, the following operators are introduced:
Q c , r U r exp ( i k 2 c | r | 2 ) U r F r , f U r + U r exp ( i 2 π f r ) d r   , F 1 f , r U f + U f exp ( i 2 π f r ) d f
where the operators Q[c, r], F r ,   f , and F 1 r ,   f in the equation indicate multiplication by the phase factor, Fourier transform, and inverse Fourier transform, respectively. The scalar forms of the vector symbol are r = (x, y) and f = (fx, fy), representing the spatial coordinate and the frequency domain coordinate, respectively. Next is the derivation of SASM. First, the Fresnel diffraction equation can be written as:
U r = 1 i λ Δ z + U 0 r 0 exp ( i k 2 Δ z r r 0 2 ) d r 0   ,
where ∆z is the diffraction distance and r0 and r denote the coordinate vectors at the initial plane and the diffraction plane, respectively. Then, a size scaling factor m of the diffraction plane relative to the initial plane is introduced, and the identity transformation can be performed:
r r 0 2 = r 2 2 r r 0 + r 0 2 = r 2 + r 2 m r 2 m 2 r r 0 + r 0 2 + m r 0 2 m r 0 2 = m r m 2 2 r m r 0 + r 0 2 + 1 1 m r 2 + ( 1 m ) r 0 2 = m r m r 0 2 1 m m r 2 + ( 1     m ) r 0 2 .
With Equation (17), we can further obtain:
U r = exp ( i k 2 Δ z 1     m m r 2 ) i λ Δ z + U 0 r 0 exp ( i k 2 Δ z 1 m r 0 2 ) exp ( i k m 2 Δ z r m r 0 2 ) d r 0   .
Finally, the convolution theorem can be used to obtain U(r2) as:
U r = Q m     1 m Δ z , r F 1 f 0 , r m Q λ 2 Δ z m , f 0 × F r 0 , f 0 Q 1     m Δ z , r 0 1 m U 0 r 0 .
In this algorithm, the scaling factor is determined before the diffraction process is derived, and the convolution operation is extracted such that FFT can be used for fast calculations.
This is similar to SFD in essence. The difference is that, for the Fourier transform of b in SFD and h in SASM, SFD calculates the Fourier transform, while SASM directly uses the phase factor of the calculation result. The use of FFT in the calculation process is an important factor influencing the sampling conditions; therefore, there are still differences between them. That is, SASM does not have to satisfy the second sampling condition in Equation (13) of SFD, which is obtained from the analysis of b(p0, q0).
The final sampling conditions are as follows:
Δ x 0 Δ z r λ L 0 ( m r r Δ z )   , Δ z ( m 1 ) r   .
Next, we performed simulations to verify these sampling conditions for the SASM algorithm. The two verifications were similar to those of SFD. For the first, the simulation parameters were also set as shown in Table 1. According to Equation (21) and the simulation parameters, the sampling condition is satisfied when 316 mm ≤ ∆z ≤ 750 mm. Figure 5 shows the amplitude distributions of the diffraction plane with different ∆z. It can be seen that the calculated sampling range is consistent with the simulation results. Within the calculated range, the image is only scaled. Beyond this range, aliasing occurs. When ∆z is large, the result of SASM is the same as that of SFD. When ∆z is reduced to 316 mm, the edge parts of the image start to separate from the center part, and the image is divided into nine parts, which is different from the common effect of aliasing containing replications, and is caused by the violation of the Nyquist sampling theorem by the second Fourier transform in Equation (20). With a further decrease in ∆z, the segmented part becomes larger and farther away from the center.
For the second verification, the simulation parameters were set as shown in Table 2. According to Equation (21) and the simulation parameters, the sampling condition is satisfied when ∆x0 ≤ 43.944 μm.
Figure 6 shows the amplitude distributions on the diffraction plane with different ∆x0 and N. The calculated sampling range is also consistent with the simulation results. When ∆x0 increases to 43.944 μm, the edge of the image begins to blur, and the image brightness starts to decrease. With a further increase in ∆x0, the phenomenon of aliasing becomes more serious; the edge parts of the image separate from the center part evidently such that the image is divided into nine parts and the whole image becomes blurred. It can be seen that the sampling conditions of SASM are not as strict as those of SFD due to the lack of the sampling limit for b(p0, q0).

2.3. DBFT

Figure 7 is the schematic of DBFT. U0(x0, y0) and U(x, y) represent the complex amplitude distribution of light field in the initial plane and the diffraction plane, respectively, while U1(x1, y1) is the complex amplitude distribution of the light field in a virtual intermediate plane that does not physically exist, which is indicated by the dotted lines. The diffraction process of the light field from U0(x0, y0) to U1(x1, y1), and from U1(x1, y1) to U(x, y) is taken into account, such that the size of the diffraction plane can be adjusted by changing the position of the virtual intermediate plane.
The sampling intervals on the three planes are ∆x0 = ∆y0 = L0/N, ∆x1 = ∆y1 = L1/N, and ∆x = ∆y = L/N, where L represents the sampling range and N represents the number of sampling points. The sampling range of the frequency domain (Lu, Lv) has the following mathematical relation with the spatial domain sampling interval in the discrete Fourier transform (DFT):
L u = 1 Δ x , L v = 1 Δ y   .
Therefore, for the three planes, the following relations can be obtained:
L 1 λ z 1 = 1 Δ x 0 = N L 0 , L λ z 2 = 1 Δ x 1 = N L 1   .
Then, we have the following relation:
L 1 = N λ z 1 L 0 , L = N λ z 2 L 1   .
The relation between L0 and L is:
L = z 2 z 1 L 0   .
So far, the derivation of DBFT has been completed. The core idea to solve the sampling problem is as follows: in single FFT, the sampling interval in the spatial domain and that in the frequency domain are reciprocal; hence, the size L is not large enough. However, with double FFTs, a positive proportional relation will be obtained after two reciprocal relations, as shown in Equation (25), which is applicable to the diffraction process.
It is worth noting that the absolute value is used in Equation (25), which indicates that the distance parameter can take a negative value, i.e., the intermediate virtual plane does not have to be between the initial plane and the diffraction plane but can also be placed on the left side of the initial plane or the right side of the diffraction plane. For example, the double sampling Fresnel (DSF) algorithm with similar mathematical essence places the intermediate plane at the point light source of the spherical wave for illumination [21].
From U0(x0, y0) to U1(x1, y1),
U 1 x 1 , y 1 = exp i k 2 z 1 x 1 2 + y 1 2 F U 0 x 0 , y 0 exp i k 2 z 1 x 0 2 + y 0 2   .
The phase factor outside the Fourier transform term only affects the phase distribution of U1(x1, y1); thus, it is not considered. Only the phase factor exp[(ik/2z1)(x02 + y02)] inside the Fourier transform term is considered. Thus, we obtain the sampling condition |z1| ≥ (∆x02N)/λ.
From U1(x1, y1) to U(x, y),
U x , y = exp i k 2 z 2 x 2 + y 2 F U 1 x 1 , y 1 exp i k 2 z 2 x 1 2 + y 1 2   .
Similarly, we obtain the sampling condition |z2| ≥ (∆x12N)/λ.
Next, further analysis is conducted. The spherical wave phase factor can be combined with the phase factor in the diffraction equation. In addition, the phase factor of U1(x1, y1) can also be combined with the phase factor in the Fourier transform term in the second step. The phase factor of U1(x1, y1) is composed of two parts, one is the phase factor outside the Fourier transform term, and the other is the phase factor of the new term obtained by the Fourier operation of the part inside the Fourier transform term. The influence of the amplitude term U0(x0, y0) in the Fourier transform term can be ignored; hence, the phase factor of the new term obtained after calculation is exp{−iπr(x12 + y12)/[λz1(r + z1)]}.
In addition, similar to the SFD analysis process, the phase factor inside the Fourier transform term in U(x, y) only has to satisfy the sampling conditions at the boundary of effective area of U1(x1, y1). The calculation shows that the scale of the range of the effective area relative to the original image is Nx02(r + z1)/(λrz1). Therefore, the sampling conditions of the combined phase factor can be analyzed.
The final sampling conditions can be obtained as
r z 1 r + z 1 Δ x 0 2 N λ   , z 1 ( r + z 1 + z 2 ) r z 2 1   .
Next, we performed simulations to verify this sampling condition for the DBFT algorithm. The simulation parameters were set as shown in Table 1. According to Equation (28) and the simulation parameters, the sampling condition is satisfied when −150 mm ≤ z1 ≤ −63 mm for any ∆z = (z1 + z2) > 0 mm.
Figure 8 shows the amplitude distributions of the diffraction plane with different z1. It can be seen that the calculated sampling range is consistent with the simulation results. When z1 is reduced to −150 mm, bright stripes parallel to the edge begin to appear around the image, and the image brightness starts to decrease. With a further reduction in z1, the aliasing becomes more serious and the image brightness becomes lower. When z1 is increased to −63 mm, the edge part of the image starts to separate from the center part, and the image is divided into nine parts. With a further increase in z1, the segmented part becomes larger and further away from the center. When z1 exceeds 97 mm, horizontal and vertical bright stripes appear in the middle of the image and the image brightness decreases.
Next, in order to keep the same form with the sampling conditions of other algorithms for easy comparison, z1 and z2 in the sampling conditions are expressed in terms of m and ∆z according to Equation (25). Here, two cases are considered. One is z2/z1 = m and the other is z2/z1 = −m. For the former, the final sampling condition after conversion is:
Δ x 0 Δ z r λ L 0 ( r + m r + Δ z ) Δ z m 1 r   .
For the latter, the final sampling condition after conversion is:
Δ x 0 Δ z r λ L 0 ( m r r Δ z ) Δ z m 1 r   .
It can be seen that the sampling condition of the latter is better, which is consistent with that of SASM. Therefore, in order to avoid aliasing as much as possible, the virtual intermediate plane should be placed on the left side of the initial plane rather than between the initial plane and the diffraction plane when the algorithm is used for large field of view diffraction calculations. Next, two verifications similar to those of other algorithms were performed. Here, m is fixed, which means that the ratio of z2/z1 is fixed. In addition, z1 is always negative while z2 is always positive.
For the first verification, the simulation parameters were also set as shown in Table 1. According to Equation (30) and the simulation parameters, the sampling condition is satisfied when 316 mm ≤ ∆z ≤ 750 mm.
For the second verification, the simulation parameters were set as shown in Table 2. According to Equation (30) and the simulation parameters, the sampling condition is satisfied when ∆x0 ≤ 43.944 μm.
It can be seen from Figure 9 and Figure 10 that not only are the final sampling conditions of DBFT and SASM consistent, but their verification results with the same parameters are also consistent, which shows that although the overall ideas of the two algorithms are completely different, their mathematical essence is similar.

2.4. MPASM

It can be seen that there are still sampling restrictions for the above three algorithms. If all algorithms are not applicable, the matrix product angular spectrum method (MPASM) can be considered. This algorithm was proposed by Wanli Zhao et al. in 2020 [14]. In this method, the calculation of the true angular-spectrum form without paraxial approximation based on matrix product is realized.
To get rid of the limitation ∆fx = 1/(Nx), this algorithm uses the matrix product instead of FFT to calculate the diffraction process. Moreover, the frequency domain range can be adjusted by adjusting the number of frequency domain sampling points to satisfy the sampling conditions. Therefore, there is no sampling limit in theory, but the cost is that the calculation time is increased; furthermore, if the number of points is increased to satisfy the sampling conditions, the calculation time will be further increased.
The diffraction process is calculated using the angular spectrum formula:
U x , y = F 1 F U 0 x 0 , y 0 H f x 0 , f y 0   ,
where
H f x 0 , f y 0 = exp i 2 π λ Δ z 1 λ f x 0 2 λ f y 0 2   .
After replacing FFT with matrix product operation, the diffraction equation can be converted into:
U x , y = 1 M N K f x 0 K f y 0 S 1 S 2 M y , f y 0 × M y 0 , f y 0 T U 0 x 0 , y 0 M f x 0 , x 0 T H f x 0 , f y 0 M f x 0 , x   ,
where
M f x 0 , x 0 = exp i 2 π f x 0 T x 0 = Δ x 0 2 f x 0 M A X K f x 0 n × exp i 2 π n 2 n 2 exp i 2 π n 2 n 2 + 1 exp i 2 π n 2 n 2 1 exp i 2 π n 2 + 1 n 2 exp i 2 π n 2 + 1 n 2 + 1 exp i 2 π n 2 + 1 n 2 1 exp i 2 π n 2 1 n 2 exp i 2 π n 2 1 n 2 + 1 exp i 2 π n 2 1 n 2 1
where Kfx0 is the scaling factor of the frequency domain plane sampling interval and S1 and S2 are the scaling factors of the sampling points in the frequency domain.
So far, the formula of MPASM has been obtained. This formula can be directly applied using MATLAB. Since FFT is no longer used, the sampling will not be limited by it. The disadvantages are also obvious; the computational complexity of FFT is O(N2log(N2)), while that of MPASM is O(2N2.4) [14]. When the number of sampling points is more than 300, the computational complexity of MPASM will exceed that of FFT.
For the phase factor within the transfer function:
φ = 2 π λ Δ z 1 λ f x 0 2   ,
conditions for satisfying the sampling theorem are as follows:
1 2 π φ f x 0 1 2 Δ f x 0   .
The maximum frequency is calculated as:
f M P A S M M A X = s N λ 4 + 64 ( s N λ Δ z ) 2 ( s N λ ) 2 4 2 Δ z λ   ,
where S1 = S2 = s, which controls the number of sampling points. When s = 1, Equation (37) expresses the effective sampling range of FFT, and the sampling range decreases with the increase in the diffraction distance. When s > 1, it means that the number of sampling points is increased, and it can be applied to cases where the diffraction distance is relatively large. However, at the same time, it will lead to an increase in computational complexity. The simulation results are shown in Figure 11 and Figure 12. It can be seen that when s is small, the sampling conditions of the algorithm are relatively strict, and aliasing is easy to occur. With an increase in s, the sampling condition of the algorithm becomes looser, and the upper limits of ∆z and ∆x0 become higher.
The parameters were consistent with the simulation of SFD (Table 1 and Table 2).

3. Results

The characteristics and sampling conditions of the algorithms are analyzed and summarized in Table 3, where ∆x0 is the sampling interval of the initial plane, N is the number of horizontal (vertical) sampling points, L0 is the size of initial plane, λ is the wavelength of light, m is the scaling factor of the diffraction plane relative to the initial plane, ∆z is the diffraction distance, and r is the distance between the initial plane and the center of spherical wave for illumination (for a plane wave, r tends to +∞).
m Δ x 0 2 N = λ Δ z Δ x 0 Δ z λ L 0 r 2 m ( m r r Δ z ) Δ z ( m 1 ) r Δ x 0 Δ z r λ L 0 ( m r r Δ z ) Δ z ( m 1 ) r Δ x 0 Δ z r λ L 0 ( m r r Δ z ) Δ z ( m 1 ) r It can be seen from the results that for the simulation of large field of view diffraction, three FFT-based algorithms (SFD, SASM, and DBFT) have upper limits on the diffraction distance, ∆z, and sampling pitch, ∆x0. Both ∆z and ∆x0 need to satisfy the sampling conditions to avoid aliasing. If one of them does not satisfy the sampling conditions, a smaller value of the other one will not help. In general, these three algorithms have the same restriction on the diffraction distance, ∆z. For the limits on sampling pitch ∆x0, SASM and DBFT have the same restriction, while SFD has a stricter restriction. Lastly, for the MPASM algorithm based on matrix calculation, we can break through any limits by increasing the parameter s to avoid aliasing, but the computational efficiency is generally much lower than other algorithms.

4. Discussion

In the simulation of large field of view diffraction, in the case that the centers of the initial plane and diffraction plane are coaxial, SASM and DBFT are more recommended from the aspect of aliasing because of looser sampling restrictions. Before the simulation or after the aliasing occurs during the simulation, the specific parameters can be substituted into the formula in Table 3 to check whether they satisfy the sampling conditions. This paper recommends that the check and adjustment of ∆z take precedence over ∆x0, because the limit on ∆z is independent of ∆x0, while the limit on ∆x0 is related to ∆z. In addition, the restrictions on ∆z of various FFT-based algorithms are basically consistent. Therefore, if ∆z does not satisfy the sampling conditions and the parameters ∆z, m, and r involved are not adjustable, a smaller value of ∆x0 will not help; therefore, the FFT-based algorithms should be abandoned, and the MPASM algorithm should be used for calculation to avoid aliasing. However, this generally reduces computational efficiency. If ∆z satisfies the condition but there is still aliasing, it means that ∆x0 does not satisfy the condition and needs to be reduced to below the limit. If it is difficult to reduce ∆x0, other parameters can be adjusted to increase the upper limit of ∆x0 according to the specific situation, while ensuring that ∆z still satisfies the sampling condition. If both ∆z and ∆x0 satisfy the sampling conditions, there will be no aliasing for FFT-based algorithms.
In addition, since the use of FFT is the source of sampling restrictions, fewer uses of FFT in the algorithm lead to looser sampling restrictions. Therefore, when using FFT-based algorithms, the number of times FFT is used in the algorithm should be paid attention to and minimized. For example, the Fourier transform of some expressions without information of the initial plane can be calculated manually. The algorithm should directly deduce the analytical expression instead of using FFT to calculate the Fourier transform process. Generally, sampling conditions consistent with those of SASM and DBFT can be obtained by reducing the use of FFT to two times. Further use of FFT will make the sampling restrictions stricter.
Lastly, for FFT-based algorithms, this paper summarizes the following problems that are easy to ignore or may be confusing, which can provide reference for the process of analyzing the sampling conditions of other similar algorithms:
1. When analyzing whether the phase distribution in FFT satisfies the Nyquist sampling conditions, sometimes there are two phase factors multiplied. If the two phase factors have similar forms, they should be combined and analyzed to obtain the correct results. If the two phase factors are analyzed separately, the restrictions obtained will be stricter. For example, the phase factor in U1(x1, y1) can be combined with exp[(ik/2z2)(x12 + y12)] in Equation (27);
2. When analyzing whether the phase distribution in FFT satisfies the Nyquist sampling conditions, it is necessary to pay attention to its corresponding amplitude distribution synchronously. If there is a blank area in the amplitude distribution, then, even if the phase distribution in this area breaks the Nyquist sampling conditions, it will not affect the results. Accordingly, the sampling restrictions can be further loosened. The process shown in Figure 2 is an example;
3. Sometimes it is necessary to analyze complex phase factors, such as {a(p0, q0)} in Equation (9). The theoretical expression of its phase distribution cannot be obtained because a(p0, q0) in Equation (8) is very complex. However, the factor with less influence in a(p0, q0) can be ignored to simplify the problem. For example, the influence of the amplitude term and the primary phase term in a(p0, q0) on the phase distribution of {a(p0, q0)} can be explored. If the influence is small, we can ignore them to simplify a(p0, q0) to a quadratic phase factor, and then calculate the simple approximate expression of {a(p0, q0)}.
Lastly, we qualitatively explored the definition of diffraction images at various propagation distances near the focal length at different sampling rates to study the influence of sampling choice on 3D factors. In general, for all propagation distances, including the focal length, when the sampling rate is higher than the original resolution of the initial hologram, the results of different sampling rates do not change. When the sampling rate is lower than the original resolution of the initial hologram, a lower sampling rate will lead to lower diffraction image definition. We plan to go deeper into this issue in another article.

Author Contributions

Conceptualization, P.S. and J.M.; methodology, P.S., C.C. and C.W.; software, C.W. and C.C.; validation, C.W., C.C. and P.S.; resources, P.S. and J.M.; writing, P.S., C.W. and J.M. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Shenzhen Key Fundamental Research Program (JCYJ20200109143031287) and the Shenzhen General Fundamental Research Program (WDZC20220816110140002).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Kurtulus, O.U. New Trends and Functionalities in Automotive Tail Lighting. Epstem 2021, 14, 31–38. [Google Scholar] [CrossRef]
  2. Takahashi, T.; Shimobaba, T.; Kakue, T.; Ito, T. Time-division color holographic projection in large size using a digital micromirror device. Appl. Sci 2021, 11, 6277. [Google Scholar] [CrossRef]
  3. Velez-Zea, A.; Torroba, R. Multiplane noniterative color holographic projection. Opt. Lasers Eng. 2021, 137, 106327. [Google Scholar] [CrossRef]
  4. Ikura, M.; Pathak, S.; Yamashita, A.; Asama, H. Polynomial-fitting based calibration for an active 3D sensing system using dynamic light section method. In Proceedings of the Fifteenth International Conference on Quality Control by Artificial Vision, Tokushima, Japan, 16 July 2021. [Google Scholar]
  5. Chang, C.; Qi, Y.; Wu, J.; Xia, J.; Nie, S. Image magnified lensless holographic projection by convergent spherical beam illumination. Chin. Opt. Lett. 2018, 16, 100901. [Google Scholar] [CrossRef]
  6. Goodman, W.J. Introduction to Fourier Optics, 3rd ed.; Roberts and Company: Greenwood Village, CO, USA, 2006; pp. 15–18, 72–73, 355–367. [Google Scholar]
  7. Mas, D.; Garcia, J.; Ferreira, C.; Bernardo, L.M.; Marinho, F. Fast algorithms for free-space diffraction patterns calculation. Opt. Commun. 1999, 164, 233–245. [Google Scholar] [CrossRef]
  8. Zhang, F.; Yamaguchi, I.; Yaroslavsky, L.P. Algorithm for reconstruction of digital holograms with adjustable magnification. Opt. Lett. 2004, 29, 1668–1670. [Google Scholar] [CrossRef] [PubMed]
  9. Pang, H.; Cao, A.; Liu, W.; Shi, L.; Deng, Q. Effective method for further magnifying the image in holographic projection under divergent light illumination. Appl. Opt. 2019, 58, 8713–8718. [Google Scholar] [CrossRef] [PubMed]
  10. Schmidt, J.D. Numerical Simulation of Optical Wave Propagation with Examples in MATLAB; SPIE: Bellingham, WA, USA, 2010; pp. 87–130. [Google Scholar]
  11. Muffoletto, R.P.; Tyler, J.M.; Tohline, J.E. Shifted Fresnel diffraction for computational holography. Opt. Express 2007, 15, 5631–5640. [Google Scholar] [CrossRef] [PubMed]
  12. Zhang, W.; Zhang, H.; Jin, G. Band-extended angular spectrum method for accurate diffraction calculation in a wide propagation range. Opt. Lett. 2020, 45, 1543–1546. [Google Scholar] [CrossRef] [PubMed]
  13. Shimobaba, T.; Matsushima, K.; Kakue, T.; Masuda, N.; Ito, T. Scaled angular spectrum method. Opt. Lett. 2012, 37, 4128–4130. [Google Scholar] [CrossRef] [PubMed]
  14. Zhao, W.; Wei, C.; Yuan, C.; Chang, C.; Ma, J.; Zhu, R. A flexible numerical calculation method of angular spectrum based on matrix product. Opt. Lett. 2020, 45, 5937–5940. [Google Scholar] [CrossRef]
  15. Rao, K.R.; Kim, D.N.; Hwang, J.J. Fast Fourier Transform: Algorithms and Applications; Springer: Berlin, Germany, 2010; pp. 195–234. [Google Scholar]
  16. Shimobaba, T.; Kakue, T.; Masuda, N.; Ito, T. Numerical investigation of zoomable holographic projection without a zoom lens. J. Soc. Inf. Disp. 2012, 20, 533–538. [Google Scholar] [CrossRef]
  17. Zhang, H.; Cao, L.; Zong, S.; Jin, G. Zoomable three-dimensional computer-generated holographic display based on shifted Fresnel diffraction. In Proceedings of the Holography, Diffractive Optics, and Applications VII, Beijing, China, 31 October 2016. [Google Scholar]
  18. Shimobaba, T.; Kakue, T.; Okada, N.; Oikawa, M.; Yamaguchi, Y.; Ito, T. Aliasing-reduced Fresnel diffraction with scale and shift operations. J. Optics-UK 2013, 15, 075405. [Google Scholar] [CrossRef]
  19. Shimobaba, T.; Kakue, T.; Endo, Y.; Hirayama, R.; Hiyama, D.; Hasegawa, S.; Nagahama, Y.; Sano, M.; Oikawa, M.; Ito, T. Improvement of the image quality of random phase-free holography using an iterative method. Opt. Commun. 2015, 355, 596–601. [Google Scholar] [CrossRef]
  20. Restrepo, J.F.; Garcia-Sucerquia, J. Magnified reconstruction of digitally recorded holograms by Fresnel–Bluestein transform. Appl. Opt. 2010, 49, 6430–6435. [Google Scholar] [CrossRef] [PubMed]
  21. Qu, W.; Gu, H.; Zhang, H.; Tan, Q. Image magnification in lensless holographic projection using double-sampling Fresnel diffraction. Appl. Opt. 2015, 54, 10018–10021. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Schematic of the diffraction imaging process.
Figure 1. Schematic of the diffraction imaging process.
Sensors 23 01662 g001
Figure 2. Schematic of sampling condition analysis process of SFD with amplitude distributions of some factors involved.
Figure 2. Schematic of sampling condition analysis process of SFD with amplitude distributions of some factors involved.
Sensors 23 01662 g002
Figure 3. Initial (modulation) plane and calculated amplitude distributions on the diffraction plane with different ∆z using SFD.
Figure 3. Initial (modulation) plane and calculated amplitude distributions on the diffraction plane with different ∆z using SFD.
Sensors 23 01662 g003
Figure 4. Calculated amplitude distributions on the diffraction plane with different ∆x0 and N using SFD.
Figure 4. Calculated amplitude distributions on the diffraction plane with different ∆x0 and N using SFD.
Sensors 23 01662 g004
Figure 5. Calculated amplitude distributions on the diffraction plane with different ∆z using SASM.
Figure 5. Calculated amplitude distributions on the diffraction plane with different ∆z using SASM.
Sensors 23 01662 g005
Figure 6. Calculated amplitude distributions on the diffraction plane with different ∆x0 and N using SASM.
Figure 6. Calculated amplitude distributions on the diffraction plane with different ∆x0 and N using SASM.
Sensors 23 01662 g006
Figure 7. Schematic of DBFT.
Figure 7. Schematic of DBFT.
Sensors 23 01662 g007
Figure 8. Calculated amplitude distributions on diffraction plane with different z1 and fixed ∆z = z1 + z2 = 750 mm using DBFT.
Figure 8. Calculated amplitude distributions on diffraction plane with different z1 and fixed ∆z = z1 + z2 = 750 mm using DBFT.
Sensors 23 01662 g008
Figure 9. Calculated amplitude distributions on the diffraction plane with different ∆z using DBFT.
Figure 9. Calculated amplitude distributions on the diffraction plane with different ∆z using DBFT.
Sensors 23 01662 g009
Figure 10. Calculated amplitude distributions on the diffraction plane with different ∆x0 and N using DBFT.
Figure 10. Calculated amplitude distributions on the diffraction plane with different ∆x0 and N using DBFT.
Sensors 23 01662 g010
Figure 11. Calculated amplitude distributions on diffraction plane with different ∆z and different s using MPASM.
Figure 11. Calculated amplitude distributions on diffraction plane with different ∆z and different s using MPASM.
Sensors 23 01662 g011
Figure 12. Calculated amplitude distributions on diffraction plane with different ∆x0 and different s using MPASM.
Figure 12. Calculated amplitude distributions on diffraction plane with different ∆x0 and different s using MPASM.
Sensors 23 01662 g012
Table 1. The Simulation Parameters of Verification 1 of the Sampling Conditions.
Table 1. The Simulation Parameters of Verification 1 of the Sampling Conditions.
ParametersValues
Wavelength ( λ )632.8 nm
Sampling interval on initial plane ( Δ x 0 )8 μm
Scaling factor ( m )6
Number of sampling points ( N )1080
Distance from point source to initial plane ( r )150 mm
Table 2. The Simulation Parameters of Verification 2 of the Sampling Conditions.
Table 2. The Simulation Parameters of Verification 2 of the Sampling Conditions.
ParametersValues
Wavelength ( λ )632.8 nm
Propagation distance ( Δ z )600 mm
Scaling factor ( m )6
Size of initial plane ( L 0 = N Δ x 0 )8.64 mm
Distance from point source to initial plane ( r )150 mm
Table 3. Comparison and Summary of Diffraction Algorithms.
Table 3. Comparison and Summary of Diffraction Algorithms.
AlgorithmsSampling ConditionsAdvantagesDisadvantages
S-FFT m Δ x 0 2 N = λ Δ z Simple calculationStrict restrictions
SFD Δ x 0 Δ z λ L 0 r 2 m ( m r     r     Δ z ) Δ z ( m     1 ) r Wide range of use considering that centers of planes are not coaxialMore sampling limits than SASM;
requires three FFT operations
SASM Δ x 0 Δ z r λ L 0 ( m r     r     Δ z ) Δ z ( m     1 ) r Easy to implement with two FFT operationsDiffraction distance cannot be too large
DBFT Δ x 0 Δ z r λ L 0 ( m r     r     Δ z ) Δ z ( m     1 ) r Simple principle with two FFT operationsDiffraction distance cannot be too large
MPASMNo limit with parameters adjustedWide range of use;
sampling limit can be broken by adjusting parameters
High computational complexity
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Wang, C.; Ma, J.; Cai, C.; Su, P. Nyquist Sampling Conditions of Some Diffraction Algorithms with Adjustable Magnification. Sensors 2023, 23, 1662. https://doi.org/10.3390/s23031662

AMA Style

Wang C, Ma J, Cai C, Su P. Nyquist Sampling Conditions of Some Diffraction Algorithms with Adjustable Magnification. Sensors. 2023; 23(3):1662. https://doi.org/10.3390/s23031662

Chicago/Turabian Style

Wang, Chunzheng, Jianshe Ma, Chao Cai, and Ping Su. 2023. "Nyquist Sampling Conditions of Some Diffraction Algorithms with Adjustable Magnification" Sensors 23, no. 3: 1662. https://doi.org/10.3390/s23031662

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop