1. Introduction
Due to its all-day, all-weather, long-range, high-resolution imaging capabilities [
1,
2], SAR has been an important tool in applications like resource mapping [
3], environmental monitoring [
4], and disaster assessment [
5]. Oil tanks are crucial monitoring targets in SAR remote sensing applications. Oil tank monitoring aids in getting information on oil storage levels, identifying potential safety risks, and averting leaking accidents.
SAR uses microwave signals to generate images that enable it to penetrate clouds and darkness. This is particularly beneficial for continuous monitoring because it can operate seamlessly under various environmental conditions. This technology can identify structural details, identify changes over time, and track potential problems or changes in oil tank configurations. Moreover, SAR’s ability to acquire multi-temporal data allows the creation of time-series imagery, enabling the detection of changes, movements, or anomalies associated with oil tanks. By analyzing these temporal patterns, SAR contributes to identifying potential risks, leakages, or structural modifications in oil storage facilities [
6]. In essence, SAR emerges as a powerful tool not only for visualizing oil tanks but also for dynamic monitoring over time.
The structure of the oil tank is very complex. The electromagnetic wave signal will be reflected several times between the target’s inner wall and the floating roof during SAR observation [
7,
8], causing a large number of multipath ghost images. This will have a negative impact on the SAR image’s clarity, which will in turn affect the target’s identification and analysis.
Zhang [
9,
10,
11], Horst [
12], Carlos [
13], Xu [
14], and others analyzed the multipath scattering mechanism of oil tanks. The scattering characteristics of oil tanks in SAR images were analyzed in [
9], which also set up a scattering model of oil tanks. In [
10], a prediction model based on the multipath scattering properties in the oil tank SAR images is proposed by combining the principle of SAR and multipath scattering theory. The model can provide the relationship between the geometry parameters of the tank, the SAR parameters, the approximated position, and the scatting strength of the bright region in the SAR image. Ref. [
11] proposed an approach to simulate SAR images of oil tanks by using the Shooting and Bouncing Rays (SBR) technique. The approach uses a ray perspective to calculate the scattering mechanism and deduces the approximate focus positions of the multipath rays according to the imaging formation process. Ref. [
12] uses the Coherent Raytracing SAR simulator (CohRaS) to simulate both the amplitude and phase of the returned signal. The scattering returns from different objects in the scene are calculated using both geometrical and physical optics. Also, the multipath scattering characteristics of oil tanks and the causes of multipath scattering are analyzed in detail. Studies of oil tank SAR images and analyses of the scattering characteristics of oil tanks were also conducted in [
13,
14]. The multiple reflections produced by the oil tank’s outside wall are also taken into account in [
14]. The above-mentioned articles, however, only analyze the SAR multipath scattering mechanism of oil tanks. They make no suggestions for suppressing multipath ghost images, which makes it impossible to solve the problem that multipath signals interfere with SAR images.
At present, domestic and foreign research on multipath ghost image suppression is mainly aimed at through-wall radar application scenes. In indoor contexts, the goal is to suppress multipath ghost images between targets and walls. The main multipath suppression methods include model-based multipath suppression methods and aspect-dependent sub-aperture methods.
By analyzing the interaction of electromagnetic waves between the target and the wall, P. Setlur et al. proposed a multipath suppression method based on the indoor electromagnetic wave propagation model [
15]. Based on this model, the position of multipath ghost images can be calculated. Using a two-dimensional weighting function, this method implements the correlation mapping of the multipath ghost image. The two-dimensional weighting function exhibits a high peak at the real target point, but its amplitude value is near to zero at the ghost image position. Then the two-dimensional weighting function is multiplied with the original image to produce a synthetic image. The pixel intensity at the real target point can be improved and the multipath ghost image suppressed using the synthetic image. However, this method’s weighting function variance is chosen by experience, and the correlation effect is more affected by its value. P. Setlur proposed a multipath signal suppression method based on Point Spread Functions (PSFs) in [
16]. This method eliminates the influence of arbitrary variance parameters on the two-dimensional weighting function, which is instead determined by the threshold associated with the system parameters. This type of multipath suppression method [
17,
18] ignores the multipath effect between different targets and requires prior knowledge of the observing background. Using the above methods to locate the position of the multipath ghost image is challenging for complex structural targets, such as oil tanks, especially when no prior knowledge is available.
After analyzing the multipath scattering model, Wang [
19], Tan [
20,
21], and Li [
22] discovered an important feature of the multipath ghost image to be defined as Aspect Dependence (AD). The feature shows that the position of the ghost image changes with the radar location. This feature can be used to identify and suppress multipath signals without requiring information on the observation background in advance. The author of [
19] generated a series of sub-aperture images using Doppler frequency domain sub-aperture filtering, and then the changes in pixel intensity of these images were evaluated by normalized standard deviation. The multipath ghost image’s intensity sequence fluctuates because of aspect dependence. When the normalized standard deviation exceeds the predetermined threshold, it is regarded as a multipath ghost image to be suppressed. A multipath suppression method based on hidden Markov models (HMMs) was proposed in [
20,
21]. This method takes real targets in sub-aperture images as training samples to build an HMM model of the real targets and then uses the trained model to calculate the matching probability of all unclassified pixels. It is identified as a multipath false target if the matching probability is less than the threshold. A sub-aperture fusion method was proposed in [
22]. It multiplies both the sub-aperture image and the original full-aperture picture in order to suppress the multipath ghost image that varies with the aperture and enhances the real target image. On this basis, Ref. [
23] proposed a sub-aperture double-layer fusion method. This method divides the data into sub-apertures of different scales. The sub-aperture and full-aperture images are multiplied to create the first-layer image sequence. This first-layer image sequence is then grouped and multiplied to create the second-layer image, which can better suppress multipath ghost images. Ref. [
24] presented a multipath suppression method based on group sparse. The real target has the same support set in different sub-aperture images. Based on this principle, the compressed sensing reconstruction algorithm obtains the real target image and suppresses the multipath ghost image. All of the above sub-aperture methods suppress multipath ghost images by using the feature of multipath ghost images that change with aperture. However, the suppression effect is limited and the difference in aperture is quite small. They are not suitable for complex structural targets like oil tanks and are mainly used in simple situations. The multipath ghost image of the oil tank has a large area, and some parts of them overlap with the oil tank image. Thus, the real target image and the multipath ghost image are difficult to distinguish using the above methods.
This paper proposes a new multipath ghost image suppression method through multi-aspect observation. This method can suppress the multipath ghost image of complex structure targets. The radar observes the same scene from various aspect angles to obtain multi-aspect image sequences. Then, the target image and the multipath ghost image are separated based on their different characteristics from each other. This paper takes an external floating roof oil tank as an example to analyze the multipath ghost image characteristics of the oil tank. The multipath ghost image rotates with the aspect angles, whereas the scattering center of the target image does not. This paper applies the idea of principal component analysis to multipath ghost image decomposition and analyzes two principal component analysis methods based on PCA [
25,
26,
27] and RPCA [
28,
29]. The matrix decomposition rule of the two methods is different. Through research and analysis, RPCA is more suitable for multipath suppression of complex structural targets.
This article’s remaining chapters are arranged as follows. The geometry model of SAR multi-aspect observation, the radar imaging model, and the multi-aspect multipath signal characteristics of oil tanks are introduced in
Section 2. In
Section 3, the multipath ghost image suppression method based on the principal component analysis is presented. The principles and distinctions between PCA and RPCA for multipath suppression are also analyzed and contrasted. In
Section 4, the data based on real airborne multi-aspect SAR observation of oil tanks are used to verify the multipath ghost image suppression effect of the method proposed in this article. Conclusions are described in
Section 5.
3. Multi-Aspect Observation Multipath Suppression
3.1. The Basic Principle of Multi-Aspcet Observation Multipath Suppression
This section analyzes the radar signal propagation path and imaging characteristics of external floating roof oil tanks during multi-aspect observation. From the analysis in the previous section, it can be seen that there are mainly two types of reflections inside the oil tank. They are dihedral reflections and multiple reflections of radar signals produced between the inner wall of the oil tank and the external floating roof. Dihedral reflection reflects the real target scattering center in the image, whereas multiple reflections are the cause of multipath ghost images. This section mainly analyzes the relationship between the multipath ghost images inside the oil tank and the observation azimuth.
Figure 10,
Figure 11 and
Figure 12, respectively, show the propagation path of multiple reflections of electromagnetic waves inside the oil tank when observed at different azimuth angles. It can be seen from the oil tank’s SAR images that as the observation aspect changes, the position of the ghost image will change accordingly. The greater the difference in aspect, the greater the difference in position of the multipath ghost image. The structure of the oil tank is a centrally symmetrical structure about the central axis. Thus, the changing pattern of multipath ghost image position is that it rotates with the change in observation aspect. However, the position of the real target scattering center does not change with the observation aspect. Therefore, the multi-aspect characteristic differences between real scattering centers and multipath ghost images can be used to separate them.
3.2. Multi-Aspect Observation Multipath Suppression Method Based on PCA
This paper proposes to decompose real target images and multipath ghost images based on the idea of principal component analysis. PCA is a classic algorithm for principal component analysis. This section will evaluate its effectiveness in suppressing multipath ghost images in multi-aspect observations.
Figure 13 shows the schematic diagram of the multi-aspect observation multipath ghost image suppression method based on PCA. In the figure, the number of sub-images
is taken as an example;
,
,
respectively, represent the amplitude values of three sub-images, and each scatter point represents each pixel sample. The real target image pixels’ amplitude values change little with the aspect and they are distributed in the direction of the principal component vector. However, the multipath ghost image pixels’ amplitude values change greatly with the aspect and they deviate from the direction of the principal component. The point
in the image represents the pixel point that the multi-aspect sequence deviates greatly from the direction of the principal component.
The PCA decomposition process is described as follows: First, the sequence images
of different observation aspects are vectorized to form a matrix
. The size of
is
, where
and
are the image sizes. Then perform singular value decomposition on
,
where
is the diagonal matrix of singular values, and
and
are eigenvectors, respectively.
In the application scenario of this paper, the principal component direction is the feature vector
, corresponding to the maximum singular value
, and the projection value of the sequence image in the principal component direction is
. After matrix decomposition, it is divided into two parts. The first part is the orthogonal projection component of the principal component direction:
The second part is the component in the non-principal component direction:
Here is an example to illustrate. The pixel point
deviates from the stable value in the third sub-aperture image due to multipath interference, as shown in
Figure 13. According to the principle of PCA, PCA obtains the direction of the data’s maximum variance by orthogonally decomposing; that is, the direction of the principal component. After orthogonal decomposition, the amplitude value of the pixel point
is orthogonally projected to the principal component direction. The projection point is
, but the ideal value is
. Therefore, target energy loss and multipath signal residue will result from directly employing the PCA approach to orthogonally partition the data.
An example of a certain pixel’s amplitude sequence before and after PCA decomposition is shown in
Figure 14. There are ten sub-image sequences in this sample. This pixel has a large amplitude value in sub-image 5 due to the influence of multipath ghost images, assumed to be 10. There is no multipath ghost image in other sub-apertures, and the amplitude value is set to 1, as shown in
Figure 14a. The ideal value of multipath suppression is to obtain a sequence of all 1 s, as shown in
Figure 14b. Nevertheless, the sequence value obtained after PCA decomposition is displayed in
Figure 14c, and the multipath signal is not effectively suppressed. Therefore, multipath signal suppression cannot be directly addressed by the PCA method.
3.3. Multi-Angle Observation Multipath Suppression Method Based on RPCA
RPCA is also a matrix decomposition method based on the idea of principal component analysis. The biggest difference between RPCA and PCA is that RPCA uses sparse decomposition. RPCA decomposes the original data matrix
into two parts: low-rank matrix
and sparse matrix
. The model is as follows:
where
is the rank of the matrix and
is the 0 norm. The above formula must be loosened because this problem’s optimization is an NP problem. Usually, the 1 norm is used to perform convex relaxation on the 0 norm, and the matrix rank is approximated by the nuclear norm. The above problem is transformed into solving the following model.
where
represents the nuclear norm of matrix
; that is, the sum of singular values of matrix
.
is the dimension of the matrix, and
is a constant.
This paper proposes a multi-aspect multipath suppression method based on RPCA. The principle involves using the stability characteristics of the real target signal and the sparse variation characteristics exhibited by multipath ghost images from different aspects to separate them. The radar acquires a sequence of SAR images by observing the same target from various aspects. Due to the stable nature of real targets, their multi-aspect image sequence exhibits low-rank characteristics. On the other hand, the positions of multipath ghost images vary across the multi-aspect SAR image sequence, so the number of sequences with multipath interference for each pixel is sparse. The multi-aspect image sequence of multipath ghost images exhibits sparse characteristics. RPCA is employed for the purpose of conducting a low-rank and sparse decomposition of the signal. The resulting low-rank matrix represents the stable principal component, retaining information pertaining to the real target. Simultaneously, the sparse matrix represents variation deviating from the principal component, which stores the information of the multipath ghost image. By reconstructing the decomposed low-rank matrix and sparse matrix, respectively, the SAR image after multipath ghost image suppression and the multipath ghost image can be obtained, respectively.
Unlike PCA, RPCA does not separate stable principal components and changing signals through orthogonal decomposition. For points that deviate from the principal component direction, RPCA does not restore them through orthogonal mapping. RPCA decomposes the signal through regularization constraints of low rank and sparseness, which can more accurately separate the target signal and multipath ghost images. Based on this principle, when RPCA processes the pixel
signal affected by multipath interference in
Figure 14, it can accurately restore it to
.
The following example illustrates. RPCA decomposition is applied to the example shown in
Figure 14 from the preceding section, with the aim of extracting the low-rank and sparse components for a designated pixel. As shown in
Figure 15, (a) is the low-rank part of RPCA decomposition, and (b) is the sparse part after decomposition. It is evident that RPCA accurately distinguishes between stable and dynamic components of the deviated pixels when there are pixels in the matrix that deviate from the principal component direction.
The process of the multipath ghost image suppression method based on RPCA is shown in
Figure 16. The specific steps are as follows:
Step 1: Multi-aspect images are vectorized and formed into a matrix by column.
Step 2: RPCA is used to decompose the matrix, yielding a low-rank matrix and a sparse matrix .
Step 3: The low-rank matrix and the sparse matrix are, respectively, rearranged to obtain the target image sequence and the multipath image sequence.
Step 4: Average the sub-aperture image sequence to obtain the final fused image.
Step 5: Set a mask based on the sparse matrix E to remove multipath signals so that the remaining multipath signals at the corresponding positions in the low-rank matrix A can be removed.
Typically, the multipath signal energy of complex structure targets is strong and the area is large. Despite the application of RPCA processing, the low-rank matrix still retains residual multipath signals. To enhance the effectiveness of multipath suppression, this paper introduces a masking approach described in step 5 before sequence image fusion. The mask is generated based on the sparse matrix , where each ‘1’ in the mask corresponds to a ‘0’ element in E, and conversely, each ‘0’ in the mask corresponds to a non-zero element in E. This method effectively eliminates the influence of residual multipath pixels during sequence image fusion.
4. Experimental Verification
In this section, the data based on an actual airborne multi-aspect SAR observation of oil tanks are used to verify the multipath ghost image suppression effect of the method proposed in this article. The observation area is located in Zhejiang Province, China.
In the experiment, an airborne SAR system was used to observe external floating roof oil tanks. The observation geometry is the same as
Figure 1, and the experimental parameters are shown in
Table 1. The data were acquired with an observed azimuth of ±44° and a sub-aperture synthetic aperture angle of 8°. The image sequence consisted of 11 images.
PCA and RPCA decomposition techniques are employed to break down the oil tank sequence images. Stable components in the principal component direction and unstable components can be obtained.
Figure 17 and
Figure 18, respectively, show the decomposed results of three of the sub-images.
Three of the sub-images are shown in column (a) of
Figure 17, the stable principal component acquired through PCA decomposition is shown in column (b), and the unstable component obtained through PCA decomposition is shown in column (c). PCA uses orthogonal decomposition to obtain stable principal components. The components in the principal component directions of different sub-images are the same, so it can be seen that the principal component images in column (b) are the same. There are more multipath ghost images remaining, which are framed by the red arc in the figure. The unstable components in different sub-images vary with the observation aspect, as shown in column (c). PCA decomposition is inaccurate in extracting multipath signals, and unstable components will affect other stable components, resulting in target energy loss and multipath signal residue.
Figure 18 shows the results of RPCA decomposition. The parameter
is set to 1.7. Three of the sub-images are shown in column (a), and the stable low-rank images with RPCA decomposition are shown in column (b). Although the majority of the multipath ghost images are suppressed, some multipath ghost images remain because of their enormous energy and large area. Sparse images obtained by RPCA decomposition are displayed in column (c), which extract the multipath signals that vary with the observation aspect.
The final fused image is obtained by summing the decomposed sequence images, as illustrated in
Figure 19. It is evident that the image processed using the PCA method still exhibits a significant presence of multipath ghost images. This occurs because the PCA method obtains the stable principal component of the image through orthogonal decomposition. The specific method is to vertically project pixels deviating from the principal component onto the principal component direction. This approach struggles to effectively suppress multipath interference and results in the loss of target information. In contrast, the RPCA method conducts low-rank and sparse decomposition of the multi-aspect image matrix, effectively suppressing multipath ghost images while preserving the target image. Although there are still residual multipath ghost images, the suppression effect is significantly better than that of the PCA method.
Figure 19b is the non-principal component image obtained after PCA decomposition, and
Figure 19d is the sparse image obtained after RPCA decomposition. Both images represent the part of the image that deviates from the principal component; that is, the signal that varies with aspect, mainly including multipath signals, sidelobes, anisotropic signals, etc. It can be seen that
Figure 19d extracts more multipath signals than
Figure 19b, indicating that the RPCA method has a better multipath suppression effect.
Based on the analysis in the preceding section, it is evident that the sparse matrix
, acquired through RPCA decomposition, contains the information of multipath ghost images. The mask is set according to the sparse matrix
. The 1 in the mask corresponds to the 0 element in
E, and the 0 in the mask corresponds to the non-zero element in
. The sequence images obtained after masking are added. The result is shown in
Figure 20, which more effectively suppresses multipath ghost images.
In order to verify the algorithm presented in this paper, we compare it with existing sub-aperture fusion methods. The sub-aperture fusion method proposed in [
22] first adds sequence images to create a full-aperture image. Next, the sub-aperture images of different aspects are dot-multiplied with the full-aperture image and then added. The processing result of the oil tank data is shown in
Figure 21a. It is evident that the multipath ghost image was not effectively suppressed, and the information of the weak scattering area was lost. The sub-aperture double-layer fusion method proposed in [
23] adds a layer of fusion based on the original sub-aperture fusion method. This method first multiplies the sub-aperture images at different aspects with the full-aperture image to obtain the first layer fusion image. In the second layer fusion, the first layer sequence images are divided into multiple groups, and the images in different groups are correspondingly added to enhance the target image. The added images are then dot multiplied to suppress multipath ghost images. The result of processing the oil tank data with the sub-aperture double-layer fusion method is displayed in
Figure 21b. The suppression effect of multipath ghost images is better than that of the single-layer sub-aperture fusion method. However, some multipath ghost images still remain and the information loss in weak scattering areas is more serious. Generally speaking, the sub-aperture fusion method can suppress the ghost image’s energy and increase the target’s energy. This is achieved by simultaneously increasing the pixel amplitude values of the target image and decreasing the pixel amplitude values of the multipath ghost image. But it cannot accurately identify the multipath ghost image and the real target. In the application context of this article, this type of method has a certain multipath suppression effect, but there are many multipath ghost images remaining, and the energy of the weak scattering region with stable scattering is lost.
In order to quantitatively verify the performance of this algorithm, image intensity [
31] is used to evaluate this method. The approximate location of the multipath ghost image can be known from the original images, and a part of the multipath area can be selected for analysis. Taking one of the sub-images as an example, as shown in
Figure 22, the area outlined by the red frame is the selected area. The size of the selected area is 200 × 200 (azimuth × range). Correspondingly, there are
pixels in the selected area. The images are 8-bit images. Since the energy of the multipath signal is strong, the amplitude value of the multipath ghost image pixel is significantly higher than that of other pixels, and as the multipath signal is eliminated, the image intensity in the selected area will definitely decrease significantly. Then, the image intensity of the selected area can be used as an evaluation index for multipath signal suppression. The lower the image intensity in the selected area, the better the effect of suppressing multipath signals.
The image intensity is calculated as follows:
where there are
pixels in the selected area and
represents the amplitude value of the
-th pixel.
Table 2 shows the image intensity of the selected area obtained after processing oil tank data with different methods. Upon processing the image using the method proposed in this paper, the image intensity achieved is the lowest, suggesting that the multipath suppression effect of the processed image is optimal.
Experiments indicate that the RPCA method has the best suppression effect on multipath ghost images in the multipath ghost image suppression of multi-aspect oil tank images. This method performs low-rank and sparse decomposition on the matrix composed of sequence images, and it can effectively suppress multipath ghost images while retaining the target signal. The PCA method can detect multipath pixels, but it causes target energy loss and multipath suppression signals remain because of its orthogonal decomposition principle. The sub-aperture fusion method can enhance the target energy and suppress the ghost image energy, but it cannot accurately identify the multipath ghost image and the real target and may cause the target energy in the weak scattering area to be lost.