1. Introduction
Due to the system’s characteristics of monitoring the Earth independently of sunlight conditions and cloud coverage, Synthetic Aperture Radar (SAR) systems have become an ideal source for change detection applications [
1]. SAR change detection enables the identification of changes from multi-temporal images acquired in the same scene. This change may represent a target that emerged or disappeared in the scene over time. This application is relevant in remote sensing, allowing, for example, monitoring environmental changes and land use/cover [
2].
Change detection methods based on wavelength-resolution SAR systems have been explored for the past two decades [
3,
4,
5]. Since the system resolution is relative to the radar signal wavelength, the main contribution to SAR image clutter (i.e., return relating to the acquisition environment), especially at low frequencies, arises from large static objects (i.e., large scatterers), which are stable over time. Thus, the measurements carried out by this system become stable in different acquisitions [
6]. This is desirable for change detection applications since it allows for obtaining images of a given area with similar characteristics, i.e., highly correlated.
Traditionally, one of the main challenges for SAR change detection involves exploring the use of SAR images acquired from nonidentical flight passes, meaning that the SAR aperture is formed based on different flight headings. For example, the radar cross-section can be totally different, as it depends on how the target reflects the radar signal, which depends on the flight pass. In addition, power lines, fences, and buildings contribute with a very strong specular reflection depending on the pass, increasing the number of false alarms [
7]. Recently, some studies have sought to use different passes in change detection, mainly exploring the stability of wavelength-resolution systems. In [
7,
8], the nonidentical passes of the SAR measurements are suggested to be combined to enhance SAR change detection performance. This combination allows for mitigating specular reflections, mainly from elongated structures in the SAR scene, and interference due to the antenna back lobe. Thus, the probability of detection has been shown to improve, whereas the false alarm rate is minimized.
In fact, the SAR change methods found in the literature usually use co-registration steps to avoid misalignments between the SAR images [
9,
10,
11]. In low-frequency SAR, like wavelength-resolution SAR, some studies combined identical flight passes to explore different flight passes [
7,
8]. Such methods explore statistical hypothesis testing in which a decision threshold must be applied, which will decide whether a pixel is related to the target or clutter. It is very difficult for an approach like this to differentiate whether detection is associated with a true target or some reflection related to using nonidentical flight passes.
This paper shows that the identical pass constraint can be relaxed for wavelength-resolution SAR change detection based on the robust principal component analysis (RPCA) [
12]. RPCA is a blind signal separation technique recently introduced for change detection [
13], in which the input data are decomposed into low-rank and sparse components. Generally, since the target tends to move over time, the sparse component will detect this object and other sparse objects, such as power lines, related to nonidentical flight passes. In other words, RPCA detects both targets and reflections related to flight passes, which can be disregarded from the false alarm count because they usually present a characteristic behavior in the SAR image (elongated structures), thus improving the method’s performance. In addition, using more reference SAR images with such reflections related to the flight passes will make this content appear in the low-rank component, i.e., becoming something related to the clutter, which would be the ideal scenario since those structures are not the targets of interest for the application.
It is important to note that this study does not aim to propose a new change detection method based on RPCA. Instead, it aims to show another potential in low-frequency SAR that has not been demonstrated before: exploring different flight passes in a wavelength-resolution SAR change detection method based on RPCA. This study is based on the fact that the RPCA is a matrix solution that looks at the data matrix as a whole and can then detect changes related to targets and associated with using different flight passes. At the same time, reference wavelength-resolution SAR change detection methods are usually based on testing statistics, such as amplitude ratio and generalized likelihood ratio tests [
4,
7,
8], which are based on a pair of images using the one-look data statistics and are not able to perform change detection on nonidentical flight pass since the statistics is totally different when the pass changes.
We evaluate the surveillance and reference images in three scenarios: SAR images obtained from identical, slightly different, and totally different passes. Slightly different means a difference of 5° between the pass of the surveillance image and reference images, while totally different means a difference of 90° or 95°. We consider the dataset formed by 24 coregistered SAR images from the wavelength-resolution CARABAS II SAR system [
3].
This article is organized as follows.
Section 2 presents the classical formulation of RPCA and the recently proposed change detection methods based on RPCA.
Section 2.3 presents the CARABAS data with identical and nonidentical passes. Then,
Section 3 shows and evaluates detection results in terms of probability of detection and false alarm rate, considering different arrangements for the data. A discussion about the results obtained is presented in
Section 4.
Section 5 summarizes the conclusions of the paper.
3. Experimental Results
Here, we present an experiment to perform change detection on CARABAS data based on RPCA. The framework of the experiment is presented in
Figure 3. The change detection approach is based on identifying targets in a surveillance image by analyzing the respective sparse content, denoted as
. For that, we consider reference SAR images from identical, slightly different, and totally different passes.
Each surveillance SAR image is evaluated based on the probability of detection (PD) and false alarm rate (FAR) [
7,
8]. PD is obtained from the ratio between the number of detected targets and the known 25 military vehicles on the scene. Any detection not related to the targets is considered a false alarm (FA), and then the FAR is calculated by the ratio between FA and the area of the scene, i.e.,
.
PD and FAR values are obtained by considering different amounts of information in
. Hence, it is important to range the
value. In [
13,
24], the results show that the best performance in terms of PD and FAR on CARABAS data is obtained when
varies between 7 and 10 times the reference
value [
12]. The
value on the CARABAS data is given by
. In our study, we range this value from 1 up to 13 times with a step size of 1. The work in [
26] is considered as the reference for the implementation of the RPCA, and then the following parameters are used:
, and
. Those values are related to the ADMM optimization method that solves RPCA and will mainly define the convergence rate of the technique. More details on how to define such values can be seen in [
22,
23].
Similar to other wavelength-resolution change detection methods [
3], we consider morphological operations of opening and dilation based on the spatial resolution of the CARABAS data. From that, removing objects smaller than the system’s spatial resolution and connecting local changes separated by less than the practical spatial resolution is possible.
3.1. Identical Passes
Initially, we evaluate change detection performance using images from the same pass (
).
Table 2 shows the results obtained in terms of PD and FAR for
. Note that when a SAR image is used for surveillance, the remaining seven images are considered reference images in the stack. In this particular setting, we obtain a PD of 96.5% and FAR = 0.250
when considering surveillance images from 225°. Considering the average of the three flight tracks, the method reaches a PD of 95.33% for a FAR of 0.451
. The result obtained is superior to the reference method proposed in the challenge problem [
3] and competitive to the ones presented in [
24]. However, the method in [
24] is considered a rule to eliminate false alarms, which is not used in this study. Finally, we can observe that a single surveillance image with a low detection probability can significantly influence performance. For example, Image 4 of the stack with surveillance images from 230° detects only 15 targets and 7 false alarms, which accounts for almost 50% of the total 15 false alarms.
Figure 4 shows receiver operating characteristic (ROC) curves in terms of PD and FAR. The curves are obtained by varying the
value, and each PD and FAR value in the ROC curve represents an average value of the eight surveillance images as presented in
Table 2. For a PD of about 90%, it is possible to obtain a FAR = 0.104
when using images from 230° and FAR = 0.354
when using images from 135°. Finally, in all cases using identical passes, obtaining a PD of at least 95% for a FAR of 1
is excellent performance for change detection.
3.2. Slightly Different Passes
The second analysis uses reference images from slightly different passes (
).
Figure 5 shows the results obtained using surveillance images from 225° and 230° through ROC curves and compares them with those obtained with identical passes. Note that we are evaluating the same eight surveillance images as in the analysis of identical passes, changing only the reference images: seven reference images from the same pass and eight reference images from slightly different passes for identical and slightly different passes, respectively.
As expected, the best performance is obtained using identical passes. However, we achieve outstanding performance even when using slightly different passes. For example, a PD of 97.5% and FAR = 0.917 is obtained when using surveillance images from 225° and reference images from 230°. In addition, the results show that 1.187 is obtained with 92.5% of PD when using surveillance images from 230° and reference images from 225°. This study demonstrates that small variations in flight passes can still be accepted for change detection, reinforcing the stability of wavelength-resolution SAR systems and their efficacy.
If we compare the results using the surveillance image from 225° and reference images from 230° (i.e., yellow curve) to results using SAR images from an identical pass from the 230° (i.e., green curve), we can observe that for a FAR of approximately 1 , a better PD is reached using the approach based on slightly different passes. These results show that better performance can still be obtained considering the slightly different passes, depending on the surveillance SAR images considered.
3.3. Totally Different Passes
This section presents the change detection performance in scenarios where reference images are acquired with totally different passes (
). The flight pass is changed up to 95°.
Figure 6 shows the detection results considering the four possible arrangements of totally different passes using CARABAS data for
(i.e.,
). Targets can be detected very well due to the high degree of correlation between the wavelength-resolution SAR data, reaching a PD of 96% in specific cases (
Figure 6c,d). Furthermore, a reduction in
can allow better performance in terms of PD.
However, there is a significant increase in the occurrence of false alarms, mainly related to elongated structures that are sensitive to the flight pass. These elongated structures are presented in
Figure 6 and are detected due to their sparse nature in the input matrix. Using reference images acquired with a closer flight pass to the surveillance image (e.g., identical and slightly different passes) will ensure that these structures are not sparse and, therefore, will not be represented in the sparse content of the surveillance image.
Figure 7 presents change detection performance in terms of ROC curves using reference images from totally different passes and compares them with those with identical passes. The results show that change detection is feasible even using totally different passes in wavelength-resolution SAR systems. For cases with surveillance images of 225° and 230°, a degradation in PD of approximately 23% is observed compared to change detection using identical passes. For example, for a FAR of approximately 2
, there is a decrease in the PD from 99.0% to 77.0% and from 96.0% to 73.5% for surveillance images of 225° and 230°, respectively. An even more significant degradation of approximately 53% is found when surveillance images from 135° are used. However, remember that false alarms are mainly related to elongated man-made structures that present a pattern in the sparse SAR image (see mainly
Figure 1a). It could easily be classified by the system operator as content that is not, in fact, a target and then disregarded from the analysis. In this way, the effectiveness of wavelength-resolution SAR systems in change detection is shown even in worst-case scenarios, i.e., when the surveillance image is acquired with a pass totally different from the reference.
4. Discussion
Our study mainly shows that blind signal separation techniques, in this case RPCA, are robust enough to allow the use of SAR images from different flight passes in a change detection method. In traditional change detection methods, the use of SAR images obtained with identical flight passes is a requirement. Such methods are not robust enough to work with SAR images from different flight passes. In addition, it is very difficult to guarantee exactly identical flight paths between measurements.
To evaluate the performance of the change detection method based on RPCA, we consider three different scenarios, one with reference images identical to the surveillance image, another one with reference images slightly different from the surveillance image, and the last one where the surveillance image is obtained with a flight pass totally different from the flight pass of the reference images. Comparing the scenarios, the results show that the use of identical images guarantees better performance in terms of PD and FAR. For the case where the reference images are slightly different, it is still possible to obtain a FAR lower than one false alarm per square kilometer for a PD greater than 90%. When working with a totally different flight pass of around 90°, there is a loss in performance. As shown in the figures, this loss is not associated with false alarms from forest backscatter but rather with false alarms related to elongated structures sensitive to flight pass.
The performance assessment of this paper is strictly based on the characteristics of the low-frequency SAR system (e.g., stability between measurements and SAR images non-affected by speckle noise and stripmap mode). Different systems operating at other frequencies such as TerraSAR-X and Sentinel-1 certainly face challenges that prevent using different flight passes in the change detection method. In future work, we aim to explore the challenges from other sensors to verify the method generalizability. In addition, RPCA can be used jointly with other post-detection approaches that allow differentiating false alarms related to forest backscatter from false alarms related to changes in flight pass. Finally, other blind signal separation techniques can be applied, aiming at better performance.
5. Conclusions
The restricted requirement about identical passes for SAR change detection can be relaxed for change detection with wavelength-resolution SAR. The experiments on CARABAS data show that change detection with nonidentical passes is feasible with wavelength-resolution SAR. For slightly different passes, e.g., with the flight pass of 225° and 230°, the detection probabilities are above 90% with a false alarm rate of 1 false alarm per square kilometer. Such change detection performance can be considered to be very good. Compared with the change detection performance using identical passes, the degradation in detection probability is less than 5%. In the case where the totally different passes are considered for change detection, the degradation in PD is about 23% for surveillance images with flight passes of 225° and 230° and 53% for surveillance images with flight passes of 135°. This degradation is mainly related to elongated structures sensitive to the flight path, such as transmission lines and fences. Using reference images acquired with a closer flight pass to the surveillance image (e.g., identical and slightly different passes) will ensure that these structures are not sparse and, therefore, will not be represented in the sparse content of the surveillance image. Despite a decrease in PD and an increase in false alarms, our studies show that it is possible to perform change detection using images from different flight passes, given that the forest backscatter in wavelength-resolution SAR is similar even with a 95° change in the flight pass.