1. Introduction
The application of synthetic aperture radar (SAR) in Earth remote sensing has a history of more than 40 years and has entered into a golden age [
1]. SAR is an airborne and spaceborne remote sensing imaging sensor that uses microwaves to detect surface targets. It can be widely used in the day and at night and can perform high-resolution imaging in large areas under harsh weather conditions [
2]. Change detection is the process of determining the state changes of objects or phenomena based on multiple observations at different times [
3]. It is an important application in the field of remote sensing; SAR data are valuable for change detection, and their advantages are manifold. Unlike optical sensors, in addition to being unaffected by cloud cover and being able to measure at night, the most important factor is that the coherent imaging process of SAR sensors can obtain target signals that carry both amplitude and phase information, which brings high sensitivity to the detection of changes. Coherent change detection (CCD) is a method that uses the unique phase information in SAR images to detect changes that occur during two data acquisitions at different times in the same scene. Phase information is very sensitive to scene changes and can theoretically detect sub-wavelength changes [
4], so CCD can be used to detect small changed areas in the scene and is better for typical changed areas with low coherence values. It has broad application prospects in many fields.
The applications of the CCD method are multi-faceted. It can be used to detect natural changes, such as environmental disaster monitoring [
5], landslide detection [
6], and so on. If the image data is collected from a SAR sensor of sufficiently high resolution, the high sensitivity of the CCD enables the exploration of human activities, such as man-made traces [
7], vehicle trajectories [
8], etc., in urban planning [
9], agricultural development [
10], and other large-scale changes. The CCD also plays an important role in the detection of the installation of urban rooftop solar panels [
11].
The principle of the CCD method is similar to the traditional change detection method. The CCD method generally uses the complex-valued cross-correlation coefficient image generated between the interferometric synthetic aperture radar (InSAR) image pairs as the coherent change difference image to detect the changed areas [
12]; for the changed areas of interest to us, the common denominator is that the coherence is destroyed compared to the unchanged areas, showing low-coherence characteristics; therefore, the CCD judges the low-coherence areas in the scene (the correlation coefficient tends to 0) as the changed part and the high-coherence areas (the correlation coefficient tends to 1) as the non-changed part.
However, because the coherence information of SAR images is highly sensitive to changes, some regions with low coherence due to their individual characteristics appear in the coherence difference image during CCD processing, such as continuous flowing river regions and sea areas, which are affected by weather effects, and naturally changing areas, such as disturbed vegetation areas; at the same time, areas with low signal-to-noise ratios, such as occluded roads, also show low coherence. The low-coherence areas contain a large number of areas that we are not interested in, which become interference areas in CCD detection, resulting in a large number of false alarms. How to extract and eliminate false alarms is a challenge faced by CCD. Due to the influence of the false alarm areas, there is no clear boundary between the changed areas and the non-changed areas, and there is not enough contrast to efficiently and accurately extract the changed areas we are interested in to obtain a binary difference image.
With our increasing capability of acquiring SAR image data, the gradual improvement of image resolution, and in-depth research on CCD technology by scholars, CCD technology has gradually matured. The CCD is influenced by the estimator form, the window size, the number of images being used, the frequency with which the images are used, the polarization, and the threshold value for separating the changed areas of the disparity image; it is a technique with multiple degrees of freedom. Currently, in the estimator form, Cha et al. use an improved coherence estimator based on the equal variance of the two images in a two-step change detector that combines coherent and incoherent data [
13], while Wahl et al. proposed a complex reflection change detection estimator based on the same average reflection power of two images [
14]. Regarding the window size, Bouaraba et al. proposed a CCD method that adaptively adjusts the window size based on the local fringe frequency [
15]. Aiming at the lack of observational information preconditions of the single-dimensional CCD method, Andre et al. proposed a multi-band method in the frequency dimension [
16], Barber proposed a multi-temporal method in the time dimension, [
17], and so on. Hammer et al. improved the contrast between the low- and high-coherence areas by removing the topographic and noise phases [
8].
Automatic change detection technology is of great significance for exploring the potential of SAR image data and for maintaining the real-time nature of geospatial data [
18]. Due to the sensitivity of coherence to changes, CCD can have a better detection effect on typical changed areas with low coherence values. The problem to be solved is how to make it more prominent than the interference areas and efficiently extract the changed areas of interest. Many CCD algorithms rely on the observation information of more dimensions in the data to improve the detection performance [
16,
17]; how to automatically and quickly extract the region of interest using image processing methods for two images with only the same observation information and complicated scenes, and obtain a better detection effect, is an improvement direction worth exploring. The multi-scale analysis method is an effective method commonly used in image processing [
19]. It can extract and combine high- and low-frequency components and focus on any frequency details of the image, which can play an important role in the application of change detection. In this paper, a new CCD algorithm is proposed, which aims to distinguish the low-coherence interference regions from typical changed areas with lower coherence values in complicated image scenes to obtain better detection performance of typical changed areas. The innovation of this paper is aimed at solving the problem of the false-alarm rate being too high when using the CCD method and uses the multi-scale image processing method to automatically extract typical changed areas in the data of a single information dimension. At the same time, the method in this paper exhibits better performance than the traditional NCCD method and has a certain degree of freedom, which helps retain the capability of the CCD method to detect small change information. The algorithm consists of four parts. First, the coherence estimator under the assumption of equal variance is used to form the difference image, then the difference image is multi-scale transformed to obtain a new coherent difference image, then a noise filter is applied on the new difference image, and finally a threshold value is selected to segment the difference image after noise filtering to extract typical changed areas. Only by combining the four parts together can the contrast between the typical change areas and the interference areas be enhanced for a better detection effect.
The structure of this paper is as follows: after the introduction in
Section 1,
Section 2 presents a CCD method for extracting typical changed areas based on multi-scale analysis, and then
Section 3 presents the experimental results and evaluation analysis. This paper’s results are discussed in
Section 4, and conclusions are drawn in
Section 5.
2. CCD Method Based on Multi-Scale Analysis
This article focuses on the use of multi-scale analysis methods in coherent change detection to automatically extract typical changed areas with lower coherence values. The method in this paper performs a multi-scale analysis on the coherent change difference image calculated by an estimator under the assumption of equal variance statistics, which can combine the high- and low-frequency information corresponding to different scales according to the changed scenes in different data to obtain a coherent difference image that reduces false alarms. By means of noise filtering and threshold segmentation, the typical changed areas with high accuracy are finally extracted. Regardless of the process of image data acquisition and preprocessing, the four main steps of this method are as follows:
Step 1: Input the image before the changed A0 and the image after the changed A1 into the coherence estimator C, and obtain the coherent change difference image D0 under the condition of equal variance assumption.
Step 2: The coherent variation difference image D0 is first decomposed by stationary wavelet transform (SWT) and then independently reconstructed [
20] to obtain a series of high- and low-frequency scale images at different scales. According to the scene type, select the appropriate weights to combine the scale images to obtain a multi-scale coherent change difference image D1.
Step 3: Perform noise filtering on D1 to obtain a high-quality denoised coherent difference image.
Step 4: Perform threshold segmentation on X0, and divide the pixel values of the entire image into 1 and 0, where 1 represents a typical changed area and 0 represents a background area, and finally a binary change image X is obtained.
Figure 1 depicts the whole algorithm flow of the multi-scale CCD method based on all of the above processing steps.
2.1. Coherence Estimators
The original variation measure of CCD is the complex-valued correlation coefficient, and the classical coherence estimator is as follows [
21]:
In the estimator, x represents the pixel center point, N represents the number of pixels in the odd square window around x, i represents the i-th pixel in the observed window, A0 and A1 represent the complex-valued signal values of the image before and after the change, respectively, and * represents the complex-valued conjugate calculation. The value of C1 usually takes an absolute value, which represents the coherence estimation value of point x in the difference image.
Compared with the incoherent change detection method, the traditional coherence estimator can obtain more subtle changes and has better detection sensitivity for changes, but in the low-coherence region, it is a mixture of all of the decoherent regions. In addition to the changed areas we are interested in, some vegetation areas and low signal-to-noise ratio areas also have low coherence, resulting in a large number of false alarms, which seriously affects the detection performance. In order to solve this problem, it is necessary to improve the coherence estimator, introduce a complicated model, or add preconditions so as to distinguish the changed areas and the interference areas. Therefore, this paper uses a coherence estimator proposed in Berger [
22] to replace the traditional estimator under the assumption that the variances of the two images are equal so as to obtain better change detection performance. The estimator is as follows:
Since the two SAR images before and after the changes overlap without large-scale changes, it can be assumed that the variances are approximately the same. The meaning of the parameters in
C2 is the same as in
C1, and when changing the product in the denominator to a sum, the resulting estimation performance is more stable. In the literature, it has been proven that
C2 is better than
C1 as a change metric and has a stronger capability to distinguish changed regions; in Cha’s study [
13], the calculation proves that, when the coherence value is small, the mean square error of
C2 is better than that of
C1, the typical changed areas have a lower coherence value, and
C2 has excellent detection performance and stability when detecting such areas. In this paper, the CCD method through Berger’s CCD coherence estimator is called the BCCD method. After the calculation of
C2, the typical changed areas in the BCCD method show a lower coherence value than the false-alarm interference areas generated by the CCD method, which is too sensitive, so it is highlighted, but the false-alarm areas still appear as low-coherence areas, causing great interference with the detection results and affecting the extraction of the changed areas. Therefore, in order to explore the difference between the typical change areas and the false-alarm areas in the BCCD, a multi-scale analysis of the coherent change difference image was carried out, and the high- and low-frequency information of the image was observed, trying to draw a better distinction between the changed areas and the interference areas at a certain scale.
2.2. Multi-Scale Analysis
SAR images and their difference images have multi-scale characteristics in the observed world. At different scales, the change difference images present different details of changes, and the image features of different details are helpful for distinguishing the changed areas of interest; in complicated SAR image changing scenes, multi-scale analysis is very meaningful to improving the robustness and accuracy of detection. When performing multi-scale transform on the coherent change difference image calculated by the traditional CCD coherence estimator, since the region of interest and the interference region in the change region maintain similar low coherence values, they cannot be distinguished in the high- and low-frequency components of the difference image. When performing multi-scale transform on the coherent change difference image calculated by the BCCD coherence estimator, the typical changed areas exist in the low-frequency component due to its continuous variation and lower coherence value, while the interference low-coherence region is mostly the natural variation of rapid disturbance and noise, which exists in high frequency components. Through multi-scale analysis, a suitable scale is found in the BCCD difference image so that the main body of the typical changed areas is retained, and the low signal-to-noise ratio areas and the interference areas changed by their own characteristics are suppressed so that the BCCD has better detection performance.
Wavelet transform is one of the most commonly used multi-scale transform methods that can perform localized analysis on image signals [
23]. Stationary wavelet transform (SWT) is a transform method based on two-dimensional discrete wavelet transform (DWT), which retains redundancy at different scales and has the characteristics of translation invariance [
24]. SWT is suitable for noise elimination and modulus maximum analysis in various applications. In CCD, there are many noise areas and the maximum value is not obvious. SWT is suitable for use in CCD technology. The number of SWT scale decomposition layers N is usually 3 or 4, which can ensure that the detailed information will not be excessively lost and can reduce the detection accuracy. In CCD research, the SWT decomposition of the disparity image is performed, and its capability to automatically adapt to time and frequency takes into account the context information of the image, and it has better anti-noise performance and capability to preserve edges; most SWT methods use only low-frequency information to retain the main body, but discarding high-frequency components will lead to the loss of detailed information in the detection results, and the detection accuracy is low, so it needs to be improved. Taking three layers as an example, after the multi-scale decomposition of SWT, three layers of multi-scale difference images are obtained, and each layer contains low-frequency and horizontal, vertical, and diagonal high-frequency components corresponding to
, respectively.
Figure 2 is an exploded view of the SWT.
After SWT multi-scale decomposition, the decomposed image needs to be reconstructed with reduced noise. The general reconstruction method only uses low-frequency components, which can achieve the effect of denoising, but the loss of edge detail information is serious. Many applications of CCD involve detecting weak traces, and such changes are generally retained in high-frequency information; in addition, SWT decomposition has redundancy, and images at different scales are correlated; for example, the high-frequency information of the next layer will be included in the low-frequency information of the previous layer. In the literature [
20], an independent reconstruction method of SWT has been proposed. Taking three layers as an example, the reconstruction of the third layer in the original method only uses the low-frequency components of the third layer, and the reconstruction of the second layer is the result of independent reconstruction and the addition of all high- and low-frequency components in layer 3. The reconstruction of layer 1 is the same as that of layer 2. In this paper, the method is improved as follows. The low-frequency components of layer 2 are reconstructed using all high- and low-frequency components in layer 3 and added weights. The high-frequency information uses the same weights, and layer 1 uses all of the high-frequency components of layer 2. The reconstruction of the low-frequency components and the low-frequency components of layer 2 itself is weighted, too.
Figure 3 is an improvement of the independent reconstruction diagram of the three-layer SWT.
The selection of the weights of each component in the independent reconstruction method in this paper is closely related to the application scenario of the CCD method, and the sum of the weights of the next layer is 1. In most change-detection applications, only low-frequency information is used to extract areas of interest. Adding high-frequency components can highlight small changes and edge details. The single-layer low-frequency information reconstruction assists with highlighting the low-frequency subject information in the changed areas. In the application scenario of this paper, in order to extract typical changed areas while preserving edge details, the weights of low-frequency components and high-frequency components are the same as 0.5, and the weight of single-layer low-frequency reconstruction layer 2 is 0. In applications that detect small changes, the weight of high-frequency components can be increased. In general, the weight of single-layer low-frequency information reconstruction can be 0, and in the application of highlighting the main body of the changed areas, it can be considered to increase its weight and reduce the weight of high-frequency components. This method as a whole retains a certain degree of freedom. The purpose of SWT independent reconstruction is to make full use of multi-scale information to enhance the image to achieve the desired difference image performance in CCD applications.
SWT decomposition and independent reconstruction are performed on the coherent difference image generated by BCCD, and a new coherent difference image is obtained, which is called the SWT-BCCD method. Using appropriate weights in the method to combine different frequency detail components can achieve the effect of removing noise and interference areas so as to extract typical changed areas in complicated scenes.
2.3. Noise Filtering
Due to its sensitivity to changes, the CCD obtains better detection performance and at the same time brings a lot of false-alarm interference. After multi-scale transform, the main body of the typical changed areas in the coherent difference image are highlighted. However, in order to preserve the edge details of the prominent areas, there is some high-frequency information in the difference image, which only reduces the false alarms, and the noise still needs to be removed. A characteristic of bilateral filtering [
25] is to remove noise while preserving the edge details of the image. Because we focus on the typical changed areas, the use of bilateral filtering can remove the image noise and reduce the false-alarm interference of the image when the edge of the main body is well protected.
2.4. Threshold Segmentation
In SAR change-detection technology, the threshold-segmentation method is generally used to obtain the final binary change image. In the CCD method, the selection of the coherence threshold has a great influence on the final binary image performance. If the threshold is too high, some noise areas and interference areas will not be suppressed, and some scattered atypical changed areas will also appear in the final image; if the threshold is too low, the details of the typical changed areas will not be completely preserved and large areas will be missing. The threshold is divided into a global threshold and a local threshold in terms of calculation. Considering that the global threshold has the characteristics of fast calculation while maintaining threshold accuracy, many papers use the global threshold. Regarding the automatic global-threshold methods, the more mature ones are the OSTU [
26] method, the peak–valley method, iterative threshold selection, etc. These methods are mostly selected from the peak–valley of the histogram of the difference image and the neighborhood difference, but in many complicated scenarios, it is rare for the histogram corresponding to the coherent change difference image to have single or multiple peaks and valleys when using the CCD method. Therefore, in this paper, the average value of the maximum and minimum coherence values of the difference image is the most suitable threshold for extracting typical changed areas [
8]. After obtaining the binary image through threshold segmentation, we find the position where the pixel value is 1 in the image, which is the position that is judged as the typical changed areas. The performance of this method can be evaluated using a ground-truth image.
4. Discussion
In SAR image change detection applications, in addition to incoherent change detection based on image amplitudes, having a coherent change detection method that can use phase information is a more sensitive technique to detect invisible and undetectable areas of an amplitude image. It can play an important role in many small change scenarios and also has good detection performance in typical changed areas. The biggest challenge facing the CCD method is the large number of false alarms caused by its extremely high sensitivity. Most CCD algorithms hope to obtain more pre-information through data of different dimensions to reduce the probability of false alarms. Such data are usually difficult to obtain. Therefore, it is a good idea to optimize the CCD method using some image processing methods to mine the data in a single dimension to obtain the changed areas of interest.
The algorithm in this paper aims to use the multi-scale analysis method to separate the typical changed areas from the false-alarm areas in the coherent change difference image detected by the CCD at a certain scale. This is achieved using a coherence estimator with an equal variance assumption that is different from the traditional CCD and then combining the multi-scale characteristic images using an independently reconstructed SWT method. In order to achieve better performance, the overall image is also smoothed. Changes to the coherence estimator are the basis of the algorithm, and the equal variance assumption estimator can allow typical changed areas to have lower coherence values, which can be distinguished from interference region. After multi-scale transform, it can be clearly found that the typical changed areas are located on the low-frequency component and that the interference areas are located on the high-frequency component. They can be separated during reconstruction so as to achieve the purpose of extracting the typical changed areas in some application scenarios of CCD. At this time, due to the independent reconstruction method used in multi-scale reconstruction, the weights can be adjusted and combined, the small traces are retained, and the difference between the typical changed areas and the false-alarm interference areas have increased contrast between them. In terms of noise filtering, the algorithm in this paper chooses to filter the image as a whole under the premise of optimizing the calculation speed. In some application scenarios, the local filtering of the image can be considered. In terms of threshold selection, different from the incoherent method, the coherent change difference image obtained by the algorithm in this paper will exclude areas with only a small amount of image brightness change and will not change the classification of a large number of areas due to a small change in the threshold.
5. Conclusions
This paper introduces a multi-scale analysis-based CCD method for extracting typical changed areas. The algorithm includes a coherence estimator, multi-scale transform, noise filtering, and threshold selection. The results show that the typical changed areas after passing through the coherence estimator under the assumption of equal variance has a lower coherence value and can be separated from the interference region after multi-scale transform. After noise filtering, typical changed areas extracted by threshold segmentation have excellent detection performance parameters. By drawing the ROC curve and the kappa coefficient curve, we found that the method is effective and correct.
The BCCD estimator is the basis of the method in this paper. With the development of CCD technology, more advanced estimators gradually appear, and other estimators will be tried in future research. The size of the weight of each component in the independent reconstruction of SWT depends on the application scenario of the CCD method, which is relatively broad. To date, there have been some studies discussing the coherence values of various types of regions in the CCD method scene, and the selection of weights can be refined according to this. In terms of noise filtering, the bilateral filtering method filters the entire image, and subsequent research can consider more careful filtering methods to further remove noise while preserving the edge of the changed areas. In terms of threshold selection, many CCD methods can use the mean value of the coherence value as the threshold, but this is not absolute and it may not be effective in some CCD applications and needs to be adjusted according to specific conditions.
The method proposed in this paper has a good detection effect on typical changed areas, such as target detection, ship trajectory detection, and other applications and can efficiently extract interesting changed areas. This method can also be combined with commonly used NCCD change detection methods to improve the overall detection performance. This method also maintains a certain degree of freedom, which can maintain the high-sensitivity advantage of the CCD itself.
This paper conducts experiments on complicated scene data, and the results verify the effectiveness of the method proposed in this paper. The processed data contain rich types of changes in ground objects, which proves that the method proposed in this paper has a certain universality and is valuable for other CCD application scenarios.