Next Article in Journal
Real-Time Thermal Modulation of High Bandwidth MOX Gas Sensors for Mobile Robot Applications
Next Article in Special Issue
Interferometric SAR Phase Denoising Using Proximity-Based K-SVD Technique
Previous Article in Journal
Design and Manufacturing of a Disposable, Cyclo-Olefin Copolymer, Microfluidic Device for a Biosensor
Previous Article in Special Issue
Imaging for Small UAV-Borne FMCW SAR
 
 
Erratum published on 20 May 2019, see Sensors 2019, 19(10), 2314.
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Change Detection in SAR Images Based on the ROF Model Semi-Implicit Denoising Method

1
College of Information Science and Engineering, Xinjiang University, Urumuqi 830046, China
2
Institute of Image Processing and Pattern Recognition, Shanghai Jiao Tong University, Shanghai 200240, China
3
Knowledge Engineering and Discovery Research Institute, Auckland University of Technology, Auckland 1020, New Zealand
*
Author to whom correspondence should be addressed.
Sensors 2019, 19(5), 1179; https://doi.org/10.3390/s19051179
Submission received: 18 February 2019 / Revised: 25 February 2019 / Accepted: 1 March 2019 / Published: 7 March 2019

Abstract

:
The explicit solution of the traditional ROF model in image denoising has the disadvantages of unstable results and requiring many iterations. To solve the problem, a new method, ROF model semi-implicit denoising, is proposed in this paper and applied to change detections of synthetic aperture radar (SAR) images. All remote sensing images used in this article have been calibrated by ENVI software. First, the ROF model semi-implicit denoising method is used to denoise the remote sensing images. Second, for the denoised images, difference images are obtained by the logarithmic ratio and mean ratio methods. The final difference image is obtained by principal component analysis fusion (PCA fusion) of the two difference images. Finally, the final difference image is clustered by fuzzy local information C-means clustering (FLICM) to obtain the change regions. The research results show that the proposed method has high detection accuracy and time operation efficiency.

1. Introduction

Change detection of remote sensing images quantitatively analyzes image information at different times in the same area, so as to obtain the change information of the coverage area [1]. Synthetic aperture radar (SAR) is an active remote sensing technology that can collect ground information at any time and under any conditions [2,3]. Remote sensing image change detection technology can assist in updating geographic data, assessing disasters, predicting disaster development trends, and monitoring land use. The processing steps of change detection mainly include image preprocessing, generation of the difference image, detection of the change information, and evaluation of the detection result [4]. However, in SAR imaging processing, the coherent interaction between elementary scatterers on the ground and the electromagnetic waves leads to a multiplicative noise, known as speckle, affecting the SAR images. The interference noise will inevitably be introduced into a SAR image and affect change detection in SAR images [5].
In order to obtain more accurate details of the change, an image preprocessing stage is needed to reduce the noise in the SAR image. There are many methods for image space domain denoising, such as mean filtering [6], median filtering [7], Wiener filtering [8], and Lee filtering [9] methods. Furthermore, image transformation domain denoising methods include the Fourier transform [10], wavelet transform [11], and non-subsampled contourlet transform (NSCT) [12] methods. For change detection in SAR images, an image change detection algorithm based on wavelet fusion of ratio images was proposed in [13], which introduced wavelet domain decomposition into remote sensing image change detection. However, the wavelet transform can only be decomposed in three directions: horizontal, vertical, and diagonal. This means that translational invariance and multi-orientations are not considered, which will cause an image offset error, reducing change detection accuracy. NSCT has good directional selectivity and translational invariance and can effectively improve detection accuracy. Unsupervised detection of different SAR images based on an improved NSCT domain image fusion algorithm was proposed in [14]. The efficiency of the algorithm was greatly improved, but in terms of the details, NSCT had problems with retention. There was still a high amount of noise in the detection results, and the detection accuracy is low.
In recent years, emerging mathematical methods for denoising have received more attention from many scholars. The total variation (TV) model, namely the ROF model, was proposed in [15], and it can effectively reduce noise and preserve the characteristics of the details. An image denoising method based on the ROF model, using the convergence of a central difference discretization, was proposed in [16]. A semi-implicit image denoising algorithm based on the matrix format of the ROF model was proposed in [17]. An image denoising method based on the ROF model using a wavelet transform was proposed in [18]. An improved TV-ROF denoising model based on split Bregman iteration was proposed in [19]. A SAR image change detection method based on an adaptive total variation image denoising algorithm was proposed in [20]. However, the explicit solution of the traditional ROF model in the image denoising process has the disadvantages of unstable solution results and requiring many iterations [21]. To improve the solution of the traditional ROF model, a semi-implicit method is proposed in this paper and applied to the change detection of SAR images.
Based on the above analysis, in this paper a novel change detection algorithm is proposed to improve the image change detection accuracy. In order to obtain more information about the changed region, after semi-implicit denoising with the ROF model for SAR images, this paper combines the advantages of the log ratio method and the mean ratio method to obtain the difference images comprising the change information. Furthermore, this paper uses PCA (principal component analysis) fusion to preserve the characteristics of the significant information in the image and to obtain the final difference image. The fuzzy local information C-means clustering algorithm (FLICM) clusters the final difference image to obtain the changed regions.

2. The Proposed Algorithm

Consider two co-registered intensity images T1 and T2, acquired of the same scene at different times, whose sizes are M × N pixels. In order to determine the changed area of the scene over the elapsed time, a novel change detection method is proposed in this paper. The algorithm steps are as follows:
  • use the ROF model semi-implicit denoising method to denoise SAR images T1 and T2;
  • following denoising, obtain the difference images by the logarithmic ratio and mean ratio methods;
  • using the PCA method, fuse the log ratio and mean ratio difference images to obtain the final difference image; and
  • cluster the final difference image by fuzzy local information C-means clustering (FLICM) in order to obtain the change regions.
The flow chart of the proposed algorithm for change detection is shown in Figure 1.

3. Algorithm Introduction

3.1. ROF Model Semi-Implicit Denoising

The traditional display ROF model has disadvantages; the results are unstable and require a large number of iterations [22]. Therefore, a semi-implicit discrete iterative solution method is proposed in this paper, with the following steps:
  • establishment of the ROF model; and
  • numerical discretization of the ROF model.

3.1.1. Establishment of the ROF Model

Using the partial differential equation (PDE) for image denoising, a continuous function of slices can be used to approximate the real signal in the image with the edge of the image as the boundary, and the noise in the image is suppressed. Since the approximation is performed over the entire region of the image, it will not cause blurring of the edges of the image. The ROF model is a partial differential equation model based on the total variational method. Total variational image denoising constructs an energy function for the image. Afterward, using the principle that the energy function of the noisy image is larger than that of the original image, the denoised image is obtained by minimizing the energy function.
The traditional variational method uses modern numerical algebra to solve linear equations by introducing least squares fitting, but the effect is not satisfactory. Rudin, Osher, and Fatemi propose a new nonlinear total variation method [15], shown in Equation (1). Then, by solving for the extremum of the energy function, Equation (2), with the variational method, the corresponding Euler-Lagrange equation is obtained, as shown in Equation (3):
m i n i m i z e Ω u x 2 + u y 2 d x d y
E ( g ) = λ 2 Ω ( f u ) 2 d x d y + Ω ρ ( u x 2 + u y 2 ) d x d y
0 = x ( u x u x 2 + u y 2 ) + y ( u y u x 2 + u y 2 ) λ 1 λ 2 ( f u ) , i n Ω
where λ is the scale parameter which controls the similarities between the denoised and the original images, Ω is the image area, u represents a noisy image, f indicates the original image without noise, ρ is called the regularized parameter function, which is an incremental function of the gradient and satisfies ρ 0 . In Equation (2), λ 2 Ω ( f u ) 2 d x d y is used to restrict the approximation between the noisy image and the original image, while Ω ρ ( u x 2 + u y 2 ) d x d y is used to restrict the smoothness of the image.
PDE denoising uses a piecewise continuous function to approximate the real signal and suppress the noise in the image. PDE denoising is a process of image evolution over time. The time parameter t is introduced as the evolution parameter to solve the parabolic equation. That is, the gradient descent method is used to solve the following evolution equation. The time parameter t is introduced to conveniently represent the denoising process of a noisy image, which can convert Equation (3) into Equation (4). The constraint conditions that satisfy the ROF model are given by Equations (5) and (6):
u t = x ( u x u x 2 + u y 2 ) + y ( u y u x 2 + u y 2 ) λ ( f u ) , t > 0
u ( x , y , 0 ) = f ( x , y )
u n = 0 , o n Ω
When the constraints in Equations (5) and (6) are satisfied, the parameter λ t can be obtained from Equations (4) as shown in
λ t = 1 2 σ 2 [ u x 2 + u y 2 ( f x u x u x 2 + u y 2 + f y u y u x 2 + u y 2 ) ] d x d y

3.1.2. Numerical Discretization of the ROF Model

The purpose of the numerical discretization of the ROF model is to optimize the solution of the equation. In time, we adopt a preceding difference scheme, and in space, we use the semi-implicit solution method. The semi-implicit solution method introduces the method of additive operator splitting to numerically discretize the ROF model [23]. The two-dimensional image is computed in the direction of two coordinate axes, and the problem is then transformed into a sum of two one-dimensional problems. The convergence speed is increased by parallel computing.
For images T1 and T2, whose size are M × N pixels, where i = 0 , 1 , , N , j = 0 , 1 , , M , let the positions be x i = i h , y i = j h , N h = 1 . Furthermore, the partial derivatives in the spatial directions are defined as Δ ± x = ± ( u i ± 1 , j u i , j ) and Δ ± y = ± ( u i , j ± 1 u i , j ) . Let u n + 1 = u ( x i + 1 , y j + 1 , t n + 1 ) be the n + 1 th iteration result and u n = u ( x i , y j , t n ) be the n th iteration result, where t n = n Δ t . The image boundary conditions are set to u i 0 j n = u i N n = u i , M 1 n = u i , N 1 n , u M j n = u M 1 j n , u N j n = u N 1 j n , and u i j 0 = u 0 ( x i , y j ) + σ φ ( x i , y j ) . With these definitions, Equation (4) is numerically approximated by Equation (8):
u i j n + 1 = u i j n + Δ t h [ Δ x ( Δ + x u i j n ( Δ + x u i j n ) 2 + ( m i n m o d ( Δ + y u i j n , Δ y u i j n ) ) 2 ) + Δ y ( Δ + y u i j n ( Δ + y u i j n ) 2 + ( m i n m o d ( Δ + x u i j n , Δ x u i j n ) ) 2 ] Δ t λ n ( u i j n u 0 ( x i , y j ) ) = u i j n + Δ t h [ 1 P i j n u i + 1 , j n ( 1 P i j n + 1 P i 1 , j n ) u i j n ) + 1 P i 1 , j n u i 1 , j n + 1 Q i j n u i , j + 1 n ( 1 Q i j n + 1 Q i , j 1 n ) u i , j n ) + 1 Q i , j 1 n u i , j 1 n ] Δ t λ n ( u i j n u 0 ( x i , y j ) ) ]
λ n = 1 2 σ 2 [ i , j ( Δ + x u i j n ) 2 + ( Δ + y u i j n ) 2 ( Δ + x u i j 0 ) ( Δ + x u i j n ) ( Δ + x u i j n ) 2 + ( Δ + y u i j n ) 2 ( Δ + y u i j 0 ) ( Δ + y u i j n ) ( Δ + x u i j n ) 2 + ( Δ + y u i j n ) 2 ]
where   { P i , j n = ( Δ + x u i j n ) 2 + ( m i n m o d ( Δ + y u i j n , Δ y u i j n ) ) 2 P i 1 , j n = ( Δ + x u i j n ) 2 + ( m i n m o d ( Δ + y u i 1 , j n , Δ y u i 1 , j n ) ) 2 Q i , j n = ( Δ + y u i j n ) 2 + ( m i n m o d ( Δ + x u i j n , Δ x u i j n ) ) 2 Q i , j 1 n = ( Δ + y u i , j 1 n ) 2 + ( m i n m o d ( Δ + x u i , j 1 n , Δ x u i , j 1 n ) ) 2
Equation (8) is semi-implicit and is expressed in matrix format as
u n + 1 = 1 2 l [ I 2 Δ t h H ( u n ) l ] 1 u n Δ t λ n ( f u n )
where I is the identity matrix, and H = [ a i j ] is an M × N matrix. H ( u n ) x is the coefficient matrix obtained by differentiating with respect to x , and H ( u n ) y is the coefficient matrix obtained by differentiating with respect to y , which have the following components:
a i j ( u n ) x = { 1 P i , j n , j = i + 1 1 P i 1 , j n , j = i 1 ( 1 P i , j n + 1 R i 1 , j n ) , j = i 0 , e l s e   and   a i j ( u n ) y = { 1 Q i , j n , j = i + 1 1 Q i 1 , j n , j = i 1 ( 1 Q i , j n + 1 Q i 1 , j n ) , j = i 0 , e l s e
It can be seen that a i j ( u n ) x and a i j ( u n ) y are diagonally dominant tridiagonal matrices [24], and the solution of Equation (11) can be realized in the X-axis and Y-axis directions simultaneously with parallel processing, to reduce the time needed for the image denoising processing.

3.2. Generation of the Difference Images

The ways to generate a difference image include the difference and ratio methods, which involve subtracting and dividing the corresponding pixels in the two images, respectively [25]. The difference and ratio methods are simple to calculate but sensitive to noise in the images, which reduces the accuracy of the detected changes. The difference image constructed by the logarithmic ratio method can enhance the contrast of the changed region by nonlinear stretching on a logarithmic scale, while the unchanged region of the difference image is smoother, which is beneficial for classification [26]. The mean ratio method can effectively enhance the borders of the changed area and small regions of change in the images, and can also prevent the loss of change information [27]. The difference image constructed by the mean ratio method depends only on the relative change in image intensity. It can truly reflect changes in the images and retain more details.
In addition, a single difference image cannot fully represent the difference information. In order to obtain more information about the change regions, this paper combines the advantages of the log ratio and mean ratio methods to obtain difference images containing the change information. The log ratio and the mean ratio difference images are obtained by using Equations (13) and (14), respectively, for images A 1 and B 1 :
d s 1 ( i , j ) = | log 2 ( A 1 ( i , j ) + 1 ) ( B 1 ( i , j ) + 1 ) |
d s 2 ( i , j ) = 1 min ( u 1 ( i , j ) u 2 ( i , j ) , u 2 ( i , j ) u 1 ( i , j ) )
where u 1 ( i , j ) and u 2 ( i , j ) represent the mean value of pixel ( i , j ) in images A 1 and B 1 , respectively.

3.3. Principal Component Analysis Fusion (PCA Fusion)

Principal component analysis (PCA) was first proposed by Karhunen and Loeve, and is also called the K-L transform in mathematics [28]. It is a multi-dimensional orthogonal linear transformation based on statistical properties. The PCA fusion method is mainly based on K-L transformation of the two difference maps and re-projection onto the original coordinate system, so as to transform the gray-scale features of the original image into new features. Finally, the optimized features are used for change detection. The projected features are irrelevant, which suppresses the noise caused by the internal correlations of the image and compresses the original large amount of information into several feature directions. Quantitatively, components of the changed areas are enhanced, components of the non-changed areas are suppressed, and the separability of the changed and the non-changed areas is increased.
In this paper, PCA can be used to preserve the significant information in the image, by applying it to the logarithmic ratio and mean ratio difference images after denoising, and constructing the covariance matrix of the difference image. The eigenvalues and eigenvectors of the covariance matrix are solved, thereby determining the weight coefficients and the final fused image in the difference graph fusion algorithm.
The steps of PCA fusion are as follows:
  • For N images to be fused, treat each image as a one-dimensional vector x k , k = 1 , 2 , , N . Construct a data matrix X from the N images to be fused:
    X = ( x 1 , x 2 , , x N ) T
  • Solve for the covariance matrix C o v of X :
    C o v = ( σ 11 σ 1 j σ 1 N σ i 1 σ i j σ i N σ N 1 σ N j σ N N )
    where σ i j 2 is the variance X , and x i ¯ is the average of the ith vector, that is, the average gray value of the ith image.
  • Solve for the eigenvalues λ 1 , λ 2 , , λ N of the covariance matrix C o v and the corresponding eigenvectors u 1 , u 2 , , u N . Here, λ 1 > λ 2 > > λ N and the newly obtained feature vectors Y = ( y 1 , y 2 , , y N ) T satisfy Y = U T X , where U = ( u 1 , u 2 , , u N ) T , and C y = d i a g { u 1 , u 2 , , u N } . At this time, y 1 , y 2 , , y N are the 1 , 2 , , n principal components, and y 1 has the largest variance, which contains a large amount of important information about the difference graph.
  • Determine the weight coefficient ω i :
    ω i = λ i i = 1 N λ i
  • Find the final fusion image F :
    F = i = 1 N ω i S i

3.4. Fuzzy Local Information C-Means Clustering (FLICM)

A fuzzy local information C-means clustering algorithm (FLICM) was proposed in [29], and the objective function of the traditional FCM algorithm was modified in [30]. The FLICM uses the optimization criterion function J m to calculate the membership of each sample point to the class center. The fuzzy factor G k i is introduced, and the trade-off between image detail information and image noise is done automatically. The neighborhood pixels in the local window have a very flexible effect on the center pixel. The local spatial information is mainly represented by the spatial Euclidean distance between the neighboring pixels and the central pixel. This property can enable the fuzzy factor G k i to better reflect the damping degree of the neighborhood information. This feature can balance the classification tendency of each pixel in the neighborhood window and enhance the robustness of the FLICM algorithm in the presence of noise. The FLICM clustering algorithm uses the optimization criterion function J m shown in Equation (19), and the fuzzy factor G k i shown in Equation (20):
J m = i = 1 N k = 1 C [ μ k i n χ i v k 2 + G k i ]
G k i = j = N i 1 d i j + 1 ( 1 μ k j ) n χ j v k 2
where χ i is the local window center pixel; χ j is a neighboring pixel near the center pixel i of the local window; d i j is the spatial Euclidean distance of pixel i and neighboring pixel j; v k is the cluster center of class k; μ k j is the membership of the jth pixel χ j to the kth class; μ k i is a fuzzy membership matrix. v k and μ k i are as defined in Equations (21) and (22):
v k = i = 1 N μ k i n χ i i = 1 N μ k i n
μ k i = 1 j = 1 C ( χ i v k 2 + G k i χ i v k 2 + G j i ) ( 1 n 1 )

4. Experimental Study

In order to verify the effectiveness and to illustrate the practicality of the proposed method, we selected three sets of SAR images, which are well known and often used for comparison.

4.1. Description of the Experimental Data

(1) The Bern Dataset
The Bern dataset (Figure 2) is composed of two SAR images from the Bern region of the Swiss capital, acquired by the ERS-2 remote sensing satellite in April 1999 and May 1999. These images have sizes of 301 × 301 pixels, and gray values in the range of 1–256. Figure 2c is a change reference image.
(2) The Coastline Dataset
The Coastline dataset is composed of images of the Yellow River coastline, acquired by the Radarsat-2 remote sensing satellite in June 2008 and June 2009 (Figure 3). These images have sizes of 175 × 147 pixels, and gray values in the range 1–256. Figure 3c is a change reference image.
(3) The Yellow River Dataset
The Yellow River dataset is composed of images of the Yellow River estuary, acquired by the Radarsat-2 remote sensing satellite in June 2008 and June 2009 (Figure 4). These images have sizes of 356 × 233 pixels, and gray values in the range 1–256. Figure 4c is a change reference image.

4.2. Experimental Parameters

In the semi-implicit denoising process of the ROF model, the parameters of the algorithm design are the scale parameter λ, the number of iterations N, and the window size ω. The scale parameter λ is mainly used to control the level of denoising. If the image contains a significant level of noise, λ should be a smaller value, while if the image contains a lower level of noise, then λ should be a larger value [31]. On the other hand, N is a very difficult value to determine. If the number of iterations is set too small, the denoising will be insufficient. If the number of iterations is set too large, not only will the denoising time be increased, but the details will also be lost. At the same time, the size of filtering window directly affects the effect of SAR image filtering. The effect of filtering is poor when the window is too small, and the running time of the algorithm is increased when the window size is too large.
(1) The Scale Parameter λ
First, the influence of the scale parameter λ will be assessed, based on the percentage of correct classifications (PCC), the kappa coefficient (K), and the change detection time (T) for the change detection results [32]. Other employed objective quantitative indexes include the number of false negatives (FN), the number of false positives (FP), and the overall error (OE), which is the sum of FN and FP. A higher PCC represents a better change detection performance. K is an objective index that is usually used to measure the similarity between the change detection result and the reference image. The ideal value is one, which means the change detection result and the reference image are in complete agreement [33].
For the Bern SAR images, we fixed the number of iterations to N = 2; for the Coastline SAR images, we fixed the number of iterations to N = 4; for the Yellow River SAR images, we fixed the number of iterations to N = 12. The relationship between the scale parameter λ for the three datasets and the objective evaluation indexes are shown in Figure 5. It can be seen that, for the Bern SAR images, λ has little effect on the PCC and K; for the Coastline and the Yellow River SAR images, for small values of λ, PCC and K are similar. Therefore, in order to balance the values of PCC, K, and T, λ is set to 0.4 for the Bern SAR image and to 0.01 for the Coastline and Yellow River SAR images.
(2) The Number of Iterations N
The objective evaluation indexes of each dataset as a function of the number of iterations N is shown in Figure 6. It can be seen from Figure 6 that, for the Bern SAR images, if 0 < N < 8, the corresponding PCC and K are large, while for the Coastline and Yellow River SAR images, the value of N has little effect on the objective indexes PCC and K. The influence of N on T is shown in Figure 6, and the larger the value of N, the longer the processing time. Therefore, in order to balance the values of PCC, K, and T, for the Bern SAR images, we fixed N = 2; for the Coastline SAR images, we fixed N = 42; for the Yellow River SAR images, we fixed N = 12.
(3) The Window Size ω
For the fuzzy local information C-means clustering algorithm (FLICM), we next verified the influence of the window size ω on the objective indexes PCC, K, and T for the detection results. The relationships between the window size ω of each dataset and the objective evaluation indexes are shown in Figure 7. It can be seen that, for the Bern, Coastline, and Yellow River data, the corresponding PCC and K are greatly improved for the window ω = 3 × 3, and the detection run time T(s) is reduced. In order to balance the relationship between the size of the window ω and PCC, K, and T, the selected window size for the algorithm was fixed at ω = 3 × 3.

4.3. Experimental Results and Analysis

In order to evaluate the effectiveness of the proposed algorithm, denoted (f) in the following, it was compared with algorithms (a) LEE-FLICM [9], (b) DWT2-FLICM [34], (c) NSCT-FLICM [14], (d) TV-KMEANS [20], and (e) N-FLICM. Among them, we applied the Lee-med filter in algorithm (a) LEE-FLICM instead of the proposed denoising method. On the basis of the proposed algorithm (f), the semi-implicit denoising step of the ROF model was removed in the contrast algorithm (e) N-FLICM. The purpose is to prove that the proposed algorithm (f) can reduce noise and improve the performance of change detection. The paper analyzes both subjective and objective evaluations of the algorithm performance, and its universal applicability.
(1) Subjective Evaluation of Algorithm Performance
The subjective evaluation of the performance of the algorithm is performed by visually analyzing the texture details and noise residuals in the test results shown in Figure 8, Figure 9 and Figure 10. It can be seen from Figure 8, Figure 9 and Figure 10 that, although algorithm (a) LEE-FLICM reduces noise, significant details are lost, and the real change area is not well reflected; algorithm (b) DWT2-FLICM has more missed and false detections, and the change region is not accurately reflected; for algorithms (c) NSCT-FLICM and (d) TV-KMEANS, the change detection image retains the details of the change better, but there is still noise; algorithm (e) N-FLICM contains a high amount of noise and the image details are missing. In all, the proposed algorithm (f) of this paper results in less noise and more details being retained.
(2) Objective Evaluation of Algorithm Performance
In this paper, six objective indicators of change detection are assessed, which are FP, FN, OE, PCC, K and T. The data analysis of the test results is shown in Table 1.
Among the six objective indicators in Table 1, it can be concluded that compared with the algorithm (a) LEE-FLICM, algorithm (b) DWT2-FLICM, algorithm (c) NSCT-FLICM, algorithm (d) TV + Kmeans and algorithm (e) N-FLICM, the algorithm (f) reduces the OE of detection based on the number of FN and FP, which makes the PCC and Kappa coefficient improved; the algorithm not only improves the detection accuracy of the change region in the process of change detection, but also reduces the change detection time, while balancing the detection accuracy and change detection time.
(3) Universal Applicability of the Algorithm
In order to evaluate the general applicability of the method, the above six algorithms were used in data experiments on 30 groups of SAR images, and each group of data was run 20 times to verify the stability of the results of the algorithm. The objective indicators for each algorithm on the 30 groups of SAR images are shown in Figure 11. The average indicators for each algorithm are shown in Table 2.
Among the objective indicators in Figure 11, it can be concluded that, compared with algorithms (a) LEE-FLICM, (b) DWT2-FLICM, (c) NSCT-FLICM, (d) TV-KMEANS, and (e) N-FLICM, algorithm (f) better reduces the false negative rate (FN/%), the false positive rate (FP/%), and the total error rate (OE/%), which further improves the PCC and kappa coefficients. Compared with the previously mentioned algorithms, the fluctuation range of each objective index of the proposed algorithm is smaller, so it has good robustness.
From the analysis of the six average objective indicators in Table 2, compared with the results of the other six algorithms, the proposed algorithm reduces the average total error, OE/%, of detection, which improves the PCC and kappa coefficients. The proposed algorithm (f) achieves a good balance between detection accuracy and algorithm run time, and is more suitable for SAR image change detection.

5. Conclusions

In this paper, a new method using semi-implicit denoising of the ROF model is applied to the change detection of remote sensing images. The method can preserve the image texture details and reduce noise. The logarithmic ratio method is combined with complementary information from the mean ratio method in order to obtain a difference image with the change information. PCA is then used to determine a weighted fusion of the two difference images. Finally, the difference image is clustered by fuzzy local information C-means clustering (FLICM) to obtain the change region. The algorithm not only improves the detection accuracy of the changed region, but also balances the change detection accuracy and time. There are many aspects of the proposed methodology that need to be improved. For example, the accuracy of the algorithm can be improved, and the complexity of the algorithm can be reduced. In our future investigations, additional work will be conducted towards these improvements.

Author Contributions

Methodology: Z.J. and X.L.; resources: Z.J.; software: Z.J.; supervision: Z.J., J.Y. and N.K.; validation: X.L.; writing—review and editing: X.L.

Funding

This research was funded by the National Science Foundation of China grant number No. 61665012 and the International Cooperative Research and Personnel Training Projects of the Ministry of Education of the People’s Republic of China grant numbers No. 2014-2029 and 2016-2196.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Shang, R.; Qi, L.; Jiao, L.; Stolkin, R.; Li, Y. Change detection in SAR images by artificial immune multi-objective clustering. Eng. Appl. Artif. Intell. 2014, 31, 53–67. [Google Scholar] [CrossRef]
  2. Valenzuela, G.R. An asymptotic formulation for SAR images of the dynamical ocean surface. Radio Sci. 2016, 15, 105–114. [Google Scholar] [CrossRef]
  3. Bindschadler, R.A.; Jezek, K.C.; Crawford, J. Glaciological Investigations Using the Synthetic Aperture Radar Imaging System. Ann. Glaciol. 1987, 9, 11–19. [Google Scholar] [CrossRef] [Green Version]
  4. Yang, J.; Sun, W. Automatic analysis of the slight change image for unsupervised change detection. J. Appl. Remote Sens. 2015, 9, 095995. [Google Scholar] [CrossRef]
  5. Simard, M.; Degrandi, G.; Thomson, K.P.B.; Benie, G.B. Analysis of speckle noise contribution on wavelet decomposition of SAR images. IEEE Trans. Geosci. Remote Sens. 2002, 36, 1953–1962. [Google Scholar] [CrossRef]
  6. Yee, H.C.; Sjögreen, B. Non-Linear Filtering and Limiting in High Order Methods for Ideal and Non-Ideal MHD. J. Sci. Comput. 2006, 27, 507–521. [Google Scholar] [CrossRef]
  7. Chen, J.; Kang, X.; Liu, Y.; Wang, Z.J. Median Filtering Forensics Based on Convolutional Neural Networks. IEEE Signal Process. Lett. 2015, 22, 1849–1853. [Google Scholar] [CrossRef]
  8. Marks, L.D. Wiener-filter enhancement of noisy HREM images. Ultramicroscopy 2016, 62, 43–52. [Google Scholar] [CrossRef]
  9. Zhu, J.; Wen, J.; Zhang, Y. A new algorithm for SAR image despeckling using an enhanced Lee filter and median filter. In Proceedings of the International Congress on Image and Signal Processing, Hangzhou, China, 16–18 December 2013; pp. 224–228. [Google Scholar]
  10. Köstli, K.P.; Beard, P.C. Two-dimensional photoacoustic imaging by use of Fourier-transform image reconstruction and a detector with an anisotropic response. Appl. Opt. 2003, 42, 1899–1908. [Google Scholar] [CrossRef] [PubMed]
  11. Antonini, M.; Barlaud, M.; Mathieu, P.; Daubechies, I. Image coding using wavelet transform. IEEE Trans. Image Process. 1992, 1, 205–220. [Google Scholar] [CrossRef] [PubMed]
  12. Ikuta, C.; Zhang, S.; Uwate, Y.; Yang, G.; Nishio, Y. A novel fusion algorithm for visible and infrared image using non-subsampled contourlet transform and pulse-coupled neural network. In Proceedings of the International Conference on Computer Vision Theory and Applications, Lisbon, Portugal, 5–8 January 2015; pp. 160–164. [Google Scholar]
  13. Gong, M.; Yu, C.; Wu, Q. A Neighborhood-Based Ratio Approach for Change Detection in SAR Images. IEEE Geosci. Remote Sens. Lett. 2012, 9, 307–311. [Google Scholar] [CrossRef]
  14. Zhang, Y.C.; Jia, Z.H.; Qin, X.Z.; Jie, Y.; Kasabov, N. Unsupervised detection of different SAR images based on improved NSCT domain image fusion algorithm. J. Optoelectron. Laser 2015, 26, 2023–2030. [Google Scholar]
  15. Rudin, L.I.; Osher, S.; Fatemi, E. Nonlinear total variation based noise removal algorithms. Phys. D Nonlinear Phenom. 1992, 60, 259–268. [Google Scholar] [CrossRef]
  16. Lai, M.J.; Lucier, B.; Wang, J. The Convergence of a Central-Difference Discretization of Rudin-Osher-Fatemi Model for Image Denoising. In Proceedings of the International Conference on Scale Space and Variational Methods in Computer Vision, Voss, Norway, 1–5 June 2009; pp. 514–526. [Google Scholar]
  17. Cao, K.; Wang, F.; Shang, Q.-W. A Novel Image Denoising Algorithm Based on Crank-Nicholson Semi-implicit Difference Scheme. Procedia Eng. 2011, 23, 647–652. [Google Scholar]
  18. Wang, L.N.; He, W.Z.; Li, C.-L.; Liang, J. Image denoising algorithm based on wavelet transform and ROF model. Available online: http://en.cnki.com.cn/Article_en/CJFDTotal-TJJB201502011.htm (accessed on 7 March 2019).
  19. Wu, C.; Tai, X.C. Augmented Lagrangian Method, Dual Methods, and Split Bregman Iteration for ROF, Vectorial TV, and High Order Models. SIAM J. Imaging Sci. 2012, 3, 300–339. [Google Scholar] [CrossRef]
  20. Wang, X.; Jia, Z.; Yang, J.; Kasabov, N. Change detection in SAR images based on the logarithmic transformation and total variation denoising method. Remote Sens. Lett. 2017, 8, 214–223. [Google Scholar] [CrossRef]
  21. Shi, Y.-Y.; Liu, J.-J. A Semi-implicit Image Denoising Algorithm in Matrix Form. Available online: http://en.cnki.com.cn/Article_en/CJFDTOTAL-OXZG201204012.htm (accessed on 7 March 2019).
  22. Osher, S.; Solé, A.; Vese, L. Image decomposition and restoration using total variation minimization and the $Hsp {-1} $ norm. Available online: http://xueshu.baidu.com/usercenter/paper/show?paperid=0f0def36eb122397b8fd7c554e51a56f&site=xueshu_se&hitarticle=1&sc_from=xju (accessed on 7 March 2019).
  23. Weickert, J.; Romeny, B.M.t.H.; Viergever, M.A. Efficient and Reliable Schemes for Nonlinear Diffusion Filtering. IEEE Trans. Image Process. 1998, 7, 398–410. [Google Scholar] [CrossRef] [PubMed]
  24. Cross, G.W. Three types of matrix stability. Linear Algebra Appl. 1978, 20, 253–263. [Google Scholar] [CrossRef] [Green Version]
  25. Hou, B.; Wei, Q.; Zheng, Y.; Wang, S. Unsupervised Change Detection in SAR Image Based on Gauss-Log Ratio Image Fusion and Compressed Projection. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2014, 7, 3297–3317. [Google Scholar] [CrossRef]
  26. Chen, P.; Zhang, Y.; Jia, Z.; Yang, J.; Kasabov, N. Remote Sensing Image Change Detection Based on NSCT-HMT Model and Its Application. Sensors 2017, 17, 1295. [Google Scholar] [CrossRef] [PubMed]
  27. Prasath, V.B.S.; Vorotnikov, D. Weighted and well-balanced anisotropic diffusion scheme for image denoising and restoration. Nonlinear Anal. Real World Appl. 2014, 17, 33–46. [Google Scholar] [CrossRef]
  28. Wang, W.; Guyet, T.; Quiniou, R.; Cordier, M.O.; Masseglia, F.; Zhang, X. Autonomic intrusion detection: Adaptively detecting anomalies over unlabeled audit data streams in computer networks. Knowl.-Based Syst. 2014, 70, 103–117. [Google Scholar] [CrossRef] [Green Version]
  29. Krinidis, S.; Chatzis, V. A Robust Fuzzy Local Information C-Means Clustering Algorithm. IEEE Trans. Image Process. 2010, 19, 1328–1337. [Google Scholar] [CrossRef] [PubMed]
  30. Zarinbal, M.; Zarandi, M.H.F.; Turksen, I.B. Interval Type-2 Relative Entropy Fuzzy C-Means clustering. Inf. Sci. 2014, 272, 49–72. [Google Scholar] [CrossRef]
  31. Chambolle, A.; Lions, P.L. Image recovery via total variation minimization and related problems. Numer. Math. 1997, 76, 167–188. [Google Scholar] [CrossRef]
  32. Drapaca, C.S. A Nonlinear Total Variation-Based Denoising Method with Two Regularization Parameters. IEEE Trans. Bio-Med. Eng. 2009, 56, 582–586. [Google Scholar] [CrossRef] [PubMed]
  33. Rosin, P.L.; Ioannidis, E. Evaluation of global image thresholding for change detection. Pattern Recognit. Lett. 2003, 24, 2345–2356. [Google Scholar] [CrossRef] [Green Version]
  34. Ma, J.; Gong, M.; Zhou, Z. Wavelet Fusion on Ratio Images for Change Detection in SAR Images. IEEE Geosci. Remote Sens. Lett. 2012, 9, 1122–1126. [Google Scholar] [CrossRef]
Figure 1. Flowchart of the proposed algorithm for change detection.
Figure 1. Flowchart of the proposed algorithm for change detection.
Sensors 19 01179 g001
Figure 2. The Bern dataset: (a) April 1999; (b) May 1999; (c) change reference image.
Figure 2. The Bern dataset: (a) April 1999; (b) May 1999; (c) change reference image.
Sensors 19 01179 g002
Figure 3. The Coastline dataset: (a) June 2008; (b) June 2009; (c) change reference image.
Figure 3. The Coastline dataset: (a) June 2008; (b) June 2009; (c) change reference image.
Sensors 19 01179 g003
Figure 4. The Yellow River dataset: (a) June 2008; (b) June 2009; (c) change reference image.
Figure 4. The Yellow River dataset: (a) June 2008; (b) June 2009; (c) change reference image.
Sensors 19 01179 g004
Figure 5. Plots of (a) PCC, (b) K, and (c) T against the scale parameter λ on three data sets.
Figure 5. Plots of (a) PCC, (b) K, and (c) T against the scale parameter λ on three data sets.
Sensors 19 01179 g005
Figure 6. Plots of (a) PCC, (b) K, and (c) T against the number of iterations N on three data sets.
Figure 6. Plots of (a) PCC, (b) K, and (c) T against the number of iterations N on three data sets.
Sensors 19 01179 g006
Figure 7. Plots of (a) PCC, (b) K, and (c) T against the window size ω on three data sets.
Figure 7. Plots of (a) PCC, (b) K, and (c) T against the window size ω on three data sets.
Sensors 19 01179 g007
Figure 8. Change detection results of the Bern dataset derived by the (a) LEE-FLICM, (b) DWT2-FLICM, (c) NSCT-FLICM, (d) TV-KMEANS, (e) N-FLICM, and (f) proposed algorithms.
Figure 8. Change detection results of the Bern dataset derived by the (a) LEE-FLICM, (b) DWT2-FLICM, (c) NSCT-FLICM, (d) TV-KMEANS, (e) N-FLICM, and (f) proposed algorithms.
Sensors 19 01179 g008
Figure 9. Change detection results of the Coastline dataset derived by the (a) LEE-FLICM, (b) DWT2-FLICM, (c) NSCT-FLICM, (d) TV-KMEANS, (e) N-FLICM, and (f) proposed algorithms.
Figure 9. Change detection results of the Coastline dataset derived by the (a) LEE-FLICM, (b) DWT2-FLICM, (c) NSCT-FLICM, (d) TV-KMEANS, (e) N-FLICM, and (f) proposed algorithms.
Sensors 19 01179 g009
Figure 10. Change detection results of the Yellow River dataset derived by the (a) LEE-FLICM, (b) DWT2-FLICM, (c) NSCT-FLICM, (d) TV-KMEANS, (e) N-FLICM, and (f) proposed algorithms.
Figure 10. Change detection results of the Yellow River dataset derived by the (a) LEE-FLICM, (b) DWT2-FLICM, (c) NSCT-FLICM, (d) TV-KMEANS, (e) N-FLICM, and (f) proposed algorithms.
Sensors 19 01179 g010
Figure 11. The Objective indicators (a) FP/%, (b) FN/%, (c) OE/%, (d) PCC/%, (e) K, and (f) T/s for each algorithm on 30 groups of SAR images.
Figure 11. The Objective indicators (a) FP/%, (b) FN/%, (c) OE/%, (d) PCC/%, (e) K, and (f) T/s for each algorithm on 30 groups of SAR images.
Sensors 19 01179 g011
Table 1. Objective indicators of different detection methods.
Table 1. Objective indicators of different detection methods.
DatasetsMethodFPFNOEPCC/%KappaT/s
BernLEE-FLICM3430734199.620.830714.63
DWT2-FLICM10719430199.670.86209.66
NSCT-FLICM10617327999.690.87405.49
TV-KMEANS13014927999.690.87672.99
N-FLICM12016828899.680.87103.74
Proposed 10017227299.700.87694.42
CoastlineLEE-FLICM8829099.650.92225.92
DWT2-FLICM1891820799.190.83284.19
NSCT-FLICM1593819799.230.83454.17
TV-KMEANS169517499.320.85822.43
N-FLICM2014224399.050.80192.12
Proposed 7457999.690.93072.54
Yellow RiverLEE-FLICM905284118998.540.770314.27
DWT2-FLICM17382699998.780.74897.87
NSCT-FLICM43947391298.880.80018.53
TV-KMEANS20872232431995.880.73998.23
N-FLICM805409121498.510.75554.81
Proposed 60823784598.970.82907.01
Table 2. Average objective indicators of different detection methods.
Table 2. Average objective indicators of different detection methods.
Method FP ¯ / % FN ¯ / % OE ¯ / % PCC ¯ / % Kappa ¯ T ¯ / s
LEE-FLICM0.801.081.8498.020.786015.78
DWT2-FLICM0.652.042.7097.290.670717.96
NSCT-FLICM1.331.222.5697.360.756721.67
TV-KMEANS1.450.693.0796.630.854712.78
N-FLICM1.361.272.6797.360.75755.92
Proposed 0.680.881.5698.380.83856.89

Share and Cite

MDPI and ACS Style

Lou, X.; Jia, Z.; Yang, J.; Kasabov, N. Change Detection in SAR Images Based on the ROF Model Semi-Implicit Denoising Method. Sensors 2019, 19, 1179. https://doi.org/10.3390/s19051179

AMA Style

Lou X, Jia Z, Yang J, Kasabov N. Change Detection in SAR Images Based on the ROF Model Semi-Implicit Denoising Method. Sensors. 2019; 19(5):1179. https://doi.org/10.3390/s19051179

Chicago/Turabian Style

Lou, Xuemei, Zhenhong Jia, Jie Yang, and Nikola Kasabov. 2019. "Change Detection in SAR Images Based on the ROF Model Semi-Implicit Denoising Method" Sensors 19, no. 5: 1179. https://doi.org/10.3390/s19051179

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop