Next Article in Journal
Node Scheduling Strategies for Achieving Full-View Area Coverage in Camera Sensor Networks
Previous Article in Journal
Diagnosis of Compound Fault Using Sparsity Promoted-Based Sparse Component Analysis
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Remote Sensing Image Change Detection Based on NSCT-HMT Model and Its Application

1
College of Information Science and Engineering, Xinjiang University, Urumuqi 830046, China
2
Institute of Image Processing and Pattern Recognition, Shanghai Jiao Tong University, Shanghai 200400, China
3
Knowledge Engineering and Discovery Research Institute, Auckland University of Technology, Auckland 1020, New Zealand
*
Author to whom correspondence should be addressed.
Sensors 2017, 17(6), 1295; https://doi.org/10.3390/s17061295
Submission received: 24 March 2017 / Revised: 1 June 2017 / Accepted: 1 June 2017 / Published: 6 June 2017
(This article belongs to the Section Remote Sensors)

Abstract

:
Traditional image change detection based on a non-subsampled contourlet transform always ignores the neighborhood information’s relationship to the non-subsampled contourlet coefficients, and the detection results are susceptible to noise interference. To address these disadvantages, we propose a denoising method based on the non-subsampled contourlet transform domain that uses the Hidden Markov Tree model (NSCT-HMT) for change detection of remote sensing images. First, the ENVI software is used to calibrate the original remote sensing images. After that, the mean-ratio operation is adopted to obtain the difference image that will be denoised by the NSCT-HMT model. Then, using the Fuzzy Local Information C-means (FLICM) algorithm, the difference image is divided into the change area and unchanged area. The proposed algorithm is applied to a real remote sensing data set. The application results show that the proposed algorithm can effectively suppress clutter noise, and retain more detailed information from the original images. The proposed algorithm has higher detection accuracy than the Markov Random Field-Fuzzy C-means (MRF-FCM), the non-subsampled contourlet transform-Fuzzy C-means clustering (NSCT-FCM), the pointwise approach and graph theory (PA-GT), and the Principal Component Analysis-Nonlocal Means (PCA-NLM) denosing algorithm. Finally, the five algorithms are used to detect the southern boundary of the Gurbantunggut Desert in Xinjiang Uygur Autonomous Region of China, and the results show that the proposed algorithm has the best effect on real remote sensing image change detection.

1. Introduction

Image change detection is the process of identifying changes in land cover through analyzing remote sensing images acquired in the same geographical location at different times [1]. It is widely used in the fields of video surveillance [2], medical diagnosis [3], land use [4], and natural disaster detection [5]. Changes in land use and oasis coverage have a direct impact on the human environment and ecological processes. Information regarding changes in land use and coverage are important for natural resource management and scientific decision-making [6,7], and are a critical component of research in the areas of the environment, forestry, hydrology, agriculture, geography, and ecology. Using remote sensing images for land use and oasis cover change detection can quickly and accurately obtain change information and development trends. However, the rapid updating of land cover data has become a technical problem in the fields of remote sensing and geographic information systems. Methods of quickly and accurately determining changes based on geographical data, and unsupervised techniques for extracting the changes in objects from an image are greatly significant for rapidly updating land use and oasis cover images [8].
Li et al. proposed a multi-scale image change detection algorithm based on Markov Random Field (MRF) information fusion [9]. They introduced the MRF model into remote sensing image change detection. The MRF model describes the state dependent relationship between adjacent image coordinates and expresses the local statistical characteristics of the image. Do et al. proposed the contourlet hidden Markov tree (HMT) model, which was based on the implicit Markov model in the wavelet domain [10]. The dependency between the coefficients was expanded from intra-scale to inter-scale. Gong et al. proposed a SAR image change detection algorithm based on improved MRF energy function and fuzzy clustering (MRF-FCM) [11]. The algorithm described in [9,10] greatly improves detection accuracy; however, it uses the iterative optimization strategy. If the algorithm is directly used for change detection, it involves a large calculation with low efficiency. Although the algorithm proposed in [11] has reduced complexity, the change detection results are still vulnerable to the influence of the clutter noise because the relevant context is absent. Hesen et al. proposed an unsupervised change detection algorithm based on the nonsubsampled contourlet and fuzzy C-mean clustering (NSCT-FCM) algorithm [12]. The efficiency of the algorithm is greatly improved, but the detection accuracy is low. Pham et al. proposed a pointwise approach to detect land-cover changes between two SAR images to capture the image’s significant contextual information (PA-GT) [13]. Yousif et al. proposed a SAR image change detection algorithm based on the principal componenet analysis (PCA) algorithm and the nonlocal means (NLM) denoising algorithm [14].
With the development of remote sensing technology, change detection in remote sensing image has become more and more important. The algorithms that are used to detect SAR images and multi-spectral images change should be different, because the noise is significantly different from SAR and optical image data, but many algorithms can be used to detect both the synthetic aperture radar images and the optical images. Yetgin et al. proposed a novel technique for unsupervised change detection of multi-spectral satellite images using Gaussian mixture model (GMM), local gradual descent, and k-means clustering [15]. Celik et al. proposed an unsupervised change detection method for satellite images which conducted on the synthetic aperture radar images and the optical images [16]. Ma et al. proposed an unsupervised change detection method based on an improved rough fuzzy c-means clustering method (SRFPCM) for synthetic aperture radar and optical remote sensing images [17]. There are also many similar algorithms in the literature [18,19,20,21,22].
In order to reduce the influence of noise on the detection results, we propose a remote sensing image change detection algorithm based on the non-subsampled contourlet transform and the Hidden Markov Tree (NSCT-HMT) model. First, the ENVI software is used to calibrate the original remote sensing images. After that, the difference map is obtained using mean value method, and then the NSCT-HMT model is used to denoise the difference image. The Fuzzy Local Information C-means (FLICM) algorithm is then used to classify the denoised images. The experimental results show that the proposed method is more accurate than MRF-FCM, NSCT-FCM, PA-GT and PCA-NLM algorithms. Finally, the algorithms are applied to detect oasis coverage on the southern boundary of the Gurbantunggut Desert in the Xinjiang Uygur Autonomous Region of China.

2. Image Change Detection with NSCT-HMT Model

The ENVI software is used to calibrate the original remote sensing images. After calibration, the images are subjected to decibel transformation, prior to the operation to generate the difference map. In this paper, all parameter values are set the same for all our data.

2.1. Generation of the Difference Image

The ways to generate a difference map include the difference method and ratio method, and both can effectively construct difference images from optical remote sensing images, but the difference method is sensitive to image quality and the spectral characteristics of the objective conditions, resulting in a high rate of missed detection and false positives. The ratio method includes the logarithmic ratio method and mean ratio method. Among them, the advantage of the logarithmic ratio method is the ability to convert multiplicative speckle noise to additive noise, and the background information of the difference image obtained by the logarithmic transformation is relatively flat. The disadvantages are that the logarithmic ratio algorithm compresses the variation range of the difference image, and has the characteristics of enhancing the low intensity pixels to weaken the high intensity pixels, and cannot reflect the real change trends to the maximum extent [23]. The mean ratio method, on the other hand, does not have such problems. The mean value rule can effectively enhance the contour of the change area and changes in a small area, and can also prevent the loss of change information. In order to take full account of the relevant context, the difference map constructed by the mean value ratio depends only on relative changes in image intensity. It can truly reflect the changes in the region and retain more details. Therefore, in this paper, we use the mean ratio method proposed by Inglada et al. to generate the difference image [24].
Assume F and G are images of the same location taken at different times and the size of these images are r pixels × c pixels, and they have been calibrated by ENVI.
The mean-ratio operation formula is as follows:
X m ( i , j ) = 1 min ( μ 1 ( i , j ) μ 2 ( i , j ) , μ 2 ( i , j ) μ 1 ( i , j ) )
where μ1 (i, j) and μ2 (i, j) respectively represent the local mean value of F and G at the point (i, j) in the window size of ω × ω, ω = 1, 3, 5, 7, ...

2.2. A Denoising Method Based on the NSCT-HMT Model

After obtaining the mean difference map, this paper uses the non-sampling contourlet HMT (NSCT-HMT) model proposed by Wang et al. to denoise the difference image [25]. The original NSCT-HMT model is mainly used to process the optical images. In this paper, we apply it to remote sensing image denoising. The overview of the basic rationale of the adopted methodologies:
  • The mean difference map was dealt with the NSCT decomposition;
  • After the NSCT decomposition, the coefficients of NSCT are fitted by Gauss mixture model;
  • Using the HMT model to estimate the parameters;
  • The Monte-Carlo method is used to generate random white noise images and balance the variance of the image in the NSCT domain;
  • The EM algorithm is used to estimate the NSCT coefficient of the denoised image;
  • Using the NSCT synthesis to get denoised image.

2.2.1. NSCT Transform and the Hidden Markov Model

Da et al. proposed a kind of non-sampling contourlet transform (NSCT) that was based on the contourlet transform [26]. The NSCT does not have a sampling process in the image decomposition and reconstruction process, and it is composed of two-dimensional non-sampled pyramid filter banks and non-down-sampling filter banks. The result of this treatment is that the NSCT transform has translation invariance in addition to being multi-resolution, multi-scale, and anisotropic. Although the NSCT coefficients do not obey a Gauss distribution, they follow a zero mean mixed Gauss distribution. The NSCT coefficients can be modeled using a mixture of two Gauss functions. They have the characteristics of persistence and aggregation, and have a strong dependence on the neighborhood coefficient. These NSCT characteristics have laid the foundation for the establishment of the Markov model in the NSCT domain (NSCT-HMT). After obtaining the mean difference map, three layers of NSCT decomposition was performed. The number of sub-bands in each layer is 4, 4 and 8.
The hidden Markov model (HMT) is a double stochastic process consisting of a hidden Markov chain with a certain number of states and a set of random functions. It can be divided into a hidden layer and an observation layer. The hidden layer cannot be directly observed, and includes a certain number of states. The observation layer (actual observation) can have some observations corresponding to the state. The observation vector is generated by a sequence of states with probability density distribution. It is used to express various states by a probability density distribution.

2.2.2. Establishment of NSCT-HMT Model

In theory, a signal needs to be accurately represented by a series of Gaussian distributions. However, in the actual image processing application, it is possible to use the 2~4 Gaussian mixture to approximate the image [27,28]. The coefficients of NSCT can be modeled using a mixture of two Gauss functions. Formulas (2) and (3) are used to build the coefficients of the Gauss mixture model [25]:
f N i ( N i ) = m = 1 n f s i ( m ) f N i | s i   ( N i / s i = m )
f N | s i ( N i | s i = m ) = 1 2 π σ i m 2 exp [ ( N i μ i m ) 2 2 σ i m 2 ] = g ( N i ; μ i m ; σ i m 2 )
where Ni represents the coefficient of a certain subband in each layer. si indicates in which state the coefficients are selected. fsi(m) is the probability distribution function of the large and small states, and m = 1 n f s i ( m ) = 1 ; f N i | s i ( N i | s i = m ) represents the probability distribution density function corresponding to the Gauss model when the coefficients are in a specific state. μ i m and σ i m 2 represent the mean and variance of the Gauss distribution, respectively.
The probability distribution function of N 1 in each direction sub-band node can be expressed as P N 1 ( m ) , where m is the number of hidden states. State transition probabilities can be expressed as ε i , ρ ( i ) m , n = f ( s i = m | s ρ ( i ) = n ) .
The above parameters are represented by a formal θ N H M T of four tuples [25]:
θ N H M T = { ( P N 1 ( m ) , ε i , ρ ( i ) m , n , σ i , m 2 , μ i , m ) | i = 1 , 2 , , p ; m , n = 1 , 2 , , M }
where P represents the number of coefficients and M represents the number of states. The NSCT-HMT model can be represented by the four tuple of parameters as shown in Formula (4).

2.2.3. Image Denoising Based on NSCT-HMT Model

In order to calculate of the model parameters, we use the HMT-EM algorithm proposed by Fan et al. to estimate the parameters [29], and the local optimal solution is obtained by iteration. A noisy image can be understood as the superposition of original image information and noise. If we assume that the NSCT coefficient of the difference image is y, then y is composed of the NSCT coefficient x of the original image and the NSCT coefficient n of the noise. So the image denoising problem can be transformed into the estimation of the NSCT coefficient x of the original image in the case of the NSCT coefficient y of the noisy image.
Image denoising based on NSCT-HMT model is as follows:
  • By Equation (4), the parameters of the model can be expressed as:
    θ N HMT = { P N 1 ( m ) , ε i , ρ ( i ) m , n , σ i , m 2 , μ i , m }
  • The Monte-Carlo method proposed by Crouse et al. is used to generate random white noise images and balance the variance of the image in the NSCT domain [30], and then the noise variance of the coefficient is estimated in the noise image model. The variance of the noise coefficient can be expressed as ( σ ( j , k , i ) ( noise ) ) 2 . The coefficient model of the original image can be obtained by subtracting the noisy image’s variance of the noise coefficient of the NSCT-HMT model [26]:
    ( σ ( j , k , i ) , m x ) 2 = [ ( σ ( j , k , i ) , m y ) 2 ( σ ( j , k , i ) ( noise ) ) 2 ]
    where j, k, i respectively refer to the scale, direction, and coefficient. m indicates the hidden state of the NSCT coefficient.
  • The NSCT-HMT parameter model of the denoised image can be expressed as:
    θ N HMT x = { P N 1 ( m ) , ε i , ρ ( i ) m , n , ( σ i , m ( x ) ) 2 , μ i , m }
    The above parameters are used to estimate the NSCT coefficients of the denoised image. When the state Sj,k,i is constant, the NSCT coefficients obey the Gauss distribution. It is assumed that the noise is Gauss white noise with a mean value of 0, and it is independent of the NSCT coefficient. Then the NSCT coefficient of the Bayes denoised image [26] can be represented as:
    E [ x j , k , i | y j , k , i , θ N HMT x , S j , k , i ] = ( σ ( j , k , i ) , m ( x ) ) 2 ( σ ( j , k , i ) , m ( x ) ) 2 + ( σ ( j , k , i ) , m ( n ) ) 2 × y j , k , i
  • The conditional probability obtained by the EM algorithm [26] can be expressed as:
    p ( S j , k , i = m | y j , k , i , θ N HMT x )
  • The NSCT coefficient of the denoised image can be estimated as:
    E [ x j , k , i | y j , k , i , θ N HMT x ] = m p ( S j , k , i = m | y j , k , i , θ N HMT x ) × ( σ ( j , k , i ) , m ( x ) ) 2 ( σ ( j , k , i ) , m ( x ) ) 2 + ( σ ( j , k , i ) , m ( n ) ) 2 × y j , k , i

2.3. FLICM Clustering

In this paper, we use the FLICMC clustering algorithm proposed by Krindis et al. [31]. This algorithm modifies the objective function of the traditional FCM algorithm, and introduces the fuzzy factor Gki,:
G k i = j = N i 1 d i j + 1 ( 1 μ k j ) n x j ν k 2
where d i j is a spatial euclidean distance between the i pixel and the neighborhood j pixel. μ k j indicates the degree of ownership of the j pixel to class k. x j represents the neighborhood pixels near the center i pixel in the local window. v k is the clustering center of class k.
The objective function of the FLICM algorithm is shown below:
J m = i = 1 N k = 1 c [ μ k i n x i v k 2 + G k i ]
where x i is the center pixel of local window. v k and μ k j respectively represent the class k clustering centers and fuzzy membership matrix. They can be expressed as:
v k = i = 1 N μ k i n x i i = 1 N μ k i n
μ k i = 1 j = 1 c ( x i v k 2 + G k i x i v k 2 + G j i ) 1 ( n 1 )

2.4. Implementation Steps

The implementation steps are as follows:
Step 1:
The original remote sensing images are calibrated by ENVI software;
Step 2:
The difference image is obtained by using Equation (1) on the calibrated images;
Step 3:
The NSCT transform is used to transform the difference image, and the transformed coefficients are modeled using a hidden Markov tree. Equation (6) is used to obtain the coefficients of the original image. Finally, Equation (10) is used to estimate the NSCT coefficients of the denoised image.
Step 4:
The Inverse NSCT transform is used to obtain the difference image after denoising.
Step 5:
After the above treatment, Equation (12) is used to cluster the difference map, and the final change detection results are obtained.
The algorithm flow is shown below as Figure 1.

3. SAR Image Change Detection

3.1. The Selection of the Window Size for SAR Image

To illustrate the effect of window size on change detection results, we examine the relationship between window size ω × ω and percentage correct classification (PCC).
As can be seen in Figure 2, when the window size is 3 × 3, PCC can get the optimal solution. The reason is that if the selection is too large, the noise removal is relatively clean, but it will lead to the loss of edge and detail information. If selected too small, more details will be retained, but the denoising effect is poor, so for the SAR images in this paper, ω = 3.

3.2. SAR Image Data Description

In order to verify the effectiveness and to illustrate the practicality of the proposed method, we use two sets of real SAR images in [32]. The reason why we choose these two sets of SAR images is that these two groups of images are well known and often used for comparison.

3.2.1. Real Remote Sensing Image of the Bern Data Set

The first sets of real SAR image data of Bern, Switzerland were obtained by ERS-2 in April 1999 and May 1999, and are shown below in Figure 3a,b. The images are 301 × 301 pixels in size and have a gray level of 256. Changes are mainly caused by a flood, and the reference map is shown in Figure 3c.

3.2.2. Real Remote Sensing Image of Ottawa Data Set

The second set of real SAR image data from Ottawa, Canada was obtained by Radarsat in May 1997 and August 1997. They are shown below as Figure 4a,b. The images are 290 × 350 pixels and have a gray level of 256. The main change is the surface change caused by flooding, and the reference map is shown in Figure 4c.

3.3. SAR Image Data Experimental Results and Analysis

To evaluate the effectiveness of the proposed algorithm, we use the above three real remote sensing image data sets for change detection. The algorithm proposed in this paper is compared with the MRF-FCM [11], NSCT-FCM [12], PA-GT [13] and PCA-NLM [15] algorithms. Results of the qualitative analysis are shown in Figure 5 and Figure 6.
As can be seen from Figure 5f, there is no isolated clutter in the resulting graph, which means that the algorithm proposed in this paper can effectively suppress non-changing clutter. It can be seen from Figure 6f that the resulting image effectively suppresses noise effectively and preserves the details of the change.
In order to quantitatively evaluate the performance of the algorithm, we use the MRF-FCM, NSCT-FCM, PA-GT, PCA-NLM and the proposed algorithm to detect change in two groups of data sets, and quantitatively analyze the test results. The evaluation indexes are false negatives (FN), false positives (FP), overall error (OE), percentage correct classification (PCC), the Kappa index and the running time (T) (the running time was obtained by calculating the mean value of 20 runs).
The results are shown in Table 1. As can be seen in Table 1, in comparison with MRF-FCM, NSCT-FCM, PA-GT and PCA-NLM, the proposed algorithm has the lowest number of false positives, the lowest total number of errors, and the highest PCC and the Kappa index. As for the running time, although the proposed algorithm takes a bit longer than the NSCT-FCM, PA-GT and PCA-NLM algorithms, the detection accuracy is much higher than theirs.

3.4. The General Applicability of Verification Glgorithm for SAR Image

The five algorithms are used to process the experimental data of 30 groups. The average results are shown in Table 2.
For the running time, this paper takes the experimental data of 30 groups of 300 × 300 pixels images. The data for each group were run 20 times and then averaged. The results of each parameter are shown in Table 2. The following conclusions can be drawn from Table 2:
  • Compared with the previous algorithms, the proposed algorithm can suppress clutter noise better while preserving detailed information from the original image.
  • The proposed algorithm has a faster processing speed than MRF-FCM, but it is a little slower than NSCT-FCM, PA-GT and PCA-NLM. The complexity of the proposed algorithm needs to be improved.
  • The proposed algorithm is suitable to detect SAR images.

4. Multi-Spectral Image Change Detection

Due to the fact that SAR image processing is intrinsically complex, with the presence of the speckle noise, it is difficult to analysis SAR images, and the multi-spectral images are easy affected by the presence of cloud cover or different sunlight conditions. The application to SAR and multi-spectral optical data should be different, but there are many algorithms that can be used to detect both the synthetic aperture radar images and the optical images. Just as the algorithms proposed in [13,14,15,16,17,18,19,20]. We are lucky enough to find an algorithm which can be used for both SAR and multi-spectral remote sensing image change detection.

4.1. The Selection of the Window Size for Multi-Spectral Remote Sensing Image

When the image spatial resolution is 30 m, the relationship between window size ω × ω and percentage correct classification (PCC) is as follows: as can be seen in Figure 7, when the window size is 1 × 1, PCC can get the optimal solution, so we choose ω = 1 when we are dealing with multi-spectral remote sensing images.
When the window size is 1 × 1, Equation (1) will be changed into:
X m ( i , j ) = 1 min ( X 1 ( i , j ) X 2 ( i , j ) , X 2 ( i , j ) X 1 ( i , j ) )
where X1 (i, j) and X2 (i, j) respectively represent the value of the pixel at the point ( i , j ).

4.2. Image Data Description

The set of real multi-spectral remote sensing image data are acquired by the Landsat Enhances Thematic Mapper Plus (ETM+) sensor of the Landsat-7 satellite, in an area of Mexico in April 2000 and May 2002. Figure 8a,b shows channel 4 of the 2000 and 2002 images, respectively. The instrument’s pixel resolution is 30. The images are 512 × 512 pixels and have a gray level of 256. The changes were caused by a fire that burned a large part of the vegetation in the test region, and the reference map is shown in Figure 8c.

4.3. Multi-Spectral Image Data Experimental Results and Analysis

The evaluation indexes are false negatives (FN), false positives (FP), overall error (OE), percentage correct classification (PCC), the Kappa index and the running time (T). The following conclusions can be drawn from Figure 9 and in Table 3:
  • The PA-GT and PCA-NLM algorithms can achieve good results when dealing with SAR images. But, in dealing with real multi-spectral remote sensing images, the results are poor.
  • The proposed algorithm can be used for multi-spectral remote sensing image change detection.

4.4. The General Applicability of Verification Glgorithm for Multi-Spectral Image

The five algorithms are used to process the experimental data of 30 groups. The images are 500 × 500 pixels in size. The average results are shown in Table 4.
The following conclusions can be drawn from Table 4:
  • Compared with the previous four algorithms, the proposed algorithm has a good balance in the number of false negatives and false positives.
  • The proposed algorithm is more suitable to detect multi-spectral images.

5. Application

5.1. Acquisition of Real Remote Sensing Image

The Gurbantunggut Desert is located in the hinterland of the Junggar basin in northern Xinjiang, China. It is China’s largest fixed and semi-fixed desert, and is located at 44°11′~46°20′ N and 84°31′~90°00′ E. Its acreage is about 4.88 × 104 km2. Precipitation occurs mainly in the spring and annually does not reach 150 mm. Its average annual evaporation potential is higher at more than 2000 mm, and the annual average temperature is 6~10 °C.
We choose a set of real multi-spectral remote sensing image data which are acquired by the Landsat Enhances Thematic Mapper Plus (ETM+) sensor of the Landsat-7 satellite, in an area of Gurbantunggut Desert in July 1999 and July 2007. The instrument’s pixel resolution is 30 m. Figure 10a,b shows channel 3 of the 1999 and 2007 images, respectively. They are registered using ENVI. The images are 570 × 570 pixels, and have a gray scale of 256. The image data is mainly composed of desert, vegetation, and street construction. Changes mainly result from the government and citizens combating desertification and planting vegetation and crops.

5.2. Analysis the Change of Oasis Cover

The above five algorithms are used to detect the change of Gurbantunggut data set. The results of the change of oasis cover in the study area are shown in Figure 11 and Table 5. The white pixels in Figure 11 represent the oasis cover change.
In the blue and purple areas, parts of the places have indeed changed, but the MRF-FCM and PCA-NLM algorithms did not detect the changed parts. In the red area, there is no change in this area, but NSCT-FCM and PA-GT algorithms have detected changes.

6. Conclusions

A remote sensing image change detection algorithm based on the NSCT-HMT denoising model is proposed in this paper. The proposed change detection method is tested for both optical and synthetic aperture radar satellite images. The mean-ratio operation is adopted to obtain the difference image, which will be denosing by the NSCT-HMT model. Then, using the FLICM algorithm, the difference image is divided into the change area and unchanged area. The experimental results show that compared with MRF-FCM, NSCT-FCM, PA-GT and PCA-NLM algorithms, the algorithm proposed in this paper takes full account of the characteristics of the spatial neighborhood. It not only enhances the changes of the regional profile and the small area, but also can effectively suppress the clutter noise, and the final change detection accuracy is improved. Finally, we apply the algorithms to detect the oasis coverage of the southern Gurbantunggut Desert, and the results show that the proposed algorithm has a good detection ability.
In this paper, the multi-spectral optical data sets are acquired by the Landsat-7, so we did not list the relationship between the value of window size and the image spatial resolution in the paper, but we did some experiments, and we found that when the image spatial resolution is lower than 10 m, the value of window size must choose 1 × 1, or using other method such as the different method or log- ratio method, etc., to get the multi-spectral optical different image. There are many places in this paper that need to be improved. For example, how to reduce the complexity of the algorithm and how to further improve the accuracy of the algorithm. In our future investigations, additional work will be conducted on them.

Acknowledgments

This work was supported in part by the International Cooperative Research and Personnel Training Projects of the Ministry of Education of the People’s Republic of China [Grant number DICE2014-2029 and 2016-2196].

Author Contributions

Zhenhong Jia conceived and designed the experiments; Jie Yang and Nikola Kasabov designed algorithm; Pengyun Chen and Yichen Zhang performed the experiments; Pengyun Chen and Yichen Zhang analyzed the data; Zhenhong Jia contributed reagents/materials/analysis tools; Pengyun Chen wrote the paper.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Richards, J.A.; Jia, X. Remote Sensing Digital Image Analysis, 4th ed.; Springer: Berlin/Heidelberg, Germany, 2006; pp. 40–86. [Google Scholar]
  2. Tsai, D.M.; Lai, S.C. Independent component analysis-based background subtraction for indoor surveillance. IEEE Trans. Image Process. 2009, 18, 158–167. [Google Scholar] [CrossRef] [PubMed]
  3. Ho, S.S.; Wechsler, H. A martingale framework for detecting changes in data streams by testing exchangeability. IEEE Trans. Pattern Anal. Mach. Intell. 2010, 32, 2113–2127. [Google Scholar] [PubMed]
  4. Gao, Z.; Xu, N.; Fu, C.; Ning, J. Evaluating Drought Monitoring Methods Using Remote Sensing: A Dynamic Correlation Analysis Between Heat Fluxes and Land Cover Patterns. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2015, 8, 298–303. [Google Scholar] [CrossRef]
  5. Giustarini, L.; Hostache, R.; Matgen, P.; Schumann, G.J.-P.; Bates, P.D.; Mason, D.C. A change detection approach to flood mapping in urban areas using TerraSAR-X. IEEE Trans. Geosci. Remote Sens. 2013, 51, 2417–2430. [Google Scholar] [CrossRef]
  6. Meyer, W.B.; Turner, B.L. Human population growth and global land-use/cover change. Annu. Rev. Ecol. Syst. 1992, 23, 39–61. [Google Scholar] [CrossRef]
  7. Lunetta, R.S.; Elvidge, C.D. Remote Sensing Change Detection: Environmental Monitoring Methods and Applications; Taylor & Francis Ltd.: New Delhi, India, 1999; pp. 22–41. [Google Scholar]
  8. Paglieroni, D.W.; Pechard, C.T.; Beer, N.R. Change Detection in Constellations of Buried Objects Extracted From Ground-Penetrating Radar Data. IEEE Trans. Geosci. Remote Sens. 2015, 53, 2426–2439. [Google Scholar] [CrossRef]
  9. Li, S.Z. Markov Random Field Modeling in Image Analysis; Springer Science & Business Media: Berlin, Germany, 2009. [Google Scholar]
  10. Do, M.N.; Vetterli, M. The contourlet transform: An efficient directional multiresolution image representation. IEEE Trans. Image Process. 2005, 14, 2091–2106. [Google Scholar] [CrossRef] [PubMed]
  11. Gong, M.; Su, L.; Jia, M.; Chen, W. Fuzzy clustering with a modified MRF energy function for change detection in synthetic aperture radar images. IEEE Trans. Fuzzy Syst. 2014, 22, 98–109. [Google Scholar] [CrossRef]
  12. Hesen, R.; Jia, Z.H.; Qin, X.Z.; Jie, Y.; Hu, R. Based on NSCT Combination with FCM Multitemporal Remote Sensing Image Change Detection. Laser J. 2014, 35, 42–44. [Google Scholar]
  13. Pham, M.T.; Mercier, G.; Michel, J. Change Detection between SAR Images Using a Pointwise Approach and Graph Theory. IEEE Trans. Geosci. Remote Sens. 2015, 54, 1–13. [Google Scholar] [CrossRef]
  14. Yousif, O.; Ban, Y. Improving Urban Change Detection from Multitemporal SAR Images Using PCA-NLM. IEEE Trans. Geosci. Remote Sens. 2013, 51, 2032–2041. [Google Scholar] [CrossRef]
  15. Yetgin, Z. Unsupervised Change Detection of Satellite Images Using Local Gradual Descent. IEEE Trans. Geosci. Remote Sens. 2012, 50, 1919–1929. [Google Scholar] [CrossRef]
  16. Celik, T.; Ma, K.K. Multitemporal Image Change Detection Using Undecimated Discrete Wavelet Transform and Active Contours. IEEE Trans. Geosci. Remote Sens. 2011, 49, 706–716. [Google Scholar] [CrossRef]
  17. Ma, W.; Jiao, L.; Gong, M.; Li, C. Image change detection based on an improved rough fuzzy c-means clustering algorithm. Int. J. Mach. Learn. Cybern. 2014, 5, 369–377. [Google Scholar] [CrossRef]
  18. Brunner, D.; Bruzzone, L.; Lemoine, G. Change detection for earthquake damage assessment in built-up areas using very high resolution optical and SAR imagery. In Proceedings of the IEEE Geoscience and Remote Sensing Symposium, Honolulu, HI, USA, 25–30 July 2010; pp. 3210–3213. [Google Scholar]
  19. Shao, P.; Shi, W.; He, P.; Hao, P.; Zhang, X. Novel Approach to Unsupervised Change Detection Based on a Robust Semi-Supervised FCM Clustering Algorithm. Remote Sens. 2016, 8, 264. [Google Scholar] [CrossRef]
  20. Mercier, G.; Moser, G.; Serpico, S.B. Conditional Copulas for Change Detection in Heterogeneous Remote Sensing Images. IEEE Trans. Geosci. Remote Sens. 2008, 46, 1428–1441. [Google Scholar] [CrossRef]
  21. Zhang, J.; Wang, X.; Chen, T.; Zhang, Y. Change detection for the urban area based on multiple sensor information fusion. In Proceedings of the IEEE International Geoscience and Remote Sensing Symposium, Seoul, Korea, 29–29 July 2005. [Google Scholar]
  22. Alberga, V. Similarity Measures of Remotely Sensed Multi-Sensor Images for Change Detection Applications. Remote Sens. 2009, 1, 122–143. [Google Scholar] [CrossRef]
  23. Kuruoglu, E.E.; Zerubia, J. Modeling SAR images with a generalization of the Rayleigh distribution. IEEE Trans. Image Process. 2004, 13, 527–533. [Google Scholar] [CrossRef] [PubMed]
  24. Inglada, J.; Mercier, G. A New Statistical Similarity Measure for Change Detection in Multitemporal SAR Images and Its Extension to Multiscale Change Analysis. IEEE Trans. Geosci. Remote Sens. 2007, 45, 1432–1445. [Google Scholar] [CrossRef]
  25. Wang, X.; Ni, P.; Su, X.; Fang, L.; Song, C. The nonsubsampled Contourlet HMT model. Sci. China Inf. Sci. 2013, 43, 1431. [Google Scholar]
  26. Da, C.A.; Zhou, J.; Do, M.N. The nonsubsampled contourlet transform: Theory, design, and applications. IEEE Trans. Image Process. 2006, 15, 3089–3101. [Google Scholar]
  27. Wu, Y.; Li, M.; Zong, H.; Wang, X. Fusion Segmentation Algorithm for SAR Images Based on HMT in Contourlet Domain and D-S Theory of Evidence. Proceedings of Computational Science and Its Applications (ICCSA), Seoul, Korea, 29 June–2 July 2009; Gervasi, O., Taniar, D., Murgante, B., Laganà, A., Mun, Y., Gavrilova, M.L., Eds.; Springer: Berlin/Heidelberg, Germany, 2009; pp. 937–951. [Google Scholar]
  28. Wang, X.H.; Chen, M.Y.; Song, C.M.; Xu, M.C.; Fang, L.L. Contourlet HMT model with directional feature. Sci. China Inf. Sci. 2012, 55, 1563–1578. [Google Scholar] [CrossRef]
  29. Fan, G.; Xia, X.G. Wavelet-based texture analysis and synthesis using hidden Markov models. IEEE Trans. Circuits Syst. I Fundam. Theory Appl. 2003, 50, 106–120. [Google Scholar]
  30. Crouse, M.S.; Nowak, R.D.; Baraniuk, R.G. Wavelet-based statistical signal processing using hidden Markov models. IEEE Trans. Signal Process. 1998, 46, 886–902. [Google Scholar] [CrossRef]
  31. Krinidis, S.; Chatzis, V. A robust fuzzy local information C-means clustering algorithm. IEEE Trans. Image Process. 2010, 19, 1328–1337. [Google Scholar] [CrossRef] [PubMed]
  32. Gong, M.; Zhou, Z.; Ma, J. Change Detection in Synthetic Aperture Radar Images Based on Image Fusion and Fuzzy Clustering. IEEE Trans. Image Process. 2012, 21, 2141–2151. [Google Scholar] [CrossRef] [PubMed]
Figure 1. The algorithm flowchart.
Figure 1. The algorithm flowchart.
Sensors 17 01295 g001
Figure 2. The relationship between window size ω × ω and PCC.
Figure 2. The relationship between window size ω × ω and PCC.
Sensors 17 01295 g002
Figure 3. Bern data set: (a) Image acquired in April 1999; (b) Image acquired in May 1999; (c) The reference change image.
Figure 3. Bern data set: (a) Image acquired in April 1999; (b) Image acquired in May 1999; (c) The reference change image.
Sensors 17 01295 g003
Figure 4. Ottawa data set: (a) Image acquired in May 1997; (b) Image acquired in August 1997; (c) The reference change image.
Figure 4. Ottawa data set: (a) Image acquired in May 1997; (b) Image acquired in August 1997; (c) The reference change image.
Sensors 17 01295 g004
Figure 5. Change detection images obtained for the Bern data set: (a) The reference change image; (b) NSCT-FCM; (c) MRF-FCM; (d) PA-GT; (e) PCA-NLM; (f) Proposed algorithm.
Figure 5. Change detection images obtained for the Bern data set: (a) The reference change image; (b) NSCT-FCM; (c) MRF-FCM; (d) PA-GT; (e) PCA-NLM; (f) Proposed algorithm.
Sensors 17 01295 g005
Figure 6. Change detection images obtained for the Ottawa data set: (a) The reference change image; (b) NSCT-FCM; (c) MRF-FCM; (d) PA-GT; (e) PCA-NLM; (f) Proposed algorithm.
Figure 6. Change detection images obtained for the Ottawa data set: (a) The reference change image; (b) NSCT-FCM; (c) MRF-FCM; (d) PA-GT; (e) PCA-NLM; (f) Proposed algorithm.
Sensors 17 01295 g006
Figure 7. The relationship between window size ω × ω and PCC.
Figure 7. The relationship between window size ω × ω and PCC.
Sensors 17 01295 g007
Figure 8. Mexico data set: (a) Image acquired in April 2000; (b) Image acquired in May 2005; (c) The reference change image.
Figure 8. Mexico data set: (a) Image acquired in April 2000; (b) Image acquired in May 2005; (c) The reference change image.
Sensors 17 01295 g008
Figure 9. Change detection images obtained for the Mexico data set: (a) The reference change image; (b) NSCT-FCM; (c) MRF-FCM; (d) PA-GT; (e) PCA-NLM; (f) Proposed algorithm.
Figure 9. Change detection images obtained for the Mexico data set: (a) The reference change image; (b) NSCT-FCM; (c) MRF-FCM; (d) PA-GT; (e) PCA-NLM; (f) Proposed algorithm.
Sensors 17 01295 g009
Figure 10. Gurbantunggut data set: (a) Image acquired in July 1999; (b) Image acquired in July 2007.
Figure 10. Gurbantunggut data set: (a) Image acquired in July 1999; (b) Image acquired in July 2007.
Sensors 17 01295 g010
Figure 11. Change detection images obtained for Gurbantunggut data set: (a) NSCT-FCM; (b) MRF-FCM; (c) PA-GT; (d) PCA-NLM; (e) Proposed algorithm.
Figure 11. Change detection images obtained for Gurbantunggut data set: (a) NSCT-FCM; (b) MRF-FCM; (c) PA-GT; (d) PCA-NLM; (e) Proposed algorithm.
Sensors 17 01295 g011
Table 1. SAR image change detection results under evaluation by different algorithms.
Table 1. SAR image change detection results under evaluation by different algorithms.
Data SetMethod UsedFNFPOEPCC (%)KappaT (s)
BernNSCT-FCM16828245099.500.81468.43
MRF-FCM4736441199.550.845373.91
PA-GT19510930499.670.862110.06
PCA-NLM9626736399.610.851711.29
Proposed Method17310327699.690.879618.43
OttawaNSCT-FCM2362286252297.510.91129.36
MRF-FCM6811079176098.260.935583.81
PA-GT1010747175797.910.920312.43
PCA-NLM781872165398.370.938714.08
Proposed Method532833136598.650.949820.37
Table 2. Results of different algorithms for detecting the average change of SAR remote sensing images.
Table 2. Results of different algorithms for detecting the average change of SAR remote sensing images.
Method Used F N ¯ /% F P ¯ /% O E ¯ /% P C C ¯ /% K a p p a ¯ T ¯ /s
NSCT-FCM10.729.8620.5879.420.80438.34
MRF-FCM5.0413.4218.4681.540.824673.58
PA-GT3.234.047.2792.730.874210.02
PCA-NLM4.217.4311.6488.360.864911.04
Proposed Method2.112.734.8495.160.892717.95
Table 3. Multi-spectral image change detection results under evaluation by different algorithms.
Table 3. Multi-spectral image change detection results under evaluation by different algorithms.
Data SetMethod UsedFNFPOEPCC (%)KappaT (s)
MexicoNSCT-FCM10302402343298.690.741815.48
MRF-FCM1699724242399.070.8143124.50
PA-GT9971586258399.010.783120.72
PCA-NLM4395126452198.090.562823.65
Proposed Method1425671209199.110.841728.54
Table 4. Results of detecting the average change of multi-spectral remote sensing images.
Table 4. Results of detecting the average change of multi-spectral remote sensing images.
Method Used F N ¯ /% F P ¯ /% O E ¯ /% P C C ¯ /% K a p p a ¯ T ¯ /s
NSCT-FCM5.187.9313.1186.890.786415.36
MRF-FCM4.973.828.7991.210.8013122.43
PA-GT2.834.677.5092.500.745820.45
PCA-NLM11.591.9413.5386.470.581623.51
Proposed Method2.912.235.1494.860.879327.74
Table 5. The running time of five algorithms.
Table 5. The running time of five algorithms.
TimeNSCT-FCMMRF-FCMPA-GTPCA-NLMProposed Algorithm
T (s)19.5154.325.729.335.2

Share and Cite

MDPI and ACS Style

Chen, P.; Zhang, Y.; Jia, Z.; Yang, J.; Kasabov, N. Remote Sensing Image Change Detection Based on NSCT-HMT Model and Its Application. Sensors 2017, 17, 1295. https://doi.org/10.3390/s17061295

AMA Style

Chen P, Zhang Y, Jia Z, Yang J, Kasabov N. Remote Sensing Image Change Detection Based on NSCT-HMT Model and Its Application. Sensors. 2017; 17(6):1295. https://doi.org/10.3390/s17061295

Chicago/Turabian Style

Chen, Pengyun, Yichen Zhang, Zhenhong Jia, Jie Yang, and Nikola Kasabov. 2017. "Remote Sensing Image Change Detection Based on NSCT-HMT Model and Its Application" Sensors 17, no. 6: 1295. https://doi.org/10.3390/s17061295

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop