Search Results (15)

In response to the problem of stripe noise significantly reducing the clarity and details of side-scan sonar images due to various factors, the authors of this paper propose an improved Criminisi method for stripe noise suppression. To address the issues encountered in the Criminisi algorithm during the suppression of stripe noise in side-scan sonar images, the following steps are suggested: firstly, introduce dynamic weights in the priority calculation to adaptively adjust the confidence and data term weights based on the current patch’s texture complexity; secondly, utilize the Sobel operator in the data term calculation to capture the image edge information more accurately; and, thirdly, optimize the matching block search process by introducing the Manhattan distance in addition to the Sum of Squared Differences (SSD) criterion to further select the best matching block while transitioning from a global search to a local search. Experimental validation was conducted using simulated stripe noise images, comparing the proposed method with four traditional denoising techniques. The results demonstrate that the denoising effectiveness of the proposed method is superior, effectively restoring texture in noisy regions while preserving texture structure integrity. Ablation experiments validate the effectiveness of the proposed improvements. Denoising experiments on real noisy images show satisfactory results with this method, and combining it with Fourier transform for additional smoothing in certain cases may yield even better results. Full article

Hyperspectral image (HSIs) denoising is a preprocessing step that plays a crucial role in many applications used in Earth observation missions. Low-rank tensor representation can be utilized to restore mixed-noise HSIs, such as those affected by mixed Gaussian, impulse, stripe, and deadline noises. Although there is a considerable body of research on spatial and spectral prior knowledge concerning subspace, the correlation between the spectral continuity and the nonlocal sparsity of the spectral and spatial factors is not yet fully understood. To address this deficiency, in the present study, we determined the correlation between these factors using a cascaded technique, and we describe in this paper the double-factor tensor cascaded-rank (DFTCR) minimization method that was used. The information existing in the nonlocal sparsity property of the spatial factor was employed to promote a geometrical feature representation, and a tensor cascaded-rank minimization approach was introduced as a nonlocal self-similarity to promote restoration quality. The continuity between the difference and nonlocal gradient sparsity constraints of the spectral factor was also introduced to learn the basis. Furthermore, to estimate the solutions of the proposed model, we developed an algorithm based on the alternating direction method of multipliers (ADMM). The performance of the DFTCR method was tested by a comparison with eleven established denoising methods for HSIs. The results showed that the proposed DFTCR method exhibited superior performance in the removal of mixed noise from HSIs. Full article

The cornea is an important refractive structure in the human eye. The corneal segmentation technique provides valuable information for clinical diagnoses, such as corneal thickness. Non-contact anterior segment optical coherence tomography (AS-OCT) is a prevalent ophthalmic imaging technique that can visualize the anterior and posterior surfaces of the cornea. Nonetheless, during the imaging process, saturation artifacts are commonly generated due to the tangent of the corneal surface at that point, which is normal to the incident light source. This stripe-shaped saturation artifact covers the corneal surface, causing blurring of the corneal edge, reducing the accuracy of corneal segmentation. To settle this matter, an inpainting method that introduces structural similarity and frequency loss is proposed to remove the saturation artifact in AS-OCT images. Specifically, the structural similarity loss reconstructs the corneal structure and restores corneal textural details. The frequency loss combines the spatial domain with the frequency domain to ensure the overall consistency of the image in both domains. Furthermore, the performance of the proposed method in corneal segmentation tasks is evaluated, and the results indicate a significant benefit for subsequent clinical analysis. Full article

In the context of non-uniformity correction (NUC) within infrared imaging systems, current methods frequently concentrate solely on high-frequency stripe non-uniformity noise, neglecting the impact of global low-frequency non-uniformity on image quality, and are susceptible to ghosting artifacts from neighboring frames. In response to such challenges, we propose a method for the correction of non-uniformity in single-frame infrared images based on noise separation in the wavelet domain. More specifically, we commence by decomposing the noisy image into distinct frequency components through wavelet transformation. Subsequently, we employ a clustering algorithm to extract high-frequency noise from the vertical components within the wavelet domain, concurrently employing a method of surface fitting to capture low-frequency noise from the approximate components within the wavelet domain. Ultimately, the restored image is obtained by subtracting the combined noise components. The experimental results demonstrate that the proposed method, when applied to simulated noisy images, achieves the optimal levels among seven compared methods in terms of MSE, PSNR, and SSIM metrics. After correction on three sets of real-world test image sequences, the average non-uniformity index is reduced by 75.54%. Moreover, our method does not impose significant computational overhead in the elimination of superimposed noise, which is particularly suitable for applications necessitating stringent requirements in both image quality and processing speed. Full article

Coal mining is necessary for the development of society but at the same time causes ecological damage that must also be repaired based on science. In the arid and semi-arid regions of northwest China, surface cracks are one of the major geo-environmental problems caused by coal mining, and studies are urgently needed to determine how to effectively repair them in a scientific manner. The rapid development of unmanned aerial vehicle (UAV) remote sensing technology in recent years has resulted in a good source of data for acquiring feature information on surface cracks. Existing studies mainly focus on high-precision crack extraction methods, and there are few studies on the methods for evaluating cracks. However, clarifying the degree of cracks requiring repair and what repair measures are required through scientific and reasonable evaluation methods is necessary to formulate effective crack repair and land reclamation plans. Given these considerations, in this study, the degree of both crack development and soil damage were evaluated based on the crack extraction results of UAV images. Based on the results of indoor experiments and field measurements, the grading criteria for the degree of crack development and soil damage were constructed. Crack density was used as the evaluation index for the degree of crack development (slight: <0.4%, moderate: 0.4–2%, severe: >2%). The distance between soil and cracks was the basis of the evaluation index for the soil damage degree (severe damage area: <0.6 m; slight damage area: 0.6–1.2 m; no obvious damage area: >1.2 m). Through the results from evaluating the degree of both crack development and soil damage in the study area, it was found that the degree of crack development was mainly moderate and located in the northern crack zone of the study area, with the cracks and damaged soil showing a striped pattern in the east-west direction. Combining the evaluation results of crack development and soil damage, the ecological restoration model of “natural restoration + crack filling + water supplementing + vegetation planting” is proposed. We conclude that crack repair should be applied in areas where moderate and severe cracks have developed, whereas soil repair should target the soil within 1.2 m of the cracks in the above area. This study is the first attempt to construct and evaluate the classification criteria of crack development degree and soil damage degree from the perspective of cracks and soil, and the results are of guiding significance for land reclamation in mining areas. Full article

Remote sensing nighttime lights (NTLs) offers a unique perspective on human activity, and NTL images are widely used in urbanization monitoring, light pollution, and other human-related research. As one of the payloads of sustainable development science Satellite-1 (SDGSAT-1), the Glimmer Imager (GI) provides a new multi-spectral, high-resolution, global coverage of NTL images. However, during the on-orbit testing of SDGSAT-1, a large number of stripes with bad or corrupted pixels were observed in the L1A GI image, which directly affected the accuracy and availability of data applications. Therefore, we propose a novel destriping algorithm based on anomaly detection and spectral similarity restoration (ADSSR) for the GI image. The ADSSR algorithm mainly consists of three parts: pretreatment, stripe detection, and stripe restoration. In the pretreatment, salt-pepper noise is suppressed by setting a minimum area threshold of the connected components. Then, during stripe detections, the valid pixel number sequence and the total pixel value sequence are analyzed to determine the location of stripes, and the abnormal pixels of each stripe are estimated by a clustering algorithm. Finally, a spectral-similarity-based method is adopted to restore all abnormal pixels of each stripe in the stripe restoration. In this paper, the ADSSR algorithm is compared with three representative destriping algorithms, and the robustness of the ADSSR algorithm is tested on different sizes of GI images. The results show that the ADSSR algorithm performs better than three representative destriping algorithms in terms of visual and quantitative indexes and still maintains outstanding performance and robustness in differently sized GI images. Full article

Hyperspectral images (HSIs) are frequently contaminated by different noises (Gaussian noise, stripe noise, deadline noise, impulse noise) in the acquisition process as a result of the observation environment and imaging system limitations, which makes image information lost and difficult to recover. In this paper, we adopt a 3D-based SSCA block neural network of U-Net architecture for remote sensing HSI denoising, named SSCANet (Spatial and Spectral-Channel Attention Network), which is mainly constructed by a so-called SSCA block. By fully considering the characteristics of spatial-domain and spectral-domain of remote sensing HSIs, the SSCA block consists of a spatial attention (SA) block and a spectral-channel attention (SCA) block, in which the SA block is to extract spatial information and enhance spatial representation ability, as well as the SCA block to explore the band-wise relationship within HSIs for preserving spectral information. Compared to earlier 2D convolution, 3D convolution has a powerful spectrum preservation ability, allowing for improved extraction of HSIs characteristics. Experimental results demonstrate that our method holds better-restored results than other compared approaches, both visually and quantitatively. Full article

To eliminate the mixed noise in hyperspectral images (HSIs), three-dimensional total variation (3DTV) regularization has been proven as an efficient tool. However, 3DTV regularization is prone to losing image details in restoration. To resolve this issue, we proposed a novel TV, named spatial domain spectral residual total variation (SSRTV). Considering that there is much residual texture information in spectral variation image, SSRTV first calculates the difference between the pixel values of adjacent bands and then calculates a 2DTV for the residual image. Experimental results demonstrated that the SSRTV regularization term is powerful at changing the structures of noises in an original HSI, thus allowing low-rank techniques to get rid of mixed noises more efficiently without treating them as low-rank features. The global low-rankness and spatial–spectral correlation of HSI is exploited by low-rank Tucker decomposition (LRTD). Moreover, it was demonstrated that the l_2,1 norm is more effective to deal with sparse noise, especially the sample-specific noise such as stripes or deadlines. The augmented Lagrange multiplier (ALM) algorithm was adopted to solve the proposed model. Finally, experimental results with simulated and real data illustrated the validity of the proposed method. The proposed method outperformed state-of-the-art TV-regularized low-rank matrix/tensor decomposition methods in terms of quantitative metrics and visual inspection. Full article

Road extraction from remote sensing images has attracted much attention in geospatial applications. However, the existing methods do not accurately identify the connectivity of the road. The identification of the road pixels may be interfered with by the abundant ground such as buildings, trees, and shadows. The objective of this paper is to enhance context and strip features of the road by designing UNet-like architecture. The overall method first enhances the context characteristics in the segmentation step and then maintains the stripe characteristics in a refinement step. The segmentation step exploits an attention mechanism to enhance the context information between the adjacent layers. To obtain the strip features of the road, the refinement step introduces the strip pooling in a refinement network to restore the long distance dependent information of the road. Extensive comparative experiments demonstrate that the proposed method outperforms other methods, achieving an overall accuracy of 98.25% on the DeepGlobe dataset, and 97.68% on the Massachusetts dataset. Full article

The Orbita hyperspectral satellite (OHS) is the first hyperspectral satellite with surface coating technology for sensors in the world. It includes 32 bands from visible to near-infrared wavelengths. However, technology such as the fabricating process of complementary metal–oxide–semiconductor (CMOS) sensors makes the image contain a lot of random and unsystematic stripe noise, which is so bad that it seriously affects visual interpretation, object recognition and the application of the OHS data. Although a large number of stripe removal algorithms have been proposed, very few of them take into account the characteristics of OHS sensors and analyze the causes of OHS data noise. In this paper, we propose a destriping algorithm for OHS data. Firstly, we use both the adaptive moment matching method and multi-level unidirectional total variation method to remove stripes. Then a model based on piecewise linear least squares fitting is proposed to restore the vertical details lost in the first step. Moreover, we further utilize the spectral information of the OHS image, and extend our 2-D destriping method to the 3-D case. Results demonstrate that the proposed method provides the optimal destriping result on both qualitative and quantitative assessments. Moreover, the experimental results show that our method is superior to the existing single-band and multispectral destriping methods. Also, we further use the algorithm to the stripe noise removal of other real remote sensing images, and excellent image quality is obtained, which proves the universality of the algorithm. Full article

Hyperspectral image (HSI) restoration is an important task of hyperspectral imagery processing, which aims to improve the performance of the subsequent HSI interpretation and applications. Considering HSI is always influenced by multiple factors—such as Gaussian noise, stripes, dead pixels, etc.—we propose an HSI-oriented probabilistic low-rank restoration method to address this problem. Specifically, we treat the expected clean HSI as a low-rank matrix. We assume the distribution of complex noise obeys a mixture of Gaussian distributions. Then, the HSI restoration problem is casted into solving the clean HSI from its counterpart with complex noise. In addition, considering the rank number need to be assigned manually for existing low-rank based HSI restoration method, we propose to automatically determine the rank number of the low-rank matrix by taking advantage of hyperspectral unmixing. Experimental results demonstrate HSI image can be well restored with the proposed method. Full article

Hyperspectral images (HSIs) are always corrupted by complicated forms of noise during the acquisition process, such as Gaussian noise, impulse noise, stripes, deadlines and so on. Specifically, different bands of the practical HSIs generally contain different noises of evidently distinct type and extent. While current HSI restoration methods give less consideration to such band-noise-distinctness issues, this study elaborately constructs a new HSI restoration technique, aimed at more faithfully and comprehensively taking such noise characteristics into account. Particularly, through a two-level hierarchical Dirichlet process (HDP) to model the HSI noise structure, the noise of each band is depicted by a Dirichlet process Gaussian mixture model (DP-GMM), in which its complexity can be flexibly adapted in an automatic manner. Besides, the DP-GMM of each band comes from a higher level DP-GMM that relates the noise of different bands. The variational Bayes algorithm is also designed to solve this model, and closed-form updating equations for all involved parameters are deduced. The experiment indicates that, in terms of the mean peak signal-to-noise ratio (MPSNR), the proposed method is on average 1 dB higher compared with the existing state-of-the-art methods, as well as performing better in terms of the mean structural similarity index (MSSIM) and Erreur Relative Globale Adimensionnelle de Synthèse (ERGAS). Full article

This paper introduces a variational method for destriping data acquired by pushbroom-type satellite imaging systems. The model leverages sparsity in signals and is based on current research in sparse optimization and compressed sensing. It is based on the basic principles of regularization and data fidelity with certain constraints using modern methods in variational optimization, namely, total variation (TV), $L^1$ fidelity, and the alternating direction method of multipliers (ADMM). The proposed algorithm, TV– $L^1$ , uses sparsity-promoting energy functionals to achieve two important imaging effects. The TV term maintains boundary sharpness of the content in the underlying clean image, while the $L^1$ fidelity allows for the equitable removal of stripes without over- or under-penalization, providing a more accurate model of presumably independent sensors with an unspecified and unrestricted bias distribution. A comparison is made between the TV– $L^2$ model and the proposed TV– $L^1$ model to exemplify the qualitative efficacy of an $L^1$ striping penalty. The model makes use of novel minimization splittings and proximal mapping operators, successfully yielding more realistic destriped images in very few iterations. Full article

Remote sensing images could provide us with tremendous quantities of large-scale information. Noise artifacts (stripes), however, made the images inappropriate for vitalization and batch process. An effective restoration method would make images ready for further analysis. In this paper, a new method is proposed to correct the stripes and bad abnormal pixels in charge-coupled device (CCD) linear array images. The method involved a line tracing method, limiting the location of noise to a rectangular region, and corrected abnormal pixels with the Lagrange polynomial algorithm. The proposed detection and restoration method were applied to Gaofen-1 satellite (GF-1) images, and the performance of this method was evaluated by omission ratio and false detection ratio, which reached 0.6% and 0%, respectively. This method saved 55.9% of the time, compared with traditional method. Full article

It has been previously reported that thermal emissive bands (TEB) 27–29 in the Terra (T-) MODerate resolution Imaging Spectroradiometer (MODIS) have been significantly affected by electronic crosstalk. Successful linear theory of the electronic crosstalk effect was formulated, and it successfully characterized the effect via the use of lunar observations as viable inputs. In this paper, we report the successful characterization and mitigation of the electronic crosstalk for T-MODIS band 30 using the same characterization methodology. Though the phenomena of the electronic crosstalk have been well documented in previous works, the novel for band 30 is the need to also apply electronic crosstalk correction to the non-linear term in the calibration coefficient. The lack of this necessity in early works thus demonstrates the distinct difference of band 30, and, yet, in the same instances, the overall correctness of the characterization formulation. For proper result, the crosstalk correction is applied to the band 30 calibration coefficients including the non-linear term, and also to the earth view radiance. We demonstrate that the crosstalk correction achieves a long-term radiometric correction of approximately 1.5 K for desert targets and 1.0 K for ocean scenes. Significant striping removal in the Baja Peninsula earth view imagery is also demonstrated due to the successful amelioration of detector differences caused by the crosstalk effect. Similarly significant improvement in detector difference is shown for the selected ocean and desert targets over the entire mission history. In particular, band 30 detector 8, which has been flagged as “out of family” is restored by the removal of the crosstalk contamination. With the correction achieved, the science applications based on band 30 can be significantly improved. The linear formulation, the characterization methodology, and the crosstalk effect correction coefficients derived using lunar observations are once again demonstrated to work remarkably well. Full article