Search Results (22)

While traditionally focused on coronary anatomy, cardiac computed tomography now enables non-invasive myocardial tissue characterization. By evaluating late iodine enhancement (LIE) and extracellular volume (ECV), single-energy CT (SECT) provides a valuable alternative to cardiac magnetic resonance for assessing ischemic and non-ischemic pathologies. However, clinical implementation of SECT faces technical challenges, primarily the low contrast-to-noise ratio (CNR) of iodine and the reliance on image subtraction for ECV quantification, both of which increase radiation exposure and susceptibility to spatial misregistration. To address these issues, protocol optimization is essential. Evidence-based recommendations include using low tube voltages to shift the X-ray spectrum closer to the iodine K-edge, paired with high reference tube currents. Additionally, delayed acquisition timing should be tailored to specific pathological targets to account for differences in contrast kinetics, and advanced iterative or deep learning image reconstructions should be implemented to mitigate noise. Optimized SECT demonstrates diagnostic and prognostic utility in conditions like acute myocardial infarction, hypertrophic cardiomyopathy, cardiac amyloidosis, and left ventricular thrombus detection. While spectral imaging represents the future, optimizing SECT through technical adjustments and standardized training is crucial for integrating myocardial characterization into routine workflows. Full article

Orthophoto change detection is used to find real land cover changes in urban monitoring, disaster assessment, and environmental management. In practice, however, multi-temporal orthophotos are rarely identical in geometry and radiometry even after standard preprocessing. Small residual misregistration, local building displacement, shadow movement, and illumination differences can produce edge-like responses that look like change but do not correspond to any land cover transition. These false alarms increase manual checking costs and reduce the reliability of change maps. This study addresses that practical problem by proposing an attention-guided conditional adversarial framework, named Attention-GAN, for false alarm-resistant orthophoto change detection. The aim is not to detect small perturbations as changes but to detect real land cover changes while suppressing responses to nuisance variations that should be treated as unchanged. The framework integrates a multi-scale spatial attention module, a channel attention module, and a PatchGAN discriminator. It also introduces perturbation-negative training pairs, where controlled geometric and radiometric perturbations are applied to unchanged image pairs and assigned all-zero change masks. Experiments on LEVIR-CD, WHU-CD, and DSIFN-CD show competitive or moderately higher accuracy than the selected representative baselines, with F1 scores of 91.2%, 92.45%, and 93.18%, respectively. In the ablation experiment, the false change rate on perturbation-negative validation pairs is reduced to 4.9%. Repeated-run statistics and ablation results indicate that the proposed training strategy mainly improves robustness by reducing false alarms under the evaluated perturbation range. The results support the use of controlled nuisance perturbations as a reproducible way to train and evaluate false alarm resistance, while broader validation under real multi-view, seasonal, and cross-sensor distortions remains necessary. Full article

In recent years, deep learning has driven remarkable progress in remote sensing change detection (CD); however, practical deployment is still hindered by two limitations. First, CD results are easily degraded by imaging-induced uncertainties—mixed pixels and blurred boundaries, radiometric inconsistencies (e.g., shadows and seasonal illumination changes), and slight residual misregistration—leading to pseudo-changes and fragmented boundaries. Second, prevailing methods follow a static one-pass inference paradigm and lack an explicit feedback mechanism for adaptive error correction, which weakens generalization in complex or unseen scenes. To address these issues, we propose a feedback-driven CD framework that integrates a dual-branch U-Net with deep reinforcement learning (RL) for pixel-level probabilistic iterative refinement of an initial change probability map. The backbone produces a preliminary posterior estimate of change likelihood from multi-scale bi-temporal features, while a PPO-based RL agent formulates refinement as a Markov decision process. The agent leverages a state representation that fuses multi-scale features, prediction confidence/uncertainty, and spatial consistency cues (e.g., neighborhood coherence and edge responses) to apply multi-step corrective actions. From an imaging and interpretation perspective, the RL module can be viewed as a learnable, self-adaptive imaging optimization mechanism: for high-risk regions affected by blurred boundaries, radiometric inconsistencies, and local misalignment, the agent performs feedback-driven multi-step corrections to improve boundary fidelity and spatial coherence while suppressing pseudo-changes caused by shadows and illumination variations. Experiments on four datasets (CDD, SYSU-CD, PVCD, and BRIGHT) verify consistent improvements. Using SiamU-Net as an example, the proposed RL refinement increases mIoU by 3.07, 2.54, 6.13, and 3.1 points on CDD, SYSU-CD, PVCD, and BRIGHT, respectively, with similarly consistent gains observed when the same RL module is integrated into other representative CD backbones. Full article

Object detection in challenging imaging domains like security screening, medical analysis, and satellite imaging is often hindered by signal degradation (e.g., noise, blur) and spatial ambiguity (e.g., occlusion, extreme scale variation). We argue that many standard architectures fail by fusing multi-scale features prematurely, which amplifies noise. This paper introduces the Enhance-Fuse-Align (E-F-A) principle: a new architectural blueprint positing that robust feature enhancement and explicit spatial alignment are necessary preconditions for effective feature fusion. We implement this blueprint in a model named SecureDet, which instantiates each stage: (1) an RFCBAMConv module for feature Enhancement; (2) a BiFPN for weighted Fusion; (3) ECFA and ASFA modules for contextual and spatial Alignment. To validate the E-F-A blueprint, we apply SecureDet to the highly challenging task of X-ray contraband detection. Extensive experiments and ablation studies demonstrate that the mandated E-F-A sequence is critical to performance, significantly outperforming both the baseline and incomplete or improperly ordered architectures. In practice, enhancement is applied prior to fusion to attenuate noise and blur that would otherwise be amplified by cross-scale aggregation, and final alignment corrects mis-registrations to avoid sampling extraneous signals from occluding materials. Full article

Pushbroom hyperspectral imaging (HSI) systems intrinsically measure our surroundings by leveraging 1D spatial imaging, where each pixel contains a unique spectrum of the observed materials. Spatial misregistration is an important property of HSI systems because it defines the spectral integrity of spatial pixels and requires characterization. The IEEE P4001 Standards Association committee has defined laboratory-based methods to test the ultimate limit of HSI systems but negates any impacts from mounting and flying the instruments on airborne platforms such as unmanned aerial vehicles (UAV’s) or drones. Our study was designed to demonstrate a novel vicarious technique using convex mirrors to bridge the gap between laboratory and field-based HSI performance testing with a focus on extracting hyperspectral spatial misregistration. A fast and simple extraction technique is proposed for estimating the sampled Point Spread Function’s width, along with keystone, as a function of wavelength for understanding the key contributors to hyperspectral spatial misregistration. With the ease of deploying convex mirrors, off-axis spatial misregistration is assessed and compared with on-axis behavior, where the best performance is often observed. In addition, convex mirrors provide an easy methodology to exploit ortho-rectification errors related to fixed pushbroom HSI systems, which we will show. The techniques discussed in this study are not limited to drone-based systems but can be easily applied to other airborne or satellite-based systems. Full article

In push-broom hyperspectral imaging systems, the sensor rotation to the optical plane leads to linear spatial misregistration (LSM) in hyperspectral images (HSIs). To compensate for hardware defects through software, this paper develops four methods to detect LSM in HSIs. Different from traditional methods for grayscale images, the method of fitting the sum of abundance (FSAM) and the method of searching for equal abundance (SEAM) are achieved by hyperspectral unmixing for a selected rectangular transition areas containing an edge, which makes good use of spatial and spectral information. The method based on line detection for band-interleaved-by-line (BIL) images (LDBM) and the method based on the Fourier transform of BIL images (FTBM) aim to characterize the slope of line structure in BIL images and get rid of the dependence on scene and wavelength. A full strategy is detailed from aspects of data selection, LSM detection, and image correction. The full spectrum airborne hyperspectral imager (FAHI) is China’s new generation push-broom scanner. The HSIs obtained by FAHI are tested and analyzed. Experiments on simulation data compare the four proposed methods with traditional methods and prove that FSAM outperforms other methods in terms of accuracy and stability. In experiments on real data, the application of the full strategy on FAHI verifies its effectiveness. This work not only provides reference for other push-broom imagers with similar problems, but also helps to reduce the requirement for hardware calibration. Full article

Background: Lung subtraction CT (LSCT), the subtraction of noncontrast CT from CT pulmonary angiography (CTPA) without spatial misregistration, is easily applicable by utilizing a software-based deformable image registration technique without additional hardware and permits the evaluation of lung perfusion as iodine accumulation, similar to that observed in perfusion lung single photon emission CT (PL-SPECT). The aim of this study was to use LSCT to newly assess the quantitative correlation between the CT value on LSCT and radioactive count on PL-SPECT as a reference and validate the quantification of lung perfusion by measuring the CT value in chronic thromboembolic pulmonary hypertension (CTEPH). Methods: We prospectively enrolled 47 consecutive patients with CTEPH undergoing both LSCT and PL-SPECT; we used noncontrast CT, CTPA, and LSCT to measure CT values and PL-SPECT to measure radioactive counts in areas representing three different perfusion classes—no perfusion defect, subsegmental perfusion defect, and segmental perfusion defect; we compared CT values on noncontrast CT, CTPA, and LSCT and radioactive counts on PL-SPECT among the three classes, then assessed the correlation between them. Results: Both the CT values and radioactive counts differed significantly among the three classes (p < 0.01 for all) and showed weak correlation (ρ = 0.38) by noncontrast CT, moderate correlation (ρ = 0.61) by CTPA, and strong correlation (ρ = 0.76) by LSCT. Conclusions: The CT value measurement on LSCT is a novel quantitative approach to assess lung perfusion in CTEPH and only correlates strongly with radioactive count measurement on PL-SPECT. Full article

To solve the problem of low detection accuracy of small objects in UAV optical remote sensing images due to low contrast, dense distribution, and weak features, this paper proposes a small object detection method based on feature alignment of candidate regions is proposed for remote sensing images. Firstly, AFA-FPN (Attention-based Feature Alignment FPN) defines the corresponding relationship between feature mappings, solves the misregistration of features between adjacent levels, and improves the recognition ability of small objects by aligning and fusing shallow spatial features and deep semantic features. Secondly, the PHDA (Polarization Hybrid Domain Attention) module captures local areas containing small object features through parallel channel domain attention and spatial domain attention. It assigns a larger weight to these areas to alleviate the interference of background noise. Then, the rotation branch uses RROI to rotate the horizontal frame obtained by RPN, which avoids missing detection of small objects with dense distribution and arbitrary direction. Next, the rotation branch uses RROI to rotate the horizontal box obtained by RPN. It solves the problem of missing detection of small objects with dense distribution and arbitrary direction and prevents feature mismatch between the object and candidate regions. Finally, the loss function is improved to better reflect the difference between the predicted value and the ground truth. Experiments are conducted on a self-made dataset. The experimental results show that the mAP of the proposed method reaches 82.04% and the detection speed reaches 24.3 FPS, which is significantly higher than that of the state-of-the-art methods. Meanwhile, the ablation experiment verifies the rationality of each module. Full article

Remote sensing products, such as land cover data products, are essential for a wide range of scientific studies and applications, and their quality evaluation and relative comparison have become a major issue that needs to be studied. Traditional methods, such as error matrices, are not effective in describing spatial distribution because they are based on a pixel-by-pixel comparison. In this paper, the relative quality comparison of two remote sensing products is turned into the difference measurement between the spatial distribution of pixels by proposing a max-sliced Wasserstein distance-based similarity index. According to optimal transport theory, the mathematical expression of the proposed similarity index is firstly clarified, and then its rationality is illustrated, and finally, experiments on three open land cover products (GLCFCS30, FROMGLC, CNLUCC) are conducted. Results show that based on this proposed similarity index-based relative quality comparison method, the spatial difference, including geometric shapes and spatial locations between two different remote sensing products in raster form, can be quantified. The method is particularly useful in cases where there exists misregistration between datasets, while pixel-based methods will lose their robustness. Full article

A band-to-band mis-registration (BBMR) error often occurs in remote sensing (RS) images acquired by multi-spectral push broom spectrometers such as the Sentinel-2 Multi-spectral Instrument (MSI), leading to adverse impacts on the reliability of further RS applications. Although the systematic band-to-band registration conducted during the image production process corrects most BBMR errors, there are still quite a few images being observed with discernible BBMR. Thus, a quick BBMR detection method is needed to assess the quality of online RS products. We here propose a hybrid framework for detecting BBMR between the visible bands in MSI images. This framework comprises three main steps: first, candidate chips are captured based on Google Earth Engine (GEE) spatial analysis functions to shrink the valid areas inside image scenes as potential target chips. The redundant data pertaining to the local operation process are thus narrowed down. Second, spectral abnormal areas are precisely extracted from inside every single chip, excluding the influences of clouds and water surfaces. Finally, the abnormal areas are matched pixel by pixel between bands, and the best-fit coordinates are then determined to compare with tolerance. Here, the proposed method was applied to 71,493 scenes of MSI Level-1C images covering China and its surrounding areas on the GEE platform. From these images, 4356 chips from 442 scenes were detected with inter-band offsets among the visible bands. Further manual visual inspection revealed that the proposed method had an accuracy of 98.07% at the chip scale and 88.46% at the scene scale. Full article

Multispectral imagery contains abundant spectral information on terrestrial and oceanic targets, and retrieval of the geophysical variables of the targets is possible when the radiometric integrity of the data is secured. Multispectral cameras typically require the registration of individual band images because their lens locations for individual bands are often displaced from each other, thereby generating images of different viewing angles. Although this type of displacement can be corrected through a geometric transformation of the image coordinates, a mismatch or misregistration between the bands still remains, owing to the image acquisition timing that differs by bands. Even a short time difference is critical for the image quality of fast-moving targets, such as water surfaces, and this type of deformation cannot be compensated for with a geometric transformation between the bands. This study proposes a novel morphological band registration technique, based on the quantile matching method, for which the correspondence between the pixels of different bands is not sought by their geometric relationship, but by the radiometric distribution constructed in the vicinity of the pixel. In this study, a Micasense Rededge-M camera was operated on an unmanned aerial vehicle and multispectral images of coastal areas were acquired at various altitudes to examine the performance of the proposed method for different spatial scales. To assess the impact of the correction on a geophysical variable, the performance of the proposed method was evaluated for the chlorophyll-a concentration estimation. The results showed that the proposed method successfully removed the noisy spatial pattern caused by misregistration while maintaining the original spatial resolution for both homogeneous scenes and an episodic scene with a red tide outbreak. Full article

Remote sensing image change detection (CD) is done to identify desired significant changes between bitemporal images. Given two co-registered images taken at different times, the illumination variations and misregistration errors overwhelm the real object changes. Exploring the relationships among different spatial–temporal pixels may improve the performances of CD methods. In our work, we propose a novel Siamese-based spatial–temporal attention neural network. In contrast to previous methods that separately encode the bitemporal images without referring to any useful spatial–temporal dependency, we design a CD self-attention mechanism to model the spatial–temporal relationships. We integrate a new CD self-attention module in the procedure of feature extraction. Our self-attention module calculates the attention weights between any two pixels at different times and positions and uses them to generate more discriminative features. Considering that the object may have different scales, we partition the image into multi-scale subregions and introduce the self-attention in each subregion. In this way, we could capture spatial–temporal dependencies at various scales, thereby generating better representations to accommodate objects of various sizes. We also introduce a CD dataset LEVIR-CD, which is two orders of magnitude larger than other public datasets of this field. LEVIR-CD consists of a large set of bitemporal Google Earth images, with 637 image pairs (1024 × 1024) and over 31 k independently labeled change instances. Our proposed attention module improves the F1-score of our baseline model from 83.9 to 87.3 with acceptable computational overhead. Experimental results on a public remote sensing image CD dataset show our method outperforms several other state-of-the-art methods. Full article

Proper satellite-based crop monitoring applications at the farm-level often require near-daily imagery at medium to high spatial resolution. The combination of data from different ongoing satellite missions Sentinel 2 (ESA) and Landsat 7/8 (NASA) provides this unprecedented opportunity at a global scale; however, this is rarely implemented because these procedures are data demanding and computationally intensive. This study developed a robust stream processing for the harmonization of Landsat 7, Landsat 8 and Sentinel 2 in the Google Earth Engine cloud platform, connecting the benefit of coherent data structure, built-in functions and computational power in the Google Cloud. The harmonized surface reflectance images were generated for two agricultural schemes in Bekaa (Lebanon) and Ninh Thuan (Vietnam) during 2018–2019. We evaluated the performance of several pre-processing steps needed for the harmonization including the image co-registration, Bidirectional Reflectance Distribution Functions correction, topographic correction, and band adjustment. We found that the misregistration between Landsat 8 and Sentinel 2 images varied from 10 m in Ninh Thuan (Vietnam) to 32 m in Bekaa (Lebanon), and posed a great impact on the quality of the final harmonized data set if not treated. Analysis of a pair of overlapped L8-S2 images over the Bekaa region showed that, after the harmonization, all band-to-band spatial correlations were greatly improved. Finally, we demonstrated an application of the dense harmonized data set for crop mapping and monitoring. An harmonic (Fourier) analysis was applied to fit the detected unimodal, bimodal and trimodal shapes in the temporal NDVI patterns during one crop year in Ninh Thuan province. The derived phase and amplitude values of the crop cycles were combined with max-NDVI as an R-G-B false composite image. The final image was able to highlight croplands in bright colors (high phase and amplitude), while the non-crop areas were shown with grey/dark (low phase and amplitude). The harmonized data sets (with 30 m spatial resolution) along with the Google Earth Engine scripts used are provided for public use. Full article

Translational motion of a target will lead to image misregistration in interferometric inverse synthetic aperture radar (InISAR) imaging. In this paper, a strong scattering centers fusion (SSCF) technique is proposed to estimate translational motion parameters of a maneuvering target. Compared to past InISAR image registration methods, the SSCF technique is advantageous in its high computing efficiency, excellent antinoise performance, high registration precision, and simple system structure. With a one-input three-output terahertz InISAR system, translational motion parameters in both the azimuth and height direction are precisely estimated. Firstly, the motion measurement curves are extracted from the spatial spectrums of mutually independent strong scattering centers, which avoids the unfavorable influences of noise and the “angle scintillation” phenomenon. Then, the translational motion parameters are obtained by fitting the motion measurement curves with phase unwrapping and intensity-weighted fusion processing. Finally, ISAR images are registered precisely by compensating the estimated translational motion parameters, and high-quality InISAR imaging results are achieved. Both simulation and experimental results are used to verify the validity of the proposed method. Full article

Despite increases in the spatial resolution of satellite imagery prompting interest in object-based image analysis, few studies have used object-based methods for monitoring changes in coral reefs. This study proposes a high accuracy object-based change detection (OBCD) method intended for coral reef environment, which uses QuickBird and WorldView-2 images. The proposed methodological framework includes image fusion, multi-temporal image segmentation, image differencing, random forests models, and object-area-based accuracy assessment. For validation, we applied the method to images of four coral reef study sites in the South China Sea. We compared the proposed OBCD method with a conventional pixel-based change detection (PBCD) method by implementing both methods under the same conditions. The average overall accuracy of OBCD exceeded 90%, which was approximately 20% higher than PBCD. The OBCD method was free from salt-and-pepper effects and was less prone to images misregistration in terms of change detection accuracy and mapping results. The object-area-based accuracy assessment reached a higher overall accuracy and per-class accuracy than the object-number-based and pixel-number-based accuracy assessment. Full article