Search Results (85)

Atmospheric turbulence severely degrades high-resolution satellite videos through spatiotemporally coupled distortions, including temporal jitter, spatial-variant blur, deformation, and scintillation, thereby constraining downstream analytical capabilities. Restoring turbulence-corrupted videos poses a challenging ill-posed inverse problem due to the inherent randomness of turbulent fluctuations. While existing turbulence mitigation methods for long-range imaging demonstrate partial success, they exhibit limited generalizability and interpretability in large-scale satellite scenarios. Inspired by refractive-index structure constant ($C_n^2$) estimation from degraded sequences, we propose a physics-informed turbulence signature (TS) prior that explicitly captures spatiotemporal distortion patterns to enhance model transparency. Integrating this prior into a lucky imaging framework, we develop a Physics-Based Turbulence Mitigation Network guided by Turbulence Signature (TMTS) to disentangle atmospheric disturbances from satellite videos. The framework employs deformable attention modules guided by turbulence signatures to correct geometric distortions, iterative gated mechanisms for temporal alignment stability, and adaptive multi-frame aggregation to address spatially varying blur. Comprehensive experiments on synthetic and real-world turbulence-degraded satellite videos demonstrate TMTS’s superiority, achieving 0.27 dB PSNR and 0.0015 SSIM improvements over the DATUM baseline while maintaining practical computational efficiency. By bridging turbulence physics with deep learning, our approach provides both performance enhancements and interpretable restoration mechanisms, offering a viable solution for operational satellite video processing under atmospheric disturbances. Full article

While deep learning-based image matching methods excel at extracting high-level semantic features from remote sensing data, their performance degrades significantly under cross-daylight conditions and wide-baseline geometric distortions, particularly in multi-source street-view scenarios. This paper presents a novel illumination-invariant framework that synergistically integrates geometric topology and semantic consistency to achieve robust multi-view matching for cross-daylight urban perception. We first design a self-supervised learning paradigm to extract illumination-agnostic features by jointly optimizing local descriptors and global geometric structures across multi-view images. To address extreme perspective variations, a homography-aware transformation module is introduced to stabilize feature representation under large viewpoint changes. Leveraging a graph neural network with hierarchical attention mechanisms, our method dynamically aggregates contextual information from both local keypoints and semantic topology graphs, enabling precise matching in occluded regions and repetitive-textured urban scenes. A dual-branch learning strategy further refines similarity metrics through supervised patch alignment and unsupervised spatial consistency constraints derived from Delaunay triangulation. Finally, a topology-guided multi-plane expansion mechanism propagates initial matches by exploiting the inherent structural regularity of street scenes, effectively suppressing mismatches while expanding coverage. Extensive experiments demonstrate that our framework outperforms state-of-the-art methods, achieving a 6.4% improvement in matching accuracy and a 30.5% reduction in mismatches under cross-daylight conditions. These advancements establish a new benchmark for reliable multi-source image retrieval and localization in dynamic urban environments, with direct applications in autonomous driving systems and large-scale 3D city reconstruction. Full article

Oil seals are vital components in industrial production, necessitating high-precision 3D reconstruction for automated geometric measurement and quality inspection. High-quality point cloud completion is integral to this process. However, existing methods heavily rely on large datasets and often yield sub-optimal outcomes—such as distorted geometry and uneven point distributions—under limited sample conditions, constraining their industrial applicability. To address this, we propose a point cloud completion network that integrates a dynamic weighted fusion of multi-scale features with Transformer enhancements. Our approach incorporates three key innovations: a multi-layer perceptron fused with EdgeConv to enhance local feature extraction for small-sample oil seal rings, a dynamic weighted fusion strategy to adaptively optimize global feature integration across varying missing rates of oil seal rings, and a Transformer-enhanced multi-layer perceptron to ensure geometric consistency by linking global and local features. These innovations collectively enable high-quality point cloud completion for small-sample oil seal rings, achieving significant improvements at a 25% missing rate, reducing CD by 46%, EMD by 49%, and MMD by 74% compared to PF-Net. Experiments on the ShapeNet-Part dataset further validate the model’s strong generalizability across diverse categories. Experimental results on the industrial oil seal ring dataset and the small-sample ShapeNet sub-dataset show that our approach exhibits highly competitive performance compared to existing models. Full article

Airborne hyperspectral LiDAR (AHSL) is a technology that integrates the spectral content collected using hyperspectral imaging and the precise 3D descriptions of observed objects obtained using LiDAR (light detection and ranging). AHSL detects the spectral and three-dimensional (3D) information on an object simply using laser measurements. Nevertheless, the advantageous richness of spectral properties also introduces novel issues into the scan unit, the mechanical–optical trade-off. Specifically, the abundant spectral information requires a larger optical aperture, limiting the acceptance of the mechanic load by the scan unit at a demanding rotation speed and flight height. Via the simulation and analysis of scan models, it is exhibited that Palmer scans fit the large optical aperture required by AHSL best. Furthermore, based on the simulation of the Palmer scan model, 45.23% is explored as the optimized ratio of overlap (ROP) for minimizing the diversity of the point density, with a reduction in the coefficient of variation (CV) from 0.47 to 0.19. The other issue is that it is intricate to calibrate the scanning geometry using outside devices due to the complex optical path. A self-calibration strategy is proposed for tackling this problem, which integrates indoor laser vector retrieval and airborne orientation correction. The strategy is composed of the following three improvements: (1) A self-determined laser vector retrieval strategy that utilizes the self-ranging feature of AHSL itself is proposed for retrieving the initial scanning laser vectors with a precision of 0.874 mrad. (2) A linear residual estimated interpolation method (LREI) is proposed for enhancing the precision of the interpolation, reducing the RMSE from 1.517 mrad to 0.977 mrad. Compared to the linear interpolation method, LREI maintains the geometric features of Palmer scanning traces. (3) A least-deviated flatness restricted optimization (LDFO) algorithm is used to calibrate the angle offset in aerial scanning point cloud data, which reduces the standard deviation in the flatness of the scanning plane from 1.389 m to 0.241 m and reduces the distortion of the scanning strip. This study provides a practical scanning method and a corresponding calibration strategy for AHSL. Full article

DEMs derived from Interferometric Synthetic Aperture Radar (InSAR) imagery are frequently influenced by multiple factors, resulting in systematic horizontal and elevation inaccuracies that affect their applicability in large-scale scenarios. To mitigate this problem, this study employs affine models and polynomial function models to refine the relative planar precision and elevation accuracy of the DEM. To acquire high-quality control data for the adjustment model, this study introduces a DEM feature matching method that maintains invariance to geometric distortions, utilizing filtered ICESat-2 ATL08 data as elevation control to enhance accuracy. We first validate the effectiveness and features of the proposed InSAR-DEM matching algorithm and select 45 ALOS high-resolution DEM scenes with different terrain features for large-scale DEM block adjustment experiments. Additionally, we select additional Sentinel-1 and Copernicus DEM data to verify the reliability of multi-source DEM matching and adjustment. The experimental results indicate that elevation errors across different study areas were reduced by approximately 50% to 5%, while the relative planar accuracy improved by around 93% to 17%. The TPs extraction method for InSAR-DEM proposed in this paper is more accurate at the sub-pixel level compared to traditional sliding window matching methods and is more robust in the case of non-uniform geometric deformations. Full article

An Earth system spatial grid (ESSG) is an extension of a discrete global grid system (DGGS) in the radial direction. It is an important tool for organizing, representing, simulating, analyzing, sharing, and visualizing spatial data. The existing ESSGs suffer from complex spatial relationships and significant geometric distortion. To mitigate these problems, a spherical geodesic degenerate octree grid (SGDOG) and its encoding and decoding schemes are proposed in this paper. The SGDOG extends the great circle arc QTM in the radial direction and adopts different levels of the great circle arc QTM at different radial depths. The subdivision of SGDOG is simple and clear, and has multi-level characteristics. The experimental results demonstrate that the SGDOG has advantages of simple spatial relationships, convergent volume distortion, and real-time encoding and decoding. The SGDOG has the potential to organize and manage global spatial data and perform large-scale visual analysis of the Earth system. Full article

Side-scan sonar and multi-beam echo sounder (MBES) are the most widely used underwater surveying tools in marine mapping today. The MBES offers high accuracy in depth measurement but is limited by low imaging resolution due to beam density constraints. Conversely, side-scan sonar provides high-resolution backscatter intensity images but lacks precise positional information and often suffers from distortions. Thus, MBES and side-scan images complement each other in depth accuracy and imaging resolution. To obtain high-quality seafloor topography images in practice, matching between MBES and side-scan images is necessary. However, due to the significant differences in content and resolution between MBES depth images and side-scan backscatter images, they represent a typical example of heterogeneous images, making feature matching difficult with traditional image matching methods. To address this issue, this paper proposes a feature matching network based on the LoFTR algorithm, utilizing the intermediate layers of the ResNet-50 network to extract shared features between the two types of images. By leveraging self-attention and cross-attention mechanisms, the features of the MBES and side-scan images are combined, and a similarity matrix of the two modalities is calculated to achieve mutual matching. Experimental results show that, compared to traditional methods, the proposed model exhibits greater robustness to noise interference and effectively reduces noise. It also overcomes challenges, such as large nonlinear differences, significant geometric distortions, and high matching difficulty between the MBES and side-scan images, significantly improving the optimized image matching results. The matching error RMSE has been reduced to within six pixels, enabling the accurate matching of multi-beam and side-scan images. Full article

Optical image sequences of spacecraft acquired by space-based monocular cameras are typically imaged through exposure bracketing. The spacecraft feature deformable alignment network for multi-exposure image fusion (SFDA-MEF) aims to synthesize a High Dynamic Range (HDR) spacecraft image from a set of Low Dynamic Range (LDR) images with varying exposures. The HDR image contains details of the observed target in LDR images captured within a specific luminance range. The relative attitude of the spacecraft in the camera coordinate system undergoes continuous changes during the orbital rendezvous, which leads to a large proportion of moving pixels between adjacent frames. Concurrently, subsequent tasks of the In-Orbit Servicing (IOS) system, such as attitude estimation, are highly sensitive to variations in multi-view geometric relationships, which means that the fusion result should preserve the shape of the spacecraft with minimal distortion. However, traditional methods and unsupervised deep-learning methods always exhibit inherent limitations in dealing with complex overlapping regions. In addition, supervised methods are not suitable when ground truth data are scarce. Therefore, we propose an unsupervised learning framework for the multi-exposure fusion of optical spacecraft image sequences. We introduce a deformable convolution in the feature deformable alignment module and construct an alignment loss function to preserve its shape with minimal distortion. We also design a feature point extraction loss function to render our output more conducive to subsequent IOS tasks. Finally, we present a multi-exposure spacecraft image dataset. Subjective and objective experimental results validate the effectiveness of SFDA-MEF, especially in retaining the shape of the spacecraft. Full article

A bistatic synthetic aperture radar (BiSAR) system with a Medium-Earth-Orbit (MEO) SAR transmitter and high-maneuvering receiver (MEO/HM-BiSAR) can achieve a wide swath and high resolution. However, due to the complex orbit characteristics and the nonlinear trajectory of the receiver, MEO/HM-BiSAR high-resolution imaging faces two major challenges. First, the complex geometric configuration of the BiSAR platforms is difficult to model accurately, and the ‘non-stop-go’ effects should also be considered. Second, non-negligible wavefront curvature caused by the nonlinear trajectories introduces residual phase errors. The existing spaceborne BiSAR imaging algorithms often suffer from image defocusing if applied to MEO/HM-BiSAR. To address these problems, a novel high-resolution imaging algorithm named MSSWCC (Modified Second-Order Space-Variant Wavefront Curvature Correction) is proposed. First, a high-precision range model is established based on an analysis of MEO SAR’s orbital characteristics and the receiver’s curved trajectory. Based on the echo model, the wavefront curvature error is then addressed by two-dimensional Taylor expansion to obtain the analytical expressions for the high-order phase errors. By analyzing the phase errors in the wavenumber domain, the compensation functions can be designed. The MSSWCC algorithm not only corrects the geometric distortion through reverse projection, but it also compensates for the second-order residual spatial-variant phase errors by the analytical expressions for the two-dimensional phase errors. It can achieve high-resolution imaging ability in large imaging scenes with low computational load. Simulations and real experiments validate the high-resolution imaging capabilities of the proposed MSSWCC algorithm in MEO/HM-BiSAR. Full article

Laser Hot Wire (LHW) Directed Energy Deposition (DED) Additive Manufacturing (AM) processes are capable of manufacturing parts with a high deposition rate. There is a growing research interest in replacing large cast Nickel Aluminum Bronze (NAB) components using LHW DED processes for maritime applications. Understanding thermomechanical behavior during LHW DED of NAB is a critical step towards the production of high-quality NAB parts with desired performance and properties. In this paper, finite element simulations are first used to predict the thermomechanical time histories during LHW DED of NAB test coupons with an increasing geometric complexity, including single-layer and multilayer depositions. Simulation results are experimentally validated through in situ measurements of temperatures at multiple locations in the substrate as well as displacement at the free end of the substrate during and immediately following the deposition process. The results in this paper demonstrate that the finite element predictions have good agreement with the experimental measurements of both temperature and distortion history. The maximum prediction error for temperature is 5% for single-layer samples and 6% for multilayer samples, while the distortion prediction error is about 12% for single-layer samples and less than 4% for multilayer samples. In addition, this study shows the effectiveness of including a stress relaxation temperature at 500 °C during FE modeling to allow for better prediction of the low cross-layer accumulation of distortion in multilayer deposition of NAB. Full article

Short-range MEMS-based (Micro Electronical Mechanical System) LiDAR provides precise point cloud datasets for rock fragment surfaces. However, there is more vibrational noise in MEMS-based LiDAR signals, which cannot guarantee that the reconstructed point cloud data are not distorted with a high compression ratio. Many studies have illustrated that wavelet-based clustered compressive sensing can improve reconstruction precision. The k-means clustering algorithm can be conveniently employed to obtain clusters; however, estimating a meaningful k value (i.e., the number of clusters) is challenging. An excessive quantity of clusters is not necessary for dense point clouds, as this leads to elevated consumption of memory and CPU resources. For sparser point clouds, fewer clusters lead to more distortions, while excessive clusters lead to more voids in reconstructed point clouds. This study proposes a local clustering method to determine a number of clusters closer to the actual number based on GMM (Gaussian Mixture Model) observation distances and density peaks. Experimental results illustrate that the estimated number of clusters is closer to the actual number in four datasets from the KEEL public repository. In point cloud compression and recovery experiments, our proposed approach compresses and recovers the Bunny and Armadillo datasets in the Stanford 3D repository; the experimental results illustrate that our proposed approach improves reconstructed point clouds’ geometry and curvature similarity. Furthermore, the geometric similarity increases to 0.9 above in our complete rock fragment surface datasets after selecting a better wavelet basis for each dimension of MEMS-based LiDAR signals. In both experiments, the sparsity of signals was 0.8 and the sampling ratio was 0.4. Finally, a rock outcrop point cloud data experiment is utilized to verify that the proposed approach is applicable for large-scale research objects. All of our experiments illustrate that the proposed adaptive clustered compressive sensing approach can better reconstruct MEMS-based LiDAR point clouds with a lower sampling ratio. Full article

Experimental analysis on small-scale models is widely used to predict the dynamic responses of full-scale structures subjected to impact loads. However, due to manufacturing constraints, achieving a perfectly scaled model under a large scaling factor is challenging, leading to the use of distorted scaled models as a compromise. This paper introduces an improved similarity law that ensures distorted scaled models accurately replicate the dynamic responses of prototype stiffened plates under impact loads. The proposed similarity law meticulously considers both the distorted attached plate thickness and variations in stiffener configuration. Double input parameters involving the load case and geometry are formulated to govern the dynamic responses of integrated stiffeners. Additionally, an approximate method rooted in elastic–plastic theory is developed to assess the dominant behaviors of stiffened plates during impact. Consequently, the distorted stiffener configuration of scaled models is designed through a methodology primarily centered on capturing dominant behaviors. Comprehensive numerical simulations are conducted to evaluate the behavior of stiffened plates subjected to impact loads. The results compellingly demonstrate that the proposed similarity law adeptly compensates for geometric distortions, ensuring reliable predictions of dynamic responses in distorted scaled models. Full article

For the purpose of achieving long-range, high-resolution, and ultra-wide-swath airborne earth imaging at extremely low-light levels (0.01 Lux), a low-light imaging system built on multi-detector optical butting was researched. Having decomposed the system’s specifications and verified its low-light imaging capability, we proposed to employ an optical system with a large relative aperture and low distortion and achieve imaging through the field-of-view (FOV) butting facilitated by eight 1080P high-sensitivity scientific complementary metal-oxide semiconductor (SCMOS) detectors. This paper elaborates on the design concept of the mechanical configuration of the imaging system; studies the calculation method of the structural parameters of the reflection prism; provides mathematical expressions for geometric parameters, such as the length and width of the splicing prism; and designs in detail the splicing structure of six reflection prisms for eight-channel beam splitting. Based on the design and computational results, a high-resolution, wide-swath imaging system for an ambient illuminance of 0.01 Lux was developed. Exhibiting a ground sampling distance (GSD) of 0.5 m (at a flight height of 5 km), this low-light imaging system keeps the FOV overlap ratio between adjacent detectors below 3% and boasts an effective image resolution of 4222 × 3782. The results from flight testing revealed that the proposed imaging system is capable of generating wide-swath, high-contrast resolution imagery under airborne and low-light conditions. As such, the way the system is prepared can serve as a reference point for the development of airborne low-light imaging devices. Full article

Effective features play an important role in synthetic aperture radar (SAR) image interpretation. However, since SAR images contain a variety of terrain types, it is not easy to extract effective features of different terrains from SAR images. Deep learning methods require a large amount of labeled data, but the difficulty of SAR image annotation limits the performance of deep learning models. SAR images have inevitable geometric distortion and coherence speckle noise, which makes it difficult to extract effective features from SAR images. If effective semantic context features cannot be learned for SAR images, the extracted features struggle to distinguish different terrain categories. Some existing terrain classification methods are very limited and can only be applied to some specified SAR images. To solve these problems, a jigsaw puzzle self-supervised learning (JPSSL) framework is proposed. The framework comprises a jigsaw puzzle pretext task and a terrain classification downstream task. In the pretext task, the information in the SAR image is learned by completing the SAR image jigsaw puzzle to extract effective features. The terrain classification downstream task is trained using only a small number of labeled data. Finally, fully connected conditional random field processing is performed to eliminate noise points and obtain a high-quality terrain classification result. Experimental results on three large-scene high-resolution SAR images confirm the effectiveness and generalization of our method. Compared with the supervised methods, the features learned in JPSSL are highly discriminative, and the JPSSL achieves good classification accuracy when using only a small amount of labeled data. Full article

Additive manufacturing (AM) by using direct metal deposition (DMD) often causes erratic distortion patterns, especially on large parts. This study presents a systematic distortion analysis by employing numerical approaches using transient–thermal and structural simulations, experimental approaches using tomography, X-ray diffraction (XRD), and an analytical approach calculating the buckling distortion of a piston. The most essential geometrical features are thin walls situated between massive rings. An eigenvalue buckling analysis, a DMD process, and heat treatment simulation are presented. The eigenvalue buckling simulation shows that it is highly dependent on the mesh size. The computational effort of the DMD and heat treatment simulation was reduced through simplifications. Moreover, artificial imperfections were imposed in the heat treatment simulation, which moved the part into the buckling state inspired by the experiment. Although the numerical results of both simulations are successful, the eigenvalue and DMD simulation cannot be validated through tomography and XRD. This is because tomography is unable to measure small elastic strain fields, the simulated residual stresses were overestimated, and the part removal disturbed the residual stress equilibrium. Nevertheless, the heat treatment simulation can predict the distortion pattern caused by an inhomogeneous temperature field during ambient cooling in an oven. The massive piston skirt cools down and shrinks faster than the massive core. The reduced yield strength at elevated temperatures and critical buckling load leads to plastic deformation of the thin walls. Full article