Search Results (66)

Timely and accurate detection of forest fires through unmanned aerial vehicle (UAV) remote sensing target detection technology is of paramount importance. However, multiscale targets and complex environmental interference in UAV remote sensing images pose significant challenges during detection tasks. To address these obstacles, this paper presents FF-Mamba-YOLO, a novel framework based on the principles of Mamba and YOLO (You Only Look Once) that leverages innovative modules and architectures to overcome these limitations. Specifically, we introduce MFEBlock and MFFBlock based on state space models (SSMs) in the backbone and neck parts of the network, respectively, enabling the model to effectively capture global dependencies. Second, we construct CFEBlock, a module that performs feature enhancement before SSM processing, improving local feature processing capabilities. Furthermore, we propose MGBlock, which adopts a dynamic gating mechanism, enhancing the model’s adaptive processing capabilities and robustness. Finally, we enhance the structure of Path Aggregation Feature Pyramid Network (PAFPN) to improve feature fusion quality and introduce DySample to enhance image resolution without significantly increasing computational costs. Experimental results on our self-constructed forest fire image dataset demonstrate that the model achieves 67.4% mAP@50, 36.3% mAP@50:95, and 64.8% precision, outperforming previous state-of-the-art methods. These results highlight the potential of FF-Mamba-YOLO in forest fire monitoring. Full article

Advancements in artificial intelligence have significantly enhanced communication for individuals with hearing impairments. This study presents a robust cross-lingual Sign Language Recognition (SLR) framework for Turkish, American English, and Arabic sign languages. The system utilizes the lightweight MediaPipe library for efficient hand landmark extraction, ensuring stable and consistent feature representation across diverse linguistic contexts. Datasets were meticulously constructed from nine public-domain sources (four Arabic, three American, and two Turkish). The final training data comprises curated image datasets, with frames for each language carefully selected from varying angles and distances to ensure high diversity. A comprehensive comparative evaluation was conducted across three state-of-the-art deep learning architectures—ConvNeXt (CNN-based), Swin Transformer (ViT-based), and Vision Mamba (SSM-based)—all applied to identical feature sets. The evaluation demonstrates the superior performance of contemporary vision Transformers and state space models in capturing subtle spatial cues across diverse sign languages. Our approach provides a comparative analysis of model generalization capabilities across three distinct sign languages, offering valuable insights for model selection in pose-based SLR systems. Full article

Source camera identification relies on sensor noise features to distinguish between different devices, but large-scale sample labeling is time-consuming and labor-intensive, making it difficult to implement in real-world applications. The noise residuals generated by different camera sensors exhibit statistical asymmetry, and the structured patterns within these residuals also show local symmetric relationships. Together, these features form the theoretical foundation for camera source identification. To address the problem of limited labeled data under few-shot conditions, this paper proposes a Cross-correlation Guided Augmentation and Prediction with Hybrid Bidirectional State-Space Model Attention (CGAP-HBSA) framework, based on the aforementioned symmetry-related theoretical foundation. The method extracts symmetric correlation structures from unlabeled samples and converts them into reliable pseudo-labeled samples. Furthermore, the HBSA network jointly models symmetric structures and asymmetric variations in camera fingerprints using a bidirectional SSM module and a hybrid attention mechanism, thereby enhancing long-range spatial modeling capabilities and recognition robustness. In the Dresden dataset, the proposed method achieves an identification accuracy for the 5-shot camera source identification task that is only 0.02% lower than the current best-performing method under few-shot conditions, MDM-CPS, and outperforms other classical few-shot camera source identification methods. In the 10-shot task, the method improves by at least 0.3% compared to MDM-CPS. In the Vision dataset, the method improves the identification accuracy in the 5-shot camera source identification task by at least 6% compared to MDM-CPS, and in the 10-shot task, it improves by at least 3% over the best-performing MDM-CPS method. Experimental results demonstrate that the proposed method achieves competitive or superior performance in both 5-shot and 10-shot settings. Additional robustness experiments further confirm that the HBSA network maintains strong performance even under image compression and noise contamination conditions. Full article

Surface soil moisture (SSM) is essential for crop growth, irrigation management, and drought monitoring. However, conventional field-based measurements offer limited spatial and temporal coverage, making it difficult to capture environmental variability at scale. This study introduces a multimodal soil moisture estimation framework that combines synthetic aperture radar (SAR), optical imagery, vegetation indices, digital elevation models (DEM), meteorological data, and spatio-temporal metadata. To strengthen model performance and adaptability, an intermediate fine-tuning strategy is applied to two datasets comprising 10,571 images and 3772 samples. This approach improves generalization and transferability across regions. The framework is evaluated across diverse agro-ecological zones, including farmlands, alpine grasslands, and environmentally fragile areas, and benchmarked against single-modality methods. Results with RMSE 4.5834% and $R^2$ 0.8956 show consistently high accuracy and stability, enabling the production of reliable field-scale soil moisture maps. By addressing the spatial and temporal challenges of soil monitoring, this framework provides essential information for precision irrigation. It supports site-specific water management, promotes efficient water use, and enhances drought resilience at both farm and regional scales. Full article

The growth of aquaculture poses significant challenges for disease management, impacting economic sustainability and global food security. Traditional diagnostics are slow and require expertise, while current deep learning models, including CNNs and Transformers, face a trade-off between capturing global symptom context and maintaining computational efficiency. This paper introduces FishMambaNet, a novel framework that integrates selective state space models (SSMs) with convolutional networks for accurate and efficient fish disease diagnosis. FishMambaNet features two core components: the Fish Disease Detection State Space block (FSBlock), which models long-range symptom dependencies via SSMs while preserving local details with gated convolutions, and the Multi-Scale Convolutional Attention (MSCA) mechanism, which enriches multi-scale feature representation with low computational cost. Experiments demonstrate state-of-the-art performance, with FishMambaNet achieving a mean Average Precision at 50% Intersection over Union (mAP@50) of 86.7% using only 4.3 M parameters and 10.7 GFLOPs, significantly surpassing models like YOLOv8-m and RT-DETR. This work establishes a new paradigm for lightweight, powerful disease detection in aquaculture, offering a practical solution for real-time deployment in resource-constrained environments. Full article

Accurate soybean mapping is critical for food–oil security and cropping assessment, yet spatiotemporal heterogeneity arising from fragmented parcels and phenological variability reduces class separability and robustness. This study aims to deliver a high-resolution, reusable pipeline and quantify the marginal benefits of feature selection and architecture design. We built a full-season multi-temporal Sentinel-1/2 stack and derived candidate optical/SAR features (raw bands, vegetation indices, textures, and polarimetric terms). Jeffries–Matusita (JM) distance was used for feature–phase joint selection, producing four comparable feature sets. We propose a lightweight APM-UNet: an Attention Sandglass Layer (ASL) in the shallow path to enhance texture/boundary details, and a Parallel Vision Mamba layer (PVML with Mamba-SSM) in the middle/bottleneck to model long-range/global context with near-linear complexity. Under a unified preprocessing and training/evaluation protocol, the four feature sets were paired with U-Net, SegFormer, Vision-Mamba, and APM-UNet, yielding 16 controlled configurations. Results showed consistent gains from JM-guided selection across architectures; given the same features, APM-UNet systematically outperformed all baselines. The best setup (JM-selected composite features + APM-UNet) achieved PA 92.81%, OA 97.95, Kappa 0.9649, Recall 91.42%, IoU 0.7986, and F1 0.9324, improving PA and OA by ~7.5 and 6.2 percentage points over the corresponding full-feature counterpart. These findings demonstrate that JM-guided, phenology-aware features coupled with a lightweight local–global hybrid network effectively mitigate heterogeneity-induced uncertainty, improving boundary fidelity and overall consistency while maintaining efficiency, offering a potentially transferable framework for soybean mapping in complex agricultural landscapes. Full article

Although surface soil moisture (SSM) is particularly important in crop yield prediction, irrigation scheduling optimization, and runoff generation mechanisms, accurate monitoring of time-series SSM is still challenging for agricultural and hydrological research. This study presented an improved approach integrating Sentinel-1 C-band SAR and MODIS optical data (2019–2020) to estimate surface soil moisture. To address vegetation effects, we developed a piecewise function using fractional vegetation coverage (FVC) to correct soil moisture and backscatter extrema and established the normalized difference enhanced vegetation index (NDEVI) to characterize backscatter-vegetation relationships across various land covers. Furthermore, the Density-Based Spatial Clustering of Applications with Noise (DBSCAN) algorithm identified anomalous surface changes, enabling segmentation of long-term series into invariant periods that satisfy the change detection method assumptions. Validation in the Shandian River Basin demonstrated significant improvement over traditional methods, achieving determination coefficients (R²) of 0.844 and root mean square errors (RMSE) of 0.030 m³/m³. The method effectively captured soil moisture dynamics from precipitation and irrigation events, providing reliable monitoring in heterogeneous landscapes. This integrated approach offers a robust technical framework for multi-source remote sensing of soil moisture in semi-arid areas, enhancing capability for agricultural water resource management. Full article

With the increasing demand for higher precision and real-time performance in industrial surface defect detection, multimodal detection methods integrating RGB images and 3D point clouds have drawn considerable attention. However, current mainstream methods typically employ computationally expensive Transformer-based models for capturing global features, resulting in significant inference delays that hinder their practical deployment for online inspection tasks. Furthermore, existing approaches exhibit limited capability in deep cross-modal interactions, negatively impacting defect detection and segmentation accuracy. In this paper, we propose a novel multimodal anomaly detection framework based on a bidirectional Mamba network to enhance cross-modal feature interaction and fusion. Specifically, we introduce an anomaly-aware parallel feature extraction network, leveraging a hybrid scanning state space model (SSM) to efficiently capture global and long-range dependencies with linear computational complexity. Additionally, we develop a cross-enhanced feature fusion module to facilitate dynamic interaction and adaptive fusion of multimodal features at multiple scales. Extensive experiments conducted on two publicly available benchmark datasets, MVTec 3D-AD and Eyecandies, demonstrate that the proposed method consistently outperforms existing approaches in both defect detection and segmentation tasks. Full article

Soil moisture plays a crucial role in hydrological processes and serves as a key driver of rainfall-induced landslides, especially in regions with steep terrain and intense precipitation. Traditional landslide risk models often oversimplify soil moisture and infiltration dynamics, which limits their predictive accuracy. This study presents a deep learning-based framework for generating high-resolution, spatiotemporal Surface Soil Moisture (SSM) maps for Prince George’s County, Maryland—a region highly susceptible to rainfall-triggered landslides—aimed at improving infiltration modeling and landslide prediction. A Convolutional Long Short-Term Memory (ConvLSTM) network integrates static spatial features (elevation, slope, soil type) with multi-temporal meteorological variables (precipitation, temperature, humidity, wind speed, evapotranspiration) and vegetation indices. The model is trained using dense SSM maps derived from Sentinel-1 SAR data processed through a change detection algorithm, providing a physically meaningful alternative to sparse in-situ observations. To address data imbalance, a two-pass patch extraction strategy was implemented to enhance representation of high-SSM conditions. The framework leverages high-performance computing resources to process large-scale, multi-temporal raster datasets efficiently. Evaluation results show strong predictive performance, with the two-day model achieving ${\mathrm{R}}^2$ = 0.72, correlation = 0.85, RMSE = 0.154, and MAE = 0.103. The results demonstrate the model’s capability to produce fine-resolution, wall-to-wall SSM maps that capture the spatial and temporal dynamics of surface soil moisture, supporting the development of early warning systems and landslide hazard mitigation strategies. Full article

Hyperspectral imagery (HSI), characterized by the integration of both spatial and spectral information, is widely employed in various fields, such as environmental monitoring, geological exploration, precision agriculture, and medical imaging. Hyperspectral image classification (HSIC), as a key research direction, aims to establish a mapping relationship between pixels and land-cover categories. Nevertheless, several challenges persist, including difficulties in feature extraction, the trade-off between effective integration of local and global features, and spectral redundancy. We propose FreqMamba, a novel model that efficiently combines CNN, a custom attention mechanism, and the Mamba architecture. The proposed framework comprises three key components: (1) A novel multi-scale deformable convolution feature extraction module equipped with spectral attention, which processes spectral and spatial information through a dual-branch structure to enhance feature representation for irregular terrain contours; (2) a novel group-separated attention module that integrates group convolution with group-separated self-attention, effectively balancing local feature extraction and global contextual modeling; (3) a newly introduced bidirectional scanning Mamba branch that efficiently captures long-range dependencies with linear computational complexity. The proposed method achieves optimal performance on multiple benchmark datasets, including QUH-Tangdaowan, QUH-Qingyun, and QUH-Pingan, with the highest overall accuracy reaching 97.47%, average accuracy reaching 93.52%, and a Kappa coefficient of 96.22%. It significantly outperforms existing CNN, Transformer, and SSM-based methods, demonstrating its effectiveness, robustness, and superior generalization capability. Full article

Background and Objective: Accurate classification of standard fetal ultrasound planes is a critical step in prenatal diagnostics, enabling reliable biometric measurements and anomaly detection. Conventional deep learning approaches, particularly convolutional neural networks (CNNs) and transformers, often face challenges such as domain variability, noise artifacts, class imbalance, and poor calibration, which limit their clinical utility. This study proposes a hybrid state–space and vision transformer framework designed to address these limitations by integrating sequential dynamics and global contextual reasoning. Methods: The proposed framework comprises five stages: (i) preprocessing for ultrasound harmonization using intensity normalization, anisotropic diffusion filtering, and affine alignment; (ii) hybrid feature encoding with a state–space model (SSM) for sequential dependency modeling and a vision transformer (ViT) for global self-attention; (iii) multi-task learning (MTL) with anatomical regularization leveraging classification, segmentation, and biometric regression objectives; (iv) gated decision fusion for balancing local sequential and global contextual features; and (v) calibration strategies using temperature scaling and entropy regularization to ensure reliable confidence estimation. The framework was comprehensively evaluated on three publicly available datasets: FETAL_PLANES_DB, HC18, and a large-scale fetal head dataset. Results: The hybrid framework consistently outperformed baseline CNN, SSM-only, and ViT-only models across all tasks. On FETAL_PLANES_DB, it achieved an accuracy of 95.8%, a macro-F1 of 94.9%, and an ECE of 1.5%. On the Fetal Head dataset, the model achieved 94.1% accuracy and a macro-F1 score of 92.8%, along with superior calibration metrics. For HC18, it achieved a Dice score of 95.7%, an IoU of 91.7%, and a mean absolute error of 2.30 mm for head circumference estimation. Cross-dataset evaluations confirmed the model’s robustness and generalization capability. Ablation studies further demonstrated the critical role of SSM, ViT, fusion gating, and anatomical regularization in achieving optimal performance. Conclusions: By combining state–space dynamics and transformer-based global reasoning, the proposed framework delivers accurate, calibrated, and clinically meaningful predictions for fetal ultrasound plane classification and biometric estimation. The results highlight its potential for deployment in real-time prenatal screening and diagnostic systems. Full article

The thermal therapy mask, as a wearable device, requires precise thermal management to ensure therapeutic efficacy and safety, which necessitates a detailed investigation of its heat conduction behavior under complex conditions. However, the heat convective behavior of an orthotropic thermal therapy mask with an embedded line heat source under practical operational conditions has not yet been rigorously investigated. Therefore, this study addresses this specific problem by abstracting it into a 2D orthotropic transient heat conduction problem with a line heat source under Robin BCs, and derives its analytical solution using the SSM without any assumption of solution form. The SSM first transforms the governing equation into the frequency domain via the Laplace transform technique and reformulates it within the Hamiltonian framework. The original problem is then decomposed into two subproblems, which are solved by the method of separation of variables and the symplectic eigen expansion. The final analytical solution is obtained through superposing the solutions of the subproblems, and its accuracy is validated through comparison with the finite element method. The influence of the heat convection coefficient on the thermal behavior is systematically analyzed, revealing that increasing the heat convection coefficient accelerates the procedure from transient to steady state and results in reduced steady-state temperature. Furthermore, the analysis of orthotropic thermal conductivity reveals a “short-plank effect”, where the temperature evolution is limited by the smaller thermal conductivity. This study provides benchmark results for accurate and efficient thermal prediction and may enable an extension to broader applications in flexible electronics such as wearable sensors and displays. Full article

Real-time monitoring of offshore wind turbines (OWTs) through satellite remote sensing imagery is considered an essential process for large-scale infrastructure surveillance in ocean engineering. Current detection systems, however, are constrained by persistent technical limitations, including prohibitive deployment costs, insufficient discriminative power for learned features, and susceptibility to environmental interference. To address these challenges, a dual-branch architecture named OWTDNet is proposed, which integrates global contextual modeling via State Space Models (SSMs) with CNN-based local feature extraction for high-resolution OWTs detection. The primary branch utilizes a Mamba-structured encoder with linear computational complexity to establish long-range spatial dependencies, while an auxiliary Blurring-MobileNetv3 (B-Mv3) branch is designed to compensate for the local feature extraction deficiencies inherent in SSMs. Additionally, a novel Feature Alignment Module (FAM) is introduced to systematically coordinate cross-modal feature fusion between Mamba and CNN branches through channel-wise recalibration and position-aware alignment mechanisms. This module not only enables complementary feature integration but also enhances turbine-specific responses through attention-driven feature modulation. Comprehensive experimental validation demonstrated the superiority of the proposed framework, achieving a mean average precision (AP) of 47.1% on 40,000 × 40,000-pixel satellite imagery, while maintaining practical computational efficiency (127.7 s per image processing time). Full article

Accurate daily surface soil moisture (SSM) mapping at high spatial resolution (e.g., 30 m) remains challenging due to individual satellite sensor limitations. Although passive microwave sensors provide frequent coarse-resolution observations and synthetic aperture radar (SAR) offers high-resolution data intermittently, achieving both simultaneously requires sensor synergy. This paper introduces the microwave–optical multi-stage synergistic downscaling framework (MMSDF) to generate daily 30 m SSM products. The framework integrates SMAP L4 (9 km), MODIS data (500 m–1 km), harmonized Landsat Sentinel-2 (HLS, 30 m), radiometric terrain corrected Sentinel-1 (RTC-S1, 30 m), and auxiliary geographic data. It comprises three stages: (1) downscaling SMAP L4 to 1 km via random forest; (2) calibrating Sentinel-1 water cloud model (WCM) using intermediate 1 km SSM to retrieve 30 m SSM without in situ calibration; and (3) fusing daily 1 km SSM and intermittent 30 m WCM-derived retrievals using the spatial–temporal fusion model (ESTARFM) to generate seamless daily 30 m SSM maps. Validation against in situ measurements from 16 sites in Hunan Province, China (summer 2024) yielded R of 0.54 and RMSE of 0.045 ${\mathrm{cm}}^3/{\mathrm{cm}}^3$. Results demonstrate the framework’s capability to synergize multi-source data for high-resolution daily SSM estimates valuable for hydrological and agricultural applications. Full article

Hyperspectral image (HSI) classification requires models that can simultaneously capture spatial structures and spectral continuity. Although state space models (SSMs), particularly Mamba, have shown strong capability in long-sequence modeling, their application to HSI remains limited due to insufficient spectral relation modeling and the constraints of unidirectional processing. To address these challenges, we propose BiMambaHSI, a novel bidirectional spectral—spatial framework. First, we proposed a joint spectral—spatial gated mamba (JGM) encoder that applies forward–backward state modeling with input-dependent gating, explicitly capturing bidirectional spectral—spatial dependencies. This bidirectional mechanism explicitly captures long-range spectral—spatial dependencies, overcoming the limitations of conventional unidirectional Mamba. Second, we introduced the spatial—spectral mamba block (SSMB), which employs parallel bidirectional branches to extract spatial and spectral features separately and integrates them through a lightweight adaptive fusion mechanism. This design enhanced spectral continuity, spatial discrimination, and cross-dimensional interactions while preserving the linear complexity of pure SSMs. Extensive experiments on five public benchmark datasets (Pavia University, Houston, Indian Pines, WHU-Hi-HanChuan, and WHU-Hi-LongKou) demonstrate that BiMambaHSI consistently achieves state-of-the-art performance, improving classification accuracy and robustness compared with existing CNN- and Transformer-based methods. Full article