Search Results (53)

This study explores the integration of point cloud data obtained from unmanned aerial vehicles (UAVs) and unmanned surface vehicles (USVs) to address limitations in photogrammetry and to create comprehensive models of aquatic environments. The UAV platform (AUTEL EVO II) employs structure-from-motion (SfM) photogrammetry using optical imagery, while the USV (equipped with a NORBIT iWBMS multibeam sonar system) collects underwater bathymetric data. UAVs commonly face constraints in battery life and image-processing capacity, making it necessary to merge smaller UAV point clouds into larger, more complete models. The USV-derived bathymetric data are integrated with UAV-derived surface data to construct unified terrain models that include both above-water and underwater features. This study evaluates three coordinate transformation (CT) methods—4-parameter, 6-parameter, and 7-parameter—across three study areas in Taiwan to assess their effectiveness in registering USV–UAV and UAV–UAV point clouds. For USV–UAV integration, all CT methods improved alignment accuracy compared with results without CT, achieving decimeter-level precision. For UAV–UAV integrations, the 7-parameter method provided the best accuracy, especially in areas with low terrain roughness such as rooftops and pavements, while improvements were less pronounced in areas with high roughness such as tree canopies. These findings demonstrate that the 7-parameter CT method offers an effective and straightforward approach for accurate point cloud integration from different platforms and sensors. Full article

This paper addresses the cooperative formation control problem for a heterogeneous unmanned system composed of Unmanned Surface Vehicles (USVs) and Autonomous Underwater Vehicles (AUVs) under coexisting constraints of actuator faults, time-varying communication topology, and communication delay. First, a unified dynamic model is established under the Euler–Lagrange framework. Building on this, a novel distributed adaptive fault-tolerant control (DAFTC) framework is proposed. This framework integrates a Dynamic Event-Triggered Mechanism (DETM) to address communication bandwidth limitations, alongside an adaptive fault-tolerant strategy to enhance system robustness. The novelty lies in the cohesive integration of DETM for communication efficiency and adaptive laws for online fault compensation (both loss of effectiveness and bias), while rigorously handling communication delays via Lyapunov–Krasovskii analysis. It is proven via Lyapunov stability analysis that the proposed control protocol ensures all signals in the closed-loop system remain semi-globally uniformly ultimately bounded, with the formation tracking error converging to an adjustable compact set. Simulation results demonstrate the framework’s effectiveness. Compared to periodic communication (0.1 s interval), the proposed DETM reduces the communication load by over 99.6%. Even when subjected to a 25% effectiveness fault and a 5 Nm bias fault, the root-mean-square (RMS) tracking error is maintained below 0.15 m, validating the system’s high performance and robustness. Full article

As crucial transportation hubs and economic nodes, the underwater security and infrastructure maintenance of harbors are of paramount importance. Harbors are characterized by high vessel traffic and complex underwater environments, where traditional underwater inspection methods, such as diver operations, face challenges of low efficiency, high risk, and limited operational range. This paper introduces a collaborative survey and disposal system that integrates a deformable unmanned surface vehicle (USV) with a lightweight remotely operated vehicle (ROV). The USV is equipped with a side-scan sonar (SSS) and a multibeam echo sounder (MBES), enabling rapid, large-area searches and seabed topographic mapping. The ROV, equipped with an optical camera system, forward-looking sonar (FLS), and a manipulator, is tasked with conducting close-range, detailed observations to confirm and dispose of abnormal objects identified by the USV. Field trials were conducted at an island harbor in the South China Sea, where simulated underwater objects, including an iron drum, a plastic drum, and a rubber tire, were deployed. The results demonstrate that the USV-ROV collaborative system effectively meets the demands for underwater environmental measurement, object localization, identification, and disposal in complex harbor environments. The USV acquired high-resolution (0.5 m × 0.5 m) three-dimensional topographic data of the harbor, effectively revealing its topographical features. The SSS accurately localized and preliminarily identified all deployed simulated objects, revealing their acoustic characteristics. Repeated surveys revealed a maximum positioning deviation of 2.2 m. The lightweight ROV confirmed the status and location of the simulated objects using an optical camera and an underwater positioning system, with a maximum deviation of 3.2 m when compared to the SSS locations. The study highlights the limitations of using either vehicle alone. The USV survey could not precisely confirm the attributes of the objects, whereas a full-area search of 0.36 km² by the ROV alone would take approximately 20 h. In contrast, the USV-ROV collaborative model reduced the total time to detect all objects to 9 h, improving efficiency by 55%. This research offers an efficient, reliable, and economical practical solution for applications such as underwater security, topographic mapping, infrastructure inspection, and channel dredging in harbor environments. Full article

This research provides a new systematic solution to the essential issue of self-noise interference in underwater acoustic sensing signals induced by unmanned surface vehicles (USVs) operating at sea. The self-noise pertains to the near-field interference noise generated by the growing diversity and volume of acoustic equipment utilized by USVs. The generating mechanism of self-noise is clarified, and a self-noise propagation model is developed to examine its three-dimensional coupling properties within spatiotemporal fluctuation environments in the time-frequency-space domain. On this premise, the YOLOv11 object identification framework is innovatively applied to the delay-Doppler (DD) feature maps of self-noise, thereby overcoming the constraints of traditional time-frequency spectral approaches in recognizing noise with delay spread and overlapping characteristics. A comprehensive comparison with traditional models like YOLOv8 and SSD reveals that the suggested delay-Doppler YOLO (DD-YOLO) algorithm attains an average accuracy of 87.0% in noise source identification. An enhanced denoising method, termed optimized time-frequency regularized overlapping group shrinkage (OTFROGS), is introduced, using structural sparsity alongside non-convex regularization techniques. Comparative experiments with traditional denoising methods, such as the normalized least mean square (NLMS) algorithm, wavelet threshold denoising (WTD), and the original time-frequency regularized overlapping group shrinkage (TFROGS), reveal that OTFROGS outperforms them in mitigating USV self-noise. This study offers a dependable technological approach for optimizing the performance of USV acoustic systems and proposes a theoretical framework and methodology applicable to different underwater acoustic sensing contexts. Full article

The accurate monitoring of short-term bathymetric changes in shallow waters is essential for effective coastal management and planning. Machine Learning (ML) applied to Unmanned Aerial Vehicle (UAV)-based multispectral imagery offers a rapid and cost-effective solution for bathymetric surveys. However, models based solely on multispectral imagery are inherently limited by confounding factors such as shadow effects, poor water quality, and complex seafloor textures, which obscure the spectral–depth relationship, particularly in heterogeneous coastal environments. To address these issues, we developed a hybrid bathymetric inversion model that integrates digital surface model (DSM) data—providing high-resolution topographic information—with ML applied to UAV-based multispectral imagery. The model training was supported by multibeam sonar measurements collected from an Unmanned Surface Vehicle (USV), ensuring high accuracy and adaptability to diverse underwater terrains. The study area, located around Lazarus Island, Singapore, encompasses a sandy beach slope transitioning into seagrass meadows, coral reef communities, and a fine-sediment seabed. Incorporating DSM-derived topographic information substantially improved prediction accuracy and correlation, particularly in complex environments. Compared with linear and bio-optical models, the proposed approach achieved accuracy improvements exceeding 20% in shallow-water regions, with performance reaching an R² > 0.93. The results highlighted the effectiveness of DSM integration in disentangling spectral ambiguities caused by environmental variability and improving bathymetric prediction accuracy. By combining UAV-based remote sensing with the ML model, this study presents a scalable and high-precision approach for bathymetric mapping in complex shallow-water environments, thereby enhancing the reliability of UAV-based surveys and supporting the broader application of ML in coastal monitoring and management. Full article

Research in marine hydrographic environmental monitoring continues to deepen, necessitating a hardware platform capable of traversing air–water interfaces to collect vertical gradient parameters across oceanographic profiles. This paper proposes a deeply integrated heterogeneous monitoring platform for marine hydrological vertical profiling, addressing the functional limitations of conventional unmanned surface vehicles (USVs) and unmanned aerial vehicles (UAVs) in subsurface monitoring. By co-designing a hybrid aerial underwater vehicle (HAUV) with cross-domain capabilities and a USV, the system leverages USVs for long-endurance surface operations and HAUVs for high-speed vertical column monitoring. Key innovations include (1) a distributed collaborative architecture enabling “Air–Sea–Air” cyclic operations; (2) dynamic modeling of HAUV-USV interactions incorporating aerodynamic and hydrodynamic coupling; (3) an MPC-based collaborative tracking algorithm for real-time USV pursuit under marine disturbances; and (4) a vision-guided synchronous landing strategy achieving decimeter-level docking accuracy in bad conditions. Simulation experiments validate the system’s efficacy in trajectory tracking and precision landing. This work bridges the critical gap in marine vertical profile monitoring while demonstrating robust cross-domain coordination. Full article

Autonomous Unmanned Surface Vehicle (USV) operations in complex ocean engineering scenarios necessitate robust navigation, guidance, and control technologies. These systems require reliable sensor-based object detection and efficient, safe, and energy-aware path planning. To address these multifaceted challenges, this paper proposes a novel synergistic AI framework. The framework integrates (1) a novel adaptation of the Swin-Transformer to generate a dense, semantic risk map from raw visual data, enabling the system to interpret ambiguous marine conditions like sun glare and choppy water, enabling real-time environmental understanding crucial for guidance; (2) a Transformer-enhanced A-star (T-ASTAR) algorithm with spatio-temporal attentional guidance to generate globally near-optimal and energy-aware static paths; (3) a domain-adapted TD3 agent featuring a novel energy-aware reward function that optimizes for USV hydrodynamic constraints, making it suitable for long-endurance missions tailored for USVs to perform dynamic local path optimization and real-time obstacle avoidance, forming a key control element; and (4) CUDA acceleration to meet the computational demands of real-time ocean engineering applications. Simulations and real-world data verify the framework’s superiority over benchmarks like A* and RRT, achieving 30% shorter routes, 70% fewer turns, 64.7% fewer dynamic collisions, and a 215-fold speed improvement in map generation via CUDA acceleration. This research underscores the importance of integrating powerful AI components within a hierarchical synergy, encompassing AI-based perception, hierarchical decision planning for guidance, and multi-stage optimal search algorithms for control. The proposed solution significantly advances USV autonomy, addressing critical ocean engineering challenges such as navigation in dynamic environments, object avoidance, and energy-constrained operations for unmanned maritime systems. Full article

Efficient and timely data collection in Underwater Acoustic Sensor Networks (UASNs) for Internet of Underwater Things (IoUT) applications remains a significant challenge due to the inherent limitations of the underwater environment. This paper presents a Value of Information (VoI)-based trajectory planning framework for a single Autonomous Underwater Vehicle (AUV) operating in coordination with an Unmanned Surface Vehicle (USV) to collect data from multiple Cluster Heads (CHs) deployed across an uneven seafloor. The proposed approach employs a VoI model that captures both the importance and timeliness of sensed data, guiding the AUV to collect and deliver critical information before its value significantly degrades. A forward Dynamic Programming (DP) algorithm is used to jointly optimize the AUV’s trajectory and the USV’s start and end positions, with the objective of maximizing the total residual VoI upon mission completion. The trajectory design incorporates the AUV’s kinematic constraints into travel time estimation, enabling accurate VoI evaluation throughout the mission. Simulation results show that the proposed strategy consistently outperforms conventional baselines in terms of residual VoI and overall system efficiency. These findings highlight the advantages of VoI-aware planning and AUV–USV collaboration for effective data collection in challenging underwater environments. Full article

Maritime vision sensing can be applied to maritime unmanned systems to perform search and rescue (SAR) missions under complex marine environments, as multiple unmanned aerial vehicles (UAVs) and unmanned surface vehicles (USVs) are able to conduct vision sensing through the air, the water-surface, and underwater. However, in these vision-based maritime SAR systems, collaboration between UAVs and USVs is a critical issue for successful SAR operations. To address this challenge, in this paper, we propose a long-endurance collaborative SAR scheme which exploits the complementary strengths of the maritime unmanned systems. In this scheme, a swarm of UAVs leverages a multi-agent reinforcement-learning (MARL) method and probability maps to perform cooperative first-phase search exploiting UAV’s high altitude and wide field of view of vision sensing. Then, multiple USVs conduct precise real-time second-phase operations by refining the probabilistic map. To deal with the energy constraints of UAVs and perform long-endurance collaborative SAR missions, a multi-USV charging scheduling method is proposed based on MARL to prolong the UAVs’ flight time. Through extensive simulations, the experimental results verified the effectiveness of the proposed scheme and long-endurance search capabilities. Full article

This paper mainly investigates the fault-tolerant consensus problem in heterogeneous multi-agent systems. Firstly, a control model of a leader–follower heterogeneous multi-agent system (HMAS) composed of multiple unmanned aerial vehicles (UAVs), multiple unmanned surface vehicles (USVs), and multiple unmanned underwater vehicles (UUVs) is established. Then, for the fault-tolerant control (FTC) consensus problem of heterogeneous systems under partial actuator failures and interruption failures, an optimal FTC protocol for heterogeneous multi-agent systems based on the control allocation algorithm is designed. The derived optimal FTC protocol is applied to the heterogeneous system. The asymptotic stability of the protocol is proved by the Lyapunov stability theory. Finally, the effectiveness of the control strategy is verified through simulation tests. Full article

This paper investigates the stability issues of the Unmanned Surface Vehicle (USV)–Unmanned Underwater Vehicle (ROV) system induced by cable loads under real marine conditions and high-speed operation. This study focuses on the dynamic coupling characteristics of cable forces affecting the unmanned platform and outlines the variation patterns of these forces under different operational scenarios. By developing the dynamic models of the USV, UC, and UUV, a comprehensive system model for the unmanned marine platform is constructed. The accuracy of the cable model is validated through experimental results, and the coupling interference effects of the cable during collaborative operations are systematically analyzed from multiple perspectives. Additionally, the cable tension and force behaviors under high-speed cruising conditions are thoroughly examined. The results provide a solid foundation for the development of cable load prediction models for collaborative marine unmanned platforms, and offer both theoretical and numerical insights for dynamic control strategies based on cable force adjustments. Full article

With the growing use of unmanned surface vehicles (USVs) for underwater exploration, efficient wireless charging solutions like inductive power transfer (IPT) are crucial for addressing power limitations. This paper presents a novel IPT system for USVs and introduces a systematic design approach for optimizing magnetic couplers. The proposed design addresses three critical challenges: misalignment tolerance, lightweight construction, and thermal safety, which are intricately linked through a magnetic field. In terms of misalignment, this paper demonstrates that the coil length is a key factor in determining misalignment tolerance. For a lightweight design, replacing the ferrite plate with ferrite bars can significantly reduce the weight of the coupler without causing core saturation. The design is further validated through a two-way coupled electromagnetic–thermal simulation. The results reveal that, with proper thermal management, the system avoids thermal risks in underwater environments compared to air. Finally, a 3 kW prototype is constructed and tested in fresh water, achieving 55 V and 50 A wireless charging at an 85.7% full-load dc-to-dc efficiency, thus confirming the practicality and performance of the design. Full article

Generating aerial shoreline segmentation masks can be a daunting task, often requiring manual labeling or correction. This is further problematic because neural segmentation models require decent and abundant data for training, requiring even more manpower to automate the process. In this paper, we propose utilizing Unmanned Surface Vehicles (USVs) in an automated shoreline segmentation system on satellite imagery. The remotely controlled vessel first collects above- and underwater shoreline information using light detection and ranging (LiDAR) and multibeam echosounder (MBES) measuring instruments, resulting in a geo-referenced 3D point cloud. After cleaning and processing these data, the system integrates the projected map with an aerial image of the region. Based on the height values of the mapped points, the image is segmented. Finally, post-processing methods and the k-NN algorithm are introduced, resulting in a complete binary shoreline segmentation mask. The obtained data were used for training U-Net-type segmentation models with pre-trained backbones. The InceptionV3-based model achieved an accuracy of 96% and a dice coefficient score of 93%, demonstrating the effectiveness of the proposed system as a source of data acquisition for training deep neural networks. Full article

The Police Robot for Inspection and Mapping of Underwater Evidence (PRIME) is an uncrewed surface vehicle (USV) currently being developed for underwater search and recovery teams to assist in crime scene investigation. The USV maps underwater scenes using sidescan sonar (SSS). Test exercises use a clothed mannequin lying on the seafloor as a target object to evaluate system performance. A robust, automated method for detecting human body-shaped objects is required to maximise operational functionality. The use of a convolutional neural network (CNN) for automatic target recognition (ATR) is proposed. SSS image data acquired from four different locations during previous missions were used to build a dataset consisting of two classes, i.e., a binary classification problem. The target object class consisted of 166 196 × 196 pixel image snippets of the underwater mannequin, whereas the non-target class consisted of 13,054 examples. Due to the large class imbalance in the dataset, CNN models were trained with six different imbalance ratios. Two different pre-trained models (ResNet-50 and Xception) were compared, and trained via transfer learning. This paper presents results from the CNNs and details the training methods used. Larger datasets are shown to improve CNN performance despite class imbalance, achieving average F1 scores of 97% in image classification. Average F1 scores for target vs background classification with unseen data are only 47% but the end result is enhanced by combining multiple weak classification results in an ensemble average. The combined output, represented as a georeferenced heatmap, accurately indicates the target object location with a high detection confidence and one false positive of low confidence. The CNN approach shows improved object detection performance when compared to the currently used ATR method. Full article