Sign in to use this feature.

Years

Between: -

Subjects

remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline

Journals

Article Types

Countries / Regions

Search Results (68)

Search Parameters:
Keywords = International Regulations for Preventing Collisions at Sea (COLREGs)

Order results
Result details
Results per page
Select all
Export citation of selected articles as:
32 pages, 2102 KiB  
Article
D* Lite and Transformer-Enhanced SAC: A Hybrid Reinforcement Learning Framework for COLREGs-Compliant Autonomous Navigation in Dynamic Maritime Environments
by Tianqing Chen, Yamei Lan, Yichen Li, Jiesen Zhang and Yijie Yin
J. Mar. Sci. Eng. 2025, 13(8), 1498; https://doi.org/10.3390/jmse13081498 - 4 Aug 2025
Viewed by 38
Abstract
Autonomous navigation in dynamic, multi-vessel maritime environments presents a formidable challenge, demanding strict adherence to the International Regulations for Preventing Collisions at Sea (COLREGs). Conventional approaches often struggle with the dual imperatives of global path optimality and local reactive safety, and they frequently [...] Read more.
Autonomous navigation in dynamic, multi-vessel maritime environments presents a formidable challenge, demanding strict adherence to the International Regulations for Preventing Collisions at Sea (COLREGs). Conventional approaches often struggle with the dual imperatives of global path optimality and local reactive safety, and they frequently rely on simplistic state representations that fail to capture complex spatio-temporal interactions among vessels. We introduce a novel hybrid reinforcement learning framework, D* Lite + Transformer-Enhanced Soft Actor-Critic (TE-SAC), to overcome these limitations. This hierarchical framework synergizes the strengths of global and local planning. An enhanced D* Lite algorithm generates efficient, long-horizon reference paths at the global level. At the local level, the TE-SAC agent performs COLREGs-compliant tactical maneuvering. The core innovation resides in TE-SAC’s synergistic state encoder, which uniquely combines a Graph Neural Network (GNN) to model the instantaneous spatial topology of vessel encounters with a Transformer encoder to capture long-range temporal dependencies and infer vessel intent. Comprehensive simulations demonstrate the framework’s superior performance, validating the strengths of both planning layers. At the local level, our TE-SAC agent exhibits remarkable tactical intelligence, achieving an exceptional 98.7% COLREGs compliance rate and reducing energy consumption by 15–20% through smoother, more decisive maneuvers. This high-quality local control, guided by the efficient global paths from the enhanced D* Lite algorithm, culminates in a 10–32 percentage point improvement in overall task success rates compared to state-of-the-art baselines. This work presents a robust, verifiable, and efficient framework. By demonstrating superior performance and compliance with rules in high-fidelity simulations, it lays a crucial foundation for advancing the practical application of intelligent autonomous navigation systems. Full article
(This article belongs to the Special Issue Motion Control and Path Planning of Marine Vehicles—3rd Edition)
Show Figures

Figure 1

36 pages, 7335 KiB  
Article
COLREGs-Compliant Distributed Stochastic Search Algorithm for Multi-Ship Collision Avoidance
by Bohan Zhang, Jinichi Koue, Tenda Okimoto and Katsutoshi Hirayama
J. Mar. Sci. Eng. 2025, 13(8), 1402; https://doi.org/10.3390/jmse13081402 - 23 Jul 2025
Viewed by 229
Abstract
The increasing complexity of maritime traffic imposes growing demands on the safety and rationality of ship-collision-avoidance decisions. While most existing research focuses on simple encounter scenarios, autonomous collision-avoidance strategies that comply with the International Regulations for Preventing Collisions at Sea (COLREGs) in complex [...] Read more.
The increasing complexity of maritime traffic imposes growing demands on the safety and rationality of ship-collision-avoidance decisions. While most existing research focuses on simple encounter scenarios, autonomous collision-avoidance strategies that comply with the International Regulations for Preventing Collisions at Sea (COLREGs) in complex multi-ship environments remain insufficiently investigated. To address this gap, this study proposes a novel collision-avoidance framework that integrates a quantitative COLREGs analysis with a distributed stochastic search mechanism. The framework consists of three core components: encounter identification, safety assessment, and stage classification. A cost function is employed to balance safety, COLREGs compliance, and navigational efficiency, incorporating a distance-based weighting factor to modulate the influence of each target vessel. The use of a distributed stochastic search algorithm enables decentralized decision-making through localized information sharing and probabilistic updates. Extensive simulations conducted across a variety of scenarios demonstrate that the proposed method can rapidly generate effective collision-avoidance strategies that fully comply with COLREGs. Comprehensive evaluations in terms of safety, navigational efficiency, COLREGs adherence, and real-time computational performance further validate the method’s strong adaptability and its promising potential for practical application in complex multi-ship environments. Full article
(This article belongs to the Special Issue Maritime Security and Risk Assessments—2nd Edition)
Show Figures

Figure 1

22 pages, 2337 KiB  
Article
From Misunderstanding to Safety: Insights into COLREGs Rule 10 (TSS) Crossing Problem
by Ivan Vilić, Đani Mohović and Srđan Žuškin
J. Mar. Sci. Eng. 2025, 13(8), 1383; https://doi.org/10.3390/jmse13081383 - 22 Jul 2025
Viewed by 356
Abstract
Despite navigation advancements in enhanced sensor utilization and increased focus on maritime training and education, most marine accidents still involve collisions with high human involvement. Furthermore, navigators’ knowledge and application of the most often misunderstood Rule 10 Traffic Separation Schemes (TSS) according to [...] Read more.
Despite navigation advancements in enhanced sensor utilization and increased focus on maritime training and education, most marine accidents still involve collisions with high human involvement. Furthermore, navigators’ knowledge and application of the most often misunderstood Rule 10 Traffic Separation Schemes (TSS) according to the Convention on the International Regulations for Preventing Collisions at Sea (COLREG) represents the first focus in this study. To provide insight into the level of understanding and knowledge regarding COLREG Rule 10, a customized, worldwide survey has been created and disseminated among marine industry professionals. The survey results reveal a notable knowledge gap in Rule 10, where we initially assumed that more than half of the respondents know COLREG regulations well. According to the probability calculation and chi-square test results, all three categories (OOW, Master, and others) have significant rule misunderstanding. In response to the COLREG misunderstanding, together with the increasing density of maritime traffic, the implementation of Decision Support Systems (DSS) in navigation has become crucial for ensuring compliance with regulatory frameworks and enhancing navigational safety in general. This study presents a structural approach to vessel prioritization and decision-making within a DSS framework, focusing on the classification and response of the own vessel (OV) to bow-crossing scenarios within the TSS. Through the real-time integration of AIS navigational status data, the proposed DSS Architecture offers a structured, rule-compliant architecture to enhance navigational safety and the decision-making process within the TSS. Furthermore, implementing a Fall-Back Strategy (FBS) represents the key innovation factor, which ensures system resilience by directing operator response if opposing vessels disobey COLREG rules. Based on the vessel’s dynamic context and COLREG hierarchy, the proposed DSS Architecture identifies and informs the navigator regarding stand-on or give-way obligations among vessels. Full article
(This article belongs to the Special Issue Advances in Navigability and Mooring (2nd Edition))
Show Figures

Figure 1

22 pages, 2586 KiB  
Article
Model Predictive Control for Autonomous Ship Navigation with COLREG Compliance and Chart-Based Path Planning
by Primož Potočnik
J. Mar. Sci. Eng. 2025, 13(7), 1246; https://doi.org/10.3390/jmse13071246 - 28 Jun 2025
Viewed by 466
Abstract
Autonomous ship navigation systems must ensure safe and efficient route planning while complying with the International Regulations for Preventing Collisions at Sea (COLREGs). This paper presents an integrated navigation framework that combines chart-based global path planning with a Model Predictive Control (MPC) approach [...] Read more.
Autonomous ship navigation systems must ensure safe and efficient route planning while complying with the International Regulations for Preventing Collisions at Sea (COLREGs). This paper presents an integrated navigation framework that combines chart-based global path planning with a Model Predictive Control (MPC) approach for local trajectory tracking and COLREG-compliant collision avoidance. The method generates feasible reference routes using maritime charts and predefined waypoints, while the MPC controller ensures precise path following and dynamic re-planning in response to nearby vessels and coastal obstacles. Coastal features and shorelines are modeled using Global Self-consistent, Hierarchical, High-resolution Geography data, enabling MPC to treat landmasses as static obstacles. Other vessels are represented as dynamic obstacles with varying speeds and headings, and COLREG rules are embedded within the MPC framework to enable rule-compliant maneuvering during encounters. To address real-time computational constraints, a simplified MPC formulation is introduced, balancing predictive accuracy with computational efficiency, making the approach suitable for embedded implementations. The navigation framework is implemented in a MATLAB-based simulation with real-time visualization supporting multi-vessel scenarios and COLREG-aware vessel interactions. Simulation results demonstrate robust performance across diverse maritime scenarios—including complex multi-ship encounters and constrained coastal navigation—while maintaining the shortest safe routes. By seamlessly integrating chart-aware path planning with COLREG-compliant, MPC-based collision avoidance, the proposed framework offers an effective, scalable, and robust solution for autonomous maritime navigation. Full article
Show Figures

Figure 1

17 pages, 1857 KiB  
Article
Modeling Navigator Awareness of COLREGs Interpretation Using Probabilistic Curve Fitting
by Deuk-Jin Park, Hong-Tae Kim, Sang-A Park, Tae-Yeon Kim and Jeong-Bin Yim
J. Mar. Sci. Eng. 2025, 13(5), 987; https://doi.org/10.3390/jmse13050987 - 20 May 2025
Viewed by 382
Abstract
Despite the existence of standardized collision regulations such as the International Regulations for Preventing Collisions at Sea (COLREGs), ship collisions continue to occur, indicating persistent gaps in how navigators interpret and apply these rules. The COLREGs are globally adopted rules that govern vessel [...] Read more.
Despite the existence of standardized collision regulations such as the International Regulations for Preventing Collisions at Sea (COLREGs), ship collisions continue to occur, indicating persistent gaps in how navigators interpret and apply these rules. The COLREGs are globally adopted rules that govern vessel conduct to avoid collisions. Borderline encounter situations—such as those between head-on and crossing, or overtaking and crossing—pose particular challenges, often resulting in inconsistent or ambiguous interpretations. This study models navigator awareness as a probabilistic function of encounter angle, aiming to identify interpretive transition zones and cognitive uncertainty in rule application. A structured survey was conducted with 101 licensed navigators, each evaluating simulated ship encounter scenarios with varying relative bearings. Responses were collected using a Likert scale and analyzed in angular sectors known for interpretational ambiguity: 006–012° for head on to crossing (HC) and 100–160° for overtaking to crossing (OC). Gaussian curve fitting was applied to the response distributions, with the awareness center (μ) and standard deviation (σ) serving as indicators of consensus and ambiguity. The results reveal sharp shifts in awareness near 008° and 160°, suggesting cognitively unstable zones. Risk-averse interpretation patterns were also observed, where navigators tended to classify borderline situations more conservatively under uncertainty. These findings suggest that navigator awareness is not deterministic but probabilistically structured and context sensitive. The proposed awareness modeling framework helps bridge the gap between regulatory prescriptions and real world navigator behavior, offering practical implications for MASS algorithm design and COLREGs refinement. Full article
Show Figures

Figure 1

23 pages, 10158 KiB  
Article
Navigation and Obstacle Avoidance for USV in Autonomous Buoy Inspection: A Deep Reinforcement Learning Approach
by Jianhui Wang, Zhiqiang Lu, Xunjie Hong, Zeye Wu and Weihua Li
J. Mar. Sci. Eng. 2025, 13(5), 843; https://doi.org/10.3390/jmse13050843 - 24 Apr 2025
Cited by 1 | Viewed by 861
Abstract
To address the challenges of manual buoy inspection, this study enhances a previously proposed Unmanned Surface Vehicle (USV) inspection system by improving its navigation and obstacle avoidance capabilities using Proximal Policy Optimization (PPO). For improved usability, the entire system adopts a fully end-to-end [...] Read more.
To address the challenges of manual buoy inspection, this study enhances a previously proposed Unmanned Surface Vehicle (USV) inspection system by improving its navigation and obstacle avoidance capabilities using Proximal Policy Optimization (PPO). For improved usability, the entire system adopts a fully end-to-end design, with an angular deviation weighting mechanism for stable circular navigation, a novel image-based radar encoding technique for obstacle perception and a decoupled navigation and obstacle avoidance architecture that splits the complex task into three independently trained modules. Experiments validate that both navigation modules exhibit robustness and generalization capabilities, while the obstacle avoidance module partially achieves International Regulations for Preventing Collisions at Sea (COLREGs)-compliant maneuvers. Further tests in continuous multi-buoy inspection tasks confirm the architecture’s effectiveness in integrating these modules to complete the full task. Full article
(This article belongs to the Special Issue The Control and Navigation of Autonomous Surface Vehicles)
Show Figures

Figure 1

30 pages, 8829 KiB  
Article
Adaptive Temporal Reinforcement Learning for Mapping Complex Maritime Environmental State Spaces in Autonomous Ship Navigation
by Ruolan Zhang, Xinyu Qin, Mingyang Pan, Shaoxi Li and Helong Shen
J. Mar. Sci. Eng. 2025, 13(3), 514; https://doi.org/10.3390/jmse13030514 - 6 Mar 2025
Cited by 2 | Viewed by 1206
Abstract
The autonomous decision-making model for ship navigation requires extensive interaction and trial-and-error in real, complex environments to ensure optimal decision-making performance and efficiency across various scenarios. However, existing approaches still encounter significant challenges in addressing the temporal features of state space and tackling [...] Read more.
The autonomous decision-making model for ship navigation requires extensive interaction and trial-and-error in real, complex environments to ensure optimal decision-making performance and efficiency across various scenarios. However, existing approaches still encounter significant challenges in addressing the temporal features of state space and tackling complex dynamic collision avoidance tasks, primarily due to factors such as environmental uncertainty, the high dimensionality of the state space, and limited decision robustness. This paper proposes an adaptive temporal decision-making model based on reinforcement learning, which utilizes Long Short-Term Memory (LSTM) networks to capture temporal features of the state space. The model integrates an enhanced Proximal Policy Optimization (PPO) algorithm for efficient policy iteration optimization. Additionally, a simulation training environment is constructed, incorporating multi-factor coupled physical properties and ship dynamics equations. The environment maps variables such as wind speed, current velocity, and wave height, along with dynamic ship parameters, while considering the International Regulations for Preventing Collisions at Sea (COLREGs) in training the autonomous navigation decision-making model. Experimental results demonstrate that, compared to other neural network-based reinforcement learning methods, the proposed model excels in environmental adaptability, collision avoidance success rate, navigation stability, and trajectory optimization. The model’s decision resilience and state-space mapping align with real-world navigation scenarios, significantly improving the autonomous decision-making capability of ships in dynamic sea conditions and providing critical support for the advancement of intelligent shipping. Full article
Show Figures

Figure 1

29 pages, 6142 KiB  
Article
Collision Avoidance Behavior Mining Model Considering Encounter Scenarios
by Shuzhe Chen, Chong Zhang, Lei Wu, Ziwei Wang, Wentao Wu, Shimeng Li and Haotian Gao
Appl. Sci. 2025, 15(5), 2616; https://doi.org/10.3390/app15052616 - 28 Feb 2025
Viewed by 792
Abstract
With the development of intelligent waterborne transportation, mining collision avoidance patterns based on spatiotemporal and motion data of ships are crucial for the autonomous navigation of intelligent ships, which requires accurate collision avoidance information under various encounter scenarios. Addressing the existing issues of [...] Read more.
With the development of intelligent waterborne transportation, mining collision avoidance patterns based on spatiotemporal and motion data of ships are crucial for the autonomous navigation of intelligent ships, which requires accurate collision avoidance information under various encounter scenarios. Addressing the existing issues of low precision and false detection in data mining algorithms, this paper proposes a collision avoidance behavior mining model considering encounter scenarios. The model is based on the Automatic Identification System (AIS) and the International Regulations for Preventing Collisions at Sea (COLREGs); it firstly identifies ship collision avoidance turning points by analyzing trajectory curvature with turning and recovering factors. Then, by combining AIS data and the specific navigational environment, it matches the ship encounter pairs and determines the encounter scenarios. Comparative experiments show that the model demonstrates superior accuracy in various scenarios compared to traditional algorithm. Finally, the model was applied to AIS data east of the Yangtze River Estuary, recognizing a total of 827 instances of ship collision avoidance behavior under different encounter scenarios. The case study shows that the model can precisely mine collision avoidance information, laying a solid foundation for future research on autonomous collision avoidance decision making for intelligent ships. Full article
(This article belongs to the Special Issue Advances in Intelligent Maritime Navigation and Ship Safety)
Show Figures

Figure 1

14 pages, 2782 KiB  
Article
Research on Collision Avoidance Methods for Unmanned Surface Vehicles Based on Boundary Potential Field
by Yongzheng Li, Panpan Hou, Chen Cheng and Biwei Wang
J. Mar. Sci. Eng. 2025, 13(1), 88; https://doi.org/10.3390/jmse13010088 - 6 Jan 2025
Cited by 2 | Viewed by 1140
Abstract
In recent years, unmanned surface vehicles (USVs) have gained increasing attention in industry due to their efficiency and versatility in marine operations. Artificial potential field (APF) methods, with their strong adaptability and simplicity of implementation, are widely used in USV path planning tasks. [...] Read more.
In recent years, unmanned surface vehicles (USVs) have gained increasing attention in industry due to their efficiency and versatility in marine operations. Artificial potential field (APF) methods, with their strong adaptability and simplicity of implementation, are widely used in USV path planning tasks. However, the naive APF method struggles in static complex environments, due to the local minima problem. Not to mention that actual navigations may involve other dynamic traffic participants. In this work, an improved APF algorithm integrating the boundary potential field method and the International Regulations for Preventing Collisions at Sea (COLREGs) is proposed. By incorporating the boundary potential field method, this novel approach effectively reduces the computational burden caused by clusters of land obstacles in complex environments, significantly improving computational efficiency. Furthermore, the APF method is refined to ensure the algorithm strictly adheres to COLREGs in head-on, overtaking, and crossing encounters, generating smooth and safe collision avoidance paths. The proposed method was tested in numerous complex scenarios derived from electronic navigational charts. The simulation results demonstrated the robustness and efficiency of the proposed algorithm for collision avoidance within complex maritime environments, providing reliable technical support for autonomous obstacle avoidance in dynamic ocean conditions. Full article
(This article belongs to the Section Ocean Engineering)
Show Figures

Figure 1

28 pages, 9484 KiB  
Article
Virtual Reality Fusion Testing-Based Autonomous Collision Avoidance of Ships in Open Water: Methods and Practices
by Haiming Zhou, Mao Zheng, Xiumin Chu, Chengqiang Yu, Jinyu Lei, Bowen Lin, Kehao Zhang and Wubin Hua
J. Mar. Sci. Eng. 2024, 12(12), 2181; https://doi.org/10.3390/jmse12122181 - 28 Nov 2024
Viewed by 930
Abstract
With the rapid development of autonomous collision avoidance algorithms on ships, the technical demand for the testing and verification of autonomous collision avoidance algorithms is increasing; however, the current testing of autonomous collision avoidance algorithms is mainly based on the virtual simulation of [...] Read more.
With the rapid development of autonomous collision avoidance algorithms on ships, the technical demand for the testing and verification of autonomous collision avoidance algorithms is increasing; however, the current testing of autonomous collision avoidance algorithms is mainly based on the virtual simulation of the computer. To realize the testing and verification of the autonomous collision avoidance algorithm in the real ship scene, a method of virtual reality fusion testing in open water is proposed and real ship testing is carried out. Firstly, an autonomous ship collision avoidance test and evaluation system is established to research the test method of ship encounters in open water. Starting from the convention on the international regulations for preventing collisions at sea (COLREG), the main scenario elements of ship collision avoidance are analyzed. Based on the parametric modeling method of ship collision avoidance scenarios, a standard test scenario library for ship collision avoidance in open waters is established. Then, based on the demand for a ship collision avoidance function test, the evaluation index system of ship collision avoidance is constructed. Subsequently, for the uncertainty of the initial state of the real ship test at sea, the virtual–real space mapping method to realize the correspondence of the standard scenario in the real world is proposed. A standardized testing process to improve testing efficiency is established. Finally, the method of conducting virtual simulation and virtual reality fusion tests for various scenarios are verified, respectively. The test results show that the test method can effectively support the testing of autonomous collision avoidance algorithms for ships in open waters and provide a practical basis for improving the pertinence and practicability of ship collision avoidance testing. Full article
Show Figures

Figure 1

21 pages, 6905 KiB  
Article
Research on the Give-Way Ships Determination Based on Field Theory
by Yunfeng Zhang, Yong Shen, Zhexue Xie and Yihua Liu
J. Mar. Sci. Eng. 2024, 12(11), 1973; https://doi.org/10.3390/jmse12111973 - 2 Nov 2024
Viewed by 1057
Abstract
The Convention on the International Regulations for Preventing Collisions at Sea, 1972 (COLREGs) stipulates ships’ obligations when encountering each other. However, human action remains a primary cause of collision accidents. In the complex environment of mixed navigation involving MASS and manned ships, the [...] Read more.
The Convention on the International Regulations for Preventing Collisions at Sea, 1972 (COLREGs) stipulates ships’ obligations when encountering each other. However, human action remains a primary cause of collision accidents. In the complex environment of mixed navigation involving MASS and manned ships, the applicability of the COLREGs for determining the give-way ship has faced certain challenges. Therefore, this study proposes a model for determining the give-way ship, combining ship characteristics and using an asymmetric Gaussian function to construct the potential field of stand-on ships from the perspective of give-way ships. It constructs the cost function based on field theory to determine the respective avoidance costs for both ships in a crossing situation, with the ship incurring the lowest cost selected as the give-way ship, followed by a case study to validate the model. The research is dedicated to coordinating avoidance action objectively, effectively reducing maritime collisions, and providing exploratory guidance for collision avoidance decision-making in future mixed navigation environments. Full article
(This article belongs to the Section Ocean Engineering)
Show Figures

Figure 1

30 pages, 14351 KiB  
Article
Dynamic Path Planning Method for Unmanned Surface Vessels in Complex Traffic Conditions of Island Reefs Waters
by Jing Peng, Xinyuan Zhao and Qi Zhao
Drones 2024, 8(11), 620; https://doi.org/10.3390/drones8110620 - 29 Oct 2024
Cited by 1 | Viewed by 1453
Abstract
Unmanned Surface Vehicles (USVs) operating in complex traffic conditions in island reef waters often require different types of algorithms. Therefore, selecting a dynamic path-planning algorithm with strong adaptability has become a new challenge. This paper proposes a dynamic adaptive path planning algorithm for [...] Read more.
Unmanned Surface Vehicles (USVs) operating in complex traffic conditions in island reef waters often require different types of algorithms. Therefore, selecting a dynamic path-planning algorithm with strong adaptability has become a new challenge. This paper proposes a dynamic adaptive path planning algorithm for USVs, incorporating an improved Dynamic Window Approach (DWA) with fuzzy logic and the International Regulations for Preventing Collisions at Sea (COLREGS). The algorithm is designed by integrating three key aspects: evaluation function, fuzzy control, and COLREGS. First, to enable USVs to approach the target point more safely and quickly during navigation, an additional target point attraction sub-function is introduced, extending the original evaluation function. Furthermore, to ensure robust dynamic path planning for USVs across various water environments, such as narrow channels, reef-laden waters, and open seas, fuzzy logic is integrated with the improved DWA algorithm. Since USVs must comply with COLREGS during navigation, the algorithm incorporates these regulations, enhancing the DWA algorithm with fuzzy logic to ensure compliance. Finally, simulation experiments validate the proposed algorithm, demonstrating that the planned paths are safer and more stable, ensuring the safe navigation of USVs in compliance with COLREGS. Full article
Show Figures

Figure 1

21 pages, 4836 KiB  
Article
A Novel Dynamically Adjusted Entropy Algorithm for Collision Avoidance in Autonomous Ships Based on Deep Reinforcement Learning
by Guoquan Chen, Zike Huang, Weijun Wang and Shenhua Yang
J. Mar. Sci. Eng. 2024, 12(9), 1562; https://doi.org/10.3390/jmse12091562 - 5 Sep 2024
Cited by 4 | Viewed by 1701
Abstract
Decision-making for collision avoidance in complex maritime environments is a critical technology in the field of autonomous ship navigation. However, existing collision avoidance decision algorithms still suffer from unstable strategy exploration and poor compliance with regulations. To address these issues, this paper proposes [...] Read more.
Decision-making for collision avoidance in complex maritime environments is a critical technology in the field of autonomous ship navigation. However, existing collision avoidance decision algorithms still suffer from unstable strategy exploration and poor compliance with regulations. To address these issues, this paper proposes a novel autonomous ship collision avoidance algorithm, the dynamically adjusted entropy proximal policy optimization (DAE-PPO). Firstly, a reward system suitable for complex maritime encounter scenarios is established, integrating the International Regulations for Preventing Collisions at Sea (COLREGs) with collision risk assessment. Secondly, the exploration mechanism is optimized using a quadratically decreasing entropy method to effectively avoid local optima and enhance strategic performance. Finally, a simulation testing environment based on Unreal Engine 5 (UE5) was developed to conduct experiments and validate the proposed algorithm. Experimental results demonstrate that the DAE-PPO algorithm exhibits significant improvements in efficiency, success rate, and stability in collision avoidance tests. Specifically, it shows a 45% improvement in success rate per hundred collision avoidance attempts compared to the classic PPO algorithm and a reduction of 0.35 in the maximum collision risk (CR) value during individual collision avoidance tasks. Full article
Show Figures

Figure 1

22 pages, 21321 KiB  
Article
USV Collision Avoidance Decision-Making Based on the Improved PPO Algorithm in Restricted Waters
by Shuhui Hao, Wei Guan, Zhewen Cui and Junwen Lu
J. Mar. Sci. Eng. 2024, 12(8), 1428; https://doi.org/10.3390/jmse12081428 - 19 Aug 2024
Cited by 2 | Viewed by 2021
Abstract
The study presents an optimized Unmanned Surface Vehicle (USV) collision avoidance decision-making strategy in restricted waters based on the improved Proximal Policy Optimization (PPO) algorithm. This approach effectively integrates the ship domain, the action area of restricted waters, and the International Regulations for [...] Read more.
The study presents an optimized Unmanned Surface Vehicle (USV) collision avoidance decision-making strategy in restricted waters based on the improved Proximal Policy Optimization (PPO) algorithm. This approach effectively integrates the ship domain, the action area of restricted waters, and the International Regulations for Preventing Collisions at Sea (COLREGs), while constructing an autonomous decision-making system. A novel set of reward functions are devised to incentivize USVs to strictly adhere to COLREGs during autonomous decision-making. Also, to enhance convergence performance, this study incorporates the Gated Recurrent Unit (GRU), which is demonstrated to significantly improve algorithmic efficacy compared to both the Long Short-Term Memory (LSTM) network and traditional fully connected network structures. Finally, extensive testing in various constrained environments, such as narrow channels and complex waters with multiple ships, validates the effectiveness and reliability of the proposed strategy. Full article
(This article belongs to the Section Ocean Engineering)
Show Figures

Figure 1

12 pages, 3922 KiB  
Article
Ship Trajectory Planning and Optimization via Ensemble Hybrid A* and Multi-Target Point Artificial Potential Field Model
by Yanguo Huang, Sishuo Zhao and Shuling Zhao
J. Mar. Sci. Eng. 2024, 12(8), 1372; https://doi.org/10.3390/jmse12081372 - 12 Aug 2024
Cited by 7 | Viewed by 2068
Abstract
Ship path planning is the core problem of autonomous driving of smart ships and the basis for avoiding obstacles and other ships reasonably. To achieve this goal, this study improved the traditional A* algorithm to propose a new method for ship collision avoidance [...] Read more.
Ship path planning is the core problem of autonomous driving of smart ships and the basis for avoiding obstacles and other ships reasonably. To achieve this goal, this study improved the traditional A* algorithm to propose a new method for ship collision avoidance path planning by combining the multi-target point artificial potential field algorithm (MPAPF). The global planning path was smoothed and segmented into multi-target sequence points with the help of an improved A* algorithm and fewer turning nodes. The improved APF algorithm was used to plan the path of multi-target points locally, and the ship motion constraints were considered to generate a path that was more in line with the ship kinematics. In addition, this method also considered the collision avoidance situation when ships meet, carried out collision avoidance operations according to the International Regulations for Preventing Collisions at Sea (COLREGs), and introduced the collision risk index (CRI) to evaluate the collision risk and obtain a safe and reliable path. Through the simulation of a static environment and ship encounter, the experimental results show that the proposed method not only has good performance in a static environment but can also generate a safe path to avoid collision in more complex encounter scenarios. Full article
Show Figures

Figure 1

Back to TopTop