1. Introduction
As a critical support for modern international trade and the maritime economy, large smart hub seaports rely on digital twin technology to achieve comprehensive, real-time data monitoring and analysis. In the digital twin seaport project, traditional manual inspection methods face high costs and safety risks and fail to meet the need for real-time, precise monitoring of port facilities. In contrast, robotic inspection systems based on digital twin technology, combined with advanced sensors and navigation technologies, can provide efficient, safe, and accurate inspections, greatly improving port safety management and operational efficiency. In this context, path planning becomes a core issue in robotic inspection systems. Especially in the complex and dynamic seaport environment, efficient, accurate, and optimized path planning is particularly critical. Digital twin technology can provide precise real-time environmental models and dynamic data for robotic inspection, enabling more intelligent path planning. Researching path planning for port inspection robots is not only the foundation for realizing automated inspections but also plays a vital role in promoting the smart development of seaports, offering innovative solutions to enhance port management efficiency, ensure port safety, and optimize resource allocation.
With the development of artificial intelligence and automation technology, robot path planning has become one of the core issues in intelligent systems. The RRT (Rapidly-exploring Random Tree) algorithm is widely used in robot path planning due to its efficient search capability in high-dimensional spaces. However, the traditional RRT algorithm has problems such as slow convergence speed and poor path quality when dealing with complex environments. Therefore, in recent years, many scholars have proposed various improvement methods to enhance the efficiency and adaptability of the RRT algorithm. RRT* is an improved version of the RRT algorithm that introduces an optimization mechanism, making the path gradually approach the optimal one. RRT* optimizes the path by reconnecting the nearest nodes, thereby improving the quality of the path [
1]. Informed-RRT* is an improved algorithm based on RRT*, which utilizes the known target area information to reduce unnecessary search space and accelerate the convergence speed [
2]. RRT-Connect is a dual-tree RRT algorithm that generates two trees simultaneously from the start and end points to speed up the path search process [
3]. Hybrid A* + RRT combines the heuristic search ability of the A* algorithm and the random sampling ability of RRT, making it suitable for path planning tasks with complex constraints [
4]. For complex obstacle environments, some studies have proposed RRT algorithms combined with obstacle detection mechanisms to improve the safety and feasibility of the path [
5]. In dynamic environments, the RRT algorithm needs to consider the motion state of obstacles, so some studies have proposed dynamic RRT algorithms to adapt to real-time changing environments [
6]. Combining reinforcement learning with RRT can enhance the algorithm’s adaptive ability in complex environments and achieve more efficient path planning [
7]. Multi-objective optimization RRT algorithms aim to optimize multiple indicators such as path length, safety, and energy consumption simultaneously, making them suitable for path planning in multi-task scenarios [
8]. Utilizing deep learning models to predict obstacle distribution or path quality can significantly improve the efficiency and accuracy of the RRT algorithm [
9]. Combining swarm intelligence algorithms (such as particle swarm optimization) with RRT can improve the search efficiency of the algorithm in large-scale environments [
10]. This paper proposes a hybrid global path planning method that combines an improved A* algorithm with fuzzy logic. By introducing a fuzzy control mechanism to optimize the heuristic function, the quality and adaptability of the path in complex urban environments are enhanced. Experimental results show that this method has higher robustness and efficiency in dynamic obstacle scenarios [
11]. Dynamic obstacle avoidance based on deep reinforcement learning is implemented, which is suitable for path planning in unstructured environments [
12]. The artificial potential field method is improved by introducing a dynamic weighting mechanism to enhance the stability and adaptability of local path planning [
9]. Propose a multi-agent path planning framework based on graph neural networks, which is used for path coordination and optimization in collaborative robot systems [
13].
In recent years, with the development of automation technology, path planning has been increasingly applied in robotics, autonomous driving, and unmanned aerial vehicles andother fields. The reasoning-based path planning methods, especially the RRT (Rapidly-exploring Random Tree) technology, have become an important tool for solving complex path planning problems. The traditional RRT method explores by gradually building a tree structure with the goal of approximating the shortest path. However, to improve the efficiency and quality of path planning, researchers have proposed various improved and extended methods in recent years, including bidirectional RRT (bidirectional-RRT*), RRT and neural networks, RRT and reinforcement learning, and real-time RRT (real-time path planning), etc. The bidirectional RRT* method effectively reduces the computational time of path planning by introducing a bidirectional exploration mechanism during the path search process, and can find better paths in a wider range of environments. The combination of RRT and neural networks further enhances the intelligence level of path planning, as the neural network optimizes the decision-making quality of the path generation process by learning complex patterns in the environment. The combination of RRT and reinforcement learning enables the path planning method to continuously optimize the path planning strategy through adaptive learning, especially in dynamic environments. The real-time RRT method addresses the challenge of real-time requirements in application scenarios by improving the response speed and processing capacity of the algorithm, and solves the problem of robots needing to respond quickly in complex environments. With the continuous development of these methods, the reasoning-based path planning technology is gradually breaking through the limitations of traditional methods, and its application in dynamic, complex, and unknown environments has been widely explored and realized. Future research will further focus on how to combine these methods with other technologies such as big data analysis and cloud computing to enhance the intelligence level and practicality of path planning, in order to meet more complex task requirements.
Since the inception of the A* algorithm in 1966, scholars worldwide have introduced a plethora of global path planning approaches, encompassing graph-based schemes, sampling-based schemes, bio-inspired algorithms, and fuzzy algorithms [
14]. Li et al. [
15] notably enhanced the efficiency of the A* algorithm through bidirectional alternating search. Nonetheless, in intricate scenarios, the heuristic function’s reliance may not always guarantee optimal outcomes, thereby posing challenges in ensuring the quality of global path trajectories. In response, Xu et al. [
16] proposed a method for the smooth path planning of mobile robots, leveraging a novel fourth-order Bezier transition curve and an improved particle swarm optimization algorithm. Their approach entailed constructing a fourth-order Bezier transition curve with three overlapping control points. Tang et al. [
17] pioneered the application of deep reinforcement learning algorithms in substation environments, facilitating obstacle avoidance and precise planning of inspection paths through cloud computing. Concurrently, local path planning algorithms are often integrated with global algorithms to achieve precision in planning when confronted with complexity or insufficient environmental data. While traditional local planning typically employs algorithms such as Dynamic Window Approach (DWA) and artificial potential fields, ongoing research indicates that many global algorithms can be tailored to meet local planning requirements following suitable modifications. Wu et al. [
18] proposed a novel BAS-APF algorithm, amalgamating beetle antenna search algorithms with APF algorithms to enable real-time dynamic path planning for mobile robots. Trinh et al. [
19] introduced a local planning algorithm for robotic pedestrians, leveraging reinforcement learning for path planning and constructing predictive models based on obstacle hazards, thus offering a local planning approach akin to human cognitive processes. Chang et al. [
20] proposed an enhanced DWA algorithm based on Q-learning, dynamically adapting the evaluation function and leveraging Q-learning to flexibly learn state space, action space, and reward functions of DWA parameters, thereby addressing issues related to insufficient evaluation functions and high dependence on global references in traditional DWA algorithms. Through simulation experiments, they demonstrated the algorithm’s efficacy in complex environments. Gammell et al. [
2] introduced an enhanced algorithm termed Informed RRT*, which augments the randomness of the RRT algorithm by employing optimal sampling from elliptical heuristics. Nonetheless, this approach is susceptible to local extreme value problems in complex environments.
The aforementioned methods typically adhere to a point-to-point path planning principle. However, in port inspection environments, the necessity arises to cover multiple inspection points, posing a challenge for traditional algorithms to achieve global planning with minimal path cost. Furthermore, traditional local planning algorithms primarily focus on navigating around unknown obstacles along the robot’s operational path. Yet, in port inspection settings, apart from human workers, the presence of unknown obstacles is minimal, thus diminishing the efficacy of traditional local algorithms in performance enhancement.
Although the dual RRT algorithm may improve efficiency in some scenarios, it increases computational complexity. Since the dual RRT typically searches for paths in two directions simultaneously, this may lead to the algorithm requiring more computational resources in certain situations, especially in complex or dynamic environments. Compared to the traditional RRT, it may result in unnecessary increases in computational load, thereby affecting efficiency. One characteristic of the RRT algorithm is that it generates paths step by step. Although it can find a feasible path, this path is usually not globally optimal. Even though the dual RRT searches for paths in two directions, it may not necessarily solve the problem of local optimality. Especially in environments with obstacles or complex paths, the dual RRT may still get stuck in local optimality and cannot guarantee a higher quality path than a single RRT. Although the dual RRT may reduce the time for path search in some cases, it may sacrifice some path accuracy. In complex environments, the paths generated by the dual RRT may require more post-processing or correction to achieve the desired accuracy, while the RRT algorithm can generate feasible paths more directly. The dual RRT may need additional optimization steps to ensure path smoothness and accuracy, and these steps may not be effective in all situations. The RRT is a highly adaptable algorithm that can handle dynamic changes in the environment well, and the performance of the dual RRT’s improvement in such situations may not be as flexible as a single RRT. Especially in complex environments or tasks with high real-time requirements, the RRT may still be a more suitable choice.
In response to the aforementioned challenges, this study introduces a path-planning algorithm founded on an enhanced Rapidly-exploring Random Tree (RRT) approach. Firstly, through refining the algorithm’s search strategy, the agility and adaptability of path planning can be augmented. Secondly, the development of suitable heuristic functions can expedite the model’s convergence rate. Lastly, the utilization of trajectory smoothing methods can produce executable trajectories that adhere to vehicle motion constraints, thereby amplifying the efficiency and viability of path planning.
4. Experimental Results and Analysis
The experimental environment of this paper: Window11 64-bit operating system, i7-10400 CPU, main frequency 2.3 GHz, memory 16 GB (State Key Laboratory of Coastal and Offshore Engineering, Dalian University of Technology, Dalian, China), simulation software Matlab 2020b. All the algorithms were compared and tested under the same dataset, initial conditions and simulation parameters to ensure the comparability and reliability of the results.
Firstly, by projecting a 3D laser onto a 2D depth map, the ground is segmented according to the pitch Angle, and non-ground point clouds are clustered and marked point cloud data are obtained to reduce the dimension of the laser point cloud data. Then, four groups of feature point clouds are obtained by feature extraction based on smoothness. The 6-degree-of-freedom attitude transformation matrix is solved by Levenberg-Marquardt optimization method. Then, the iterative nearest point algorithm is used for loop detection. Finally, the current point cloud is mapped to the global map based on graph optimization, and the high-precision map is established.
4.1. Static Environment Comparison Simulation Experiment
To validate the efficacy and superiority of the enhanced RRT algorithm proposed in this study within a known static environment, comparative simulation experiments are conducted against the improved A* algorithm [
26], the enhanced ACO algorithm [
27], the refined ACO-based algorithm [
28], the optimized RRT algorithm [
29], and the quadratic optimization algorithm [
30]. The evaluation criteria encompass five key aspects: path length, total steering angle, number of steering maneuvers, planning time, and frequency of obstacle collisions. The simulations are executed on the MATLAB 2021a platform, utilizing a 50 × 50 raster map with a minimum resolution of 3 cm × 3 cm. The experimental findings are presented in
Figure 6 and
Figure 7.
The depicted results reveal that in a complex environment featuring a higher density of 50 × 50 obstacles, the algorithm enhancements proposed in this study achieve convergence to 76 after 20 iterations. In comparison, the refined A* algorithm converges to 90 after 60 iterations, the enhanced ACO algorithm converges to 94 after 60 iterations, the ACO-based improved algorithm converges to 88 after 58 iterations, the optimized RRT algorithm converges to 86 after 50 iterations, and the quadratic optimization algorithm converges to 80 after 30 iterations.
The algorithm enhancement presented in this paper reduces the number of iterations by 64.91%, 58.33%, and 37.50%, respectively, while decreasing the path length by 12.49%, 7.67%, and 3.69% when compared to the improved ACO, ACO-based algorithm, and optimized RRT algorithm. Additionally, post-secondary optimization yields a 2.6% reduction in path length and a 53.9% decrease in the number of transitions compared to pre optimization.
Notably, the enhanced algorithm in this paper demonstrates significantly accelerated convergence, fewer iterations, and identifies a relatively shorter optimal route length when contrasted with the other four algorithms.
The data from
Table 1 elucidates that the improved RRT algorithm, with 100 iterations, exhibited the shortest execution time, contrasting with the improved ACO algorithm which recorded the longest total runtime. This discrepancy can be attributed to the notably intricate environment, where finding a feasible path poses substantial challenges. Notably, both the improved algorithm and the secondary optimization algorithm showcased an increase in total elapsed time, primarily due to the exponential rise in computational demands stemming from algorithmic enhancements.
Furthermore, the performance metrics, including average path length, average number of convergences, and average steering angle, highlight the superior effectiveness of the improved algorithm presented in this paper, in comparison to the other four methods. These results further affirm its capability in navigating complex environments and optimizing path planning parameters.
4.2. Ablation Experiment
To validate the efficacy of each algorithmic enhancement proposed in this paper, ablation experiments were conducted on 50 × 50 raster maps to scrutinize the experimental outcomes, as detailed in the subsequent table.
As shown in
Table 2, the enhancement of the search strategy resulted in significant reductions in both average path length and steering angle length, greatly improving the algorithm’s efficiency. Following the integration of the heuristic function, the convergence speed increased while the steering angle was minimized. Additionally, although trajectory smoothing led to a slight decrease in algorithm speed, other performance metrics showed improvement [
30]. In conclusion, the three enhancements applied to the RRT foundation in this study have proven to be effective on their own.
While the original heuristic function exhibits superior global search capability, it inadvertently results in slower overall algorithm convergence, extended runtime, and diminished local search effectiveness, as depicted in
Figure 8. Conversely, the enhanced heuristic function proposed in this study not only enhances computational speed but also fortifies local search capability, thereby facilitating accelerated algorithm convergence in later stages, as illustrated in
Figure 9. Through a total of 15 experiments, both pre and post the heuristic function improvement, with the initial 20 iterations considered, the average convergence curve depicted in
Figure 10 further underscores the accelerated convergence speed facilitated by the improved heuristic function, significantly reducing the likelihood of convergence oscillations.
4.3. Simulation of Port Environment Simulation Experiment
In this paper, experiments were conducted in a simulated harbor environment, with the robot’s initial and final positions set at coordinates (35, 25), representing the location of the charging station. The black grid in the figure denotes static obstacles and safety margins within the inspection area. The robot’s objective is to navigate from the starting point to the endpoint without collisions, utilizing a combination of global and local target points. Along the inspection path, the primary focus is on reaching the warehouse, with the robot strategically planning local inspections based on remaining battery power post-warehouse inspection. The robot’s battery capacity is 10 km, and it moves at a speed of 5 km/h. When the remaining battery falls below 30%, the robot promptly returns to the charging station. During a specific inspection instance, when the robot reaches the inspection point in the lower left corner of the parking lot, having covered 7.21 km, and the remaining battery is less than 30% of the total mileage, the robot directly heads back to the designated red charging point. Additionally, the inspection robot is equipped with a power sensor and navigation system for real-time power monitoring and autonomous identification of charging routes. The power sensor accurately measures the battery level, while the navigation system employs pre-set path planning and environmental awareness technologies to guide the robot to charging stations [
31]. Upon detecting a low power level, the inspection robot initiates a charging route search program, leveraging sensors for voltage and current changes, visual recognition, predefined paths, wireless communication, and map localization to ensure timely charging and uninterrupted inspection task execution. The outcomes of these procedures are illustrated in
Figure 11,
Figure 12 and
Figure 13.
As depicted in
Figure 11,
Figure 12 and
Figure 13, the algorithm presented in this paper demonstrates efficient completion of inspection tasks within the harbor area, successfully navigating around obstacles with minimal error between the desired and simulated paths. It exhibits a high level of accuracy and adaptability in diverse inspection areas, enabling real-time power monitoring and autonomous charging route exploration. Notably, at specific sampling points such as 9–11, 14–17, and 25–27, the algorithm shows larger errors due to unique robot conditions. However, the robot gradually converges towards the desired path by leveraging global and local target points. Near sampling point 24, the trajectory influenced solely by local target points yields better results, emphasizing the significance of local guidance. Although trajectories 18–22 and 28–32 exhibit larger errors and deviate more from the desired path, they are deemed reasonable upon comprehensive planning analysis. Through this evaluation, it is evident that the algorithm in this paper excels in identifying optimal paths within complex environments, see
Table 3.
Based on the aforementioned analysis, it can be inferred that the enhanced algorithm proposed in this paper adeptly adheres to the desired path within simulated environments. It effectively navigates obstacle avoidance and achieves precise local path planning through the combined influence of global and local target points. This substantiates the efficacy of the improved algorithm put forth in this study.
5. Summary
Upon comprehensive analysis, it is clear that the enhanced algorithm introduced in this paper successfully navigates the desired path within simulated environments. The algorithm demonstrates robust performance in key areas, such as obstacle avoidance and local path planning. By leveraging the interplay between global and local target points, the algorithm is able to generate precise, adaptive paths that respond dynamically to environmental changes. This synergy between global and local planning ensures that the vehicle not only reaches its intended destination but also avoids potential obstacles efficiently, maintaining smooth and safe motion throughout. The results confirm the effectiveness of the proposed enhancements, showcasing their ability to improve path planning accuracy, robustness, and overall performance in complex, real-world scenarios.
In synopsis, we propose a path planning algorithm based on an enhanced Rapidly-Exploring Random Tree (RRT) approach tailored specifically for port inspection environments. Within this algorithm, we introduce an adaptive step-size strategy to bolster its resilience. This strategy enables the algorithm to dynamically adjust its step size, thereby optimizing performance across varying environmental complexities encountered during inspections. Furthermore, in the algorithm’s optimization phase, we implement a mechanism to prune redundant nodes from the generated path, enhancing path generation speed. By mitigating redundant nodes, path complexity is significantly reduced, concurrently bolstering efficiency while preserving path accuracy and reliability. Subsequently, following path generation, we employ a Bezier smoothing algorithm to refine the path. The Bezier smoothing algorithm effectively mitigates sharp angles and corners, rendering the path smoother and continuous. This refinement not only enhances path aesthetics but also aids in diminishing vibrations and minimizing energy consumption during the execution of the path by robots or vehicles. Consequently, these refinements contribute to heightened inspection efficiency and stability.
In order to verify the effectiveness of the navigation system in practical applications, we used the Turtlebot3 mobile robot in the ROS platform running on the 64-bit Ubuntu 18.04 operating system with 4 GB memory to carry out experiments on different types of scenarios, which were built in the Gazebo simulation platform. As shown in the
Figure 14, we set up a factory warehouse environment to simulate the real-world environment. Using real-time positioning and map-building capabilities in Rviz, we scan the simulation environment, build the corresponding map, and perform path planning.
The path planning algorithm, which integrates enhanced RRT methodology with adaptive step size strategy, redundant node removal, and Bezier smoothing processing, is tailored for optimal application within the unique inspection environment of ports. This comprehensive approach enhances the efficiency and precision of path planning, thereby offering robust support and assurance for inspection operations.
The depth camera data is first read into the ROS environment, then front-end and back-end threads are executed to build a sparse feature point map and continuously updated to create a real-time point cloud map. The front-end keyframes are passed into the point cloud build thread to generate the point cloud map. The effectiveness of the proposed map generation algorithm is verified by the corresponding point cloud map in the
Figure 15, which shows the good three-dimensional effect of the map construction in the indoor environment.
As shown in the
Figure 16, the algorithm detects the motion trajectory of the object, which is consistent with the actual trajectory. Although there is a deviation between the detected trajectory and the actual trajectory, there is no serious deviation, which meets the robot’s perception requirements. When the motion trajectory of the object changes significantly, there is still no serious deviation, and it also meets the perception requirements of the robot.
By comparing point cloud maps to visual maps, it can be observed that maps built using multi-line laser scanning are sharper than those built using visual algorithms, thus reducing cumulative errors and providing better edge contour processing. In addition, in order to verify the feasibility, reliability and accuracy of the algorithm, the map generation time, map generation effect and CPU utilization are compared [
32].
Several tests were carried out to ensure the accuracy of the experiment. The robot is fixed at a specific location, labeled the origin (0, 0), and the output object movement data is compared with the actual object movement data.
The algorithm detects that the point cloud map is basically consistent with the simulated scene, and the detected trajectory has no obvious deviation from the actual trajectory, which meets the robot’s perception requirements. As shown in the figure, when the motion trajectory of the object changes greatly, there is a slight deviation between the detected trajectory and the actual trajectory, but no serious deviation occurs, and it still meets the perception requirements of the robot.
After testing, the path planned by the A-STAR algorithm maintains A certain distance from the obstacle, avoiding the collision between the robot and it. At the same time, the global path planning effect is good, can accurately reach the set target point position, meet the requirements of accurate positioning navigation. The robot moves along the obstacle (square) path and avoids autonomously through local path planning when encountering obstacles. The process and results of local path planning are shown in the
Figure 17.
After testing, the inspection robot can accurately achieve autonomous obstacle avoidance, complete the local path planning of the set target point, and meet the requirements of accurate positioning and navigation.
In the context of the digital twin engineering of large smart hub seaports, the automation and intelligence of port inspection systems have become crucial for enhancing port safety, efficiency, and effectiveness. Traditional manual inspection methods can no longer meet the high efficiency and precision requirements of port operations, particularly in the complex port environments. In contrast, robotic inspection, with its efficiency, safety, and precision, has become one of the key technologies driving the development of smart ports. However, the complexity and dynamic nature of port environments present significant challenges for robotic path planning. Therefore, simulating the port environment and optimizing path planning algorithms based on digital twin technology are particularly important [
33].
With the continuous advancement of technology and the diversification of industry demands, the scalability of the inspection model will become a key factor in its development. In the future, we can enhance the flexibility and adaptability of the inspection model through the following aspects: By adopting a modular architecture, different functional modules can be independently upgraded and replaced, meeting the needs of various scenarios and improving the upgrade efficiency of the overall system; Utilizing big data and artificial intelligence technologies, conducting in-depth analysis of inspection data, thereby enabling self-learning and optimization, and improving the accuracy and intelligence level of the inspection model; Ensuring that the inspection model can seamlessly connect with various devices and systems, enabling efficient operation in different environments and enhancing the application scope; According to the special needs of different customers and industries, providing customized solutions to enhance the adaptability of the model and improve user experience. By leveraging cloud computing technology, migrating the computing and storage capabilities of the inspection model to the cloud, improving data processing capabilities and model scalability, and supporting large-scale applications. Through the above measures, the inspection model will possess greater adaptability and development potential, and be able to maintain competitiveness in the ever-changing market environment.