You are currently viewing a new version of our website. To view the old version click .
Applied Sciences
  • Article
  • Open Access

6 March 2025

Bio-Inspired Traffic Pattern Generation for Multi-AMR Systems

,
,
,
and
1
Faculty of Mechanical Engineering, University of Ljubljana, 1000 Ljubljana, Slovenia
2
Faculty of Electrical Engineering, University of Ljubljana, 1000 Ljubljana, Slovenia
*
Author to whom correspondence should be addressed.
This article belongs to the Special Issue Advancements in Multi-Agent Systems and Artificial Intelligence: Methodologies, Applications, and Future Trends

Abstract

In intralogistics, autonomous mobile robots (AMRs) operate without predefined paths, leading to complex traffic patterns and potential conflicts that impact system efficiency. This paper proposes a bio-inspired optimization method for autonomously generating spatial movement constraints for autonomous mobile robots (AMRs). Unlike traditional multi-agent pathfinding (MAPF) approaches, which focus on temporal coordination, our approach proactively reduces conflicts by adapting a weighted directed grid graph to improve traffic flow. This is achieved through four mechanisms inspired by ant colony systems: (1) a movement reward that decreases the weight of traversed edges, similar to pheromone deposition, (2) a delay penalty that increases edge weights along delayed paths, (3) a collision penalty that increases weights at conflict locations, and (4) an evaporation mechanism that prevents premature convergence to suboptimal solutions. Compared to the existing approaches, the proposed approach addresses the entire intralogistic problem, including plant layout, task distribution, release and dispatching algorithms, and fleet size. Its autonomous movement rule generation and low computational complexity make it well suited for dynamic intralogistic environments. Validated through physics-based simulations in Gazebo across three scenarios, a standard MAPF benchmark, and two industrial environments, the movement constraints generated using the proposed method improved the system throughput by up to 10% compared to unconstrained navigation and up to 4% compared to expert-designed solutions while reducing the need for conflict-resolution interventions.

1. Introduction

Setting up efficient multi-robot systems in industrial environments presents a complex challenge. In industrial settings, this requires careful consideration of numerous interconnected parameters, such as plant layout, task distribution, dispatching, and pathfinding algorithms [1]. These parameters form a web of dependencies where adjustments to one aspect often necessitate changes in others to maintain the overall system efficiency and performance [2,3]. The specific characteristics of each intralogistic problem demand strategically developed movement constraints to prevent collisions, deadlocks, and congestion—common challenges that impact system performance in warehouse and manufacturing environments [4,5].
While various terms are used in the literature to describe movement rules for mobile robots, this paper focuses on movement constraints and spatial rules that influence robot navigation decisions, implemented through costmaps in the form of weighted directed grid graphs. This implementation provides more flexibility than traditional roadmaps (physical or virtual predefined paths) while maintaining structured traffic patterns.
Traditionally, intralogistic automation has relied on Autonomous Guided Vehicles (AGVs), which require predefined paths marked by magnetic tapes or similar guidance systems. These roadmaps must be carefully designed by human experts with a deep understanding of system operations [6]. While effective, this manual design process can be extremely time-consuming, leading to increased research interest in automated approaches that can accelerate the process and improve the solution quality [7,8,9,10].
In recent years, autonomous mobile robots (AMRs) have emerged as a flexible alternative to AGVs, offering the ability to navigate anywhere within the workspace [11]. However, this increased flexibility does not automatically translate to higher efficiency. In narrow corridors or aisles, unrestricted AMR movement can lead to congestion and reduced throughput [12]. Similarly, in high-density storage areas, the lack of structured movement can result in inefficient navigation and increased collision risks [13]. Thus, while AMRs do not require physical guidance infrastructure, they still benefit from structured movement patterns that help to prevent or resolve conflicts efficiently.
To address these challenges while maintaining AMRs’ inherent flexibility, we propose an approach based on ant colony optimization (ACO) for the automated generation of movement constraints. The method utilizes a weighted, directed grid graph where the edge weights are dynamically adjusted according to real-time performance metrics. The approach combines offline costmap generation through simulation-based optimization with subsequent integration into path planning systems. During simulation, the algorithm explores the workspace under various operational conditions, utilizing digital pheromones to represent traversal costs, congestion levels, and collision risks. These pheromone distributions are aggregated into precomputed costmaps that provide a foundation for global path planning. The resulting costmaps can be integrated with established planning algorithms such as A*, effectively guiding robots toward more efficient collective movement patterns.
The optimization algorithm implements four mechanisms derived from ant colony systems. These include movement rewards that reinforce successful paths, delay penalties that modify weights based on task completion times, collision penalties that adjust weights in conflict areas, and an evaporation mechanism that prevents convergence to suboptimal solutions. In contrast to existing approaches that consider only the physical layout, our method incorporates key intralogistic system parameters including fleet size, task distribution patterns, dispatching algorithms, and operational constraints. This systematic approach enables the generation of movement constraints optimized for specific applications, thereby reducing robot conflicts and improving system performance.
To validate and demonstrate the effectiveness of this approach, we present a comprehensive study organized as follows. Section 2 presents the related work, focusing on the movement constraint generation method. Section 3 describes the proposed bio-inspired optimization method, including the discrete-time grid graph simulation and the detailed mechanisms of the optimization algorithm. The implementation of these movement constraints in the ROS2 Nav2 navigation stack is also presented. In Section 4, we validate our approach on three distinct scenarios: a standard multi-agent pathfinding (MAPF) benchmark layout and two real industrial environments using both event-based and physics-based simulations. The solutions are evaluated based on collision reduction and system throughput. Section 5 concludes the paper with the key findings and future research directions.

3. Methodology

Our approach extends the ACO framework to address the specific challenges of multi-robot transport systems. The core innovation lies in adapting ACO’s pheromone-based pathfinding to handle collision avoidance and delay minimization in dynamic environments. The algorithm continuously modifies edge weights in a grid graph based on robot movements, collisions, and task performance, effectively creating an emergent coordination system for multiple AMRs.

3.1. Environment Representation and Problem Formulation

The environment is represented as a weighted grid graph G = ( V , E , w ) , where vertices V correspond to traversable locations and directed edges E V × V connect adjacent vertices. The weight function w : E [ ϵ , 1 ϵ ] assigns positive real values to edges, representing the cost of moving along that edge, where ϵ is a small positive constant that prevents numerical issues at the boundaries. The weights correspond to the concentration of pheromones on the edges in the ACO framework, influencing the path planning decisions of the AMRs, with lower weights indicating more favorable paths. Tasks are defined as tuples T = ( p pickup , p dropoff , t due ) specifying a pickup location, a dropoff location, and a due time. New tasks are generated as existing ones are completed and are assigned to the nearest available AMR.
The optimization objective is to determine the optimal weight configuration w * = { w e * } e E that maximizes system throughput Θ , defined as the number of tasks completed per unit time:
arg max w Θ ( w ) ; w e [ ϵ , 1 ϵ ]    e E
In this framework, system throughput Θ ( w ) is a composite metric reflecting the effectiveness of AMR operations under the edge weight configuration w. While individual weights influence the immediate routing decisions of AMRs, their collective configuration shapes the emergent behavior of the entire system. The optimization problem presents a substantial search space due to the continuous nature of the weights and the combinatorial nature of weight configurations. Furthermore, the emergent nature of the optimization metric necessitates an optimization approach capable of refining complex behaviors over time.
Given the complexity of the search space, traditional optimization methods such as gradient descent or linear programming are not well suited for the problem. In contrast, the proposed bio-inspired approach offers several advantages, including scalability in terms of layout size and number of vehicles, adaptability to continuous task execution, and computational efficiency through parallelism.

3.2. Bio-Inspired Coordination Mechanisms

In our framework, each AMR acts as an “ant” executing transport tasks. Paths are planned using a modified A* algorithm that favors straight-line movements by adding small penalties for direction changes. The costmap guiding AMR navigation evolves through the following four bio-inspired mechanisms that continuously update edge weights:
Movement rewards (pheromone deposition): Similar to pheromone trails in natural ant colonies, successful movements reinforce paths by reducing their costs:
Δ w e = r m
where r m is the movement reward factor. The mechanism encourages the reuse of paths.
Collision handling: When AMRs encounter conflicts, the system applies both temporal delays and spatial penalties:
t c o l l i s i o n = t p · n c o n f l i c t
where t p is the base penalty duration and n c o n f l i c t is the number of AMRs involved. In addition, the edges that lead to the collision are penalized to prevent the AMRs from taking these paths in the future:
Δ w e = p c · 1 if   regular   collision α s if   side   collision
where p c is the collision penalty factor and α s [ 0 , 1 ] is the side collision multiplier, which can be adjusted to reduce the penalty for side collisions. This reflects that merging into the existing traffic flow is less disruptive than head-on collisions.
Delay feedback: The third mechanism takes into account the delay by reducing costs when the task is completed on time and increasing costs when collisions and resulting delays occur. When a task is completed, all edges in its path are updated based on the delay:
Δ w e = α d · ( t c o m p l e t i o n t d u e )
where α d is the delay factor and ( t c o m p l e t i o n t d u e ) is the task’s delay. This mechanism reinforces paths without delays and helps to avoid future conflicts by discouraging AMRs from using recently contested paths.
Pheromone evaporation: The evaporation mechanism is designed to prevent the system from over-relying on recently adjusted edge weights that may have been affected by temporary conditions such as transient congestion or short-lived obstacles. By gradually resetting the value of each weight to its initial value w i n i t , the system ensures that the influence of past events diminishes over time. The edge weights gradually return to their initial value w i n i t through
Δ w e = λ ( w e w i n i t )
where λ is the evaporation rate. This prevents the system from becoming trapped in suboptimal patterns.
Weight update implementation: The effectiveness of the bio-inspired mechanisms depends critically on how weight modifications are implemented. A key challenge is maintaining edge weights within meaningful bounds ([ ϵ , 1 ϵ ]) while ensuring that repeated modifications do not lead to saturation or numerical instability. To address this, we employ a log-ratio transformation for all weight updates:
w n e w = e ln ( w o l d / ( 1 w o l d ) ) + Δ w 1 + e ln ( w o l d / ( 1 w o l d ) ) + Δ w
where w n e w is the updated edge weight, w o l d is the current edge weight, and Δ w represents the weight modification determined by the various mechanisms. This transformation naturally bounds weights between 0 and 1 while preserving relative differences in magnitudes of the modifications. It enables smooth, continuous updates without abrupt changes. All previously described mechanisms (movement rewards, collision penalties, delay feedback, and evaporation) express their modifications as Δ w values, which are then applied through this transformation. This unified approach to weight updates ensures that the different mechanisms work harmoniously, creating a robust and stable adaptation system that maintains its responsiveness throughout extended operation periods.
Figure 1 illustrates the coordination process with three AMRs executing assigned tasks simultaneously. Figure 1a displays their movement paths, highlighting a collision between two robots near the end of their routes. The subsequent figures demonstrate the sequential application of our bio-inspired mechanisms: initial movements decrease path costs (Figure 1b), collision locations are assigned higher costs (Figure 1c), paths are then reinforced or penalized based on the resulting delays (due to the collisions, shown in Figure 1d), and, finally, evaporation gradually returns costs toward the neutral value of 0.5 (Figure 1e). For clarity, neutral costs are omitted from the figure.
Figure 1. Illustration of the bio-inspired mechanisms. (a) AMR movements and the corresponding weights after applying (b) movement rewards (pheromone deposition), (c) collision handling, (d) delay feedback, and (e) pheromone evaporation.
Algorithm implementation: Building on these weight modification mechanisms, the complete algorithm, presented in Algorithm 1, operates continuously during system runtime. For each AMR, it combines path planning with real-time adaptation of the environment representation. The algorithm processes new tasks as they arrive, plans and executes movements for each AMR, and updates edge weights based on system feedback. This continuous adaptation creates emergent behavior where the system learns to avoid congestion and minimize delays while maintaining efficient paths.
The algorithm maintains a balance between exploitation of known good paths (through movement rewards) and exploration of alternatives (through evaporation). This core ACO-inspired behavior is enhanced with mechanisms specifically designed for multi-robot coordination. Immediate collision avoidance is achieved through dynamic weight penalties that redistribute traffic away from congested areas, while the delay feedback mechanism serves a dual purpose: it both optimizes task execution times and reinforces the avoidance of potentially problematic paths where delays might occur due to congestion or frequent conflicts. Together, these mechanisms create an adaptive system that learns to anticipate and prevent delays by steering AMRs towards efficient conflict-free paths.
Algorithm 1 Bio-inspired cost optimization
1:
Initialize grid graph G = ( V , E , w ) with neutral weights
2:
while simulation running do
3:
   Handle new task arrivals and assignments
4:
   for each AMR a A  do
5:
         Plan path using modified A* on G
6:
         Move according to plan
7:
         if movement successful then
8:
                  Apply movement reward to traversed edge
9:
         else if collision occurred then
10:
             Apply collision penalty
11:
             Delay involved AMRs
12:
         end if
13:
         if task completed then
14:
             Apply delay-based penalties/rewards
15:
         end if
16:
   end for
17:
   Apply evaporation to all edge weights
18:
end while

3.3. Implementation and Parameters

A discrete-event simulator was developed to evaluate and optimize the proposed approach. The simulator handles all key events, including the arrival of the tasks, assignments, robot movements, and collision detection. Event processing is optimized for performance to enable fast evaluation over many iterations, which facilitates parameter tuning and algorithmic refinements. The simulation tracks the state of all AMRs, active tasks, and edge weights, updating them according to the mechanisms described above when events occur.
The optimization process operates through three sequential phases, each emphasizing different aspects of the movement strategy. All edge weights are bounded between 0 and 1 and represent normalized movement costs that directly influence A* path planning. The weights are initialized at 0.5 to allow both positive preferences (weights below 0.5) and avoidance patterns (weights above 0.5) to develop. To ensure a stable and gradual evolution of the weights, the modification factors ( r m , p c , α s , α d , and λ ) are set several orders of magnitude smaller than the weights themselves, typically around 10 3 . This allows the system to accumulate meaningful patterns over many iterations without sudden destabilizing changes.
The parameters for each phase are shown in Table 2.
Table 2. Optimization parameters by phase.
In Phase 1, the focus is on collision avoidance and the formation of basic traffic patterns with aggressive collision penalties. Phase 2 focuses on optimizing the timing of tasks by introducing delay penalties while reducing collision sensitivity. In the final phase, movement patterns are refined through increased movement rewards and evaporation, allowing for smoother traffic flow. The effectiveness of the optimization depends on the balance between these mechanisms. Strong collision penalties in the early phases establish basic safety patterns, while the emphasis on movement rewards and evaporation in the later phases allows these patterns to adapt to changing conditions. The delay factor helps to maintain efficient task completion without compromising the emergent traffic patterns. An analysis of the optimization parameters as well as stability and convergence is presented next through an illustrative example.

3.4. Illustrative Example

To illustrate the key mechanisms of the optimization process, we present a simplified 4 × 4 test scenario, shown in Figure 2. The environment contains four AMRs with pickup and dropoff stations positioned in the corners.
Figure 2. Solutions to the test problem: (a) first solution and (b) second solution.
For each generated task T, the due time t d u e is set to d + 3 , where d is the minimum path length for the AMR to complete the task. This buffer of 3 time units provides some flexibility in conflict resolution while maintaining pressure on the system to optimize routes. The collision penalty parameter t p is set to 6 units, which creates a significant incentive for the optimization process to develop conflict-avoiding movement patterns.
The optimization process results in two symmetrical solutions, shown in Figure 2a,b, demonstrating how different movement patterns can evolve under the same optimization parameters due to the stochastic nature of the process. Both solutions generate inner and outer rings, preferring movements in opposite directions.
The temporal evolution of movement patterns during the optimization process can be observed through successive snapshots taken every 20,000 iterations, as shown in Figure 3. For clarity, only costs lower than the neutral value of 0.5 are displayed. During the first 100,000 iterations, an inner roundabout pattern emerges through the combined effect of the movement reward mechanism and the collision penalty. The latter is particularly important in penalizing the initial shortest routes along the outer edges of the environment, where head-on collisions are most likely to occur. This naturally leads to the formation of a central circular pattern that provides conflict-free paths between stations. Between iterations 100,000 and 150,000, the delay penalty becomes the dominant factor, driving the propagation of costs outward from the established inner ring. In this phase, the organized movement pattern is effectively extended to the outer regions of the environment. In the final phase of optimization (iterations 150,000 to 200,000), the established movement patterns are reinforced through continued application of the movement reward mechanism, while the evaporation mechanism evaporates the rest.
Figure 3. The emergence of the resulting movement patterns.
Further experiments with modified parameters reveal how different conditions influence the emerging movement patterns. When only a single AMR operates in the environment, the optimization generates bidirectional paths that directly connect pickup and dropoff stations, as shown in Figure 4a. Without the need to avoid conflicts, the system naturally converges to these shortest paths between stations. The importance of the collision penalty mechanism becomes evident when it is disabled, as illustrated in Figure 4b, which shows the optimization results using 4 AMRs. In this case, the movement reward mechanism alone leads to the formation of a single-direction outer ring, where the direction (clockwise or counterclockwise) is randomly determined in the early stages of optimization and subsequently reinforced through positive feedback. If, instead, additional tasks are introduced between the top two stations, creating higher traffic demand along the top row, a distinct hybrid pattern emerges (Figure 4c). A bidirectional path is formed between these frequently connected stations, demonstrating the algorithm’s ability to adapt to non-uniform task distribution patterns.
Figure 4. Additional test scenarios demonstrating the impact of different parameters on the emerging movement patterns: (a) solution with a single AMR, (b) solution without collision penalty, and (c) solution with additional tasks.
A sensitivity analysis was performed by varying key parameters, specifically the collision penalty p c in Phase 1 and the delay factor α d in Phase 2. As illustrated in Figure 5, alternative parameter values can sometimes achieve similar performance levels. However, the default parameter configuration converges more reliably to the optimal solution.
Figure 5. Sensitivity analysis of key parameters by phase.
Figure 6 compares the performance of the default algorithm with a variant where Phase 1 is omitted (i.e., without the initial 100,000 optimization iterations). Without Phase 1, the algorithm primarily relies on Phase 2 to determine the movement directions, followed by Phase 3, which reinforces them. The results show that both system performance (e.g., throughput) and stability, as measured by the standard deviation of performance metrics, decrease significantly without Phase 1. This shows how important the initial phase is for establishing basic collision avoidance strategies before throughput is optimized in subsequent phases.
Figure 6. Comparison of algorithm performance when Phase 1 is removed, means and standard deviations.
This simple yet illustrative example demonstrates several important strengths of the proposed optimization approach. From the test scenarios, we can clearly observe how the algorithm consistently generates coherent movement patterns that adapt to different operating conditions and system parameters. The emergence of roundabouts, bidirectional corridors, and hybrid solutions shows that the method can discover suitable movement constraints without requiring explicit programming of these patterns.
The results are particularly notable in their consistency. While the stochastic nature of the process can lead to different specific solutions, as shown in the original two variants, the generated patterns invariably reflect the underlying system requirements. For example, when traffic is concentrated between specific stations, the algorithm reliably develops more direct routes between these points while maintaining efficient circulation patterns for the remaining traffic. Similarly, the degradation to simple bidirectional paths in the single-AMR case and the emergence of unidirectional flow when collision avoidance is not prioritized demonstrate that the optimization process responds logically to changes in system parameters.

3.5. ROS2 Implementation

ROS, recently upgraded to ROS2, is a set of software libraries and tools for the development of robotic applications [38]. One of the key systems within ROS2 is Nav2, a comprehensive modular and easily reconfigurable navigation stack that facilitates the seamless integration of diverse sensors, planners, and controllers. The top-level component of Nav2 is the Behavior Tree Navigator, which activates and tracks the progress of the three task-specific asynchronous servers, i.e., the Recovery Server, the Controller Server, and the Planner Server [39]. Each of these task-specific servers operates as an ROS2 node that provides algorithm plugins in the form of dynamically loaded libraries at runtime.
Global path planning is usually formulated as a graph search problem to find the shortest path from the starting point to the goal destination [40]. Computing the global path for a robot is a task of the planner server, more precisely the global planner. It seeks to find the optimal sequences of valid configurations to determine a route through an environment [41]. The algorithms for global path planning are usually extensions of Dijkstra’s algorithm that try to find the path with minimum cost. Since the A* algorithm was used for generation of bio-inspired grid graphs, we tested our approach by comparing A* that works on non-optimized cost maps to A* that calculates the least cost path based on the obtained optimized costmaps. For this purpose, a new Nav2 global planner plugin was developed. For local planning and conflict resolution in a dynamic environment, the Model Predictive Path Integral (MPPI) controller [42], a successor of Timed Elastic Band (TEB) and pure path tracking MPC controllers, was used.
To simulate the robots and test the developed plugin, Gazebo [43], a 3D rigid body simulator, was used. It provides the necessary interfaces for physics-based simulations in realistic environments. The robot used for the simulations was the Turtlebot3 Waffle, a two-wheeled robot equipped with a 360 Laser Distance Sensor LDS-01. For this robot, a physical model and interface packages are already provided by ROS2. We chose Turtlebots 3 for our Gazebo simulations because they provide a standardized, well-documented platform that captures the essential kinematic and motion planning challenges of differential-drive robots, commonly employed in warehouse logistics. Their widespread use in robotics research also allows for better reproducibility and comparison with other approaches.

4. Case Studies

To validate our approach, we tested the optimization algorithm on three distinct environments: a standard MAPF benchmark layout featuring connected rooms and two real industrial scenarios from manufacturing facilities. For the industrial scenarios, we compared our results with solutions from human experts to evaluate their performance against traditional manual design approaches. These cases were chosen to demonstrate the effectiveness of the method across different scales and levels of complexity, from academic benchmarks to real-world applications.
Given the unique nature of our approach, which focuses on spatial optimization through movement constraints rather than temporal coordination as in traditional MAPF, a direct comparison with the existing benchmarks is challenging. While MAPF benchmarks typically evaluate collision avoidance and temporal efficiency, our method addresses the spatial distribution of robot traffic and the associated costs. Therefore, we evaluated our approach in two ways: first by comparing it to human expert solutions in real industrial scenarios and second by measuring the improvement over standard A* pathfinding without directional constraints. This evaluation methodology enables demonstrating both the practical value in real-world settings and the quantitative benefits of our spatial optimization approach.
The expert solutions were designed by industry practitioners who were provided the layout, number of robots, and task descriptions, including frequencies and pickup/delivery locations. The experts manually drew their preferred directions on paper, which were then translated into low directed costs for comparison with our automated approach. While expert-designed solutions benefit from human intuition and experience, they face several inherent limitations. Experts typically rely on simple rules and visual heuristics, making it difficult to optimize for complex interactions between multiple robots. They tend to favor symmetric patterns that are easier to conceptualize but may not be optimal. Additionally, it is difficult for experts to take into account the specifics of an intralogistic problem such as specific task frequencies between stations.
The evaluation process included both quick assessments and comprehensive validations to ensure the robustness of our optimization algorithm. First, we used the optimization algorithm to generate movement constraints for each environment using the event-based simulator. The solutions were then evaluated within the same environment. We then performed a thorough validation of the optimized movement constraints using physics-based simulations in Gazebo. In this stage, the constraints were implemented through our custom Nav2 global planner plugin, which enabled a detailed examination of the algorithm’s performance in a more realistic simulation environment.
All the optimizations were performed with the same parameter settings as described in Section 3, with the only variation being the number of AMRs, which was adjusted according to the specific requirements of each environment. This consistency helps to demonstrate the robustness of the method across different scenarios while also illustrating how the resulting movement patterns naturally adapt to the unique characteristics of each layout.

4.1. MAPF Benchmark: Rooms’ Layout

The rooms’ layout represents a standard benchmark from the MAPF literature [44], consisting of multiple connected rooms separated by narrow corridors. This layout is particularly challenging due to its bottlenecks and potential for deadlocks in the doorways. The environment contains sixteen rooms connected by narrow corridors, five pickup and five dropoff stations distributed across the rooms, and corridors wide enough for only one AMR at a time. The optimization process for five AMRs resulted in several notable movement patterns, namely one-way traffic flows through certain corridors as shown in Figure 7.
Figure 7. The solution to the rooms’ layout, obtained through the presented algorithm.

4.2. Industrial Scenario A

The first industrial scenario represents a real manufacturing facility designed for two automated forklifts. The layout features input buffers (pickup stations) in the bottom left area and dropoff stations in the top right, with several intermediate buffer locations distributed throughout the space. Figure 8 shows two solutions, one designed by an expert and another generated algorithmically. The most notable difference is in the bottom left area, where the expert chose two-way traffic along the sides of the layout, while the algorithmic solution features two downwards paths and an upwards one through the center. Another notable difference is that the experts could only provide preferred directions for each cell; therefore, the costs are either low (green arrow) or neutral (everywhere else).
Figure 8. The (a) expert and (b) algorithmic solutions for industrial scenario A. Pickups in light, intermediate buffers in medium, and dropoffs in dark blue.

4.3. Industrial Scenario B

The second industrial scenario depicts another manufacturing facility designed for five automated forklifts. The layout is characterized by a vertical material flow, with pickups at the top, processing units on the right—each with their own pickups and dropoffs—and final dropoffs in the bottom left, along with scattered intermediate buffers. Figure 9 shows the expert and algorithmic solutions. The algorithmic solution features significantly more one-way movement patterns.
Figure 9. The (a) expert and (b) algorithmic solutions for industrial scenario B.

4.4. Evaluation in the Event-Based Simulator

Although the event-based simulator was primarily used for optimization, its computational efficiency also makes it valuable for rapid evaluation of different movement strategies. We leveraged this capability to perform detailed performance comparisons across multiple metrics. For each scenario, key operational aspects were evaluated through simulations running for 10,000 iterations (ticks of simulated time) with 10 repetitions to ensure statistical significance. The evaluation tracked the number of conflicts (collisions requiring recovery), tasks completed, percentage of tasks completed within their due time, average delay per task, and total path length traveled by all the AMRs.
In the rooms scenario (Table 3), our approach performed significantly better across all the metrics compared to unweighted pathfinding. Conflicts decreased by 41.9% (7.50 vs. 12.90), whereas task completion improved by 10.7% (9.12 vs. 8.24). On-time task completion increased substantially from 63.4% to 85.0%. The average delay per task dropped by 68.9% (2.34 vs. 7.52), with only a minimal increase in path length (90.98 vs. 88.44).
Table 3. Rooms’ results.
In industrial scenario A (Table 4), our method showed statistically significant improvements over both the unweighted and expert approaches. Conflicts were significantly reduced to 3.55 ± 0.25 compared to the unweighted (6.85 ± 0.35, p < 0.05 ) and expert (3.85 ± 0.40, p < 0.05 ) solutions. The task completion rate was highest at 22.70 ± 0.25, significantly higher than the expert (20.05 ± 0.35) and unweighted (22.05 ± 0.35) solutions. On-time task completion reached 76.6%, with the lowest average delay being 0.47 units. This was achieved with only a modest increase in path length compared to unweighted routing (39.62 vs. 37.84).
Table 4. Scenario A results.
The more complex industrial scenario B (Table 5) demonstrated statistically significant improvements across the key metrics. Conflicts decreased significantly by 20.3% compared to the expert solution (14.64 ± 0.40 vs. 18.38 ± 0.96) and by 30.8% compared to unweighted (21.16 ± 0.60). Task completion showed significant improvement to 14.36 ± 0.22 tasks versus the expert (12.98 ± 0.44) and unweighted (12.42 ± 0.28) solutions. On-time delivery reached 85.72%, significantly higher than the expert (77.15%) and unweighted (68.39%) solutions. Average delay was reduced to 2.54 units while maintaining path lengths comparable to the expert solution.
Table 5. Scenario B results.
Across all the evaluated scenarios, our bio-inspired optimization approach consistently demonstrated substantial reductions in conflicts and delays while enhancing task completion rates and punctuality. As shown in Figure 10, the system achieves a steady improvement in punctuality—a critical metric for industrial applications—throughout the 200,000 iteration optimization process. The minimal increases in path lengths indicate that the algorithm effectively balances the trade-offs between minimizing traversal distances and enhancing overall system performance.
Figure 10. Analysis of punctuality for industrial scenarios: (a) scenario A and (b) scenario B.

4.5. Gazebo Simulations

We validated our approach using physics-based simulations in Gazebo. The simulations were executed in the simulator (Figure 11a,b), using the environments built based on the three example maps (obstacles represented as walls), and visualized using RViz (Figure 11c).
Figure 11. Simulation in ROS2/Gazebo: (a) 3D view of the rooms’ layout, (b) top-down view, and (c) RViZ view.
The duration of the simulation was 1 h of simulated time. We compared the throughput of A* that works on non-optimized costmaps with A* that works on costmaps generated by the proposed bio-inspired algorithm. This comparison is motivated by several factors. Firstly, A* is widely regarded as a benchmark algorithm in path planning due to its efficiency and optimality guarantees. Secondly, since our bio-inspired method uses A* as its underlying pathfinding algorithm, A* serves as the most appropriate baseline for comparison. This allows us to isolate and evaluate the specific improvements introduced by our bio-inspired weight optimization. Additionally, A* is widely used in many robotic navigation systems, including the ROS2 Nav2 stack, making it a practical and relevant comparison point for real-world applications.

4.6. Results

We evaluated our bio-inspired movement constraints against unweighted map and expert-designed solutions by measuring the total number of completed tasks and distinguishing between tasks completed with and without recovery actions due to conflicts such as near-collisions during one-hour simulations. The results are shown in Figure 12.
Figure 12. Performance comparison across scenarios. Bars show tasks completed with and without recovery actions; whiskers indicate the standard deviation of total task completions.
In the rooms scenario, our algorithmic solution improved the efficiency as fewer recovery actions were needed (18.7 ± 2.21 vs. 20.9 ± 2.02 for the unweighted map) while more tasks were completed overall (45.6 ± 3.72 vs. 41.4 ± 4.03). The higher proportion of tasks without recovery actions (26.9 ± 4.12 vs. 20.5 ± 4.50) indicates more effective traffic management.
For industrial scenario A, our approach showed a significant improvement, with more tasks completed (123.4 ± 5.72) than both the unweighted map (113.6 ± 8.95) and expert solutions (119.0 ± 6.32). Notably, fewer recovery interventions were required (10.1 ± 2.96 vs. 14.2 ± 2.94 for the unweighted map and 10.4 ± 2.50 for the expert solution), indicating more efficient movement patterns.
In the more complex industrial scenario B, which involves five AMRs, our solution achieved higher throughput (73.5 ± 5.15 tasks) compared to the unweighted map (68.4 ± 4.45) and expert solutions (72.4 ± 4.99). The recovery interventions were comparable across all the approaches (21.7 ± 2.95 for our algorithmic solution, 20.7 ± 2.95 for the unweighted map, and 22.3 ± 2.50 for the expert solution), suggesting that some baseline level of conflict resolution may be unavoidable in complex environments.
These results show that our bio-inspired constraints consistently improve system performance, particularly in scenarios with clear traffic patterns. The method effectively reduces the number of recovery actions while maintaining or improving throughput across different environmental complexities.

5. Conclusions

This study presents a bio-inspired approach for the autonomous generation of movement constraints in multi-AMR systems, demonstrating how an optimization mechanism based on four basic principles—movement rewards, collision penalties, delay feedback, and evaporation—can effectively improve system performance. It was shown that spatial constraints can proactively reduce the number of conflict situations without temporal coordination.
The efficiency of the proposed method was validated through both event-based and physics-based simulations. The solutions obtained with our method consistently outperformed both unconstrained navigation and expert-designed solutions. Significant improvements in system performance were observed in several test scenarios, including standard MAPF benchmarks and real industrial environments.
Compared to other existing approaches, our method offers several advantages. First, the method integrates complete system characteristics, including layout, fleet size, task distribution, and dispatching algorithms, into the optimization process and tailors the solution to the specific intralogistics problem. The existing approaches usually only take into account the layout. Second, the method can successfully handle complex spatial constraints (e.g., narrow corridors), which reduces the need for recovery actions while ensuring high throughput. Third, solution generation is very fast and typically requires only a few minutes, even for complex layouts. If the system parameters change (increased demand, different material flow, fleet size, etc.), the movement constraints can be adapted quickly and without manual redesign.
The adaptability and low computational complexity of the proposed approach provide flexibility that traditional design approaches lack, making it particularly practical for dynamic real-world applications. The successful integration with the ROS2 Nav2 stack through a custom global planner plugin also demonstrates the practical applicability of the approach in standard robotics frameworks.
However, there are some limitations of the proposed method that should be considered. We have shown that conflict situations with other vehicles can be proactively reduced through spatial constraints, but the performance advantages diminish in extremely dense traffic situations, where temporal coordination becomes essential. For real-world deployment, our approach could be integrated with state-of-the-art scheduling algorithms to jointly address spatial and temporal coordination. This can lead to additional improvements in system efficiency.
Another limitation of the proposed method is that it assumes static obstacles, while the resolution of conflicts with dynamic obstacles is left to the local planner. It also does not incorporate real-time adaptability mechanisms to adjust movement constraints dynamically based on observed traffic fluctuations.
To enhance real-world applicability, several future directions should be explored. First, the optimization algorithm should be extended to incorporate dynamic parameter adjustment, enabling more effective adaptation to varying traffic densities and patterns. Second, integrating reinforcement learning techniques could further enhance the adaptability of movement constraints in response to real-time operational conditions. A hybrid approach combining bio-inspired heuristics with learning-based methods may offer a robust solution for balancing proactive spatial constraint generation with real-time adaptability. Finally, additional validation in real industrial settings would help to verify the effectiveness of the method under actual operating conditions. This includes evaluating how the approach scales with larger fleets, interacts with dynamic obstacles such as human workers, and integrates with industrial fleet management systems. Addressing these aspects would help to bridge the gap between theoretical performance gains and real-world deployment.

Author Contributions

Conceptualization, R.V., G.K. and T.Ž.; methodology, R.V., T.Ž., A.M. and J.D.; software, R.V., T.Ž., A.M. and J.D.; validation, R.V. and T.Ž.; formal analysis, R.V.; investigation, R.V., G.K. and T.Ž.; resources, R.V. and G.K.; data curation, R.V., T.Ž. and A.M.; writing—original draft preparation, R.V., T.Ž., A.M. and J.D.; writing—review and editing, R.V., G.K., T.Ž. and A.M.; visualization, T.Ž., A.M. and R.V.; supervision, R.V. and G.K.; project administration, R.V. and G.K.; funding acquisition, R.V. and G.K. All authors have read and agreed to the published version of the manuscript.

Funding

This work has been supported by The Slovenian Research and Innovation Agency ARIS, grant nos. L2-60153, P2-0219, and P2-0270.

Data Availability Statement

The source code for the discrete-event-based simulator and the Gazebo validations is available at https://github.com/lampa-research/bio-inspired-traffic-optimization (accessed on 29 January 2025).

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Sousa, N.; Oliveira, N.; Praca, I. A Multi-Agent System For Autonomous Mobile Robot Coordination. In Proceedings of the Modelling and Simulation 2021: 35th Annual European Simulation and Modelling Conference 2021 (ESM 2021), Virtual Event, 31 May–2 June 2021; pp. 105–110. [Google Scholar]
  2. Cortés, J.; Egerstedt, M. Coordinated control of multi-robot systems: A survey. Sice J. Control. Meas. Syst. Integr. 2017, 10, 495–503. [Google Scholar]
  3. Kalempa, V.C.; Piardi, L.; Limeira, M.; de Oliveira, A.S. Multi-robot preemptive task scheduling with fault recovery: A novel approach to automatic logistics of smart factories. Sensors 2021, 21, 6536. [Google Scholar] [CrossRef] [PubMed]
  4. Raibail, M.; Rahman, A.H.A.; AL-Anizy, G.J.; Nasrudin, M.F.; Nadzir, M.S.M.; Noraini, N.M.R.; Yee, T.S. Decentralized multi-robot collision avoidance: A systematic review from 2015 to 2021. Symmetry 2022, 14, 610. [Google Scholar] [CrossRef]
  5. Jiang, Z.; Zhang, X.; Wang, P. Grid-Map-Based Path Planning and Task Assignment for Multi-Type AGVs in a Distribution Warehouse. Mathematics 2023, 11, 2802. [Google Scholar] [CrossRef]
  6. Stenzel, J.; Lünsch, D.; Schmitz, L. Automated topology creation for global path planning of large AGV fleets. In Proceedings of the IEEE Intelligent Transportation Systems Conference 2021 (ITSC 2021), Indianapolis, Indiana, 19–22 September 2021; pp. 3373–3380. [Google Scholar]
  7. Digani, V.; Sabattini, L.; Secchi, C.; Fantuzzi, C. An automatic approach for the generation of the roadmap for multi-AGV systems in an industrial environment. In Proceedings of the 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems, Chicago, IL, USA, 14–18 September 2014; pp. 1736–1741. [Google Scholar]
  8. Beinschob, P.; Meyer, M.; Reinke, C.; Digani, V.; Secchi, C.; Sabattini, L. Semi-automated map creation for fast deployment of AGV fleets in modern logistics. Robot. Auton. Syst. 2017, 87, 281–295. [Google Scholar] [CrossRef]
  9. Uttendorf, S.; Eilert, B.; Overmeyer, L. Combining a fuzzy inference system with an A* algorithm for the automated generation of roadmaps for Automated Guided Vehicles. Automatisierungstechnik 2017, 65, 189–197. [Google Scholar] [CrossRef]
  10. Stenzel, J.; Schmitz, L. Automated Roadmap Graph Creation and MAPF Benchmarking for Large AGV Fleets. In Proceedings of the 2022 8th International Conference on Automation, Robotics and Applications, ICARA 2022, Prague, Czech Republic, 18–20 February 2022; pp. 146–153. [Google Scholar]
  11. Keith, R.; La, H.M. Review of Autonomous Mobile Robots for the Warehouse Environment. arXiv 2024, arXiv:2406.08333. [Google Scholar]
  12. Wurman, P.R.; D’Andrea, R.; Mountz, M. Coordinating hundreds of cooperative, autonomous vehicles in warehouses. AI Mag. 2008, 29, 9–20. [Google Scholar]
  13. Azadeh, K.; De Koster, R.; Roy, D. Robotized and automated warehouse systems: Review and recent developments. Transp. Sci. 2019, 53, 917–945. [Google Scholar] [CrossRef]
  14. Kleiner, A.; Sun, D.; Meyer-Delius, D. ARMO: Adaptive road map optimization for large robot teams. In Proceedings of the 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems, San Francisco, CA, USA, 25–30 September 2011; pp. 3276–3282. [Google Scholar]
  15. Henkel, C.; Toussaint, M. Optimized Directed Roadmap Graph for Multi-Agent Path Finding Using Stochastic Gradient Descent. In Proceedings of the 35th Annual ACM Symposium on Applied Computing, Brno, Czech Republic, 30 March–3 April 2020; pp. 776–783. [Google Scholar]
  16. Kozjek, D.; Malus, A.; Vrabič, R. Reinforcement-Learning-Based Route Generation for Heavy-Traffic Autonomous Mobile Robot Systems. Sensors 2021, 21, 4809. [Google Scholar] [CrossRef]
  17. Kim, J.; Kim, K. Optimizing Large-Scale Fleet Management on a Road Network using Multi-Agent Deep Reinforcement Learning with Graph Neural Network. In Proceedings of the 2021 IEEE International Intelligent Transportation Systems Conference (ITSC), Indianapolis, IN, USA, 19–22 September 2021. [Google Scholar] [CrossRef]
  18. Choi, H.; Yu, S.; Lee, D.; Noh, S.D.; Ji, S.; Kim, H.; Yoon, H.; Kwon, M.; Han, J. Optimization of the Factory Layout and Production Flow Using Production-Simulation-Based Reinforcement Learning. Machines 2024, 12, 390. [Google Scholar] [CrossRef]
  19. Chen, Y.; Chen, M.; Yu, F.; Lin, H.; Yi, W. An improved ant colony algorithm with deep reinforcement learning for the robust multiobjective AGV routing problem in assembly workshops. Appl. Sci. 2024, 14, 7135. [Google Scholar] [CrossRef]
  20. Zhang, X.; Li, W.; Li, H.; Liu, Y.; Liu, F. Load balancing of multi-AGV road network based on improved Q-learning algorithm and macroscopic fundamental diagram. Complex Intell. Syst. 2024, 10, 3025–3039. [Google Scholar] [CrossRef]
  21. Hu, H.; Yang, X.; Xiao, S.; Wang, F. Anti-conflict AGV path planning in automated container terminals based on multi-agent reinforcement learning. Int. J. Prod. Res. 2023, 61, 65–80. [Google Scholar] [CrossRef]
  22. Peñacoba, M.; Bayona, E.; Sierra-García, J.E.; Santos, M. Route Optimization for UVC Disinfection Robot Using Bio-Inspired Metaheuristic Techniques. Biomimetics 2024, 9, 744. [Google Scholar] [CrossRef] [PubMed]
  23. Zhang, Y.; Gong, D.W.; Zhang, J.H. Robot path planning in uncertain environment using multi-objective particle swarm optimization. Neurocomputing 2013, 103, 172–185. [Google Scholar] [CrossRef]
  24. Thabit, S.; Mohades, A. Multi-robot path planning based on multi-objective particle swarm optimization. IEEE Access 2018, 7, 2138–2147. [Google Scholar] [CrossRef]
  25. Wang, L.; Liu, L.; Lu, X. Robot Path Planning Based on Generative Learning Particle Swarm Optimization. IEEE Access 2024, 12, 130063–130072. [Google Scholar] [CrossRef]
  26. Wei, C.; Ji, Z.; Cai, B. Particle swarm optimization for cooperative multi-robot task allocation: A multi-objective approach. IEEE Robot. Autom. Lett. 2020, 5, 2530–2537. [Google Scholar] [CrossRef]
  27. Lamini, C.; Benhlima, S.; Elbekri, A. Genetic algorithm based approach for autonomous mobile robot path planning. Procedia Comput. Sci. 2018, 127, 180–189. [Google Scholar] [CrossRef]
  28. Tuncer, A.; Yildirim, M. Dynamic path planning of mobile robots with improved genetic algorithm. Comput. Electr. Eng. 2012, 38, 1564–1572. [Google Scholar] [CrossRef]
  29. Vrabič, R.; Žužek, T.; Škulj, G.; Banfi, I.; Zaletelj, V. Improving the Flow in Multi-robot Logistic Systems Through Optimization of Layout Roadmaps. In Proceedings of the International Conference on Intelligent Autonomous Systems 17 (IAS 2022), Zagreb, Croatia, 13–16 June 2022; pp. 923–934. [Google Scholar]
  30. Tao, Y.; Gao, H.; Ren, F.; Chen, C.; Wang, T.; Xiong, H.; Jiang, S. A mobile service robot global path planning method based on ant colony optimization and fuzzy control. Appl. Sci. 2021, 11, 3605. [Google Scholar] [CrossRef]
  31. Kulatunga, A.; Liu, D.; Dissanayake, G.; Siyambalapitiya, S. Ant Colony Optimization based Simultaneous Task Allocation and Path Planning of Autonomous Vehicles. In Proceedings of the 2006 IEEE Conference on Cybernetics and Intelligent Systems, Bangkok, Thailand, 7–9 June 2006; pp. 1–6. [Google Scholar]
  32. Porta Garcia, M.; Montiel, O.; Castillo, O.; Sepulveda, R.; Melin, P. Path planning for autonomous mobile robot navigation with ant colony optimization and fuzzy cost function evaluation. Appl. Soft Comput. 2009, 9, 1102–1110. [Google Scholar] [CrossRef]
  33. Purian, F.; Sadeghian, E. Mobile robots path planning using ant colony optimization and Fuzzy Logic algorithms in unknown dynamic environments. In Proceedings of the 2013 International Conference on Control, Automation, Robotics and Embedded Systems (CARE), Jabalpur, Madhya Pradesh, India, 16–18 December 2013; pp. 1–6. [Google Scholar]
  34. Gan, Y.; Qu, F.; Sun, F.; He, W.; Zhang, P. Research on path planning for mobile robot based on ACO. In Proceedings of the 2017 29th Chinese Control And Decision Conference (CCDC), Chongqing, China, 28–30 May 2017; pp. 6738–6743. [Google Scholar]
  35. Bedi, P.; Mediratta, N.; Dhand, S.; Sharma, R.; Singhal, A. Avoiding Traffic Jam Using Ant Colony Optimization—A Novel Approach. In Proceedings of the International Conference on Computational Intelligence and Multimedia Applications (ICCIMA 2007), Sivakasi, Tamil Nadu, India, 13–15 December 2007; pp. 61–67. [Google Scholar]
  36. Jansen, M.R.J.M.R.; Sturtevant, N. Direction maps for cooperative pathfinding. In Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, Palo Alto, CA, USA, 22–24 October 2008; Volume 4, pp. 185–190. [Google Scholar]
  37. Žužek, T.; Vrabič, R.; Zdešar, A.; Škulj, G.; Banfi, I.; Bošnak, M.; Zaletelj, V.; Klančar, G. Simulation-Based Approach for Automatic Roadmap Design in Multi-AGV Systems. IEEE Trans. Autom. Sci. Eng. 2023, early access. [Google Scholar] [CrossRef]
  38. Macenski, S.; Foote, T.; Gerkey, B.; Lalancette, C.; Woodall, W. Robot Operating System 2: Design, architecture, and uses in the wild. Sci. Robot. 2022, 7, eabm6074. [Google Scholar] [CrossRef] [PubMed]
  39. Macenski, S.; Martin, F.; White, R.; Clavero, J.G. The Marathon 2: A Navigation System. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Las Vegas, NV, USA, 25–29 October 2020. [Google Scholar]
  40. Diéguez, A.; Sanz, R.; Fernández, J. A global motion planner that learns from experience for autonomous mobile robots. Robot.-Comput.-Integr. Manuf. 2007, 23, 544–552. [Google Scholar] [CrossRef]
  41. Macenski, S.; Moore, T.; Lu, D.; Merzlyakov, A.; Ferguson, M. From the Desks of ROS Maintainers: A Survey of Modern & Capable Mobile Robotics Algorithms in the Robot Operating System 2. Robot. Auton. Syst. 2023, 168, 104493. [Google Scholar]
  42. MPPI. Available online: https://navigation.ros.org/configuration/packages/configuring-mppic.html (accessed on 25 July 2024).
  43. Gazebo. Available online: https://classic.gazebosim.org/ (accessed on 25 July 2024).
  44. Stern, R.; Sturtevant, N.; Felner, A.; Koenig, S.; Ma, H.; Walker, T.; Li, J.; Atzmon, D.; Cohen, L.; Kumar, T.; et al. Multi-Agent Pathfinding: Definitions, Variants, and Benchmark. In Proceedings of the Twelfth Annual Symposium on Combinatorial Search (SoCS 2019), Napa, CA, USA, 16–17 July 2019; pp. 151–158. [Google Scholar]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Article Metrics

Citations

Article Access Statistics

Multiple requests from the same IP address are counted as one view.