Next Article in Journal
Machine Learning-Based Position Detection Using Hall-Effect Sensor Arrays on Resource-Constrained Microcontroller
Previous Article in Journal
A Review of Strain-Distributed Optical Fiber Sensors for Geohazard Monitoring: An Update
Previous Article in Special Issue
A Digital Twin Framework for Visual Perception in Electrical Substations Under Dynamic Environmental Conditions
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Heuristic Approaches for Coordinating Collaborative Heterogeneous Robotic Systems in Harvesting Automation with Size Constraints

1
Department of Mechanical and Aerospace Engineering, Michigan Technological University, Houghton, MI 49931, USA
2
Department of Applied Computing, Michigan Technological University, Houghton, MI 49931, USA
*
Author to whom correspondence should be addressed.
Sensors 2025, 25(20), 6443; https://doi.org/10.3390/s25206443 (registering DOI)
Submission received: 9 September 2025 / Revised: 9 October 2025 / Accepted: 16 October 2025 / Published: 18 October 2025

Abstract

Multi-agent coordination with task allocation, routing, and scheduling presents critical challenges when deploying heterogeneous robotic systems in constrained agricultural environments. These systems involve real-time sensing during their operations with various sensors, and having quick updates on coordination based on sensed data is critical. This paper addresses the specific requirements of harvesting automation through three heuristic approaches: (1) primal–dual workload balancing inspired by combinatorial optimization techniques, (2) greedy task assignment with iterative local optimization, and (3) LLM-based constraint processing through prompt engineering. Our agricultural application scenario incorporates robot size constraints for navigating narrow crop rows while optimizing task completion time. The greedy heuristic employs rapid initial task allocation based on proximity and capability matching, followed by iterative route refinement. The primal–dual approach adapts combinatorial optimization principles from recent multi-depot routing solutions, dynamically redistributing workloads between robots through dual variable adjustments to minimize maximum completion time. The LLM-based method utilizes structured prompt engineering to encode spatial constraints and robot capabilities, generating feasible solutions through successive refinement cycles. We implemented and compared these approaches through extensive simulations. Preliminary results demonstrate that all three approaches produce feasible solutions with reasonable quality. The results demonstrate the potential of the methods for real-world applications that can be quickly adopted into variations of the problem to offer valuable insights into solving complex coordination problems with heterogeneous multi-robot systems.

1. Introduction

The automation of agricultural harvesting processes through collaborative heterogeneous robotic systems represents a significant advancement in addressing global challenges such as food security, labor shortages, and sustainable farming practices, particularly for small farms. Small-scale farms, which often prioritize artisanal products or small-scale distillations, face acute labor shortages and cannot afford the specialized machinery used by larger operations. The potential for the automation of small farm harvesting through adaptive collaboration with heterogeneous robotic fleets is considerable. However, the effective deployment of such systems requires solving complex path planning problems that extend beyond traditional optimization challenges.
Agricultural automation presents unique challenges due to several factors. A farm may cultivate multiple crop varieties, each requiring different harvesting techniques or handling, thus necessitating a fleet of heterogeneous robots with specialized capabilities. As a case study, consider a lavender farm where different species require robots of varying sizes and toolsets for optimal harvesting. Additionally, the dynamic nature of the agricultural environment, with seasonal and daily changes in field conditions, necessitates optimizing for efficiency while satisfying diverse robot-specific constraints such as size, payload capacity, and fuel consumption. Each farm has different restrictions and needs, which may require different strategies for collaborative operations. Our research aims to develop algorithms for vehicle routing problems under diverse settings with generalized cases applicable to various domains beyond agriculture, such as warehouse logistics, surveillance, and search and rescue operations [1,2,3,4,5,6,7,8].
Recent research has proposed various state-of-the-art techniques for agricultural automation involving multiple heterogeneous robots. For instance, Conesa-Muñoz et al. introduced a simulated annealing-based method for path planning of heterogeneous agricultural vehicles, optimizing criteria such as distance, cost, and time while considering fuel capacity [9] under the simplified assumptions of uniform field geometry. Furchì et al. developed a route planning strategy for heterogeneous mobile robots in precision agriculture, utilizing a multi-Steiner Traveling Salesman Problem to optimize task assignments and paths while accounting for fuel constraints [10]. Mukhamediev et al. proposed a genetic-algorithm-based method for coverage path planning of heterogeneous aerial vehicles with fuel constraints, focusing on environments with convex fields without obstacles [11]. Urvina et al. presented an integrated planning strategy for Skid–Steer Mobile Robots in complex agricultural environments, combining a global planning algorithm with a local path planner based on the Informed Rapidly exploring Random Tree Star [12]. This method prioritizes harvesting positions based on criteria such as minimum path length and vehicle load capacity while considering motion constraints. Pak et al. evaluated path planning algorithms for smart farms, concluding that the A* algorithm is suitable for minimizing crop damage and demonstrates high localization accuracy, although their study was limited to single-robot scenarios [13]. Utamima and Reiners addressed Agricultural Route Planning in multifield environments with irregular field shapes, aiming to optimize paths for (semi-)autonomous machines using a Fast Hybrid Algorithm [14].
Although these approaches offer valuable insights, they are often tailored to specific applications, which can limit their extensibility. This specialization highlights the need for more versatile and adaptable solution frameworks. Our work explicitly integrates robot-specific size constraints at narrow passages into a generalized framework and introduces a novel Large Language Model (LLM)-based heuristic for task allocation and path planning without task-specific training. This research develops and evaluates three distinct heuristic approaches: (1) a primal–dual heuristic derived from the problem’s mathematical formulation; (2) a fast greedy heuristic based on intuitive, iterative improvement; and (3) the LLM-based heuristic that leverages advanced prompt engineering. Our primary objective is to minimize the makespan (total completion time) while adhering to robot-specific size constraints at narrow passages. By developing and comparing these diverse methods, this paper provides a comprehensive analysis of different strategies for tackling complex coordination challenges. This approach not only addresses the immediate needs of agricultural automation but also offers insights with implications for a wide range of applications beyond agriculture.

2. Problem Description and Formulation

We are given a set of heterogeneous robots, each with a unique depot location, speed, physical size, and a set of tasks to be completed. The goal is to design a route for each robot that enables it to complete all tasks. The solution must be optimized for the following objective and adhere to a specific set of constraints. (1) Task coverage: Ensure that at least one robot handles every task. (2) Motion constraints: Each route must satisfy the motion constraints specific to the corresponding robot, accounting for its unique capabilities and limitations. (3) Size constraints: Each route must satisfy the size constraints for each robot, which means the robot is only allowed to travel in passages wider than its width. (4) Minimized job completion time: We aim to find the most efficient route for each robot to complete all tasks while minimizing the maximum operating time among all the robots. Figure 1 illustrates a sample scenario in a lavender farm, where two robots of different sizes are tasked with harvesting distinct lavender species, navigating passages of varying widths.
The problem assumes that the robots depart from their respective depots and return to the depots after visiting all the assigned tasks. Speed differences are reflected in the travel cost c o s t i j k , which represents the travel time for the robot k between locations of tasks i and j, using the average running speed of the robot. To incorporate kinematic feasibility, travel costs are computed by applying nonholonomic motion constraints. Travel costs are assumed to be symmetric between any two tasks. The robots are indexed k = 1 , , m such that their speeds are non-increasing, meaning their travel costs are non-decreasing, i.e., c o s t i j 1 c o s t i j 2 , , c o s t i j m , i , j V k , k = 1 , , m .
The problem is formulated as a Mixed-Integer Linear Program (MILP), which is NP-hard [15]. The heuristics described in Section 3 are derived from the Linear Program (LP) relaxation of this model. Given m robots and n tasks, the sets, parameters, and variables used in the formulation are defined as follows:
  • Sets and indices:
R = { r 1 , , r m } a set of robots
D = { d 1 , , d m } a set of depots
T = { t 1 , , t n } a set of tasks
V k = { d k } T a set of vertices for r k
E k = { ( i , j ) , i , j V k } a set of edges that connect all vertices in V k
  • Parameters:
P i j the minimum width of passages where vertices i and j are located
W k the width of r k
Ma sufficiently large constant (e.g., max ( W k ) )
c o s t i j k the travel cost of the edge from vertex i to j for r k
δ k ( S ) the subset of the edges of E k with one end in S and the other end in V k S
  • Decision variables:
x i j k the decision variable that represents whether edge ( i , j ) is used for the tour of r k
x i j k = 1 if edge ( i , j ) is traveled by r k 0 otherwise
z U k the decision variable that represents the assignment of tasks in T
z U k = 1 if U contains all vertices not assigned to r 1 , , r k 0 otherwise
qa continuous variable representing the maximum travel cost (makespan)
The MILP formulation is presented below. Note that for the LP relaxation used by our heuristic, the binary constraints on x i j k and z U k are relaxed to be non-negative.
C L P = min q
( i , j ) δ 1 ( S ) x i j 1 2 2 T U S z U 1 S T ,
( i , j ) δ k ( S ) x i j k 2 T U S ( z U k 1 z U k ) S T , k = 2 , , m 1 ,
( i , j ) δ m ( S ) x i j m 2 T U S z U m 1 S T ,
P i j W k M ( x i j k 1 ) ( i , j ) E k , k = 1 , , m ,
q i , j V k c o s t i j k x i j k k = 1 , , m ,
x i j k { 0 , 1 } , z U k { 0 , 1 } , q 0 .
For any U T , z U k is defined for k = 1 , , m 1 . For the first robot, for any S T , at least two edges must be selected from δ 1 ( S ) for its tour if there exists at least one task in S that is not connected to any of the depots in the set { d 2 , , d m } ; that is ( i , j ) δ 1 ( S ) x i j 1 2 , if T U S z U 1 = 0 . This condition can be expressed as ( i , j ) δ 1 ( S ) x i j 1 2 2 T U S z U 1 . Similarly, for any robot k { 2 , , m 1 } , for any S T , at least two edges must be chosen from δ k ( S ) for the tour of robot r k if S contains at least one task assigned to that robot. This constraint can be written as ( i , j ) δ k ( S ) x i j k 2 T U S ( z U k 1 z U k ) . Finally, for the last robot ( k = m ) , the corresponding constraint is ( i , j ) δ m ( S ) x i j m 2 T U S z U m 1 . Figure 2 provides an illustrative example of how the z U k variable functions within the assignment structure.
Constraints (1) and (6) work together to minimize the makespan q, a standard technique to linearize a min–max objective. Constraints (2)–(4) are connectivity constraints that serve two critical functions: (1) they ensure the set of tasks assigned to all robots forms a complete partition of the total task set T, and (2) they act as subtour elimination constraints, ensuring each robot follows a single continuous tour. Constraint (5) is the explicit size constraint. Using the Big M method, it ensures that if a path ( i , j ) is used by r k , then the condition W k P i j must hold. Consequently, nodes that are connected by passages narrower than W k are excluded from the feasible set of routes for robot r k , preventing infeasible task assignments. Constraint (7) defines the domains for the decision variables.

3. Heuristic Approaches for Coordination of Heterogeneous Robotic Systems

This section details the three distinct heuristic approaches developed to solve the coordination problem for heterogeneous robotic systems: a primal–dual-based heuristic derived from the mathematical formulation, an intuitive greedy algorithm, and a novel approach utilizing a Large Language Model (LLM) through prompt engineering.

3.1. A Primal–Dual Based Heuristic

Our primal–dual heuristic is derived from the linear programming (LP) relaxation of the problem, as formulated in (1)–(4) and (6)–(7) while relaxing the size constraint (5). The algorithm leverages the duality of this LP relaxation to construct approximate solutions. The dual formulation is as follows:
C d u a l = max 2 S T Y 1 ( S )
S : e δ k ( S ) Y k ( S ) c o s t i j k B k i , j V k , k = 1 , , m ,
S U Y k ( S ) S U Y k + 1 ( S ) U T , k = 1 , , m 1 ,
k = 1 , , m B k 1
Y k ( S ) 0 S T , k = 1 , , m ,
B k 0 k = 1 , , m .
The core structure of the algorithm, including the iterative search and workload balancing mechanisms, is adapted from our previous work in [16]. The algorithm begins with all dual variables set to zero and increases them uniformly with fixed B k values. This process continues until a constraint in (9) or (10) becomes tight. If a constraint in (9) becomes tight, the corresponding edge is added to its respective robot’s graph G k , merging the vertex sets it connects. If the newly formed set is reachable from the robot’s depot, it is marked as inactive; otherwise, it remains active. If a constraint in (10) becomes tight, the corresponding set is marked, and the iteration proceeds. The loop terminates when all sets for the first robot become inactive. The process is repeated for updated B k values to improve the workload balance. The primary modification in this work is the integration of Algorithm 1, which introduces a reallocation step to explicitly handle the size constraints after the initial relaxed assignment is determined. The following notations are used in the algorithm description:
  • Algorithm Notations:
F k Tasks allocated to r k while F = { F 1 , , F m }
P k Path of r k with tasks in F k while P = { P 1 , , P m }
ZThe set of violated assignments in the initial allocation
G k The graph that belongs to r k
N k A queue of nearby depots for the k t h depot arranged in ascending order
Algorithm 1 first identifies all task assignments that violate the size constraints and places them in a set Z for reassignment. It then iterates through each “violating” task z Z and evaluates the cost of reassigning it to every other robot capable of handling it. The reassignment that results in the minimum increase to the maximum cost (makespan) across all robots is selected. This ensures that all constraints are met while maintaining a balanced workload.
Algorithm 1 [Tour, TourCost] = Reallocation (F)
  1:
for  k = 1 , , m   do
  2:
    Let Q k be a set of vertices connected to d k .
  3:
    if there exists any vertex that violates the size constraints then
  4:
        Add it to Z and remove it from Q k .
  5:
    end if
  6:
end for
  7:
Remove all vertices in Q 1 from the rest of the graphs.
  8:
for  z Z   do
  9:
    Find the robots that can handle z.
10:
     if there exists any target assigned to multiple robots then
11:
      for each r k that can handle z do
12:
          Form a temporary assignment by adding all vertices in the component connected
          to z in G k to the Q k and removing them from the original assigned partition.
13:
          Compute the minimum spanning tree costs for the updated assignments and
          save the maximum cost to compare.
14:
      end for
15:
      Compare the resulting costs and pick the lowest one.
16:
    else
17:
       Add all vertices in the component connected to z in G k to Q k , and remove them
       from other partitions if there are any.
18:
    end if
19:
end for
20:
Find the tour with the minimum cost for each Q k .
21:
return  T o u r , T o u r C o s t

3.2. A Greedy Heuristic

In contrast to the formulation-driven primal–dual method, our second approach is a greedy heuristic based on intuitive, iterative improvement steps. The algorithm, detailed in Algorithm 2, consists of two main phases: initial routing and iterative redistribution. In the initial routing phase, the heuristic begins by generating a feasible initial solution. Each task is assigned to the robot that can service it with the lowest travel cost from its depot, without considering workload balance. Once all tasks are assigned, an optimal tour for each robot’s assigned task set ( F k ) is calculated using an established solver. In our implementation, we use the Lin–Kernighan–Helsgaun (LKH) algorithm [17]. While this phase initially resembles classical nearest-neighbor heuristics, which assign tasks solely based on minimal travel cost, it goes beyond such methods by iteratively improving the solution to reduce the overall makespan (i.e., the maximum travel cost among all robots). The algorithm iteratively refines the initial solution until no further improvements are possible. In each iteration, (1) the robot with the current maximum travel cost, r k , is identified as the most “overloaded”. (2) For each task in F k , the algorithm identifies a set of candidate robots, N k , that could potentially take over the task. These candidates are typically the robots with the second-lowest travel cost to that task. (3) The algorithm evaluates transferring each task from F k to a candidate robot in N k . A transfer is executed only if it satisfies two conditions: (a) the transfer reduces the overall maximum travel cost, and (b) the new route for the recipient robot does not violate any size constraints. This process of identifying the most loaded robot and attempting to offload its tasks continues until no task transfer can be found that reduces the makespan; at this point, the solution is considered locally optimal. Our approach explicitly targets workload balance and route efficiency across heterogeneous robots, combining a simple initial assignment with a systematic, greedy improvement phase. This allows the algorithm to escape naive initial solutions and achieve higher-quality, balanced routes in practical scenarios.
Algorithm 2 Coordination of multiple heterogeneous robots
  1:
Initial Routing
  2:
F k for k = 1 , , m
  3:
for  j = 1 : n   do
  4:
    Find a depot d k that could be reachable with the lowest cost and insert j into F k .
  5:
end for
  6:
Find the optimal path P k with the tasks in F k for k = 1 , , m .
  7:
Redistribution
  8:
while no exchange is available do
  9:
     κ = { 1 , , m }
10:
    while  κ is not empty do
11:
        Find r k that has the maximum travel cost.
12:
        κ κ r k
13:
        Find the neighboring depots N k by picking the depot with the second lowest cost
        for all tasks in F k .
14:
        for each depot d N k  do
15:
            For all tasks in F k , see if transferring the task to r d would decrease the maximum
            travel cost while satisfying all the constraints, and transfer the task if possible.
16:
        end for
17:
     end while
18:
end while
19:
Find the optimal path P k with the updated F k for k = 1 , , m .
20:
return  P k

3.3. A LLM-Based Heuristic via Prompt Engineering

While Large Language Models (LLMs) have shown versatility across many domains, their application to multi-robot coordination remains nascent. Recent studies have explored LLMs for robot action planning, but their methods often face challenges with scalability, real-time adaptability, and solution feasibility when applied to complex, heterogeneous routing problems. For instance, approaches like ProgPrompt [18] and LLM-Planner [19] can be limited by the need for real-time coordination or extensive training data. Similarly, frameworks such as SMART-LLM [20] may generate infeasible solutions, which is a critical issue for routing problems with strict constraints. Other works have used LLMs to find heuristics from existing solutions [21] or to improve success rates through self-debugging [22], but these methods do not always guarantee optimality or applicability to novel problems. These studies highlight a need for specialized approaches that can handle the unique constraints of dynamic, heterogeneous environments without relying on fine-tuning or iterative refinement.
To address these challenges, we propose a zero-shot, LLM-based heuristic that relies on carefully structured prompt engineering. Our methodology centers on designing a single, comprehensive prompt that provides the LLM with a complete definition of the environment, constraints, and optimization objectives. The goal is to enable the LLM to generate high-quality, feasible solutions without prior training on the specific problem type. This section details the prompt’s structured composition, which is key to achieving consistent and valid solutions.
The prompt is organized into three main sections:
  • Role and goal definition: The prompt begins by explicitly instructing the LLM to act as an optimization expert. It emphasizes that all subsequent information must be carefully considered to generate a valid task allocation that respects all constraints and objectives.
  • Zero-Shot Example (In-Context Learning): A complete, solved example is provided to illustrate the required logic and output format. This allows the LLM to learn from a single demonstration and generalize its reasoning to new instances. The example includes
    Map information: Definitions of the coordinate system, traversable passages, and task locations.
    Robot specifications: Depot locations and corresponding cost matrices for each robot, where infinite costs represent infeasible paths due to size constraints.
    Constraints: An explicit explanation of how the cost matrices encode the size constraints.
    Expected output: A sample solution showing the final task allocation for each robot.
  • Problem Instance: Following the example, the prompt defines the new problem that the LLM must solve. This section mirrors the structure of the example but contains the specific map, robot, and task data for the target instance.
This structured process, illustrated in Figure 3, is designed to provide the LLM with all necessary context—environmental, operational, and objective-based—to function as an effective zero-shot optimizer for this complex routing problem. Once the LLM generates a solution, a custom verification function checks that all tasks are assigned correctly and whether any constraints are violated. This mechanism ensures that infeasible solutions are corrected before final assignment. While our experiments show that this approach produces feasible solutions, infeasible outputs can still occur. In such cases, a refinement step can guide the LLM toward a valid solution. This underscores the necessity of precise prompt design, as well-structured and comprehensive prompts play a critical role in mitigating hallucinations in the LLM’s output.

4. Implementation and Computational Results

4.1. Experimental Setup and Performance Metrics

We validated the three proposed heuristic approaches through simulations on a PC with a 13th Gen Intel Core i7-1370P CPU and 64 GB of RAM. To ensure robust results, we generated 100 independent instances for each problem size by randomly placing tasks and depots within a given area. Each robot in the heterogeneous fleet was assigned a distinct average speed and width, with the travel cost, C o s t i j k , defined as the travel time based on the robot’s average running velocity.
To evaluate performance, we assessed two key criteria: solution quality and computational time. Solution quality was measured with a Posteriori Bound (PB), which compares an algorithm’s makespan ( T a l g o ) to a baseline’s makespan ( T b a s e l i n e ), calculated as P B = T a l g o / T b a s e l i n e . A lower PB value signifies a better solution.

4.2. Analysis of Results

Our initial tests on small-scale problems (2–4 robots, 100–200 tasks) used the primal–dual heuristic as the baseline. As shown in Figure 4, both faster heuristics consistently outperformed the primal–dual approach on average. The greedy heuristic proved most effective, reducing the makespan by 11–19% for 100 tasks and 16–22% for 200 tasks compared to the baseline. The LLM-based heuristic also showed strong performance, with improvements of up to 10% for 100 tasks and 12% for 200 tasks. While the greedy heuristic achieved higher average performance than the LLM-based heuristic, the standard deviations indicate that both methods exhibited comparable variability across problem instances. This suggests that the LLM-based heuristic can be similarly reliable in terms of consistency, even though it occasionally produces less optimal solutions. The difference in computational efficiency, detailed in Table 1, is even more striking. The primal–dual heuristic’s runtime grew significantly with problem size, averaging over 100 s for 200-task instances. In contrast, the greedy and LLM-based heuristics were exceptionally fast, consistently returning solutions in sub-second times. Both heuristics demonstrated minimal runtime variability, indicating robust computational performance. Given its prohibitive computation time, the primal–dual approach was excluded from further testing on larger problem instances.
For larger-scale instances (up to four robots and 1500 tasks), we compared the greedy and LLM-based heuristics, using the superior greedy algorithm as the new baseline. Figure 5 shows that the LLM-based heuristic produced solutions of lower quality, with an average makespan that was 7–12% worse than the greedy approach. An analysis of the computational time, detailed in Table 2, further reinforces the superior performance of the greedy heuristic. The greedy algorithm remained computationally efficient, with its maximum runtime peaking at 5.3 s even for the largest 1500-task instances, and the low standard deviations reflect highly predictable performance. In contrast, the LLM-based heuristic’s runtime scaled significantly with problem complexity, requiring up to 16.3 s on average and reaching a maximum of 21.8 s for the 1500-task, four-robot scenario. However, its comparable runtime variance demonstrates that, despite longer runtimes, the computational effort of the LLM-based heuristic is consistent. These results demonstrate that while the LLM can generate feasible solutions for large-scale problems, the greedy heuristic offers both faster computation and higher-quality solutions, making it the more effective approach for these complex instances.

5. Conclusions

This paper addressed the complex challenge of coordinating heterogeneous robotic systems in agriculture by developing and comparing three distinct heuristic approaches: a primal–dual algorithm, a specialized greedy heuristic, and a novel method using an LLM with zero-shot prompt engineering.
Our computational results demonstrated that for the specific problem of minimizing makespan under size constraints, the greedy heuristic provided the most optimal and computationally efficient solutions at the current scale, as it is specifically designed for the current problem formulation. Its performance advantage arises from a simple initial assignment combined with iterative redistribution, though more complex problems may require improved initial routing to achieve efficiency. In contrast, the LLM-based heuristic represents a significant advancement in flexibility and adaptability. Without task-specific fine-tuning, it produces high-quality, feasible solutions and can be relatively easily modified to accommodate new, complex tasks that incorporate robot-specific capabilities or adapt to dynamic environmental changes by adjusting the natural language prompt. While its average performance was slightly lower and its runtime was higher than the greedy heuristic, its ability to handle complex and evolving problem definitions makes it particularly valuable in scenarios requiring adaptability. This achievement showcases the potential of LLMs to function as generalized problem-solvers in robotics. This is critical for real-world agricultural environments where operational requirements can change daily. The ability to generate valid solutions from a high-level description dramatically lowers the barrier for developing and deploying robotic coordination strategies.
Future work will focus on two primary directions. First, we aim to enhance the LLM-based approach by exploring more advanced techniques, such as chain-of-thought prompting or allowing the model to interact with external code libraries and optimization tools, which could improve its performance and reliability. Second, we will focus on bridging the gap in the real-world deployment of heterogeneous robots by extending the problem formulation to incorporate practical operational constraints and environmental uncertainties—such as heterogeneous robot capabilities, battery and payload limits, dynamic obstacles, terrain variations, and task dependencies. Validating these advanced algorithms through physical experiments on a robotic fleet will be a crucial next step toward deploying autonomous systems in dynamic agricultural environments.

Author Contributions

Conceptualization, J.B., M.P. and V.N.; methodology, J.B., H.L., A.P. and M.P.; software, J.B., H.L. and A.P.; validation, J.B., H.L., A.P., M.P. and V.N.; formal analysis, J.B. and H.L.; investigation, J.B. and M.P.; resources, J.B., M.P. and V.N.; writing—original draft preparation, J.B. and H.L.; writing—review and editing, J.B., M.P. and V.N.; visualization, H.L. and J.B.; supervision, J.B.; project administration, J.B.; funding acquisition, J.B. All authors have read and agreed to the published version of the manuscript.

Funding

The Michigan Department of Agriculture and Rural Development has supported this work with a Farm Innovation Grant, grant number 24*3460.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The original contributions presented in this study are included in the article. Further inquiries can be directed to the corresponding authors.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Reinecke, M.; Prinsloo, T. The influence of drone monitoring on crop health and harvest size. In Proceedings of the 2017 1st International Conference on Next Generation Computing Applications (NextComp), Grand Baie, Mauritius, 19–21 July 2017; pp. 5–10. [Google Scholar] [CrossRef]
  2. Malveaux, C.; Hall, S.G.; Price, R. Using Drones in Agriculture: Unmanned Aerial Systems for Agricultural Remote Sensing Applications. In Proceedings of the American Society of Agricultural and Biological Engineers, Montreal, QC, Canada, 13–16 July 2014; p. 1. [Google Scholar] [CrossRef]
  3. Ozog, P.; Carlevaris-Bianco, N.; Kim, A.; Eustice, R.M. Long-term Mapping Techniques for Ship Hull Inspection and Surveillance using an Autonomous Underwater Vehicle. J. Field Robot. 2016, 33, 265–289. [Google Scholar] [CrossRef]
  4. Kanistras, K.; Martins, G.; Rutherford, M.J.; Valavanis, K.P. A survey of unmanned aerial vehicles (UAVs) for traffic monitoring. In Proceedings of the 2013 International Conference on Unmanned Aircraft Systems (ICUAS), Atlanta, GA, USA, 28–31 May 2013; pp. 221–234. [Google Scholar] [CrossRef]
  5. Yuan, C.; Zhang, Y.; Liu, Z. A survey on technologies for automatic forest fire monitoring, detection, and fighting using unmanned aerial vehicles and remote sensing techniques. Can. J. For. Res. 2015, 45, 783–792. [Google Scholar] [CrossRef]
  6. Casbeer, D.W.; Kingston, D.B.; Beard, R.W.; McLain, T.W. Cooperative forest fire surveillance using a team of small unmanned air vehicles. Int. J. Syst. Sci. 2006, 37, 351–360. [Google Scholar] [CrossRef]
  7. Murphy, R.R.; Kravitz, J.; Stover, S.L.; Shoureshi, R. Mobile robots in mine rescue and recovery. IEEE Robot. Autom. Mag. 2009, 16, 91–103. [Google Scholar] [CrossRef]
  8. Huang, Y.W.; Sasaki, Y.; Harakawa, Y.; Fukushima, E.F.; Hirose, S. Operation of underwater rescue robot anchor diver III during the 2011 Tohoku Earthquake and Tsunami. In Proceedings of the OCEANS’11 MTS/IEEE KONA, Waikoloa, HI, USA, 19–22 September 2011; pp. 1–6. [Google Scholar] [CrossRef]
  9. Conesa-Muñoz, J.; Bengochea-Guevara, J.M.; Andujar, D.; Ribeiro, A. Efficient distribution of a fleet of heterogeneous vehicles in agriculture: A practical approach to multi-path planning. In Proceedings of the 2015 IEEE International Conference on Autonomous Robot Systems and Competitions, Vila Real, Portugal, 8–10 April 2015; pp. 56–61. [Google Scholar]
  10. Furchì, A.; Lippi, M.; Carpio, R.F.; Gasparri, A. Route optimization in precision agriculture settings: A multi-Steiner TSP formulation. IEEE Trans. Autom. Sci. Eng. 2022, 20, 2551–2568. [Google Scholar] [CrossRef]
  11. Mukhamediev, R.I.; Yakunin, K.; Aubakirov, M.; Assanov, I.; Kuchin, Y.; Symagulov, A.; Levashenko, V.; Zaitseva, E.; Sokolov, D.; Amirgaliyev, Y. Coverage path planning optimization of heterogeneous UAVs group for precision agriculture. IEEE Access 2023, 11, 5789–5803. [Google Scholar] [CrossRef]
  12. Urvina, R.P.; Guevara, C.L.; Vásconez, J.P.; Prado, A.J. An integrated route and path planning strategy for skid–steer mobile robots in assisted harvesting tasks with terrain traversability constraints. Agriculture 2024, 14, 1206. [Google Scholar] [CrossRef]
  13. Pak, J.; Kim, J.; Park, Y.; Son, H.I. Field evaluation of path-planning algorithms for autonomous mobile robot in smart farms. IEEE Access 2022, 10, 60253–60266. [Google Scholar] [CrossRef]
  14. Utamima, A.; Reiners, T. Navigating route planning for multiple vehicles in multifield agriculture with a fast hybrid algorithm. Comput. Electron. Agric. 2023, 212, 108021. [Google Scholar] [CrossRef]
  15. Karp, R. Reducibility Among Combinatorial Problems. Complex. Comput. Comput. 1972, 40, 85–103. [Google Scholar] [CrossRef]
  16. Bae, J.; Park, M. A Heuristic for Efficient Coordination of Multiple Heterogeneous Mobile Robots considering Workload Balance. IEEE Robot. Autom. Lett. 2021, 6, 4064–4070. [Google Scholar] [CrossRef]
  17. LKH-2.0.10. Available online: http://akira.ruc.dk/~keld/research/LKH/ (accessed on 3 December 2024).
  18. Singh, I.; Blukis, V.; Mousavian, A.; Goyal, A.; Xu, D.; Tremblay, J.; Fox, D.; Thomason, J.; Garg, A. ProgPrompt: Generating Situated Robot Task Plans using Large Language Models. In Proceedings of the 2023 IEEE International Conference on Robotics and Automation (ICRA), London, UK, 29 May–2 June 2023; pp. 11523–11530. [Google Scholar] [CrossRef]
  19. Song, C.H.; Wu, J.; Washington, C.; Sadler, B.M.; Chao, W.L.; Su, Y. LLM-Planner: Few-shot grounded planning for embodied agents with large language models. In Proceedings of the IEEE/CVF International Conference on Computer Vision, Paris, France, 1–6 October 2023; pp. 2998–3009. [Google Scholar]
  20. Kannan, S.S.; Venkatesh, V.L.; Min, B.C. SMART-LLM: Smart multi-agent robot task planning using large language models. arXiv 2023, arXiv:2309.10062. [Google Scholar]
  21. Huang, Y.; Zhang, W.; Feng, L.; Wu, X.; Tan, K.C. How multimodal integration boosts the performance of LLM for optimization: Case study on capacitated vehicle routing problems. arXiv 2024, arXiv:2403.01757. [Google Scholar] [CrossRef]
  22. Huang, Z.; Shi, G.; Sukhatme, G.S. From Words to Routes: Applying Large Language Models to Vehicle Routing. arXiv 2024, arXiv:2403.10795. [Google Scholar] [CrossRef]
Figure 1. An example of the proposed problem with two different-sized robots navigating size-constrained paths in a lavender farm.
Figure 1. An example of the proposed problem with two different-sized robots navigating size-constrained paths in a lavender farm.
Sensors 25 06443 g001
Figure 2. Example of the decision variable z U k in a scenario with 3 robots and 19 tasks. (a) z U 1 = 1 only if U includes all tasks not visited by the r 1 , thus, when U = { t 11 , , t 19 } . (b) z U 2 = 1 only if U includes all tasks not visited by r 1 , r 2 , thus, when U = { t 17 , , t 19 } .
Figure 2. Example of the decision variable z U k in a scenario with 3 robots and 19 tasks. (a) z U 1 = 1 only if U includes all tasks not visited by the r 1 , thus, when U = { t 11 , , t 19 } . (b) z U 2 = 1 only if U includes all tasks not visited by r 1 , r 2 , thus, when U = { t 17 , , t 19 } .
Sensors 25 06443 g002
Figure 3. The flow of the LLM-based approach, showing how a structured prompt containing the problem definition and an example guides the LLM to produce a feasible solution.
Figure 3. The flow of the LLM-based approach, showing how a structured prompt containing the problem definition and an example guides the LLM to produce a feasible solution.
Sensors 25 06443 g003
Figure 4. Posteriori bound for small-scale instances.
Figure 4. Posteriori bound for small-scale instances.
Sensors 25 06443 g004
Figure 5. Posteriori Bound for larger-scale instances.
Figure 5. Posteriori Bound for larger-scale instances.
Sensors 25 06443 g005
Table 1. Computation time and standard deviation for small-scale instances.
Table 1. Computation time and standard deviation for small-scale instances.
# of Robots100 Tasks200 Tasks
Primal–Dual Greedy LLM-Based Primal–Dual Greedy LLM-Based
Average computation time in seconds
    211.250.010.0486.960.020.14
    313.200.020.0597.090.040.20
    415.160.030.07103.060.070.29
Maximum computation time in seconds
    238.800.010.20224.730.050.24
    340.180.040.20235.320.090.30
    446.230.050.23217.340.130.55
Standard deviation of computation time
    23.710.000.0221.620.010.02
    36.270.010.0239.040.020.03
    47.010.010.0227.470.020.07
Table 2. Computation time and standard deviation for larger-scale instances.
Table 2. Computation time and standard deviation for larger-scale instances.
# of Robots500 Tasks1000 Tasks1500 Tasks
Greedy LLM-Based Greedy LLM-Based Greedy LLM-Based
Average computation time in seconds
    20.080.900.263.600.568.27
    30.181.380.555.801.2412.23
    40.281.790.887.261.7416.26
Maximum computation time in seconds
    20.191.140.944.161.609.11
    30.552.022.088.733.1214.55
    40.583.432.3510.125.3521.79
Standard deviation of computation time
    20.030.900.170.210.340.27
    30.090.250.320.950.691.41
    40.110.330.441.160.922.60
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Lee, H.; Bae, J.; Patil, A.; Park, M.; Nguyen, V. Heuristic Approaches for Coordinating Collaborative Heterogeneous Robotic Systems in Harvesting Automation with Size Constraints. Sensors 2025, 25, 6443. https://doi.org/10.3390/s25206443

AMA Style

Lee H, Bae J, Patil A, Park M, Nguyen V. Heuristic Approaches for Coordinating Collaborative Heterogeneous Robotic Systems in Harvesting Automation with Size Constraints. Sensors. 2025; 25(20):6443. https://doi.org/10.3390/s25206443

Chicago/Turabian Style

Lee, Hyeseon, Jungyun Bae, Abhishek Patil, Myoungkuk Park, and Vinh Nguyen. 2025. "Heuristic Approaches for Coordinating Collaborative Heterogeneous Robotic Systems in Harvesting Automation with Size Constraints" Sensors 25, no. 20: 6443. https://doi.org/10.3390/s25206443

APA Style

Lee, H., Bae, J., Patil, A., Park, M., & Nguyen, V. (2025). Heuristic Approaches for Coordinating Collaborative Heterogeneous Robotic Systems in Harvesting Automation with Size Constraints. Sensors, 25(20), 6443. https://doi.org/10.3390/s25206443

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop