Multi-Agent System for Smart Roll-on/Roll-off Terminal Management: Orchestration and Communication Strategies for AI-Driven Optimization
Abstract
:1. Introduction
2. State of Knowledge
2.1. Industry 4.0 and Digital Transformation in Ports
2.2. AI Applications in Port Management
2.3. Optimization of Vehicle Movements in Ro-Ro Terminals
2.4. Research Gap
3. Methodology Steps
3.1. Defining the Scope and System Requirements
- Key port processes that can benefit from digitalization and intelligent automation are identified.
- The limitations of traditional vehicle management systems in Ro-Ro terminals are analyzed.
- The functional and non-functional requirements of the system are defined, including efficiency, reduction of transit times, energy optimization, and scalability.
3.2. Multi-Agent System (MAS) Architecture Design
- Definition of intelligent entities and their respective functions (orchestration, space allocation, route optimization, flow control, boarding management, and supervision).
- Specification of communication between agents, defining information exchange protocols, and collaborative decision-making models.
- Development of an architecture diagram, visualizing the key interactions between agents to ensure an efficient flow of information and operations.
3.3. Selection of Optimization Algorithms and Technologies
- Heuristic and metaheuristic optimization for space allocation (genetic algorithms, taboo search).
- Route planning algorithms (A*, Dijkstra, reinforcement learning) to minimize transit times.
- Traffic analysis and simulation for flow control using IoT sensors.
- Scheduling models and dynamic planning for the coordination of vehicle boarding.
- Artificial intelligence and predictive analytics for system monitoring and continuous improvement.
3.4. Modeling of Communication and Coordination Between Agents
- Hierarchical communication with the orchestrating agent (EOO) for global decisions.
- Direct interaction between specialized agents to minimize latencies.
- Negotiation based on priorities and availability in the allocation of resources.
- Use of middleware and standard communication protocols (JADE, MQTT, ROS) to ensure interoperability in digital environments.
3.5. Integration of Human Interaction into the System
- Supervisors can modify priorities and reassign spaces in the terminal.
- Controllers can intervene in route planning and traffic management in critical cases.
- Managers can evaluate performance metrics and make strategic adjustments to the system.
3.6. Theoretical Evaluation and Comparative Analysis
- Comparison with traditional port management models, measuring potential benefits of the system.
- Analysis of the expected impact on the reduction of time and energy consumption in Ro-Ro terminals.
- Identification of challenges and limitations in the implementation of the multi-agent system.
4. Results and Discussion
4.1. Definition of the Scope and System Requirements
- Lack of automation in the allocation of spaces, which generates inefficiencies and unnecessary waiting times.
- Non-optimized routes within the terminal, causing longer journeys and higher energy consumption.
- Reactive traffic management, without real-time adjustment mechanisms.
- Manual coordination of shipment, which introduces delays and reduces operational capacity.
- Low data integration and centralized supervision, making strategic decision-making difficult.
- Manual space assignment, without location optimization.
- Uncoordinated flow of vehicles, with inefficient routes.
- Internal congestion in the field due to lack of dynamic regulation.
- Manual boarding processes, generating unnecessary waiting.
- Reactive monitoring, based on late reports instead of real-time data.
4.2. Design of the Multi-Agent System Architecture (MAS)
4.2.1. Intelligent Entities: Function, Required Data, and Human Interaction
4.2.2. Selection of Algorithms and Technologies for Optimization
- Heuristic optimization in combinatorial problems.
- Efficient route search in dynamic environments.
- Data-driven predictive modeling in traffic management and monitoring.
- Multi-agent negotiation for decentralized coordination.
- Efficient and flexible coordination: the use of contract net protocol (CNP)-based trading in the EOO allows agents to manage tasks in a decentralized manner, reducing overhead on a single node and ensuring adaptability to changes in demand.
- Rapid optimization in space allocation: the taboo search and genetic algorithms in the EDV allow efficient solutions to be found without the need to evaluate all possible combinations, achieving a better distribution of vehicles in the field with reduced processing times.
- Dynamic and efficient routes: the use of A*, Dijkstra, and reinforcement learning in the ENR allows optimal routes to be calculated by adapting to changes in traffic, ensuring shorter and more efficient journeys within the terminal.
- Intelligent traffic management: machine learning with predictive models in the ECF allows congestion to be anticipated and traffic to be dynamically adjusted in the terminal, avoiding blockages and downtime in operations.
- Accurate boarding synchronization: the application of metaheuristics for dynamic scheduling in the ECE improves the allocation of boarding shifts, reducing delays and optimizing ramp utilization.
- Monitoring and continuous improvement: the use of machine learning to detect anomalies in ESO allows for identifying patterns of inefficiency and optimizing the system based on historical data, ensuring progressive improvements in port management.
4.2.3. Modeling Communication and Coordination Between Agents
- Hierarchical (EOO coordinates all entities).
- Direct interaction between specialized entities.
- Negotiation based on priorities for the distribution of resources.
- Hierarchical Architecture (Hierarchical): the system has an orchestrating agent (EOO) that manages and coordinates the other agents, which resembles the hierarchical structure of the image. Decision-making flows from the top down, with each agent specializing in specific tasks.
- Router + Aggregator Pattern: The EOO acts as a router that receives data from different agents and redistributes it according to operational needs. It also works as an aggregator, collecting information from multiple sources (IoT sensors, optimization algorithms, traffic data) to generate coordinated decisions.
- Shared Database with Different Tools: The model is based on the integration of optimization tools, planning algorithms, and operational databases, which fits with the pattern of a shared database used by different agents.
4.3. Integration of Human Interaction into the System
- 1.
- Supervisors
- They adjust orchestrator agent (EOO) parameters to modify priorities.
- They review alerts generated by the monitoring and optimization agent (ESO).
- They can approve or block critical system decisions.
- 2.
- Operators in the terminal
- They can modify the allocation of spaces in the field managed by the vehicle distribution agent (EDV).
- They intervene in the modification of routes generated by the navigation and routing agent (ENR) if there are unexpected blockages.
- They make adjustments to flow control agent (ECF) traffic restrictions in cases of severe congestion.
- 3.
- Terminal managers
- Acceevaluate performance metrics and operational efficiency.
4.4. Theoretical and Comparative Evaluation of the Model
- Space allocation: Reduction of occupancy time by up to 25%.
- Route optimization: Less unnecessary travel and energy savings.
- Traffic management: Dynamic adaptation to congestion.
- Synchronized boarding: Avoid unnecessary waiting.
- Proactive monitoring: Reduction of operational errors through AI.
4.5. Limitations and Future Lines of Work
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- Zhou, F.; Yu, K.; Xie, W.; Lyu, J.; Zheng, Z.; Zhou, S. Digital Twin-Enabled Smart Maritime Logistics Management in the Context of Industry 5.0. IEEE Access 2024, 12, 10920–10931. [Google Scholar] [CrossRef]
- Iannone, R.; Miranda, S.; Prisco, L.; Riemma, S.; Sarno, D. Proposal for a Flexible Discrete Event Simulation Model for Assessing the Daily Operation Decisions in a Ro–Ro Terminal. Simul. Model. Pract. Theory 2016, 61, 28–46. [Google Scholar] [CrossRef]
- Urrea, C.; Garrido, F.; Kern, J. Design and Implementation of Intelligent Agent Training Systems for Virtual Vehicles. Sensors 2021, 21, 492. [Google Scholar] [CrossRef]
- Song, L.; Hu, X.; Zhang, G.; Spachos, P.; Plataniotis, K.N.; Wu, H. Networking Systems of AI: On the Convergence of Computing and Communications. IEEE Internet Things J. 2022, 9, 20352–20381. [Google Scholar] [CrossRef]
- Shan, Q.; Qu, Q.; Song, J.; Teng, F.; Xiao, G.; Zhang, X.; Li, T. Multi-Agent System-Based Polymorphic Distributed Energy Management for Ships Entering and Leaving Ports Considering Computing Power Resources. Complex Intell. Syst. 2024, 10, 1247–1264. [Google Scholar] [CrossRef]
- Kanellos, F.D. Real-time Control Based on Multi-agent Systems for the Operation of Large Ports as Prosumer Microgrids. IEEE Access 2017, 5, 9439–9452. [Google Scholar] [CrossRef]
- Othman, B.; De Nunzio, G.; Sciarretta, A.; Di Domenico, D.; Canudas-de-Wit, C. Connectivity and Automation as Enablers for Energy-Efficient Driving and Road Traffic Management. In Handbook of Climate Change Mitigation and Adaptation; Lackner, M., Sajjadi, B., Chen, W.-Y., Eds.; Springer International Publishing: Cham, Switzerland, 2022; pp. 2337–2376. [Google Scholar] [CrossRef]
- Severino, A.; Martseniuk, L.; Curto, S.; Neduzha, L. Routes Planning Models for Railway Transport Systems in Relation to Passengers’ Demand. Sustainability 2021, 13, 8686. [Google Scholar] [CrossRef]
- Shakya, S.R.; Jha, S. Introduction to Industrial Internet of Things (IIoT)–Toward the future Internet. In Quality Assessment and Security in Industrial Internet of Things; CRC Press: Boca Raton, FL, USA, 2024; pp. 1–19. Available online: https://www.taylorfrancis.com/chapters/edit/10.1201/9781003530572-1/introduction-industrial-internet-things-iiot-toward-future-internet-sarbagya-ratna-shakya-sudan-jha (accessed on 14 March 2025).
- Heilig, L.; Lalla-Ruiz, E.; Voß, S. Digital Transformation in Maritime Ports: Analysis and a Game Theoretic Framework. Netnomics Econ. Res. Electron. Netw. 2017, 18, 227–254. [Google Scholar] [CrossRef]
- Kanellos, F.D.; Volanis, E.S.M.; Hatziargyriou, N.D. Power management method for large ports with multi-agent systems. IEEE Trans. Smart Grid 2017, 10, 1259–1268. [Google Scholar] [CrossRef]
- Djedouboum, A.C.; Ari, A.A.A.; Gueroui, A.M.; Mohamadou, A.; Aliouat, Z. Big Data Collection in Large-scale Wireless Sensor Networks. Sensors 2018, 18, 4474. [Google Scholar] [CrossRef]
- González-Cancelas, N.; Vaca-Cabrero, J.; Camarero-Orive, A. IoV and Blockchain for Traffic Optimization in Ro-Ro Terminals: A Case Study in the Spanish Port System. Future Internet 2025, 17, 99. [Google Scholar] [CrossRef]
- Durlik, I.; Miller, T.; Kostecka, E.; Łobodzińska, A.; Kostecki, T. Harnessing AI for Sustainable Shipping and Green Ports: Challenges and Opportunities. Appl. Sci. 2024, 14, 5994. [Google Scholar] [CrossRef]
- Abril, D.; Paternina-Arboleda, C.D.; Velasquez-Bermudez, J. An Integrated Event-Driven Real-Time Tactical–Operational Optimization Framework for Smart Port Operations Planning. Logistics 2024, 8, 65. [Google Scholar] [CrossRef]
- Tien, J.M. Internet of Things; Real-time Decision Making, and Artificial Intelligence. Ann. Data Sci. 2017, 4, 149–178. [Google Scholar] [CrossRef]
- Sedjelmaci, H.; Tourki, K.; Ansari, N. Enabling 6G security: The synergy of zero trust architecture and artificial intelligence. IEEE Netw. 2023, 38, 171–177. [Google Scholar] [CrossRef]
- Moshebah, O.Y.; Rodríguez-González, S.; González, A.D. A max–min fairness-inspired approach to enhance the performance of multimodal transportation networks. Sustainability 2024, 16, 4914. [Google Scholar] [CrossRef]
- Christodoulou, A.; Raza, Z.; Woxenius, J. The integration of RoRo shipping in sustainable intermodal transport chains: The case of a North European RoRo service. Sustainability 2019, 11, 2422. [Google Scholar] [CrossRef]
- Gao, J.; Chi, M.; Hu, Z. Energy Consumption Optimization of Inland Sea Ships Based on Operation Data and Ensemble Learning. Math. Probl. Eng. 2022, 2022, 9231782. [Google Scholar] [CrossRef]
- Setiawan, A.; Hadi, A.R.A.; Widyaningsih, U. Optimization of Shipping Best Route Determination Based on Big Data Analysis for Marine Fuel Efficiency. 2025. Available online: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=5158253 (accessed on 14 March 2025).
- Ivanov, D.; Dolgui, A.; Sokolov, B. Applicability of Optimal Control Theory to Adaptive Supply Chain Planning and Scheduling. Annu. Rev. Control 2012, 36, 73–84. [Google Scholar] [CrossRef]
- Zhai, M.; Jin, Z.; Yan, Z.; Gu, Z.; Li, Z.; Xiao, D. Heuristic-based Vehicle Arrangement for Ro-Ro Ships. Sci. Rep. 2024, 14, 30889. [Google Scholar] [CrossRef]
- Abourraja, M.N.; Rouky, N.; Kornevs, M.; Meijer, S.; Kringos, N. A Simulation-Based Decision Support Framework Devoted to Ro–Ro Terminals: Design, Implementation and Evaluation. Comput. Ind. Eng. 2023, 180, 109248. [Google Scholar] [CrossRef]
- Abourraja, M.N.; Kringos, N.; Meijer, S. Exploiting Simulation Model Potential in Investigating Handling Capacity of Ro-Ro Terminals: The case STUDY of Norvik Seaport. Simul. Model. Pract. Theory 2022, 117, 102513. [Google Scholar] [CrossRef]
- Henesey, L.; Notteboom, T.; Davidsson, P. Agent-based Simulation of Stakeholders Relations: An Approach to Sustainable Port and Terminal Management. Multi-Agent Syst. Contain. Termin. Manag. 2003, 99. Available online: https://www.researchgate.net/profile/Lawrence-Henesey/publication/239541534_Multi-agent_systems_for_container_terminal_management/links/0deec52e032c1b7d7f000000/Multi-agent-systems-for-container-terminal-management.pdf#page=119 (accessed on 14 March 2025).
- Zhu, Y.; Li, H.; Wang, Z.; Li, Q.; Dou, Z.; Xie, W.; Zhang, Z.; Wang, R.; Nie, W. Optimal Evacuation Route Planning of Urban Personnel at Different Risk Levels of Flood Disasters Based on the Improved 3D Dijkstra’s Algorithm. Sustainability 2022, 14, 10250. [Google Scholar] [CrossRef]
- Lupi, M.; Boero, M.; Conte, D.; Rappis, L.N.; Vannucci, M.; Farina, A. An Its System for Reducing Congestion and Noise Pollution Due to Vehicles to/from Port Terminals. Sustainability 2022, 14, 14579. [Google Scholar] [CrossRef]
- Du, T.; Turrin, M.; Jansen, S.; van den Dobbelsteen, A.; Fang, J. Gaps and Requirements for Automatic Generation of Space Layouts with Optimised Energy Performance. Autom. Constr. 2020, 116, 103132. [Google Scholar] [CrossRef]
- Martin-Iradi, B.; Pacino, D.; Ropke, S. An Adaptive Large Neighborhood Search Heuristic for the Multi-port Continuous Berth Allocation Problem. Eur. J. Oper. Res. 2024, 316, 152–167. [Google Scholar] [CrossRef]
- Nadi, A.; Snelder, M.; van Lint, J.W.C.; Tavasszy, L. A Data-driven and Multi-agent Decision Support System for Time Slot Management at Container Terminals: A Case Study for the Port of Rotterdam. arXiv 2023, arXiv:2311.15298. [Google Scholar] [CrossRef]
- Yao, M.; Hu, M.; Yin, J.; Su, J.; Yin, M. A Two-Stage Optimization Model for Airport Stand Allocation and Ground Support Vehicle Scheduling. Appl. Sci. 2024, 14, 11407. [Google Scholar] [CrossRef]
- Sayda, A.F. Multi-agent Systems for Industrial Applications: Design, Development, and Challenges. In Multi-Agent Systems-Modeling, Control, Programming, Simulations and Applications; IntechOpen: London, UK, 2011; Available online: https://core.ac.uk/download/pdf/478119296.pdf#page=483 (accessed on 14 March 2025).
Entity | Main Function | Required Data | Human Interaction |
---|---|---|---|
EOO—Operations Orchestrating Entity | Coordinates communication and synchronization between entities. Make strategic decisions and resolve conflicts in real time. | Terminal status (occupied spaces, traffic, ramp availability). Operational reports of each entity. | Supervisors can manually modify priorities and approve critical decisions. Operators can report incidents. |
EDV—Vehicle Distribution Entity | Determines the best location for each vehicle in the field, reducing travel times. | Availability of spaces in the field. Type and dimensions of the vehicle. Estimated boarding time. | Operators can manually reassign locations in special cases. |
ENR—Navigation and Routes Entity | Calculate optimal routes to minimize transit times and energy consumption. | Current location and destination of each vehicle. Internal traffic status. | Operators can modify routes in the event of blockages or adverse conditions. |
ECF—Flow Control Entity | It regulates traffic within the terminal to avoid congestion and high waiting times. | Traffic status at the terminal. Movement restrictions. | Controllers can manually activate restrictions or release locked zones. |
ECE—Shipping Coordination Entity | Manage the arrival of vehicles at the boarding ramp, synchronizing the flow with the departure of the ship. | Departure time of the vessel. Capacity and availability of the boarding ramp. Condition of vehicles in transit. | Supervisors can modify boarding shifts. Managers can adjust load strategies. |
ESO—Supervisory and Optimization Entity | Evaluate system performance and adjust operating parameters to improve efficiency. | Operation KPIs of each entity. Performance history and data analysis. | Managers can review efficiency reports and make strategic adjustments. |
Algorithm | Advantages | Disadvantages | Application in the Model |
---|---|---|---|
A* (Route Search) | Find the optimal route with computational efficiency. Adaptable to real-time traffic changes. | It can become computationally expensive in environments with many variables. | Optimization of routes within the terminal. |
Dijkstra (Route Search) | Exact algorithm to find the shortest route. Robust and widely validated. | Less efficient compared to A* in environments with large volumes of data. | Alternative for trajectory planning. |
Reinforcement Learning Techniques | Able to learn dynamically and improve decisions with experience. | It requires prior training and large volumes of data to improve its accuracy. | Optimization of internal traffic management. |
Contract Net Protocol (CNP) | It provides a decentralized mechanism for trading between agents. | It can generate more communication traffic between agents, affecting latency in large systems. | Coordination of tasks between agents (spaces, routes, traffic). |
Taboo Search (Allocation of Spaces) | Find optimal solutions to complex combinatorial problems. | It does not guarantee finding the best global solution, but it avoids falling into local lows. | Optimization of the allocation of spaces in the field. |
Genetic Algorithms (Allocation Of Spaces) | Ability to optimize in large search spaces. Find solutions close to the optimum. | It requires longer processing time and parameter adjustment for optimal performance. | Alternative for the allocation of vehicle spaces in the terminal. |
Entity | Main Algorithm | Justification |
---|---|---|
EOO—Operations Orchestrating Entity | Multi-agent systems with contract net protocol (CNP)-based trading | An efficient coordination mechanism is required between entities with different objectives and constraints. The contract net protocol (CNP) allows specialized agents to negotiate tasks without overloading a single central node. In addition, it guarantees flexibility in the face of changes in demand and distribution of resources. |
EDV—Vehicle Distribution Entity | Heuristic optimization (taboo search, genetic algorithms) | The optimal allocation of spaces in the field is a problem of combinatorial optimization. Advanced heuristics, such as taboo search and genetic algorithms, make it possible to find solutions close to the optimal without the need to evaluate all possible combinations, significantly reducing calculation time. |
ENR—Navigation and Routes Entity | Pathfinder A, Dijkstra, reinforcement learning | To find the shortest path from the field to the boarding ramp, route planning algorithms are required. Dijkstra ensures the optimal path in networks with positive weights, while A* improves efficiency in dynamic environments with heuristics. If traffic is highly changeable, you can use reinforcement learning, which adapts routing decisions based on previous experiences. |
ECF—Flow Control Entity | Traffic models with IoT and machine learning | Real-time traffic management involves handling sensor data and predicting congestion patterns. Machine Learning models (regression, neural networks) can anticipate areas of high congestion and suggest proactive adjustments in traffic flows, avoiding bottlenecks. |
ECE—Shipping Coordination Entity | Dynamic scheduling with metaheuristics | Vehicle coordination on the boarding ramp must be adapted based on the load, vessel restrictions, and ramp availability. Algorithms such as GRASP (Greedy Randomized Adaptive Search Procedure) and Colony Optimization optimize shipment time planning with computational efficiency. |
ESO—Supervisory and Optimization Entity | Machine learning for anomaly detection and optimization | To continuously evaluate the efficiency of the system, it is necessary to analyze historical patterns and detect anomalies in operations. Unsupervised learning models (clustering, outlier detection with DBSCAN or Isolation Forest) allow inefficiencies to be identified without manual intervention. |
Entity | Send Data To | Receive Data From |
---|---|---|
EOO (Orchestrator) | ALL | ALL |
EDV (Vehicle Distribution) | EOO, ENR | EOO |
ENR (Navigation and Routing) | EOO, ECF | EDV, EOO |
ECF (Flow Control) | EOO, ECE | ENR, EOO |
ECE (Shipping Coordination) | EOO, ESO | ECF, EOO |
ESO (Monitoring and Optimization) | EOO | ALL |
Entity | Permitted Human Intervention | Level of Intervention |
---|---|---|
EOO (Orchestrator) | Modification of priorities and operational rules. | Supervisors |
EDV (Vehicle Distribution) | Manual reassignment of spaces in the field. | Terminal operators |
ENR (Navigation and Routing) | Route adjustment and unlocking of closed areas. | Terminal operators |
ECF (Flow Control) | Application of restrictions or release of roads. | Terminal operators |
ECE (Shipping Coordination) | Rescheduling of boarding times. | Supervisors and managers |
ESO (Monitoring and Optimization) | Analysis and redefinition of strategies. | Terminal managers |
Criterion | Traditional Model | Multi-Agent Model (Proposed) | Reference |
---|---|---|---|
Allocation of Spaces | Manual or semi-automatic, with high occupancy times. | Dynamic optimization with heuristics, expected 25% reduction in occupancy times. | [29] |
Route Optimization | Static, based on operational experience. | Dynamic calculation with A*, Dijkstra, and reinforcement learning, expected reduction of 15–30% in transit times. | [30] |
Traffic Management | Reactive, without real-time adjustments. | Continuous adaptation based on prediction and IoT sensors. | [31] |
Synchronized Boarding | Based on fixed schedules, without dynamic optimization. | Dynamic adjustment with adaptive scheduling, 20% reduction in waiting times. | [32] |
System Monitoring | Based on manual reports and subsequent adjustments. | Predictive analytics and real-time optimization using AI. | [33] |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
González-Cancelas, N.; Vaca-Cabrero, J.; Camarero-Orive, A. Multi-Agent System for Smart Roll-on/Roll-off Terminal Management: Orchestration and Communication Strategies for AI-Driven Optimization. Appl. Sci. 2025, 15, 6079. https://doi.org/10.3390/app15116079
González-Cancelas N, Vaca-Cabrero J, Camarero-Orive A. Multi-Agent System for Smart Roll-on/Roll-off Terminal Management: Orchestration and Communication Strategies for AI-Driven Optimization. Applied Sciences. 2025; 15(11):6079. https://doi.org/10.3390/app15116079
Chicago/Turabian StyleGonzález-Cancelas, Nicoletta, Javier Vaca-Cabrero, and Alberto Camarero-Orive. 2025. "Multi-Agent System for Smart Roll-on/Roll-off Terminal Management: Orchestration and Communication Strategies for AI-Driven Optimization" Applied Sciences 15, no. 11: 6079. https://doi.org/10.3390/app15116079
APA StyleGonzález-Cancelas, N., Vaca-Cabrero, J., & Camarero-Orive, A. (2025). Multi-Agent System for Smart Roll-on/Roll-off Terminal Management: Orchestration and Communication Strategies for AI-Driven Optimization. Applied Sciences, 15(11), 6079. https://doi.org/10.3390/app15116079