Skip to Content
You are currently on the new version of our website. Access the old version .

24 Results Found

  • Article
  • Open Access
3 Citations
3,933 Views
24 Pages

29 April 2021

Decentralized partially observable Markov decision process (DEC-POMDP) models sequential decision making problems by a team of agents. Since the planning of DEC-POMDP can be interpreted as the maximum likelihood estimation for the latent variable mod...

(This article belongs to the Section Information Theory, Probability and Statistics)
  • Article
  • Open Access
4,080 Views
19 Pages

Multi-Agent Planning under Uncertainty with Monte Carlo Q-Value Function

  • Jian Zhang,
  • Yaozong Pan,
  • Ruili Wang,
  • Yuqiang Fang and
  • Haitao Yang

4 April 2019

Decentralized partially observable Markov decision processes (Dec-POMDPs) are general multi-agent models for planning under uncertainty, but are intractable to solve. Doubly exponential growth of the search space as the horizon increases makes a brut...

(This article belongs to the Section Computing and Artificial Intelligence)
  • Article
  • Open Access
3 Citations
3,341 Views
28 Pages

30 July 2023

Coordinating multiple unmanned aerial vehicles (UAVs) for the purposes of target finding or surveying points of interest in large, complex, and partially observable environments remains an area of exploration. This work proposes a modeling approach a...

(This article belongs to the Special Issue Unmanned Aerial Systems (UAS) for Global Challenges: Current Technologies and Future Prospects)
  • Article
  • Open Access
2 Citations
1,760 Views
21 Pages

Assisted-Value Factorization with Latent Interaction in Cooperate Multi-Agent Reinforcement Learning

  • Zhitong Zhao,
  • Ya Zhang,
  • Siying Wang,
  • Yang Zhou and ,
  • Ruoning Zhang and
  • Wenyu Chen
  • + 1 author+ 0 author

27 April 2025

With the development of value decomposition methods, multi-agent reinforcement learning (MARL) has made significant progress in balancing autonomous decision making with collective cooperation. However, the collaborative dynamics among agents are con...

(This article belongs to the Section E1: Mathematics and Computer Science)
  • Article
  • Open Access
6 Citations
2,584 Views
27 Pages

12 September 2024

Directional unmanned aerial vehicle (UAV) ad hoc networks (DUANETs) are widely applied due to their high flexibility, strong anti-interference capability, and high transmission rates. However, within directional networks, complex mutual interference...

(This article belongs to the Special Issue Space–Air–Ground Integrated Networks for 6G)
  • Article
  • Open Access
2 Citations
1,771 Views
19 Pages

16 April 2026

Considering that the unmanned aerial vehicles (UAVs) are susceptible to both co-channel interference and malicious jamming with limited onboard battery energy, this paper proposes an energy-harvesting-assisted anti-jamming communication framework for...

(This article belongs to the Special Issue Intelligent Spectrum Management in UAV Communication)
  • Review
  • Open Access
9 Citations
8,381 Views
36 Pages

Decision-Making for Path Planning of Mobile Robots Under Uncertainty: A Review of Belief-Space Planning Simplifications

  • Vineetha Malathi,
  • Pramod Sreedharan,
  • Rthuraj P R,
  • Vyshnavi Anil Kumar and ,
  • Anil Lal Sadasivan,
  • Ganesha Udupa,
  • Liam Pastorelli and
  • Andrea Troppina
  • + 3 authors+ 0 author

15 September 2025

Uncertainty remains a central challenge in robotic navigation, exploration, and coordination. This paper examines how Partially Observable Markov Decision Processes (POMDPs) and their decentralized variants (Dec-POMDPs) provide a rigorous foundation...

(This article belongs to the Section Sensors and Control in Robotics)
  • Article
  • Open Access
5 Citations
2,047 Views
20 Pages

Energy Management for Distributed Carbon-Neutral Data Centers

  • Wenting Chang,
  • Chuyi Liu,
  • Guanyu Ren and
  • Jianxiong Wan

30 May 2025

With the continuous expansion of data centers, their carbon emission has become a serious issue. A number of studies are committing to reduce the carbon emission of data centers. Carbon trading, carbon capture, and power-to-gas technologies are promi...

  • Review
  • Open Access
3 Citations
2,822 Views
29 Pages

30 January 2026

Multi-robot systems (MRSs) offer distinct advantages in large-scale exploration but require tight coupling between decentralized decision-making and collaborative estimation. This survey reviews learning-based multi-robot Active Collaborative Simulta...

(This article belongs to the Special Issue Applications of Robot Navigation in Autonomous Systems)
  • Article
  • Open Access
14 Citations
3,325 Views
16 Pages

T3OMVP: A Transformer-Based Time and Team Reinforcement Learning Scheme for Observation-Constrained Multi-Vehicle Pursuit in Urban Area

  • Zheng Yuan,
  • Tianhao Wu,
  • Qinwen Wang,
  • Yiying Yang and ,
  • Lei Li and
  • Lin Zhang
  • + 1 author+ 0 author

Smart Internet of Vehicles (IoVs) combined with Artificial Intelligence (AI) will contribute to vehicle decision-making in the Intelligent Transportation System (ITS). Multi-vehicle pursuit (MVP) games, a multi-vehicle cooperative ability to capture...

(This article belongs to the Special Issue Recent Advances in the IoT and Smart City Based on Artificial Intelligence)
  • Article
  • Open Access
5 Citations
3,618 Views
25 Pages

14 August 2024

Unmanned Aerial Vehicles (UAVs) have garnered widespread attention in reconnaissance and search operations due to their low cost and high flexibility. However, when multiple UAVs (multi-UAV) collaborate on these tasks, a limited communication range c...

(This article belongs to the Special Issue Distributed Control, Optimization, and Game of UAV Swarm Systems)
  • Article
  • Open Access
1 Citations
572 Views
20 Pages

High penetration of distributed photovoltaic (PV) generation in active distribution networks (ADNs) has intensified voltage violations and rapid voltage fluctuations, especially under extreme reverse-power-flow conditions. Traditional centralized vol...

  • Article
  • Open Access
32 Citations
9,165 Views
19 Pages

31 December 2024

Unmanned aerial vehicles (UAVs) furnished with computational servers enable user equipment (UE) to offload complex computational tasks, thereby addressing the limitations of edge computing in remote or resource-constrained environments. The applicati...

(This article belongs to the Section Sensors and Robotics)
  • Article
  • Open Access
27 Views
27 Pages

9 November 2026

UAV, mounted aerial base stations offer remarkable deployment flexibility for 6G Non Terrestrial Networks (NTNs), yet their hovering energy demands present a critical sustainability bottleneck, particularly as network topologies continuously evolve i...

  • Article
  • Open Access
2 Citations
2,711 Views
27 Pages

16 January 2025

The merging behavior of vehicles at entry ramps and the speed differences between ramps and mainline traffic cause merging traffic bottlenecks. Current research, primarily focusing on single traffic control strategies, fails to achieve the desired ou...

(This article belongs to the Topic Digital and Intelligent Technologies and Application in Urban Construction, Operation, Maintenance, and Renewal)
  • Article
  • Open Access
6 Citations
1,741 Views
29 Pages

A Novel Data-Driven Multi-Agent Reinforcement Learning Approach for Voltage Control Under Weak Grid Support

  • Jiaxin Wu,
  • Ziqi Wang,
  • Ji Han,
  • Qionglin Li and ,
  • Ran Sun,
  • Chenhao Li,
  • Yuehan Cheng,
  • Bokai Zhou,
  • Jiaming Guo and
  • Bocheng Long
  • + 5 authors+ 0 author

4 December 2025

To address active voltage control in photovoltaic (PV)-integrated distribution networks characterized by weak voltage support conditions, this paper proposes a multi-agent deep reinforcement learning (MADRL)-based coordinated control method for PV cl...

(This article belongs to the Topic Advanced Strategies for Smart Grid Reliability and Energy Optimization)
  • Article
  • Open Access
614 Views
30 Pages

31 August 2026

Multi-UAV Cooperative Target Search (MCTS) is a critical task in low-altitude sensing applications, requiring agents to efficiently explore unknown environments under complex constraints. However, traditional search methods are mostly unscalable and...

(This article belongs to the Section Artificial Intelligence in Drones (AID))
  • Article
  • Open Access
619 Views
28 Pages

A Neighbor Feature Aggregation-Based Multi-Agent Reinforcement Learning Method for Fast Solution of Distributed Real-Time Power Dispatch Problem

  • Baisen Chen,
  • Chenghuang Li,
  • Qingfen Liao,
  • Wenyi Wang and ,
  • Lingteng Ma and
  • Xiaowei Wang
  • + 1 author+ 0 author

To address the challenges posed by the strong uncertainty of high-proportion renewable energy sources (RES) to the secure and stable operation of distributed real-time power dispatch (D-RTPD) in new-type power systems, this paper proposes an integrat...

(This article belongs to the Special Issue AI-Enhanced Strategies for Power Grid Operation and Resilience: Integration of Emerging Resources and Technologies)
  • Article
  • Open Access
3 Citations
1,107 Views
22 Pages

1 March 2026

The increasing penetration of inverter-interfaced photovoltaic (PV) generation in active distribution networks (ADNs) intensifies fast voltage violations and makes real-time Volt-VAR control (VVC) challenging, especially when each inverter has only p...

  • Feature Paper
  • Article
  • Open Access
577 Views
34 Pages

31 May 2026

The growing penetration of variable renewable energy sources transforms power grid dispatch into a high-dimensional, stochastic, and multi-agent decision-making problem that challenges both classical optimization and standard Reinforcement Learning (...

(This article belongs to the Special Issue Innovative Methods in Long Sequence Forecasting and Time Series Analysis)
  • Article
  • Open Access
6 Citations
3,633 Views
31 Pages

24 June 2025

Intelligent Connected Vehicles (ICVs) impose stringent requirements on real-time computational services. However, limited onboard resources and the high latency of remote cloud servers restrict traditional solutions. Unmanned Aerial Vehicle (UAV)-ass...

  • Article
  • Open Access
27 Citations
4,145 Views
30 Pages

A Method for Multi-AUV Cooperative Area Search in Unknown Environment Based on Reinforcement Learning

  • Yueming Li,
  • Mingquan Ma,
  • Jian Cao,
  • Guobin Luo and ,
  • Depeng Wang and
  • Weiqiang Chen
  • + 1 author+ 0 author

As an emerging direction of multi-agent collaborative control technology, multiple autonomous underwater vehicle (multi-AUV) cooperative area search technology has played an important role in civilian fields such as marine resource exploration and de...

(This article belongs to the Special Issue Unmanned Marine Vehicles: Perception, Planning, Control and Swarm)
  • Article
  • Open Access
1 Citations
1,413 Views
39 Pages

UAV Mission Planning for Post-Disaster Victim Localisation via Federated Multi-Agent Reinforcement Learning

  • Alparslan Güzey,
  • Mehmet Akif Çifçi,
  • Fazlı Yıldırım and
  • Arda Yaşar Erdoğan

18 May 2026

Rapid localisation of trapped victims after urban disasters is essential but challenging because Bluetooth Low Energy (BLE) beacons are intermittent, radio propagation is obstructed by rubble, UAVs are energy-constrained, and real-world multi-UAV tra...

  • Article
  • Open Access
1,076 Views
39 Pages

Shared immersive environment sports venues, virtual classrooms, and collaborative workspaces require multiple users to stream 360° videos simultaneously over the same edge network, yet every existing adaptive bitrate system optimises each viewer...

(This article belongs to the Special Issue 3D Image Processing: Progress and Challenges)