Skip to Content

679 Results Found

  • Article
  • Open Access
2 Citations
1,372 Views
22 Pages

2 October 2025

We propose a speed-adaptive robot accurate path-tracking framework based on the soft actor–critic (SAC) and Stanley methods (STANLY_ASAC). First, the Lidar–Inertial Odometry Simultaneous Localization and Mapping (LIO-SLAM) method is used...

(This article belongs to the Section Sensors and Robotics)
  • Article
  • Open Access
352 Views
37 Pages

Evaluating Deep Actor–Critic Methods for Path Planning of Mobile Manipulators Under Wheel–Terrain Interaction

  • Christian Camacho Morales,
  • Oscar Camacho,
  • Marco Herrera,
  • Juan Pablo Vásconez and ,
  • Brayan Durán Toconás and
  • Alvaro Prado-Romo
  • + 1 author+ 0 author

2 September 2026

Reinforcement learning (RL) has become an effective paradigm for enabling autonomous robots to acquire navigation policies directly from interaction with complex and uncertain environments. Nevertheless, autonomous path planning for Skid-Steer Mobile...

(This article belongs to the Special Issue Advancement of Mathematical Methods in Feature Representation Learning for Artificial Intelligence, Data Mining and Robotics, 3rd Edition)
  • Article
  • Open Access
1 Citations
2,174 Views
20 Pages

12 August 2025

The locomotion control of unmanned quadruped robots has been one of the greatest challenges in robotics. Deep reinforcement learning has made great achievements in robot control. However, extracting effective features from historical information to i...

(This article belongs to the Special Issue Advances in Deep Learning for Drones and Its Applications: 2nd Edition)
  • Article
  • Open Access
5 Citations
4,090 Views
18 Pages

16 October 2022

Taking advantage of faster speed, less resource consumption and better biological interpretability of spiking neural networks, this paper developed a novel spiking neural network reinforcement learning method using actor-critic architecture and tempo...

  • Article
  • Open Access
23 Citations
11,873 Views
18 Pages

3 January 2023

There are several automated stock trading programs using reinforcement learning, one of which is an ensemble strategy. The main idea of the ensemble strategy is to train DRL agents and make an ensemble with three different actor–critic algorith...

(This article belongs to the Section Computing and Artificial Intelligence)
  • Article
  • Open Access
19 Citations
8,500 Views
20 Pages

The Actor-Dueling-Critic Method for Reinforcement Learning

  • Menghao Wu,
  • Yanbin Gao,
  • Alexander Jung,
  • Qiang Zhang and
  • Shitong Du

30 March 2019

Model-free reinforcement learning is a powerful and efficient machine-learning paradigm which has been generally used in the robotic control domain. In the reinforcement learning setting, the value function method learns policies by maximizing the st...

(This article belongs to the Special Issue Advances in Machine Learning for Intelligent Engineering Systems and Applications)
  • Article
  • Open Access
6 Citations
2,266 Views
15 Pages

24 March 2023

Future wireless communication systems require higher performance requirements. Based on this, we study the combinatorial optimization problem of power allocation and dynamic user pairing in a downlink multicarrier non-orthogonal multiple-access (NOMA...

  • Article
  • Open Access
16 Citations
5,940 Views
31 Pages

End-to-End AUV Motion Planning Method Based on Soft Actor-Critic

  • Xin Yu,
  • Yushan Sun,
  • Xiangbin Wang and
  • Guocheng Zhang

1 September 2021

This study aims to solve the problems of poor exploration ability, single strategy, and high training cost in autonomous underwater vehicle (AUV) motion planning tasks and to overcome certain difficulties, such as multiple constraints and a sparse re...

(This article belongs to the Section Sensors and Robotics)
  • Article
  • Open Access
14 Citations
4,807 Views
22 Pages

16 December 2022

This study aims to solve the issue of the safe navigation of autonomous underwater vehicles (AUVs) in an unknown underwater environment. AUV will encounter canyons, rocks, reefs, fish, and underwater vehicles that threaten its safety during underwate...

(This article belongs to the Special Issue AI for Navigation and Path Planning of Marine Vehicles)
  • Article
  • Open Access
8 Citations
5,285 Views
22 Pages

8 December 2023

Online learning platforms provide diverse course resources, but this often results in the issue of information overload. Learners always want to learn courses that are appropriate for their knowledge level and preferences quickly and accurately. Effe...

(This article belongs to the Special Issue Recommender Systems and Data Mining)
  • Article
  • Open Access
28 Citations
6,878 Views
15 Pages

A Path-Planning Method Based on Improved Soft Actor-Critic Algorithm for Mobile Robots

  • Tinglong Zhao,
  • Ming Wang,
  • Qianchuan Zhao,
  • Xuehan Zheng and
  • He Gao

The path planning problem has gained more attention due to the gradual popularization of mobile robots. The utilization of reinforcement learning techniques facilitates the ability of mobile robots to successfully navigate through an environment cont...

(This article belongs to the Special Issue Biomimicry for Optimization, Control, and Automation)
  • Article
  • Open Access
3 Citations
1,654 Views
27 Pages

6 January 2026

Focusing on continuous action space methods for autonomous maneuvering decision making in 1v1 unmanned aerial vehicle scenarios, this paper first establishes a UAV kinematic model and a decision-making framework under the Markov Decision Process. Sec...

(This article belongs to the Topic International Conference on Autonomous Unmanned Systems (5th ICAUS 2025))
  • Article
  • Open Access
9 Citations
3,152 Views
16 Pages

12 April 2024

Ship path planning is one of the most important themes in waterway transportation, which is deemed as the cleanest mode of transportation due to its environmentally friendly and energy-efficient nature. A path-planning method that combines the soft a...

  • Article
  • Open Access
34 Citations
8,438 Views
28 Pages

A Soft Actor-Critic Deep Reinforcement-Learning-Based Robot Navigation Method Using LiDAR

  • Yanjie Liu,
  • Chao Wang,
  • Changsen Zhao,
  • Heng Wu and
  • Yanlong Wei

7 June 2024

When there are dynamic obstacles in the environment, it is difficult for traditional path-generation algorithms to achieve desired obstacle-avoidance results. To solve this problem, we propose a robot navigation control method based on SAC (Soft Acto...

  • Article
  • Open Access
11 Citations
4,466 Views
14 Pages

Automatic Casting Control Method of Continuous Casting Based on Improved Soft Actor–Critic Algorithm

  • Xiaojun Wu,
  • Wenze Jiang,
  • Sheng Yuan,
  • Hongjia Kang and ,
  • Qi Gao and
  • Jinzhou Mi
  • + 1 author+ 0 author

21 April 2023

Continuous casting production is an important stage in smelting high-quality steel, and automatic casting control based on artificial intelligence is a key technology to improve the continuous casting process and the product quality. By controlling t...

(This article belongs to the Special Issue Advanced Tundish Metallurgy and Clean Steel Technology)
  • Article
  • Open Access
6 Citations
1,735 Views
26 Pages

Deep-Reinforcement-Learning-Enhanced Kriging Modeling Method with Limit State Dominant Sampling for Aeroengine Structural Reliability Analysis

  • Jiongran Wen,
  • Yipin Sun,
  • Aifang Chao,
  • Baiyang Zheng and ,
  • Jian Li and
  • Haozhe Feng
  • + 1 author+ 0 author

22 August 2025

Reliability analysis of aeroengine structures is a critical task in aerospace engineering, but traditional methods often face challenges of low computational efficiency and insufficient accuracy when dealing with complex, high-dimensional, and nonlin...

  • Article
  • Open Access
17 Citations
5,391 Views
27 Pages

23 October 2023

An end-to-end approach to autonomous navigation that is based on deep reinforcement learning (DRL) with a survival penalty function is proposed in this paper. Two actor–critic (AC) frameworks, namely, deep deterministic policy gradient (DDPG) a...

(This article belongs to the Special Issue AI-Driving for Autonomous Vehicles)
  • Article
  • Open Access
15 Citations
4,129 Views
25 Pages

In this study, an intelligent hybrid algorithm based on deep-reinforcement learning (DRL) is proposed to achieve autonomous navigation and intelligent collision avoidance for a smart autonomous marine surface vessel (SMASV). First, the kinematic mode...

(This article belongs to the Special Issue AI for Navigation and Path Planning of Marine Vehicles)
  • Article
  • Open Access
8 Citations
1,991 Views
33 Pages

20 January 2026

Heating, ventilation, and air-conditioning (HVAC) systems dominate energy consumption in hot-climate buildings, where maintaining occupant comfort under extreme outdoor conditions remains a critical challenge, particularly under emerging time-of-use...

(This article belongs to the Special Issue Advanced Artificial Intelligence/Machine Learning Techniques for Safe Operation and Control in Power and Sustainable Energy Systems)
  • Article
  • Open Access
745 Views
22 Pages

Soft Actor-Critic-Based Power Optimization Method for UAV Wireless Charging Systems

  • Zhuoyue Dai,
  • Yongmin Yang,
  • Yanting Luo,
  • Zhilong Lin and
  • Guanpeng Yang

19 March 2026

Maintaining high power delivery under uncertain landing positions is a key challenge for wireless charging of unmanned aerial vehicles (UAVs). This paper presents a data-driven power optimization method based on the Soft Actor-Critic algorithm for mu...

(This article belongs to the Section Drone Communications)
  • Article
  • Open Access
546 Views
21 Pages

An Autonomous-Exploration Method for Mobile Robots Based on Distributional Soft Actor–Critic

  • He Ding,
  • Benke Gao,
  • Hao Chen,
  • Shuai Yang and ,
  • Zan Tang,
  • Hanqiang Deng,
  • Quan Liu and
  • Jian Huang
  • + 3 authors+ 0 author

11 June 2026

Autonomous exploration requires reliable viewpoint evaluation from partial observations. Existing reinforcement-learning methods commonly approximate each action by using a scalar expected return, which is inadequate in unknown environments with hete...

  • Article
  • Open Access
777 Views
30 Pages

A Multi-UAV Cooperative Mission Planning Method Based on Multi-Agent Guided Soft Actor–Critic

  • Shuanli Jia,
  • Naiming Qi,
  • Zheng Li,
  • Long He and ,
  • Rui Zhou and
  • Yanfang Liu
  • + 1 author+ 0 author

5 July 2026

Multiple unmanned aerial vehicles (UAVs) performing cooperative missions in complex environments face challenges such as difficult cooperative decision-making, stringent spatiotemporal consistency constraints, and environmental uncertainty. The coope...

(This article belongs to the Special Issue UAV Swarm Intelligent Control and Decision-Making)
  • Article
  • Open Access
7 Citations
2,805 Views
16 Pages

4 October 2022

Electric vehicles (EVs) have become popular in daily life, which influences carbon dioxide emissions and reshapes the curves of community loads. It is crucial to study efficient carbon emission scheduling algorithms to lessen the influence of EVs&rsq...

  • Article
  • Open Access
1 Citations
3,603 Views
16 Pages

15 December 2024

The prevalent utilization of deterministic strategy algorithms in Multi-Agent Deep Reinforcement Learning (MADRL) for collaborative tasks has posed a significant challenge in achieving stable and high-performance cooperative behavior. Addressing the...

(This article belongs to the Section Evolutionary Algorithms and Machine Learning)
  • Article
  • Open Access
287 Views
30 Pages

Accurate estimation of state-of-charge (SoC) and state-of-health (SoH) is important for lithium-ion battery operation. This study investigates an actor–critic formulation of joint SoC/SoH estimation using TD3 and SAC with a composite reward and...

(This article belongs to the Section Storage Systems)
  • Article
  • Open Access
21 Citations
6,527 Views
16 Pages

10 July 2019

An optimal feedback controller for a given Markov decision process (MDP) can in principle be synthesized by value or policy iteration. However, if the system dynamics and the reward function are unknown, a learning agent must discover an optimal cont...

(This article belongs to the Special Issue Entropy Based Inference and Optimization in Machine Learning)
  • Article
  • Open Access
9 Citations
3,854 Views
21 Pages

An Applied Framework for Smarter Buildings Exploiting a Self-Adapted Advantage Weighted Actor-Critic

  • Ioannis Papaioannou,
  • Asimina Dimara,
  • Christos Korkas,
  • Iakovos Michailidis and ,
  • Alexios Papaioannou,
  • Christos-Nikolaos Anagnostopoulos,
  • Elias Kosmatopoulos,
  • Stelios Krinidis and
  • Dimitrios Tzovaras
  • + 4 authors+ 0 author

27 January 2024

Smart buildings are rapidly becoming more prevalent, aiming to create energy-efficient and comfortable living spaces. Nevertheless, the design of a smart building is a multifaceted approach that faces numerous challenges, with the primary one being t...

(This article belongs to the Special Issue Smart Energy Systems: Learning Methods for Control and Optimization)
  • Article
  • Open Access
375 Views
22 Pages

Sample Selection Generative Adversarial Networks for Intelligent Frequency Regulation of Microgrids

  • Xi Ye,
  • Xuetong Ouyang,
  • Baorui Chen,
  • Xi Wang and ,
  • Tong Zhu,
  • Kai Yang and
  • Runzhi Chen
  • + 2 authors+ 0 author

9 June 2026

Large-scale renewable energy integration introduces random power fluctuations into microgrids, increasing the difficulty of frequency regulation. To improve regulation stability and training efficiency, this article proposes sample selection generati...

(This article belongs to the Special Issue Power-Electronics-Based New-Type Power Systems: Data Analysis, Planning, Operation, and Stability Control)
  • Article
  • Open Access
14 Citations
5,106 Views
13 Pages

In the past decade, the application of deep reinforcement learning (DRL) in portfolio management has attracted extensive attention. However, most classical RL algorithms do not consider the exogenous and noise of financial time series data, which may...

(This article belongs to the Topic Machine and Deep Learning)
  • Article
  • Open Access
12 Citations
4,316 Views
21 Pages

Coverage Path Planning Using Actor–Critic Deep Reinforcement Learning

  • Sergio Isahí Garrido-Castañeda,
  • Juan Irving Vasquez and
  • Mayra Antonio-Cruz

5 March 2025

One of the main capabilities a mobile robot must demonstrate is the ability to explore its environment. The core challenge in exploration lies in planning the route to fully cover the environment. Despite recent advances, this problem remains unsolve...

(This article belongs to the Topic Advances in Mobile Robotics Navigation, 2nd Edition)
  • Article
  • Open Access
1 Citations
1,182 Views
30 Pages

Model-Based Reinforcement Learning for Containing Malware Propagation in Wireless Radar Sensor Networks

  • Haitao Lin,
  • Can Tian,
  • Linman Chen,
  • Daizhi Liao and ,
  • Yunbo Wang and
  • Yubo Hua
  • + 1 author+ 0 author

2 September 2025

To address malware containment challenges in WRSNs—where traditional integer-order models neglect propagation memory effects and standard reinforcement learning (RL) suffers from slow trial-and-error limitations—we propose the following:...

(This article belongs to the Special Issue Intelligent Sensing, Control and Actuation in Networked Systems)
  • Article
  • Open Access
3 Citations
880 Views
21 Pages

21 April 2026

This paper presents an adaptive optimal consensus tracking control scheme for canonical nonlinear multi-agent systems (MASs) with unknown dynamics, employing an actor–critic reinforcement learning (RL) framework. The scheme integrates a sliding...

(This article belongs to the Special Issue Symmetry in Control Systems: Theory, Design, and Application)
  • Article
  • Open Access
468 Views
24 Pages

AI Agents for Supply Chain: Path Following Control Using Adaptive Kalman Filter Reinforcement Learning

  • Petru Stefan Vasian,
  • Ionut Dancau,
  • Catalin Dumitrescu,
  • Eduard-Cristian Popovici and
  • Petrica Ciotirnae

17 July 2026

Path following control is a fundamental problem in robotics and autonomous systems, essential for the navigation of vehicles, drones, and mobile robots. The goal is to maintain a system on a predefined path despite external perturbations and complex...

(This article belongs to the Special Issue AI Applications in Transportation and Logistics)
  • Article
  • Open Access
8 Citations
2,697 Views
12 Pages

Secondary Voltage Collaborative Control of Distributed Energy System via Multi-Agent Reinforcement Learning

  • Tianhao Wang,
  • Shiqian Ma,
  • Na Xu,
  • Tianchun Xiang and ,
  • Xiaoyun Han,
  • Chaoxu Mu and
  • Yao Jin
  • + 2 authors+ 0 author

25 September 2022

In this paper, a new voltage cooperative control strategy for a distributed power generation system is proposed based on the multi-agent advantage actor-critic (MA2C) algorithm, which realizes flexible management and effective control of distributed...

  • Article
  • Open Access
2 Citations
1,882 Views
15 Pages

Hierarchical Decision Making-Based Intelligent Game Confrontation on UAV Swarm

  • Guannan Chang,
  • Siyuan Ren,
  • Shuna Zhang and
  • Xiaofeng Zhang

21 November 2025

To address the challenge of decision making in close-range air combat for fixed-wing unmanned air vehicle (UAV) swarms, this paper proposes a distributed Hierarchical Cooperative Soft Actor-Critic with maximum entropy (HC-SAC) framework. A top-level...

(This article belongs to the Topic International Conference on Autonomous Unmanned Systems (5th ICAUS 2025))
  • Article
  • Open Access
3 Citations
3,211 Views
12 Pages

Policy Optimization of the Power Allocation Algorithm Based on the Actor–Critic Framework in Small Cell Networks

  • Haibo Chen,
  • Zhongwei Huang,
  • Xiaorong Zhao,
  • Xiao Liu and ,
  • Youjun Jiang,
  • Pinyong Geng,
  • Guang Yang,
  • Yewen Cao and
  • Deqiang Wang
  • + 4 authors+ 0 author

2 April 2023

A practical solution to the power allocation problem in ultra-dense small cell networks can be achieved by using deep reinforcement learning (DRL) methods. Unlike traditional algorithms, DRL methods are capable of achieving low latency and operating...

(This article belongs to the Topic Application of Deep Learning Method in 6G Communication Technology)
  • Article
  • Open Access
4 Citations
3,486 Views
13 Pages

10 September 2020

We present a differentially private actor and its eligibility trace in an actor-critic approach, wherein an actor takes actions directly interacting with an environment; however, the critic estimates only the state values that are obtained through bo...

(This article belongs to the Special Issue Advances in Machine Learning)
  • Article
  • Open Access
8 Citations
3,385 Views
23 Pages

3 January 2025

With the rapid advancement of the manufacturing industry and the widespread implementation of intelligent manufacturing systems, the energy-aware distributed heterogeneous flexible job shop scheduling problem (DHFJSP) has emerged as a critical challe...

(This article belongs to the Section AI-Enabled Process Engineering)
  • Article
  • Open Access
70 Citations
13,457 Views
21 Pages

Multi-Agent Reinforcement Learning for Traffic Flow Management of Autonomous Vehicles

  • Anum Mushtaq,
  • Irfan Ul Haq,
  • Muhammad Azeem Sarwar,
  • Asifullah Khan and ,
  • Wajeeha Khalil and
  • Muhammad Abid Mughal
  • + 1 author+ 0 author

21 February 2023

Intelligent traffic management systems have become one of the main applications of Intelligent Transportation Systems (ITS). There is a growing interest in Reinforcement Learning (RL) based control methods in ITS applications such as autonomous drivi...

(This article belongs to the Section Vehicular Sensing)
  • Tutorial
  • Open Access
67 Views
13 Pages

Following the evolution from theoretical foundations to advanced deep learning algorithms, a coherent overview of reinforcement learning (RL) is proposed in this tutorial. We begin with the mathematical formalization of sequential decision-making via...

(This article belongs to the Section Learning)
  • Article
  • Open Access
1 Citations
4,562 Views
22 Pages

FASTune: Towards Fast and Stable Database Tuning System with Reinforcement Learning

  • Lei Shi,
  • Tian Li,
  • Lin Wei,
  • Yongcai Tao and ,
  • Cuixia Li and
  • Yufei Gao
  • + 1 author+ 0 author

Configuration tuning is vital to achieving high performance for a database management system (DBMS). Recently, automatic tuning methods using Reinforcement Learning (RL) have been explored to find better configurations compared with database administ...

(This article belongs to the Section Computer Science & Engineering)
  • Article
  • Open Access
3 Citations
4,273 Views
19 Pages

9 January 2023

In recent years, the model compression technique is very effective for deep neural network compression. However, many existing model compression methods rely heavily on human experience to explore a compression strategy between network structure, spe...

(This article belongs to the Special Issue Learning-Based Control and Nonlinear Optimization: Theory, Models, Algorithms, and Applications)
  • Article
  • Open Access
2 Citations
2,752 Views
21 Pages

Intelligent Decision-Making Analytics Model Based on MAML and Actor–Critic Algorithms

  • Xintong Zhang,
  • Beibei Zhang,
  • Haoru Li,
  • Helin Wang and
  • Yunqiao Huang

14 September 2025

Traditional Reinforcement Learning (RL) struggles in dynamic decision-making due to data dependence, limited generalization, and imbalanced subjective/objective factors. This paper proposes an intelligent model combining the Model-Agnostic Meta-Learn...

(This article belongs to the Section AI Systems: Theory and Applications)
  • Article
  • Open Access
4 Citations
2,886 Views
19 Pages

System Frequency Control Method Driven by Deep Reinforcement Learning and Customer Satisfaction for Thermostatically Controlled Load

  • Rusi Chen,
  • Haiguang Liu,
  • Chengquan Liu,
  • Guangzheng Yu and ,
  • Xuan Yang and
  • Yue Zhou
  • + 1 author+ 0 author

24 October 2022

The intermittence and fluctuation of renewable energy aggravate the power fluctuation of the power grid and pose a severe challenge to the frequency stability of the power system. Thermostatically controlled loads can participate in the frequency reg...

(This article belongs to the Topic Artificial Intelligence and Sustainable Energy Systems)
  • Article
  • Open Access
5 Citations
2,869 Views
19 Pages

Extended Maximum Actor–Critic Framework Based on Policy Gradient Reinforcement for System Optimization

  • Jung-Hyun Kim,
  • Yong-Hoon Choi,
  • You-Rak Choi,
  • Jae-Hyeok Jeong and
  • Min-Suk Kim

11 February 2025

Recently, significant research efforts have been directed toward leveraging Artificial Intelligence for sensor data processing and system control. In particular, it is essential to determine the optimal path and trajectory by calculating sensor data...

(This article belongs to the Special Issue Advances in Machine Learning and Data Mining: Emerging Trends and Applications)
  • Article
  • Open Access
8 Citations
3,652 Views
26 Pages

18 February 2024

With the popularity of smart devices and the growth of high-bandwidth applications, the wireless industry is facing an increased surge in data traffic. This challenge highlights the limitations of traditional edge-caching solutions, especially in ter...

  • Article
  • Open Access
6 Citations
5,941 Views
18 Pages

30 May 2022

Poker has been considered a challenging problem in both artificial intelligence and game theory because poker is characterized by imperfect information and uncertainty, which are similar to many realistic problems like auctioning, pricing, cyber secu...

(This article belongs to the Section Complexity)
  • Article
  • Open Access
54 Citations
13,257 Views
19 Pages

In the current landscape where cybersecurity threats are escalating in complexity and frequency, traditional defense mechanisms like rule-based firewalls and signature-based detection are proving inadequate. The dynamism and sophistication of modern...

(This article belongs to the Special Issue Novel Methods Applied to Security and Privacy Problems in Future Networking Technologies)
  • Article
  • Open Access
508 Views
19 Pages

Fixed-wing unmanned aerial vehicle formation control confronts the dual challenges of achieving optimal performance amidst complex nonlinear dynamics and ensuring flight safety by constraining tracking errors. Existing reinforcement learning methods,...

(This article belongs to the Special Issue Intelligent Control Techniques for Unmanned Aerial Vehicles)

of 14