Skip to Content

1,224 Results Found

  • Article
  • Open Access
18 Citations
6,297 Views
17 Pages

Deep reinforcement learning (DRL) trains agents to make decisions by learning from rewards and penalties, using trial and error. It combines reinforcement learning (RL) with deep neural networks (DNNs), enabling agents to process large datasets and l...

  • Article
  • Open Access
7 Citations
2,666 Views
14 Pages

Deep Q-Network for Optimal Decision for Top-Coal Caving

  • Yi Yang,
  • Xinwei Li,
  • Huamin Li,
  • Dongyin Li and
  • Ruifu Yuan

2 April 2020

In top-coal caving, the window control of hydraulic support is a key issue to the perfect economic benefit. The window is driven by the electro-hydraulic control system whose command is produced by the control model and the corresponding algorithm. H...

(This article belongs to the Section L: Energy Sources)
  • Article
  • Open Access
9 Citations
4,445 Views
23 Pages

Timeslot Scheduling with Reinforcement Learning Using a Double Deep Q-Network

  • Jihye Ryu,
  • Juhyeok Kwon,
  • Jeong-Dong Ryoo,
  • Taesik Cheung and
  • Jinoo Joung

20 February 2023

Adopting reinforcement learning in the network scheduling area is getting more attention than ever because of its flexibility in adapting to the dynamic changes of network traffic and network status. In this study, a timeslot scheduling algorithm for...

(This article belongs to the Section Networks)
  • Article
  • Open Access
14 Citations
3,556 Views
14 Pages

Train Scheduling with Deep Q-Network: A Feasibility Test

  • Intaek Gong,
  • Sukmun Oh and
  • Yunhong Min

25 November 2020

We consider a train scheduling problem in which both local and express trains are to be scheduled. In this type of train scheduling problem, the key decision is determining the overtaking stations at which express trains overtake their preceding loca...

(This article belongs to the Section Applied Industrial Technologies)
  • Article
  • Open Access
8 Citations
1,721 Views
21 Pages

Quadruple Deep Q-Network-Based Energy Management Strategy for Plug-In Hybrid Electric Vehicles

  • Dingyi Guo,
  • Guangyin Lei,
  • Huichao Zhao,
  • Fang Yang and
  • Qiang Zhang

13 December 2024

This study proposes the use of a Quadruple Deep Q-Network (QDQN) for optimizing the energy management strategy of Plug-in Hybrid Electric Vehicles (PHEVs). The aim of this research is to improve energy utilization efficiency by employing reinforcemen...

(This article belongs to the Section E: Electric Vehicles)
  • Article
  • Open Access
256 Citations
19,396 Views
19 Pages

Deep Q-Learning Based Reinforcement Learning Approach for Network Intrusion Detection

  • Hooman Alavizadeh,
  • Hootan Alavizadeh and
  • Julian Jang-Jaccard

The rise of the new generation of cyber threats demands more sophisticated and intelligent cyber defense solutions equipped with autonomous agents capable of learning to make decisions without the knowledge of human experts. Several reinforcement lea...

  • Article
  • Open Access
8 Citations
4,860 Views
15 Pages

24 November 2021

A Deep-Q-Network (DQN) controls a virtual agent as the level of a player using only screenshots as inputs. Replay memory selects a limited number of experience replays according to an arbitrary batch size and updates them using the associated Q-funct...

(This article belongs to the Special Issue Advances in Artificial Intelligence: Machine Learning, Data Mining and Data Sciences)
  • Article
  • Open Access
22 Citations
6,281 Views
15 Pages

Using a Reinforcement Q-Learning-Based Deep Neural Network for Playing Video Games

  • Cheng-Jian Lin,
  • Jyun-Yu Jhang,
  • Hsueh-Yi Lin,
  • Chin-Ling Lee and
  • Kuu-Young Young

This study proposed a reinforcement Q-learning-based deep neural network (RQDNN) that combined a deep principal component analysis network (DPCANet) and Q-learning to determine a playing strategy for video games. Video game images were used as the in...

(This article belongs to the Section Artificial Intelligence)
  • Article
  • Open Access
11 Citations
3,686 Views
17 Pages

Powering UAV with Deep Q-Network for Air Quality Tracking

  • Alaelddin F. Y. Mohammed,
  • Salman Md Sultan,
  • Seokheon Cho and
  • Jae-Young Pyun

16 August 2022

Tracking the source of air pollution plumes and monitoring the air quality during emergency events in real-time is crucial to support decision-makers in making an appropriate evacuation plan. Internet of Things (IoT) based air quality tracking and mo...

(This article belongs to the Section Environmental Sensing)
  • Article
  • Open Access
1 Citations
454 Views
24 Pages

16 June 2026

Intelligent packet routing in sixth-generation (6G) heterogeneous wireless networks must contend with stochastic link failures, heterogeneous delay profiles, and the severe memory constraints of edge nodes. We propose a quantum deep Q-network (Q-DQN)...

  • Article
  • Open Access
43 Citations
3,980 Views
16 Pages

Trajectory Planning for UAV-Assisted Data Collection in IoT Network: A Double Deep Q Network Approach

  • Shuqi Wang,
  • Nan Qi,
  • Hua Jiang,
  • Ming Xiao and ,
  • Haoxuan Liu,
  • Luliang Jia and
  • Dan Zhao
  • + 2 authors+ 0 author

Unmanned aerial vehicles (UAVs) are becoming increasingly valuable as a new type of mobile communication device and autonomous decision-making device in many application areas, including the Internet of Things (IoT). UAVs have advantages over other s...

(This article belongs to the Special Issue Emerging Unmanned Aerial Vehicle Communication Techniques for the Next Generation of Wireless Networks)
  • Article
  • Open Access
6 Citations
3,926 Views
25 Pages

Virtual Network Function Embedding under Nodal Outage Using Deep Q-Learning

  • Swarna Bindu Chetty,
  • Hamed Ahmadi,
  • Sachin Sharma and
  • Avishek Nag

With the emergence of various types of applications such as delay-sensitive applications, future communication networks are expected to be increasingly complex and dynamic. Network Function Virtualization (NFV) provides the necessary support towards...

(This article belongs to the Special Issue Cognitive Software Defined Networking and Network Function Virtualization and Applications)
  • Article
  • Open Access
8 Citations
2,735 Views
16 Pages

5 September 2022

Geoacoustic inversion is important for seabed geotechnical applications. It can be formulated as a problem that seeks an optimal solution in a high-dimensional parameter space. The conventional inversion approach exploits optimization methods with a...

(This article belongs to the Special Issue Advances in Artificial Intelligence: Machine Learning, Data Mining and Data Sciences)
  • Article
  • Open Access
11 Citations
3,337 Views
19 Pages

A Deep Q-Network-Based Algorithm for Multi-Connectivity Optimization in Heterogeneous Cellular-Networks

  • Juan Jesús Hernández-Carlón,
  • Jordi Pérez-Romero,
  • Oriol Sallent,
  • Irene Vilà and
  • Ferran Casadevall

18 August 2022

The use of multi-connectivity has become a useful tool to manage the traffic in heterogeneous cellular network deployments, since it allows a device to be simultaneously connected to multiple cells. The proper exploitation of this technique requires...

(This article belongs to the Special Issue Advances in Dense 5G/6G Wireless Networks)
  • Article
  • Open Access
15 Citations
6,208 Views
15 Pages

Deep Q-Network (DQN) Model for Disease Prediction Using Electronic Health Records (EHRs)

  • Nabil M. AbdelAziz,
  • Gehan A. Fouad,
  • Safa Al-Saeed and
  • Amira M. Fawzy

7 February 2025

Many efforts have proved that deep learning models are effective for disease prediction using electronic health records (EHRs). However, these models are not yet precise enough to predict diseases. Additionally, ethical concerns and the use of cluste...

(This article belongs to the Section Computer Science, Mathematics and AI)
  • Article
  • Open Access
22 Citations
4,121 Views
13 Pages

25 January 2023

With the advent of the Internet of Things (IoT) era, a wide array of wireless sensors supporting the IoT have proliferated. As key elements for enabling the IoT, wireless sensor nodes require minimal energy consumption and low device complexity. In p...

(This article belongs to the Section Sensor Networks)
  • Article
  • Open Access
38 Citations
6,537 Views
17 Pages

Double Deep Q-Network with a Dual-Agent for Traffic Signal Control

  • Jianfeng Gu,
  • Yong Fang,
  • Zhichao Sheng and
  • Peng Wen

29 February 2020

Adaptive traffic signal control (ATSC) based on deep reinforcement learning (DRL) has shown promising prospects to reduce traffic congestion. Most existing methods keeping traffic signal phases fixed adopt two agent actions to match a four-phase suff...

(This article belongs to the Special Issue Intelligent Transportation Systems)
  • Article
  • Open Access
20 Citations
2,999 Views
12 Pages

Secure Healthcare Model Using Multi-Step Deep Q Learning Network in Internet of Things

  • Patibandla Pavithra Roy,
  • Ventrapragada Teju,
  • Srinivasa Rao Kandula,
  • Kambhampati Venkata Sowmya and ,
  • Anca Ioana Stan and
  • Ovidiu Petru Stan
  • + 1 author+ 0 author

Internet of Things (IoT) is an emerging networking technology that connects both living and non-living objects globally. In an era where IoT is increasingly integrated into various industries, including healthcare, it plays a pivotal role in simplify...

(This article belongs to the Section Systems & Control Engineering)
  • Article
  • Open Access
23 Citations
3,506 Views
21 Pages

A Novel Path Planning Approach for Mobile Robot in Radioactive Environment Based on Improved Deep Q Network Algorithm

  • Zhiqiang Wu,
  • Yebo Yin,
  • Jie Liu,
  • De Zhang and ,
  • Jie Chen and
  • Wei Jiang
  • + 1 author+ 0 author

11 November 2023

The path planning problem of nuclear environment robots refers to finding a collision-free path under the constraints of path length and an accumulated radiation dose. To solve this problem, the Improved Dueling Deep Double Q Network algorithm (ID3QN...

  • Article
  • Open Access
6 Citations
3,436 Views
17 Pages

13 October 2022

Deep reinforcement learning (DRL) algorithms interact with the environment and have achieved considerable success in several decision-making problems. However, DRL requires a significant number of data before it can achieve adequate performance. More...

(This article belongs to the Section A: Computer Science)
  • Article
  • Open Access
31 Citations
5,524 Views
22 Pages

Multiple Unmanned Aerial Vehicle Autonomous Path Planning Algorithm Based on Whale-Inspired Deep Q-Network

  • Wenshan Wang,
  • Guoyin Zhang,
  • Qingan Da,
  • Dan Lu and ,
  • Yingnan Zhao,
  • Sizhao Li and
  • Dapeng Lang
  • + 2 authors+ 0 author

8 September 2023

In emergency rescue missions, rescue teams can use UAVs and efficient path planning strategies to provide flexible rescue services for trapped people, which can improve rescue efficiency and reduce personnel risks. However, since the task environment...

(This article belongs to the Special Issue UAV Trajectory Generation, Optimization and Cooperative Control)
  • Article
  • Open Access
10 Citations
3,684 Views
20 Pages

15 November 2024

Particle Swarm Optimization (PSO) is a widespread evolutionary technique that has successfully solved diverse optimization problems across various application fields. However, when dealing with more complex optimization problems, PSO can suffer from...

  • Article
  • Open Access
38 Citations
5,115 Views
15 Pages

23 January 2023

Recently, with the development of autonomous driving technology, vehicle-to-everything (V2X) communication technology that provides a wireless connection between vehicles, pedestrians, and roadside base stations has gained significant attention. Vehi...

(This article belongs to the Special Issue Energy-Efficient Communication Networks and Systems)
  • Article
  • Open Access
1 Citations
1,505 Views
22 Pages

Graph Convolution Neural Network and Deep Q-Network Optimization-Based Intrusion Detection with Explainability Analysis

  • Kelvin Mwiga,
  • Mussa Dida,
  • Leandros Maglaras,
  • Ahmad Mohsin and ,
  • Helge Janicke and
  • Iqbal H. Sarker
  • + 1 author+ 0 author

24 February 2026

As networks expand in size and complexity, coupled with an exponential increase in intrusions on network and IoT systems, this leads to traditional models failing to capture increasingly intricate correlations among network components accurately. Gra...

(This article belongs to the Special Issue Advanced Applications of WSNs and the IoT—2nd Edition)
  • Article
  • Open Access
2 Citations
3,128 Views
24 Pages

A Failure Risk-Aware Multi-Hop Routing Protocol in LPWANs Using Deep Q-Network

  • Shaojun Tao,
  • Hongying Tang,
  • Jiang Wang and
  • Baoqing Li

15 July 2025

Multi-hop routing over low-power wide-area networks (LPWANs) has emerged as a promising technology for extending network coverage. However, existing protocols face high transmission disruption risks due to factors such as dynamic topology driven by s...

(This article belongs to the Special Issue Security, Privacy and Trust in Wireless Sensor Networks)
  • Article
  • Open Access
84 Citations
7,068 Views
17 Pages

AUV 3D Path Planning Based on the Improved Hierarchical Deep Q Network

  • Yushan Sun,
  • Xiangrui Ran,
  • Guocheng Zhang,
  • Hao Xu and
  • Xiangbin Wang

24 February 2020

This study proposed the 3D path planning of an autonomous underwater vehicle (AUV) by using the hierarchical deep Q network (HDQN) combined with the prioritized experience replay. The path planning task was divided into three layers, which realized t...

(This article belongs to the Special Issue Unmanned Marine Vehicles)
  • Article
  • Open Access
15 Citations
3,513 Views
18 Pages

6 October 2021

Battery energy storage technology is an important part of the industrial parks to ensure the stable power supply, and its rough charging and discharging mode is difficult to meet the application requirements of energy saving, emission reduction, cost...

  • Article
  • Open Access
16 Citations
4,137 Views
12 Pages

3 January 2022

Traffic congestion is a worsening problem owing to an increase in traffic volume. Traffic congestion increases the driving time and wastes fuel, generating large amounts of fumes and accelerating environmental pollution. Therefore, traffic congestion...

(This article belongs to the Special Issue 10th Anniversary of Applied Sciences: Invited Papers in Computing and Artificial Intelligence Section)
  • Article
  • Open Access
19 Citations
4,149 Views
19 Pages

31 August 2022

The development of hybrid renewable energy systems (HRESs) can be the most feasible solution for a stable, environment-friendly, and cost-effective power generation, especially in rural and island territories. In this studied HRES, solar and wind ene...

(This article belongs to the Topic Artificial Intelligence and Sustainable Energy Systems)
  • Article
  • Open Access
14 Citations
3,795 Views
20 Pages

30 November 2024

Path planning is a key task in mobile robots, and the application of Deep Q Network (DQN) algorithm for mobile robot path planning has become a hotspot and challenge in current research. In order to solve the obstacle avoidance limitations faced by t...

  • Article
  • Open Access
2 Citations
881 Views
22 Pages

Deep Q-Network Based Optimal Charging Coordination of Electric Vehicles Considering Vehicle-to-Grid Technology

  • Yicheng Li,
  • Yue Xiang,
  • Tianwen Zheng,
  • Cao Wen and ,
  • Wei Wei,
  • Jun Tong,
  • Haifeng Hu,
  • Zhou Sun,
  • Tianjin Chen and
  • Qian Zhang
  • + 5 authors+ 0 author

To further enhance the active participation of electric vehicles in grid interaction and reduce the decision-making costs for electric vehicle aggregators, this paper addresses the challenges in current EV charging and V2G (Vehicle-to-Grid) managemen...

(This article belongs to the Topic Intelligent, Flexible, and Effective Operation of Smart Grids with Novel Energy Technologies and Equipment)
  • Article
  • Open Access
3 Citations
3,759 Views
17 Pages

8 November 2024

AMHSs (Automated Material Handling Systems) are widely used in major Fabs (semiconductor fabrication plants). The OHT in an AMHS is responsible for handling the FOUP (Front Opening Unified Pod) within the Fabs. Due to the unidirectional track, the mo...

  • Article
  • Open Access
2 Citations
570 Views
32 Pages

As the number of unmanned aerial vehicles (UAVs) and the volume of computational tasks increase in UAV ad hoc networks (UAVANET), the solution space for task allocation strategies grows exponentially. In practical emergency scenarios with concurrent...

(This article belongs to the Special Issue Advances in Intelligent Wireless Communications: AI, Optimization, and Beyond)
  • Article
  • Open Access
3 Citations
2,026 Views
24 Pages

23 January 2025

Model-free deep reinforcement learning (MFDRL) is well-suited for real-time traffic signal control (RTSC), as it is a sequential decision problem where the environment is difficult to be a priori modeled, but has performance metrics sufficing as rewa...

(This article belongs to the Section Transportation and Future Mobility)
  • Article
  • Open Access
1 Citations
2,697 Views
18 Pages

16 November 2023

When the call center queuing system becomes complex, it turns out that the static routing policy is not optimal. This paper considers the problem of the dynamic routing policy for call centers with multiple skill types and agent groups. A state-depen...

  • Article
  • Open Access
3 Citations
1,264 Views
19 Pages

Enhanced-Dueling Deep Q-Network for Trustworthy Physical Security of Electric Power Substations

  • Nawaraj Kumar Mahato,
  • Junfeng Yang,
  • Jiaxuan Yang,
  • Gangjun Gong and ,
  • Jianhong Hao,
  • Jing Sun and
  • Jinlu Liu
  • + 2 authors+ 0 author

18 June 2025

This paper introduces an Enhanced-Dueling Deep Q-Network (EDDQN) specifically designed to bolster the physical security of electric power substations. We model the intricate substation security challenge as a Markov Decision Process (MDP), segmenting...

(This article belongs to the Special Issue Energy, Electrical and Power Engineering: 3rd Edition)
  • Article
  • Open Access
2 Citations
2,016 Views
38 Pages

Double Deep Q-Network-Based Solution for the Dynamic Electric Vehicle Routing Problem

  • Mehmet Bilge Han Taş,
  • Kemal Özkan,
  • İnci Sarıçiçek and
  • Ahmet Yazıcı

26 December 2025

The Dynamic Electric Vehicle Routing Problem (D-EVRP) presents a framework that requires electric vehicles to meet demand with limited energy capacity. When dynamic demand flows and charging requirements are considered together, traditional methods c...

(This article belongs to the Section Computing and Artificial Intelligence)
  • Article
  • Open Access
4 Citations
1,548 Views
25 Pages

22 March 2025

The efficiency of the current cellular network is limited due to the imbalance between resource availability and traffic demand. To overcome these limitations, baseband units (BBUs) are deployed on virtual machines (VMs) to form a virtual pool of BBU...

(This article belongs to the Section Computing and Artificial Intelligence)
  • Article
  • Open Access
17 Citations
3,793 Views
20 Pages

Effective real-time autonomous navigation for mobile robots in static and dynamic environments has become a challenging and active research topic. Although the simultaneous localization and mapping (SLAM) algorithm offers a solution, it often heavily...

  • Article
  • Open Access
5 Citations
2,422 Views
26 Pages

22 November 2023

This paper explores the use of deep reinforcement learning in solving the multi-agent aircraft traffic planning (individual paths) and collision avoidance problem for a multiple UAS, such as that for a cargo drone network. Specifically, the Deep Q-Ne...

(This article belongs to the Collection Air Transportation—Operations and Management)
  • Article
  • Open Access
416 Views
32 Pages

2 June 2026

This study presents a reinforcement learning-based approach for the adaptive control of chaotic systems, where a Deep Q-Network (DQN) is employed to adjust the parameters of a nonlinear backstepping controller in order to maximize a predefined reward...

(This article belongs to the Section Electrical, Electronics and Communications Engineering)
  • Article
  • Open Access
16 Citations
3,927 Views
17 Pages

29 November 2023

In this paper, motivated by the production process of electronic control modules in the digital electronic detonators industry, we study a multi-objective flexible flow shop scheduling problem. The objective is to find a feasible schedule that minimi...

(This article belongs to the Section Manufacturing Processes and Systems)
  • Article
  • Open Access
3 Citations
2,063 Views
18 Pages

A Novel FBG Placement Optimization Method for Tunnel Monitoring Based on WOA and Deep Q-Network

  • Jiguo Liu,
  • Ming Song,
  • Heng Shu,
  • Wenbo Peng and ,
  • Longhai Wei and
  • Kai Wang
  • + 1 author+ 0 author

21 October 2024

By employing the whale optimization algorithm’s (WOA) capability to reduce the probability of being stuck in a locally optimal solution, this study proposed an improved WOA-DQN algorithm based on the Deep Q-Network algorithm (DQN). Firstly, the...

(This article belongs to the Section A: Computer Science)
  • Article
  • Open Access
6 Citations
1,021 Views
19 Pages

10 April 2026

Multi-UAV communication networks face significant challenges in achieving high energy efficiency and low communication latency under dynamic topology and interference conditions. This paper proposes a Dueling Deep Q-Network (DQN) framework for joint...

(This article belongs to the Section Drone Communications)
  • Article
  • Open Access
2 Citations
1,593 Views
38 Pages

26 February 2026

Deep Q-Networks (DQNs) have achieved strong performance across a range of benchmark tasks; however, their reliability under varying reward structures and planning horizons remains insufficiently characterized. This study presents a systematic cross-e...

(This article belongs to the Special Issue Machine/Deep Learning Applications and Intelligent Systems)
  • Article
  • Open Access
4 Citations
2,626 Views
17 Pages

High-Speed Three-Dimensional Aerial Vehicle Evasion Based on a Multi-Stage Dueling Deep Q-Network

  • Yefeng Yang,
  • Tao Huang,
  • Xinxin Wang,
  • Chih-Yung Wen and
  • Xianlin Huang

31 October 2022

This paper proposes a multi-stage dueling deep Q-network (MS-DDQN) algorithm to address the high-speed aerial vehicle evasion problem. High-speed aerial vehicle pursuit and evasion are an ongoing game attracting significant research attention in the...

(This article belongs to the Section Aeronautics)
  • Article
  • Open Access
1 Citations
830 Views
19 Pages

11 January 2026

Decision-making for maneuvering in the presence of long-range threats is crucial for enhancing the safety and reliability of autonomous aerial platforms operating in beyond-line-of-sight environments. This study employs the Deep Q-Network (DQN) metho...

(This article belongs to the Section Aeronautics)
  • Article
  • Open Access
33 Citations
8,190 Views
13 Pages

Design of Obstacle Avoidance for Autonomous Vehicle Using Deep Q-Network and CARLA Simulator

  • Wasinee Terapaptommakol,
  • Danai Phaoharuhansa,
  • Pramote Koowattanasuchat and
  • Jartuwat Rajruangrabin

In this paper, we propose a deep Q-network (DQN) method to develop an autonomous vehicle control system to achieve trajectory design and collision avoidance with regard to obstacles on the road in a virtual environment. The intention of this work is...

(This article belongs to the Special Issue Intelligent Vehicle Control Systems)
  • Article
  • Open Access
14 Citations
3,565 Views
21 Pages

10 March 2023

In an unmanned aerial vehicles ad hoc network (UANET), UAVs communicate with each other to accomplish intricate tasks collaboratively and cooperatively. However, the high mobility of UAVs, the variable link quality, and heavy traffic loads can lead t...

(This article belongs to the Section Sensor Networks)
  • Article
  • Open Access
13 Citations
6,054 Views
28 Pages

Stock market prediction is a subject of great interest within the finance industry and beyond. In this context, our research investigates the use of reinforcement learning through implementing the double deep Q-network (DDQN) alongside technical indi...

(This article belongs to the Special Issue Machine Learning Advances and Applications on Natural Language Processing (NLP))

of 25