Skip to Content

36 Results Found

  • Article
  • Open Access
15 Citations
4,930 Views
18 Pages

9 January 2024

This study provides simulation and experimental results on techniques for avoiding static and dynamic obstacles using a deep Q-learning (DQL) reinforcement learning algorithm for a two-wheel mobile robot with independent control. This method integrat...

(This article belongs to the Section Actuators for Robotics)
  • Article
  • Open Access
26 Citations
5,866 Views
15 Pages

Impact of Halogen Substituents on Interactions between 2-Phenyl-2,3-dihydroqulinazolin-4(1H)-one Derivatives and Human Serum Albumin

  • Feng Liu,
  • Yi Wang,
  • Cong Lv,
  • Lei Wang and ,
  • Junjun Ou,
  • Min Wang and
  • Shangzhong Liu
  • + 2 authors+ 0 author

17 February 2012

A novel type of 2-(un)substituted phenyl-2,3-dihydroquinazolin-4(1H)-one (DQL) derivatives were designed and synthesized to study the impact of halogen substituents on interactions between DQL and human serum albumin (HSA) by comparison methodology....

  • Article
  • Open Access
23 Citations
4,270 Views
20 Pages

Deep Q-Learning-Based Transmission Power Control of a High Altitude Platform Station with Spectrum Sharing

  • Seongjun Jo,
  • Wooyeol Yang,
  • Haing Kun Choi,
  • Eonsu Noh and ,
  • Han-Shin Jo and
  • Jaedon Park
  • + 1 author+ 0 author

19 February 2022

A High Altitude Platform Station (HAPS) can facilitate high-speed data communication over wide areas using high-power line-of-sight communication; however, it can significantly interfere with existing systems. Given spectrum sharing with existing sys...

(This article belongs to the Special Issue Unmanned Aerial Vehicle (UAV)-Enabled Wireless Communications and Networking)
  • Article
  • Open Access
4 Citations
2,763 Views
19 Pages

14 May 2023

Path planning in complex environments remains a challenging task for unmanned vehicles. In this paper, we propose a decoupled path-planning algorithm with the help of a deep reinforcement learning algorithm that separates the evaluation of paths from...

(This article belongs to the Special Issue Adaptive Dynamic Programming and Control Application in Intelligent Systems)
  • Feature Paper
  • Article
  • Open Access
7 Citations
5,450 Views
35 Pages

22 April 2025

In this study, we deploy drones as dynamic base stations to address the issue of optimizing user coverage in areas without fixed base station infrastructure. To optimize drone placement, we employ Deep Q-Learning, beginning with a centralized approac...

(This article belongs to the Special Issue UAV-Assisted Mobile Wireless Networks and Applications)
  • Article
  • Open Access
2 Citations
2,458 Views
23 Pages

A Hybrid Direct Search and Model-Based Derivative-Free Optimization Method with Dynamic Decision Processing and Application in Solid-Tank Design

  • Zhongda Huang,
  • Andy Ogilvy,
  • Steve Collins,
  • Warren Hare and ,
  • Michelle Hilts and
  • Andrew Jirasek
  • + 1 author+ 0 author

7 February 2023

A derivative-free optimization (DFO) method is an optimization method that does not make use of derivative information in order to find the optimal solution. It is advantageous for solving real-world problems in which the only information available a...

(This article belongs to the Special Issue Algorithms for Biomedical Image Analysis and Processing)
  • Article
  • Open Access
37 Citations
5,606 Views
18 Pages

1 May 2019

The operation of a wastewater treatment plant (WWTP) is a typical complex control problem, with nonlinear dynamics and coupling effects among the variables, which renders the implementation of real-time optimal control an enormous challenge. In this...

(This article belongs to the Special Issue Advances in Water and Wastewater Monitoring and Treatment Technology)
  • Article
  • Open Access
4 Citations
2,627 Views
33 Pages

Comparative Study of Neuroevolution and Deep Reinforcement Learning for Voltage Regulation in Power Systems

  • Adrián Alarcón Becerra,
  • Vinícius Albernaz Lacerda,
  • Roberto Rocca,
  • Ana Patricia Talayero Navales and
  • Andrés Llombart Estopiñán

24 November 2025

The regulation of voltage in transmission networks is becoming increasingly complex due to the dynamic behavior of modern power systems and the growing penetration of renewable generation. This study presents a comparative analysis of three artificia...

(This article belongs to the Section Inventions and Innovation in Electrical Engineering/Energy/Communications)
  • Article
  • Open Access
256 Citations
19,422 Views
19 Pages

Deep Q-Learning Based Reinforcement Learning Approach for Network Intrusion Detection

  • Hooman Alavizadeh,
  • Hootan Alavizadeh and
  • Julian Jang-Jaccard

The rise of the new generation of cyber threats demands more sophisticated and intelligent cyber defense solutions equipped with autonomous agents capable of learning to make decisions without the knowledge of human experts. Several reinforcement lea...

  • Article
  • Open Access
27 Citations
7,733 Views
19 Pages

24 February 2023

This paper considers a downlink resource-allocation problem in distributed interference orthogonal frequency-division multiple access (OFDMA) systems under maximal power constraints. As the upcoming fifth-generation (5G) wireless networks are increas...

(This article belongs to the Special Issue Information Theory in Emerging Wireless Communication Systems and Networks)
  • Article
  • Open Access
9 Citations
1,711 Views
25 Pages

7 October 2025

A hybrid control architecture is proposed for enhancing the stability and energy management of DC microgrids (DCMGs) integrating photovoltaic generation, batteries, and supercapacitors. The approach combines nonlinear Sliding Mode Control (SMC) for f...

(This article belongs to the Section E2: Control Theory and Mechanics)
  • Review
  • Open Access
14 Citations
4,470 Views
21 Pages

Comparative Analysis of Indoor Air Quality and Thermal Comfort Standards in School Buildings across New Zealand with Other OECD Countries

  • Vineet Kumar Arya,
  • Eziaku Onyeizu Rasheed,
  • Don Amila Sajeevan Samarasinghe and
  • Suzanne Wilkinson

COVID-19 has improved awareness of the importance of appropriate indoor air quality (IAQ) in indoor spaces, particularly in classrooms where children are expected to learn. Research has shown that poor IAQ and temperature levels affect the cognitive...

(This article belongs to the Special Issue Indoor Air Quality in Buildings)
  • Article
  • Open Access
15 Citations
4,196 Views
18 Pages

19 June 2022

Including redundancy is popular and widely used in a fault-tolerant method for memories. Effective fault-tolerant methods are a demand of today’s large-size memories. Recently, system-on-chips (SOCs) have been developed in nanotechnology, with...

(This article belongs to the Section E: Engineering and Technology)
  • Article
  • Open Access
19 Citations
3,635 Views
19 Pages

26 March 2024

The service life and fuel consumption of fuel cell system (FCS) are the main factors limiting the commercialization of fuel cell electric vehicles (FCEV). Effective energy management strategies (EMS) can reduce fuel consumption during the cycle and p...

(This article belongs to the Section D2: Electrochem: Batteries, Fuel Cells, Capacitors)
  • Article
  • Open Access
14 Citations
5,579 Views
36 Pages

AI-Enabled Interference Mitigation for Autonomous Aerial Vehicles in Urban 5G Networks

  • Anirudh Warrier,
  • Saba Al-Rubaye,
  • Gokhan Inalhan and
  • Antonios Tsourdos

13 October 2023

Integrating autonomous unmanned aerial vehicles (UAVs) with fifth-generation (5G) networks presents a significant challenge due to network interference. UAVs’ high altitude and propagation conditions increase vulnerability to interference from...

  • Article
  • Open Access
42 Citations
6,943 Views
17 Pages

26 December 2021

Modern adaptive radars can switch work modes to perform various missions and simultaneously use pulse parameter agility in each mode to improve survivability, which leads to a multiplicative increase in the decision-making complexity and declining pe...

(This article belongs to the Special Issue Signal Processing and Machine Learning for Smart Sensing Applications)
  • Article
  • Open Access
29 Citations
6,261 Views
22 Pages

Self-Adaptive Priority Correction for Prioritized Experience Replay

  • Hongjie Zhang,
  • Cheng Qu,
  • Jindou Zhang and
  • Jing Li

2 October 2020

Deep Reinforcement Learning (DRL) is a promising approach for general artificial intelligence. However, most DRL methods suffer from the problem of data inefficiency. To alleviate this problem, DeepMind proposed Prioritized Experience Replay (PER). T...

(This article belongs to the Section Computing and Artificial Intelligence)
  • Article
  • Open Access
8 Citations
3,604 Views
21 Pages

20 January 2024

The efficiency and dynamics of hybrid electric vehicles are inherently linked to effective energy management strategies. However, complexity is heightened due to uncertainty and variations in real driving conditions. This article introduces an innova...

(This article belongs to the Special Issue Computational Intelligence-Based Modeling, Control, Estimation, and Optimization in Electrical Motor/Drive, Renewable Energy, and Power Systems, Volume II)
  • Article
  • Open Access
6 Citations
3,929 Views
25 Pages

Virtual Network Function Embedding under Nodal Outage Using Deep Q-Learning

  • Swarna Bindu Chetty,
  • Hamed Ahmadi,
  • Sachin Sharma and
  • Avishek Nag

With the emergence of various types of applications such as delay-sensitive applications, future communication networks are expected to be increasingly complex and dynamic. Network Function Virtualization (NFV) provides the necessary support towards...

(This article belongs to the Special Issue Cognitive Software Defined Networking and Network Function Virtualization and Applications)
  • Article
  • Open Access
42 Citations
6,747 Views
21 Pages

12 June 2024

This paper investigates the application of hybrid reinforcement learning (RL) models to optimize lithium-ion batteries’ charging and discharging processes in electric vehicles (EVs). By integrating two advanced RL algorithms—deep Q-learni...

(This article belongs to the Special Issue Electrochemical Conversion and Energy Storage System)
  • Article
  • Open Access
15 Citations
6,216 Views
15 Pages

Deep Q-Network (DQN) Model for Disease Prediction Using Electronic Health Records (EHRs)

  • Nabil M. AbdelAziz,
  • Gehan A. Fouad,
  • Safa Al-Saeed and
  • Amira M. Fawzy

7 February 2025

Many efforts have proved that deep learning models are effective for disease prediction using electronic health records (EHRs). However, these models are not yet precise enough to predict diseases. Additionally, ethical concerns and the use of cluste...

(This article belongs to the Section Computer Science, Mathematics and AI)
  • Article
  • Open Access
2 Citations
3,750 Views
20 Pages

Deep Q-Learning-Based Buffer-Aided Relay Selection for Reliable and Secure Communications in Two-Hop Wireless Relay Networks

  • Cheng Zhang,
  • Xuening Liao,
  • Zhenqiang Wu,
  • Guoyong Qiu and ,
  • Zitong Chen and
  • Zhiliang Yu
  • + 1 author+ 0 author

17 May 2023

This paper investigates the problem of buffer-aided relay selection to achieve reliable and secure communications in a two-hop amplify-and-forward (AF) network with an eavesdropper. Due to the fading of wireless signals and the broadcast nature of wi...

(This article belongs to the Special Issue Cognitive Radio Networks: Technologies, Challenges and Applications)
  • Article
  • Open Access
2 Citations
1,851 Views
19 Pages

Asynchronously H∞ Tracking Control and Optimization for Switched Flight Vehicles with Time-Varying Delay

  • Xing Yang,
  • Bin Fu,
  • Xiaochuan Ma,
  • Yu Liu and ,
  • Dongyu Yuan and
  • Xintong Wu
  • + 1 author+ 0 author

24 January 2024

The current paper verifies the asynchronous H∞ control and optimization problem for flight vehicles with a time-varying delay. The nonlinear dynamic model and Jacobian linearization establish the flight vehicle’s switched model. An asynch...

  • Article
  • Open Access
444 Views
29 Pages

5 August 2026

This paper addresses the voltage regulation problem for DC microgrids modeled as nonlinear dynamical systems subject to parametric uncertainties and external disturbances. A data-driven predictive hybrid control scheme is developed, combining a nonli...

(This article belongs to the Special Issue AI-Based and Data-Driven Modeling and Control: Mathematical Methods and Industrial Applications)
  • Article
  • Open Access
21 Citations
4,367 Views
24 Pages

Deep Reinforcement Learning for Workload Prediction in Federated Cloud Environments

  • Zaakki Ahamed,
  • Maher Khemakhem,
  • Fathy Eassa,
  • Fawaz Alsolami and ,
  • Abdullah Basuhail and
  • Kamal Jambi
  • + 1 author+ 0 author

3 August 2023

The Federated Cloud Computing (FCC) paradigm provides scalability advantages to Cloud Service Providers (CSP) in preserving their Service Level Agreement (SLA) as opposed to single Data Centers (DC). However, existing research has primarily focused o...

(This article belongs to the Section Communications)
  • Article
  • Open Access
12 Citations
3,807 Views
19 Pages

30 December 2021

Unmanned Aerial Vehicle (UAV)-assisted cellular networks over the millimeter-wave (mmWave) frequency band can meet the requirements of a high data rate and flexible coverage in next-generation communication networks. However, higher propagation loss...

(This article belongs to the Special Issue UAV Control and Communications in 5G and beyond Networks)
  • Article
  • Open Access
2 Citations
1,922 Views
26 Pages

Recent work on decentralized computational trust models for open multi-agent systems has resulted in the development of CA, a biologically inspired model which focuses on the trustee’s perspective. This new model addresses a serious unresolved...

(This article belongs to the Collection Extravaganza Feature Papers on Hot Topics in Machine Learning and Knowledge Extraction)
  • Article
  • Open Access
7 Citations
3,255 Views
18 Pages

Ultra-Reliable Deep-Reinforcement-Learning-Based Intelligent Downlink Scheduling for 5G New Radio-Vehicle to Infrastructure Scenarios

  • Jizhe Wang,
  • Yuanbing Zheng,
  • Jian Wang,
  • Zhenghua Shen and ,
  • Lei Tong,
  • Yahao Jing,
  • Yu Luo and
  • Yong Liao
  • + 3 authors+ 0 author

13 October 2023

Higher standards for reliability and efficiency apply to the connection between vehicle terminals and infrastructure by the fifth-generation mobile communication technology (5G). A vehicle-to-infrastructure system uses a communication system called N...

(This article belongs to the Special Issue Vehicle-to-Everything (V2X) Communication for Intelligent Transportation)
  • Article
  • Open Access
14 Citations
9,990 Views
25 Pages

27 November 2018

Historically, the focus of industrial health and safety (H&S) has been on safety and accident avoidance with relatively less attention to long-term occupational health other than via health monitoring and surveillance. The difficulty is the multi...

  • Article
  • Open Access
22 Citations
5,832 Views
39 Pages

3 December 2024

This study assesses the application of artificial intelligence (AI) algorithms for optimizing resource allocation, demand-supply matching, and dynamic pricing within circular economy (CE) digital marketplaces. Five AI models—autoregressive inte...

(This article belongs to the Section Economic and Business Aspects of Sustainability)
  • Article
  • Open Access
264 Views
42 Pages

16 October 2026

This paper presents a hierarchical safe control approach for DC microgrids, combining learning-based energy management with rigorous constraint enforcement. The main novelty is a covariance-aware coupling mechanism that simultaneously informs CBF con...

(This article belongs to the Special Issue Advanced Control Systems and Engineering Cybernetics)
  • Article
  • Open Access
37 Citations
4,240 Views
27 Pages

Authentication and Resource Allocation Strategies during Handoff for 5G IoVs Using Deep Learning

  • Hemavathi,
  • Sreenatha Reddy Akhila,
  • Youseef Alotaibi,
  • Osamah Ibrahim Khalaf and
  • Saleh Alghamdi

9 March 2022

One of the most sought-after applications of cellular technology is transforming a vehicle into a device that can connect with the outside world, similar to smartphones. This connectivity is changing the automotive world. With the speedy growth and d...

  • Article
  • Open Access
480 Views
38 Pages

A Five-Step MCDM Framework for AR Use Case Selection in Railway Maintenance

  • Tayyarat Oumaima,
  • Abdeslam Ahmadi,
  • Sedki Mohamed and
  • Hicham El Kimi

4 July 2026

Despite the growing adoption of Augmented Reality (AR) in industrial maintenance, no structured methodology exists to systematically identify which operations are best suited for effective AR deployment. This study addresses this gap by proposing a f...

(This article belongs to the Section Applied Industrial Technologies)
  • Article
  • Open Access
8 Citations
1,533 Views
18 Pages

23 July 2025

Efficient and intelligent spectrum access is crucial for meeting the diverse Quality of Service (QoS) demands of Vehicular Internet of Things (V-IoT) systems in next-generation cellular networks. This work proposes a novel reinforcement learning (RL)...

(This article belongs to the Section Internet of Things)
  • Article
  • Open Access
1 Citations
2,171 Views
34 Pages

10 June 2025

Indoor environmental quality profoundly impacts student learning outcomes and teacher effectiveness, particularly in primary education, where children spend most of their developmental years. The study compares the New Zealand Ministry of Education&r...

(This article belongs to the Special Issue Advances in Green Building Systems)
  • Article
  • Open Access
8 Citations
3,994 Views
25 Pages

Scaling Swarm Coordination with GNNs—How Far Can We Go?

  • Gianluca Aguzzi,
  • Davide Domini,
  • Filippo Venturini and
  • Mirko Viroli

1 November 2025

The scalability of coordination policies is a critical challenge in swarm robotics, where agent numbers may vary substantially between deployment scenarios. Reinforcement learning (RL) offers a promising avenue for learning decentralized policies fro...

(This article belongs to the Section AI in Autonomous Systems)