Skip to Content

26 Results Found

  • Article
  • Open Access

20 November 2026

The construction industry has a higher accident rate than other industries and a shrinking inflow of new workers, and obstacle avoidance is a core task for autonomous construction equipment. Many earlier studies treated every obstacle as a single cat...

(This article belongs to the Special Issue AI-Driven BIM and Construction Management)
  • Article
  • Open Access
708 Views
39 Pages

9 April 2026

Reducing traction energy in urban rail systems while preserving safety, punctuality, and passenger comfort remains challenging. Additionally, route-level tram studies that train deep reinforcement learning (DRL) policies using Operational Train Monit...

  • Article
  • Open Access
4 Citations
2,325 Views
20 Pages

Guidance commands of flight vehicles can be regarded as a series of data sets having fixed time intervals; thus, guidance design constitutes a typical sequential decision problem and satisfies the basic conditions for using the deep reinforcement lea...

  • Article
  • Open Access
319 Views
29 Pages

25 October 2026

Deep reinforcement learning (DRL) controllers for heating, ventilation and air conditioning (HVAC) are rarely deployed on real edge hardware or evaluated across climates, and published DRL-HVAC studies seldom report a physical deployment. The contrib...

(This article belongs to the Section G: Energy and Buildings)
  • Article
  • Open Access
3 Citations
3,303 Views
15 Pages

Incremental Reinforcement Learning for Portfolio Optimisation

  • Refiloe Shabe,
  • Andries Engelbrecht and
  • Kian Anderson

Portfolio optimisation is a crucial decision-making task. Traditionally static, this problem is more realistically addressed as dynamic, reflecting frequent trading within financial markets. The dynamic nature of the portfolio optimisation problem ma...

(This article belongs to the Special Issue Deep Learning and Explainable Artificial Intelligence)
  • Article
  • Open Access
1 Citations
1,734 Views
37 Pages

30 March 2026

To enhance the navigation efficiency and obstacle avoidance capability of omnidirectional mobile robots in unstructured and complex environments, this paper conducts research on intelligent path planning and management for X-type Mecanum-wheeled mobi...

(This article belongs to the Section Robotics, Mechatronics and Intelligent Machines)
  • Article
  • Open Access
386 Views
19 Pages

Reinforcement Learning-Based Tension Control for Marine Winches Under JONSWAP Irregular Wave Disturbances

  • Doru Cosmin Munteniță,
  • Adrian Filipescu,
  • Răzvan Șolea and
  • Adrian Șerbencu

17 October 2026

Active tension control in marine cable winch systems is challenged by vessel heave motion under irregular wave excitation, which generates dynamic disturbances that fixed-gain proportional-integral (PI) controllers cannot fully compensate. This study...

(This article belongs to the Special Issue Advanced Modeling and Intelligent Control of Marine Vehicles)
  • Article
  • Open Access
221 Views
27 Pages

1 October 2026

Autonomous agents in adversarial environments must allocate sensing resources, deploy spatial assets, and control combat actions under partial observability. We formulate this coupling as a three-phase partially observable decision process with heter...

(This article belongs to the Section Artificial Intelligence)
  • Article
  • Open Access
9 Citations
3,369 Views
22 Pages

5 November 2024

As the decarbonization strategies of automated container terminals (ACTs) continue to advance, electrically powered Battery-Automated Guided Vehicles (B-AGVs) are being widely adopted in ACTs. The U-shaped ACT, as a novel layout, faces higher AGV ene...

(This article belongs to the Special Issue Application of System Engineering and Complex Theory in Transportation)
  • Article
  • Open Access
22 Citations
6,574 Views
20 Pages

30 May 2024

Landing a multi-rotor uncrewed aerial vehicle (UAV) on a moving target in the presence of partial observability, due to factors such as sensor failure or noise, represents an outstanding challenge that requires integrative techniques in robotics and...

  • Article
  • Open Access
215 Views
27 Pages

1 October 2026

To address slow dynamic-reconfiguration response and difficulty in satisfying hard constraints in the task scheduling of heterogeneous maritime unmanned platforms, this paper proposes a constraint-aware proximal policy optimization (CPPO). CPPO model...

(This article belongs to the Section Ocean Engineering)
  • Article
  • Open Access
2 Citations
925 Views
18 Pages

This study presents a novel data-driven framework for developing airport-specific landing policies and procedures from historical successful-landing data. The proposed process, termed the Airport-Dependent Landing Procedure (ADLP), is motivated by th...

(This article belongs to the Section Data)
  • Article
  • Open Access
19 Citations
4,152 Views
22 Pages

The study presents an optimized Unmanned Surface Vehicle (USV) collision avoidance decision-making strategy in restricted waters based on the improved Proximal Policy Optimization (PPO) algorithm. This approach effectively integrates the ship domain,...

(This article belongs to the Section Ocean Engineering)
  • Article
  • Open Access
1,275 Views
28 Pages

3 July 2026

Autonomous obstacle avoidance for UAVs in dynamic obstacle-dominated complex environments must address time-varying local collision risks from multiple directions under the constraints imposed by local sensing, environmental uncertainty, execution sa...

(This article belongs to the Topic Advanced Methods in Unmanned Aerial Vehicle Control, Navigation, and Safety)
  • Article
  • Open Access
3 Citations
1,332 Views
19 Pages

Prediction of Dissolved Gases in Transformer Oil Based on CEEMDAN-PWOA-VMD and BiGRU

  • Xinsong Peng,
  • Hongying He,
  • Haiwen Chen,
  • Jiahan Liu and
  • Shoudao Huang

Aiming at improving the prediction accuracy of the gas dissolved in transformer oil which occurs with strong nonlinearity, this paper presents a method named CEEMDAN-PWOA-VMD-BIGRU for gas content prediction. First, Complete Ensemble Empirical Mode D...

(This article belongs to the Special Issue Advanced Power Electronics and Sustainable Energy Systems: Recent Developments, Challenges and Future Perspectives)
  • Article
  • Open Access
139 Views
30 Pages

19 October 2026

A UAV inspecting a live 750 kV corridor needs a LoRa uplink in which towers repeatedly cross the line of sight. The LoRaWAN adaptive data rate (ADR) infers each decision from recently decoded frames, so a sustained obstruction starves its evidence wi...

(This article belongs to the Section Artificial Intelligence)
  • Article
  • Open Access
26 Citations
7,998 Views
37 Pages

LSTM-Enhanced Deep Reinforcement Learning for Robust Trajectory Tracking Control of Skid-Steer Mobile Robots Under Terra-Mechanical Constraints

  • Jose Manuel Alcayaga,
  • Oswaldo Anibal Menéndez,
  • Miguel Attilio Torres-Torriti,
  • Juan Pablo Vásconez and ,
  • Tito Arévalo-Ramirez and
  • Alvaro Javier Prado Romo
  • + 1 author+ 0 author

Autonomous navigation in mining environments is challenged by complex wheel–terrain interaction, traction losses caused by slip dynamics, and sensor limitations. This paper investigates the effectiveness of Deep Reinforcement Learning (DRL) tec...

(This article belongs to the Section Intelligent Robots and Mechatronics)
  • Article
  • Open Access
4 Citations
1,645 Views
26 Pages

To address the path planning challenges for land–air amphibious biomimetic robots in unstructured environments, this study proposes a global path planning algorithm based on an Improved Proximal Policy Optimization (IPPO) framework. Unlike trad...

(This article belongs to the Special Issue Theory and Application of Bioinspired Robotics and Intelligent Control)
  • Article
  • Open Access
147 Views
37 Pages

We introduce PhASE-RTAQC, a phase-aware multi-scale encoding framework for risk-aware twin-actor quadcopter control with Proximal Policy Optimization (PPO). A Gated Recurrent Unit (GRU) summarizes recent state history to infer a bounded continuous co...

  • Article
  • Open Access
5 Citations
2,491 Views
22 Pages

Deep Reinforcement Learning-Based Guidance Law for Intercepting Low–Slow–Small UAVs

  • Peisen Zhu,
  • Wanying Xu,
  • Yongbin Zheng,
  • Peng Sun and
  • Zeyu Li

30 October 2025

Low, small, and slow (LSS) unmanned aerial vehicles (UAVs) pose great challenges for conventional guidance methods. However, existing deep reinforcement learning (DRL)-based interception guidance law has mostly focused on simplified two-dimensional p...

(This article belongs to the Section Aeronautics)
  • Article
  • Open Access
67 Citations
6,989 Views
19 Pages

10 April 2021

The proliferation of distributed renewable energy resources (RESs) poses major challenges to the operation of microgrids due to uncertainty. Traditional online scheduling approaches relying on accurate forecasts become difficult to implement due to t...

  • Article
  • Open Access
6 Citations
2,691 Views
23 Pages

22 June 2023

As the construction of supporting infrastructure for electric vehicles (EV) becomes more and more perfect, an energy replenishment station (ERS) involving photovoltaics (PV) that can provide charging and battery swapping services for electric vehicle...

(This article belongs to the Topic Emerging Trends in Electric Vehicles, Smart Grids and Smart Cities)
  • Article
  • Open Access
1 Citations
1,334 Views
28 Pages

21 October 2025

We propose State-DynAttn, a hybrid architecture for robust air traffic flow prediction under weather disruptions, which integrates state-space models (SSMs) with dynamic graph attention to address the challenges of long-range dependency modeling and...

(This article belongs to the Special Issue Optimization and Machine Learning-Based Methods in Air Traffic Management and Aeronautical Domains)
  • Article
  • Open Access
6 Citations
1,859 Views
22 Pages

3 December 2025

Driven by the global energy transition and carbon-neutrality goals, virtual power plants (VPPs) are expected to aggregate distributed energy resources and participate in multiple electricity markets while achieving economic efficiency and low carbon...

(This article belongs to the Section F5: Artificial Intelligence and Smart Energy)
  • Case Report
  • Open Access
119 Views
9 Pages

11 November 2026

Background and Clinical Significance: Endometriosis is a chronic, estrogen-dependent inflammatory condition that can cause pain, infertility, and, in its deep infiltrating form, bowel involvement. Dienogest is a progestin that is commonly used for th...

(This article belongs to the Section Obstetrics/Gynaecology)
  • Article
  • Open Access
1 Citations
909 Views
51 Pages

E’CHIT: Identity-Stable Operator-Centric UAV Tracking for Disaster Response

  • Aykut Sirma,
  • Angelos Plastropoulos,
  • Gilbert Tang and
  • Argyrios Zolotas

20 August 2026

Search-and-rescue (SAR) missions following earthquakes and other disasters require aerial video perception systems that do more than detect objects in isolated frames. Operators must maintain the identities of access points, vehicles, responders, haz...

(This article belongs to the Topic Advanced Technologies and Applications for Unmanned Systems)