Skip to Content

25 Results Found

  • Article
  • Open Access
625 Views
30 Pages

Class-incremental learning allows a model to continuously acquire new classes from sequentially arriving data while preserving its ability to recognize previously learned ones, which is essential for improving adaptability and supporting long-term ev...

  • Article
  • Open Access
507 Views
24 Pages

Real-time semantic segmentation models offer an excellent balance between accuracy and inference speed. However, deploying these models in dynamic real-world environments often requires the ability to learn novel classes incrementally without retrain...

(This article belongs to the Special Issue Cyber-Physical Systems: Recent Developments and Emerging Trends)
  • Article
  • Open Access
360 Views
21 Pages

15 June 2026

In class-incremental learning (CIL), a model must learn new classes while retaining previous knowledge without storing all historical data. Generative replay mitigates catastrophic forgetting by synthesizing old class samples, but conventional pipeli...

(This article belongs to the Section Computing and Artificial Intelligence)
  • Article
  • Open Access
265 Views
13 Pages

Validation-Selected Constrained Incremental Learning for Simulation-Based UAV Subsystem Fault Prediction

  • Guang Rong,
  • Di Wu,
  • Chao Tang,
  • Ye Huang and ,
  • Xiangyu Meng,
  • Jian Wang and
  • Jianyuan Wang
  • + 2 authors+ 0 author

28 August 2026

Fixed offline prognostic models can lose accuracy when sensor-data distribution changes after model development. This paper presents a validation-selected incremental-learning framework for time-before-failure (TBF) regression in three simulated unma...

(This article belongs to the Special Issue Application of Multidisciplinary Optimization and Artificial Intelligence Techniques to Aerospace Engineering (Volume III))
  • Article
  • Open Access
271 Views
35 Pages

6 October 2026

Continual learning of large language models requires incorporating new knowledge while limiting catastrophic forgetting; however, many low-rank adaptation (LoRA)-based methods retain task-specific modules or separate learning spaces that grow with th...

(This article belongs to the Special Issue Computational Intelligence and Big Data Analytics)
  • Article
  • Open Access
19 Citations
4,422 Views
15 Pages

Dynamic Target Tracking of Autonomous Underwater Vehicle Based on Deep Reinforcement Learning

  • Jiaxiang Shi,
  • Jianer Fang,
  • Qizhong Zhang,
  • Qiuxuan Wu and ,
  • Botao Zhang and
  • Farong Gao
  • + 1 author+ 0 author

1 October 2022

Due to the unknown motion model and the complexity of the environment, the problem of target tracking for autonomous underwater vehicles (AUVs) became one of the major difficulties in model-based controllers. Therefore, the target tracking task of AU...

(This article belongs to the Special Issue Autonomous Underwater Vehicle Technology Advances in Ocean Observation)
  • Article
  • Open Access
4 Citations
3,040 Views
18 Pages

26 January 2021

Autonomous learning of robotic skills seems to be more natural and more practical than engineered skills, analogous to the learning process of human individuals. Policy gradient methods are a type of reinforcement learning technique which have great...

(This article belongs to the Section Robotics and Automation)
  • Article
  • Open Access
682 Views
32 Pages

Background: Continual learning (CL) is increasingly important for developing adaptive clinical AI models; however, its application to histopathology remains challenging due to privacy constraints, expanding diagnostic categories, and staining variabi...

(This article belongs to the Section Machine Learning and Artificial Intelligence in Diagnostics)
  • Article
  • Open Access
2 Citations
1,061 Views
22 Pages

6 March 2026

A novel model-free hierarchical reinforcement learning (HRL)–based Linear Quadratic Regulator (LQR) control framework with adaptive weight selection is proposed to address the reliance of conventional LQR methods on accurate system models and m...

(This article belongs to the Special Issue Dynamic Modeling and Simulation for Control Systems, 3rd Edition)
  • Article
  • Open Access
153 Views
34 Pages

Learning Persistent Referential Identity for Two-Hop Retrieval in Event-Stream Models

  • Nurgali Kadyrbek,
  • Madina Mansurova,
  • Zhuldyz Talasbayeva and
  • Zhadyra Zhumasheva

We learn compatible destination and owner views in bounded, transcript-free records. Structural source/type/version addressing selects the first relation; authoritative, requested-attribute filtering reduces ordinary candidates to a mean of 3.28. Lea...

(This article belongs to the Special Issue Knowledge Discovery and Extraction with Large Language Models, Retrieval-Augmented Generation, and Autonomous Agents: Methods, Architectures, and Applications)
  • Article
  • Open Access
6 Citations
3,359 Views
18 Pages

15 November 2024

Path planning for robots based on reinforcement learning encounters challenges in integrating semantic information about environments into the training process. In unseen or complex environmental information, agents often perform sub-optimally and re...

(This article belongs to the Section Actuators for Surface Vehicles)
  • Article
  • Open Access
2 Citations
1,402 Views
18 Pages

1 August 2025

Piano fingering estimation remains a complex problem due to the combinatorial nature of hand movements and no best solution for any situation. A recent model-free reinforcement learning framework for piano fingering modeled each monophonic piece as a...

(This article belongs to the Special Issue New Advances in Data Analytics and Mining)
  • Article
  • Open Access
16 Citations
4,651 Views
17 Pages

Aero-Engine Modeling and Control Method with Model-Based Deep Reinforcement Learning

  • Wenbo Gao,
  • Muxuan Pan,
  • Wenxiang Zhou,
  • Feng Lu and
  • Jin-Quan Huang

23 February 2023

Due to the strong representation ability and capability of learning from data measurements, deep reinforcement learning has emerged as a powerful control method, especially for nonlinear systems, such as the aero-engine control system. In this paper,...

(This article belongs to the Special Issue Machine Learning for Aeronautics)
  • Article
  • Open Access
27 Citations
6,914 Views
26 Pages

12 September 2022

Continual learning (CL), also known as lifelong learning, is an emerging research topic that has been attracting increasing interest in the field of machine learning. With human activity recognition (HAR) playing a key role in enabling numerous real-...

(This article belongs to the Section Wearables)
  • Article
  • Open Access
22 Citations
5,558 Views
16 Pages

Research on Multi-Robot Formation Control Based on MATD3 Algorithm

  • Conghang Zhou,
  • Jianxing Li,
  • Yujing Shi and
  • Zhirui Lin

31 January 2023

This paper investigates the problem of multi-robot formation control strategies in environments with obstacles based on deep reinforcement learning methods. To solve the problem of value function overestimation in the deep deterministic policy gradie...

  • Article
  • Open Access
1,023 Views
18 Pages

24 September 2025

Deep learning (DL)-based multi-user physical layer authentication (PLA) in the Industrial Internet of Things (IIoT) requires frequent updates as new users join. Class incremental learning (CIL) addresses this challenge, but existing generative replay...

(This article belongs to the Section Internet of Things)
  • Article
  • Open Access
1 Citations
2,173 Views
21 Pages

1 October 2025

Atmospheric turbulence severely limits the stability and reliability of free-space optical (FSO) uplinks by inducing wavefront distortions and random intensity fluctuations. This study investigates the use of reinforcement learning (RL) with beacon-b...

(This article belongs to the Special Issue Innovations in Optical Wireless Communications: Challenges and Opportunities)
  • Article
  • Open Access
23 Citations
3,488 Views
21 Pages

A Novel Path Planning Approach for Mobile Robot in Radioactive Environment Based on Improved Deep Q Network Algorithm

  • Zhiqiang Wu,
  • Yebo Yin,
  • Jie Liu,
  • De Zhang and ,
  • Jie Chen and
  • Wei Jiang
  • + 1 author+ 0 author

11 November 2023

The path planning problem of nuclear environment robots refers to finding a collision-free path under the constraints of path length and an accumulated radiation dose. To solve this problem, the Improved Dueling Deep Double Q Network algorithm (ID3QN...

  • Article
  • Open Access
423 Views
17 Pages

18 August 2026

Class-incremental three-dimensional point cloud semantic segmentation requires models to learn newly introduced categories while preserving previously acquired knowledge without storing historical point clouds. This setting is challenged by represent...

(This article belongs to the Section Computing and Artificial Intelligence)
  • Article
  • Open Access
12 Citations
3,725 Views
19 Pages

6 January 2021

In the proton exchange membrane fuel cell (PEMFC) system, the flow of air and hydrogen is the main factor influencing the output characteristics of PEMFC, and there is a coordination problem between their flow controls. Thus, the integrated controlle...

(This article belongs to the Section Intelligent Sensors)
  • Article
  • Open Access
6 Citations
2,794 Views
22 Pages

This paper addresses the challenge of offloading resource-intensive image segmentation tasks and allocating computing resources within the Internet of Vehicles (IoV) using edge-based AI. To overcome the limitations of onboard computing in smart vehic...

(This article belongs to the Special Issue Internet of Vehicles for Intelligent Transportation System: Current Trends and Future Perspectives)
  • Article
  • Open Access
5 Citations
5,236 Views
22 Pages

29 April 2024

In the rapidly evolving landscape of cybersecurity, model extraction attacks pose a significant challenge, undermining the integrity of machine learning models by enabling adversaries to replicate proprietary algorithms without direct access. This pa...

(This article belongs to the Section Computing and Artificial Intelligence)
  • Feature Paper
  • Article
  • Open Access
5 Citations
3,377 Views
22 Pages

18 April 2021

Ancillary services rely on operating reserves to support an uninterrupted electricity supply that meets demand. One of the hidden reserves of the grid is in thermostatically controlled loads. To efficiently exploit these reserves, a new realization o...

(This article belongs to the Special Issue Demand Response Optimization Techniques for Smart Power Grids)
  • Article
  • Open Access
587 Views
37 Pages

1 August 2026

Cooperative multi-agent reinforcement learning (MARL) is hard when rewards are sparse. This is an evaluation study built around a negative result. We study CHARM (Cooperative Hindsight-Augmented Role-conditioned Memory), a four-part memory layer that...

(This article belongs to the Section Computing and Artificial Intelligence)
  • Article
  • Open Access
2 Citations
1,284 Views
33 Pages

21 May 2026

Cooperative multi-UAV path planning under dynamic and adversarial conditions demands simultaneous satisfaction of safety, efficiency, and coordination constraints, yet existing swarm-intelligence and RL–swarm hybrids rely on deterministic switc...