Skip to Content
You are currently on the new version of our website. Access the old version .
Applied SciencesApplied Sciences
  • Article
  • Open Access

31 March 2025

15 Pages

Balancing Depth for Robustness: A Study on Reincarnating Reinforcement Learning Models

,
,
,
,
,
,
and
School of Control and Computer Engineering, North China Electric Power University, Beijing 102206, China
*
Author to whom correspondence should be addressed.

Abstract

This paper investigates the impact of adaptive network depth selection on the robustness and performance of Regenerative Reinforcement Learning (RRL) models. RRL accelerates learning by reusing previously computed results. We propose a task-driven approach to dynamically configure network depth to explore the best architecture on Atari 2600 games. The experimental results show that a seven-layer network achieves the best balance between feature extraction, policy learning, and robustness, achieving an IQM score of 1.2 in a pool of 10 games. While deeper networks risk overfitting, shallower architectures struggle to cope with complex task dynamics. Our results highlight the key role of adaptive depth in enhancing the generalization, stability, and efficiency of RRL models.

Article Metrics

Citations

Article Access Statistics

Multiple requests from the same IP address are counted as one view.