Next Article in Journal
Voltage Collapse and Early Failure Indicators in a Degraded EV Battery Under High-Current Load
Next Article in Special Issue
Credit Card Fraud Detection Under Extreme Class Imbalance Using Leakage-Safe Feature Selection and GA-Based Hyperparameter Optimization
Previous Article in Journal
Dynamic Analysis of High-Speed Elevator Braking Incorporating Time-Varying Slip and Multi-Mode Operational Transitions
Previous Article in Special Issue
Effects of AI-Assisted Physical Exercise on the Health of Elderly Women: A Randomized Controlled Trial Based on Smart Devices and Personalized Exercise Guidance
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Study on the Vulnerability of Multilayer Subway Networks Based on the SPM and DQN

by
Chen Yang
,
Lei Zhang
*,†,
Liang You
,
Wenjie Tian
,
Chuhan Ma
and
Bowu Wei
Equipment Management and Unmanned Aerial Vehicle Engineering School, Air Force Engineering University, Xi’an 710051, China
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
Appl. Sci. 2026, 16(9), 4259; https://doi.org/10.3390/app16094259
Submission received: 13 March 2026 / Revised: 21 April 2026 / Accepted: 23 April 2026 / Published: 27 April 2026

Abstract

To address the escalating vulnerability of metro systems under multiple perturbations—including extreme rainfall, equipment failures, and passenger surges—this study tackles several limitations in existing research: the predominant focus on single-layer topology, the neglect of cross-layer coupling effects between physical facilities and functional systems, the lack of dynamic global information in critical node identification, and the insufficient consideration of network clustering characteristics in cascading failure analysis. Drawing on complex systems theory, this study constructs a physical–functional bilayer coupled network model, proposes three improved Deep Q-Network algorithms for identifying cross-layer critical nodes, and introduces a cluster-augmented sandpile model to simulate the differentiated propagation of cascading failures. An empirical case study of the Zhengzhou Metro network demonstrates that the constructed bilayer network exhibits scale-free properties, that the improved DQN algorithms significantly outperform classical benchmarks—including degree centrality, betweenness centrality, closeness centrality, and the greedy algorithm—in sequential disruption efficiency, and that the safety tolerance coefficient and limit coefficient exert substantial regulatory effects on network vulnerability. The methodological framework developed herein—integrating bilayer coupled modeling, deep reinforcement learning-based critical node identification, and cluster-augmented sandpile cascading failure analysis—provides a transferable technical pathway for vulnerability assessment of multilayer coupled networks, with its applicability validated through the Zhengzhou case.

1. Introduction

As archetypal large-scale critical infrastructure, metro systems are paramount for ensuring urban public safety and enhancing the quality of life for residents. Their reliable and secure operation is therefore of utmost importance. In recent years, these networks have been increasingly beleaguered by a spectrum of safety incidents, including equipment malfunctions, flooding, and surges in passenger flow. Compounding these challenges are the rapid expansion of network scale, increasing topological complexity, and the inherently challenging operational environment characterized by confined spaces, high population densities, and difficult emergency evacuation. Consequently, metro networks exhibit the characteristics of multi-layer coupling [1] and mutual interdependence [2]. The core of urban metro network vulnerability analysis resides in two principal dimensions: first, node importance evaluation, which aims to precisely identify the critical nodes underpinning network functionality; and second, cascading failure analysis, which seeks to elucidate the dynamic process by which local disruptions propagate through network couplings, potentially culminating in system-wide collapse. Thus, a deep investigation into the structural properties of urban metro networks is imperative. This entails developing methods for quantifying node importance in multi-layer networks, simulating the evolutionary dynamics of cascading failures, and analyzing the key factors influencing the dynamic shifts in vulnerability. Such endeavors provide an indispensable foundation for safeguarding the normal operation of metro networks.
Current research on node importance evaluation, a cornerstone of vulnerability analysis, exhibits two predominant methodological trends. The first trend focuses on network topology. Early studies primarily concentrated on the direct connection characteristics of nodes, but the field has since evolved towards hierarchical decomposition and global structural analysis. Opsahl et al. [3] integrated edge weights into degree centrality, introducing the concept of node strength and laying the groundwork for analyzing directed, weighted networks. Yang et al. [4] proposed an improved gravity centrality method based on the k-shell algorithm, designated KSGC, for identifying influential nodes in complex networks. This method incorporates node position information, rendering it more reasonable compared to the original gravity centrality approach. Zhao et al. [5] developed a centrality measure that simultaneously considers node degree and local clustering coefficients, thereby enabling a more comprehensive assessment of local node centrality. Kai et al. [6] proposed the MKS algorithm, which integrates node self-characteristics, positional features, and local attributes, effectively addressing the coarse granularity issue inherent in the k-shell algorithm. Zhu et al. [7] incorporated topological information and node typology into an improved PageRank algorithm, fully accounting for the distinctions among generators, loads, and tie nodes, thereby substantially enhancing critical node identification accuracy in power grids. Liu et al. [8] employed the k-shell decomposition method to stratify the network into a hierarchical structure ranging from core to periphery, subsequently applying the H-index to screen nodes within each hierarchical layer. Curado et al. [9] proposed the C-RRWG method, which simultaneously integrates local, global, and dynamic node interaction information, effectively balancing intra-community importance with global network connectivity, thereby providing a more comprehensive measurement paradigm for influential node detection in complex networks. Yang et al. [10] proposed a novel node ranking method based on neighbor lines and local network structure, simultaneously considering both attribute information of neighbor lines and local structural information. Zhao et al. [11] developed the Multi-attribute CRITIC-TOPSIS Network Decision Index, MCTNDI, which integrates multiple centrality indicators and synthesizes local neighborhood importance with network topological position, thereby addressing the perspective bias inherent in single-indicator approaches. Hu et al. [12] proposed a node importance identification algorithm based on multi-order and multi-attributes of neighborhoods in complex networks, utilizing spatial position attributes and special topological structure attributes to comprehensively analyze node importance through integrated consideration of direct and indirect influences.
The second trend encompasses research conducted from the dimension of node attribute characteristics, with such studies integrating topological position and intrinsic node attributes. Liu et al. [13] combined traffic flow characteristics to propose a weighted betweenness centrality algorithm, constructing a weighted traffic network in L-space while reducing computational complexity. Lilin et al. [14] proposed a multi-attribute weighted fusion algorithm that assigns indicator weights using both the entropy weight method and analytic hierarchy process. Hajarathaiah et al. [15] introduced an innovative framework incorporating multiple node attribute characteristics, including degree and clustering coefficient, to create feature vectors for each node. Yang et al. [16] proposed a multi-attribute node importance ranking algorithm based on entropy weight method and analytic hierarchy process, integrating degree centrality, position-based k-shell values, and PageRank values from random walks, effectively addressing the overlap problem. Li et al. [17] introduced an advanced centrality model, DKBC, based on gravitational principles. The DKBC model integrates centrality attributes including node degree, spatial positioning, and betweenness centrality, thereby enhancing the accuracy of critical node identification in complex networks. Morejon et al. [18] proposed the semi-local centrality with weighted lexicographic extension of neighborhoods (SL-WLEN), a novel centrality metric designed to overcome existing limitations by incorporating topological structure and node attributes through local components.
Cascading failure research, as the core of vulnerability analysis, is essential for elucidating the failure propagation mechanisms within metro networks. In the domain of urban metro complex networks, scholars have conducted multi-dimensional explorations. Zhang et al. [19] developed a unified framework for quantitatively assessing metro network resilience, originating from the perspective of network efficiency and performance loss triangles. Using the Shanghai metro as a case study, they revealed its robustness to random failures yet vulnerability to deliberate attacks, and proposed optimal recovery strategies. Xu et al. [20] constructed a multi-stage resilience framework integrated with passenger flow data, conducting a comparative analysis of five major global metro networks. This work elucidated the critical influences of topological structure, passenger flow distribution, and passenger behavior on system resilience. Yang et al. [21] analyzed metro network topological characteristics based on complex network theory and proposed a weighted composite indicator, revealing scale-free features characterized by robustness to random failures and vulnerability to hub-directed attacks. Zhang et al. [22] investigated cascading failure patterns in the Nanjing metro under deliberate attacks by integrating coupled map lattice models with passenger load redistribution mechanisms, identifying critical attack modes and corresponding vulnerability thresholds. Furthermore, advancements in cascading failure models, such as the sandpile model and percolation theory, have provided robust support for metro vulnerability research through their application in simulating failure propagation. However, cascading failure models that specifically target the unique physical–functional bilayer coupling characteristics of metro systems still require significant development.
However, a critical examination of the above research progress reveals three interrelated and progressively deepening bottlenecks that together constitute a theoretical gap constraining the understanding of metro system vulnerability.
First, at the level of network modeling, existing models exhibit fundamental simplifications in characterizing the internal coupling mechanisms of the system. The vast majority of studies abstract metro networks as single-layer topologies; even those that incorporate multilayer modeling confine their analytical granularity to the macroscopic connectivity of lines and stations. Although pioneering work by Shen et al. has extended the modeling perspective to in-station facility networks, their framework remains essentially a single-layer description of the relationship between physical facilities and passenger flow, with the cross-layer coupling logic between physical entities and functional systems entirely set aside. This omission is not a mere lack of detail; rather, it deprives the model of the capacity to capture the cross-layer causal chain of facility damage leading to functional interruption and ultimately service loss, thereby detaching the physical foundation of vulnerability assessment from engineering reality.
Second, at the level of critical node identification, existing methods suffer from dual limitations in applicability and global scope when applied to bilayer coupled networks, limitations that are directly rooted in the aforementioned modeling simplifications. On the one hand, mainstream algorithms rely heavily on local neighborhood attributes or static global metrics and lack the capacity to deeply mine the sequential decision value of nodes under dynamic topological evolution. This leads to the systematic omission of bridge-type critical nodes—nodes that are structurally important yet do not stand out in terms of degree. On the other hand, and more fundamentally, these algorithms are almost exclusively grounded in the theoretical framework of single-layer networks. When confronted with asymmetric coupling edges and heterogeneous failure propagation paths between the physical and functional layers, traditional metrics become largely ineffective in measuring cross-layer influence. A node with an unremarkable degree in the physical layer may exert decisive influence over the entire network by virtue of the core functional system it supports, yet this information remains entirely invisible under a single-layer evaluation paradigm.
Third, at the level of cascading failure simulation, a significant mismatch exists between classical failure propagation rules and the core structural characteristics of the metro bilayer network revealed in this study. We find that the actual physical–functional bilayer metro network exhibits a pronounced clustered structure, wherein nodes aggregate into functional groups characterized by high internal cohesion and low external coupling. In contrast, the failure diffusion logic of conventional sandpile models and load–capacity models rests on the implicit assumption of homogeneous mixing among nodes and cannot capture the differential dynamics of failure saturation within clusters and selective propagation across clusters. This rule-level deficiency leads to qualitative discrepancies in the phase-transition patterns produced by simulations compared with real-world observations, thereby weakening the model’s capacity to explain the evolution of system robustness.
In light of the above, this study constructs and validates a systematically integrated analytical framework. First, deep reinforcement learning algorithms are introduced to leverage their sequential decision-making capability on dynamic topologies for identifying critical nodes in bilayer coupled networks, thereby overcoming the inherent insensitivity of traditional methods to cross-layer influence. Second, an improved sandpile model incorporating cluster characteristics is employed to simulate the selective cross-layer propagation of cascading failures, compensating for the inadequacy of classical rules in capturing clustered structures. The core contribution of this work lies not in proposing isolated novel algorithms, but in the first systematic and organic integration of bilayer coupled network modeling, deep reinforcement learning, and cluster-augmented sandpile dynamics into a complete methodological chain for assessing physical–functional cross-layer coupling failures in metro systems. Empirical analysis of the Zhengzhou Metro network validates the effectiveness and applicability of this integrated framework in vulnerability assessment, thereby providing a solid theoretical foundation and actionable practical reference for analyzing the structural properties of multilayer coupled networks and enhancing the resilience of urban metro systems.

2. Multi-Layer Urban Metro Network Model and Topological Properties

2.1. Construction of the Multi-Layer Metro Network Model

Employing network coupling theory, the multi-layer coupled metro network was defined as a triplet. The network can be represented as N = N P , N V , N R , where N P , N V , N R denote the physical layer, the functional layer, and the coupling connections between these two layers, respectively. The physical layer, N P = ( P , E ) , was modeled as an undirected connected network. Here, P represents the set of nodes in the physical layer, and E represents the set of edges. An adjacency matrix, A = [ a i j ] ( a i j = 1 or 0 ), was used to denote the presence absence of a direct connection between physical nodes i and j . The functional layer was represented in an analogous manner. In reality, the physical infrastructure within a metro system is highly heterogeneous. However, when these diverse physical units are considered as service nodes oriented towards passenger flow, they can be effectively simplified in the modeling process as nodes with homogeneous attributes within the complex network framework.
It should be noted that abstracting heterogeneous physical facilities as homogeneous nodes constitutes a standard modeling practice in complex network-based vulnerability analysis and does not imply a disregard for functional distinctions. For instance, Shen et al. [23], in constructing a facility network model for metro stations, similarly abstracted various facilities—such as ticket vending machines, fare gates, and staircases—as homogeneous nodes to investigate cascading failure processes driven by passenger flow redistribution. This study focuses on the macroscopic propagation patterns of cross-layer coupling failures between the physical and functional layers, rather than on the fine-grained operation of individual facilities. In cascading failure analysis, the direction and intensity of failure propagation are governed primarily by the topological position and coupling structure of a node, not by its specific equipment type. Homogenizing physical facilities as passenger service nodes substantially reduces model complexity without compromising the capacity to capture cross-layer failure mechanisms. Naturally, this simplification also delineates the applicable boundaries of the model: when research involves equipment-specific failure modes or nonlinear capacity effects, heterogeneous parameters must be introduced as extensions. Such refinements can be implemented in future work through the incorporation of node-type labels. For the present objectives—namely, constructing a vulnerability assessment framework and validating its methodology—the homogeneity assumption is fully sufficient to support the validity of the core conclusions.
This study uses the Zhengzhou Metro network as the empirical case. Data collection procedures were as follows: (1) Network topology: Line and station connectivity data were obtained from the official Zhengzhou Metro website and Baidu Maps in October 2024. The physical-layer network contains 228 nodes and 379 intra-layer edges; the functional layer contains 190 nodes and 193 intra-layer edges; the coupling layer contains 38 inter-layer edges. (2) Passenger flow: Daily average station-level passenger volumes were sourced from the publicly released September 2024 operational report of Zhengzhou Metro Group. (3) Facility identification and coupling: Physical facilities (ticket vending machines, security checkpoints, fare gates, etc.) and functional modules (AFC, ISCS, PIS, etc.) were identified based on standard station design blueprints. Coupling relationships were established by mapping each physical facility to its supported functional module(s). (4) Field verification: The first author conducted on-site inspections at 12 stations across Lines 1, 2, and 5 from 10–15 October 2024, to verify facility layouts and coupling assignments. Complete node lists, edge lists, and the coupling matrix are included in the main text and figures. The information flows between these systems were abstracted as edges. Critically, certain physical infrastructure components are responsible for supporting specific informational functions. Damage to such a physical node inherently compromises its corresponding functional module, and vice versa. This reciprocal interdependence necessitates the coupling connection between the physical and functional layers in the network model. Based on this coupling relationship matrix, a bilayer urban metro network model was constructed, as illustrated in Figure 1. The red network layer represents the physical layer, and the green network layer represents the functional layer.

2.2. Topological Analysis of the Network

Node degree and degree distribution serve as fundamental metrics reflecting the heterogeneity and connection patterns of a network. The degree of a node, defined as the number of edges incident to it, provides a straightforward indication of its local importance. In vulnerability studies, high-degree nodes (hubs) are typically prioritized targets for deliberate attacks, as their removal often induces maximal disruption to the overall connectivity and functionality of the network. Figure 2 illustrates the degree distributions for both the physical and functional layers of the Zhengzhou metro network, where darker node coloring corresponds to higher degree values.
The degree distribution, P ( k ) , denotes the probability that a randomly selected node has a degree exactly equal to k . This distribution is a critical metric for characterizing the heterogeneous topological properties of the entire network. Statistical analysis of node degrees was performed for the bilayer urban metro network, with the resulting degree distributions presented in Figure 3. In this figure, the abscissa represents node degree, while the ordinate represents the count of nodes sharing a given degree. The term P ( k ) is used to denote the proportion of nodes with degree k relative to the total number of nodes in the network. Examination of the degree distributions across the three networks (physical, functional, and coupled) reveals that nodes with low degree values constitute the overwhelming majority, whereas nodes with high degree values are comparatively rare.
To validate the scale-free properties of the Zhengzhou multi-layer metro network, curve fitting was performed on the degree distributions. Multiple fitting models were evaluated, and the Allometric1 model was identified as providing the optimal fit. The node degree distributions were found to conform to power-law distributions, exhibiting superior goodness-of-fit compared to exponential or normal distributions. Specifically, the degree distribution of the physical layer followed a power law of the form y = 3.48 x 2.63 , that of the functional layer followed y = 0.73 x 2.13 , and the distribution for the multi-layer network as a whole followed y = 0.55 x 1.64 , as detailed in Figure 3.
The fitted power-law exponents are provided in the figure caption. These distributions, characterized by a high proportion of low-degree nodes and a small number of highly connected hubs, confirm that the Zhengzhou multi-layer metro network exhibits scale-free characteristics [23]. Consequently, the network possesses the dual properties typical of complex networks: robustness against random failures coupled with vulnerability to deliberate attacks [24].

3. Identification of Critical Nodes in Urban Multi-Layer Metro Networks Using an Improved DQN Algorithm

The validity of node importance ranking directly determines the quality of vulnerability analysis. Existing methods fall into two categories: classical centrality metrics and heuristic search strategies. Both, however, suffer from fundamental limitations when applied to critical node identification in bilayer coupled networks.
Classical centrality metrics are typically computed once on a given static topology and used for node ranking under the implicit assumption that the ranking remains valid throughout the analysis. Under sequential node removal, however, the network topology evolves continuously, and critical paths along with connectivity structures are progressively reshaped, causing nonlinear reordering of node importance in response to prior removals. This dynamic dependence on perturbation history cannot be adequately captured by a static initial centrality ranking alone. Heuristic methods that recalculate centrality after each removal partially mitigate this issue but face two critical bottlenecks: first, the computational cost of recomputing global metrics grows prohibitively with network size, particularly in bilayer networks; second, greedy optimization of one-step rewards lacks foresight regarding cumulative disruption effects and is prone to local optima.
Deep reinforcement learning overcomes these limitations at a fundamental level. First, DQN aims to maximize long-term cumulative reward, directly learning a mapping from network states to removal actions—an approach inherently suited to the combinatorial optimization nature of sequential dismantling. Second, deep networks can implicitly encode topological evolution, obviating the need for explicit recomputation of global metrics and thereby balancing computational efficiency with decision optimality. Third, in bilayer coupled networks where cross-layer dependencies cause dynamic shifts in node value as failures propagate, the interactive learning mechanism of DQN is uniquely capable of adaptively capturing this reassessment process.
Given these advantages, this study introduces the DQN algorithm with multidimensional improvements to systematically evaluate its effectiveness in identifying critical nodes within bilayer coupled networks.

3.1. The Deep Q-Network (DQN) Algorithm

The Deep Q-Network algorithm represents a significant breakthrough in the field of deep reinforcement learning. By integrating deep learning with traditional reinforcement learning, DQN effectively overcomes the challenges associated with the curse of dimensionality that arises when Q-learning is applied to high-dimensional state spaces. The core innovation of this method lies in its use of deep neural networks to approximate the optimal action-value function, thereby enabling an agent to select actions through strategic interaction with the environment, with the goal of maximizing cumulative long-term rewards. The DQN network architecture comprises five fundamental components: the environment, the agent, states, actions, and rewards.
The agent learns to select optimal actions through interaction with the environment, aiming to maximize cumulative long-term rewards. Through continuous trial-and-error and feedback mechanisms within the environment, the agent learns and optimizes its policy, enabling autonomous adaptation and optimal decision-making in complex and dynamic settings. The core technologies underlying the DQN architecture are illustrated in Figure 4 and described as follows:
(1)
Loss Function
The loss function in DQN is designed based on the Q-value update mechanism inherent to Q-learning algorithms. It is defined by calculating the mean squared error between the current estimated Q-value and the target Q-value. The specific mathematical expression is provided in Equation (1):
L ( θ ) = E [ ( r + γ max a Q ( s , a ; θ ) Q ( s , a ; θ ) ) 2 ]
where θ represents the parameters of the main network, θ represents the parameters of the target network, r is the immediate reward received after taking action a in state s , γ is the discount factor, and s is the subsequent state.
(2)
Experience Replay
Prior to the introduction of Experience Replay (ER), training data typically exhibited strong temporal correlations. These correlations predisposed models to overfitting during training and exacerbated the non-stationarity of the data distribution. To mitigate these issues, the ER mechanism was proposed to break the temporal dependencies between samples and improve data utilization efficiency. Specifically, each interaction experience is stored in a replay buffer as a tuple ( s , a , r , s ) , representing the current state, action taken, reward received, and subsequent state. These tuples are not independent of one another. If samples were drawn sequentially for batch learning during training according to their temporal order, the model would be prone to converging to local optima. Therefore, historical data are randomly sampled from the replay buffer for parameter updates, thereby enhancing training stability and accelerating convergence.
(3)
Target Network
The Deep Q-Network guides the agent’s decision-making process by estimating the state-action value function. However, in environments with high-dimensional state and action spaces, estimated Q-values are susceptible to substantial fluctuations caused by environmental dynamics or policy changes, leading to training instability. To address this challenge, DQN introduces a target network architecture. As indicated in Equation (2), the target network computes the target Q-value using a delayed update mechanism. This network operates independently from the main network, with its parameters periodically copied from the main network. This design effectively smoothes the training targets, reduces the optimization difficulty of the regression task, and consequently enhances the stability of the learning process.
Q t a r g e t = r + γ · m a x a Q ( s , a ; θ )

3.2. Improved DQN Algorithm Workflow

Building upon the findings reported in [24], the DQN algorithm has demonstrated superior performance in identifying critical nodes in complex networks compared to other baseline methods. However, the conventional approach exhibits limitations in feature extraction for large-scale complex networks. To address this shortcoming, we implemented multi-dimensional improvements to the algorithm. The training workflow of the improved DQN network is illustrated in Figure 5, with the fundamental process comprising the following six steps:
Step 1: Data Preprocessing and Environment Initialization. The Zhengzhou metro network data were first preprocessed by reading edge lists and constructing the bilayer complex network graph structure. Each node was assigned a layer-type identifier. During environment initialization, a multi-dimensional feature vector was constructed as the state representation for each node, incorporating degree centrality, layer-type information encoded using one-hot encoding, and a status flag indicating whether the node had been removed. The action space for the agent was defined as the sequential selection of nodes for removal. The reward function was designed based on the ratio of the size of the largest connected component to the number of remaining nodes following node removal. A smaller ratio indicated a greater degree of network disruption, corresponding to higher criticality of the removed node.
The choice of the largest connected component ratio as the reward function is grounded in standard practice within complex network vulnerability research. The size of the largest connected component serves as a fundamental indicator of structural integrity, directly reflecting a network’s capacity to maintain basic connectivity under attack. For metro systems, connectivity is a prerequisite for passenger transport—loss of the largest component implies widespread service disruption. Guiding the DQN agent with this metric therefore enables effective identification of nodes whose removal maximally compromises global connectivity. It should be acknowledged that this metric emphasizes topological connectivity and does not directly capture finer-grained operational consequences such as passenger delays or safety impacts. Incorporating multi-dimensional performance indicators into a composite reward function represents a promising direction for future work.
Step 2: Neural Network Architecture and Hyperparameter Configuration. A deep Q-network model was constructed comprising two fully connected hidden layers, each containing 128 neurons. The output layer dimension matched the total number of network nodes, ensuring that each node corresponded to a distinct actionable choice. An experience replay buffer was initialized with a capacity of 2000. Key reinforcement learning hyperparameters were configured as follows: discount factor (γ) of 0.95, initial exploration rate (ε) of 1.0, exploration decay rate of 0.995, minimum exploration rate of 0.01, and learning rate of 0.001. The model employed mean squared error as the loss function and utilized the Adam optimizer for parameter updates.
The hyperparameter values follow standard practices in deep reinforcement learning for combinatorial optimization [25,26] and were fine-tuned via preliminary grid search on a validation set. A discount factor of γ = 0.95 balances immediate and long-term rewards; a learning rate of 0.001 with the Adam optimizer ensures stable convergence; the exploration rate decay schedule facilitates sufficient exploration in early training and progressive exploitation thereafter. The key findings—namely, the relative effectiveness of node ranking—remain robust across reasonable hyperparameter ranges ( γ 0.9 ,   0.99 , learning rate 0.0005 ,   0.005 ).
Step 3: Training Episode Execution. At the beginning of each training episode, the environment was reset to its original network state. The agent selected nodes for removal based on the current feature vector states of all nodes, employing an ε-greedy policy for action selection. Upon execution of an action, the environment returned a new state vector, an immediate reward, and a termination flag. The termination condition was satisfied when all nodes had been removed. The reward was defined as the negative value of the ratio of the largest connected component size to the number of remaining nodes following node removal. The reward was consistently negative; a higher reward value indicated a greater degree of network disruption, signifying that the removed node was more critical. Experience tuples generated at each interaction step—comprising state, action, reward, next state, and termination flag—were stored in the experience replay buffer.
Step 4: Experience Sampling and Network Update. Once the number of samples stored in the experience replay buffer exceeded the predefined batch size of 32, a mini-batch of experiences was randomly sampled for training. For each sampled experience, the target Q-value was computed as follows: if the experience corresponded to a terminal state, the target Q-value was set equal to the immediate reward; otherwise, the target Q-value was calculated as the immediate reward plus the product of the discount factor and the maximum Q-value for the subsequent state. This target value was subsequently used to update the Q-value estimate for the corresponding action within the main network, with network parameters optimized via gradient descent. Concurrently, the exploration rate was decayed after each training step according to the predefined decay rate, thereby facilitating a gradual transition from exploration to exploitation.
Step 5: Model Persistence and Performance Monitoring. A comprehensive model persistence mechanism was implemented, enabling the direct saving of model parameters and training states through the agent object upon completion of training. Throughout the training process, the system automatically recorded multiple key performance indicators, including cumulative rewards, exploration rate dynamics, Q-value convergence behavior, and loss function evolution. Comprehensive visualization of training curves was generated, providing a systematic basis for model evaluation and hyperparameter optimization.
Step 6: Critical Node Identification and Output. Based on the fully trained DQN model, forward propagation was performed to compute the Q-values for each node under different states, which served as the criterion for node importance assessment. Nodes were ranked according to their Q-values in descending order, yielding the critical node identification results. Node importance distribution charts were subsequently generated to visually represent the differential criticality of nodes within the network, thereby providing theoretical support for subsequent network analysis and strategic decision-making.
Through this improved DQN-based critical node identification algorithm for complex networks, a ranking of critical nodes was obtained. This ranking laid the foundation for the subsequent intentional attack simulations based on node importance. The complete pseudocode of the three algorithms is provided in Appendix A.

4. Cascading Failure Mechanism Based on a Sandpile Model Incorporating Cluster Characteristics

In complex networks, a cluster refers to a densely connected subgroup or community of nodes within the network. The constructed urban bilayer metro complex network exhibits pronounced cluster characteristics. To account for this property, a sandpile model incorporating cluster characteristics was developed to simulate the failure propagation process in complex networks, as illustrated in Figure 6.
The sandpile model falls within the domain of self-organized criticality theory, and its evolutionary process can be delineated into three primary stages. The first stage is the accumulation phase, during which sand grains continuously fall onto a flat surface, gradually accumulating to form a conical pile. The second stage is the critical state formation phase. As the slope of the pile increases to a specific threshold, the system begins to exhibit local collapses of varying scales. At this juncture, a dynamic equilibrium is established between newly added and sliding sand grains. The final stage is the global instability phase, which occurs when the input of sand grains exceeds the system’s carrying capacity, triggering a global collapse of the entire sandpile.
Based on the literature [27], transportation networks exhibit enhanced stability and improved flow efficiency following aggregation transformations, thereby validating the effectiveness of cascading failure propagation rules based on the sandpile model for transportation networks. Building upon this foundation and accounting for the pronounced clustering characteristics of the constructed Zhengzhou metro network, we introduced an improved sandpile model incorporating cluster characteristics to govern cascading failure propagation. In this improved sandpile model, two metrics are employed to characterize the state of a given physical node: the load and the threshold. The load represents the real-time “height” of physical node, corresponding to the magnitude of the load it currently bears. The threshold denotes the critical load at which node failure occurs, representing the maximum load that node can withstand. Initially, the load of each physical node was set to 0, indicating that the physical infrastructure has not been subjected to attack and is operating under normal conditions. The failure propagation process of the sandpile model is illustrated schematically in Figure 6 and can be delineated into the following six stages.
Stage 1: Node P i is subjected to an attack. When H i     Z i , node P i continues to operate normally. When H i > Z i , node P i fails and releases load to its neighboring nodes, at which point the process proceeds to Stage 2.
Stage 2: An evaluation is performed to determine whether the failed node P i is an edge node. If so, the process proceeds to Stage 3; otherwise, it proceeds to Stage 6. The distribution of edge nodes within clusters is illustrated in Figure 7, where nodes connecting two clusters are identified as edge nodes.
Stage 3: Nodes that fail at this stage are exclusively edge nodes. A failed edge node P i must release load to its downstream neighboring nodes. The magnitude of load released from edge node P i to its downstream nodes depends on the type classification of these downstream neighboring nodes. Consequently, a further subdivision of edge node categories is required at this juncture. When edge node P i fails, if all downstream nodes connected to it belong to the same cluster, the process proceeds to Stage 4; otherwise, it proceeds to Stage 5.
Stage 4: In this stage, all downstream nodes connected to the failed edge node belong to the same cluster, as illustrated in Figure 8. The upstream edge node transfers its entire load P i to the downstream node P j , i.e., H j = H j + H i . When all downstream nodes connected to the upstream edge node belong to the same cluster, load distribution within the cluster is determined based on node load capacity. The calculation formulas for node load capacity L I N , relative link circulation R L C , and cluster load capacity L I C are introduced below [27,28,29]:
L I N i = ( 1 + α ) L i 0
L I C   =   i ω max ( C i L i , 0 )
R L C i j = S i k Γ j S k
S i = min ( Y i , j Γ i Y j ) λ , Γ i Y i λ , Γ i =
Y i = L I C i F i , F i L I C i 0 , F i > L I C i
where α represents the tolerance coefficient, reflecting the network’s redundant design capacity for overload conditions; L i 0 denotes the initial load of node i and S i represents the state value of node i , indicating its current remaining load capacity. Γ j denotes the set of neighboring nodes of node i , and Y i represents the residual load capacity of node i . The parameter λ serves as a tuning parameter that controls the degree of nonlinearity in the redistribution process. F i represents the real-time load of node i . Node capacity (LIN) measures the ability of a node to accommodate external unstable load while maintaining its own functionality without failure. Relative link circulation (RLC) essentially reflects the capacity of an edge, which can be understood as the maximum load allowed to pass through the corresponding node per unit time. Cluster capacity (LIC) characterizes the ability of a group of nodes, considered as a whole, to withstand external unstable load. The load distribution scheme is presented as follows:
d ( i , j n ) = r a n k R L C i j n , L I N i j 1 = L I N i j 2 = = L I N i j n r a n k R L C i j n ( max ( L I N i j n ) ) , L I N i j c L I N i j d
Here, d i , j n represents the load distribution strategy, L I N i j n denotes the node load capacity, and R C F i j n indicates the relative link circulation of the edge connecting nodes. The term r a n k R C F i j n signifies that when the node load capacities of all downstream nodes are equal, the relative link circulation of the edges between the edge node and each downstream node are sorted in descending order, and load is allocated sequentially according to this ranking. The term r a n k R C F i j n max L I N i j n signifies that when disparities exist among the node load capacities of downstream nodes, the downstream nodes are first sorted in descending order of their node load capacities, followed by sorting the relative link circulation of the edges between the edge node and each downstream node in descending order. The load distribution strategy is then determined by integrating these two rankings.
Stage 5: In this stage, the downstream nodes belong to different clusters, as illustrated in Figure 9. The load distribution scheme is governed by Equation (9), where D ( i , j n ) denotes the load distribution strategy, L I C i j n represents the cluster load capacity.
D ( i , j n ) = r a n k R C F ij n , L I C i j 1 = L I C i j 2 = = L I C i j n r a n k R C F i j n ( max ( L I C i j n ) ) , L I C i j c L I C i j d
Since the downstream nodes connected to the failed edge node belong to different clusters, the load distribution process at this stage follows a two-step approach: first, determining the priority order among the downstream clusters, and second, establishing the priority order among nodes within each selected cluster.
The term r a n k R C F i j n signifies that when the cluster load capacities of all downstream cluster sets are equal, the priority order for load distribution is determined by sorting all connecting edges in descending order of their relative link circulation. The term r a n k R C F i j n max L I C i j n signifies that when disparities exist among the cluster load capacities of the downstream cluster sets, the clusters are first sorted in descending order of their cluster load capacities, thereby establishing the order in which load is transmitted to downstream clusters. Subsequently, the edges connecting nodes to adjacent clusters are sorted in descending order of their relative link circulation, and load is allocated according to this sequence. The edge node preferentially transfers its load to the cluster with the highest cluster load capacity; load is not transmitted to the cluster with the next highest cluster load capacity until the prioritized cluster can no longer absorb additional load.
Stage 6: This stage governs load transfer processes within a cluster, where the failed node is not an edge node and shares cluster membership with all its neighboring nodes. The load transfer strategy in this stage prioritizes nodes with higher node load capacity for load reception. If the node load capacities of neighboring nodes are equal, load distribution priority is determined by sorting the connecting edges in descending order of their relative link circulation. If the node load capacities differ, neighboring nodes are first sorted in descending order of their node load capacities, followed by sorting the connecting edges in descending order of their relative link circulation. The load distribution sequence is then established by integrating these two rankings.
It should be acknowledged that the load redistribution rules and failure threshold definitions in the improved sandpile model remain abstractions of real-world complexity. In actual metro operations, passenger flow redistribution is influenced by individual decision-making, station-level guidance, and real-time dispatching interventions, while facility failure thresholds vary with equipment type, aging conditions, and maintenance levels. The present model focuses on capturing the macroscopic modulation of cascading failure pathways by cluster structures. The adopted simplifications, while ensuring model tractability, are sufficient to reveal the core dynamics of cross-layer coupled failure propagation. If the research objective shifts toward fine-grained prediction under specific scenarios, more sophisticated heterogeneous parameters and behavioral models would be required. This extension is left for future investigation.

5. Simulation and Validation of Urban Bilayer Metro Network Vulnerability

5.1. Visualization of Node Importance Ranking Results Based on the Improved DQN Algorithm

To enhance the effectiveness of critical node identification in complex networks, this study introduced the Deep Q-Network method for identification research. Given that the traditional DQN exhibits suboptimal performance in feature extraction for large-scale complex networks [25], we implemented multi-dimensional improvements to the algorithm and rigorously validated the effectiveness of these various improvement strategies through vulnerability analysis experiments.
The first improvement involved replacing the convolutional layers in DQN with fully connected layers to enhance the network’s recognition accuracy of input information. Since convolutional layers are prone to losing critical information when extracting network structural features, the substitution with fully connected layers effectively mitigates this issue. The second improvement introduced the Double DQN architecture, which employs a dual-network structure (with the Eval network responsible for action selection and the Target network responsible for Q-value computation) combined with a dynamic exploration strategy to address the Q-value overestimation problem inherent in traditional DQN. The third improvement incorporated the Dueling DQN architecture, which decomposes the Q-value into a state value function and an advantage function.
Incorporating the degree centrality-based node ranking method, node importance ranking results were obtained using the aforementioned four approaches (three improved DQN variants and the degree centrality method), as shown in Figure 10. Table 1 presents the node rankings derived from these four methods. Figure 8 visualizes the metro network with node rankings obtained from different methods, where higher-ranking nodes are represented with larger sizes and increased color saturation and brightness. As is evident from the figure, critical nodes identified based on degree centrality are closely interconnected and tend to cluster within specific regions of the network. In contrast, critical nodes identified by the improved DQN, Dueling DQN, and Double DQN methods exhibit relatively uniform distribution, span the entire network scope. The underlying reason for this disparity is that traditional critical node identification methods lack global feature extraction capabilities. These ranking results will serve as the basis for formulating intentional attack strategies, providing a foundation for subsequent vulnerability analysis of complex networks.

5.2. Validation of the Improved Sandpile Model Applicability

To evaluate the capacity of the improved sandpile model in capturing cascading failure dynamics, this study compares the evolution of the largest connected component ratio under sustained attack loads using two alternative failure rules: the conventional load–capacity model and the improved sandpile model. The results are presented in Figure 11.
The two rules yield markedly distinct robustness profiles. The conventional load–capacity model exhibits an abrupt, cliff-like phase transition—network connectivity collapses precipitously as attacks accumulate, reflecting the implicit assumption that local overload instantaneously triggers global failure. In contrast, the improved sandpile model displays a continuous phase transition, with connectivity declining gradually as attack loads increase. This pattern captures the progressive diffusion of local perturbations through inter-layer coupling, buffered by system redundancy—a “local accumulation–gradual propagation” dynamic that aligns more closely with the observed behavior of real metro networks, where failures emerge slowly and propagate with inherent buffering capacity [27]. It should be noted that the effectiveness of sandpile-based propagation rules in simulating cascading failure processes in clustered transportation infrastructure networks has been substantiated in the existing literature. For instance, Dui et al. [27], in analyzing cascading failures in traffic networks, similarly employed cluster-aggregation-based load redistribution rules and demonstrated that networks exhibit enhanced stabil ity and improved flow capacity after aggregation. This provides methodological support for the application of the improved sandpile model to vulnerability analysis of bilayer metro networks in the present study.
In summary, the continuous phase transition driven by self-organized criticality in the improved sandpile model is more consistent with theoretical expectations for failure dynamics in hierarchically coupled networks than the abrupt collapse mode of the conventional model. It should be emphasized that this comparison serves as a theoretical plausibility argument for the model’s ability to capture failure propagation in clustered bilayer networks, rather than as direct empirical validation against historical incident data. The network topology data, passenger flow data, and facility coupling relationships used in this study are all derived from real-world collection and field investigations, thereby providing a realistic data foundation for the model analysis. Empirical verification of the model awaits the accumulation of real-world cascading failure cases in future work.

5.3. Analysis of the Safety Tolerance Coefficient

The safety tolerance coefficient α determines the level of redundancy in node capacity design: a larger α enhances a node’s ability to withstand overload, thereby suppressing the propagation of cascading failures. Drawing on typical redundancy ranges encountered in engineering design, this study adopts α ∈ [0.1, 0.9] to cover a gradient of scenarios from minimal to high redundancy. Under a fixed limit coefficient β = 1.2 and a deliberate attack strategy, we examine the influence of α on both the largest connected component ratio and network efficiency, with the results presented in Figure 12.
As the cumulative attack load increases, overall network performance exhibits a declining trend; however, the value of α markedly modulates the pattern of degradation. At low redundancy (α = 0.1), the network undergoes a precipitous, cliff-like collapse early in the attack sequence. When α is raised to 0.3, the moderate redundancy partially buffers the overload impact, leading to a noticeably slower rate of decline. For α ≥ 0.5, the network maintains a gradual descent—or even brief plateaus—over a substantial range of attack loads, indicating a significant enhancement in resilience. These results demonstrate that increasing the safety tolerance coefficient effectively delays the cascading failure process, and that a critical interval exists within which network performance transitions from brittle collapse to progressive degradation.
In summary, a larger safety tolerance coefficient α substantially improves network robustness against cascading failures, shifting the degradation mode from brittle collapse toward gradual decline. Accordingly, reasonable redundancy capacity should be allocated to critical nodes during metro network design and operation to strengthen the system’s ability to buffer localized failures.

5.4. Analysis of the Limit Coefficient

The limit coefficient β defines the maximum overload capacity of a node beyond its baseline redundancy: a larger β reduces the likelihood of node failure under load surges, thereby constraining both the spatial extent and the severity of cascading failure propagation. Consistent with engineering practice, this study selects β ∈ [1.0, 1.8] to represent a gradient from relatively low to relatively high overload margins. With the safety tolerance coefficient fixed at α = 0.3 and a deliberate attack strategy employed, we investigate the influence of β on the largest connected component ratio and network efficiency, as shown in Figure 13.
As the cumulative attack load grows, network performance exhibits an overall downward trend; yet increasing β substantially alters the degradation trajectory. At low β (β = 1.2), the maximum overload capacity is limited, and a steep performance collapse occurs early in the attack. Raising β to 1.5 expands the overload margin, visibly flattening the decline curve. At β = 1.8, performance degrades only very gradually across a wide range of attack loads, demonstrating effective suppression of overload-driven failure. These findings indicate that a larger limit coefficient delays the cascading failure process, and that a critical interval exists across which the network transitions from rapid collapse to progressive degradation.

5.5. Vulnerability Analysis Based on the Improved Sandpile Model

The physical layer of metro networks is highly susceptible to physical disruptions such as passenger surges, rainstorm flooding, and malicious attacks, whereas the functional layer is vulnerable to cyber threats [28,29,30]; moreover, failures in the two layers can propagate reciprocally. In light of this, the present study employs the cascading failure propagation rules of the improved sandpile model to conduct a vulnerability analysis of the Zhengzhou metro bilayer complex network [31].
To evaluate the impact of different node importance ranking methods on network robustness, seven node ranking strategies are adopted in deliberate attack simulation experiments, during which the largest connected component ratio is monitored in real time as the cumulative attack load increases. The seven strategies comprise four classical methods—degree centrality, betweenness centrality, closeness centrality, and the greedy algorithm—along with the three improved DQN variants proposed in this work: DQN, Dueling DQN, and Double DQN. The simulation results are presented in Figure 14.
As can be clearly observed from Figure 14, the largest connected component ratio exhibits a declining trend under all strategies as the cumulative attack load increases. Notably, the curves corresponding to the three improved DQN algorithms descend significantly faster than those of all classical methods. At a cumulative attack load of only 2000, the largest connected component ratio under the DQN method has already dropped to 0.2, whereas the corresponding ratios for degree centrality, betweenness centrality, and closeness centrality remain as high as 0.90, 0.97, and 0.97, respectively, and the greedy algorithm reaches only 0.85. As the attack load further increases, the DQN series continues to exhibit the fastest rate of connectivity decay, ultimately leading to global network collapse under comparatively small attack loads.
The above results indicate that, in the examined case, the node sequences identified by the improved DQN algorithms achieve greater disruption efficiency against network connectivity than the classical centrality methods and the greedy algorithm included in the comparison. This phenomenon may be attributed to the following: classical centrality methods compute rankings based on a static topology and are therefore ill-equipped to capture the dynamic evolution of network structure and the consequent reassessment of residual node importance following sequential removals; the greedy algorithm, although capable of re-evaluating at each step, remains constrained by a locally optimal perspective. In contrast, the improved DQN implicitly incorporates topological evolution information by learning a mapping from network states to removal actions, thereby exhibiting certain advantages in sequential disruption tasks.
In summary, within the bilayer coupled network context examined in this study, the improved DQN algorithms demonstrate better performance in critical node identification compared with the classical methods considered, offering a viable technical pathway for subsequent vulnerability analysis and protection strategy research.

6. Discussion

(1)
The Zhengzhou metro bilayer network exhibits the typical scale-free characteristics of complex networks, manifested by dense interconnections among nodes, pronounced dominance of hub nodes, and concentrated line distribution. Revealing this structural feature provides a topological foundation for understanding the coexistence of robustness against random failures and vulnerability to deliberate attacks in metro systems [32].
(2)
The three improved DQN algorithms proposed in this study consistently outperform four classical baselines—degree centrality, betweenness centrality, closeness centrality, and the greedy algorithm—in sequential node disruption tasks. This advantage stems primarily from the adaptive learning capability of DQN in capturing dynamic topological evolution. Classical methods compute rankings based on a static topology and are therefore ill equipped to capture the reassessment of node importance induced by the progressive reshaping of the residual network following sequential removals. This finding offers methodological support for the targeted protection of critical facilities in metro networks.
(3)
The cluster-augmented sandpile model revises the phase transition behavior of cascading failure from the abrupt collapse characteristic of conventional load–capacity models to a continuous and progressive degradation pattern, thereby better reflecting the gradual failure propagation and redundancy buffering observed in actual metro systems. Sensitivity analyses of the safety tolerance coefficient and the limit coefficient demonstrate that increasing redundancy capacity substantially delays the failure propagation process and enables a transition from brittle collapse to progressive degradation. These results provide a quantitative reference for the redundancy design of both physical facilities and functional modules in metro systems.
(4)
The three DQN enhancements and the cluster-augmented sandpile model introduced in this work each address a specific bottleneck within the vulnerability analysis pipeline. The contributions of these components are clearly delineated, and their combination does not introduce redundant complexity. Specifically, the fully connected DQN mitigates the loss of topological information that convolutional layers incur when processing graph-structured data. Double DQN suppresses the Q-value overestimation bias inherent in sequential decision making by decoupling action selection from value evaluation. Dueling DQN improves sample efficiency in neutral states through value function decomposition. The experimental results presented in Figure 14 indicate that all three DQN variants significantly outperform the four classical baselines—degree centrality, betweenness centrality, closeness centrality, and the greedy algorithm—requiring substantially fewer node removals to achieve a comparable degree of network disruption. The comparable performance among the three variants further suggests that the core improvement yields the primary gain, while the subsequent enhancements introduce no performance degradation. Meanwhile, the cluster-augmented sandpile model revises the phase transition behavior of cascading failure from the abrupt collapse of conventional load–capacity models to a progressive degradation pattern, as shown in Figure 11, which aligns more closely with the gradual failure propagation and redundancy buffering observed in real metro systems. These techniques are integrated in a modular fashion, with each enhancement yielding traceable experimental gains. The overall complexity of the framework is commensurate with the improvement achieved in vulnerability assessment capability.
(5)
This study has several limitations. The validation of the critical node identification results is primarily based on comparative network disruption efficiency within a simulation environment and has not yet been directly correlated with historical failure records or operational vulnerability data from actual metro systems. This limitation arises from two objective constraints. First, complete node-level cascading failure propagation chains from real incidents are exceedingly scarce in the public domain. Even for well-documented events such as the Zhengzhou Metro Line 5 incident during the July 20 rainstorm, detailed facility-level failure sequences are neither systematically archived nor publicly released. Second, equipment fault logs and passenger flow anomaly records maintained by metro operators generally involve safety and commercial sensitivities, rendering them largely inaccessible for academic validation. Nevertheless, it is noteworthy that the most severely affected section in the July 20 event—the segment between Haitansi Station and Shakoulu Station—lies within a region densely populated by the physical–functional coupling critical nodes identified in this study. This observation provides a degree of qualitative corroboration for the plausibility of the model’s identification results. Should data-sharing collaborations with metro operators be established in the future, access to anonymized equipment failure logs and spatiotemporal passenger flow anomaly data would enable more rigorous empirical validation and parameter calibration of the model.
(6)
The core contribution of this study lies in the development of a transferable methodological framework, namely the systematic integration of physical–functional bilayer coupled modeling, improved DQN-based critical node identification, and cluster-augmented sandpile cascading failure analysis. This framework can be replicated for any metro network by inputting the target city’s network topology and passenger flow data, thereby possessing the potential for cross-city transferability. The present study employs the Zhengzhou metro network as a single empirical case, and the generalizability of its conclusions should be interpreted with appropriate caution. As a typical continental urban rail transit system, Zhengzhou Metro is characterized by a relatively large network scale, complex line topology, and high passenger volume, features shared by metro systems in many provincial capital cities in China. The case selection thus possesses a reasonable degree of representativeness. Nevertheless, variations in topological morphology, passenger flow distribution, and operational practices across different urban metro networks imply that the critical node distribution patterns and vulnerability thresholds identified in this study may not be directly transferable. Validating the applicability of the framework to metro networks with diverse structural typologies, as well as conducting comparative studies that account for inter-city variations, constitutes an important direction for future research.
(7)
Based on the above findings, this study offers the following engineering recommendations for the practical operation and maintenance management of metro systems:
  • Metro operators may use the node importance ranking generated by the improved DQN algorithm to designate the top 10% of nodes as Tier-1 protection targets, with priority allocation of redundant resources, and include the top 20% of nodes in an intensified inspection schedule.
  • For newly constructed metro stations, it is recommended that physical facilities and functional modules reserve redundancy capacity according to the thresholds α ≥ 0.5 and β ≥ 1.5. For existing stations, current α and β values may be back-calculated, and stations falling below the critical thresholds should be prioritized for retrofitting.
  • Since node importance shifts dynamically during the failure propagation process, metro operators are advised to employ simulation tools to pre-envision the evolution of critical nodes under different initial failure scenarios and to develop multi-scenario emergency response plans accordingly.
  • When configuring redundancy for critical physical facilities, operators should verify that the dependent functional modules possess equivalent capacity margins, thereby preventing functional-layer bottlenecks from undermining the effectiveness of physical redundancy.
  • In the planning of new lines, excessive concentration of facilities in a single hub area should be consciously avoided. If critical nodes are densely distributed in a particular zone, measures such as adding parallel passageways or dispersing functionally similar facilities may be adopted to reduce their topological centrality.
  • Metro operators in different cities may apply the proposed framework by inputting local network topology and passenger flow data to construct city-specific critical node inventories and vulnerability basemaps, thereby supporting the formulation of differentiated and precision-targeted protection strategies.

Author Contributions

Conceptualization, C.Y. and L.Z.; methodology, C.Y.; software, C.Y. and C.M.; validation, C.Y. and W.T.; formal analysis, C.Y., L.Y., C.M. and B.W.; investigation, C.Y.; data curation, C.Y. and B.W.; writing—original draft preparation, C.Y. and L.Z.; writing—review and editing, L.Z. and L.Y.; supervision, L.Z. and W.T. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Natural Science Foundation of China (Grant No. 52074309).

Data Availability Statement

The data that support the findings of this study are presented in the article and are not publicly available due to privacy or ethical restrictions.

Conflicts of Interest

The authors declare no conflicts of interest.

Appendix A

Algorithm A1: Improved DQN Training Procedure
Input: Bilayer coupled graph G, number of training episodes M, target network update frequency C
Output: Trained main network parameters theta
  1.
Initialize experience replay buffer D with capacity N = 2000
  2.
Construct main network Q: replace the convolutional layers of the original DQN with three fully connected layers (512 -> 256 -> 128), ReLU activation, linear output layer; denote parameters as theta
  3.
Construct target network Q_hat with the same architecture as the main network; set parameters theta_minus = theta
  4.
Set hyperparameters: discount factor gamma = 0.95, exploration rate epsilon = 1.0, decay rate 0.995, minimum epsilon_min = 0.01, learning rate eta = 0.001
  5.
for episode = 1 to M do
  6.
Reset environment: residual graph G’ = G, set of surviving nodes V_alive = all nodes
  7.
Compute initial state S = {s_i | i in V_alive}, where s_i = [d_i, o_i, r_i]
  8.
for t = 1 to |V| do
  9.
With probability epsilon, select a random action a_t in V_alive
  10.
Otherwise a_t = argmax_{a in V_alive} Q(S, a; theta)
  11.
Remove node a_t from G’, update V_alive = V_alive \ {a_t}
  12.
Compute reward R_t = - (number of nodes in the largest connected component) / (total number of remaining nodes)
  13.
Compute new state S’ = {s_i | i in V_alive}
  14.
Store transition (S, a_t, R_t, S’) in D
  15.
Sample a random minibatch B from D, |B| = 32
  16.
For each sample (S_j, a_j, R_j, S’j) in B, compute target value y_j:
if V_alive is empty: y_j = R_j
else: y_j = R_j + gamma * max{a’ in V_alive} Q_hat(S’_j, a’; theta_minus)
  17.
Update theta by minimizing the mean squared error loss
  18.
Every C steps, synchronize target network: theta_minus = theta
  19.
S = S’
  20.
end for
  21.
epsilon = max(epsilon * 0.995, epsilon_min)
  22.
end for
Algorithm A2: Double DQN Training Procedure
Input: Bilayer coupled graph G, number of training episodes M, target network update frequency C
Output: Trained main network parameters theta
  1.
Initialize experience replay buffer D with capacity N = 2000
  2.
Construct main network Q: three fully connected layers (512 -> 256 -> 128), ReLU activation, linear output layer; denote parameters as theta
  3.
Construct target network Q_hat with the same architecture as the main network; set parameters theta_minus = theta
  4.
Set hyperparameters: gamma = 0.95, epsilon = 1.0, epsilon_decay = 0.995, epsilon_min = 0.01, alpha = 0.001
  5.
for episode = 1 to M do
  6.
Reset environment: G’ = G, V_alive = all nodes
  7.
Compute initial state S = {s_i | i in V_alive}
  8.
for t = 1 to |V| do
  9.
With probability epsilon, select a random action a_t in V_alive
  10.
Otherwise a_t = argmax_{a in V_alive} Q(S, a; theta)
  11.
Remove a_t from G’, update V_alive
  12.
Compute reward R_t = - (number of nodes in the largest connected component) / (total number of remaining nodes)
  13.
Compute new state S’ = {s_i | i in V_alive}
  14.
Store (S, a_t, R_t, S’) in D
  15.
Sample a random minibatch B from D, |B| = 32
  16.
// Double DQN improvement: decouple action selection and value evaluation to suppress Q-value overestimation
For each sample, compute target value y_j:
if V_alive is empty: y_j = R_j
else:
a* = argmax_{a’ in V_alive} Q(S’_j, a’; theta) // main network selects action
y_j = R_j + gamma * Q_hat(S’_j, a*; theta_minus) // target network evaluates value
  17.
Update theta by minimizing the MSE loss
  18.
Every C steps, synchronize target network: theta_minus = theta
  19.
S = S’
  20.
end for
  21.
epsilon = max(epsilon * epsilon_decay, epsilon_min)
  22.
end for
Algorithm A3: Dueling DQN Training Procedure
Input: Bilayer coupled graph G, number of training episodes M, target network update frequency C
Output: Trained main network parameters theta
  1.
Initialize experience replay buffer D with capacity N = 2000
  2.
Construct main network Q (Dueling architecture improvement):
Shared feature extraction layers: three fully connected layers (512 -> 256 -> 128), ReLU activation
State value stream V: fully connected layer (64) -> outputs scalar V(s)
Action advantage stream A: fully connected layer (64) -> outputs vector A(s, a) of dimension equal to the number of nodes
// Dueling improvement: decompose Q-value into state value and action advantage
Output: Q(s, a) = V(s) + (A(s, a) - mean over all actions of A(s, a’))
  3.
Construct target network Q_hat with the same architecture as the main network; set parameters theta_minus = theta
  4.
Set hyperparameters: gamma = 0.95, epsilon = 1.0, epsilon_decay = 0.995, epsilon_min = 0.01, alpha = 0.001
  5.
for episode = 1 to M do
  6.
Reset environment: G’ = G, V_alive = all nodes
  7.
Compute initial state S = {s_i | i in V_alive}
  8.
for t = 1 to |V| do
  9.
With probability epsilon, select a random action a_t in V_alive
  10.
Otherwise a_t = argmax_{a in V_alive} Q(S, a; theta)
  11.
Remove a_t from G’, update V_alive
  12.
Compute reward R_t = - (number of nodes in the largest connected component) / (total number of remaining nodes)
  13.
Compute new state S’ = {s_i | i in V_alive}
  14.
Store (S, a_t, R_t, S’) in D
  15.
Sample a random minibatch B from D, |B| = 32
  16.
For each sample, compute target value y_j (same as in Algorithm A1, step 16)
  17.
Update theta by minimizing the MSE loss
  18.
Every C steps, synchronize target network: theta_minus = theta
  19.
S = S’
  20.
end for
  21.
epsilon = max(epsilon * epsilon_decay, epsilon_min)
  22.
end for

References

  1. Zhang, L.; Xu, M.; Wang, S. Quantifying Bus Route Service Disruptions under Interdependent Cascading Failures of a Multimodal Public Transit System Based on an Improved Coupled Map Lattice Model. Reliab. Eng. Syst. Saf. 2023, 235, 109250. [Google Scholar] [CrossRef]
  2. Wang, J.; Liao, F.; Wu, J.; Sun, H.; Wang, W.; Gao, Z. Measurement of Functional Resilience of Transport Network: The Case of the Beijing Subway Network. Transp. Policy 2023, 140, 54–67. [Google Scholar] [CrossRef]
  3. Opsahl, T.; Agneessens, F.; Skvoretz, J. Node Centrality in Weighted Networks: Generalizing Degree and Shortest Paths. Soc. Netw. 2010, 32, 245–251. [Google Scholar] [CrossRef]
  4. Yang, X.; Xiao, F. An Improved Gravity Model to Identify Influential Nodes in Complex Networks Based on K-Shell Method. Knowl. Based Syst. 2021, 227, 107198. [Google Scholar] [CrossRef]
  5. Zhao, N.; Yang, S. A Novel Method to Identify Key Nodes in Complex Networks Based on Degree and Neighborhood Information. Appl. Sci. 2024, 14, 521. [Google Scholar] [CrossRef]
  6. Kai, L.; Shi, A. Identification of Node Influence Based on Improved K-Shell Algorithm. In Proceedings of the 2019 IEEE 1st International Conference on Civil Aviation Safety and Information Technology (ICCASIT) 2019, Kunming, China, 17–19 October 2019; IEEE: New York, NY, USA, 2019; pp. 262–266. [Google Scholar] [CrossRef]
  7. Zhu, D.; Wang, H.; Wang, R.; Duan, J.; Bai, J. Identification of Key Nodes in a Power Grid Based on Modified PageRank Algorithm. Energies 2022, 15, 797. [Google Scholar] [CrossRef]
  8. Liu, X.; Ye, S.; Fiumara, G.; De Meo, P. Influential Spreaders Identification in Complex Networks with TOPSIS and K-Shell Decomposition. IEEE Trans. Comput. Soc. Syst. 2023, 10, 347–361. [Google Scholar] [CrossRef]
  9. Curado, M.; Tortosa, L.; Vicent, J.F. A Novel Measure to Identify Influential Nodes: Return Random Walk Gravity Centrality. Inf. Sci. 2023, 628, 177–195. [Google Scholar] [CrossRef]
  10. Yang, J.; Lu, J.; Wu, Y.; Li, T.; Yang, Y. A Node Ranking Method Based on Local Structure Information in Complex Networks. Eng. Lett. 2022, 30, 161–167. Available online: http://www.engineeringletters.com/issues_v30/issue_1/EL_30_1_18.pdf (accessed on 20 April 2026).
  11. Zhao, X.; Zhang, Y.; Zhai, Q.; Zhang, J.; Qi, L. A Multi-Attribute Decision-Making Approach for Critical Node Identification in Complex Networks. Entropy 2024, 26, 1075. [Google Scholar] [CrossRef]
  12. Hu, G.; Hu, J.; Kang, K.; Xu, X.; Ren, Y. Identifying Important Nodes Based on Neighborhood Multi Order Multi Attribute in Complex Networks. Phys. Scr. 2025, 100, 055211. [Google Scholar] [CrossRef]
  13. Zadeh, L.A. Fuzzy Sets. Inf. Control 1965, 8, 338–353. [Google Scholar] [CrossRef]
  14. Zadeh, L.A. The Concept of a Linguistic Variable and Its Application to Approximate Reasoning-I, II, III. Inf. Sci. 1975, 8, 199–249. [Google Scholar] [CrossRef]
  15. Hajarathaiah, K.; Enduri, M.K.; Anamalamudi, S.; Abdul, A.; Chen, J. Node Significance Analysis in Complex Networks Using Machine Learning and Centrality Measures. IEEE Access 2024, 12, 10186–10201. [Google Scholar] [CrossRef]
  16. Yang, W.; Liu, Q.; Zhang, W. Node Importance Ranking for Influence Maximization in Social Networks. J. King Saud Univ. Comput. Inf. Sci. 2025, 37, 181. [Google Scholar] [CrossRef]
  17. Li, S.; Quan, Y.; Luo, X.; Wang, J. Influential Nodes Identification for Complex Networks Based on Multi-Feature Fusion. Sci. Rep. 2025, 15, 11440. [Google Scholar] [CrossRef]
  18. Morejon, M.F.O.; Moreira, R.I.Y. SL-WLEN, a Novel Semi-Local Centrality Metric with Weighted Lexicographic Extended Neighborhood for Identifying Influential Nodes in Networks with Weighted Edges and Nodal Attributes. Mathematics 2025, 13, 2614. [Google Scholar] [CrossRef]
  19. Zhang, D.; Du, F.; Huang, H.; Zhang, F.; Ayyub, B.M.; Beer, M. Resiliency Assessment of Urban Rail Transit Networks: Shanghai Metro as an Example. Saf. Sci. 2018, 106, 230–243. [Google Scholar] [CrossRef]
  20. Xu, Z.; Chopra, S.S.; Lee, H. Resilient Urban Public Transportation Infrastructure: A Comparison of Five Flow-Weighted Metro Networks in Terms of the Resilience Cycle Framework. IEEE Trans. Intell. Transp. Syst. 2022, 23, 12688–12699. [Google Scholar] [CrossRef]
  21. Yang, Y.; Liu, Y.; Zhou, M.; Li, F.; Sun, C. Robustness Assessment of Urban Rail Transit Based on Complex Network Theory: A Case Study of the Beijing Subway. Saf. Sci. 2015, 79, 149–162. [Google Scholar] [CrossRef]
  22. Zhang, J.; Wang, Z.; Wang, S.; Shao, W.; Zhao, X.; Liu, W. Vulnerability Assessments of Weighted Urban Rail Transit Networks with Integrated Coupled Map Lattices. Reliab. Eng. Syst. Saf. 2021, 214, 107707. [Google Scholar] [CrossRef]
  23. Shen, Y.; Yang, H.; Ren, G.; Ran, B. Model Cascading Overload Failure and Dynamic Vulnerability Analysis of Facility Network of Metro Station. Reliab. Eng. Syst. Saf. 2024, 242, 109711. [Google Scholar] [CrossRef]
  24. Jiang, Y.; Liu, L.; Shu, J. Method for Identifying Key Nodes in Complex Networks Based on Improved DDQN Algorithm. Appl. Res. Comput. 2025, 42, 1122–1127. [Google Scholar] [CrossRef]
  25. Ermagun, A.; Tajik, N.; Janatabadi, F.; Mahmassani, H. Uncertainty in Vulnerability of Metro Transit Networks: A Global Perspective. J. Transp. Geogr. 2023, 113, 103710. [Google Scholar] [CrossRef]
  26. Wang, Z.; Pei, Y.; Liu, J.; Liu, H. Vulnerability Analysis of Urban Road Networks Based on Traffic Situation. Int. J. Crit. Infrastruct. Prot. 2023, 41, 100590. [Google Scholar] [CrossRef]
  27. Dui, H.; Chen, S.; Duan, D.; Xu, X. Reliability-Oriented Network Cascading Failure Analysis. Oper. Res. Manag. Sci. 2021, 30, 106–112. [Google Scholar]
  28. Gao, P.; Zheng, W.; Liu, J.; Wu, D. Research on Modeling and Analysis Methods of Railway Station Yard Diagrams Based on Multi-Layer Complex Networks. Appl. Sci. 2025, 15, 2324. [Google Scholar] [CrossRef]
  29. Cheng, G.; Lu, Y.; Zhang, M.; Huang, J. Node Importance Evaluation and Network Vulnerability Analysis on Complex Network. J. Natl. Univ. Def. Technol. 2017, 39, 120–127. [Google Scholar] [CrossRef]
  30. Hu, J.; Yang, M.; Zhen, Y.; Fu, W. Node Importance Evaluation of Urban Rail Transit Based on Signaling System Failure: A Case Study of the Nanjing Metro. Appl. Sci. 2024, 14, 9600. [Google Scholar] [CrossRef]
  31. Chen, S.; Wang, Z.; Jin, B.; Tong, X.; Jin, H. Vulnerability Assessment Framework for Physical Protection Systems Integrating Complex Networks and Fuzzy Petri Nets. Appl. Sci. 2025, 15, 7062. [Google Scholar] [CrossRef]
  32. Ma, C.; Zhang, L.; You, L.; Tian, W. A Review of Supply Chain Resilience: A Network Modeling Perspective. Appl. Sci. 2025, 15, 265. [Google Scholar] [CrossRef]
Figure 1. Zhengzhou Metro physical–functional coupling network topology diagram. The red layer represents the physical facility network, the green layer represents the functional system network, and inter-layer links denote coupling relationships.
Figure 1. Zhengzhou Metro physical–functional coupling network topology diagram. The red layer represents the physical facility network, the green layer represents the functional system network, and inter-layer links denote coupling relationships.
Applsci 16 04259 g001
Figure 2. Zhengzhou Metro multi-layer network degree distribution topology diagram. Darker node colors indicate higher degree values.
Figure 2. Zhengzhou Metro multi-layer network degree distribution topology diagram. Darker node colors indicate higher degree values.
Applsci 16 04259 g002
Figure 3. Node degree distributions and power-law fitting curves for three types of networks. (a) Physical layer, (b) Functional layer, (c) Multi-layer metro network. The horizontal axis represents node degree, and the vertical axis represents the proportion of nodes.
Figure 3. Node degree distributions and power-law fitting curves for three types of networks. (a) Physical layer, (b) Functional layer, (c) Multi-layer metro network. The horizontal axis represents node degree, and the vertical axis represents the proportion of nodes.
Applsci 16 04259 g003
Figure 4. Schematic diagram of the DQN algorithm structure, illustrating three core modules: loss function computation, experience replay buffer sampling, and target network delayed update.
Figure 4. Schematic diagram of the DQN algorithm structure, illustrating three core modules: loss function computation, experience replay buffer sampling, and target network delayed update.
Applsci 16 04259 g004
Figure 5. Improved DQN training flowchart, illustrating the complete training process from data preprocessing and environment initialization to agent interaction and model updating.
Figure 5. Improved DQN training flowchart, illustrating the complete training process from data preprocessing and environment initialization to agent interaction and model updating.
Applsci 16 04259 g005
Figure 6. Schematic diagram of failure propagation in the sandpile model incorporating cluster characteristics, illustrating the differentiated load redistribution from failed nodes to downstream nodes within the same cluster and across different clusters.
Figure 6. Schematic diagram of failure propagation in the sandpile model incorporating cluster characteristics, illustrating the differentiated load redistribution from failed nodes to downstream nodes within the same cluster and across different clusters.
Applsci 16 04259 g006
Figure 7. Schematic diagram of edge nodes. Nodes connecting two distinct clusters are defined as edge nodes, which play a key role in cross-cluster load redistribution during failure propagation. In this illustration, both P3 and P5 are edge nodes.
Figure 7. Schematic diagram of edge nodes. Nodes connecting two distinct clusters are defined as edge nodes, which play a key role in cross-cluster load redistribution during failure propagation. In this illustration, both P3 and P5 are edge nodes.
Applsci 16 04259 g007
Figure 8. Schematic diagram of load distribution when downstream nodes belong to the same cluster. All downstream neighboring nodes of the failed edge node belong to a single cluster, and the load is redistributed within that cluster. In this illustration, P5, P6, and P7 are edge nodes and all belong to the same cluster.
Figure 8. Schematic diagram of load distribution when downstream nodes belong to the same cluster. All downstream neighboring nodes of the failed edge node belong to a single cluster, and the load is redistributed within that cluster. In this illustration, P5, P6, and P7 are edge nodes and all belong to the same cluster.
Applsci 16 04259 g008
Figure 9. Schematic diagram of load distribution when downstream nodes belong to different clusters. The downstream neighboring nodes of the failed edge node belong to multiple clusters, and the load is preferentially transferred to the cluster with the highest cluster capacity. In this illustration, P5 and P8 are edge nodes but belong to different clusters.
Figure 9. Schematic diagram of load distribution when downstream nodes belong to different clusters. The downstream neighboring nodes of the failed edge node belong to multiple clusters, and the load is preferentially transferred to the cluster with the highest cluster capacity. In this illustration, P5 and P8 are edge nodes but belong to different clusters.
Applsci 16 04259 g009
Figure 10. Visualization of node rankings based on four algorithms. Node size and color saturation indicate ranking importance. The four subfigures present results for degree centrality, DQN, Dueling DQN, and Double DQN, respectively. The critical nodes identified by DQN-based methods are more uniformly distributed across the entire network.
Figure 10. Visualization of node rankings based on four algorithms. Node size and color saturation indicate ranking importance. The four subfigures present results for degree centrality, DQN, Dueling DQN, and Double DQN, respectively. The critical nodes identified by DQN-based methods are more uniformly distributed across the entire network.
Applsci 16 04259 g010
Figure 11. Comparison of network robustness under two cascading failure rules. The conventional load-capacity model exhibits an abrupt phase transition, whereas the improved sandpile model displays a continuous and progressive degradation pattern, which aligns more closely with the gradual failure propagation observed in real metro systems.
Figure 11. Comparison of network robustness under two cascading failure rules. The conventional load-capacity model exhibits an abrupt phase transition, whereas the improved sandpile model displays a continuous and progressive degradation pattern, which aligns more closely with the gradual failure propagation observed in real metro systems.
Applsci 16 04259 g011
Figure 12. Relationship between different safety tolerance coefficients α and metro network vulnerability. At low α values, the network undergoes abrupt collapse; for α ≥ 0.5, the decline curve becomes gradual, indicating that increased redundancy capacity significantly enhances network resilience.
Figure 12. Relationship between different safety tolerance coefficients α and metro network vulnerability. At low α values, the network undergoes abrupt collapse; for α ≥ 0.5, the decline curve becomes gradual, indicating that increased redundancy capacity significantly enhances network resilience.
Applsci 16 04259 g012
Figure 13. Relationship between different limit coefficients β and metro network vulnerability. Larger β values result in a more gradual decline in network performance with increasing attack load; at β = 1.8, the network remains relatively stable across a wide range of attack loads.
Figure 13. Relationship between different limit coefficients β and metro network vulnerability. Larger β values result in a more gradual decline in network performance with increasing attack load; at β = 1.8, the network remains relatively stable across a wide range of attack loads.
Applsci 16 04259 g013
Figure 14. Variation of the largest connected component ratio under different attack strategies based on the improved sandpile model. The attack effectiveness of seven node importance ranking strategies is compared. The curves corresponding to the improved DQN methods decline most rapidly, indicating their superior node identification performance in sequential disruption tasks compared with classical baselines.
Figure 14. Variation of the largest connected component ratio under different attack strategies based on the improved sandpile model. The attack effectiveness of seven node importance ranking strategies is compared. The curves corresponding to the improved DQN methods decline most rapidly, indicating their superior node identification performance in sequential disruption tasks compared with classical baselines.
Applsci 16 04259 g014
Table 1. Top-10 critical node rankings of the metro network identified by four algorithms. The node IDs corresponding to the top ten rankings obtained by degree centrality, DQN, Dueling DQN, and Double DQN are presented.
Table 1. Top-10 critical node rankings of the metro network identified by four algorithms. The node IDs corresponding to the top ten rankings obtained by degree centrality, DQN, Dueling DQN, and Double DQN are presented.
AlgorithmsDegree Centrality DQNDueling DQNDouble DQN
Rank
1211111293
2312229
31114121294
43111113292
5613114101
68121123
792114130
81331534
91412111131
10231121419
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Yang, C.; Zhang, L.; You, L.; Tian, W.; Ma, C.; Wei, B. A Study on the Vulnerability of Multilayer Subway Networks Based on the SPM and DQN. Appl. Sci. 2026, 16, 4259. https://doi.org/10.3390/app16094259

AMA Style

Yang C, Zhang L, You L, Tian W, Ma C, Wei B. A Study on the Vulnerability of Multilayer Subway Networks Based on the SPM and DQN. Applied Sciences. 2026; 16(9):4259. https://doi.org/10.3390/app16094259

Chicago/Turabian Style

Yang, Chen, Lei Zhang, Liang You, Wenjie Tian, Chuhan Ma, and Bowu Wei. 2026. "A Study on the Vulnerability of Multilayer Subway Networks Based on the SPM and DQN" Applied Sciences 16, no. 9: 4259. https://doi.org/10.3390/app16094259

APA Style

Yang, C., Zhang, L., You, L., Tian, W., Ma, C., & Wei, B. (2026). A Study on the Vulnerability of Multilayer Subway Networks Based on the SPM and DQN. Applied Sciences, 16(9), 4259. https://doi.org/10.3390/app16094259

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop