3.3. Graph Feature Splitting (GFS)
Following the feature-splitting paradigm introduced in TFI, we first divide the input feature dimensions into a graph-favored part and a graph-disfavored part. The intuition is that graph propagation is not uniformly beneficial to all feature dimensions. Some dimensions are more compatible with topology-aware aggregation and can benefit from message passing, whereas others may be degraded by neighborhood mixing and are therefore better handled by a graph-agnostic encoder. Based on this observation, GFS routes different feature dimensions to different learning branches instead of applying the same propagation operator to the entire feature space.
Existing graph metrics mainly characterize feature similarity over connected nodes. However, for feature splitting, what we need to evaluate is not merely whether neighboring nodes are similar, but whether graph propagation on a specific feature dimension can provide label-relevant information for downstream prediction. To this end, mutual information offers a suitable tool, as it directly measures the statistical dependence between variables and can capture both linear and non-linear relationships [
31].
To measure the propagation preference of each feature dimension, TFI assigns the
d-th feature dimension a topology-aware informativeness score:
where
denotes the propagated signal of the
d-th feature dimension,
k is the propagation hop, and
y denotes the node label random variable. A larger
indicates that the
d-th feature dimension contains more label-relevant information after graph propagation, and is therefore more suitable for topology-aware encoding.
Specifically, the mutual information term in Equation (
1) is computed as
where
U and
V denote two random variables,
is their joint probability distribution, and
and
are the corresponding marginal probability distributions. In Equation (
1),
U and
V correspond to the label variable
y and the propagated feature signal
, respectively.
In practice, TFI is estimated on the labeled training nodes only, so that no supervision from validation or test nodes is involved in feature splitting. For each feature dimension, the aggregated scalar signal is discretized into B bins by quantile-based partitioning, and the mutual information is then computed from the empirical joint distribution between the discretized signal and labels. To avoid excessive computational overhead and training instability, the feature split is computed before the main optimization stage and kept fixed during training unless otherwise specified.
After computing
for all feature dimensions, we rank these scores and split the feature space according to a ratio
. Let
be the threshold for selecting the top-
r fraction of feature dimensions according to their TFI scores. The graph-favored feature subset
and the graph-disfavored feature subset
are defined as follows:
In this way, the original feature matrix is decomposed into a propagation-oriented part and a non-propagation part.
The two subsets are then processed by separate encoders. Specifically, the graph-favored features
are fed into a GNN branch to exploit informative neighborhood interactions, while the graph-disfavored features
are processed by an MLP branch to preserve discriminative signals without introducing unnecessary message mixing. For the
ℓ-th layer, the two branches are written as
where
and
.
Finally, the outputs of the two branches are fused to obtain the final node representation:
where
denotes concatenation, and
and
are trainable parameters. The fused representation
is then used for downstream node classification. Through this split-processing design, GFS provides an explicit implementation of selective propagation at the feature-dimension level.
3.4. Core–Shell Adaptive Augmentation (CSA)
Although GFS determines feature-wise propagation preference through a statistical criterion, the reliability of this estimation still depends on the local context from which the aggregated signals are formed. In realistic graphs, however, local neighborhoods are often mixed and structurally unstable: nodes near class boundaries may be surrounded by label-inconsistent neighbors, making the resulting context less reliable for judging whether a feature dimension should be propagated. Therefore, the role of CSA is to construct a cleaner contextual space for more reliable TFI estimation before feature splitting.
To examine how different context construction strategies affect TFI estimation, we conduct an exploratory comparison of six variants, including perturbation-based, masking-based, and clustering-based methods. As shown in
Table 1, the clustering-based variant yields the most consistent improvement across datasets. This result suggests that effective TFI estimation benefits more from a cleaner contextual space for aggregation than from generic structure-agnostic perturbations. One possible explanation is that clustering-based augmentation reorganizes nodes with similar characteristics into compact local groups, thereby reducing the interference caused by mixed boundary neighborhoods and providing cleaner contextual support for propagation preference estimation.
This intuition can also be understood from the formulation of TFI. Using the identity of mutual information, we have
where
is fixed for a given dataset. Therefore, improving
is equivalent to reducing the conditional uncertainty
. In mixed boundary neighborhoods, semantically inconsistent neighbors may participate in aggregation, making the resulting aggregated signal less discriminative for predicting labels and thus increasing the conditional uncertainty. By contrast, a cleaner contextual space can provide more stable local evidence, making the aggregated feature more informative about the label distribution. More specifically, boundary nodes distort TFI estimation by perturbing the empirical dependency between the propagated feature signal and the label variable. When label-inconsistent neighbors are mixed during propagation, similar propagated feature values may no longer provide stable label-discriminative cues. Consequently, the empirical label uncertainty conditioned on the same discretized feature bin increases, which enlarges
and lowers
. As a result, some potentially graph-favored dimensions may be underestimated and incorrectly assigned to the graph-agnostic branch, leading to biased feature splitting.
These observations further suggest that the choice of context constructor is also critical. For TFI estimation, a suitable constructor should preserve local purity and structural stability, thereby providing more reliable contextual support for feature-wise propagation preference estimation. Prior studies suggest that effective aggregation relies on stable intra-class topological patterns rather than consistency-based metrics alone [
32]. From this perspective, granular computing provides a suitable inductive principle, as it organizes samples into compact information granules that better capture locally coherent and semantically stable regions [
33]. In particular, the purity-skeleton dynamic hypergraph suggests that a purity-aware, granular-ball construction can effectively organize feature-space correlations and data distributions into structured local regions [
34], thereby preserving important information and providing a more reliable contextual basis for TFI estimation.
As further illustrated in
Figure 4, granular-ball clustering yields cleaner local partitions than
k-NN clustering, especially around boundary regions, which is consistent with our goal of constructing a more reliable contextual space for TFI estimation. To further quantify this observation, we compute the partition purity on a sampled class-pair subgraph from the dataset. For each granular ball
, its purity is defined as
, and the weighted granular-ball purity is computed as
, where
is the number of nodes in the sampled subgraph. For
k-NN, since it does not produce explicit disjoint clusters, we treat each node’s
k-nearest-neighbor set
as its local context and compute the average local purity as
.
As shown in
Table 2, granular-ball clustering achieves slightly higher purity on the whole subgraph and a much larger improvement in the boundary region. In particular, the relative improvement reaches 8.58% in the boundary region, indicating that its advantage mainly lies in suppressing label mixing near class boundaries. This quantitative result supports the visual observation in
Figure 4:
k-NN may connect feature-close but label-inconsistent nodes around boundary regions, whereas purity-aware, granular-ball clustering can recursively separate low-purity regions and form cleaner local contexts. Therefore, what we need is a purity-aware context constructor that can suppress boundary contamination while preserving structurally stable local support for TFI estimation. Motivated by this observation, we design CSA to instantiate such a context enhancement mechanism.
Specifically, CSA constructs a contextual space composed of two complementary parts: a purity-aware core and an anchor-guided shell. The design choice is intentionally lightweight in function rather than exhaustive in mechanism: the core is introduced to suppress local boundary contamination, while the shell is introduced only to provide complementary structural support when local evidence is insufficient.
We first use a clustering algorithm to partition the node feature space into a set of local granular balls
. For each ball
, its center and radius are defined as
where
denotes the feature vector of node
, and the summation is taken over all nodes whose feature vectors belong to the granular ball
.
Following the granular ball computing formulation, the purity of
is measured as
where
denotes the subset of samples in the
t-th subcluster of
, and
is the number of subclusters in
. Balls with purity lower than a hyperparameter threshold
p are recursively split until the criterion is satisfied. In this way, the resulting purity-ball set provides compact local regions that better reflect the feature-space distribution and reduce boundary-induced mixing.
For each node
, let
denote the index of the granular ball containing it. We then define the core representation of
as
where
controls the strength of local purity-aware refinement.
While the core improves local semantic coherence, TFI estimation also benefits from complementary structural evidence beyond a single granular ball. To this end, we select a small set of representative anchor nodes from the largest granular balls. Let
denote the anchor set, where each anchor is chosen as the highest-degree node in one selected large ball:
with
denoting the
s-th selected large granular ball.
To make the shell aware of granular-ball boundaries under purity-aware guidance, we define a purity-aware, ball-level edge cost
and compute the shortest ball-aware distance
from node
to anchor
:
For subsequent computation, we further map this distance into an anchor affinity
and use these affinities to obtain the shell representation of node
:
where
is the sigmoid function and
is a small constant.
However, the need for shell supplementation is not uniform across nodes. Nodes located in locally stable regions usually already possess sufficiently reliable contextual support and, therefore, require only limited shell enhancement, whereas nodes near boundary regions are more likely to suffer from unstable local evidence and thus need stronger structural compensation. This suggests that the amount of injected shell information should be adjusted according to each node’s structural role. Inspired by the idea of local-global centrality, which jointly characterizes nodes from local and global structural perspectives, we introduce a node-wise adaptive weight to modulate the strength of shell information injected into each node [
35]. Specifically, we quantify each node from two complementary aspects, namely local influence (
) and global influence (
), which are defined as follows:
We further combine them into an adaptive centrality score
where
is a balancing coefficient. After min-max normalization, the node-wise fusion weight is obtained as
Finally, we combine the core and shell to obtain final feature
and estimate TFI on the CSA-enhanced context.
The purity-aware core reduces the ambiguity in feature-preference estimation, while the adaptive shell provides a more reliable structural context. In this way, CSA stabilizes node representations to support clearer feature splitting.
In addition to improving the reliability of feature-preference estimation, CSA is designed as a lightweight preprocessing component, where the main extra cost comes from purity-aware, granular-ball clustering. Following the notation above, let and F denote the number of nodes and the input feature dimension, respectively. Since the granular-ball set has been defined as , M denotes the number of generated granular balls, while the number of graph edges is written explicitly as . Let I denote the maximum number of recursive splitting iterations in the purity-aware, granular-ball clustering process, and let S denote the number of selected anchors. Since CSA is conducted before TFI-based feature splitting, it introduces a one-time preprocessing cost rather than an additional cost repeatedly incurred in each training epoch.
Specifically, purity-aware, granular-ball clustering recursively checks and splits low-purity balls. In each splitting iteration, the algorithm scans node features in the current balls to compute ball centers, radii, and purity scores. Since all nodes are visited at most once in each iteration, this clustering step costs . After the granular balls are obtained, constructing the core representation only requires a feature-level interpolation between each node and the center of its corresponding ball, with cost . Anchor selection can be completed by computing node degrees and scanning candidate balls, resulting in time. For the anchor-guided shell, computing ball-aware distances from S anchors on the sparse graph costs with a standard shortest-path implementation, and aggregating anchor features for all nodes costs . The adaptive core–shell fusion further costs . Therefore, the overall time complexity of CSA is .
The following dual-branch forward propagation after feature splitting also does not double the graph propagation cost. Let and denote the dimensions of the graph-favored and graph-agnostic feature subsets, respectively, where . Only the graph-favored subset is fed into the GNN branch and involves sparse neighborhood aggregation, while the graph-agnostic subset is processed by an MLP branch without using the adjacency matrix. Therefore, the MLP branch introduces only node-wise feature transformation cost, e.g., for a hidden dimension H, and does not incur edge-wise message passing cost such as . Since , the dual-branch design reallocates features between graph-based and graph-agnostic encoders rather than applying two full graph propagations.
In our implementation, both I and S are bounded constants. Therefore, for sparse graphs where , the CSA preprocessing complexity reduces to a near-linear cost, approximately . The space complexity mainly comes from storing the enhanced node features, granular-ball assignments, ball centers, sparse graph structure, and anchor affinities, requiring space. Since and S is fixed, the space complexity is bounded by . Thus, although CSA introduces purity-aware, granular-ball clustering and the subsequent model adopts dual-branch forward propagation, the framework does not introduce dense pairwise computation or duplicate full graph propagation, and its additional cost remains lightweight compared with standard sparse graph learning.
3.5. Dual-Branch Polarized Topology Refinement (DPTR)
Although GFS separates graph-favored and graph-disfavored feature dimensions for selective propagation, the graph-based branch may still suffer from a practical mismatch: once the split propagation-oriented features are no longer well aligned with the original graph, message passing on the unchanged topology may route information through incompatible edges. Meanwhile, the graph-based and feature-only branches provide naturally complementary views, but their interaction remains limited if they are optimized independently. To address these issues, we introduce a Dual-branch Polarized Topology Refinement (DPTR) module, which refines the propagation topology from a polarized perspective and further coordinates this refinement with graph-independent evidence from the feature-only branch.
Let
and
denote the propagation-favored features and the feature-only features obtained by GFS, respectively. Following the polarized formulation, we define the similarity matrix
and the dissimilarity matrix
as
where
denotes vector concatenation,
, and
and
are learnable parameters.
On the MLP branch, we first obtain the branch embedding and then compute the posterior prediction as follows:
where
is the output projection matrix, and
denotes the posterior vector of node
.
Since the feature-only branch does not rely on graph propagation, its posterior provides graph-independent semantic evidence that can serve as a complementary cue for topology refinement. In particular, we use the inner product between posterior distributions to measure the semantic consistency between two nodes [
36,
37], and define
To obtain a sparse and stable coordination operator, we further normalize and sparsify
:
where
denotes the set of the top-
K nodes with the largest posterior consistency scores for node
.
Equation (
25) serves as a posterior coordination operator for topology refinement. Specifically,
anchors the refinement to the observed graph structure,
provides polarized support from the graph-favored branch, and
acts as a semantic gate derived from the feature-only branch. The Top-
K sparsification further keeps the coordination local and prevents over-dense semantic connections.
We then use the posterior consistency operator to coordinate the polarized relation term when constructing the refined topology:
where
is a learnable parameter.
Accordingly, we take
and define the normalized propagation matrix as
where
is the degree matrix of
.
The graph-based branch then performs message passing on the refined topology and
:
Let
denote the output embedding of the graph-based branch. We then fuse the two branch representations and make the final prediction:
For node classification, the task loss is defined as
To jointly regularize the polarized topology and the posterior consistency operator, we introduce an auxiliary topology-coordination loss defined as
where
is the Laplacian matrix of the original graph,
denotes a set of sampled non-edge pairs. The overall objective is
The first term regularizes the refined relation matrix with respect to the graph structure, encouraging structurally coherent topology refinement. The second term explicitly increases posterior agreement on observed edges while discouraging high agreement on sampled non-edge pairs. In this way, constrains the refined topology from both structural and semantic perspectives.
The complexity of DPTR mainly comes from the pairwise polarized topology refinement. Let and denote the dimensions of the graph-favored and graph-agnostic feature subsets, respectively, where . Let H denote the hidden dimension, C denote the number of classes, L denote the number of GNN layers, and K denote the number of retained posterior-consistency neighbors. Different from the CSA module, DPTR is performed during model training. Following the polarized topology perturbation formulation, the similarity matrix and the dissimilarity matrix are defined over node pairs. Therefore, computing the pairwise polarized relation introduces a quadratic term with respect to the number of nodes.
Specifically, projecting the graph-favored features into the hidden space costs . Computing the pairwise similarity and dissimilarity scores over node pairs costs , and storing the corresponding polarized relation matrices requires space before sparsification. On the graph-agnostic branch, the MLP produces posterior predictions through node-wise transformations, with cost . The posterior consistency matrix R is computed by pairwise inner products between posterior distributions, which costs time and requires temporary storage if fully materialized. The subsequent Top-K operation sparsifies the posterior coordination operator and keeps only K candidates for each node, leading to a sparse operator with stored entries.
After the polarized relation and posterior coordination are obtained, the refined topology is constructed by coordinating the original adjacency, polarized relation scores, and posterior consistency. The final message passing is performed on the refined topology. If the refined topology is stored after Top-K sparsification and adjacency-based masking, the propagation cost is , where denotes the number of retained edges in the refined topology. Therefore, the per-epoch time complexity of DPTR can be summarized as , and its additional space complexity is .
Although DPTR introduces a quadratic pairwise relation-estimation term, this cost is controlled in two aspects. First, the polarized computation is applied to the graph-favored branch after feature splitting, rather than to the entire original feature space. Second, the graph-agnostic branch is implemented by an MLP and does not introduce another graph propagation process. Moreover, Top-K sparsification prevents the refined topology used for message passing from becoming fully dense. Therefore, DPTR introduces additional pairwise topology-refinement overhead, but it does not duplicate full graph convolution over both branches. This design provides a practical trade-off between topology refinement capability and computational cost on the evaluated benchmark graphs.
In this way, DPTR first learns polarity-aware relations directly from the split propagation-favored features, and then further uses posterior consistency from the feature-only branch as complementary guidance to coordinate topology refinement. The resulting topology is better aligned with the split propagation features, thereby alleviating feature–topology mismatch and reducing the risk that messages are passed along incompatible edges. For clarity, we summarize the overall procedure of CSA-PTR in Algorithm 1.
| Algorithm 1 The overall procedure of CSA-PTR. |
Require: Graph adjacency matrix , feature matrix , labels , maximal training epochs T Ensure: Prediction result
- 1:
Initialize model parameters - 2:
Construct context-enhanced features via Equation ( 21) - 3:
Compute TFI scores on and split features into and - 4:
for do - 5:
Construct polarized relations based on via Equation ( 22) - 6:
Obtain posterior consistency operator from the MLP branch on via Equation ( 25) - 7:
Construct refined topology via Equation ( 26) - 8:
Obtain graph-based embedding with GNN on and - 9:
Obtain feature-only embedding with MLP on - 10:
Fuse and to obtain via Equation ( 29) - 11:
Compute the - 12:
Update parameters by gradient descent - 13:
end for - 14:
return
|