4.3.1. Comparison with Mainstream Methods
To comprehensively validate the effectiveness of the proposed method, we conducted a systematic comparison with mainstream skeleton-based action recognition models on NTU RGB+D 60 and NTU RGB+D 120. This comparison encompasses traditional GCN architectures, spatiotemporal Transformer structures, and recent models focused on occlusion robustness. The table lists the parameter scales of each method and their performance under the NTU60 X-Sub and NTU120 X-Sub settings.
The results shown in
Table 1 demonstrate that classic GCN-based models (such as ST-GCN, 2s-AGCN, and SGN) exhibit robust performance in standard scenarios. Subsequent approaches like CTR-GCN, BlockGCN, and MTGCN further improved recognition accuracy through more refined topological modeling or lightweight strategies. Notably, BlockGCN achieved 93.1% accuracy on the NTU60 X-Sub dataset, demonstrating the crucial role of skeletal topology in spatiotemporal modeling. However, these models are predominantly optimized for unobstructed conditions and lack dedicated mechanisms to handle structural discontinuities and semantic information loss caused by occlusion. Consequently, they exhibit significant performance degradation when confronted with complex inputs such as occlusions or noise. To address the common occlusion challenge in real-world scenarios, RA-GCN and MSFGCN enhance feature recovery capabilities through multi-stream fusion and multi-scale geometric representations; Transformer-based architectures like SkeletonMAE and VQM-VAE explicitly reconstruct missing joint positions or semantic information through reconstruction-based frameworks, thereby improving adaptability to structurally incomplete inputs. Despite demonstrating positive progress in occlusion robustness, these methods remain constrained in practical application due to structural complexity, high parameter counts, and high computational costs. The proposed ROC-GCN demonstrates strong performance on both the NTU60 and NTU120 datasets. More importantly, ROC-GCN achieves this with a parameter size of only 2.51 M, significantly lower than most advanced occlusion-targeted methods. These results highlight the effectiveness of the proposed design in achieving an effective balance between model efficiency and robustness to occlusion.
4.3.2. Performance Comparison of Standard Datasets
To evaluate the performance and generalization capability of the proposed method, experiments were conducted on NTU RGB+D 60 and NTU RGB+D 120. Each dataset was trained with five random seeds, reporting the mean and standard deviation of Top-1 and Top-5 accuracy. Performance was analyzed for both modality fusion and individual modality (Joint, Bone, Joint Motion, and Bone Motion).
Table 2 compares ROC-GCN with the baseline on the NTU60 and NTU120 datasets, demonstrating consistent performance gains and improved training stability across both benchmarks.
Under the NTU60 X-Sub protocol, ROC-GCN achieves 89.77% Top-1 and 98.46% Top-5 accuracy, improving the baseline by 0.41 and 0.18 percentage points, respectively. In addition to accuracy gains, training stability is substantially enhanced, with Top-1 standard deviation reduced from 0.61% to 0.17% and Top-5 standard deviation from 0.28% to 0.02%, indicating markedly improved training consistency.
On NTU120 X-Sub, ROC-GCN similarly achieves superior performance, with Top-1 accuracy achieving 86.72%, gaining 0.48 percentage point improvement. Meanwhile, the Top-1 standard deviation decreases from 0.47% to 0.10%, demonstrating strong robustness under large-scale and diverse action distributions.
The consistent reduction in performance variance across both datasets further validates the effectiveness of the proposed adaptive dropout mechanism in suppressing perturbations caused by noisy joints and anomalous frames.
Table 3 presents the per-modality comparison between the baseline and our method on both datasets. On the NTU60 dataset, the proposed method consistently improves recognition accuracy across all modalities, outperforming the baseline in overall performance. The largest gain is observed in the Bone Motion modality (+0.71%), which can be attributed to the effective temporal noise suppression provided by the Adaptive Drop Module. By dynamically adjusting spatiotemporal drop ratios, the module enhances the robustness of motion feature extraction under noisy or occluded conditions.
Training stability is also significantly improved across all modalities. The standard deviation is reduced from 0.83% to 0.51% for Joint, 1.62% to 1.01% for Bone, 1.40% to 0.87% for Joint Motion, and 0.83% to 0.48% for Bone Motion, indicating more consistent optimization behavior.
On the NTU120 dataset, the Joint modality achieves the highest accuracy (83.05%) in both models, confirming that joint coordinates remain the primary semantic representation for action recognition. Our method further improves accuracy by 0.25% while reducing standard deviation by 18.8%, suggesting that the Local–Global Body-Prior-Guided Attention mechanism effectively focuses on key action regions (e.g., hands, legs) while reducing interference from background joints and extraneous movements through global semantic guidance.
Among motion-related modalities, Bone Motion (+1.23%) shows the largest performance gain, highlighting the model’s enhanced ability to compensate for missing structures under complex spatiotemporal dynamics. Meanwhile, the marked reduction in standard deviation (e.g., 27.3% in Joint Motion) indicates effective suppression of spatiotemporal noise accumulation, resulting in more stable training and more consistent prediction.
Overall, experimental results on standard datasets demonstrate that the proposed method consistently improves recognition accuracy and substantially enhances training stability under unobstructed conditions. The observed accuracy gains, together with the consistent reduction in standard deviation across both datasets, indicate improved robustness to noisy joints and anomalous inputs. This mitigates training perturbations arising from sensor noise and keypoint detection errors, further confirming the effectiveness and general applicability of the proposed method in common application scenarios.
4.3.3. Performance Comparison of Occlusion Datasets
To evaluate the accuracy and robustness of the model in recognizing actions under complex occlusion scenarios, we designed two occlusion datasets based on NTU60 and NTU120 for assessment.
Table 4 shows the model’s performance on the NTU60/120 occlusion dataset in detail.
On the NTU60 occlusion dataset, our method achieves a Top-1 accuracy of 79.72%, improving the baseline by 0.98 percentage points, indicating that ROC-GCN effectively mitigates performance degradation under spatial random occlusion. Training stability is also improved, with Top-1 and Top-5 standard deviations reduced by 12.6% and 12.7%, respectively, demonstrating more consistent and reliable recognition across spatial random occlusion and levels of joint loss.
On the NTU120 occlusion dataset, our method achieves consistent performance improvements, with Top-1 and Top-5 accuracy increasing by 0.73 and 0.60 percentage points over the baseline, respectively. The model also exhibits markedly enhanced stability, as reflected by 26.7% and 65.6% reductions in Top-1 and Top-5 standard deviations. These results indicate that ROC-GCN effectively suppresses noise propagation under spatiotemporally continuous occlusion, maintaining stable optimization and inference despite structural information loss.
Figure 7 illustrates the comparative results across the four datasets.
As shown in
Table 5, the proposed method demonstrates targeted performance improvements across different skeleton modalities and occlusion settings. Its behavior is closely related to the adopted occlusion strategy and the representational characteristics of the skeleton modality.
As further illustrated in
Figure 8, the per-modality accuracy on the NTU60/120 occlusion datasets reflects these targeted improvements.On the NTU60 occlusion dataset, the proposed method achieves consistent performance gains across all four skeleton modalities, with the most pronounced improvement observed in the Joint modality. Specifically, Top-1 accuracy increases by 5.32 percentage points over the baseline, demonstrating the enhanced capability of the proposed architecture to model spatial dependencies under random joint absence conditions. When spatial occlusions disrupt local joint consistency, the model effectively exploits the global skeletal topology to integrate information from visible joints, thereby alleviating performance degradation caused by occlusion. Moreover, the standard deviation in the Joint modality is substantially reduced from 11.29 to 2.81, further confirming the improved training stability under Spatial Random Occlusion scenarios.
On the NTU120 occlusion dataset, the Joint Motion and Bone Motion modalities achieved improvements of 1.66 and 1.16 percentage points, respectively. These results demonstrate that under spatially continuous and temporally consistent occlusion conditions, the proposed Occlusion Compensation Graph Convolution Module and Local–Global Body-Prior-Guided Attention mechanism synergistically enhance the model’s ability to capture dynamic temporal action variations and relative joint motion relationships. Consequently, the model maintains stable recognition performance even in scenarios with missing structural information.
Overall, experimental results on the occlusion benchmarks comprehensively validate the effectiveness of the proposed method under complex input conditions. By dynamically suppressing unreliable joints across both spatial and temporal dimensions, the Adaptive Body-Prior-Guided Drop substantially reduces sensitivity to anomalous inputs, thereby mitigating feature degradation induced by occlusion and detection errors. Under spatiotemporal continuous occlusion, the coordinated interaction between the Local–Global Body-Prior-Guided Attention mechanism, the feature-guided mechanism, and multi-hop mechanism enables more complete exploitation of structural information from visible joints. This facilitates robust inference of action semantics in occluded regions and alleviates performance loss arising from structural context disruption. Furthermore, the two occlusion datasets constructed in this study provide a systematic and controllable evaluation framework. By incorporating complementary occlusion mechanisms—Spatial Random Occlusion and Spatiotemporal Continuous Occlusion—they enable comprehensive training and assessment across diverse occlusion patterns, effectively reducing evaluation bias caused by insufficient or uneven occlusion distributions in standard data.
4.3.4. Validation on Real-World Missing Joints
While the synthetic occlusion benchmarks enable controlled evaluation, real-world joint losses caused by sensors exhibit more complex and less predictable patterns. To assess whether the robustness observed under synthetic settings transfers to practical scenarios, we further evaluate ROC-GCN on a real missing-joint subset of NTU RGB+D 120 (X-Sub).
The subset is obtained by intersecting the X-Sub test split with the official
samples_with_missing_skeletons.txt released with NTU RGB+D 120, which enumerates sequences containing missing or invalid joint coordinates in the raw Kinect output. Sequences with entirely absent joint data were discarded and only samples with partial joint loss were retained. No synthetic masking is applied. This yields 179 samples, for which we record the joint-visibility ratio
.
Figure 9 illustrates a representative real-world missing-joint sample.
As shown in
Table 6, ROC-GCN improves Top-1 accuracy by 3.36 percentage points on the full real-missing set, and the improvement scales with the severity of spatial loss, reaching
,
, and
on the
,
, and
subsets, respectively, indicating that the proposed compensation mechanisms are selectively activated precisely when the visible-joint set is small. These results confirm that the robustness observed on the synthetic spatial benchmarks transfers to naturally occurring sensor-induced joint losses.
4.3.7. Ablation Experiment
Table 8 reports the ablation results of each proposed module, using BPG-GCN as the baseline and progressively incorporating the adaptive dropout module, the Local–Global Body-Prior-Guided Attention (LG-BPGA) mechanism, and the combined multi-hop and feature-guided design.
Introducing the adaptive dropout module improves Top-1 and Top-5 accuracy by 0.55 and 0.39 percentage points, respectively. This module suppresses spatially noisy joints and temporally abnormal frames, thereby improving the quality of input data. The dynamic weight fusion mechanism adaptively adjusts the spatiotemporal discard ratio across different scenarios, enabling the model to flexibly handle various types of noise interference. Building on this, integrating the LG-BPGA mechanism yields a further 0.33 percentage point gain in Top-1 accuracy, reaching 89.56%. By modeling local body semantics and incorporating global information, the model better preserves structural coherence and compensates for missing information under occlusion. Finally, adding the multi-hop and feature-guided mechanisms further increases Top-1 accuracy by 0.28 percentage points, achieving 89.84%. It is worth noting that introducing the multi-hop and feature-guided mechanisms leads to a 0.06% drop in Top-5 accuracy, which lies within the seed-to-seed fluctuation range observed in our experiments. Meanwhile, Top-1 accuracy continues to improve by 0.28%, indicating that long-range aggregation contributes discriminative information rather than amplifying noise. By enlarging the graph receptive field and guiding feature propagation along skeletal topology, this component enhances long-range dependency modeling and improves robustness to structural information loss.