1. Introduction
Person re-identification aims to associate pedestrian images captured across non-overlapping camera views and serves as a fundamental component of intelligent surveillance systems. With the emergence of large-scale datasets such as Market-1501 and MSMT17, deep learning-based approaches have significantly advanced the field. Early CNN-based models, including IDE [
1], PCB [
2], and MGN [
3], improve representation learning through part-based modeling and multi-granularity supervision. More recently, Transformer-based architectures, such as TransReID [
4], PVT-based ReID [
5], and ViT-based adaptations [
6], further enhance global context modeling and achieve state-of-the-art performance under holistic settings. Despite these advances, occlusion remains a critical yet underexplored challenge in practical scenarios. In crowded environments, pedestrians are frequently partially occluded by other individuals, vehicles, or scene objects, leading to incomplete visual observations and corrupted feature representations. Performance degradation under occlusion has been widely observed on dedicated benchmarks such as Occluded-DukeMTMC and Partial-ReID.
As shown in
Figure 1, occluded person re-identification is challenged by both local discriminative dependency and severe occlusion interference. In cases (a) and (b), the key identity cues mainly lie in local regions, and relying too much on global information may mislead the model. In cases (c) and (d), the pedestrians are heavily occluded, so without proper handling, the model can be easily affected by noise and irrelevant regions. These examples illustrate the importance of both local feature modeling and occlusion-robust learning.
To address partial visibility, several studies propose part-alignment or region-selection strategies. Partial ReID [
7] introduces region matching for incomplete body images, while APH [
8] leverages alignment and hallucination mechanisms. Visibility-aware models such as VPM [
9] explicitly detect visible regions for matching, and SCPNet [
10] introduces spatial-channel parallel learning to enhance occlusion robustness. Other works, including PGFA [
11], HOReID [
12], and PAT [
13], attempt to model part-level correlations or graph relationships for robust representation learning. Additionally, data augmentation strategies such as random erasing [
14], Cutout [
15], and DropBlock [
16] are widely adopted to simulate occlusion during training.
Although these methods improve robustness to some extent, two fundamental limitations remain. First, most approaches rely on implicit attention mechanisms to handle occlusion without explicitly supervising part-level visibility reliability. As a result, occluded regions may still introduce noisy or misleading information during feature aggregation. Second, existing occlusion simulation strategies are typically random and unstructured, lacking controllability and semantic consistency. Random erasing-based methods cannot accurately reflect realistic obstruction patterns, thereby limiting generalization to real-world scenarios.
To overcome these challenges, we propose a unified framework termed Visibility-Guided and Occlusion-Simulated Learning (VGOSL) for robust person re-identification. The framework integrates two complementary components.
Our design is motivated by the observation that occluded person ReID requires not only local part modeling but also reliable estimation of which parts remain informative under occlusion. Existing part-based methods improve discriminative representation through local region partition and part-level feature learning, while adaptive feature weighting strategies enhance informative responses during feature aggregation. However, these mechanisms usually do not explicitly model the visibility reliability of each local part under occlusion. Based on this observation, our framework explicitly estimates part-level visibility reliability and further combines it with structured occlusion simulation to guide robust feature learning.
First, we design a part-aware visibility modeling (PVM) module to explicitly estimate the reliability of local part representations. By introducing patch-level visibility supervision, the model learns to predict part visibility scores and adaptively reweight local features during global aggregation. This mechanism suppresses unreliable regions while emphasizing informative parts, leading to more stable and discriminative representations under occlusion.
Second, we introduce an occlusion box simulation (OBS) module that generates structured and controllable occlusion patterns during training. Unlike random erasing-based strategies, OBS simulates realistic obstruction via structured occlusion boxes and adopts multi-branch supervision to encourage occlusion-invariant feature learning. The joint optimization of PVM and OBS enables the model to learn visibility-aware and occlusion-robust representations in a unified manner.
Extensive experiments on five widely used benchmarks, including Occluded-DukeMTMC, DukeMTMC-reID, Market-1501, Partial-ReID, and MSMT17, demonstrate that the proposed framework achieves competitive performance under both holistic and occluded settings, validating the effectiveness and generalization capability of explicit visibility modeling and structured occlusion simulation. The main contributions of this work are summarized as follows:
We propose a unified occlusion-robust ReID framework, VGOSL, integrating visibility-aware feature aggregation and structured occlusion simulation.
We design a part-aware visibility modeling (PVM) module that explicitly supervises part-level reliability and guides adaptive global representation learning.
We introduce an occlusion box simulation (OBS) module to generate structured and controllable occlusion patterns for robust multi-branch learning.
Extensive evaluations on both holistic and occlusion benchmarks verify the effectiveness and generalization capability of the proposed approach.
The remainder of this paper is organized as follows:
Section 2 RELATED WORK reviews related work on occlusion-robust person re-identification and occlusion simulation strategies.
Section 3 Methods presents the proposed VGOSL framework, including the PVM and OBS modules as well as the overall training objective.
Section 4 EXPERIMENTS reports the experimental settings, comparison results, ablation studies, and visualization analyses. Finally,
Section 5 concludes this paper.
4. Experiments
4.1. Dataset Introduction
We evaluate the proposed VGOSL framework on five widely-used person re-identification benchmarks, including Occluded-Duke [
11], DukeMTMC-reID [
31], Market1501 [
1], Partial-ReID [
7], and MSMT17 [
32].
Occluded-Duke is a challenging occlusion-focused benchmark derived from DukeMTMC-reID. It contains 15,618 training images of 702 identities. For evaluation, it includes 2210 occluded query images and 17,661 gallery images. It is specifically designed to assess person re-identification performance under severe occlusion.
DukeMTMC-reID is a large-scale person re-identification dataset collected from 8 cameras. It contains 36,411 images of 1404 identities in total. Following the standard DukeMTMC-reID setting, the training set includes 16,522 images of 702 identities. For evaluation, 17,661 images of another 702 identities are used for testing, including 2228 query images and the remaining gallery images. This benchmark is widely used for evaluating person re-identification performance under multi-camera scenarios.
Market-1501 consists of 32,668 images of 1501 identities captured from 6 cameras. The training set contains 12,936 images of 751 identities, while the evaluation is conducted with 3368 query images and 19,732 gallery images from the remaining 750 identities.
Partial-ReID contains 600 images of 60 identities, with 5 holistic images and 5 partial images for each identity. During evaluation, partial images are used as probe images, while holistic images serve as gallery samples, making it suitable for assessing partial person matching performance.
MSMT17 is a large-scale and challenging benchmark consisting of 126,441 images of 4101 identities captured from 15 cameras. The training set includes 32,621 images of 1041 identities, while the test set consists of 11,659 query images and 82,161 gallery images from 3060 identities.
4.2. Evaluation Metrics
Following standard ReID evaluation protocols, we adopt Cumulative Matching Characteristics (CMCs) [
33] and mean Average Precision (mAP) [
34] as the evaluation metrics. CMC measures whether at least one correct match appears within the top-k retrieved results, and Rank-1 accuracy is reported to reflect the probability that the correct identity is retrieved at the first position. In addition, mAP provides a more comprehensive evaluation of retrieval performance by considering both the precision and the ranking positions of all correct matches for each query. Therefore, CMC emphasizes top-rank matching capability, while mAP better reflects the overall ranking quality of the retrieval system.
4.3. Experimental Settings
All experiments are conducted on a server equipped with an NVIDIA vGPU with 32 GB of memory (Nvidia, Santa Clara, CA, USA). The models are implemented in PyTorch (2.3.0) and trained on a single GPU. We adopt a Transformer-based backbone instantiated by ViT-B/16 [
6]. The stride size is set to 12 × 12. All input images are resized to 256 × 128 during both training and testing. Data augmentation includes random horizontal flipping (probability 0.5), padding of 10 pixels, and random erasing (probability 0.5). Pixel normalization is applied with mean [0.5, 0.5, 0.5] and standard deviation [0.5, 0.5, 0.5].
We employ the softmax-triplet sampler with 4 instances per identity in each mini-batch. The batch size is set to 32 for training and 256 for testing. The model is optimized using stochastic gradient descent with momentum 0.9 and weight decay
. The initial learning rate is set to 0.008 and linearly warmed up at the beginning of training. The total training duration is 120 epochs, and evaluation is conducted every 10 epochs. The source code has been publicly released at:
https://github.com/wangchunfengc/VGOSL (accessed on 10 May 2026).
4.4. Comparison with State-of-the-Art Methods
We compare the proposed VGOSL framework with recent state-of-the-art methods on six widely used benchmarks. For fair comparison, we report the results under the standard evaluation protocols of each dataset. The comparison is organized into three groups according to dataset characteristics.
4.4.1. Duke-Family Benchmarks
DukeMTMC-reID and Occluded-Duke share the same identity pool and camera setup, where Occluded-Duke can be regarded as an occlusion-augmented variant of DukeMTMC-reID. Therefore, we group them together to evaluate both holistic and occluded scenarios under a consistent data distribution. As shown in
Table 1, we compare VGOSL with recent transformer-based and occlusion-aware methods, including RTGAT [
19], CTU [
35], MSAMGO [
36], CA-Jaccard [
37], SSPEM [
38], FCDA [
39], IPCBReID [
40], MTIPE [
41], HDA-Net [
42], FOSENet [
43], POFR [
44], OA-ReID [
45] and MDFA [
46]. On DukeMTMC-reID, VGOSL achieves competitive performance compared with these strong baselines. On the more challenging Occluded-Duke benchmark, VGOSL achieves competitive performance compared with recent state-of-the-art methods, especially in terms of mAP, demonstrating the effectiveness of part-aware visibility modeling under partial occlusion.
4.4.2. Large-Scale Holistic Benchmarks
Market1501 and MSMT17 are large-scale holistic benchmarks that focus on identity scalability and diverse camera conditions rather than explicit occlusion modeling. We group them together to evaluate the generalization ability of VGOSL.
Table 2 compares VGOSL with strong transformer-based baselines such as RTGAT [
19], CTU [
35], MSAMGO [
36], CA-Jaccard [
37], SSPEM [
38], FCDA [
39], MTIPE [
41], HDA-Net [
42], POFR [
44], OA-ReID [
45], COFD-Net [
51], IPCBReID [
40], MSPL [
52], and MBDBFormer [
53] VGOSL achieves competitive or superior results on both datasets, demonstrating that the proposed occlusion simulation and visibility-guided aggregation do not degrade holistic retrieval performance and maintain strong scalability on large identity sets.
4.4.3. Small-Scale Partial Person Benchmarks
In addition to large-scale holistic datasets, we further evaluate VGOSL on small-scale partial person benchmarks, where probe images often contain severe occlusions or truncated body regions. Compared with conventional large-scale ReID datasets, these benchmarks are characterized by limited training samples and a higher degree of local information corruption, making them particularly challenging for robust feature learning. As reported in
Table 3, we compare VGOSL with representative partial or occlusion-aware methods, including DSR [
56], PGFA [
11], PFT [
57], CTU [
35], POFR [
44] and MSPL [
52]. Despite the reduced data scale and increased difficulty, VGOSL consistently achieves competitive or superior performance across these benchmarks. This improvement can be attributed to the explicit modeling of part reliability and the adaptive reweighting mechanism, which suppress unreliable local responses and enhance discriminative visible regions. Such design enables VGOSL to construct more robust global representations under extreme partial observation conditions.
4.5. Ablation Study
4.5.1. Module Ablation
To verify the contribution of each core module to the overall performance, we conduct module ablation experiments on the Occluded-Duke dataset, and the results are reported in the
Table 4. The baseline model achieves 54.1% mAP and 65.0% Rank-1. After introducing the PVM module, the performance improves significantly to 61.8% mAP and 71.5% Rank-1, corresponding to gains of 7.7 percentage points and 6.5 percentage points over the baseline, respectively. Furthermore, when the OBS module is individually added to the baseline, the model achieves 62.0% mAP and 71.8% Rank-1, which are 7.9 percentage points and 6.8 percentage points higher than the baseline. When both PVM and OBS are jointly introduced, the model further improves to 63.1% mAP and 72.8% Rank-1, achieving the best performance among all configurations. Compared with the baseline, the overall improvement reaches 9.0 percentage points in mAP and 7.8 percentage points in Rank-1. These results indicate that PVM and OBS exhibit good complementarity. Overall, both modules independently bring stable performance gains, while their combination yields the best results, thereby validating the effectiveness and rationality of the proposed design.
4.5.2. Ablation on the Number of Partitions
To analyze the effect of the partition number on non-model performance, we conduct ablation experiments with different partition settings on the Occluded-Duke dataset, and the results are reported in
Table 5. When
N = 1, the model achieves 62.6% mAP and 70.6% Rank-1, indicating that coarse-grained local modeling alone is still insufficient for capturing fine-grained discriminative cues under occlusion. As the number of partitions increases, the overall performance shows an initial improvement followed by slight fluctuations. When
N = 2, the model reaches 62.7% mAP and 71.5% Rank-1. Further increasing the number to
N = 3 improves the mAP to 63.2%, while the Rank-1 slightly drops to 71.4%. When
N = 4, the model achieves 63.1% mAP and 72.8% Rank-1, yielding the best Rank-1 performance among all settings while maintaining a high mAP level. Although the mAP at
N = 3 is 0.1 percentage points higher than that at
N = 4, its Rank-1 is noticeably lower. This suggests that a smaller number of partitions may offer a marginal advantage in overall retrieval precision, but it is less effective in terms of the most critical top-1 matching accuracy. When the partition number is further increased to
N = 5 and
N = 6, the performance no longer improves and instead declines to 62.8%/72.1% and 63.0%/71.4%, respectively. This indicates that excessive partitioning may overly fragment local regions, weakening the semantic completeness contained in each part and introducing more noise and instability, which is unfavorable for robust feature learning.
Overall, an appropriate partition strategy helps enhance the modeling of locally visible regions and thus improves discriminative robustness in occluded scenarios. As shown in
Table 5, increasing the number of partitions generally brings performance gains by enabling finer-grained local representation learning. When comparing
and
, the mAP of
is only 0.1 percentage points lower than that of
, while its Rank-1 accuracy is improved by 1.4 percentage points. This indicates that
achieves a better balance between overall retrieval accuracy and top-ranked matching performance. Therefore, we finally choose
as the optimal partition setting.
4.6. Visualization Analysis
4.6.1. t-SNE Feature Distribution Visualization Analysis
To provide an intuitive understanding of the discriminative ability of the learned features, we perform t-SNE visualization on the extracted embeddings. Specifically, we randomly select 30 person identities from the test set and project their high-dimensional features into a two-dimensional space for comparison between the baseline and the proposed method.
As shown in
Figure 4, the feature distributions produced by the baseline exhibit noticeable overlap among several identities. In particular, the samples highlighted by the dashed circle are mixed together in the embedding space, indicating that the baseline fails to sufficiently separate some visually similar or heavily occluded identities. Such ambiguous decision boundaries suggest limited discriminative power under challenging occlusion scenarios.
In contrast, the feature embeddings generated by our method form more compact intra-class clusters and clearer inter-class separations. Most identities are well grouped with reduced overlap between different categories, demonstrating that the proposed method learns more discriminative and robust representations. This improvement can be attributed to the enhanced modeling of visible local regions and the strengthened ability to suppress interference caused by occluded or noisy regions.
Overall, the t-SNE visualization qualitatively verifies that our method produces a more separable feature space than the baseline, which is consistent with the quantitative improvements observed in the retrieval results.
4.6.2. Retrieval Visualization Analysis
To further evaluate the practical retrieval behavior of the proposed method, we visualize the top-ranked retrieval results of the baseline and our method on the test set, as shown in
Figure 5. Specifically, we present two successful cases in (c) and (d), as well as two failure cases in (a) and (b). In each group, the first row corresponds to the baseline, while the second row corresponds to our method. The images with green borders denote correct matches, whereas those with red borders indicate incorrect retrievals.
As shown in the successful cases, our method generally yields more accurate and stable retrieval results than the baseline. In particular, in case (d), the proposed method demonstrates a stronger ability to capture discriminative fine-grained details under challenging conditions. Although the probe image suffers from occlusion, our method still retrieves more correct matches at higher ranks, while the baseline makes an incorrect Rank-1 prediction under severe occlusion. This suggests that the proposed method is more effective in focusing on informative visible regions and suppressing interference from occluded or irrelevant areas.
At the same time, the failure cases further reveal the limitations of both methods in extremely challenging scenarios. In case (a), although our method achieves a noticeably higher retrieval success rate than the baseline overall, incorrect matches still appear in the top-ranked results. A closer inspection shows that, under severe occlusion, the wrongly retrieved samples share highly similar local appearance details with the query, which makes them difficult to distinguish. This indicates that when only limited visual cues are available, both methods may still confuse identities with highly similar fine-grained characteristics.
Overall, the retrieval visualizations demonstrate that the proposed method improves the ranking quality and matching robustness compared with the baseline, especially in occluded scenarios. Nevertheless, the failure examples also suggest that there is still room for improvement in finer-grained identity discrimination, particularly when different pedestrians exhibit highly similar local textures, poses, or visible body parts under heavy occlusion.
4.6.3. Intra-Class/Inter-Class Distance Distribution Analysis
To further investigate the discriminative capability of the learned features, we visualize the distributions of intra-class and inter-class distances for the baseline and the proposed method. As shown in
Figure 6, the blue histogram denotes the intra-class distance distribution, while the orange histogram represents the inter-class distance distribution.
From the baseline distribution, although the intra-class and inter-class distances are generally separable, there still exists a noticeable overlap region between the two distributions. This indicates that the baseline may still confuse some hard positive and hard negative samples, leading to limited discriminative power in challenging scenarios. In contrast, the proposed method exhibits a clearer separation between the two distributions. The intra-class distances are more concentrated in a lower-distance region, while the inter-class distances are distributed farther away, resulting in a larger margin between the two groups.
In particular, the distance gap increases from 0.493 in the baseline to 0.583 in our method. The enlarged separation margin suggests that the proposed model is able to pull samples from the same identity closer together while pushing samples from different identities farther apart. Therefore, the learned embedding space becomes more discriminative and structured, which directly reflects the stronger class separability of our method.
Overall, the intra-class/inter-class distance visualization provides intuitive evidence that the proposed method achieves higher inter-class discrimination and better intra-class compactness than the baseline, thereby contributing to more reliable person re-identification under challenging conditions.
4.6.4. Hyper-Parameter Sensitivity Analysis
To analyze the effect of the hyper-parameter
, we vary it from 0.1 to 2.1 and report the corresponding mAP and Rank-1 results in
Figure 7. It can be observed that the model achieves the best performance when
= 1.3. Meanwhile, the performance remains relatively stable across the entire interval, without obvious fluctuations. This indicates that the proposed method is robust to the choice of
and does not require highly sensitive hyper-parameter tuning. Therefore,
= 1.3 is selected as the default setting in our experiments.
4.6.5. Model Complexity Analysis
To further analyze the complexity of the proposed method, we compare different models in terms of parameter size and FLOPs, as shown in the
Table 6. It can be observed that our method contains 93.090 M parameters, which is still relatively compact compared with some existing methods. This indicates that, although additional occlusion-aware and visibility-related modules are introduced, the overall parameter scale remains at an acceptable level without causing excessive parameter growth.
Meanwhile, the FLOPs of our method increase to 64.1314 G, compared with 20.8005 G for the baseline. The main reason for this increase is not that the backbone itself becomes excessively complicated, but that our method adopts a multi-input strategy during the forward process. Specifically, the model takes the original image, cropped image, and randomly erased image as inputs simultaneously. Since all three inputs need to pass through feature extraction and subsequent representation learning stages, the overall computational cost increases substantially. Therefore, the rise in FLOPs is mainly caused by the use of multiple input branches rather than by a significant expansion of the model parameters.
Despite the increased computational cost, our method achieves better retrieval performance, reaching 72.8% Rank-1 and 63.1% mAP. This suggests that the additional computation is effectively used to enhance occlusion modeling and fine-grained feature representation, thereby leading to more discriminative and robust retrieval results. Overall, the proposed method achieves a favorable balance among model size, computational complexity, and recognition performance.
To further verify whether the multi-input strategy is necessary during testing, we additionally evaluate an original-only inference setting. Specifically, the final trained weights are loaded, while only the original image is used during inference. As shown in
Table 6, the original-only setting requires only one forward pass per image and reduces the inference time from 6.783 ms/img to 3.541 ms/img. Meanwhile, it achieves the same Rank-1 accuracy of 72.8% and mAP of 63.1% as the multi-input setting. This indicates that the occlusion-simulated inputs mainly serve as an auxiliary regularization strategy during training, helping the original-image branch learn more robust occlusion-aware representations. Therefore, the proposed method can be simplified to original-only testing for practical deployment without requiring multiple forward passes at test time.
4.6.6. Heatmap Visualization Analysis
To further investigate the attention behavior of the model under occluded conditions, we visualize the activation heatmaps of the baseline and VGOSL on several representative examples, as shown in
Figure 8. From the figure, it can be observed that our method exhibits more accurate and stable responses to discriminative pedestrian regions.
For cases (a), (b), and (d), the upper body of the target pedestrian remains largely visible without severe occlusion. In these examples, the heatmaps generated by VGOSL focus more consistently on the overall human body regions, especially the visible upper-body structure and appearance cues. Compared with the baseline, our method produces more concentrated and semantically meaningful activations, indicating a stronger ability to capture informative pedestrian features rather than irrelevant background responses.
For cases (c) and (e), the target pedestrian is partially occluded by other nearby persons, making the identification task more challenging. Under such conditions, the baseline is more easily distracted by surrounding pedestrians, and part of its attention is shifted to interference regions, which may weaken the discriminative representation of the target identity. In contrast, VGOSL can still accurately focus on the target pedestrian and emphasize the visible local body parts that remain informative. This suggests that our method is better at suppressing interference from occluding persons and exploiting local visible cues for robust person identification.
Overall, the heatmap visualizations demonstrate that the proposed method can attend to more relevant pedestrian regions under both mild and severe occlusion. Especially in crowded or partially occluded scenarios, it shows stronger target awareness and local discriminative modeling ability, which further explains its superior retrieval performance.