1. Introduction
Vegetation plays a fundamental role in carbon cycling, local climate regulation, urban heat island mitigation, and biodiversity maintenance [
1,
2,
3]. Therefore, its boundary delineation and spatial distribution extraction are directly related to applications such as urban ecological assessment, land use/cover change monitoring, forest phase analysis, and precision agriculture [
4,
5,
6]. High-resolution remote sensing (RS) imagery can provide more detailed canopy texture and ground object boundary information and has become an important data source for vegetation remote sensing research [
7,
8]. With the popularization of commercial satellites and unmanned aerial vehicle (UAV) platforms, the cost of acquiring high-resolution near-ground or aerial imagery continues to decrease, but higher spatial detail also means stronger inter-class confusion and boundary uncertainty [
9,
10,
11,
12].
However, this also significantly increases the difficulty of automatically extracting target features. Traditional classification algorithms based on spectral features (such as Normalized Difference Vegetation Index (NDVI), threshold methods based on hue–saturation–value (HSV) color space, and clustering) perform reasonably well when facing simple backgrounds and images with significant spectral differences at medium to low resolutions. However, when applied to high-resolution imagery, due to the intensification of “same object different spectrum” and “different object same spectrum” phenomena, the boundaries between vegetation and non-vegetation ground objects become blurred, and the segmentation accuracy and robustness of traditional methods significantly decline [
13,
14,
15]. In recent years, deep learning (DL) technologies represented by deep convolutional neural networks (CNNs) have demonstrated powerful multi-level feature learning and pattern recognition capabilities, achieving breakthrough progress in the field of remote sensing semantic segmentation [
16,
17,
18,
19]. For example, the classic U-Net [
20] and DeepLabV3+ [
21], which incorporates atrous spatial pyramid pooling modules, can significantly surpass the segmentation effects of classic image processing algorithms when sufficient high-quality manually annotated pixel-level training data is obtained (as shown in
Figure 1).
Although fully supervised deep learning models have shown excellent performance in vegetation extraction tasks, their practical applications still face obvious bottlenecks [
22,
23]. On one hand, pixel-level manual annotation of remote sensing imagery is an extremely time-consuming and expensive task, especially in dynamic monitoring tasks involving multi-temporal and multi-scale scenarios, making it extremely difficult to construct a sufficiently large high-quality annotation library [
24,
25]. If training is conducted directly under data scarcity (i.e., “small-sample”) conditions, the above-mentioned fully supervised models with large parameters are highly prone to severe overfitting, leading to a cliff-like decline in cross-regional or cross-domain generalization capabilities [
26,
27]. Recent few-shot remote sensing benchmarks further show that limited labeled data remain a central obstacle for robust semantic segmentation, especially when models must preserve both base-class performance and adaptation to new land-cover patterns [
28]. Therefore, reducing annotation dependence requires not only stronger segmentation architectures but also more efficient use of the available training data. Existing studies have addressed this issue along two related lines. One line focuses on selecting more representative training samples; for example, grouped sample selection in multispectral remote sensing classification can improve accuracy with fewer labeled samples [
29]. Another line focuses on dataset quality control for deep CNN training, where low-quality or weakly informative samples are filtered to improve learning efficiency without sacrificing accuracy [
30]. These studies indicate that the composition and reliability of the training set are especially important when high-resolution annotations are limited. In the present study, this idea is extended to cross-temporal vegetation segmentation by using confidence-filtered pseudo-labels from unlabeled temporal imagery to enlarge the effective supervision set while controlling label noise.
To address the data scarcity crisis brought by small-sample annotation, vision foundation models have entered the research horizon as a completely new technical paradigm [
31]. In 2023, Meta AI released the “Segment Anything Model” (SAM) [
32], which, through pre-training on the massive real-world Segment Anything 1 Billion (SA-1B) dataset, demonstrated unprecedented zero-shot and few-shot segmentation potential. Subsequently, to overcome the high computational overhead of the original SAM, lightweight foundation networks and derivative structures, including MobileSAM [
33], SAM2-Tiny [
34], and the updated SAM2.1 were successively proposed, further improving inference efficiency on edge devices and scene segmentation performance [
35,
36,
37]. Recent studies have also explored how SAM-type foundation models can be adapted to remote sensing semantic segmentation through object/boundary constraints, multimodal adapters, and lightweight geospatial-domain initialization for onboard deployment [
38,
39,
40]. Additionally, open-vocabulary segmentation models such as SegEarth-OV [
41] attempt to break free from the burden of heavy pixel annotation through cross-modal text prompts, while recent open-vocabulary remote sensing segmentation research has further highlighted the need to combine general vision–language priors with remote sensing domain features [
42]. The latest instance segmentation architecture of the YOLO series, YOLO11s-seg, combines multi-target localization with pixel-level instance mask extraction [
43].
Although these novel deep learning architectures and vision foundation networks have demonstrated impressive results on their respective domains’ standard benchmarks, for the vertical task of vegetation segmentation in high-resolution remote sensing imagery under “small-sample” extreme conditions, the academic community still lacks comprehensive and in-depth systematic comparative evaluation [
44,
45,
46]. Specifically, what are the performance limits of different paradigms (foundation models vs. fully supervised models vs. open-vocabulary models vs. instance segmentation models) under small-sample constraints? Are there systematic differences in their generalization capabilities when facing cross-regional public remote sensing datasets with different lighting and climate characteristics? More importantly, how can we efficiently and cost-effectively utilize the abundant unlabeled image resources in temporal remote sensing data to further improve the small-sample learning effects of foundation models? These urgent real-world questions still lack quantitative verification and scientific conclusions [
47,
48,
49,
50].
To fill the above research gaps and solve the small-sample application dilemma in vegetation monitoring, this study uses high-resolution red–green–blue (RGB) remote sensing imagery (0.75 m resolution) from the Nanjing Zijinshan region from 2022 to 2024 as the core test platform, systematically evaluating and comparing the performance of eight currently highly representative deep learning networks in small-sample vegetation segmentation tasks. These eight networks cover fine-tuned vision foundation model series (SAM2-Tiny, SAM2.1-Tiny, MobileSAM, MobileSAMV2), classic feature encoding–decoding fully supervised models (UNet, DeepLabV3+), open-vocabulary segmentation models (SegEarth-OV), and efficient instance segmentation models (YOLO11s-seg).
The cross-dataset comparisons in this study are not intended to serve as dataset-independent leaderboard results alone, because the mean Intersection over Union (mIoU) depends on sensor characteristics, spatial resolution, geographic domain, annotation style, and acquisition conditions. Instead, they are used to examine how different model paradigms respond to realistic domain shifts after being trained under the same small-sample vegetation segmentation protocol. The key distinction of this research is therefore the combination of a self-constructed multi-temporal Zijinshan vegetation dataset, a unified training and inference setting, cross-domain robustness testing, and Cross-Temporal Pseudo-Label Self-Training (CT-PLST) with unlabeled temporal imagery under scarce annotation conditions.
Based on the above motivations, the main research contributions of this paper can be summarized by the following four aspects:
Systematic Model Comparison Innovation: This study comprehensively compares eight mainstream models within a unified high-resolution remote sensing small-sample experimental framework, covering vision foundation models (SAM2 series, MobileSAM series), classic fully supervised models, open-vocabulary models, and instance segmentation models, and clarifies the performance boundaries and applicable conditions of different paradigms in vegetation segmentation under small-sample constraints [
51,
52,
53,
54,
55].
Vision Foundation Model Generalization Verification: In a high-resolution remote sensing small-sample environment, this study systematically shows that fine-tuned SAM2.1-Tiny and SAM2-Tiny achieve optimal accuracy, the strongest stability, and the best cross-dataset generalization capability in vegetation segmentation. Cross-validation on three public remote sensing datasets (LoveDA, Potsdam, Vaihingen) provides strong quantitative evidence for the practical application of foundation models and offers an evidence-based model selection basis for researchers [
56,
57,
58,
59,
60].
Cross-Temporal Pseudo-Label Self-Training Strategy Innovation: Addressing the reality of scarce remote sensing annotations and abundant multi-temporal data, we propose the CT-PLST method. This innovative strategy effectively utilizes unlabeled temporal imagery to improve model performance, increasing SAM2-Tiny’s mIoU from 0.7776 to 0.7888 (+1.44%), providing a low-cost efficiency enhancement solution for small-sample remote sensing tasks and revealing the practical role of temporal self-supervision in alleviating annotation scarcity [
61,
62,
63,
64,
65].
Open-Source Dataset and Engineering Guidance: We construct and open-source the Nanjing Zijinshan multi-temporal high-resolution vegetation segmentation dataset while publicly releasing the complete set of fine-tuned models, comparative experiment code, and model configurations. We provide lightweight deployment recommendations from multiple dimensions including accuracy, speed, resource consumption, and stability, offering directly implementable engineering references for practical tasks such as ecological monitoring and forestry surveys, significantly improving research transparency and application accessibility in this field [
66,
67].
The remainder of this paper is organized as follows.
Section 2 presents the materials and methods.
Section 3 describes the experimental setup and results.
Section 4 discusses the model differences, CT-PLST, and practical implications. Finally,
Section 5 summarizes the main findings, limitations, and future research directions.
2. Materials and Methods
2.1. Deep Learning Segmentation Models
Feature extraction is the cornerstone of modern remote sensing image semantic segmentation tasks. In this study, eight representative models were selected to cover classical fully supervised semantic segmentation, lightweight vision foundation models, open-vocabulary segmentation, single-stage instance segmentation, and fine-tuned foundation model paradigms. These models were evaluated under the same dataset split, image size, training protocol, and metric system to ensure a fair comparison. Their main architectural characteristics, technical paradigms, and task-specific roles are summarized in
Table 1.
In addition to the eight models used in the main controlled comparison, four recent foundation- and prompt-based models were evaluated as supplementary experiments to broaden the model scope. DINOv2 ViT-L/14-Reg and DINOv3 ViT-L/16 were tested as frozen-backbone dense segmentation models with lightweight trained segmentation heads, reflecting the recent progress of self-supervised visual foundation backbones with dense feature transferability [
68,
69]. QwenVL2.5-3B and LocateAnything-3B were evaluated separately as prompt-based localization or grounding models; their predicted boxes were converted into coarse binary masks only for box-mask metric calculation. The inclusion of QwenVL2.5-3B follows recent progress in vision–language models with structured localization ability [
70]. Therefore, these two prompt-based models are reported as supplementary evidence rather than as direct replacements for dense semantic segmentation networks.
2.2. Vegetation Segmentation Strategy Using Deep Learning Models
Based on the aforementioned models, this study deploys a systematic experimental diagnostic workflow including data flow slicing, fine-tuning strategy configuration, and cross-domain inference generalization (with the overall system structure shown in
Figure 2).
In standard DL segmentation processes, extremely small amounts of manually annotated data (small-sample constraints) cause all models, even fully supervised networks’ backbones, to exhibit severe overfitting effects and statistical bias phenomena. To break through this constraint, this section focuses on explaining the core innovative method of this paper: the Cross-Temporal Pseudo-Label Self-Training (CT-PLST) mechanism. This method addresses the reality of high remote sensing image annotation costs but abundant multi-temporal data, innovatively designing a teacher–student distillation framework that significantly improves foundation model segmentation accuracy driven by extremely small amounts of annotations while maintaining high confidence by effectively activating massive unlabeled temporal image resources in the same region, providing a low-cost, high-efficiency enhancement solution for small-sample remote sensing tasks (workflow shown in
Figure 3) [
27,
31].
The CT-PLST mechanism is designed as a rigorous teacher–student two-stage distillation process. Let represent the labeled dataset containing extremely small amounts of accurately annotated historical imagery (e.g., 2022–2023), and let represent massive unlabeled new temporal long-scroll remote sensing data (e.g., 2024).
Stage 1: Teacher Model Optimal Fitting and Label Inference.
On the foundation backbone (such as fine-tuned SAM2-Tiny, etc.), iterative supervised learning is performed through the labeled dataset to obtain the “teacher model weights” at the peak validation set accuracy. Subsequently, is used to perform frame-by-frame forward inference on the massive unlabeled set , generating prediction posterior probability distribution matrices containing classification confidence. To eliminate pseudo-artifacts from mis-segmentation, we use confidence threshold to filter pseudo-labels; combining threshold ablation results, this paper finally sets to 0.70 as the default setting for CT-PLST:
Here,
is a pseudo-label confidence threshold rather than the ordinary 0.5 probability cutoff used for final binary mask generation during unified inference. Its value was selected according to three criteria: retaining enough temporal samples for self-training, suppressing low-confidence boundary and shadow errors, and achieving the best performance trade-off in the threshold ablation. This confidence-based filtering is consistent with common semi-supervised segmentation practice, where high-confidence predictions are treated as reliable pseudo-labels, whereas low-confidence or unreliable predictions are suppressed, separated, or purified before being used for training [
32,
71,
72]. Multi-threshold image binarization is widely used in remote sensing when vegetation or other land-cover classes are separated from spectral indices or grayscale response maps. In CT-PLST, however, thresholding is applied to model posterior confidence to control pseudo-label reliability, so the threshold is determined by pseudo-label quality and ablation performance rather than by the histogram distribution of raw image intensities.
where
represents the predicted probability that the
k-th pixel of the
j-th unlabeled image belongs to class
c (e.g., vegetation or not). Only when the probability breaks through the
threshold can it be legally converted to a deterministic strong pseudo-class
.
Stage 2: Student Network Retraining Joint Iteration.
We forcibly bind the extracted high-quality pseudo-label set
with the gold standard set
for joint training iteration (retraining) by the pre-initialized “student model”
. In this joint cycle, the student model’s generalization ability is greatly enhanced due to constraints from expanded multi-temporal physical geomorphological features [
32,
34]. The overall constraint loss function used for end-to-end network iteration is
where
adopts standard pixel-level cross-entropy loss to separately calculate the distance deviation between the supervised component and teacher-specified labels. This paper fixes
at 1.0; i.e., the supervised term and pseudo-label term adopt equal-weight fusion to prevent the unsupervised branch from excessively dominating optimization in early training.
2.3. Dataset
To evaluate the model and the proposed self-training framework’s high-resolution generalization capability, this study uses one self-constructed multi-temporal dataset and three public remote sensing semantic segmentation datasets. The Zijinshan dataset serves as the core few-shot training and same-domain temporal testing dataset, while LoveDA, Potsdam, and Vaihingen are used for cross-dataset robustness assessment under different spatial resolutions, urban structures, and vegetation–background distributions. Representative samples from the Zijinshan dataset are shown in
Figure 4, and the main dataset characteristics are summarized in
Table 2.
2.4. Evaluation Criteria
For the pixel-level segmentation task, we adopted a standard confusion-matrix-based evaluation system, including Precision, Recall, F1-score, mean Intersection over Union (mIoU), and overall Accuracy. These metrics emphasize different aspects of segmentation performance. Precision measures how many of the pixels predicted as vegetation are reliable, whereas Recall focuses on how much of the real vegetation area is recovered. F1-score provides a compromise between the two and reflects the balance between missed detections and false detections. In this study, mIoU is used as the core metric because it directly measures the spatial overlap between the predicted masks and the manual annotations, which is more consistent with the practical requirements of segmentation tasks. Overall accuracy is reported only as a supplementary reference for describing the general consistency of pixel-level classification and is not used as the main basis for model ranking.
To ensure comparability among different models, the evaluation split, model input size, and inference procedure were fixed within each dataset, and no post-processing operation was applied. The same metric calculation script was used for both the local Zijinshan dataset and the three public datasets used for generalization testing, thereby reducing potential bias introduced by manual intervention.
4. Discussion
Based on the experimental results in the previous section, this section further analyzes the deep mechanisms of different models’ performance in small-sample remote sensing vegetation segmentation tasks from the perspective of understanding why such results are obtained, systematically revealing the internal determining factors of performance differences. Unlike simply listing numerical values, this section focuses more on the coupling relationship between model structure, training methods, cross-domain migration capabilities, and deployment constraints, discovering the design logic and application boundaries of different technical paradigms through comparative analysis.
The results show that SAM2 series models achieved better performance in final IoU and F1 scores, while MobileSAM series have more advantages in speed and resource occupation. DeepLabV3+ and UNet, as classic fully supervised models, can still output stable results but are easily affected by local texture bias in complex boundaries and cross-temporal scenarios. YOLO11s-seg and SegEarth-OV, respectively, reflect the boundaries of instance segmentation paradigm and open-vocabulary paradigm in continuous semantic segmentation problems.
The more important methodological point is that CT-PLST should not be interpreted as a completely new self-training family, but as a task-specific adaptation of classical pseudo-label learning to cross-temporal remote sensing data. In Lee’s pseudo-label framework, unlabeled samples are assigned hard labels by the current model and then folded back into supervised learning [
31]; CT-PLST follows this hard-label idea, but the novelty lies in using temporally separated imagery from the same region as a structured source of unlabeled data, so the additional supervision comes from seasonal appearance change rather than from merely expanding the sample count. Noisy Student also uses teacher-generated pseudo-labels, but it emphasizes repeated teacher–student iteration together with injected noise and large-scale data augmentation on largely in-distribution samples [
34]. In contrast, CT-PLST keeps the teacher stage explicitly tied to the best validation checkpoint, filters pseudo-labels by a confidence threshold, and then re-trains on cross-temporal imagery to confront seasonal drift, brightness change, and boundary perturbation. FixMatch is even closer in spirit to consistency regularization: it couples weak and strong augmentations of the same image and enforces agreement under confidence filtering [
32]. CT-PLST does not optimize a weak/strong augmentation consistency objective; instead, it transfers high-confidence predictions across time, so the supervisory signal is temporal consistency rather than augmentation consistency. Therefore, the core contribution of CT-PLST is not a new loss form, but a more suitable data construction strategy for remote sensing scenes where unlabeled images naturally arrive as time series.
This also matters for the cross-dataset discussion, because the same model can look strong on one domain yet weak on another when spatial resolution changes. In that sense, CT-PLST demonstrates how to exploit temporal structure, but the cross-dataset section shows that resolution remains an independent axis of robustness that is not solved by pseudo-labeling alone.
This distinction also explains why the gain is modest rather than dramatic. Self-training methods usually produce the largest gains when the baseline is weak or when the unlabeled data distribution is very rich but the pseudo-label quality remains controllable. Here, SAM2-Tiny already starts from a strong foundation-model prior, so there is less headroom for absolute mIoU growth. The observed +1.44% gain is therefore better understood as a robustness-oriented improvement: it comes from reduced missed boundaries, more stable masks under temporal shift, and better exploitation of unlabeled imagery, not from a wholesale redesign of the segmentation pipeline. In this sense, the value of CT-PLST is that it converts the temporal dimension itself into a supervision source, which is particularly appropriate for remote sensing scenarios where appearance changes are driven by season, illumination, and acquisition date rather than by random augmentation alone.
5. Conclusions
This paper focuses on the small-sample vegetation segmentation problem in high-resolution remote sensing imagery. Combined with Zijinshan’s own multi-temporal data and public datasets such as LoveDA, Potsdam, and Vaihingen, it systematically compares eight representative models, including SAM2-Tiny, SAM2.1-Tiny, MobileSAM, MobileSAMV2, UNet, DeepLabV3+, YOLO11s-seg, and SegEarth-OV, within a unified experimental framework under small-sample conditions, clarifying the performance boundaries and application limitations of foundation models, traditional convolutional networks, open-vocabulary models, and instance segmentation models in vegetation segmentation tasks. Through systematic comparison, it clearly indicates the outstanding advantages of vision foundation models in small-sample remote sensing tasks and further analyzes the improvement effect of the cross-temporal pseudo-label self-training strategy CT-PLST on model generalization capabilities.
Experimental results show that under conditions of complex vegetation boundaries, significant shadow interference, high scene structure mixing degree, and extremely few annotation samples, foundation models can obtain optimal segmentation quality and the most stable boundary recovery capability after reasonable fine-tuning. Among them, SAM2.1-Tiny achieved the highest mIoU (0.7821) on the Zijinshan dataset, a 5.5% improvement over traditional U-Net; SAM2-Tiny further improved to 0.7888 (+1.44%) after CT-PLST self-training, fully verifying the effective supplementary role of high-confidence pseudo-labels on few-shot supervision signals; MobileSAMV2 and MobileSAM significantly improved inference efficiency while maintaining high accuracy, making them more suitable for resource-constrained scenarios. In comparison, UNet and DeepLabV3+ still have strong usability but are relatively limited in cross-domain generalization and fine-grained boundary expression; YOLO11s-seg and SegEarth-OV have advantages in their respective paradigms but are not suitable for directly replacing vegetation segmentation tasks oriented toward continuous semantic regions.
Overall, the core research insight of this paper is as follows. The key to small-sample remote sensing vegetation segmentation lies in systematic model evaluation and scientific selection judgment, rather than blindly pursuing the largest model scale. By establishing an organic closed loop of strong prior foundation models and high-quality pseudo-label self-training, feature distribution can be continuously improved and noise propagation suppressed under annotation-scarce conditions. The success of CT-PLST further proves that in remote sensing monitoring with abundant multi-temporal data, fully activating unlabeled temporal information is an effective way to break through small-sample bottlenecks. At the same time, this paper also has certain limitations, such as data sources and geomorphological conditions still insufficient to cover all extreme scenarios, pseudo-label filtering and error propagation mechanisms still have further optimization space, and the training and inference costs of foundation models also require continued compression in extremely resource-constrained environments. Future work can continue to deepen research in four directions—temporal information fusion, combination of self-supervision and semi-supervision, introduction of multi-spectral information, and construction of lightweight deployment chains—so that models can better serve practical tasks such as ecological surveys, forestry monitoring, urban green space assessment, and land use change analysis.