Next Article in Journal
Smart Healthcare Engineering: A Data-Driven Educational Framework for Psychrometric Analysis and Air Handling Systems in Hospitals
Previous Article in Journal
A Novel Ordering Index for Evaluating Feature Selection Quality in Personalized Smart Healthcare
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Relation-Consistency Group Contrastive Learning for Robust Multispectral Remote Sensing Classification

by
Mohcine Karroum
* and
Noureddine En-nahnahi
*
L3IA Laboratory, Faculty of Sciences Dhar El Mehraz, Sidi Mohamed Ben Abdellah University, P.O. Box 1796, Fez 30003, Morocco
*
Authors to whom correspondence should be addressed.
Technologies 2026, 14(8), 499; https://doi.org/10.3390/technologies14080499
Submission received: 6 June 2026 / Revised: 27 July 2026 / Accepted: 3 August 2026 / Published: 10 August 2026

Abstract

Multispectral remote sensing classification benefits from the complementary information carried by visible (VIS), near-infrared (NIR), and short-wave infrared (SWIR) Sentinel-2 bands, yet most deep models process them as a single stacked tensor without explicitly preserving their inter-group relationships. We propose Relation-Consistency Group Contrastive Learning (Group-CL-RC), a robustness-oriented framework combining group-level contrastive alignment with a relation-consistency regularizer defined over a compact VIS–NIR–SWIR similarity descriptor. The method is evaluated on EuroSAT All Bands using four backbones under radiometric drift, spatial masking, K-drop band removal, and compound spectral–spatial corruption (CS2C), and externally validated on Sentinel-2-only SEN12MS under standard and seasonal-shift protocols. Group-CL-RC preserves strong clean performance and yields statistically supported robustness gains over the multispectral-only baseline, with the largest improvements under K-drop and CS2C. SEN12MS supports the transfer of these robustness trends beyond EuroSAT, while showing that gains over standard Group-CL remain perturbation-dependent. Ablation studies further indicate that relation consistency is an effective robustness mechanism, particularly when spectral-group availability is degraded. Relation-deformation diagnostics show that Group-CL-RC primarily reduces decision-level sensitivity to relational distortions rather than uniformly minimizing raw deformation. Overall, inter-group relational geometry provides an interpretable and effective robustness target under controlled structured spectral and spectral–spatial degradation.

Graphical Abstract

1. Introduction

Multispectral Earth observation imagery has become a fundamental resource for large-scale environmental monitoring, land-cover mapping, agricultural assessment, and urban analysis. Modern satellite missions such as Sentinel-2 acquire images across several spectral bands spanning the visible (VIS), near-infrared (NIR), and short-wave infrared (SWIR) regions of the electromagnetic spectrum [1]. These spectral bands provide complementary information about land surfaces: visible bands capture color and fine spatial texture, near-infrared bands respond to vegetation vigor and biomass-related surface properties, and short-wave infrared bands are sensitive to moisture content, soil properties, and material composition. Effectively exploiting this cross-spectral complementarity remains a central challenge in multispectral remote sensing classification.
Despite substantial progress in deep learning for remote sensing, most multispectral classification pipelines still process spectral bands as uniformly stacked channels. This channel-stacking paradigm is practical and often effective, but it does not explicitly represent the physical organization of multispectral data or the relationships among semantically meaningful spectral subsets. This limitation is important because multispectral bands are not interchangeable measurements. Their organization reflects both sensor design and the physical interaction between electromagnetic radiation and land-surface materials [2]. In Sentinel-2 imagery, VIS, NIR, and SWIR bands encode distinct but complementary surface properties, and such physical distinctions are already widely exploited in remote sensing indices such as vegetation and moisture-related indices [3,4]. When all bands are processed uniformly, the learned representation may obscure this internal spectral structure. As a result, a model may learn discriminative features under clean conditions while remaining fragile when specific spectral groups are degraded, missing, or distorted.
Robustness is therefore a critical issue for operational multispectral remote sensing. In practical Earth observation pipelines, spectral measurements may be affected by sensor calibration drift, atmospheric effects, spatial-resolution inconsistencies across bands, missing channels, cloud contamination, shadows, or other sources of partial spectral degradation [2]. Clean test accuracy alone is thus insufficient to characterize model reliability. This concern is consistent with broader findings in computer vision showing that high clean accuracy does not necessarily imply robustness under common corruptions or distribution shift [5]. In multispectral land-cover classification, robustness is particularly challenging because corruptions are often structured rather than uniform: some perturbations modify radiometric statistics, whereas others suppress spatial regions or remove specific spectral groups. Such perturbations can disrupt not only individual band responses, but also the complementarity among spectral groups.
This observation motivates the central hypothesis of this work: robust multispectral representation learning should preserve not only group-specific embeddings, but also the relational geometry among physically meaningful spectral groups. From this perspective, multispectral robustness is partly a relational problem. The objective is therefore not merely to align spectral groups independently, but to learn a representation whose classification behavior is less sensitive to perturbation-induced deformations of the internal VIS–NIR–SWIR similarity structure. This relational viewpoint differs from standard channel-stacking classifiers, generic contrastive objectives, semantic supervision alone, and attention-based spectral fusion. Channel-stacking classifiers do not explicitly expose the physical organization of the multispectral signal. Standard group-level contrastive learning encourages compatibility among spectral-group embeddings, but it does not directly regularize the geometry of the full inter-group relation structure. Attention-based spectral fusion can learn to emphasize or suppress channels and branches, but it does not explicitly promote stability of cross-spectral relationships under degradation. Similarly, class-aware semantic losses encourage discriminative and compact class representations, whereas relation consistency targets the stability and decision-level usefulness of the cross-spectral structure itself.
To address this gap, we introduce Relation-Consistency Group Contrastive Learning (Group-CL-RC), a robustness-oriented multispectral representation-learning framework for Sentinel-2 image classification. The proposed method starts from structured spectral grouping and group-level contrastive alignment, but extends this formulation by regularizing the relational descriptor induced by VIS, NIR, and SWIR group embeddings. Rather than enforcing only pairwise spectral-group alignment, Group-CL-RC regularizes the inter-group similarity structure across clean and corrupted views. In this way, the method directly targets a failure mode that is particularly relevant under spectral degradation: deformation of the cross-spectral relational structure and its impact on the final classification decision.
The proposed framework is evaluated on EuroSAT All Bands [6] under both clean and robustness-oriented conditions. The robustness protocol covers four structured perturbation families: radiometric drift, spatial masking, K-drop band removal, and compound spectral–spatial corruption. To contextualize Group-CL-RC against representative external learning objectives, we further add a matched EuroSAT comparison with corruption-training and contrastive baselines implemented under the same experimental pipeline. External validation is then conducted on Sentinel-2-only SEN12MS under standard and seasonal-shift protocols [7].
The results show that Group-CL-RC preserves strong clean performance while improving robustness over the multispectral-only baseline under structured spectral and spectral–spatial degradation. The strongest gains occur when spectral-group availability or cross-spectral complementarity is disrupted, especially under K-drop and compound corruption. The comparison with standard Group-CL and the matched external baselines supports a conservative interpretation: relation consistency is most beneficial in specific degradation regimes and should be viewed as an interpretable robustness mechanism rather than as a universally dominant training strategy. Objective-component, descriptor-granularity, training-time corruption, relation-deformation, qualitative, and computational analyses are included to clarify the scope, reliability, and practical behavior of the proposed framework.
The main contributions of this work are summarized as follows:
  • We formulate robustness-oriented multispectral representation learning as a problem of preserving inter-group relational geometry among physically meaningful spectral groups. This shifts the focus from embedding-level stability alone to the stability and decision-level usefulness of the internal VIS–NIR–SWIR structure under spectral degradation.
  • We introduce Relation-Consistency Group Contrastive Learning (Group-CL-RC), a structured representation-learning framework that combines group-level contrastive alignment with a relation-consistency regularizer. The proposed regularizer promotes preservation of the similarity structure among VIS, NIR, and SWIR group embeddings across clean and corrupted views.
  • We distinguish relation consistency from standard semantic supervision, generic spectral fusion, and pairwise contrastive alignment. The proposed mechanism targets the structural stability of cross-spectral relationships rather than only class compactness, channel reweighting, or feature-level agreement.
  • We evaluate the framework under clean and robustness-oriented settings using Sentinel-2 EuroSAT All Bands, multiple backbone architectures, and four structured perturbation families: drift, masking, K-drop band removal, and compound spectral–spatial corruption. We further provide a matched external-baseline comparison with representative corruption-training and contrastive objectives, together with Sentinel-2-only SEN12MS validation under standard and seasonal-shift protocols.
  • We conduct controlled ablation studies of the objective components, relation-descriptor granularity, and training-time corruption strategy. These analyses clarify when relation consistency contributes most, how descriptor complexity affects robustness and cost, and whether the training corruption design influences the observed robustness behavior.
  • We provide diagnostic analyses showing that relation consistency reduces the decision-level sensitivity of the classifier to relation deformation, rather than merely minimizing raw relation-deformation magnitude. We also report computational profiling and qualitative prediction examples to characterize the practical overhead and observable effects of structured multispectral perturbations.
The remainder of this paper is organized as follows. Section 2 reviews related work on multispectral classification, robustness, contrastive learning, and relational representation learning. Section 3 presents the proposed Group-CL-RC framework and its optimization objectives. Section 4 describes the datasets, model variants, backbone architectures, training protocol, robustness perturbations, evaluation metrics, statistical testing, computational profiling, and reporting strategy. Section 5 reports the experimental results. Section 6 discusses the main findings, the relation-consistency mechanism, practical implications, and limitations. Section 7 concludes the paper and outlines future research directions.

2. Related Work

2.1. Multispectral Image Classification

Multispectral image classification assigns semantic land-cover or land-use labels to satellite image patches acquired over multiple spectral bands. Classical approaches relied on handcrafted spectral features, vegetation indices, and traditional machine-learning classifiers such as support vector machines and random forests [8,9]. Deep learning has substantially improved remote sensing image classification by enabling models to learn hierarchical spatial–spectral representations directly from image data [10,11]. Benchmark datasets such as EuroSAT have played an important role in evaluating Sentinel-2 land-use and land-cover classification models [6]. Beyond EuroSAT, larger resources involving Sentinel-2 imagery have broadened the evaluation landscape: BigEarthNet provides a large-scale multi-label Sentinel-2 benchmark for remote sensing image understanding [12,13], whereas the Sentinel-2 component of SEN12MS provides georeferenced multispectral imagery across diverse geographic and seasonal conditions [7].
Residual networks, efficient convolutional models, and transformer-based architectures have also been widely adopted to improve feature extraction and long-range spatial modeling [14,15,16,17,18,19]. Recent multispectral classification studies have further explored stacking-based ensemble learning and seasonal spectral-feature modeling, illustrating the continuing relevance of machine-learning strategies for exploiting multispectral information in land-cover and crop-type classification [20,21]. Despite these advances, many multispectral classification pipelines still rely on stacked-band representations in which all spectral channels are processed jointly without explicitly modeling the physical organization of the multispectral signal. This design is effective for learning discriminative features, but it provides limited control over the relationships among physically meaningful spectral groups such as VIS, NIR, and SWIR. This motivates representation-learning methods that exploit not only the discriminative content of spectral measurements, but also the relational structure induced by complementary spectral groups.

2.2. Robustness to Spectral and Spatial Degradation

In remote sensing, robustness concerns arise under cross-sensor, cross-region, seasonal, and acquisition-condition shifts [22]. These shifts can modify both the spatial appearance of land-cover classes and the spectral signatures recorded by the sensor, making clean in-distribution accuracy insufficient to characterize operational reliability. A wide range of strategies has therefore been investigated, including data augmentation, domain adaptation, and architecture-level robustness improvements [22,23]. Recent remote-sensing work has also combined feature-level perturbations with consistency regularization and contrastive learning in semi-supervised semantic segmentation, showing that perturbation-aware objectives can complement conventional image-level augmentation [24]. In hyperspectral image analysis, robustness to band noise, band degradation, and missing-channel conditions has received particular attention, since the high spectral dimensionality of hyperspectral data makes models sensitive to band-level distortions [25].
Robustness-oriented evaluation is less standardized in multispectral land-cover classification, although multispectral degradations can also be structured rather than uniform. Such degradations may selectively affect radiometric responses, spatial support, or specific spectral groups, and spectral and spatial perturbations may interact when they occur jointly. This structure matters because a model that remains stable under broad image-level perturbations may still be vulnerable when degradation affects the bands or spectral groups carrying class-discriminative information. Robustness analysis in multispectral classification should therefore distinguish radiometric, spatial, spectral, and compound degradation modes instead of treating corruption as a single uniform condition.

2.3. Spectral–Spatial Fusion and Attention

Several research directions have sought to improve multispectral and hyperspectral representation learning through stronger backbones, spectral–spatial fusion modules, band selection, and attention mechanisms. These approaches exploit the complementary nature of spatial context and spectral information by improving feature extraction, aggregation, and adaptive spectral weighting. Spectral–spatial architectures and attention mechanisms have been particularly influential in hyperspectral image analysis, where dense spectral sampling makes it important to capture both local spatial patterns and dependencies across bands [26,27]. For Sentinel-2-based semantic segmentation of offshore floating raft aquaculture areas, MSSFNet combines a spatial–spectral feature extraction block with a multiscale spatial attention block, illustrating the value of jointly exploiting complementary spectral and multiscale spatial information [28].
Although effective for selecting and combining informative spectral cues, these methods are generally not designed to regularize the stability of relationships among physically meaningful spectral groups under degradation. Structured perturbations may affect not only individual band features, but also the cross-spectral relationships implicitly used by the classifier. Fusion- and attention-based approaches can therefore be complemented by representation-learning objectives that explicitly regularize inter-group spectral relationships.

2.4. Contrastive Representation Learning in Remote Sensing

Contrastive representation learning has become an important paradigm for learning invariant and transferable visual representations. Methods such as SimCLR and MoCo learn representations by bringing augmented views of the same sample closer while separating unrelated samples [29,30], whereas BYOL showed that view consistency can also be exploited without explicit negative pairs [31]. Supervised contrastive learning further incorporates label information into the contrastive objective [32], and CLIP demonstrated the effectiveness of large-scale contrastive alignment across heterogeneous modalities [33].
In remote sensing, contrastive learning has been adapted to exploit geospatial structure, spatial context, multimodal Earth observation data, and geography-aware self-supervision [34,35,36]. Recent studies have additionally applied contrastive learning to multispectral band-aware cross-domain satellite image generation [37], while joint cluster- and instance-level contrastive learning developed primarily for aerial person re-identification has also been evaluated on remote-sensing classification datasets [38]. Recent Earth observation pretraining and foundation-model studies have further extended contrastive objectives toward multimodal, multi-granularity, and label-guided representation learning [39,40]. These developments are important because remote sensing images often provide multiple complementary views of the same location, whether through augmentations, temporal observations, sensor modalities, or spectral subsets. For multispectral imagery, physically meaningful spectral groups can therefore be interpreted as complementary views of the same scene, motivating group-level contrastive alignment among spectral subsets such as VIS, NIR, and SWIR.
However, standard contrastive formulations primarily operate at the level of individual samples, views, modalities, or pairwise embeddings. They encourage agreement between related representations, but they do not explicitly preserve the relational structure jointly induced by multiple spectral groups. Pairwise alignment among VIS, NIR, and SWIR embeddings therefore does not guarantee that their mutual similarity geometry remains stable when specific bands or spectral groups are corrupted. This motivates relation-aware objectives that complement contrastive alignment by regularizing the inter-group structure itself.

2.5. Relational Representation Learning

Relational representation learning offers a complementary viewpoint by focusing on the structure of relationships among embeddings rather than only on the embeddings themselves. In self-supervised learning, relational reasoning has been used to exploit dependencies among observations and to preserve similarity structures across views [41,42]. Related ideas have also been explored in relation-preserving knowledge distillation, where mutual distances, angles, or activation-similarity patterns among examples are transferred between models [43,44]. Metric-learning formulations have further modeled higher-order dependencies beyond direct pairwise distances [45]. These studies indicate that representation quality may depend not only on individual embedding positions, but also on the geometry of their relations.
However, most existing relational formulations operate across instances, teacher–student representations, or generic feature ensembles. They are not specifically designed to model the physically grounded relationships among spectral groups within a single multispectral sample, nor to preserve these relationships under structured spectral and spectral–spatial degradation. This distinction is important for multispectral imagery because VIS, NIR, and SWIR groups correspond to physically meaningful wavelength regions and encode complementary surface information. A robustness-oriented multispectral representation may therefore benefit from preserving the relationships among these group representations when the input is degraded. The remaining gap is therefore to model inter-group spectral relations as an explicit object of regularization under degradation, rather than relying only on individual embeddings, pairwise alignment, or generic feature fusion.

3. Materials and Methods

This section presents the proposed Relation-Consistency Group Contrastive Learning framework, denoted as Group-CL-RC. The method builds structured VIS, NIR, and SWIR spectral views from a Sentinel-2 multispectral input, learns group-compatible embeddings, and regularizes the relation descriptor induced by these groups under degradation. We describe the model formulation, spectral grouping, shared encoder, fusion branch, group-level contrastive objective, relation-consistency regularizer, and final optimization objective.

3.1. Overview of the Proposed Framework

Given a Sentinel-2 multispectral image, Group-CL-RC constructs a full multispectral representation and group-specific representations for the VIS, NIR, and SWIR spectral regions. A shared multispectral encoder processes both the full input and the masked group-specific views, while a separate RGB branch provides visible-spectrum features for the final fused classifier. Group-level contrastive learning promotes compatibility among complementary spectral views, and relation-consistency regularization preserves the VIS–NIR–SWIR similarity structure between clean and degraded views.
The framework contains four main components:
  • A spectral-group decomposition that defines VIS, NIR, and SWIR group views from the original multispectral image;
  • A shared multispectral encoder and projection head that map full and group-specific inputs into a common embedding space;
  • A fusion and classification branch that combines visible-spectrum and full multispectral representations for land-cover prediction;
  • A robustness-oriented training objective that combines group-level contrastive alignment with relation-consistency regularization.
The contrastive and relation-consistency objectives are used only as training-time auxiliary regularizers. At inference time, the final prediction is produced by the fused RGB–MS classification branch.
Figure 1 provides a visual summary of the proposed Group-CL-RC framework. The diagram highlights the interaction between group-level contrastive alignment, relation-consistency regularization, and supervised classification within the overall robustness-oriented learning objective.

3.2. Problem Formulation

Let X R C × H × W denote a multispectral image, where C is the number of spectral bands and H × W is the spatial resolution. In the EuroSAT All Bands setting, X corresponds to a Sentinel-2 multispectral image patch with C = 13 spectral channels. In the SEN12MS external validation setting, the same formulation is used with C = 10 retained Sentinel-2 bands. Each image has a land-cover label y { 1 , , K } , where K is the number of classes.
A standard multispectral classifier learns an encoder
f θ : R C × H × W R d b ,
followed by a prediction module that maps the extracted representation to class logits. Most multispectral deep learning pipelines process X as a single stacked spectral tensor, in which all bands are treated as input channels of the same representation. Although effective, this formulation does not explicitly encode the physical organization of the multispectral signal or the relationships among spectral groups.
Let X ˜ ( c ) denote a degraded version of X produced by a structured perturbation operator c C . In this setting, a robust multispectral representation should satisfy three properties. First, the learned representation should remain discriminative for land-cover classification. Second, embeddings associated with complementary spectral groups should remain compatible in the latent space. Third, the relational geometry among physically meaningful spectral groups should remain sufficiently stable under degradation so that perturbation-induced changes in cross-spectral structure have limited impact on the final prediction.

3.3. Spectral Group Decomposition

We define three physically meaningful spectral groups:
G = { VIS , NIR , SWIR } .
The grouping used in this work is:
VIS = { B 02 , B 03 , B 04 } , NIR = { B 08 , B 8 A } , SWIR = { B 11 , B 12 } .
The VIS group corresponds to the blue, green, and red Sentinel-2 bands and represents visible-spectrum information. The NIR group is associated with vegetation reflectance, while the SWIR group provides complementary information about moisture content, soil properties, and material composition. The RGB branch uses the same visible bands as VIS, but ordered as B04, B03, and B02 to form a conventional RGB input. The VIS, NIR, and SWIR groups are used to construct the relation-consistency descriptor, while the remaining available Sentinel-2 bands are retained in the full multispectral input. This grouping is valid for both datasets used in this study: EuroSAT All Bands provides a 13-band Sentinel-2 input, whereas the SEN12MS external validation uses the ten retained Sentinel-2 bands available in our setting. In both cases, the VIS, NIR, and SWIR bands required by the default relation descriptor are present.
For each group g G , we define a deterministic masking operator
M g : R C × H × W R C × H × W ,
which preserves the channels belonging to group g and sets the remaining channels to zero. The group-specific view is then given by
X g = M g ( X ) , g G .
This construction preserves a common input dimensionality for the full multispectral image and all group-specific views, allowing the same multispectral encoder to process both complete and masked inputs. Bands outside the default VIS, NIR, and SWIR groups, including red-edge and atmospheric bands, remain available through the full multispectral branch. They are not used as separate groups in the default relation descriptor, in order to avoid over-fragmenting the spectral space and to keep the main formulation focused on three broad spectral regimes. A finer red-edge-aware grouping is evaluated separately in the descriptor-granularity ablation.

3.4. Shared Multispectral Encoder for Full and Group-Specific Views

Let f MS denote the multispectral encoder:
f MS : R C × H × W R d b ,
where d b is the backbone feature dimension. The encoder can be instantiated with different backbone architectures, such as ResNet-50, EfficientNet-B0, ConvNeXt-Tiny, or Swin-Tiny. The number of input channels is dataset-specific: C = 13 for EuroSAT All Bands and C = 10 for the Sentinel-2-only SEN12MS external validation. Accordingly, the multispectral input stem or patch embedding is instantiated for the corresponding number of Sentinel-2 bands, while the same VIS–NIR–SWIR relation-consistency definition is retained.
Given the full multispectral image X, the encoder produces the backbone feature:
h MS = f MS ( X ) .
A projection head P maps backbone features to a common d-dimensional embedding space:
P : R d b R d .
The full multispectral embedding is therefore defined as:
z MS = P ( h MS ) = P ( f MS ( X ) ) .
For each spectral group g G , the group-specific view X g is passed through the same multispectral encoder and the same projection head:
h g = f MS ( X g ) ,
z g = P ( h g ) = P ( f MS ( M g ( X ) ) ) .
This weight-sharing design avoids introducing separate encoders for individual spectral groups and places the full and masked inputs in a common latent space. The group-specific embeddings are used only as auxiliary training representations for the contrastive and relation-consistency objectives.
The final land-cover prediction is not made from individual masked group views, but from the fused representation defined in Section 3.5.

3.5. Fusion Representation and Classification Head

The final supervised decision is made from a fused representation that combines visible-spectrum and multispectral information. Let X RGB R 3 × H × W denote the RGB subset formed by Sentinel-2 bands B 04 , B 03 , and B 02 . An RGB encoder f RGB extracts visible-spectrum features:
h RGB = f RGB ( X RGB ) .
The RGB embedding is obtained through a projection head P RGB :
z RGB = P RGB ( h RGB ) .
The full multispectral embedding z MS and the RGB embedding z RGB are concatenated:
z cat = Concat ( z RGB , z MS ) .
The fused representation is then obtained through a lightweight projection module ϕ :
z fused = ϕ ( z cat ) .
In the implementation used in this work, ϕ is a multilayer perceptron with a nonlinear activation. The fused representation is used for supervised land-cover classification, while the group-specific embeddings serve only the auxiliary contrastive and relation-consistency objectives.
The supervised classification loss is based on ArcFace, an angular-margin objective that encourages discriminative separation on the hypersphere [46]. Let z ˜ i denote the 2 -normalized fused representation of sample i:
z ˜ i = z fused , i z fused , i 2 .
Let W = [ w 1 , , w K ] denote the class-prototype matrix, with normalized class prototypes w k 2 = 1 . The cosine similarity between sample i and class k is:
cos ( θ i , k ) = w k z ˜ i .
ArcFace introduces an additive angular margin m for the ground-truth class:
i , k = s · cos ( θ i , y i + m ) , if k = y i , s · cos ( θ i , k ) , otherwise ,
where s is a scale parameter. The classification loss is the cross-entropy over these margin-modified logits:
L cls = 1 N i = 1 N log exp ( i , y i ) k = 1 K exp ( i , k ) .

3.6. Group-Level Contrastive Learning

The classification objective encourages semantic discrimination but does not explicitly enforce compatibility among complementary spectral views of the same scene. To address this limitation, we use a group-level contrastive objective over physically meaningful spectral representations and the visible-spectrum/multispectral branch structure.
Let z a i and z b i denote two embeddings extracted from the same image i, where a and b refer to two representation branches or spectral groups. In the proposed Group-CL-RC framework, the active contrastive pairs are RGB–MS, VIS–NIR, VIS–SWIR, and NIR–SWIR. The RGB–MS term encourages compatibility between the visible branch and the full multispectral branch, whereas the VIS–NIR, VIS–SWIR, and NIR–SWIR terms encourage compatibility among physically meaningful spectral groups.
Similarity is computed using cosine similarity:
sim ( z a , z b ) = z a z b z a 2 z b 2 .
For a contrastive pair ( a , b ) , the InfoNCE loss is defined as:
L a , b = 1 N i = 1 N log exp ( sim ( z a i , z b i ) / τ ) j = 1 N exp ( sim ( z a i , z b j ) / τ ) ,
where N is the batch size and τ is the temperature parameter.
The group-level contrastive loss is written as the following weighted sum:
L GCL = λ RGB , MS L RGB , MS + λ VIS , NIR L VIS , NIR + λ VIS , SWIR L VIS , SWIR + λ NIR , SWIR L NIR , SWIR .
The pair-specific weights λ RGB , MS , λ VIS , NIR , λ VIS , SWIR , and λ NIR , SWIR are specified by the corresponding backbone configuration. This pair-weighted formulation allows the strength of each spectral-pair constraint to be controlled separately.
During training, the contribution of L GCL is modulated by a warm-up/ramp-up factor α ( t ) , where t denotes the epoch:
α ( t ) = 0 , t T warm , min 1 , t T warm T ramp , t > T warm .
Here, T warm is the number of warm-up epochs during which the contrastive contribution is disabled, and T ramp is the number of ramp-up epochs used to progressively introduce the contrastive loss. This schedule prevents the contrastive objective from dominating the early supervised optimization stage.
Thus, L GCL promotes embedding-level compatibility among selected spectral views. The next subsection introduces a complementary regularizer that acts on the joint VIS–NIR–SWIR relation structure under degradation.

3.7. Relation-Consistency Regularization

Group-level contrastive learning encourages pairwise compatibility between selected spectral embeddings, but it does not explicitly constrain the joint relational geometry formed by the VIS, NIR, and SWIR groups. Group-CL-RC therefore introduces a relation-consistency regularizer that operates on a compact inter-group similarity descriptor.
For a clean multispectral image X, the default descriptor is built from the three pairwise similarities among VIS, NIR, and SWIR embeddings:
R ( X ) = sim ( z VIS , z NIR ) sim ( z VIS , z SWIR ) sim ( z NIR , z SWIR ) R 3 .
This descriptor summarizes the internal similarity configuration among the three physically meaningful spectral-group embeddings. It is not a class prediction and is not used as an additional classifier output. The descriptor is intentionally compact: with three spectral groups, the three pairwise similarities form the complete set of first-order inter-group relations. This avoids additional graph, covariance, or attention-based design choices while keeping the relation-consistency mechanism interpretable and architecture-agnostic. A finer red-edge-aware descriptor is evaluated separately in the descriptor-granularity ablation, whereas the default framework uses the VIS–NIR–SWIR descriptor.
Let X ˜ ( c ) denote a degraded view of X generated by a structured corruption operator c. For each group g G , the corrupted group view is obtained by applying the same masking operator to the degraded multispectral image:
X ˜ g ( c ) = M g ( X ˜ ( c ) ) .
The corresponding group embedding is
z ˜ g ( c ) = P f MS ( X ˜ g ( c ) ) .
The relation descriptor of the degraded view is then defined analogously:
R ( X ˜ ( c ) ) = sim ( z ˜ VIS ( c ) , z ˜ NIR ( c ) ) sim ( z ˜ VIS ( c ) , z ˜ SWIR ( c ) ) sim ( z ˜ NIR ( c ) , z ˜ SWIR ( c ) ) R 3 .
The relation-consistency loss penalizes the discrepancy between the clean and degraded relation descriptors:
L RC = 1 N i = 1 N R ( X i ) R ( X ˜ i ( c ) ) 2 2 .
This objective differs from direct embedding alignment. It does not require each spectral-group embedding to remain unchanged under degradation. Instead, it regularizes the relative similarity configuration among spectral groups. The model is therefore encouraged to learn representations whose classification behavior is less sensitive to perturbation-induced changes in cross-spectral relational structure.
Relation consistency should not be interpreted as imposing strict invariance of the descriptor under every possible corruption. Some structured perturbations can legitimately alter spectral relationships. The goal is therefore not to force identical clean and corrupted descriptors in all cases, but to reduce the harmful effect of perturbation-induced relational distortions on the learned representation and final classification behavior. This distinction is examined empirically through the relation-deformation diagnostics reported in the experimental section.

3.8. Overall Training Objective

The proposed framework combines supervised classification, group-level contrastive alignment, and relation-consistency regularization. To avoid notation ambiguity, we denote by L GCL the weighted group-level contrastive loss defined over the active contrastive pairs, and by J the total optimization objective.
The multispectral-only baseline is trained using only the supervised classification loss:
J MS = L cls .
The Group-CL objective adds the group-level contrastive term:
J Group-CL = L cls + α ( t ) L GCL ,
where α ( t ) is the contrastive warm-up/ramp-up factor.
To isolate the contribution of relation consistency, we also consider a Group-RC objective:
J Group-RC = L cls + λ RC L RC .
This variant removes the contrastive term and is used as an objective-component ablation.
The proposed Group-CL-RC objective combines both auxiliary mechanisms:
J Group-CL-RC = L cls + α ( t ) L GCL + λ RC L RC .
The three terms play complementary roles. The classification loss optimizes land-cover discrimination from the fused representation. The group-level contrastive loss promotes embedding-level compatibility among visible, multispectral, and spectral-group representations. The relation-consistency loss regularizes the VIS–NIR–SWIR descriptor between clean and training-time degraded views. In the default Group-CL-RC configuration, the degraded view is generated by a structured spectral corruption specified in the experimental setup.
The auxiliary objectives are used during training to shape the representation space. At inference time, prediction is made from the fused RGB–MS representation using the classification head; no additional relation descriptor or group-specific classifier is required for the final decision. This design keeps the inference-time decision pathway unchanged while using group-level and relation-level constraints to promote robustness under structured spectral and spectral–spatial degradation.

4. Experimental Setup

This section describes the datasets, model variants, training procedure, robustness perturbations, evaluation metrics, statistical analysis, computational profiling, and reproducibility settings used to evaluate Group-CL-RC.

4.1. Datasets and Preprocessing

The main experiments are conducted on EuroSAT All Bands, a Sentinel-2 multispectral land-use and land-cover classification dataset [6]. Each sample is a 64 × 64 image patch assigned to one of ten semantic land-cover classes. In this setting, the full multispectral input uses the 13 Sentinel-2 bands available in EuroSAT All Bands. All inputs are normalized using dataset-level statistics to reduce inter-band scale differences and stabilize optimization. The same train, validation, and test splits, label mapping, and preprocessing pipeline are used across the clean, robustness, ablation, and diagnostic experiments on EuroSAT.
To assess whether the robustness behavior observed on EuroSAT extends beyond the main benchmark, we construct an external validation setting from SEN12MS [7]. SEN12MS is used only through its Sentinel-2 multispectral component; Sentinel-1 data are excluded and no multi-sensor fusion is performed. The retained SEN12MS Sentinel-2 input contains ten bands:
{ B 02 , B 03 , B 04 , B 05 , B 06 , B 07 , B 08 , B 8 A , B 11 , B 12 } .
This 10-band configuration preserves all bands required by the default Group-CL-RC relation descriptor, namely VIS = { B 02 , B 03 , B 04 } , NIR = { B 08 , B 8 A } , and SWIR = { B 11 , B 12 } . The EuroSAT All Bands channels not retained in our SEN12MS input, namely B 01 , B 09 , and B 10 , are therefore absent from the SEN12MS validation input, but they are not required to construct the VIS–NIR–SWIR relation descriptor. This design keeps the external validation aligned with the Sentinel-2 multispectral setting and with the proposed relation-consistency framework, while adapting the full multispectral input dimensionality from 13 bands in EuroSAT to 10 bands in SEN12MS.
The SEN12MS label space is filtered to retain eight harmonized land-cover classes, corresponding to the class identifiers retained in the constructed manifests:
{ 1 , 2 , 3 , 4 , 5 , 6 , 7 , 10 } .
Samples outside this retained class set are removed before constructing the final partitions. The retained class identifiers are then mapped consistently across training, validation, and test sets, so that all evaluated models solve the same eight-class classification problem. This filtering defines a controlled external validation setting rather than reproducing the full original SEN12MS label space.
Two SEN12MS validation protocols are constructed from the filtered Sentinel-2 samples. The first is a standard scene-disjoint protocol, in which the training, validation, and test partitions are built from disjoint scene sets. This prevents samples from the same scene from appearing simultaneously in training or validation and in the test set. The resulting standard protocol contains 13,200 training samples, 4420 validation samples, and 18,106 test samples. The second is a seasonal-shift protocol, in which non-winter scenes are used for training and validation, while winter scenes are reserved for testing. This protocol is designed to introduce a stronger seasonal distribution shift than the standard scene-disjoint setting and contains 13,089 training samples, 4331 validation samples, and 29,027 winter test samples.
For both SEN12MS protocols, the constructed data records preserve the sample identifier, scene identifier, season, and class label. These metadata fields make the scene-level and seasonal structure traceable during evaluation and ensure that the standard and seasonal-shift protocols remain distinguishable after inference. Both protocols use the same retained class set and the same Sentinel-2-only preprocessing convention; therefore, differences between them arise from the split construction rather than from the label space or sensor configuration. The SEN12MS protocols are used only as external validation settings and are reported separately from the EuroSAT experiments because SEN12MS differs from EuroSAT in spatial coverage, class taxonomy, sample distribution, and acquisition conditions.
The main characteristics of the two SEN12MS validation protocols are summarized in Table 1.

4.2. Model Variants and Backbones

The evaluation compares four objective variants. The multispectral-only baseline, denoted as ms_only, uses the full multispectral input and is optimized only with the supervised classification objective. The group_cl variant adds group-level contrastive alignment without relation consistency. The group_rc variant uses relation-consistency regularization without group-level contrastive learning. The proposed Group-CL-RC variant combines supervised classification, group-level contrastive alignment, and relation-consistency regularization.
The main EuroSAT clean and robustness comparisons are conducted with four backbone architectures: ConvNeXt-Tiny [47], ResNet-50 [16], EfficientNet-B0 [17], and Swin-Tiny [15]. These backbones cover convolutional and transformer-based representation families and allow us to assess whether the robustness behavior of relation consistency is architecture-dependent. For all backbones, the multispectral input stem is adapted to the dataset-specific Sentinel-2 input dimensionality: 13 channels for EuroSAT All Bands and 10 channels for the SEN12MS external validation. The projection dimension is fixed to d = 256 across the multispectral branch, RGB branch, group-specific embeddings, and fused representation.
Additional clean ablation variants are reported in Supplementary Section S1.2 and Supplementary Tables S11 and S12. They are used only to contextualize nominal performance and are not treated as main robustness baselines.

4.3. Training Protocol

All experiments follow a common training and evaluation pipeline. Training samples use the training transform, whereas validation and test samples use the deterministic evaluation transform. The best checkpoint is selected according to validation Macro-F1 and reloaded before final test evaluation.
Training uses AdamW with cosine annealing learning-rate scheduling. Automatic mixed precision, gradient clipping, learning rates, batch sizes, objective weights, and contrastive schedules are controlled by backbone-specific configuration files and reported in Supplementary Section S1.1 and Supplementary Tables S1–S10. For variants using ArcFace, the angular-margin head uses scale parameter s = 30.0 and margin m = 0.2 [46]. For variants using group-level contrastive learning, InfoNCE is used with temperature τ = 0.07 .
For relation-consistency variants, training uses clean and corrupted views of the same input and evaluates the relation-consistency loss between their inter-group descriptors. In the default Group-CL-RC configuration, the corrupted training view is generated using K-drop band removal on the NIR + SWIR groups with k = 1 . This training-time corruption is distinct from the evaluation-time perturbations described in Section 4.4. Alternative training-time corruptions are examined in Section 5.8.

4.4. Robustness Perturbation Protocol

Robustness is evaluated using four structured perturbation families applied only at test time. They are not used as training labels or model-selection criteria, but as controlled stress tests for isolating different failure modes under spectral or spatial degradation.

Radiometric Drift

Radiometric drift applies gain, bias, and noise changes to selected spectral channels or spectral groups in order to evaluate sensitivity to radiometric instability. The evaluated drift levels use paired gain, bias, and noise values:
( 0.00 , 0.00 , 0.000 ) , ( 0.05 , 0.02 , 0.005 ) , ( 0.10 , 0.03 , 0.010 ) , ( 0.20 , 0.05 , 0.015 ) .

Masking

Masking suppresses localized spatial regions with mask ratios 0.0 , 0.1 , 0.2 , and 0.3 , using patch sizes between 8 and 24 pixels. It evaluates the effect of local spatial unreliability in the multispectral input.

K-Drop Band Removal

K-drop removes a target-dependent number of spectral bands from selected spectral groups. It directly evaluates robustness to missing or unavailable spectral information, with particular relevance to non-visible spectral evidence.

Compound Spectral–Spatial Corruption

The compound spectral–spatial corruption family, denoted as CS2C, combines radiometric drift, spatial masking, resolution mismatch, band misregistration, and K-drop band removal within a single controlled degradation. It is designed to stress the classifier under simultaneous spectral and spatial distortions rather than under a single isolated perturbation. CS2C uses four ordinal severity levels indexed from 0 to 3, with the exact parameter schedule reported in Table 2. At each severity level, drift is applied in scaled-reflectance space, masking suppresses random rectangular spatial regions, resolution mismatch is simulated by downsampling and bilinear upsampling selected bands, misregistration spatially shifts selected bands, and K-drop removes a target-dependent number of bands from the selected target pool. Severity 0 corresponds to the unperturbed condition, whereas higher severities progressively increase the combined degradation. As for the other perturbation families, CS2C is used as a controlled stress test and should not be interpreted as an exhaustive simulation of all operational acquisition conditions.
The perturbations are evaluated on several spectral targets, including NIR, SWIR, NIR + SWIR, and non-RGB bands. The non-RGB target degrades non-visible spectral information while preserving the visible RGB channels. For CS2C, the selected target determines the bands affected by drift, masking, resolution mismatch, misregistration, and the band pool from which K-drop selects removed bands. Because perturbation families differ in severity and target structure, results are reported separately by corruption family. Additional severity-level and target-wise analyses are provided in Supplementary Sections S1.5 and S1.6, respectively.

4.5. Evaluation Metrics

The primary metric is Macro-F1, which gives equal importance to all classes and is suitable when robustness effects differ across land-cover categories. Accuracy is also reported for clean evaluation and selected robustness summaries as a standard reference metric.
For a given metric M, the family-level robustness gain of Group-CL-RC over the multispectral-only baseline is defined as
Δ M avg = M avg GCL-RC M avg MS ,
where M avg GCL-RC and M avg MS denote the average performances of Group-CL-RC and ms_only, respectively, over the matched evaluation points of a corruption family.
Worst-case robustness gain is defined as
Δ M worst = M worst GCL-RC M worst MS ,
where M worst GCL RC and M worst MS denote the lowest performances observed within the corresponding corruption family.
For robustness-retention diagnostics, we also report the fraction of clean Macro-F1 preserved under non-clean perturbations. This metric complements absolute Macro-F1 by quantifying how much nominal performance is retained under degraded inputs.

4.6. Statistical Analysis

Results are reported as mean ± standard deviation over the relevant seeds, corruption instances, or matched evaluation grids, depending on the experimental block. The main clean comparison between ms_only and Group-CL-RC is reported over five seeds across four backbones. The main EuroSAT robustness comparison uses matched evaluation points, where each pair shares the same backbone, checkpoint seed, corruption family, target group, and perturbation level. This design isolates the effect of the model variant from variation in the robustness grid.
For inferential comparison blocks, paired statistical analyses are performed on matched evaluation points. For each inferential block, we report the mean paired difference, bootstrap confidence intervals, paired significance tests, Cohen’s d z when applicable, win/tie/loss counts, and Holm-corrected p-values for related comparison families. Statistical analyses are reported separately for the main EuroSAT robustness evaluation, SEN12MS external validation, objective-component ablation, descriptor-granularity ablation, and training-time corruption ablation.
The matched external-baseline comparison is reported as a descriptive controlled comparison over three seeds and the compact robustness grid. Since its purpose is to contextualize Group-CL-RC against representative external training objectives rather than to establish a universal dominance claim, we report mean ± standard deviation but do not use this block as a separate inferential hypothesis test.
The objective-component ablation compares group_cl, group_rc, and Group-CL-RC in a controlled setting using ConvNeXt-Tiny and Swin-Tiny over three seeds. This block is separated from the full four-backbone robustness comparison because it addresses whether relation consistency is independently effective and whether it complements group_cl.
For relation-deformation diagnostics, we report relation-deformation measures, relation-preservation scores, Macro-F1 drops, robustness retention, and sensitivity slopes linking relation deformation to classification degradation. These diagnostics characterize how relation consistency affects internal spectral-group geometry and decision-level sensitivity.

4.7. Computational Profiling Protocol

Computational profiling quantifies the training-time and inference-time cost of the evaluated variants. Profiling is performed with ConvNeXt-Tiny and Swin-Tiny. For each backbone and variant, profiling is repeated over three seeds using six-epoch wall-clock runs with the original backbone-specific batch size.
We report trainable parameters, THOP forward-pass multiply–accumulate operations (MACs), average wall-clock time per epoch, training throughput in images per second, and peak GPU memory. The reported MACs correspond to the inference forward pass. The epoch-time measurements characterize relative training overhead under the same hardware and software environment and are not intended as hardware-independent runtime estimates.

4.8. Software, Code Availability, and Reproducibility

All experiments were implemented in Python 3.10.19 using PyTorch 2.7.1 compiled with CUDA 11.8, torchvision 0.22.1, timm 1.0.23, NumPy 2.2.6, SciPy 1.15.3, scikit-learn 1.7.2, and THOP 0.1.1.post2209072238. The experiments were conducted under Ubuntu 24.04.4 LTS on an Alienware Aurora R8 workstation (Dell Technologies, Round Rock, TX, USA) equipped with two NVIDIA GeForce RTX 2070 SUPER GPUs, each with 8 GB of memory (NVIDIA Corporation, Santa Clara, CA, USA), using NVIDIA driver 595.71.05. Backbone architectures were instantiated using the timm and torchvision libraries.
Backbone-specific hyperparameters, objective weights, contrastive schedules, relation-consistency settings, perturbation configurations, and profiling settings are documented in Supplementary Section S1.1 and Supplementary Tables S1–S10.
The training and evaluation scripts, configuration files, robustness-evaluation utilities, and statistical-analysis scripts will be made available in a public repository upon publication. Additional materials may be provided by the corresponding author upon reasonable request.

5. Results

This section evaluates Group-CL-RC from complementary perspectives. We first report clean EuroSAT performance, then analyze robustness under structured spectral and spatial perturbations using matched evaluation points. We next assess the statistical support of the EuroSAT robustness gains and provide a matched comparison with representative corruption-training and contrastive baselines. We then evaluate external robustness on Sentinel-2-only SEN12MS under standard and seasonal-shift protocols. Finally, we analyze objective components, descriptor granularity, training-time corruption, worst-case behavior, relation-deformation sensitivity, qualitative examples, and computational cost. Unless otherwise stated, results are reported as mean ± standard deviation over the relevant seeds or matched evaluation grid.

5.1. Clean Performance on EuroSAT

We first examine whether Group-CL-RC preserves nominal classification performance on clean EuroSAT All Bands test samples. Table 3 compares Group-CL-RC with the multispectral-only baseline across four backbones over five seeds. For Group-CL-RC, clean scores are reported using the no-margin evaluation output to ensure comparability with the multispectral-only baseline.
Group-CL-RC preserves strong clean performance across convolutional and transformer-style backbones. The Macro-F1 differences relative to ms_only remain small: +0.0007 for ConvNeXt-Tiny, +0.0022 for EfficientNet-B0, +0.0009 for ResNet-50, and +0.0004 for Swin-Tiny. Thus, the robustness-oriented objective does not introduce a meaningful clean-performance penalty in the evaluated EuroSAT setting. Because both variants already achieve high clean Macro-F1, the central empirical question is whether Group-CL-RC improves robustness under structured degradation. Additional clean ablations are reported in Supplementary Section S1.2 and Supplementary Tables S11 and S12.

5.2. Robustness Under Structured Spectral and Spatial Corruptions on EuroSAT

We next evaluate robustness under structured spectral and spatial perturbations using matched evaluation points. Each matched point uses the same corruption family, backbone, checkpoint seed, target group, and perturbation level for both ms_only and Group-CL-RC. Table 4 reports the full-grid matched averages, and Figure 2 provides the corresponding visual summary.
Group-CL-RC improves Macro-F1 over ms_only across all four corruption families. The largest gains occur under CS2C, where Macro-F1 increases from 0.7094 to 0.9465, and under K-drop, where it increases from 0.7572 to 0.9461. These families directly disrupt non-visible spectral information and are therefore central to evaluating relation-aware multispectral robustness. The CS2C result should be interpreted within the controlled matched perturbation protocol used here: it demonstrates strong stability under the defined compound stress test, but not a universal guarantee against all real-world spectral–spatial shifts.
Drift and masking produce smaller but consistently positive gains, with Macro-F1 increasing from 0.9506 to 0.9860 under drift and from 0.9159 to 0.9797 under masking. Because the K-drop grid contains a target-dependent number of perturbation levels, a target-balanced family average was also computed; the K-drop gain remains substantial at +0.1688 Macro-F1.
Table 5 decomposes the matched robustness comparison by backbone. Group-CL-RC improves over ms_only for all four backbones and all corruption families, showing that the robustness gain is not restricted to a single architecture.
Under CS2C, gains remain large across architectures, ranging from +0.2154 on Swin-Tiny to +0.2737 on ResNet-50. Under K-drop, gains range from +0.1367 on EfficientNet-B0 to +0.2347 on Swin-Tiny, supporting the conclusion that Group-CL-RC is especially useful when spectral-group availability is disrupted. Drift produces smaller but positive gains, while masking yields intermediate improvements. Target-wise results in Supplementary Section S1.6 and Supplementary Figure S1 further show positive gains for all evaluated spectral targets.

5.3. Statistical Significance of EuroSAT Robustness Gains

We next assess whether the robustness gains observed on EuroSAT are statistically supported under matched evaluation. The analysis is performed on paired Macro-F1 values, where each pair compares ms_only and Group-CL-RC under the same backbone, checkpoint seed, corruption family, target group, and perturbation level.
To avoid diluting robustness effects with unperturbed or near-clean levels, the main statistical table focuses on non-clean perturbation conditions. These results are summarizes in Table 6. Full-grid statistical results, including all perturbation levels, are reported in Supplementary Section S1.3 and Supplementary Table S13.
The paired analysis confirms that the EuroSAT robustness gains are statistically supported. Across all non-clean perturbation conditions, Group-CL-RC improves Macro-F1 from 0.7807 to 0.9560, corresponding to a +0.1753 absolute gain and a +22.46% relative improvement. This global improvement remains significant after Holm correction for both the paired t-test and the Wilcoxon signed-rank test.
Family-wise results show the largest supported gains under CS2C and K-drop, followed by masking and drift. Thus, the improvements reported in Table 4 reflect systematic matched gains rather than isolated numerical fluctuations. For completeness, the clean paired comparison also shows a small supported Macro-F1 gain, from 0.9879 to 0.9890 over 20 matched clean pairs; its magnitude confirms that the main contribution of Group-CL-RC lies in robustness rather than nominal clean accuracy.

5.4. Matched External-Baseline Comparison

To address the need for a direct quantitative comparison with representative external learning objectives, we add a matched EuroSAT All Bands comparison. Rather than comparing with published scores obtained under different modalities, band configurations, splits, or robustness protocols, all baselines are implemented within the same pipeline and evaluated with the same train/test split, three seeds, checkpoint-selection criterion, compact robustness grid, and Macro-F1 metric.
The comparison includes three representative baselines. CorruptTrain-MS is our controlled supervised corruption-augmentation baseline: each sample is optimized with the same classification objective using clean and structured-corrupted multispectral views, following the general corruption-robustness and image-augmentation paradigms [5,23]. Because no named published architecture is reproduced, CorruptTrain-MS should be interpreted as an implementation-controlled baseline rather than as a direct reimplementation of a specific published method. SupCon-MS adapts the supervised contrastive loss of Khosla et al. [32] to the fused multispectral representation. Paired-View InfoNCE-MS adapts the SimCLR contrastive formulation of Chen et al. [29], treating the clean and structured-corrupted multispectral views of the same image as the positive pair. Group-CL-RC is evaluated with the default VIS–NIR–SWIR descriptor for both ConvNeXt-Tiny and Swin-Tiny; the red-edge-aware descriptor is kept as a separate descriptor-granularity ablation. This block is interpreted descriptively rather than as a separate inferential dominance test. Additional family-level results for the matched external-baseline comparison are reported in the Supplementary Materials, where ConvNeXt-Tiny and Swin-Tiny are detailed separately.
Table 7 shows that the matched external baselines are strong competitors. On ConvNeXt-Tiny, Group-CL-RC remains close to the strongest robust average and outperforms the two contrastive baselines in aggregate robustness. CorruptTrain-MS obtains the highest robust average, confirming that direct supervised exposure to structured corruptions is a strong robustness factor.
On Swin-Tiny, CorruptTrain-MS is clearly stronger under the compact robustness protocol, while Group-CL-RC preserves the highest clean Macro-F1 among the compared methods. These results position Group-CL-RC as a competitive and interpretable spectral-relation objective, not as a universally dominant replacement for corruption-training strategies. They also clarify that robustness behavior is architecture-dependent under structured multispectral degradation.

5.5. External Validation on SEN12MS

We further evaluate Group-CL-RC on SEN12MS as an external Sentinel-2-only validation setting. As described in Section 4.1, the Sentinel-1 component is excluded, and the evaluation is restricted to the ten retained Sentinel-2 bands used in our SEN12MS setting. This 10-band input retains the VIS, NIR, and SWIR bands required by the relation-consistency descriptor, which keeps the protocol aligned with the proposed VIS–NIR–SWIR framework. The goal is not to establish benchmark-leading SEN12MS performance, but to assess whether the EuroSAT robustness trends remain meaningful under different scenes, class distributions, spatial coverage, and seasonal conditions.
Table 8 reports the compact SEN12MS summary. Clean performance is averaged over two protocols, two backbones, and three seeds. The robustness columns report Macro-F1 over the strictly aligned non-clean validation grid: drift uses severity 2, while K-drop and CS2C use severities 2 and 3. Robust Avg. is the unweighted average of the three family-level means and is used only as a compact aggregate.
The SEN12MS results are more challenging than the EuroSAT results, as expected for an external validation setting with different sampling, taxonomy, geographic coverage, and seasonal structure. On clean SEN12MS samples, ms_only obtains the highest Macro-F1, so the external validation does not indicate a clean-performance advantage for Group-CL-RC. This is consistent with the role of Group-CL-RC as a robustness-oriented regularizer rather than a mechanism primarily designed to improve nominal accuracy.
Under non-clean perturbations, both group-structured variants substantially improve over ms_only. Group-CL-RC increases the robust average from 0.3945 to 0.4997, while group_cl obtains a similar value of 0.5005. The paired analysis shows that Group-CL-RC significantly improves over ms_only at the pooled non-clean level, but is not globally different from group_cl. Thus, SEN12MS supports the robustness value of group-structured learning while limiting any claim of universal Group-CL-RC superiority over standard Group-CL.
The clearest Group-CL-RC-specific advantage appears under K-drop. Group-CL-RC reaches 0.5333 Macro-F1, compared with 0.4324 for ms_only and 0.5128 for group_cl; the gain over group_cl remains statistically supported after Holm correction. Under CS2C, both group-structured variants remain well above ms_only, but group_cl obtains the higher mean. Overall, SEN12MS strengthens the paper in a controlled and conservative way: the EuroSAT robustness conclusions are not confined to a single dataset, but the added benefit of relation consistency remains perturbation-dependent.

5.6. Objective-Component Ablation

We next isolate the contributions of group-level contrastive alignment and relation consistency by comparing group_cl, group_rc, and Group-CL-RC. The ablation is evaluated with ConvNeXt-Tiny and Swin-Tiny over three seeds. Table 9 reports the global results across the four corruption families.
The ablation reveals a perturbation-dependent profile. Relation consistency is not merely a secondary add-on to Group-CL: group_rc is itself a strong robustness mechanism, especially under CS2C and masking. Under CS2C, group_rc improves over group_cl by +0.1207 Macro-F1 and obtains the highest global mean; under masking, it also obtains the best mean, with a +0.0352 gain over group_cl.
Under K-drop, the full Group-CL-RC objective performs best, improving over the best single-component variant by +0.0470. This indicates that group-level contrastive alignment and relation consistency are most complementary when spectral-group availability is directly degraded. The backbone-wise analysis in Supplementary Section S1.9 and Supplementary Table S19 supports the same interpretation: Group-CL-RC is best under K-drop for both ConvNeXt-Tiny and Swin-Tiny, whereas the best variant under CS2C and masking depends on the corruption family and backbone.

5.7. Descriptor-Granularity Ablation

We further test whether a finer relation descriptor improves EuroSAT robustness. This descriptor-granularity ablation uses ConvNeXt-Tiny over three seeds. The default Group-CL-RC descriptor models the three pairwise VIS–NIR–SWIR relations, whereas the red-edge-aware descriptor adds the Sentinel-2 red-edge bands as a fourth group, increasing the descriptor size from three to six pairwise relations. The results of this ablation are reported in Table 10.
The red-edge-aware descriptor improves the global non-clean Macro-F1 from 0.9571 to 0.9680, a +0.0109 absolute gain. This robustness gain remains statistically supported after Holm correction, whereas the smaller clean Macro-F1 increase is not statistically significant. At the family level, the largest numerical gain occurs under CS2C, suggesting that explicitly separating red-edge bands can help when spectral and spatial degradations jointly affect the multispectral input.
This improvement comes with a measurable cost: the descriptor size increases from three to six relations, and average training time rises from 2.531 h to 3.025 h, an overhead of approximately +19.5%. We therefore retain the compact VIS–NIR–SWIR descriptor as the default configuration, while treating the red-edge-aware descriptor as a more robust but more expensive alternative.

5.8. Training-Time Corruption Ablation

We next analyze how the training-time corruption used to construct the degraded view affects Group-CL-RC. This ablation is conducted on EuroSAT with ConvNeXt-Tiny over three seeds. We compare K-drop on NIR + SWIR bands, drift on non-RGB bands, masking on non-RGB bands, and a mixed strategy that samples heterogeneous corruption types. All variants are evaluated on the same clean and robustness grid.
The training-time corruption ablation results are reported in Table 11.
All four training-time corruption strategies preserve similar clean Macro-F1, with differences below 0.001. Thus, the corruption choice mainly affects robustness rather than nominal clean performance. K-drop on NIR + SWIR bands obtains the highest aggregate robustness and the best K-drop performance, supporting its use as the default training-time corruption for Group-CL-RC.
The best training corruption nevertheless depends on the evaluation family. Masking non-RGB bands performs best under masking and also obtains the highest CS2C Macro-F1, indicating that spatially structured degradation during training can help when evaluation includes masking or compound spectral–spatial effects. However, it is weaker under K-drop than K-drop NIR + SWIR training. The mixed strategy does not dominate the structured single-corruption strategies, suggesting that heterogeneous corruption exposure alone is not sufficient to improve global robustness.

5.9. Worst-Case and Retention Analysis

The previous sections report average robustness gains. We now examine whether the benefit of relation consistency also appears under severe perturbations and observed worst-case diagnostic points. This analysis compares group_cl with Group-CL-RC to isolate the effect of adding relation consistency on top of group-level contrastive learning.
Table 12 shows that Group-CL-RC improves the observed worst-case Macro-F1 over group_cl in all four corruption families. The largest gain occurs under CS2C, where worst-case Macro-F1 increases from 0.5749 to 0.7409, followed by K-drop, where it increases from 0.6226 to 0.7065.
Table 13 confirms the worst-case findings through a retention-based analysis. Across all corruption families, Group-CL-RC preserves a larger fraction of clean Macro-F1 than group_cl. The improvement is particularly visible under CS2C, where mean F1 retention increases from 0.7573 to 0.9076 and worst-case retention increases from 0.5812 to 0.7494. Under K-drop, mean retention increases from 0.8673 to 0.9256 and worst-case retention increases from 0.6313 to 0.7146. Masking and drift also show improved retention, although their absolute F1 drops are smaller.
Figure 3 summarizes the severity-level gains. Because perturbation levels have family-specific meanings, the x-axis should be read as an ordinal severity index within each corruption family. At clean or near-clean levels, differences between group_cl and Group-CL-RC are negligible and can be slightly negative. As perturbations become more severe, relation consistency provides larger gains, especially under CS2C, K-drop on NIR + SWIR, and masking. The full severity-level diagnostic table is provided in Supplementary Section S1.5 and Supplementary Table S17.

5.10. Relation-Deformation Sensitivity Analysis

We finally analyze the relationship between relation deformation and classification degradation. This diagnostic clarifies the role of the relation-consistency regularizer and avoids interpreting D RC as a direct performance metric. Here, D RC measures perturbation-induced deformation in the inter-group relation descriptor, whereas Macro-F1 drop measures downstream degradation relative to the corresponding clean condition. A model may therefore exhibit larger raw relation deformation while remaining less sensitive to that deformation at the decision level.
Table 14 reports the global sensitivity of Macro-F1 degradation to relation deformation. Compared with group_cl, Group-CL-RC substantially reduces the slope between D RC and Macro-F1 drop, from 0.2623 to 0.0917, while also reducing the mean Macro-F1 drop from 0.0767 to 0.0357. This occurs even though the mean raw D RC is higher for Group-CL-RC. The result supports the interpretation that relation consistency primarily reduces decision-level sensitivity to relation deformation rather than uniformly minimizing deformation magnitude.
Figure 4 visually supports the conclusion drawn from Table 14. The Group-CL-RC points can occupy higher D RC ranges, but their associated Macro-F1 drops remain lower on average. This supports the interpretation that the relation-consistency objective improves tolerance to relation deformation, rather than uniformly suppressing the deformation magnitude itself.
The family-wise analysis in Table 15 supports the same interpretation. The slope is lower for Group-CL-RC in all four corruption families, with the clearest reductions under CS2C, K-drop, and masking. Drift should be interpreted more cautiously because absolute F1 drops remain small for both variants.
The bucket analysis further illustrates this tolerance effect. Across low, mid, and high relation-deformation regimes, Group-CL-RC produces lower Macro-F1 drops than group_cl. Thus, even when the relation descriptor is substantially affected by perturbation, Group-CL-RC tends to preserve the final classification decision more effectively.
Additional point-level and family-wise diagnostics are reported in Supplementary Section S1.7, Supplementary Table S18, and Supplementary Figures S2–S5. These supplementary results include the detailed relation-deformation values, Macro-F1 drops, deformation-normalized drops, family-specific sensitivity summaries, and family-wise scatter plots used to support the interpretation in Table 14, Table 15 and Table 16 and Figure 4.
Overall, the relation-deformation diagnostics show that relation consistency acts as a tolerance-inducing regularizer. It does not simply force relation descriptors to remain close under every corruption. Instead, it shapes the representation so that perturbation-induced changes in inter-group relations have a smaller effect on the final decision. Together with the robustness, ablation, worst-case, and retention analyses, this supports inter-group relational geometry as an interpretable robustness target for multispectral classification.

5.11. Qualitative Analysis

To complement the quantitative robustness results, Figure 5 provides representative qualitative examples. The selected cases illustrate situations where the multispectral-only baseline changes to an incorrect prediction under structured perturbation, whereas Group-CL-RC preserves the correct class decision. These examples are illustrative rather than statistical evidence, and should be read together with the matched robustness, ablation, retention, and relation-deformation analyses.
In the drift example, the true class is Highway. The baseline changes from Highway under the clean input to PermanentCrop under drift on non-RGB bands, whereas Group-CL-RC preserves the Highway prediction. The masking and CS2C examples involve HerbaceousVegetation samples for which the baseline changes to Pasture, while Group-CL-RC preserves the correct class. The K-drop example corresponds to a River sample under NIR + SWIR band removal; the baseline changes to AnnualCrop, whereas Group-CL-RC preserves River.
Overall, the qualitative examples provide concrete illustrations of the robustness behavior quantified above. They should not be interpreted as additional statistical proof; the main evidence remains the matched quantitative evaluation, statistical tests, ablations, and diagnostic analyses.

5.12. Computational Profiling

We finally report computational profiling results for the main model variants. This analysis is included to clarify the practical cost of the proposed objective and to distinguish training-time overhead from inference-time model complexity. Profiling is conducted on EuroSAT using ConvNeXt-Tiny and Swin-Tiny over three seeds. For each backbone, we compare ms_only, group_cl, group_rc, and Group-CL-RC. The profiling runs use six training epochs and report average wall-clock time per epoch, training throughput, peak GPU memory, trainable parameters, and forward-pass MACs.
Table 17 shows that, for a fixed backbone, trainable parameters and forward-pass MACs remain essentially unchanged across variants. This is expected because the inference-time decision pathway is shared, whereas the auxiliary group-level and relation-consistency objectives are used only during training. Thus, Group-CL-RC does not introduce a substantially heavier inference architecture.
The main cost appears during training. For ConvNeXt-Tiny, the average time per epoch increases from 53.28 s for ms_only to 108.00 s for Group-CL-RC, corresponding to a 2.03× overhead. For Swin-Tiny, it increases from 89.30 s to 204.89 s, corresponding to a 2.29× overhead. This overhead is mainly due to degraded-view processing and relation-consistency computation.
Peak GPU memory remains within a practical range in the evaluated setting. For Group-CL-RC, measured peak memory is 2602 MB with ConvNeXt-Tiny and 3444 MB with Swin-Tiny. Overall, Group-CL-RC introduces a real but training-focused overhead while keeping inference complexity essentially unchanged. This trade-off is consistent with the design of the method: relation consistency improves robustness through auxiliary training constraints rather than through a substantially larger inference model.

6. Discussion

6.1. Main Findings

The experimental results support the central premise of this work: inter-group relational geometry is a meaningful target for improving robustness in multispectral remote sensing classification. Across EuroSAT clean, robustness, ablation, and diagnostic settings, Group-CL-RC preserves strong nominal performance while improving robustness under structured spectral and spectral–spatial degradation. The largest gains occur under CS2C and K-drop, indicating that the method is most useful when non-visible spectral information and cross-spectral complementarity are directly disrupted.
The matched external-baseline comparison places these gains in a more conservative context. CorruptTrain-MS is a strong supervised corruption-training baseline, especially with Swin-Tiny, whereas Group-CL-RC remains competitive and preserves an explicit spectral-relation objective. Thus, the contribution should be interpreted as a relation-aware robustness mechanism rather than as a universally dominant replacement for all corruption-training strategies.
The SEN12MS validation further supports this interpretation. Group-structured learning improves robustness over the multispectral-only baseline under the constructed Sentinel-2-only protocols, but the advantage of Group-CL-RC over standard Group-CL remains perturbation-dependent. The objective-component ablation clarifies this behavior: relation consistency is an effective robustness mechanism in its own right, while its combination with Group-CL is most clearly justified when spectral-group availability is degraded.

6.2. Interpretation of Relation Consistency

The relation-consistency term regularizes the internal similarity structure among VIS, NIR, and SWIR group embeddings across clean and corrupted views. However, it should not be interpreted as enforcing strict invariance of the relation descriptor under every corruption. Some perturbations can legitimately alter inter-group relations, especially when non-visible spectral groups are removed, masked, or strongly distorted.
The relation-deformation sensitivity analysis provides a more precise interpretation. Group-CL-RC does not uniformly reduce the raw magnitude of relation deformation measured by D RC . Instead, it reduces the downstream sensitivity of the classifier to perturbation-induced relation changes. The model can therefore experience measurable descriptor deformation while preserving a more stable classification decision.
This tolerance-based interpretation is important. The goal is not to make all clean and corrupted relation descriptors identical, but to learn representations in which inter-group spectral relations remain useful and less fragile for the final decision. The worst-case, retention, bucket-level, and relation-deformation diagnostics consistently support this interpretation.

6.3. Clean Accuracy and Robustness Are Distinct Objectives

The clean evaluation confirms that high nominal performance does not fully characterize multispectral model reliability. Several variants achieve strong clean Macro-F1, and differences among competitive multispectral models remain small under clean conditions. However, the robustness evaluation reveals substantially different behaviors when inputs are affected by structured spectral and spectral–spatial degradation.
This distinction is central for multispectral remote sensing. A model evaluated only under clean conditions may appear reliable while remaining vulnerable to degradation of NIR or SWIR information. Such degradation is practically important because non-visible bands provide vegetation, moisture, and material-composition cues that cannot be fully recovered from RGB channels alone. The gains obtained by Group-CL-RC, especially under CS2C and K-drop, therefore support treating robustness as a primary evaluation axis in multispectral classification rather than as a secondary property inferred from clean accuracy.
The descriptor-granularity ablation reinforces this conclusion. The red-edge-aware descriptor improves robustness in the evaluated EuroSAT setting but increases training time, showing that robustness, interpretability, and computational cost must be considered jointly when designing relation descriptors. The compact VIS–NIR–SWIR descriptor offers a favorable default balance.

6.4. Role of Group-CL and Relation Consistency

Group-level contrastive learning and relation consistency address related but distinct aspects of multispectral robustness. Group-CL promotes compatibility among complementary spectral views, whereas relation consistency regularizes the geometry among spectral groups. The objective-component ablation shows that these mechanisms are not redundant.
The strong performance of group_rc under CS2C and masking demonstrates that relation consistency alone provides a meaningful robustness signal. This separates its contribution from a generic multi-loss or contrastive-learning effect. Conversely, the superior behavior of Group-CL-RC under K-drop shows that the full objective is especially beneficial when spectral-group availability is degraded: Group-CL helps organize the embedding space, while relation consistency stabilizes the inter-group geometry.
The training-time corruption ablation further shows that the corrupted view used during optimization is not a neutral implementation detail. K-drop on NIR + SWIR bands provides the best aggregate robustness in the evaluated setting, while masking non-RGB bands remains competitive under masking and CS2C. This suggests that training-time corruption design should be treated as a meaningful robustness factor.

6.5. Practical Implications

The proposed framework has direct implications for deployment-oriented multispectral remote sensing. Operational Earth observation data may be affected by radiometric variability, partial spectral unreliability, local masking, missing bands, seasonal shifts, or changes in acquisition conditions. A classifier that performs well only under clean conditions may therefore be insufficient for applications requiring reliable decisions under imperfect data acquisition.
Group-CL-RC addresses this issue by explicitly modeling physically meaningful spectral groups and their relational geometry. The strongest gains under CS2C and K-drop indicate that the method is particularly relevant when non-visible spectral information is degraded, partially unavailable, or structurally distorted. Because the method operates on group embeddings and relation descriptors, it can be integrated with convolutional and transformer-style backbones without redesigning the inference classifier.
The computational profiling clarifies the practical trade-off. For a fixed backbone, Group-CL-RC keeps trainable parameters and inference forward-pass MACs essentially unchanged. The main additional cost appears during training, where degraded-view processing and relation-consistency optimization approximately double the training time relative to the multispectral-only baseline in the evaluated setup. Thus, Group-CL-RC should be interpreted as a training-time robustness regularization strategy with real but controlled overhead, not as an inference-heavy architecture.

6.6. Scope and Limitations

This study does not aim to establish state-of-the-art superiority over all recent remote-sensing representation-learning methods. Its objective is more specific: to isolate and evaluate the contribution of inter-group relation consistency under controlled multispectral degradation. The matched external-baseline comparison addresses this issue for representative corruption-training and contrastive objectives under the same EuroSAT All Bands setting, Sentinel-2 band configuration, training protocol, perturbation families, evaluation split, and seed setting. The SEN12MS experiments provide an additional Sentinel-2-only validation setting based on different scenes, class distributions, and seasonal conditions. These evaluations should therefore be interpreted as controlled contextual comparisons rather than as an exhaustive benchmark against the full remote-sensing literature.
This study validates relation-consistency regularization primarily on EuroSAT All Bands and complements it with SEN12MS external validation. EuroSAT is appropriate for testing the proposed principle because it provides Sentinel-2 imagery, multiple land-cover classes, and access to non-visible spectral bands. SEN12MS extends the evaluation to a different dataset construction with scene-disjoint and seasonal-shift protocols. Nevertheless, these experiments do not constitute exhaustive evidence of universal operational generalization.
The SEN12MS setting is deliberately restricted to the Sentinel-2 multispectral component. Sentinel-1 data are not used, and no multi-sensor fusion is performed. This keeps the external validation aligned with the proposed VIS–NIR–SWIR relation-consistency framework, but it also means that this study does not evaluate SAR–optical fusion, full SEN12MS multi-sensor learning, or cross-sensor transfer.
The perturbation protocol provides controlled and interpretable stress tests through drift, masking, K-drop, and CS2C. These perturbations isolate complementary degradation mechanisms and enable matched comparisons among model variants. However, they remain controlled approximations of operational degradation rather than exhaustive simulations of real acquisition conditions. Real atmospheric effects, clouds and shadows, sensor-specific degradation, spatial-resolution inconsistencies across bands, and naturally occurring missing-band scenarios remain important directions for future work.
The relation descriptor used here is intentionally compact and interpretable, relying on three pairwise similarities among VIS, NIR, and SWIR embeddings. This design makes the method lightweight at the descriptor level, architecture-compatible, and easy to analyze, but it does not capture all higher-order, spatially localized, red-edge-specific, or class-conditioned spectral dependencies. The descriptor-granularity ablation shows that a red-edge-aware descriptor can improve robustness at additional cost, suggesting that richer descriptors may be useful when the target application justifies the overhead.
Finally, the default training-time corruption uses K-drop on NIR + SWIR bands. The training-time corruption ablation supports this choice as a balanced default in the evaluated setting, but it also shows that masking non-RGB bands can be preferable under masking and CS2C evaluation. Future work should therefore explore adaptive curricula, corruption-family-aware training, and deployment-specific corruption policies rather than assuming that a single fixed corruption is optimal for all operational conditions.
Overall, the results support inter-group relational geometry as a meaningful and effective target for robust multispectral representation learning under the evaluated Sentinel-2 settings and structured perturbation protocols. By explicitly regularizing relationships among physically meaningful spectral groups, Group-CL-RC improves robustness under controlled spectral degradation while maintaining strong clean classification performance and preserving an inference-time architecture comparable to the underlying backbone.

7. Conclusions

This paper introduced Relation-Consistency Group Contrastive Learning (Group-CL-RC), a robustness-oriented representation-learning framework for Sentinel-2 multispectral land-cover classification. The central idea is to exploit not only class-discriminative embeddings, but also the relational geometry among physically meaningful VIS, NIR, and SWIR spectral groups. By combining group-level contrastive alignment with relation-consistency regularization, Group-CL-RC uses the internal structure of multispectral imagery as a training-time robustness signal under spectral degradation.
The experiments on EuroSAT All Bands show that Group-CL-RC preserves strong clean classification performance while improving robustness under radiometric drift, spatial masking, K-drop band removal, and compound spectral–spatial corruption. The largest gains occur under K-drop and CS2C, confirming that relation-aware regularization is particularly useful when non-visible spectral information is degraded, unavailable, or structurally distorted. The Sentinel-2-only SEN12MS validation further supports the robustness-oriented behavior of the method under standard scene-disjoint and seasonal-shift protocols, while showing that the advantage over standard Group-CL remains perturbation-dependent. The matched external-baseline comparison also shows that corruption-training and contrastive objectives are strong competitors under controlled EuroSAT evaluation, positioning Group-CL-RC as a competitive and interpretable relation-aware objective rather than as a universally dominant training strategy.
The ablation studies clarify the source and scope of these gains. Relation consistency is effective in its own right, as shown by the strong performance of the group_rc variant under compound corruption and masking. The full Group-CL-RC objective provides its clearest advantage under K-drop, where group-level alignment and relation consistency act complementarily. Descriptor-granularity and training-time corruption ablations further show that robustness depends on both the relation descriptor and the corrupted view used during optimization.
The relation-deformation diagnostics provide an important interpretation of the proposed mechanism. Group-CL-RC should not be understood as simply minimizing raw relation-deformation magnitude under every corruption. Instead, the sensitivity analysis shows that it reduces the downstream effect of relation deformation on classification degradation. This explains why the method can preserve correct decisions even when the measured relation descriptor changes substantially under perturbation.
Computational profiling shows that the robustness improvement mainly comes from training-time overhead rather than from a heavier inference model. For a fixed backbone, trainable parameters and inference forward-pass MACs remain essentially unchanged, while the additional cost arises during optimization from degraded-view processing and the auxiliary relation-consistency objective. Thus, Group-CL-RC provides a training-time robustness regularization strategy with a real but controlled computational cost.
Future work should extend this framework to broader multispectral and hyperspectral datasets, larger geographic and temporal settings, cross-region and cross-sensor evaluation, and downstream tasks such as semantic segmentation, crop monitoring, change detection, burned-area mapping, and environmental risk assessment. Further work should also investigate richer relation descriptors, adaptive corruption curricula, deployment-specific degradation models, and combinations with domain adaptation, test-time adaptation, and uncertainty-aware prediction.

Supplementary Materials

The following supporting information can be downloaded at https://www.mdpi.com/article/10.3390/technologies14080499/s1, Supplementary Section S1: Supplementary Experimental and Implementation Details. Supplementary Section S1.1 provides detailed implementation and hyperparameter settings. Supplementary Section S1.2 reports additional clean results. Supplementary Section S1.3 reports full-grid EuroSAT statistical tests. Supplementary Section S1.4 provides detailed SEN12MS external validation results. Supplementary Section S1.5 reports additional severity-level diagnostics. Supplementary Section S1.6 provides additional target-wise robustness results. Supplementary Section S1.7 provides additional relation-deformation diagnostics. Supplementary Section S1.8 reports additional worst-case and retention results. Supplementary Section S1.9 provides backbone-wise objective-component ablation details. Supplementary Section S1.10 provides family-level details for the matched external-baseline comparison; Table S1: Backbone-specific hyperparameters for the ms_only clean baseline; Table S2: group_cl training hyperparameters for the controlled objective-component setting; Table S3: Contrastive weights in the available group_cl configurations; Table S4: Backbone-specific hyperparameters for the group_rc objective-component ablation; Table S5: Backbone-specific relation-consistency weights for the group_rc ablation; Table S6: Training-time relation-consistency settings used in the group_rc ablation; Table S7: Backbone-specific training hyperparameters for the proposed Group-CL-RC variant; Table S8: Objective weights used by the proposed Group-CL-RC variant; Table S9: Contrastive warm-up and ramp-up settings for the Group-CL-RC variant; Table S10: Training-time relation-consistency settings for the proposed Group-CL-RC variant; Table S11: Additional clean ablation results on EuroSAT All Bands under the common three-seed protocol. Results report test Macro-F1 mean ± standard deviation. For each backbone, the highest mean Macro-F1 value among the compared variants is highlighted in bold; Table S12: Clean performance of group_rc without group-level contrastive learning. Results are reported as mean ± standard deviation over three seeds; Table S13: Full-grid paired statistical analysis of EuroSAT robustness gains. Results compare Group-CL-RC against ms_only using matched Macro-F1 pairs over all perturbation levels. Holm-corrected paired t-test and Wilcoxon p-values are reported; Table S14: Detailed SEN12MS external validation by protocol and backbone. Values report Macro-F1 for clean evaluation and non-clean robustness averages. The robust average is computed over the non-clean perturbation families used in the SEN12MS external validation; Table S15: Severity-level SEN12MS robustness details. Values report Macro-F1 averaged over the strictly aligned validation grid for each perturbation severity. Δ RC MS denotes the gain of Group-CL-RC over ms_only, and Δ RC CL denotes the gain of Group-CL-RC over group_cl; Table S16: Compact paired statistical tests for SEN12MS external validation. The table reports selected matched Macro-F1 comparisons that support the main interpretation. Holm-corrected paired t-test and Wilcoxon p-values are shown; Table S17: Severity-level diagnostic comparison between group_cl and Group-CL-RC on representative high-risk targets. Results report Macro-F1 mean ± standard deviation and the gain of Group-CL-RC; Figure S1: Target-wise robustness gains of Group-CL-RC over ms_only across corruption families and perturbed spectral targets. Values report Macro-F1 gains over matched evaluation points; Table S18: Relation-stability diagnostics for group_cl and Group-CL-RC. D RC denotes relation deformation, P rel denotes relation preservation, and F1 drop denotes the degradation from clean to corrupted evaluation. For each corruption family, the lower value between the two variants in the F1 drop and F1 drop/ D RC columns is highlighted in bold; Figure S2: Relation-deformation sensitivity under CS2C; Figure S3: Relation-deformation sensitivity under K-drop; Figure S4: Relation-deformation sensitivity under masking; Figure S5: Relation-deformation sensitivity under drift; Figure S6: Robustness retention comparison between group_cl and Group-CL-RC across corruption families. Higher values indicate better preservation of clean performance under perturbation; Table S19: Objective-component ablation by corruption family and backbone. Results report mean Macro-F1 over three seeds. Δ syn is computed as the gain of Group-CL-RC over the best single-component variant among group_cl and group_rc. For each corruption-family–backbone setting, the highest mean Macro-F1 value among the compared variants is highlighted in bold; Table S20: Matched external-baseline comparison on EuroSAT All Bands using ConvNeXt-Tiny. Results report Macro-F1 mean ± standard deviation over three seeds under the compact robustness protocol. Robust Avg. is computed over Drift, Masking, K-drop, and CS2C; Table S21: Matched external-baseline comparison on EuroSAT All Bands using Swin-Tiny. Results report Macro-F1 mean ± standard deviation over three seeds under the compact robustness protocol. Robust Avg. is computed over Drift, Masking, K-drop, and CS2C.

Author Contributions

Conceptualization, M.K.; methodology, M.K.; software, M.K.; validation, M.K. and N.E.-n.; formal analysis, M.K. and N.E.-n.; investigation, M.K.; resources, N.E.-n.; data curation, M.K.; writing—original draft preparation, M.K.; writing—review and editing, M.K. and N.E.-n.; visualization, M.K.; supervision, N.E.-n.; project administration, N.E.-n. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The EuroSAT All Bands and SEN12MS datasets used in this study are publicly available from the sources cited in the manuscript. The experimental results supporting the findings of this study are included in the article and the Supplementary Materials. Additional implementation details and configuration information are provided in the Supplementary Materials. Further inquiries can be directed to the corresponding author.

Acknowledgments

The authors acknowledge the use of publicly available Sentinel-2 EuroSAT All Bands and SEN12MS data for the experimental evaluation. ChatGPT (OpenAI; version 5.5) was used to assist with language polishing, editorial organization, and the preparation of an illustrative schematic of the proposed method. The authors reviewed, verified, and edited all resulting material and take full responsibility for the content of the publication.

Conflicts of Interest

The authors declare no conflicts of interest.

Abbreviations

The following abbreviations are used in this manuscript:
AMPAutomatic mixed precision
CECross-entropy
CS2CCompound spectral–spatial corruption
DRCRelation-deformation magnitude
GCLGroup-level contrastive learning
Group-CLGroup-level contrastive learning
Group-RCGroup relation consistency
Group-CL-RCRelation-Consistency Group Contrastive Learning
K-dropK-band removal
LRLearning rate
MSMultispectral
NIRNear-infrared
RCRelation consistency
RGBRed–green–blue
SWIRShort-wave infrared
VISVisible

References

  1. Drusch, M.; Del Bello, U.; Carlier, S.; Colin, O.; Fernandez, V.; Gascon, F.; Hoersch, B.; Isola, C.; Laberinti, P.; Martimort, P.; et al. Sentinel-2: ESA’s Optical High-Resolution Mission for GMES Operational Services. Remote Sens. Environ. 2012, 120, 25–36. [Google Scholar] [CrossRef]
  2. Richards, J.A. Remote Sensing Digital Image Analysis, 5th ed.; Springer: New York, NY, USA, 2013. [Google Scholar]
  3. Tucker, C.J. Red and Photographic Infrared Linear Combinations for Monitoring Vegetation. Remote Sens. Environ. 1979, 8, 127–150. [Google Scholar] [CrossRef]
  4. Gao, B.-C. NDWI—A Normalized Difference Water Index for Remote Sensing of Vegetation Liquid Water from Space. Remote Sens. Environ. 1996, 58, 257–266. [Google Scholar] [CrossRef]
  5. Hendrycks, D.; Dietterich, T. Benchmarking Neural Network Robustness to Common Corruptions and Perturbations. In Proceedings of the 7th International Conference on Learning Representations (ICLR 2019), New Orleans, LA, USA, 6–9 May 2019; OpenReview.net: Amherst, MA, USA, 2019. [Google Scholar]
  6. Helber, P.; Bischke, B.; Dengel, A.; Borth, D. EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classification. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2019, 12, 2217–2226. [Google Scholar] [CrossRef]
  7. Schmitt, M.; Hughes, L.H.; Qiu, C.; Zhu, X.X. SEN12MS—A Curated Dataset of Georeferenced Multi-Spectral Sentinel-1/2 Imagery for Deep Learning and Data Fusion. ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci. 2019, IV-2/W7, 153–160. [Google Scholar] [CrossRef]
  8. Pal, M.; Mather, P.M. Support vector machines for classification in remote sensing. Int. J. Remote Sens. 2005, 26, 1007–1011. [Google Scholar] [CrossRef]
  9. Belgiu, M.; Drăguţ, L. Random forest in remote sensing: A review of applications and future directions. ISPRS J. Photogramm. Remote Sens. 2016, 114, 24–31. [Google Scholar] [CrossRef]
  10. Hu, F.; Xia, G.-S.; Hu, J.; Zhang, L. Transferring Deep Convolutional Neural Networks for the Scene Classification of High-Resolution Remote Sensing Imagery. Remote Sens. 2015, 7, 14680–14707. [Google Scholar] [CrossRef]
  11. Cheng, G.; Han, J.; Lu, X. Remote Sensing Image Scene Classification: Benchmark and State of the Art. Proc. IEEE 2017, 105, 1865–1883. [Google Scholar] [CrossRef]
  12. Sumbul, G.; Charfuelan, M.; Demir, B.; Markl, V. BigEarthNet: A Large-Scale Benchmark Archive for Remote Sensing Image Understanding. In Proceedings of the IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Yokohama, Japan, 28 July–2 August 2019; IEEE: New York, NY, USA, 2019; pp. 5901–5904. [Google Scholar] [CrossRef]
  13. Sumbul, G.; Kang, J.; Kreuziger, T.; Marcelino, F.; Costa, H.; Benevides, P.; Caetano, M.; Demir, B. BigEarthNet Dataset with a New Class-Nomenclature for Remote Sensing Image Understanding. arXiv 2020, arXiv:2001.06372. [Google Scholar] [CrossRef]
  14. Dosovitskiy, A.; Beyer, L.; Kolesnikov, A.; Weissenborn, D.; Zhai, X.; Unterthiner, T.; Dehghani, M.; Minderer, M.; Heigold, G.; Gelly, S.; et al. An Image is Worth 16×16 Words: Transformers for Image Recognition at Scale. In Proceedings of the 9th International Conference on Learning Representations (ICLR 2021), Virtual, 3–7 May 2021; OpenReview.net: Amherst, MA, USA, 2021. [Google Scholar]
  15. Liu, Z.; Lin, Y.; Cao, Y.; Hu, H.; Wei, Y.; Zhang, Z.; Lin, S.; Guo, B. Swin Transformer: Hierarchical Vision Transformer using Shifted Windows. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), Montreal, BC, Canada, 11–17 October 2021; IEEE: New York, NY, USA, 2021; pp. 9992–10002. [Google Scholar] [CrossRef]
  16. He, K.; Zhang, X.; Ren, S.; Sun, J. Deep Residual Learning for Image Recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA, 27–30 June 2016; IEEE: New York, NY, USA, 2016; pp. 770–778. [Google Scholar] [CrossRef]
  17. Tan, M.; Le, Q.V. EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks. In Proceedings of the 36th International Conference on Machine Learning (ICML), Long Beach, CA, USA, 9–15 June 2019; PMLR: Cambridge, MA, USA, 2019; Volume 97, pp. 6105–6114. [Google Scholar]
  18. Ma, L.; Liu, Y.; Zhang, X.; Ye, Y.; Yin, G.; Johnson, B.A. Deep learning in remote sensing applications: A meta-analysis and review. ISPRS J. Photogramm. Remote Sens. 2019, 152, 166–177. [Google Scholar] [CrossRef]
  19. Yuan, W.; Xu, W. MSST-Net: A Multi-Scale Adaptive Network for Building Extraction from Remote Sensing Images Based on Swin Transformer. Remote Sens. 2021, 13, 4743. [Google Scholar] [CrossRef]
  20. Aboneh, T.; Rorissa, A.; Srinivasagan, R. Stacking-Based Ensemble Learning Method for Multi-Spectral Image Classification. Technologies 2022, 10, 17. [Google Scholar] [CrossRef]
  21. Alimagambetova, A.; Yessenova, M.; Konyrkhanova, A.; Tatyana, T.; Beissegul, A.; Tashenova, Z.; Kadirkulov, K.; Ulzada, A.; Mauina, G. Early Crop Type Classification Based on Seasonal Spectral Features and Machine Learning Methods. Technologies 2026, 14, 221. [Google Scholar] [CrossRef]
  22. Tuia, D.; Persello, C.; Bruzzone, L. Domain Adaptation for the Classification of Remote Sensing Data: An Overview of Recent Advances. IEEE Geosci. Remote Sens. Mag. 2016, 4, 41–57. [Google Scholar] [CrossRef]
  23. Shorten, C.; Khoshgoftaar, T.M. A survey on Image Data Augmentation for Deep Learning. J. Big Data 2019, 6, 60. [Google Scholar] [CrossRef]
  24. Xin, Y.; Fan, Z.; Qi, X.; Geng, Y.; Li, X. Enhancing Semi-Supervised Semantic Segmentation of Remote Sensing Images via Feature Perturbation-Based Consistency Regularization Methods. Sensors 2024, 24, 730. [Google Scholar] [CrossRef] [PubMed]
  25. Paoletti, M.E.; Haut, J.M.; Plaza, J.; Plaza, A. Deep learning classifiers for hyperspectral imaging: A review. ISPRS J. Photogramm. Remote Sens. 2019, 158, 279–317. [Google Scholar] [CrossRef]
  26. Roy, S.K.; Krishna, G.; Dubey, S.R.; Chaudhuri, B.B. HybridSN: Exploring 3-D–2-D CNN Feature Hierarchy for Hyperspectral Image Classification. IEEE Geosci. Remote Sens. Lett. 2020, 17, 277–281. [Google Scholar] [CrossRef]
  27. Mei, X.; Pan, E.; Ma, Y.; Dai, X.; Huang, J.; Fan, F.; Du, Q.; Zheng, H.; Ma, J. Spectral-Spatial Attention Networks for Hyperspectral Image Classification. Remote Sens. 2019, 11, 963. [Google Scholar] [CrossRef]
  28. Yu, H.; Hou, Y.; Wang, F.; Wang, J.; Zhu, J.; Guo, J. MSSFNet: A Multiscale Spatial–Spectral Fusion Network for Extracting Offshore Floating Raft Aquaculture Areas in Multispectral Remote Sensing Images. Sensors 2024, 24, 5220. [Google Scholar] [CrossRef] [PubMed]
  29. Chen, T.; Kornblith, S.; Norouzi, M.; Hinton, G. A Simple Framework for Contrastive Learning of Visual Representations. In Proceedings of the 37th International Conference on Machine Learning (ICML), Virtual, 13–18 July 2020; Daumé, H., III, Singh, A., Eds.; PMLR: Cambridge, MA, USA, 2020; Volume 119, pp. 1597–1607. [Google Scholar]
  30. He, K.; Fan, H.; Wu, Y.; Xie, S.; Girshick, R. Momentum Contrast for Unsupervised Visual Representation Learning. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA, 14–19 June 2020; IEEE: New York, NY, USA, 2020; pp. 9729–9738. [Google Scholar] [CrossRef]
  31. Grill, J.-B.; Strub, F.; Altché, F.; Tallec, C.; Richemond, P.H.; Buchatskaya, E.; Doersch, C.; Pires, B.A.; Guo, Z.D.; Azar, M.G.; et al. Bootstrap Your Own Latent: A New Approach to Self-Supervised Learning. In Advances in Neural Information Processing Systems; Larochelle, H., Ranzato, M., Hadsell, R., Balcan, M.F., Lin, H., Eds.; Curran Associates, Inc.: Red Hook, NY, USA, 2020; Volume 33, pp. 21271–21284. [Google Scholar]
  32. Khosla, P.; Teterwak, P.; Wang, C.; Sarna, A.; Tian, Y.; Isola, P.; Maschinot, A.; Liu, C.; Krishnan, D. Supervised Contrastive Learning. In Advances in Neural Information Processing Systems; Larochelle, H., Ranzato, M., Hadsell, R., Balcan, M.F., Lin, H., Eds.; Curran Associates, Inc.: Red Hook, NY, USA, 2020; Volume 33, pp. 18661–18673. [Google Scholar]
  33. Radford, A.; Kim, J.W.; Hallacy, C.; Ramesh, A.; Goh, G.; Agarwal, S.; Sastry, G.; Askell, A.; Mishkin, P.; Clark, J.; et al. Learning Transferable Visual Models from Natural Language Supervision. In Proceedings of the 38th International Conference on Machine Learning (ICML), Virtual, 18–24 July 2021; Meila, M., Zhang, T., Eds.; PMLR: Cambridge, MA, USA, 2021; Volume 139, pp. 8748–8763. [Google Scholar]
  34. Jean, N.; Wang, S.; Samar, A.; Azzari, G.; Lobell, D.; Ermon, S. Tile2Vec: Unsupervised Representation Learning for Spatially Distributed Data. Proc. AAAI Conf. Artif. Intell. 2019, 33, 3967–3974. [Google Scholar] [CrossRef]
  35. Ayush, K.; Uzkent, B.; Meng, C.; Tanmay, K.; Burke, M.; Lobell, D.; Ermon, S. Geography-Aware Self-Supervised Learning. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), Montreal, BC, Canada, 11–17 October 2021; IEEE: New York, NY, USA, 2021; pp. 10181–10190. [Google Scholar]
  36. Jain, U.; Uzkent, B.; Ermon, S. Multimodal Contrastive Learning for Remote Sensing Tasks. arXiv 2022, arXiv:2209.02329. [Google Scholar]
  37. Mahara, A.; Rishe, N. Multispectral Band-Aware Generation of Satellite Images across Domains Using Generative Adversarial Networks and Contrastive Learning. Remote Sens. 2024, 16, 1154. [Google Scholar] [CrossRef]
  38. Zhang, G.; Li, J.; Ye, Z. Unsupervised Joint Contrastive Learning for Aerial Person Re-Identification and Remote Sensing Image Classification. Remote Sens. 2024, 16, 422. [Google Scholar] [CrossRef]
  39. Guo, X.; Lao, J.; Dang, B.; Zhang, Y.; Yu, L.; Ru, L.; Zhong, L.; Huang, Z.; Wu, K.; Hu, D.; et al. SkySense: A Multi-Modal Remote Sensing Foundation Model Towards Universal Interpretation for Earth Observation Imagery. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); IEEE: New York, NY, USA, 2024; pp. 27672–27683. [Google Scholar] [CrossRef]
  40. Wang, Y.; Albrecht, C.M.; Zhu, X.X. Multilabel-Guided Soft Contrastive Learning for Efficient Earth Observation Pretraining. IEEE Trans. Geosci. Remote Sens. 2024, 62, 5644516. [Google Scholar] [CrossRef]
  41. Patacchiola, M.; Storkey, A. Self-Supervised Relational Reasoning for Representation Learning. Adv. Neural Inf. Process. Syst. (NeurIPS) 2020, 33, 21760–21771. [Google Scholar]
  42. Zheng, M.; You, S.; Wang, F.; Qian, C.; Zhang, C.; Wang, X.; Xu, C. ReSSL: Relational Self-Supervised Learning with Weak Augmentation. Adv. Neural Inf. Process. Syst. (NeurIPS) 2021, 34, 2543–2555. [Google Scholar]
  43. Park, W.; Kim, D.; Lu, Y.; Cho, M. Relational Knowledge Distillation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); IEEE: New York, NY, USA, 2019; pp. 3967–3976. [Google Scholar] [CrossRef]
  44. Tung, F.; Mori, G. Similarity-Preserving Knowledge Distillation. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, Republic of Korea, 27 October–2 November 2019; IEEE: New York, NY, USA, 2019; pp. 1365–1374. [Google Scholar] [CrossRef]
  45. Zheng, W.; Zhang, B.; Lu, J.; Zhou, J. Deep Relational Metric Learning. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), Montreal, BC, Canada, 11–17 October 2021; IEEE: New York, NY, USA, 2021; pp. 12165–12174. [Google Scholar] [CrossRef]
  46. Deng, J.; Guo, J.; Xue, N.; Zafeiriou, S. ArcFace: Additive Angular Margin Loss for Deep Face Recognition. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA, 16–20 June 2019; IEEE: New York, NY, USA, 2019; pp. 4690–4699. [Google Scholar] [CrossRef]
  47. Liu, Z.; Mao, H.; Wu, C.Y.; Feichtenhofer, C.; Darrell, T.; Xie, S. A ConvNet for the 2020s. In Proceedings of the 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), New Orleans, LA, USA, 18–24 June 2022; IEEE Computer Society: New York, NY, USA, 2022; pp. 11966–11976. [Google Scholar] [CrossRef]
Figure 1. Overview of the proposed Group-CL-RC framework. A Sentinel-2 multispectral image is decomposed into physically meaningful VIS, NIR, and SWIR spectral groups. Clean and corrupted views are processed by a shared multispectral backbone to produce group-specific embeddings. Group-Level Contrastive Learning (Group-CL) aligns complementary spectral representations through pairwise contrastive objectives, while the relation-consistency regularizer promotes stability of the inter-group similarity structure represented by the VIS–NIR, VIS–SWIR, and NIR–SWIR relation descriptor across clean and corrupted views. The final classification branch uses the fused RGB–MS representation for supervised land-cover prediction. The overall training objective integrates classification, group-level contrastive alignment, and relation-consistency regularization: J = L cls + α ( t ) L GCL + λ RC L RC .
Figure 1. Overview of the proposed Group-CL-RC framework. A Sentinel-2 multispectral image is decomposed into physically meaningful VIS, NIR, and SWIR spectral groups. Clean and corrupted views are processed by a shared multispectral backbone to produce group-specific embeddings. Group-Level Contrastive Learning (Group-CL) aligns complementary spectral representations through pairwise contrastive objectives, while the relation-consistency regularizer promotes stability of the inter-group similarity structure represented by the VIS–NIR, VIS–SWIR, and NIR–SWIR relation descriptor across clean and corrupted views. The final classification branch uses the fused RGB–MS representation for supervised land-cover prediction. The overall training objective integrates classification, group-level contrastive alignment, and relation-consistency regularization: J = L cls + α ( t ) L GCL + λ RC L RC .
Technologies 14 00499 g001
Figure 2. Matched robustness comparison between ms_only and Group-CL-RC across corruption families on EuroSAT. Bars report mean Macro-F1 over the matched full-grid evaluation points. Error bars denote standard deviation over the corresponding matched grid.
Figure 2. Matched robustness comparison between ms_only and Group-CL-RC across corruption families on EuroSAT. Bars report mean Macro-F1 over the matched full-grid evaluation points. Error bars denote standard deviation over the corresponding matched grid.
Technologies 14 00499 g002
Figure 3. Severity-level Macro-F1 gains of Group-CL-RC over group_cl across perturbation families. Points report mean gains at each perturbation level, and error bars indicate standard deviation over the corresponding matched evaluation points.
Figure 3. Severity-level Macro-F1 gains of Group-CL-RC over group_cl across perturbation families. Points report mean gains at each perturbation level, and error bars indicate standard deviation over the corresponding matched evaluation points.
Technologies 14 00499 g003
Figure 4. Relation-deformation sensitivity analysis. The relation-deformation score D RC is plotted against the Macro-F1 drop under matched non-clean perturbation conditions. The fitted trends show that Group-CL-RC has a lower decision-level sensitivity to relation deformation than group_cl, even though its raw relation-deformation values can be higher.
Figure 4. Relation-deformation sensitivity analysis. The relation-deformation score D RC is plotted against the Macro-F1 drop under matched non-clean perturbation conditions. The fitted trends show that Group-CL-RC has a lower decision-level sensitivity to relation deformation than group_cl, even though its raw relation-deformation values can be higher.
Technologies 14 00499 g004
Figure 5. Representative qualitative examples comparing the multispectral-only baseline and Group-CL-RC under structured perturbations. Each row shows a case where the baseline changes to an incorrect class under perturbation, whereas Group-CL-RC preserves the correct decision. The examples cover drift on non-RGB bands, masking on non-RGB bands, K-drop on NIR + SWIR bands, and compound spectral–spatial corruption on non-RGB bands.
Figure 5. Representative qualitative examples comparing the multispectral-only baseline and Group-CL-RC under structured perturbations. Each row shows a case where the baseline changes to an incorrect class under perturbation, whereas Group-CL-RC preserves the correct decision. The examples cover drift on non-RGB bands, masking on non-RGB bands, K-drop on NIR + SWIR bands, and compound spectral–spatial corruption on non-RGB bands.
Technologies 14 00499 g005
Table 1. SEN12MS external validation protocols used in this study. Both protocols use the Sentinel-2 multispectral component only, retain ten Sentinel-2 bands, and retain eight harmonized land-cover classes.
Table 1. SEN12MS external validation protocols used in this study. Both protocols use the Sentinel-2 multispectral component only, retain ten Sentinel-2 bands, and retain eight harmonized land-cover classes.
ProtocolTrain SamplesValidation SamplesTest SamplesSplit Criterion
Standard scene-disjoint13,200442018,106Disjoint scenes
Seasonal shift13,089433129,027Non-winter to winter
Table 2. Severity schedule used for compound spectral–spatial corruption (CS2C). The drift tuple denotes multiplicative gain, additive bias, and Gaussian noise standard deviation in scaled-reflectance space. The masking component uses random rectangular masks with patch sizes between 8 and 24 pixels. Resolution mismatch is implemented by downsampling and bilinear upsampling the selected bands. Misregistration denotes the maximum spatial shift, in pixels, applied to selected bands. The K-drop component removes k bands per sample from the selected target-band pool.
Table 2. Severity schedule used for compound spectral–spatial corruption (CS2C). The drift tuple denotes multiplicative gain, additive bias, and Gaussian noise standard deviation in scaled-reflectance space. The masking component uses random rectangular masks with patch sizes between 8 and 24 pixels. Resolution mismatch is implemented by downsampling and bilinear upsampling the selected bands. Misregistration denotes the maximum spatial shift, in pixels, applied to selected bands. The K-drop component removes k bands per sample from the selected target-band pool.
CS2C SeverityDrift ( g , b , σ ) Mask RatioResolution FactorMax. ShiftK-Drop k
0 ( 0.00 , 0.00 , 0.000 ) 0.00 10 px0
1 ( 0.05 , 0.02 , 0.005 ) 0.10 21 px0
2 ( 0.10 , 0.03 , 0.010 ) 0.20 22 px1
3 ( 0.20 , 0.05 , 0.015 ) 0.30 32 px2
Table 3. Clean comparison between the multispectral-only baseline and Group-CL-RC on EuroSAT All Bands. Results are reported as mean ± standard deviation over five seeds. Bold values indicate the higher mean value for each backbone and metric.
Table 3. Clean comparison between the multispectral-only baseline and Group-CL-RC on EuroSAT All Bands. Results are reported as mean ± standard deviation over five seeds. Bold values indicate the higher mean value for each backbone and metric.
BackboneVariantAccuracyMacro-F1
ConvNeXt-Tinyms_only0.9906 ± 0.00090.9900 ± 0.0009
ConvNeXt-TinyGroup-CL-RC0.9912 ± 0.00050.9907 ± 0.0006
EfficientNet-B0ms_only0.9883 ± 0.00170.9875 ± 0.0019
EfficientNet-B0Group-CL-RC0.9903 ± 0.00120.9897 ± 0.0013
ResNet-50ms_only0.9879 ± 0.00160.9871 ± 0.0017
ResNet-50Group-CL-RC0.9887 ± 0.00170.9880 ± 0.0016
Swin-Tinyms_only0.9880 ± 0.00090.9872 ± 0.0010
Swin-TinyGroup-CL-RC0.9885 ± 0.00110.9877 ± 0.0011
Table 4. Matched robustness comparison between ms_only and Group-CL-RC across corruption families on EuroSAT. Results are computed as full-grid matched averages over all available evaluation points within each family. For K-drop, the number of levels depends on the spectral target; target-balanced results are discussed in the text. The higher Macro-F1 value for each corruption family is highlighted in bold.
Table 4. Matched robustness comparison between ms_only and Group-CL-RC across corruption families on EuroSAT. Results are computed as full-grid matched averages over all available evaluation points within each family. For K-drop, the number of levels depends on the spectral target; target-balanced results are discussed in the text. The higher Macro-F1 value for each corruption family is highlighted in bold.
Corruptionms_only Macro-F1Group-CL-RC Macro-F1 Δ Macro-F1n
CS2C0.7094 ± 0.26390.9465 ± 0.0616+0.2371 ± 0.2237320
Drift0.9506 ± 0.06670.9860 ± 0.0095+0.0354 ± 0.0630320
K-drop0.7572 ± 0.22270.9461 ± 0.0538+0.1890 ± 0.1801360
Masking0.9159 ± 0.09290.9797 ± 0.0185+0.0638 ± 0.0846320
Table 5. Backbone-wise matched robustness comparison between ms_only and Group-CL-RC on EuroSAT. Results report Macro-F1 mean ± standard deviation over matched evaluation points. For each backbone, the higher mean Macro-F1 value between the two methods is highlighted in bold.
Table 5. Backbone-wise matched robustness comparison between ms_only and Group-CL-RC on EuroSAT. Results report Macro-F1 mean ± standard deviation over matched evaluation points. For each backbone, the higher mean Macro-F1 value between the two methods is highlighted in bold.
CorruptionBackbonems_onlyGroup-CL-RC Δ
CS2CConvNeXt-Tiny0.7178 ± 0.26190.9574 ± 0.0502+0.2396 ± 0.2267
CS2CEfficientNet-B00.7363 ± 0.24560.9560 ± 0.0437+0.2198 ± 0.2083
CS2CResNet-500.6873 ± 0.28830.9610 ± 0.0373+0.2737 ± 0.2596
CS2CSwin-Tiny0.6961 ± 0.26010.9115 ± 0.0885+0.2154 ± 0.1943
DriftConvNeXt-Tiny0.9676 ± 0.03640.9899 ± 0.0018+0.0223 ± 0.0357
DriftEfficientNet-B00.9444 ± 0.07340.9851 ± 0.0088+0.0407 ± 0.0663
DriftResNet-500.9277 ± 0.09390.9862 ± 0.0041+0.0585 ± 0.0923
DriftSwin-Tiny0.9625 ± 0.03760.9825 ± 0.0154+0.0201 ± 0.0295
K-dropConvNeXt-Tiny0.7657 ± 0.22120.9611 ± 0.0380+0.1954 ± 0.1903
K-dropEfficientNet-B00.8195 ± 0.18190.9563 ± 0.0413+0.1367 ± 0.1455
K-dropResNet-500.7617 ± 0.21440.9508 ± 0.0402+0.1891 ± 0.1814
K-dropSwin-Tiny0.6818 ± 0.24970.9164 ± 0.0753+0.2347 ± 0.1886
MaskingConvNeXt-Tiny0.9328 ± 0.07420.9833 ± 0.0137+0.0505 ± 0.0631
MaskingEfficientNet-B00.9312 ± 0.06040.9815 ± 0.0195+0.0503 ± 0.0531
MaskingResNet-500.8747 ± 0.13580.9827 ± 0.0107+0.1080 ± 0.1289
MaskingSwin-Tiny0.9247 ± 0.07020.9712 ± 0.0246+0.0465 ± 0.0535
Table 6. Paired statistical analysis of EuroSAT robustness gains under non-clean perturbation conditions. Results compare Group-CL-RC against ms_only using matched Macro-F1 pairs. Holm-corrected paired t-test and Wilcoxon p-values are reported.
Table 6. Paired statistical analysis of EuroSAT robustness gains under non-clean perturbation conditions. Results compare Group-CL-RC against ms_only using matched Macro-F1 pairs. Holm-corrected paired t-test and Wilcoxon p-values are reported.
Test Setnms_onlyGroup-CL-RCGainRel. GainHolm p t Holm p w
Global10000.78070.9560+0.1753+22.46% 2.31 × 10 144 1.66 × 10 164
CS2C2400.61650.9323+0.3158+51.23% 8.47 × 10 65 1.20 × 10 40
Drift2400.93810.9849+0.0468+4.99% 1.76 × 10 21 1.20 × 10 40
K-drop2800.69120.9339+0.2427+35.11% 4.15 × 10 69 4.55 × 10 47
Masking2400.89180.9766+0.0847+9.50% 1.62 × 10 35 1.20 × 10 40
Table 7. Matched external-baseline comparison on EuroSAT All Bands using ConvNeXt-Tiny and Swin-Tiny. Results report Macro-F1 mean ± standard deviation over three seeds. Robust Avg. is computed as the mean over the non-clean compact robustness families. Family-level details are provided in the Supplementary Materials.
Table 7. Matched external-baseline comparison on EuroSAT All Bands using ConvNeXt-Tiny and Swin-Tiny. Results report Macro-F1 mean ± standard deviation over three seeds. Robust Avg. is computed as the mean over the non-clean compact robustness families. Family-level details are provided in the Supplementary Materials.
BackboneMethodCleanRobust Avg.
ConvNeXt-TinyGroup-CL-RC 0.9868 ± 0.0006 0.9687 ± 0.0082
ConvNeXt-TinyCorruptTrain-MS 0.9858 ± 0.0019 0.9751 ± 0.0031
ConvNeXt-TinySupCon-MS 0.9874 ± 0.0027 0.9513 ± 0.0054
ConvNeXt-TinyPaired-View InfoNCE-MS 0.9853 ± 0.0019 0.9653 ± 0.0037
Swin-TinyGroup-CL-RC 0.9876 ± 0.0010 0.9195 ± 0.0252
Swin-TinyCorruptTrain-MS 0.9836 ± 0.0011 0.9728 ± 0.0007
Swin-TinySupCon-MS 0.9861 ± 0.0012 0.9151 ± 0.0159
Swin-TinyPaired-View InfoNCE-MS 0.9841 ± 0.0013 0.9611 ± 0.0089
Table 8. External validation on SEN12MS using the Sentinel-2 component only. Results report Macro-F1 mean ± standard deviation over the strictly aligned validation grid. Clean uses 12 scores per variant. Drift uses severity 2 and is averaged over 36 non-clean scores per variant. K-drop and CS2C use severities 2 and 3 and are each averaged over 72 non-clean scores per variant. Robust Avg. is the unweighted average of the three family-level means and is reported as a compact aggregate. For each protocol–backbone setting and evaluation column, the highest mean Macro-F1 value among the compared variants is highlighted in bold.
Table 8. External validation on SEN12MS using the Sentinel-2 component only. Results report Macro-F1 mean ± standard deviation over the strictly aligned validation grid. Clean uses 12 scores per variant. Drift uses severity 2 and is averaged over 36 non-clean scores per variant. K-drop and CS2C use severities 2 and 3 and are each averaged over 72 non-clean scores per variant. Robust Avg. is the unweighted average of the three family-level means and is reported as a compact aggregate. For each protocol–backbone setting and evaluation column, the highest mean Macro-F1 value among the compared variants is highlighted in bold.
VariantCleanDriftK-DropCS2CRobust Avg.
ms_only0.6036 ± 0.02860.5223 ± 0.02940.4324 ± 0.05510.2288 ± 0.06180.3945
group_cl0.5876 ± 0.03630.5609 ± 0.02380.5128 ± 0.03490.4278 ± 0.06160.5005
Group-CL-RC0.5907 ± 0.03560.5541 ± 0.02210.5333 ± 0.03250.4117 ± 0.06100.4997
Table 9. Global objective-component ablation under four corruption families. Results report mean Macro-F1 over ConvNeXt-Tiny and Swin-Tiny using three seeds. Δ RC denotes the gain of group_rc over group_cl. Δ syn denotes the gain of Group-CL-RC over the best single-component variant. For each corruption family, the highest mean Macro-F1 value among the compared variants is highlighted in bold.
Table 9. Global objective-component ablation under four corruption families. Results report mean Macro-F1 over ConvNeXt-Tiny and Swin-Tiny using three seeds. Δ RC denotes the gain of group_rc over group_cl. Δ syn denotes the gain of Group-CL-RC over the best single-component variant. For each corruption family, the highest mean Macro-F1 value among the compared variants is highlighted in bold.
Corruptiongroup_clgroup_rcGroup-CL-RC Δ RC Δ syn
CS2C0.80820.92890.9205+0.1207−0.0084
Drift0.98380.98580.9871+0.0020+0.0013
K-drop0.88320.88130.9302−0.0019+0.0470
Masking0.94180.97700.9639+0.0352−0.0131
Table 10. Descriptor-granularity ablation for Group-CL-RC on EuroSAT using ConvNeXt-Tiny. Results report mean Macro-F1 over three seeds. Robust Avg. denotes the mean over the non-clean EuroSAT descriptor-ablation evaluation points. Training time reports total wall-clock training time. For each performance metric, the highest mean Macro-F1 value is highlighted in bold, whereas for training time, the lowest value is highlighted in bold.
Table 10. Descriptor-granularity ablation for Group-CL-RC on EuroSAT using ConvNeXt-Tiny. Results report mean Macro-F1 over three seeds. Robust Avg. denotes the mean over the non-clean EuroSAT descriptor-ablation evaluation points. Training time reports total wall-clock training time. For each performance metric, the highest mean Macro-F1 value is highlighted in bold, whereas for training time, the lowest value is highlighted in bold.
DescriptorDim.CleanRobust Avg.DriftK-DropCS2CTraining Time (h)
Default VIS–NIR–SWIR30.9868 ± 0.00060.9571 ± 0.04080.9845 ± 0.00190.9759 ± 0.01050.9340 ± 0.04722.531 ± 0.007
Red-edge-aware60.9887 ± 0.00150.9680 ± 0.03160.9859 ± 0.00290.9811 ± 0.00760.9524 ± 0.03893.025 ± 0.007
Table 11. Training-time corruption ablation for Group-CL-RC on EuroSAT using ConvNeXt-Tiny. Results report mean Macro-F1 over three seeds. Robust Avg. denotes the mean over the non-clean evaluation conditions. For each evaluation column, the highest mean Macro-F1 value among the compared training-time corruption settings is highlighted in bold.
Table 11. Training-time corruption ablation for Group-CL-RC on EuroSAT using ConvNeXt-Tiny. Results report mean Macro-F1 over three seeds. Robust Avg. denotes the mean over the non-clean evaluation conditions. For each evaluation column, the highest mean Macro-F1 value among the compared training-time corruption settings is highlighted in bold.
Training CorruptionCleanRobust Avg.DriftMaskingK-DropCS2C
K-drop NIR + SWIR0.9885 ± 0.00050.9700± 0.00220.9876± 0.00090.9764 ± 0.00120.9820± 0.00320.9491 ± 0.0047
Drift non-RGB bands0.9884 ± 0.00080.9632 ± 0.00990.9868 ± 0.00060.9764 ± 0.00620.9614 ± 0.00540.9417 ± 0.0214
Masking non-RGB bands0.9887± 0.00040.9693 ± 0.00160.9874 ± 0.00040.9856± 0.00110.9523 ± 0.01470.9576± 0.0056
Mixed0.9878 ± 0.00160.9629 ± 0.01030.9870 ± 0.00170.9837 ± 0.00190.9755 ± 0.00540.9302 ± 0.0229
Table 12. Worst-case robustness comparison between group_cl and Group-CL-RC. The table reports the lowest observed Macro-F1 over non-clean diagnostic points for each corruption family. For each corruption family, the higher worst-case Macro-F1 value between the two methods is highlighted in bold.
Table 12. Worst-case robustness comparison between group_cl and Group-CL-RC. The table reports the lowest observed Macro-F1 over non-clean diagnostic points for each corruption family. For each corruption family, the higher worst-case Macro-F1 value between the two methods is highlighted in bold.
Corruptiongroup_clGroup-CL-RCGain
CS2C0.57490.7409+0.1660
Drift0.93480.9751+0.0404
K-drop0.62260.7065+0.0839
Masking0.83820.8702+0.0319
Table 13. Robustness retention of group_cl and Group-CL-RC. Retention measures the fraction of clean Macro-F1 preserved under non-clean diagnostic perturbations. For each corruption family, the higher retention value between the two methods is highlighted in bold.
Table 13. Robustness retention of group_cl and Group-CL-RC. Retention measures the fraction of clean Macro-F1 preserved under non-clean diagnostic perturbations. For each corruption family, the higher retention value between the two methods is highlighted in bold.
CorruptionVariantF1 RetentionWorst F1 RetentionF1 Drop
CS2Cgroup_cl0.7573 ± 0.11760.58120.2398 ± 0.1161
CS2CGroup-CL-RC0.9076 ± 0.07530.74940.0914 ± 0.0745
Driftgroup_cl0.9904 ± 0.01410.94270.0095 ± 0.0140
DriftGroup-CL-RC0.9974 ± 0.00390.98820.0026 ± 0.0039
K-dropgroup_cl0.8673 ± 0.10100.63130.1310 ± 0.0996
K-dropGroup-CL-RC0.9256 ± 0.07330.71460.0735 ± 0.0724
Maskinggroup_cl0.9340 ± 0.04710.84630.0654 ± 0.0466
MaskingGroup-CL-RC0.9661 ± 0.03130.88180.0335 ± 0.0309
Table 14. Global relation-deformation sensitivity analysis. D RC denotes relation deformation. Mean F1 Drop denotes the average decrease in Macro-F1 relative to the corresponding clean condition across the non-clean diagnostic points. The slope quantifies the decision-level sensitivity of Macro-F1 degradation to relation deformation. Lower values of both Mean F1 Drop and slope indicate greater robustness, and the lowest value for each metric among the compared variants is highlighted in bold.
Table 14. Global relation-deformation sensitivity analysis. D RC denotes relation deformation. Mean F1 Drop denotes the average decrease in Macro-F1 relative to the corresponding clean condition across the non-clean diagnostic points. The slope quantifies the decision-level sensitivity of Macro-F1 degradation to relation deformation. Lower values of both Mean F1 Drop and slope indicate greater robustness, and the lowest value for each metric among the compared variants is highlighted in bold.
VariantnPearson rSlopeMean D RC Mean F1 Drop
group_cl1500.68060.26230.27050.0767
Group-CL-RC1500.69900.09170.72190.0357
Table 15. Family-wise relation-deformation sensitivity analysis. D RC denotes relation deformation, and Mean F1 Drop denotes the average decrease in Macro-F1 relative to the corresponding clean condition within each corruption family. The slope quantifies the sensitivity of Macro-F1 degradation to relation deformation. Lower slope and lower Mean F1 Drop indicate greater decision-level robustness. For each corruption family, the lowest slope and Mean F1 Drop values among the compared variants are highlighted in bold.
Table 15. Family-wise relation-deformation sensitivity analysis. D RC denotes relation deformation, and Mean F1 Drop denotes the average decrease in Macro-F1 relative to the corresponding clean condition within each corruption family. The slope quantifies the sensitivity of Macro-F1 degradation to relation deformation. Lower slope and lower Mean F1 Drop indicate greater decision-level robustness. For each corruption family, the lowest slope and Mean F1 Drop values among the compared variants are highlighted in bold.
CorruptionVariantnSlope D RC F1 DropMean D RC Mean F1 Drop
CS2Cgroup_cl180.65240.40690.2398
CS2CGroup-CL-RC180.20261.07520.0914
Driftgroup_cl540.06650.09640.0095
DriftGroup-CL-RC540.00920.54710.0026
K-dropgroup_cl240.18160.69480.1310
K-dropGroup-CL-RC240.06850.93290.0735
Maskinggroup_cl540.39430.21050.0654
MaskingGroup-CL-RC540.08910.68500.0335
Table 16. Bucket-level analysis of Macro-F1 drop across relation-deformation regimes. Negative values of Δ indicate a lower F1 drop for Group-CL-RC relative to group_cl. Within each relation-deformation bucket, the lower mean F1 drop between the two variants is highlighted in bold.
Table 16. Bucket-level analysis of Macro-F1 drop across relation-deformation regimes. Negative values of Δ indicate a lower F1 drop for Group-CL-RC relative to group_cl. Within each relation-deformation bucket, the lower mean F1 drop between the two variants is highlighted in bold.
D RC Bucketgroup_cl F1 DropGroup-CL-RC F1 Drop Δ
Low0.02250.0049−0.0176
Mid0.13500.0095−0.1255
High0.19820.0555−0.1427
Table 17. Computational profiling of the main model variants on EuroSAT. The table reports trainable parameters, THOP forward-pass MACs, average wall-clock time per epoch, training throughput, and peak GPU memory over three profiling seeds. Time overhead is measured relative to ms_only for the same backbone.
Table 17. Computational profiling of the main model variants on EuroSAT. The table reports trainable parameters, THOP forward-pass MACs, average wall-clock time per epoch, training throughput, and peak GPU memory over three profiling seeds. Time overhead is measured relative to ms_only for the same backbone.
BackboneVariantParams (M)MACs (G)Time/Epoch (s)Time RatioThroughput (img/s)Peak GPU (MB)
ConvNeXt-Tinyms_only56.57 ± 0.001.84 ± 0.0053.28 ± 0.421.00×362.59 ± 2.892332.00 ± 0.00
ConvNeXt-Tinygroup_cl56.57 ± 0.001.84 ± 0.0070.97 ± 0.321.33×272.17 ± 1.221824.67 ± 1.15
ConvNeXt-Tinygroup_rc56.57 ± 0.001.84 ± 0.00106.92 ± 0.422.01×180.67 ± 0.713038.67 ± 1.15
ConvNeXt-TinyGroup-CL-RC56.57 ± 0.001.84 ± 0.00108.00 ± 0.882.03×178.86 ± 1.472602.00 ± 0.00
Swin-Tinyms_only55.94 ± 0.002.07 ± 0.0089.30 ± 0.151.00×216.32 ± 0.352956.00 ± 0.00
Swin-Tinygroup_cl55.94 ± 0.002.07 ± 0.00126.34 ± 0.611.41×152.90 ± 0.742260.00 ± 0.00
Swin-Tinygroup_rc55.94 ± 0.002.07 ± 0.00203.20 ± 0.802.28×95.06 ± 0.373970.00 ± 0.00
Swin-TinyGroup-CL-RC55.94 ± 0.002.07 ± 0.00204.89 ± 0.272.29×94.28 ± 0.123444.00 ± 0.00
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Karroum, M.; En-nahnahi, N. Relation-Consistency Group Contrastive Learning for Robust Multispectral Remote Sensing Classification. Technologies 2026, 14, 499. https://doi.org/10.3390/technologies14080499

AMA Style

Karroum M, En-nahnahi N. Relation-Consistency Group Contrastive Learning for Robust Multispectral Remote Sensing Classification. Technologies. 2026; 14(8):499. https://doi.org/10.3390/technologies14080499

Chicago/Turabian Style

Karroum, Mohcine, and Noureddine En-nahnahi. 2026. "Relation-Consistency Group Contrastive Learning for Robust Multispectral Remote Sensing Classification" Technologies 14, no. 8: 499. https://doi.org/10.3390/technologies14080499

APA Style

Karroum, M., & En-nahnahi, N. (2026). Relation-Consistency Group Contrastive Learning for Robust Multispectral Remote Sensing Classification. Technologies, 14(8), 499. https://doi.org/10.3390/technologies14080499

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop