Skip to Content
Remote SensingRemote Sensing
  • Article
  • Open Access

19 March 2026

27 Pages

S2A-Swin: Spectral Smoothing–Guided Spectral–Spatial Windows with Generative Augmentation for Hyperspectral Image Classification Under Class Imbalance and Limited Labels

,
,
,
,
and
1
College of Surveying and Mapping Engineering, Heilongjiang Institute of Technology, Harbin 150001, China
2
College of Physics and Electronic Engineering, Mudanjiang Normal University, Harbin 150001, China
3
College of Information and Communication Engineering, Harbin Engineering University, Harbin 150009, China
*
Author to whom correspondence should be addressed.

Highlights

What are the main findings?
  • We propose S2A-Swin, a joint spatial–spectral hybrid Swin Transformer framework that leverages prior-guided generative augmentation to address the critical challenges of limited labels and severe class imbalance in hyperspectral image classification.
  • We design two core components: a spectral–spatial Conditional GAN (SSC-cGAN) and a dimension-aware HybridSwinBlock, to synthesize physically realistic minority-class samples and efficiently model complex cross-dimensional interactions via alternating window attention.
What are the implications of the main findings?
  • By introducing a spectral smoothness constraint (SSC), the framework synthesizes physically reliable minority-class patches that maintain inherent band continuity, offering a robust data augmentation strategy.
  • The integration of SSC-cGAN and HybridSwinBlock successfully suppressed nonphysically generated noise and background interference, achieving robust feature decoupling and accurate identification of scarce spectral categories.

Abstract

Hyperspectral image (HSI) classification faces the challenges of scarce labeled data and severe class imbalance, which limits the effective training and generalization capabilities of models. To address these issues, we propose S2A-Swin, a joint spatial–spectral hybrid Swin Transformer framework. First, we develop a spectral–spatial conditional generative adversarial network (SSC-cGAN), which combines spectral and spatial smoothing regularizers to synthesize class-specific image patches, thus alleviating the problems of data scarcity and class imbalance while maintaining spectral continuity and local spatial structure consistent with real data. Second, we introduce a dimension-aware hybrid Transformer module, which adds local windows along the spectral dimension to the standard spatial window, thereby facilitating cross-dimensional feature interactions and ensuring that each spectral band is modeled using the local spatial context for more efficient joint spatial–spectral modeling. In this module, attention mechanisms for spectral and spatial windows are applied alternately (“cross-sequence” attention mechanisms), the execution order of which is guided by hyperspectral prior knowledge to enhance cross-dimensional representation learning. This module is embedded in the lightweight Swin backbone and extends the traditional spatial window mechanism through spectral window attention, capturing spectral continuity while maintaining spatial structure consistency. Extensive experiments on multiple datasets demonstrate that, compared to mainstream CNN and Transformer baselines on four benchmark datasets, the proposed method achieves overall accuracy (OA) improvements of 2.45%, 7.05%, 5.17%, and 0.85%.

1. Introduction

Hyperspectral images (HSIs) are complex three-dimensional remote sensing data that integrate abundant spectral and spatial information [1]. The spectral dimension of HSIs typically spans tens to hundreds of contiguous bands, providing fine-grained reflectance characteristics of each pixel across multiple wavelengths. Such high spectral resolution enables the discrimination of materials with subtle spectral differences, making HSIs a valuable data source for land-cover classification, mineral mapping [2], and environmental monitoring [3,4]. However, the high-dimensional complexity of HSIs and the constraints of data acquisition pose significant challenges for effective classification [5]. On the one hand, labeling HSIs is costly and time-consuming, resulting in a limited number of annotated samples. Deep learning models generally require a large amount of labeled data to achieve satisfactory performance; when trained with only a few samples, they often suffer from poor generalization and overfitting [6]. On the other hand, due to variations in land-cover distribution, the number of samples per class in HSIs is typically imbalanced: certain classes contain only a few pixels, while majority classes have abundant samples [7]. This class imbalance causes the model to be biased toward majority classes during training, leading to low recognition accuracy for minority classes. The dual challenges of limited samples and class imbalance jointly hinder the effective training and generalization of hyperspectral classification models. Therefore, how to fully exploit the spectral–spatial discriminative information in HSIs and enhance the representational capacity of models under the conditions of scarce annotations and imbalanced class distributions remains a critical and unresolved issue.
Early studies applied conventional machine learning (SVM [8], KNN [9]) to hyperspectral image (HSI) classification. These methods exploit rich spectral information and can be robust when labeled samples are scarce, achieving encouraging results. However, they usually rely on hand-crafted features and struggle to capture the complex joint spectral–spatial cues in HSIs. Their limited capacity to model high-dimensional spectral–spatial structures leaves them vulnerable to the “Hughes phenomenon”, often leading to overfitting and degraded classification performance [10]. The advent of deep learning has provided new solutions for HSI classification. By stacking nonlinear transformations, deep models learn hierarchical representations directly from data, removing the dependence on manual feature engineering and showing strong capability in feature extraction and pattern discovery [11].
However, the strong performance of deep models typically hinges on large quantities of labeled data [12]. For classes with subtle spectral differences and scarce samples, their discriminative capacity is markedly constrained. To alleviate the impact of sample scarcity and class imbalance on hyperspectral image (HSI) classification, data augmentation has been widely adopted as a key means of improving model generalization [13,14]. Conventional augmentation techniques (rotation, flipping, and noise injection) can moderately increase dataset diversity, but they often fail to capture the complex spectral–spatial variations present in real HSI scenes and therefore offer limited relief from overfitting [13]. GAN-based augmentation offers a stronger alternative by learning hyperspectral distributions and synthesizing realistic samples with diverse spectral signatures, thereby enriching minority-class coverage and improving generalization in low-label regimes [15]. Representative works such as HSGAN [16] and SSARL [17] demonstrate that adversarial generation can effectively boost few-shot HSI classification by providing additional training diversity.
Nonetheless, existing GAN-driven augmentation still faces notable limitations from a security and reliability perspective. First, many models lack targeted quality optimization for minority-class synthesis, yielding unreliable samples for long-tail categories. Second, discriminator overfitting may cause generators to collapse into producing homogeneous outputs, i.e., mode collapse, which results in insufficient intra-class coverage and leaves minority-class vulnerabilities unresolved [18]. Although WGAN-GP stabilizes adversarial training [19], its global distance optimization does not explicitly enforce the spectral smoothness and spatial coherence inherent to HSIs, often producing oscillatory artifacts and locally inconsistent samples that may introduce new risks in downstream classification [20]. Moreover, most hyperspectral GANs rely on pure noise vectors or noisy labels without physical priors, leading to unstable multi-class synthesis and a persistent trade-off between sample quality and diversity. These issues motivate the need for prior-guided generative augmentation that can simultaneously improve realism and diversity, especially for security-critical minority classes.
In summary, in order to address the above challenges, our work rethinks the HSI data feature extraction process from two different perspectives and designs a novel Swin-based HSI classification method (based on Swin: Spatial–Spectral Cooperative Conditional Adversarial Network). Specifically, this study first uses the WGAN-GP framework to construct a generative adversarial module and introduces a spectral smoothness constraint (SSC) in the loss function of the GAN. This constraint incorporates the band continuity of hyperspectral data as a regularization term into the optimization process of the generative network, guiding the model to enable the generator to synthesize more realistic and physically compliant samples that conform to the spectral smoothness characteristics, thereby effectively expanding the training data. Secondly, based on the spatial window attention mechanism of the classic Swin Transformer, we design a hybrid Swin transformer architecture and propose a spectral window attention mechanism to divide the spectral dimension into windows. The hyperspectral data structure is fully utilized by alternating spatial and spectral self-attention operations in the network layer. In our design, the Transformer encoder consists of layers that alternate attention types in sequence: one layer performs multi-head self-attention on spatial tags within a local window (like the standard Swin Transformer layers), and the next layer performs multi-head self-attention on the spectral window partitioned by the spectral dimension at each spatial location (treating the spectral bands as a sequence of attention). In this way, spatial structures (such as shape, texture, and neighborhood context) are captured in a set of layers, while spectral dependencies (such as continuous reflectance spectrum curves, absorption features, and cross-band interactions) are learned in alternating layers. This design effectively decouples the learning of spatial and spectral features, allowing each attention mechanism to focus on one of them. The spatial attention layers are confined to a local window with a shift, which maintains computational efficiency and allows the model to gradually build a scene representation from the local to the more global spatial context. On the other hand, the spectral attention layers ensure that the model explicitly learns how information propagates and correlates across wavelengths—a purely spatial transformer may only learn implicitly. By stacking these layers alternately, the network can be viewed as a two-branch transformer merged into one: with a deep-rooted understanding of both spatial layout and spectral features. Our main contributions are as follows:
  • A novel constraint: We propose a spectral smoothness constraint (SSC) mechanism, which fully utilizes the physical prior property that the difference in spectral reflectance values between adjacent bands of hyperspectral data is usually small. This method explicitly introduces the band continuity of hyperspectral data as a regularization term into the optimization process of the generative network. To our knowledge, this is the first attempt to explore the potential of constraint conditions in generative networks.
  • We novelly propose a spectral attention window module, which adds a spectral attention window to the original Swin space window to complete the spatial–spectral fusion in one block. At the same time, in different blocks, the spatial–spectral and spectral–spatial interleaving executions are flexibly completed, further improving the fine-grainedness of spectral feature extraction.
  • We conducted extensive experiments on four benchmark datasets (Indian Pines, Pavia University, Botswana, and Salinas Scene). The results show that our proposed method outperforms other state-of-the-art methods.

3. Methodology

As illustrated in Figure 1, the overall architecture of S2A-Swin comprises three main components: a pre-processing module, an SSC-cGAN, and a HybridSwinBlock. Given a hyperspectral image (HSI) I ∈ R H × W × C , where H, W, and C denote the height, width, and number of spectral bands, respectively, we first reshape I to I pn ∈ R H ′ × W ′ × C and apply normalization and zero-padding. An image patch P ∈ R p × p × C , centred on the target pixel, is then cropped from I pn and fed into the SSC-cGAN, which generates a set of synthetic samples. The resulting embeddings are forwarded to the HybridSwinBlock, followed by a multilayer perceptron (MLP) that outputs the final prediction Y ∈ R 1 × N , where N is the number of classes. The network is trained end-to-end using the standard cross-entropy loss.
Figure 1. Overview of our S2A-Swin. After the preprocessing module processes the input HSI, the image patch is cropped centered at a given pixel, which is fed to the SSC-cGAN to generate pseudo samples representing the local spatial–spectral relationship. These sample embeddings are then used as input to the HybridSwinBlock, followed by an MLP to predict the label of a given pixel.

3.1. Data Preprocessing and Spatial-Spectral Patch Construction

In order to eliminate the negative impact of data scale differences in different spectral bands on model training, this study first performed normalization processing band by band. Hyperspectral images are usually represented as a three-dimensional data cube, and each pixel contains rich spectral information. The input hyperspectral image is represented as:
X ∈ R H × W × C ,
where H and W are the image height and width, and C is the spectral dimension (number of bands). Let X b ( b = 1 , 2 , … , C ) denote the b-th spectral band; the normalised band X b norm is defined by
x b norm = x b − min X b max X b − min X b + ε , b = 1 , 2 , … , C ,
where min ( X b ) and max ( X b ) are, respectively, the minimum and maximum pixel values in band b, and ε = 10 − 6 is a small constant that prevents division by zero.
To exploit spatial context, a square neighbourhood window of size w × w ( w = 9 in this study) is centred at every labelled pixel. For any pixel located at ( i , j ) with a non-zero class label, the corresponding spatial–spectral patch P ( i , j ) ∈ R C × w × w is constructed as
P ( i , j ) = X norm i − δ : i + δ , j − δ : j + δ , 1 : C ,
where δ = ⌊ w / 2 ⌋ is the window radius ( δ = 4 when w = 9 ). To ensure that border pixels can provide a full spatial context, the normalised image X norm is mirror-padded along both spatial dimensions:
X pad = MirrorPad X norm , ( δ , δ )
After padding, the spatial dimensions of X pad are extended from the original H × W to ( H + 2 δ ) × ( W + 2 δ ) , which enables smooth extraction of patches near the image boundaries.
Each spatial–spectral patch P ( i , j ) is paired with the class label y ( i , j ) of its centre pixel to form a supervised training sample:
( P ( i , j ) , y ( i , j ) ) .
At the final stage of training and test split, we employ a stratified random sampling strategy to ensure that each class is well represented in both the training and test sets.
Let N c be the total number of available samples for class c, then the number of samples selected for the test set, N c test , is defined as:
N c test = max γ · N c , 1 , 0 < γ < 1 ,
where γ is the proportion of test samples. In this study, we set γ = 0.9 to ensure that each class has at least one sample in the test set, while the remaining samples are used for training.

3.2. Spectral–Spatial GAN (SSC-cGAN)

The goal of SSC-cGAN is to generate sample patches that closely resemble hyperspectral characteristics under conditions of data imbalance and sample scarcity, thereby augmenting the training dataset. During training, we first perform one or more gradient descent steps on the generator G, followed by gradient updates on the discriminator D. To enhance model stability and generation quality, a gradient penalty term is introduced, which is computed by sampling random points between real and generated patches through interpolation. Throughout the iterative training process, the discriminator D learns to distinguish between real patches and generated ones conditioned on class labels, while the generator G progressively improves to produce increasingly realistic patches. These generated patches become indistinguishable from real ones and adhere to spectral and spatial smoothness constraints. Once training converges, we use G to generate a large number of synthetic patches for each class, augmenting the original training set. In the subsequent classification model training, we combine real and synthetic samples. In cases where certain classes have very few samples, the synthetic data significantly increases the size and diversity of the training dataset. To ensure balanced representation across classes, we apply a class-balanced sampling strategy during augmentation. The detailed implementation of each module is described below:

3.2.1. Generative Adversarial Backbone

We adopt Conditional WGAN-GP (Wasserstein GAN with Gradient Penalty) to generate synthetic hyperspectral images (HSI) for spectral augmentation. The WGAN-GP consists of two convolutional neural networks: a generator G and a discriminator D. The generator G ( z | y ) takes as input a random noise vector z (sampled from a uniform or Gaussian distribution) and a conditional label y, and outputs a synthetic hyperspectral image X ^ = G ( z | y ) ∈ R P × P × B . The generator is implemented as a deep convolutional network. It upsamples the noise into an image with P × P pixels and B spectral bands, using transposed convolutions (deconvolution) or pixel-shuffling techniques. The conditional label y is embedded and injected into intermediate layers via conditional normalization. The discriminator D ( X | y ) is also a convolutional network. It takes as input either a real or synthetic HSI X, together with the label y, and outputs a scalar score. Unlike conventional GANs, which use binary cross-entropy loss, WGAN-GP employs the Earth-Mover (Wasserstein) distance to measure the discrepancy between the real and generated distributions. The discriminator (also referred to as the critic) does not output probabilities, but rather estimates the Wasserstein distance by maximizing the difference between real and generated samples. In practice, the training objective minimizes the negative critic score with the addition of a gradient penalty term for regularization. Formally, let D ( X | y ) denote the critic’s output score for an input HSI X with label y. The discriminator loss is defined as:
L D = − E X real ∼ p data D ( X real | y ) + E z ∼ p ( z ) D ( G ( z | y ) | y ) + λ G P E X ^ ∥ ∇ X ^ D ( X ^ | y ) ∥ 2 − 1 2 .
where the first term − E x ∼ p real [ D ( x ∣ y ) ] encourages the discriminator D to assign higher scores to real patches, and the second term E z ∼ p ( z ) [ D ( G ( z ∣ y ) ∣ y ) ] encourages D to assign lower scores to generated patches. The third term is the gradient penalty proposed in WGAN-GP (weighted by λ GP ), where x ^ denotes samples interpolated between real and generated patches (i.e., for a random ϵ ∈ [ 0 , 1 ] , x ^ = ϵ x + ( 1 − ϵ ) x ˜ ). This term penalizes the gradient norm ∥ ∇ x ^ D ( x ^ ∣ y ) ∥ 2 to be close to 1, thereby enforcing the Lipschitz constraint required for Wasserstein distance estimation. The gradient penalty helps stabilize training and prevents the discriminator from becoming too sharp or discontinuous, which is especially important for high-dimensional HSI input spaces.
The generator aims to fool the discriminator while adhering to spectral smoothness regularization. Specifically, the generator G tries to maximize D ( G ( z ∣ y ) ∣ y ) (i.e., the discriminator’s score for fake data), as a higher score implies that the discriminator considers the fake data more realistic. Therefore, we minimize the negative of this score. Without regularization, the basic generator loss would be:
L G , adv = − E z ∼ p ( z ) [ D ( G ( z ∣ y ) ∣ y ) ]

3.2.2. Spectral–Spatial Smoothness Constraint (SSC)

The continuity of hyperspectral data arises inherently from the continuous spectral reflectance properties of real-world materials and is further modulated by the overlapping Spectral Response Functions (SRFs) of adjacent detector elements in the spectrometer. While natural hyperspectral signals may exhibit low-frequency variations due to atmospheric scattering, the synthetic samples generated by unconstrained GANs often suffer from unphysical high-frequency spectral jitter. This jitter is akin to amplified sensor shot noise or adversarial checkerboard artifacts, which do not conform to physical imaging mechanisms. However, the existing data augmentation methods based on generative adversarial networks (GANs) do not explicitly consider this physical continuity constraint along the spectral dimension, which often leads to drastic unphysical changes between bands or unrealistic spectral anomalies. To this end, we propose an explicit spectral smoothness constraint mechanism (Spectral Smoothness Constraint, SSC). The core idea is to explicitly introduce the band continuity of hyperspectral data as a regularization term into the optimization process of the generative network. Therefore, we express this spectral continuity feature as:
x c + 1 ( i , j ) ≈ x c ( i , j ) , c = 1 , 2 , … , C − 1 ,
where x c ( i , j ) denotes the pixel value at spatial location ( i , j ) in band c of a real sample. Guided by this observation, we enforce an analogous continuity on the generated samples,
x ^ c + 1 ( i , j ) ≈ x ^ c ( i , j ) , c = 1 , 2 , … , C − 1 ,
where x ^ = G ( z , y ) is the output of the generator G given latent code z (and, if applicable, conditioning y). Equivalently,
[ G ( z , y ) ] c + 1 ( i , j ) ≈ [ G ( z , y ) ] c ( i , j ) , c = 1 , 2 , … , C − 1 .
Specifically, the proposed SSC penalizes discrepancies between adjacent spectral bands of a generated sample, thereby enforcing realistic and smooth behavior along the spectral dimension. To rigorously encode this continuity, we design a loss that directly measures inter-band differences and adopt the squared Euclidean distance so that abrupt changes are strongly penalized. The spectral smoothness loss is defined as
L spec = E z , y 1 C − 1 ∑ c = 1 C − 1 G ( z , y ) c + 1 − G ( z , y ) c 2 2 ,
where L spec denotes the spectral smoothness regularization term, G ( z , y ) is the generator’s hyperspectral output, and C is the number of spectral bands. Here G ( z , y ) c ∈ R H × W is the image at band c, and ∥ · ∥ 2 2 denotes the squared ℓ 2 norm over spatial pixels, i.e.,
G ( z , y ) c + 1 − G ( z , y ) c 2 2 = ∑ i = 1 H ∑ j = 1 W G ( z , y ) c + 1 ( i , j ) − G ( z , y ) c ( i , j ) 2 .
Abrupt discrepancies between adjacent spectral bands are typically physically implausible and often indicate anomalies or noise. Therefore, by explicitly penalizing such discrepancies, we can effectively reduce the probability that the generator produces anomalous samples. This explicit constraint drives the generator to directly learn, during training, to produce spectra that are smoother and more consistent with real-world material characteristics, thereby markedly improving the quality of synthetic samples. In addition, to further enhance the quality of the generated data, we introduce an auxiliary spatial smoothness regularization to suppress abrupt spatial changes in the generated samples:
L spat = E z , y [ 1 C ( w − 1 ) w ∑ i = 1 w − 1 ∑ j = 1 w G ( z , y ) : , i + 1 , j − G ( z , y ) : , i , j 2 2 + 1 C w ( w − 1 ) ∑ i = 1 w ∑ j = 1 w − 1 G ( z , y ) : , i , j + 1 − G ( z , y ) : , i , j 2 2 ] .
The spatial smoothness loss enforces local spatial continuity of generated data, preventing spatial artifacts or anomalous patterns. Serving as an auxiliary term, it cooperates with the spectral smoothness regularization to jointly improve data quality along both the spatial and spectral dimensions. The final optimization objective of the generator combines the adversarial loss with the above constraints:
L G = L G , adv + α spec L spec + α spat L spat .
Unlike conventional methods that encourage band-to-band continuity only implicitly, our approach encodes an explicit difference loss between adjacent spectral bands directly in the optimization objective, thereby enabling precise control over the generated data. A potential concern regarding the SSC is whether enforcing local smoothness might inadvertently blur the discriminative features of the synthesized samples, such as specific absorption valleys or red-edge characteristics crucial for classification. It is important to emphasize that SSC does not operate in isolation. In the overall objective (Equation (8)), the spectral smoothness is balanced by the conditional adversarial loss L G , a d v . The conditional discriminator rigorously enforces the preservation of class-specific spectral signatures to prevent mode mixing. Consequently, controlled by an appropriate weight α s p e c , the SSC functions as a localized physical low-pass filter: it effectively mitigates unphysical inter-band high-frequency noise without over-smoothing the macro-level spectral discriminative features (e.g., absorption depths) that are essential for accurate representation and classification.

3.3. HybridSwinBlock

Traditional Swin Transformer usually only performs window division and attention calculation in the spatial dimension, ignoring the importance of the spectral dimension and its interaction with the spatial dimension [35]. To this end, this study proposes the HybridSwinBlock module: it integrates the spatial window mechanism and the spectral window mechanism. By completing the window division and attention calculation of the spatial and spectral dimensions in sequence within a single block, and at the same time, alternating between the spatial and spectral dimensions, it can achieve a deep fusion of spatial and spectral features, and more fully capture the interaction between spatial and spectral features in hyperspectral images. The specific process and data changes are as follows:
A hyperspectral image is typically represented as a three-dimensional data cube, where each pixel contains rich spectral information. The input hyperspectral image is denoted by
X ∈ R h × w × c ,
where h and w are the image height and width, and c is the spectral dimension (number of channels). We first partition the spatial plane into non-overlapping windows of size w spatial × w spatial . Within each window, the data has shape C × w spatial × w spatial , and the collection of windowed tensors is
X windows ∈ R N win × C × w spatial × w spatial ,
where
N win = H w spatial × W w spatial
is the total number of spatial windows after partitioning. For efficient attention computation, the data inside each window is flattened into a two-dimensional matrix of size ( w spatial 2 ) × C , and a multi-head self-attention (MSA) operation is applied to extract spatial features. After the spatial attention, the features of each window are reshaped back to C × w spatial × w spatial and reassembled to the full feature map of size C × H × W :
X spatial = Spatial-MSA WindowPartition X , w spatial .
After obtaining X spatial , its dimensionality remains C × H × W . No further reshaping is performed; the spatially attended features are directly used as the input to the spectral-attention computation:
X intermediate = X spatial .
Along the spectral dimension, X intermediate is partitioned into contiguous spectral windows of size w spectral . Each window then has shape w spectral × H × W . Next, the data in each spectral window is flattened into a two-dimensional matrix of size ( H × W ) × w spectral , and a multi-head self-attention operation is performed independently within every window along the spectral dimension to capture inter-band dependencies and spectral continuity. After spectral attention, the features are reshaped back to C × H × W :
X spectral = Spectral-MSA SpectralPartition X intermediate , w spectral .
The final output feature representation is
X out = X spectral .
To further enhance the network’s ability to capture fine-grained spatial and spectral features, we propose an interleaved ordering mechanism inside each HybridSwinBlock, in which consecutive blocks adopt different window-attention orders:
Apply spatial attention first, followed by spectral attention:
X out = Spectral-MSA Spatial-MSA ( X ) .
Apply spectral attention first, followed by spatial attention:
X out = Spatial-MSA Spectral-MSA ( X ) .
Multiple HybridSwinBlocks together form a SwinStage. Each SwinStage consists of a series of HybridSwinBlocks; adjacent blocks alternate between the spatial-first and spectral-first windowing orders. That is, if the n-th block is spatial-first, then the ( n + 1 ) -th block is spectral-first. This interleaved attention computation enables the model to capture richer spectral interactions present in HSI data. The hybrid Swin Transformer effectively balances model complexity with hyperspectral-specific feature learning. By restricting spatial self-attention to local windows, we keep the computational cost within a controllable range (per layer 𝒪 ( P 2 M 2 ) , rather than the 𝒪 ( ( P 2 ) 2 ) of global attention). Moreover, spectral attention is inherently parallel across spatial locations because the spectral interactions of each pixel are computed independently, which allows an efficient GPU implementation with minimal inter-thread communication.
The alternation of spatial and spectral self-attention yields a hybrid multi-scale attention mechanism, enabling tokens to progressively integrate spatial neighborhood context together with inter-spectral dependencies as depth increases. Compared with traditional hybrid spatial–spectral filtering methods, our approach learns a dynamically weighted mixture (attention) instead of fixed convolutional kernels, thereby capturing more flexible, data-driven relationships more efficiently.

4. Experiments

In this section, we describe the dataset in Section 4.1, and then describe the evaluation metrics and implementation details in Section 4.2. To evaluate our S2A-Swin, we present and discuss the quantitative and qualitative results, as well as analyze the computational complexity of different methods, in Section 4.3.

4.1. Datasets

  • Indian Pines dataset:
The Indian Pines dataset was collected in 1992 over northwestern Indiana (USA) by the Airborne Visible/Infrared Imaging Spectrometer (AVIRIS). It contains an image of size 145 × 145 pixels with 224 spectral reflectance bands spanning wavelengths from 0.4 × 10 − 6 to 2.5 × 10 − 6 m . After removing bands covering atmospheric absorption regions [104–108], [150–163], and [220–224], the data are reduced to 200 bands. The scene comprises roughly two-thirds agricultural fields and one-third forest or other natural perennial vegetation. Land cover is divided into 16 classes, e.g., soybeans (min-till), and corn (min-till) as shown in Figure 2, with the number of samples for each class listed in Table 1.
Figure 2. Illustration of the IP dataset. The pseudocolor image is displayed on the left, and the corresponding ground-truth land-cover map is shown on the right, where each color represents a specific land-cover category.
  • University of Pavia dataset:
Provided by the Telecommunications and Remote Sensing Laboratory of the University of Pavia, this dataset was acquired over northern Pavia (Italy) during an airborne flight campaign using the Reflective Optics System Imaging Spectrometer (ROSIS). The image has size 610 × 340 pixels with 103 spectral bands and is labeled into 9 categories, including asphalt, meadows, gravel, trees, painted metal sheets, bare soil, bitumen, self-blocking bricks, and shadows.as shown in Figure 3, with the number of samples for each class listed in Table 2.
  • Salinas Scene dataset:
The Salinas Scene dataset was collected by AVIRIS over California’s Salinas Valley with 224 spectral bands and a high spatial resolution of 3.7 m per pixel. It contains 16 classes, such as Fallow, Stubble, and Celery in Figure 4. Table 3 reports the distribution of training and test samples for these datasets.
  • BOS Dataset:
BOS Dataset was acquired by NASA EO-1 satellite over the Okavango Delta in BOS from 2001 to 2004. The Hyperion sensor on EO-1 captures data at a 30 m pixel resolution across a 7.7 km strip in 242 bands spanning the 400–2500 nm range with 10 nm spectral windows. The UT Center for Space Research performed data preprocessing to mitigate the effects of faulty detectors, inter-detector miscalibration, and intermittent anomalies. The ground truth provides sixteen different land-cover classes, as shown in Figure 5, with the number of samples for each class listed in Table 4. The wavelength information was obtained from the EO-1 data meta files available through Portal Gscloud.
Figure 3. Illustration of the PU dataset. The pseudocolor image is displayed on the left, and the corresponding ground-truth land-cover map is shown on the right, where each color represents a specific land-cover category.
Figure 4. Illustration of the SA dataset. The pseudocolor image is displayed on the left, and the corresponding ground-truth land-cover map is shown on the right, where each color represents a specific land-cover category.
Table 1. The detailed information of IP dataset.
Figure 5. Illustration of the BOS dataset. The pseudocolor image is displayed on the left, and the corresponding ground-truth land-cover map is shown on the right, where each color represents a specific land-cover category.
Table 2. The detailed information of PU dataset.
Table 3. The detailed information of SA dataset.
Table 4. The detailed information of BOS dataset.

4.2. Experimental Setup and Performance Evaluation Metrics

4.2.1. Experimental Setup

To ensure the effectiveness and superiority of the proposed method and comprehensively and fairly evaluate our method on the four datasets, we use three key indicators, AA (indicating the proportion of correctly classified samples of all categories), OA (indicating the average classification accuracy of each category), and Kappa coefficient, to comprehensively evaluate the algorithm and conduct quantitative analysis of different methods.

4.2.2. Evaluation Indexes

For all four datasets, we adopt a unified configuration for S2A-Swin. The multi-head self-attention layers use four heads ( h = 4 ), and the hidden size of each MLP layer is set to eight times the input dimension. In the SSC-cGAN module, the noise vector dimension is set to 100, with a gradient-penalty coefficient of λ GP = 10 and a critic–generator update ratio of n critic = 5 . All classifiers are trained with the Adam optimizer with an initial learning rate of 1 × 10 − 3 and a fixed weight decay of 1 × 10 − 4 ; the learning rate (not the weight decay) is multiplied by 0.9 every 100 epochs. All experiments are conducted on a server equipped with an NVIDIA GTX 5090D GPU (32 GB). Furthermore, the selection of key spatial–spectral hyperparameters is rigorously justified through a parameter sensitivity analysis (illustrated in Figure 6). We observe an inverted-U performance trend for the smoothness regularization weights ( α s p e c and α s p a t ); excessively small values fail to suppress unphysical high-frequency GAN artifacts, while overly large values over-smooth critical discriminative features and spatial boundaries. Consequently, both α s p e c and α s p a t are optimally set to 1.0. Similarly, increasing the spatial window size initially improves accuracy by capturing richer local geometry, but sizes beyond 9 begin to introduce heterogeneous noise from adjacent classes. Therefore, we extract 9 × 9 spatial patches centred at each labeled pixel ( w s p a t i a l = 9 ), and dynamically set the spectral window size ( w s p e c t r a l ) around 10 to 15 to optimally balance long-range spectral dependency modeling with computational efficiency.
Figure 6. Parameter sensitivity analysis of the proposed S2A-Swin on the Indian Pines, Pavia University, Salinas Scene, and Botswana datasets. The charts display the variation of overall accuracy (OA) concerning the SSC-cGAN regularization weights, (a) α s p e c and (b) α s p a t , as well as the HybridSwinBlock receptive fields, (c) w s p a t i a l and (d) w s p e c t r a l .

4.3. Experimental Result and Analysis

4.3.1. Quantitative Analysis

Based on the quantitative results in Table 5, Table 6, Table 7, Table 8, Table 9, Table 10, Table 11 and Table 12, we conducted a horizontal comparison and vertical analysis of the overall accuracy (OA), average accuracy (AA), and Cohen’s κ of four benchmarks (Indian Pines, Pavia University, BOS, and Salinas Scene). The evidence is consistent and has a clear effect size: under the same training and environment settings, traditional methods (SVM) are limited by hand-crafted features and do not fully utilize the high-dimensional redundancy and spatial context of hyperspectral images, and overall lag significantly behind deep baselines. Classic deep models (1DCNN, 3DCNN, FM) benefit from nonlinear representation and local spatial modeling, and their OA/AA/ κ are significantly improved, but they still have shortcomings in long-range dependency and cross-band consistency. “Direct transfer” Transformers (such as ViT and its peers) are generally comparable to strong CNN baselines, indicating that in the absence of HSI-oriented structural priors, attention has difficulty in stably aligning spectral–spatial relationships under small sample conditions. Transformers designed for HSI variants (SPECTRAL-SWIN, CSIL, VIT, CLOLN) further alleviate these issues, but overall still lag behind this method.
Table 5. Classification results of different methods using 10% training samples per class on IP dataset.
Table 6. Classification results of different methods using 5% training samples per class on IP dataset.
Table 7. Classification results of different methods using 5% training samples per class on BOS dataset.
Table 8. Classification results of different methods using 5% training samples per class on SA dataset.
Table 9. Classification results of different methods using 5% training samples per class on PU dataset.
Table 10. Classification results of different methods using 10% training samples per class on BOS dataset.
Table 11. Classification results of different methods using 10% training samples per class on SA dataset.
Table 12. Classification results of different methods using 10% training samples per class on PU dataset.
Quantitatively, S2A-Swin achieves OA improvements of 2.45%, 7.05%, 5.17%, and 0.85% on the four datasets, respectively, compared to the strongest comparison method. Furthermore, even in the case of extreme class imbalance, AA and κ increase simultaneously, indicating that the gains are not driven by a few “large classes,” but rather broadly improve the separability of tail and easily confused classes. Taking the Pavia University dataset as an example, OA still maintains marginal advantages of approximately 0.20% and 1.07% over two strong baselines, demonstrating statistical and practical significance at the high baseline level. This is consistent with the confusion matrix. S2A-Swin’s off-diagonal terms shrink overall, and its diagonal dominance is stronger. Only in extremely difficult-to-distinguish and spatially adjacent class pairs (such as Gravel/Bricks in Pavia and Grapes Untrained/Vineyard Untrained in Salinas) are there a small amount of residual misclassification, consistent with the inherent difficulty of “nearly isospectral-adjacent” scenarios.
Overall, S2A-Swin unifies multi-scale long-range dependencies and local detail fidelity under controllable complexity through hierarchical shifting windows and spectral–spatial adaptive aggregation, resulting in a systematic, reproducible, and cross-dataset-consistent lead in the three metrics of OA, AA, and κ . Combined with our reported parameter sensitivity experiments and a unified training environment, these improvements eliminate the influence of implementation details and parameter bias, demonstrating the method’s robustness and transferability in typical HSI scenarios such as small samples, high inter-class similarity, and complex boundaries.

4.3.2. Qualitative Analysis

To further emphasize the superiority of our method, we also show the qualitative results and compare these with other advanced methods in Figure 7, Figure 8, Figure 9 and Figure 10. Pixel-level classifiers (1D CNN, HSIC-FM, ViT) are prone to produce significant salt-and-pepper artifacts and fragmented predictions in areas with complex textures or uncertain annotations due to the lack of spatial priors and neighborhood consistency constraints; patch-based CNN and hybrid structures (3D). Although CNN, CLOLN, and SWIN improve regional coherence through explicit spatial modeling, the local averaging effect of convolution will cause significant “boundary expansion/erosion” and topological fractures at the boundaries of high curvature or slender targets, such as “brick/commercial” and “road/runway” categories. When the spectral difference is weak and the background is similar (such as “bare soil/grass”), the decision boundary of SSFTT is unstable.
Figure 7. Classification maps obtained by different methods for Indian Pines. (Gt—ground truth). (a) SVM; (b) 1D-CNN; (c) 3D-CNN; (d) VIT; (e) HSIC-FM; (f) SWIN; (g) CSIL; (h) CLOLN; and (Ours).
Figure 8. Classification maps obtained by different methods for BOS. (Gt—ground truth). (a) SVM; (b) 1D-CNN; (c) 3D-CNN; (d) VIT; (e) HSIC-FM; (f) SWIN; (g) CSIL; (h) CLOLN; and (Ours).
Figure 9. Classification maps obtained by different methods for Pavia University. (Gt—ground truth). (a) SVM; (b) 1D-CNN; (c) 3D-CNN; (d) VIT; (e) HSIC-FM; (f) SWIN; (g) CSIL; (h) CLOLN; and (Ours).
Figure 10. Classification maps obtained by different methods for Pavia University. (Gt—ground truth). (a) SVM; (b) 1D-CNN; (c) 3D-CNN; (d) VIT; (e) HSIC-FM; (f) SWIN; (g) CSIL; (h) CLOLN; and (Ours).
In the absence of positioning prior, VIT attention is diffuse, which brings surface smoothness but produces systematic deviations from the real geometric boundaries (such as “road”, “parking lot 2”, and “runway”). For fine-grained category combinations with highly similar appearance and spatial proximity (“soybean no-tillage/corn no-tillage”, “highway/railway/road”, “grapes untrained/vineyard”, etc.), the decision boundary of SPECTRAL-SWIN is unstable. SPECTRAL-SWIN, CLOLN, and VIT, which rely on global attention, are more likely to mistakenly incorporate irrelevant regions when representing aggregated images, diluting class-specific cues. CSIL, which primarily relies on depthwise separability and point-by-point convolution, is limited by its effective receptive field and struggles to fully capture cross-scale discriminative evidence. The fundamental reason lies in the lack of targeted structural priors for the three-dimensional spectral–spatial properties and cross-band redundancy of HSI, or the lack of fine-grained constraints on informativeness/redundancy in contextual aggregation. In contrast, S2A-Swin utilizes hierarchical and shifted window self-attention to jointly capture multi-scale long-range dependencies while preserving local details at a manageable complexity. It also selectively enhances informative bands and key neighborhoods through spectral–spatial adaptive aggregation, suppressing redundancy and interference. Combined with the multi-view consistent encoding provided by HybridSwinBlock, it mechanistically mitigates three persistent issues: pixel noise, over-smoothing boundaries, and fine-grained similarity confusion. Its visual benefits manifest in sharper edges, improved continuity of slender structures, and significantly reduced class leakage in textured areas across a wide range of scenarios. The confusion matrix in Figure 11 is highly consistent with the above phenomenon: the off-diagonal elements of the four datasets are generally sparse and nearly diagonal, with only a few misclassifications remaining in the recognized “near-isospectral–spatial proximity” difficulty points, such as Pavia’s Gravel/Bricks and Salinas’ Grapes Untrained/Vineyard Untrained. These residual confusions are more likely a reflection of intrinsic class inseparability rather than model mismatch.
Figure 11. Confusion matrices generated by S2A-Swin over four datasets. (a) Indian Pines. (b) Pavia University. (c) BOS. (d) Salinas Scene.
Overall, S2A-Swin demonstrates systematic and interpretable advantages in the three key dimensions of “noise suppression, boundary preservation, and separation of similar classes,” resulting in higher consistency and stability between its classification maps and the ground truth across the four datasets, and demonstrating good small-sample adaptability.

4.3.3. Computational Complexity Analysis

To illustrate the computational complexity of the proposed S2A-Swin compared to other methods, we report floating-point operations (FLOPs), parameter count (Params), and inference runtime in Table 13. Following, we define an efficiency metric η that balances the gains in overall accuracy (OA) against the additional FLOPs and extra parameters required:
η = Norm ( Δ FLOPs ) + Norm ( Δ Params ) + 1 Δ OA + 1 ,
where OA is expressed in percent (so Δ OA is the change in percentage points) and Norm ( · ) denotes normalization of the respective quantity. Adding 1 to both the numerator and denominator ensures positivity and avoids division by zero. A smaller η indicates higher efficiency ( fewer additional FLOPs and parameters required to increase OA by 1%). As shown in Table 13, among the Transformer-based methods (ViT, SWIN, CSIL, CLOLN, and ours), S2A-Swin requires relatively fewer FLOPs and parameters.
Table 13. FLOPs, parameters, and inference time of comparative methods on four datasets.

5. Discussion

Under the extremely low supervision quota of only 10% labeled samples per class, the generalization of the classifier is mainly dominated by two types of risks: first, the prior bias of the long-tail class is amplified, and the discrimination boundary of the minority class is eroded by the majority class in the process of empirical risk minimization; second, the statistical sufficiency of the spectral–spatial three-dimensional structure is insufficient, making it difficult for the model to simultaneously learn the stable coupling of long-range dependencies and local geometry. Around these two points, the contribution of the data-side and model-side innovations of this method in the 10% scenario will be significantly “amplified”: after removing SS-cGAN, the decrease in macro-average indicators (AA, macro-F1, G-mean) and κ will be significantly greater than that of OA, accompanied by a significant increase in the intra-class recall variance, an expansion of the off-diagonal terms of the confusion matrix in the long tail and similar classes (such as Gravel/Bricks, Grapes Untrained/Vineyard Untrained), and an earlier overfitting and lower peak in the learning curve, indicating that the benefit of SS-cGAN does not come from “data accumulation”, but from the correct shaping of the minority class distribution and spectral-space continuity. If only spectral smoothing is removed, the unphysical spectral noise corrupts the discriminative absorption features, causing the intermixing rate of near-spectral similar classes to increase most significantly. This further confirms that SSC preserves the subtle discriminative features against generative noise, causing the intermixing rate of near-spectral similar classes to increase most significantly. To intuitively illustrate this preservation and confirm that the SSC does not inadvertently cause negative “over-smoothing”, we visualize the spectral signatures in Figure 12. Using four extreme minority classes from the Indian Pines dataset as examples, it can be observed that the generated spectra (dashed red lines) tightly follow the real data’s macroscopic envelopes (solid blue lines). Most importantly, highly discriminative local features—such as the sharp absorption valleys and distinct peaks—are perfectly retained rather than being artificially flattened. This visual evidence confirms that our calibrated SSC functions as a targeted physical constraint, eliminating unnatural high-frequency GAN jitter while strictly respecting the intrinsic spectral signatures of individual classes. Meanwhile removing only spatial smoothing will manifest as a deterioration of block consistency in the classification graph and an increase in noise points, which is consistent with the key role of spatial prior in combating noise in the 10% scenario. Replacing SS-cGAN with vanilla cGAN is equivalent, even with matching generation scale, it is difficult to replicate the same improvement in AA/ κ , indicating that “conditional generation with spectral-space consistency”, rather than “unconstrained amplification”, is the source of performance.
Figure 12. Comparison of mean spectral signatures between real samples (solid blue lines) and SS-cGAN generated samples (dashed red lines) for four extreme minority classes in the Indian Pines dataset. (a) Class 1 (Alfalfa). (b) Class 7 (Grass-pasture-mowed). (c) Class 9 (Oats). (d) Class 16 (Stone-Steel-Towers).
On the model side, removing the spectral window and retaining only the spatial window directly weakens cross-band alignment and near-spectral discrimination, with AA and κ being the primary impactin Table 14. Disrupting or removing the execution order of cross-order attention disrupts the prior “spectral → space/space → spectral” pairings, leading to boundary erosion and breakage of slender structures in the ROI, while also releasing errors for adjacent categories in the confusion matrix. Replacing the domain perception module with a standard Swin or 2D-CNN block further amplifies these distortions under equal parameter and computational conditions, suggesting that the inductive bias of “two-dimensional windowing + order alternation” is necessary, not redundant, for the three-dimensional properties of HSI.
Table 14. Ablation of proposed components with 10% training samples per class on the IP dataset.
More importantly, under the 10% annotation quota, the two aforementioned improvement paths exhibit a synergistic effect: SS-cGAN improves the coverage and balance of the “learnable distribution” at the data level, mitigating long tails and noise, while the domain-aware hybrid Swin provides a spectral–spatial decoupling and recoupling mechanism that matches this distribution at the model level, ensuring that generated and real samples are aligned in the representation space and can be consistently utilized. The combined effect of these two approaches is evident in simultaneous improvements in AA, macro-F1, and κ , significant reductions in per-class recall variance and ECE, and a gentler rise in the learning curve with later early stopping points. This chain of evidence is particularly critical under the 10% annotation quota, as it transforms “superficial OA gains” into substantial improvements in “class balance, calibration, and robustness,” thereby avoiding misinterpretation of these improvements as incidental gains from parameter tuning or data augmentation.

6. Conclusions

In this paper, we propose a novel Transformer-based model for HSI classification, named S2A-Swin, which combines the properties of HSI with the Swin Transformer network architecture. Specifically, S2A-Swin models local and hierarchical spatial-spectral relationships while building discriminative representations for better classification. S2A-Swin primarily consists of SSC-cGAN and the HybridSwinBlock. Instead of directly applying GAN to generate dependencies, SSC-cGAN leverages spectral physical properties as constraints to reorganize image patches into overlapping cubes. At the data level, a conditional generative adversarial network (SSC-cGAN) with spectral and spatial smoothing regularization is introduced to synthesize patches of scarce categories while maintaining spectral continuity and local geometric consistency, mitigating long-tail bias and insufficient training data at the source. At the model level, a domain-aware hybrid Transformer module is constructed. Through local windowing and cross-order attention in both spatial and spectral dimensions, cross-dimensional information interaction is explicitly guided, enabling the aggregation of long-range dependencies while preserving detail fidelity with manageable complexity. HybridSwinBlock extracts hierarchical spatial–spectral relationships from these tag embeddings with the help of spatial-MSA and spectral-MSA, integrating features from the Swin Transformer module to improve discriminative ability and facilitate training. The two models form a synergistic mechanism: SSC-cGAN provides a more balanced and physically consistent “learnable distribution,” while hybrid Swin uses a matching two-dimensional window and sequential prior to achieve efficient spectral–spatial joint modeling. Experiments on four HSI datasets from different scenarios demonstrate that the proposed S2A-Swin achieves comparable results to existing state-of-the-art HSI classifiers in terms of classification accuracy and computational cost.

Author Contributions

Conceptualization, B.L. and J.C.; methodology, J.C.; software, J.C.; validation, W.K.; formal analysis, W.Z.; writing—original draft preparation, J.C.; writing—review and editing, X.L.; visualization, Z.D.; supervision, B.L.; project administration, W.K.; funding acquisition, B.L. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Longjiang Project Young Goose Innovation Team Support Program under Grant 2024CYLJ01, the Natural Science Foundation of Heilongjiang Province for Key Projects, China under Grant ZD2021F004, the Science and Technology Project of the Department of Transportation of Heilongjiang Province under Project No. 2025Z016, and the Art Science Planning Project of Heilongjiang Province under Grant 2025A013.

Data Availability Statement

The Indian Pines, Pavia University, Salinas, and Botswana datasets used in this study are available at https://www.ehu.eus/ccwintco/index.php?title=Hyperspectral_Remote_Sensing_Scenes (accessed on 3 November 2023).

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Willett, R.M.; Duarte, M.F.; Davenport, M.A.; Baraniuk, R.G. Sparsity and structure in hyperspectral imaging: Sensing, reconstruction, and target detection. IEEE Signal Process. Mag. 2013, 31, 116–126. [Google Scholar] [CrossRef] [Scilit]
  2. Bandos, T.V.; Bruzzone, L.; Camps-Valls, G. Classification of hyperspectral images with regularized linear discriminant analysis. IEEE Trans. Geosci. Remote Sens. 2009, 47, 862–873. [Google Scholar] [CrossRef] [Scilit]
  3. Chang, C.I. Hyperspectral Imaging: Techniques for Spectral Detection and Classification; Springer Science & Business Media: Berlin/Heidelberg, Germany, 2003; Volume 1. [Google Scholar]
  4. Datta, D.; Mallick, P.K.; Bhoi, A.K.; Ijaz, M.F.; Shafi, J.; Choi, J. Hyperspectral image classification: Potentials, challenges, and future directions. Comput. Intell. Neurosci. 2022, 2022, 3854635. [Google Scholar] [CrossRef] [Scilit]
  5. Siche, R.; Vejarano, R.; Aredo, V.; Velasquez, L.; Saldana, E.; Quevedo, R. Evaluation of food quality and safety with hyperspectral imaging (HSI). Food Eng. Rev. 2016, 8, 306–322. [Google Scholar] [CrossRef] [Scilit]
  6. Santos, C.F.G.D.; Papa, J.P. Avoiding overfitting: A survey on regularization methods for convolutional neural networks. ACM Comput. Surv. (Csur) 2022, 54, 1–25. [Google Scholar] [CrossRef] [Scilit]
  7. Vali, A.; Comai, S.; Matteucci, M. Deep learning for land use and land cover classification based on hyperspectral and multispectral earth observation data: A review. Remote Sens. 2020, 12, 2495. [Google Scholar] [CrossRef] [Scilit]
  8. Hasan, H.; Shafri, H.Z.; Habshi, M. A comparison between support vector machine (SVM) and convolutional neural network (CNN) models for hyperspectral image classification. In IOP Conference Series: Earth and Environmental Science; IOP Publishing: Bristol, UK, 2019; Volume 357, p. 012035. [Google Scholar]
  9. Song, W.; Li, S.; Kang, X.; Huang, K. Hyperspectral image classification based on KNN sparse representation. In Proceedings of the 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS); IEEE: New York, NY, USA, 2016; pp. 2411–2414. [Google Scholar]
  10. Ahmad, M. Deep Learning for Hyperspectral Image Classification. Doctoral Thesis, Università degli Studi di Messina, Messina, Italy, 2021. Doctoral Programme in Cyber Physical Systems. Available online: https://hdl.handle.net/20.500.14242/126198 (accessed on 17 March 2025).
  11. Ahmed, S.F.; Alam, M.S.B.; Hassan, M.; Rozbu, M.R.; Ishtiak, T.; Rafa, N.; Mofijur, M.; Shawkat Ali, A.; Gandomi, A.H. Deep learning modelling techniques: Current progress, applications, advantages, and challenges. Artif. Intell. Rev. 2023, 56, 13521–13617. [Google Scholar] [CrossRef] [Scilit]
  12. Song, H.; Kim, M.; Park, D.; Shin, Y.; Lee, J.G. Learning from noisy labels with deep neural networks: A survey. IEEE Trans. Neural Netw. Learn. Syst. 2022, 34, 8135–8153. [Google Scholar] [CrossRef] [Scilit]
  13. Ullah, F.; Ullah, I.; Khan, K.; Khan, S.; Amin, F. Advances in deep neural network-based hyperspectral image classification and feature learning with limited samples: A survey. Appl. Intell. 2025, 55, 370. [Google Scholar] [CrossRef] [Scilit]
  14. Islam, M.T.; Islam, M.R.; Uddin, M.P.; Ulhaq, A. A deep learning-based hyperspectral object classification approach via imbalanced training samples handling. Remote Sens. 2023, 15, 3532. [Google Scholar] [CrossRef] [Scilit]
  15. Zhang, F.; Bai, J.; Zhang, J.; Xiao, Z.; Pei, C. An optimized training method for GAN-based hyperspectral image classification. IEEE Geosci. Remote Sens. Lett. 2020, 18, 1791–1795. [Google Scholar] [CrossRef] [Scilit]
  16. Zhan, Y.; Hu, D.; Wang, Y.; Yu, X. Semisupervised hyperspectral image classification based on generative adversarial networks. IEEE Geosci. Remote Sens. Lett. 2017, 15, 212–216. [Google Scholar] [CrossRef] [Scilit]
  17. Sun, C.; Zhang, X.; Meng, H.; Cao, X.; Zhang, J.; Jiao, L. Dual-Branch Spectral–Spatial Adversarial Representation Learning for Hyperspectral Image Classification with Few Labeled Samples. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2023, 16, 1–15. [Google Scholar] [CrossRef] [Scilit]
  18. Tomar, S.; Gupta, A. A review on mode collapse reducing gans with gan’s algorithm and theory. In GANs for Data Augmentation in Healthcare; Springer: Cham, Switzerland, 2023; pp. 21–40. [Google Scholar]
  19. Gulrajani, I.; Ahmed, F.; Arjovsky, M.; Dumoulin, V.; Courville, A.C. Improved training of wasserstein gans. Adv. Neural Inf. Process. Syst. 2017, 30, 5769–5779. [Google Scholar]
  20. Zhan, Y.; Wang, Y.; Yu, X. Semisupervised hyperspectral image classification based on generative adversarial networks and spectral angle distance. Sci. Rep. 2023, 13, 22019. [Google Scholar] [CrossRef] [Scilit]
  21. Paoletti, M.E.; Haut, J.M.; Plaza, J.; Plaza, A. Deep & dense convolutional neural network for hyperspectral image classification. Remote Sens. 2018, 10, 1454. [Google Scholar]
  22. Fu, W.; Lu, T.; Li, S. Context-aware compressed sensing of hyperspectral image. IEEE Trans. Geosci. Remote Sens. 2019, 58, 268–280. [Google Scholar] [CrossRef] [Scilit]
  23. He, J.; Zhao, L.; Yang, H.; Zhang, M.; Li, W. HSI-BERT: Hyperspectral image classification using the bidirectional encoder representation from transformers. IEEE Trans. Geosci. Remote Sens. 2019, 58, 165–178. [Google Scholar] [CrossRef] [Scilit]
  24. Yang, J.; Wu, C.; Du, B.; Zhang, L. Enhanced multiscale feature fusion network for HSI classification. IEEE Trans. Geosci. Remote Sens. 2021, 59, 10328–10347. [Google Scholar] [CrossRef] [Scilit]
  25. Kong, W.; Liu, B.; Bi, X.; Pei, J.; Chen, Z. Instructional Mask Autoencoder: A Scalable Learner for Hyperspectral Image Classification. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2024, 17, 1348–1362. [Google Scholar] [CrossRef] [Scilit]
  26. Yang, H.; Yu, H.; Zheng, K.; Hu, J.; Tao, T.; Zhang, Q. Hyperspectral image classification based on interactive transformer and CNN with multilevel feature fusion network. IEEE Geosci. Remote Sens. Lett. 2023, 20, 5507905. [Google Scholar] [CrossRef] [Scilit]
  27. Kong, W.; Liu, B.; Bi, X.; Yu, C.; Li, X.; Chen, Y. HyperSL: A Spectral Foundation Model for Hyperspectral Image Interpretation. IEEE Trans. Geosci. Remote Sens. 2025, 63, 5513119. [Google Scholar] [CrossRef] [Scilit]
  28. Liu, B.; Liu, Y.; Zhang, W.; Tian, Y.; Kong, W. Spectral swin transformer network for hyperspectral image classification. Remote Sens. 2023, 15, 3721. [Google Scholar] [CrossRef] [Scilit]
  29. Tang, J.; Ma, N.; Jia, C.; Tian, R.; Guo, Y. HyperEAST: An Enhanced Attention-Based Spectral-Spatial Transformer with Self-Supervised Pretraining for Hyperspectral Image Classification. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2025, 18, 22241–22255. [Google Scholar] [CrossRef] [Scilit]
  30. Hayes, J.; Melis, L.; Danezis, G.; De Cristofaro, E. Logan: Membership inference attacks against generative models. arXiv 2017, arXiv:1705.07663. [Google Scholar] [CrossRef] [Scilit]
  31. Shokri, R.; Stronati, M.; Song, C.; Shmatikov, V. Membership inference attacks against machine learning models. In Proceedings of the 2017 IEEE Symposium on Security and Privacy (SP); IEEE: New York, NY, USA, 2017; pp. 3–18. [Google Scholar]
  32. Liang, H.; Bao, W.; Shen, X. Adaptive weighting feature fusion approach based on generative adversarial network for hyperspectral image classification. Remote Sens. 2021, 13, 198. [Google Scholar] [CrossRef] [Scilit]
  33. Sun, C.; Zhang, X.; Meng, H.; Cao, X.; Zhang, J. AC-WGAN-GP: Generating Labeled Samples for Improving Hyperspectral Image Classification with Small-Samples. Remote Sens. 2022, 14, 4910. [Google Scholar] [CrossRef] [Scilit]
  34. Zhang, M.; Wang, Z.; Wang, X.; Gong, M.; Wu, Y.; Li, H. Features kept generative adversarial network data augmentation strategy for hyperspectral image classification. Pattern Recognit. 2023, 142, 109701. [Google Scholar] [CrossRef] [Scilit]
  35. Ullah, F.; Ullah, I.; Khan, K.; Khan, S.; Wang, Q.; Algamdi, S.A.; Aldossary, H. Squeeze-SwinFormer: Spectral Squeeze and Excitation Swin Transformer Network for Hyperspectral Image Classification. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2025, 18, 21400–21418. [Google Scholar] [CrossRef] [Scilit]
  36. Liu, B.; Zhang, H.; Zhu, J.; Chen, Y.; Pan, Y.; Gong, X.; Yan, J.; Zhang, H. Pixel-level recognition of trace mycotoxins in red ginseng based on hyperspectral imaging combined with 1DCNN-residual-BiLSTM-attention model. Sensors 2024, 24, 3457. [Google Scholar] [CrossRef] [Scilit]
  37. Lv, H.; Sun, Y.; Zhang, H.; Li, M. Hybrid 2D–3D convolution and pre-activated residual networks for hyperspectral image classification. Signal Image Video Process. 2024, 18, 3815–3827. [Google Scholar] [CrossRef] [Scilit]
  38. Yao, T.; Pan, Y.; Li, Y.; Ngo, C.W.; Mei, T. Wave-vit: Unifying wavelet and transformers for visual representation learning. In European Conference on Computer Vision; Springer: Berlin/Heidelberg, Germany, 2022; pp. 328–345. [Google Scholar]
  39. Yang, J.; Du, B.; Zhang, L. Overcoming the barrier of incompleteness: A hyperspectral image classification full model. IEEE Trans. Neural Netw. Learn. Syst. 2023, 35, 14467–14481. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  40. Yang, J.; Du, B.; Zhang, L. From center to surrounding: An interactive learning framework for hyperspectral image classification. ISPRS J. Photogramm. Remote Sens. 2023, 197, 145–166. [Google Scholar] [CrossRef] [Scilit]
  41. Li, C.; Rasti, B.; Tang, X.; Duan, P.; Li, J.; Peng, Y. Channel-Layer-Oriented Lightweight Spectral-Spatial Network for Hyperspectral Image Classification. IEEE Trans. Geosci. Remote Sens. 2024, 62, 5504214. [Google Scholar] [CrossRef] [Scilit]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Article Metrics

Citations

Article Access Statistics

Multiple requests from the same IP address are counted as one view.