Highlights
What are the main findings?
- Introduces a novel TGDHTL framework integratingMulti-Scale Stripe Attention (MSSA) with GCN and class-conditional diffusion for efficient hyperspectral image classification.
- Achieves robust cross-domain adaptation using a lightweight transformer with MMD loss, reducing labeled data needs by 25% while maintaining high accuracy.
- Evaluated on six benchmark datasets including HJ-1A and WHU-OHS, demonstrating superior performance in diverse urban and land-cover scenarios.
What are the implication of the main finding?
- Provides a scalable, data-efficient solution for HSI classification under domain shifts and resource constraints.
- Enhances applicability in remote sensing tasks such as environmental monitoring, precision agriculture, urban land-use analysis, and disaster response.
Abstract
Hyperspectral image (HSI) classification is pivotal for remote sensing applications, including environmental monitoring, precision agriculture, and urban land-use analysis. However, its accuracy is often limited by scarce labeled data, class imbalance, and domain discrepancies between standard RGB and HSI imagery. Although recent deep learning approaches, such as 3D convolutional neural networks (3D-CNNs), transformers, and generative adversarial networks (GANs), show promise, they struggle with spectral fidelity, computational efficiency, and cross-domain adaptation in label-scarce scenarios. To address these challenges, we propose the Transformer–Graph Convolutional Network–Diffusion with Hybrid Domain Adaptation (TGDHTL) framework. This framework integrates domain-adaptive alignment of RGB and HSI data, efficient synthetic data generation, and multi-scale spectral–spatial modeling. Specifically, a lightweight transformer, guided by Maximum Mean Discrepancy (MMD) loss, aligns feature distributions across domains. A class-conditional diffusion model generates high-quality samples for underrepresented classes in only 15 inference steps, reducing labeled data needs by approximately 25% and computational costs by up to 80% compared to traditional 1000-step diffusion models. Additionally, a Multi-Scale Stripe Attention (MSSA) mechanism, combined with a Graph Convolutional Network (GCN), enhances pixel-level spatial coherence. Evaluated on six benchmark datasets including HJ-1A and WHU-OHS, TGDHTL consistently achieves high overall accuracy (e.g., 97.89% on University of Pavia) with just 11.9 GFLOPs, surpassing state-of-the-art methods. This framework provides a scalable, data-efficient solution for HSI classification under domain shifts and resource constraints.
1. Introduction
Hyperspectral imaging (HSI) captures detailed spectral information across hundreds of narrow wavelength bands (400–2500 nm), enabling precise material and land-cover identification for applications such as precision agriculture, environmental monitoring, urban land-use analysis, and disaster response [1,2,3]. Compared to RGB or multispectral imaging, HSI excels in resolving subtle spectral variations due to its high-dimensional data and rich information content.
Despite its strengths, HSI classification faces significant challenges. The extensive number of spectral bands increases computational complexity, impeding real-time or large-scale deployment. Additionally, acquiring ground-truth labels is costly, leading to limited labeled datasets and an increased risk of overfitting, especially for minority classes in imbalanced datasets [4,5]. Furthermore, the complex spectral–spatial interactions in HSI data necessitate models that capture both local and long-range dependencies for accurate classification [6,7,8].
Traditional HSI classification methods, such as Support Vector Machines (SVMs) and Random Forests, rely on handcrafted features like spectral indices and texture measures. These methods struggle to model intricate spectral–spatial relationships and often exhibit poor generalization across diverse datasets, such as Indian Pines, University of Pavia, HJ-1A, and WHU-OHS [7,8,9,10,11]. Deep learning approaches, including 3D Convolutional Neural Networks (3D-CNNs) and Spectral-Spatial Residual Networks (SSRN), have advanced automated feature extraction and improved performance. However, their limited receptive fields and high parameter counts restrict their ability to model global dependencies.
Transformer-based models, such as SpectralFormer and HyViT, leverage self-attention to capture global spectral–spatial interactions, significantly enhancing classification accuracy [12,13]. Nevertheless, these models demand large labeled datasets and substantial computational resources, limiting their practicality in label-scarce or resource-constrained environments. Graph Convolutional Networks (GCNs) improve spatial coherence by modeling pixel relationships, but their scalability is constrained by the computational cost of graph construction [14,15].
To mitigate label scarcity, transfer learning from RGB domains (e.g., ImageNet) to HSI has been explored [16,17]. However, domain shifts due to differences in spectral resolution and distribution between RGB and HSI data pose significant challenges, requiring robust domain adaptation strategies. Generative models, such as Generative Adversarial Networks (GANs) and diffusion-based methods, augment training data to address label limitations [18,19,20]. Yet, GANs often compromise spectral fidelity, and traditional diffusion models incur high computational costs and latency.
These challenges—high computational demands, reliance on extensive labeled data, inadequate spectral–spatial modeling, and domain adaptation difficulties—highlight the need for a comprehensive HSI classification framework that integrates efficient feature extraction, robust data augmentation, and effective domain adaptation.
To address these issues, we propose TGDHTL (Transformer–GCN–Diffusion with Hybrid Domain Adaptation), a unified framework with three key innovations:
- Multi-Scale Stripe Attention (MSSA) with GCN Backbone: Partitions features into multi-scale stripes with sizes P = {4, 8, 16}, capturing local and global spectral–spatial dependencies with reduced complexity. A GCN backbone enhances spatial coherence and supports real-time applications.
- Class-Conditional Diffusion Augmentation: Utilizes a Denoising Diffusion Implicit Model (DDIM) to generate high-fidelity synthetic samples for minority classes (e.g., Shadows in Pavia, Oats in Indian Pines, urban structures in WHU-OHS), reducing labeled data needs by approximately 25% and computational costs by up to 80% compared to traditional 1000-step diffusion models.
- Transformer-Based Domain Adapter: Employs a lightweight transformer guided by Maximum Mean Discrepancy (MMD) loss to align RGB and HSI feature distributions, enabling robust domain adaptation in low-label regimes using ImageNet-pretrained RGB features.
Validated on six benchmark datasets (Indian Pines, University of Pavia, KSC, Salinas, HJ-1A, and WHU-OHS), TGDHTL consistently outperforms state-of-the-art baselines (e.g., ViT, iHGAN), providing a scalable and data-efficient solution for HSI classification under domain shifts and resource constraints.
Despite the remarkable individual success of Transformers, Graph Convolutional Networks (GCNs), and diffusion models in hyperspectral image (HSI) classification, no existing framework simultaneously addresses three intertwined and critical challenges: (i) severe domain shift when transferring ImageNet-pretrained RGB backbones to the hyperspectral domain, (ii) extreme label scarcity (often less than or equal to 5% labeled samples per class in real-world scenarios), and (iii) preservation of long-range spatial coherence in very large-scale satellite and urban scenes such as WHU-OHS and HJ-1A. We hypothesize that the specific integration of a lightweight Transformer-based domain adapter (guided by MMD loss), a fast class-conditional DDIM with only 15 inference steps, and a Multi-Scale Stripe Attention fused with sparse GCN creates a synergistic effect that significantly outperforms any isolated or pairwise combination of these components. This hypothesis is rigorously validated through new few-shot (1% and 5% labeled samples) and cross-domain experiments presented in Section 3 and Section 3.11.1.
The paper is organized as follows: Section 2 describes the TGDHTL framework; Section 3 presents experimental results; Section 4 analyzes findings; and Section 5 concludes with future research directions.
1.1. Related Work
The field of hyperspectral image (HSI) classification has evolved rapidly, driven by the need to handle high-dimensional spectral data, limited labeled samples, and complex spectral-spatial relationships. Recent advancements have increasingly incorporated generative models to mitigate data scarcity, with techniques like Generative Adversarial Networks (GANs) and diffusion models synthesizing realistic samples for improved robustness [1,3,4,21,22]. This section reviews the literature across three categories: traditional and CNN-based methods, transformer and graph-based models, and generative and domain adaptation approaches. While individual models such as Transformers [12,13,23], Graph Convolutional Networks (GCNs) [14,15], diffusion models [3,24], and Mamba architectures [25] have shown strong results, they often tackle only isolated challenges like computational cost or label scarcity. In contrast, no prior unified framework addresses simultaneous high data efficiency (≤5%, cross-domain generalization (RGB to HSI), and real-time inference on large-scale scenes (e.g., WHU-OHS). TGDHTL fills this gap through its integrated design.
1.1.1. Traditional and CNN-Based Methods
Early HSI classification methods relied on traditional machine learning techniques, such as Support Vector Machines (SVMs) and Random Forests, often paired with handcrafted features like spectral indices or textures. These approaches provided interpretability but faltered in handling high dimensionality and generalization across datasets, including urban land-cover in HJ-1A and WHU-OHS [8,9,10,11,26,27,28]. The rise of deep Convolutional Neural Networks (CNNs), including 3D-CNNs and residual networks, marked a shift toward automated spectral–spatial feature extraction. Enhancements like adaptive fusion and attention mechanisms have further elevated performance on benchmarks [29,30,31,32]. However, CNNs’ reliance on local receptive fields limits their capture of long-range dependencies, a challenge highlighted in comprehensive reviews of deep learning for remote sensing [22,32].
1.1.2. Transformer and Graph-Based Methods
Transformers have emerged as powerful tools for HSI classification, leveraging self-attention to model global spectral–spatial interactions effectively. Hybrid CNN–Transformer models enhance contextual understanding while maintaining spatial accuracy [12,13,33,34]. Recent innovations, including lightweight attention and state-space models, reduce overhead without compromising results [25,35]. Complementary graph-based methods represent pixels as graphs to enforce spatial coherence, with dynamic spectral–spatial GCNs and multiscale frameworks excelling in dependency learning [14,15,36]. Scalability issues persist, however, due to graph construction costs in large scenes like WHU-OHS and HJ-1A [6,37], as noted in surveys on graph networks for remote sensing [28,36,38].
1.1.3. Generative and Domain Adaptation Approaches
Generative models, such as GANs and diffusion networks, have been pivotal for augmenting labeled HSI data and combating scarcity [19,20]. For example, the Spectral Diffusion Network (SDN) uses a 20-timestep process for high-fidelity sample generation, preserving spectral integrity [3,24]. Domain adaptation from RGB sources (e.g., ImageNet) minimizes reliance on labeled HSI, focusing on feature alignment within image modalities rather than heterogeneous cross-modal transfers [39,40,41]. Techniques like class-aligned balancing bridge spectral gaps, boosting generalization [16,17,42]. Self-supervised methods, including masked autoencoders and contrastive learning, leverage unlabeled data but remain vulnerable to noise [43,44,45]. Surveys emphasize the role of these approaches in UAV, urban, and real-world HSI tasks [46], yet challenges like domain mismatch and computational demands persist [28,41]. Recent attention mechanisms, such as central and multi-area attention, refine spectral-spatial modeling [47,48], while SegHSI and hybrid attention-GCNs improve segmentation and diffusion integration [49,50,51]. Nonetheless, these methods often overlook efficient RGB-to-HSI transfer. TGDHTL uniquely combines lightweight Transformer adaptation, fast class-conditional diffusion, and MSSA-GCN fusion to tackle domain shift, label scarcity, and global coherence in large scenes.
2. Materials and Methods
This section presents the Transformer–GCN–Diffusion Hybrid Domain Adaptation (TGDHTL) framework for hyperspectral image (HSI) classification, as depicted in Figure 1. The framework integrates hybrid domain adaptation, diffusion-based augmentation, and spectral–spatial modeling to address challenges such as limited labeled data, class imbalance, and cross-modal discrepancies.
Figure 1.
Overall architecture of the proposed TGDHTL framework for HSI classification. The ImageNet-pretrained RGB branch is aligned with the HSI branch via a lightweight Transformer adapter using MMD loss (dashed red arrow). Features are enhanced through diffusion augmentation, MSSA (p = 4, 8, 16), and GCN (cosine similarity > 0.85), followed by fusion ( = 0.5) and classification. Legend (bottom): Solid black arrows = feature propagation; Dashed red arrows = loss backpropagation (MMD); Green = HSI branch; Blue = RGB branch; Purple = shared modules.
2.1. Overview
The TGDHTL framework combines hybrid domain adaptation (HDA), diffusion-based augmentation, and spectral–spatial modeling to enable robust HSI classification, as shown in Figure 1. It employs a domain adaptation module to align feature distributions between RGB (ImageNet-pretrained) and HSI domains using the Maximum Mean Discrepancy (MMD) loss [52]:
Here, and represent feature vectors from the RGB and HSI domains, respectively, extracted by domain-specific encoders. The function maps features into a reproducing kernel Hilbert space , with the squared norm quantifying distributional divergence.
The framework comprises five key components: (1) a 3D Convolutional Neural Network (CNN) for initial feature extraction, (2) a domain adaptation module with position-wise feed-forward layers and multi-head attention, (3) a diffusion augmentation module using a Denoising Diffusion Implicit Model (DDIM) [53,54], (4) a Multi-Scale Stripe Attention (MSSA) module for capturing spectral–spatial dependencies [55], and (5) a Graph Convolutional Network (GCN) for enhancing spatial coherence, followed by an MLP-based classification head. The training procedure is detailed in Algorithm 1.
| Algorithm 1 Training Procedure of the TGDHTL Framework |
| Require: Labeled HSI dataset , RGB dataset , number of diffusion steps T, learning rate Ensure: Trained model parameters 1: Initialize model parameters 2: Extract spectral–spatial features from using MSSA 3: Extract RGB features from using lightweight Transformer 4: Align domain-specific features via MMD loss 5: for each training iteration do 6: Sample mini-batch 7: Generate synthetic samples for minority classes using DDIM with T steps 8: Construct graph with threshold and apply GCN 9: Fuse features via Adapter module 10: Compute classification loss and domain loss 11: Update 12: end for 13: return |
2.2. Data Preprocessing and Feature Extraction
This subsection outlines the preprocessing and feature extraction pipeline, incorporating domain adaptation to leverage pretrained RGB models for HSI classification.
2.2.1. Data Preprocessing
The preprocessing stage reduces noise, lowers dimensionality, and standardizes inputs for efficient feature extraction [56]. The input HSI cube , where H, W, and B denote height, width, and spectral bands, respectively, is normalized to [0, 1] using min–max normalization applied per band.
2.2.2. Min–Max Normalization
Each spectral band is scaled to [0, 1] to mitigate scale disparities and preserve spectral intensities, facilitating Principal Component Analysis (PCA) and patch-level feature extraction. Noisy bands, such as water absorption bands in the Indian Pines dataset (reducing from 224 to 200 bands [7]), are removed. PCA retains 95% of the variance by projecting normalized data onto 30 eigenvectors:
where contains the top 30 eigenvectors. Overlapping patches of size 32 × 32 × 30 are extracted with a stride of 12, forming a patch tensor , where N is the number of patches.
Min–max normalization is applied per-band after variance-based band selection and outlier removal to scale features to [0, 1]. While large min–max differences could theoretically compress intermediate values, our pipeline mitigates this by first removing noisy bands (variance < 1 × 10−6) and outliers, preserving >98% of spectral discriminability. Empirical comparison with Z-score normalization on held-out validation sets shows <0.2% difference in OA and comparable SAM values, confirming no meaningful loss of subtle intermediate spectral details. The bounded range of minmax further stabilizes training of attention and diffusion modules.
2.2.3. Feature Extractor
A three-layer 3D CNN extracts spectral–spatial features from each patch . Each layer applies 64 filters (3 × 3 × 3), followed by batch normalization (BN) and ReLU activation [57]:
where and are weights and biases, and ∗ denotes 3D convolution. The CNN, pretrained on ImageNet [58], produces feature maps .
2.2.4. Domain Adaptation Module
A lightweight transformer (four layers, six attention heads, 30% weight pruning) aligns HSI features with ImageNet-pretrained RGB features by minimizing the MMD loss (Equation (1)) [16,52]. Query (), key (), and value () matrices are projected from :
where . The attention mechanism is defined as:
where . The module outputs aligned features .
To mitigate potential loss of spatial structure during sequence processing, 2D sinusoidal positional encodings (as in ViT [59]) are added to the flattened patches before input to the Transformer. These encodings explicitly preserve relative spatial positions and are maintained throughout the self-attention layers. After Transformer processing, the sequence is reshaped to the original 2D grid, ensuring full retention of spatial relationships for subsequent GCN modeling.
This design prevents any destruction of spatial properties, allowing the GCN to effectively capture long-range dependencies on spatially coherent features. Ablation results confirm that including the Transformer improves performance without degrading GCN contributions. As shown in Figure 2, hyperspectral features are extracted via a 3D CNN and aligned with RGB features using a transformer guided by MMD loss.
Figure 2.
Domain adaptation pipeline. The HSI cube is normalized per band and reduced via PCA to 30 bands. Overlapping patches (32 × 32 × 30) are processed by a three-layer 3D CNN. Extracted features are aligned with ImageNet-pretrained RGB features using a four-layer transformer with six attention heads, guided by MMD loss.
To align RGB-pretrained features with HSI data, we first apply PCA to reduce HSI to 30 principal bands (retaining >99% variance) while mitigating redundant spectral noise. Both RGB (from ImageNet-pretrained ResNet backbone) and HSI features are then projected to a shared 64-dimensional latent space using lightweight linear adapters (identical architecture, separate parameters). Maximum Mean Discrepancy (MMD) loss is computed directly in this aligned 64-dim space between source (RGB) and target (HSI) feature distributions:
where is the feature map in the reproducing kernel Hilbert space.
Figure 3 provides empirical evidence of effective alignment: t-SNE visualizations show substantial reduction in domain shift after adaptation, with MMD values decreasing from 0.45 ± 0.03 to 0.12 ± 0.02. Validation accuracy during adaptation remains stable, confirming that meaningful semantic knowledge is transferred without introducing noise.
Figure 3.
t-SNE visualization of RGB and HSI feature distributions before/after MMD-based alignment, demonstrating effective domain shift reduction.
As shown in Table 1, domain adaptation significantly reduces the MMD value (from 0.45 to 0.12) while slightly improving validation accuracy.
Table 1.
Domain adaptation results: MMD values and validation accuracy before and after alignment.
2.3. Diffusion Augmentation Module
The diffusion augmentation module generates synthetic HSI patches using a Denoising Diffusion Implicit Model (DDIM) to address limited labeled data and class imbalance [53,60,61]. The forward process adds Gaussian noise:
where controls noise intensity. The reverse process denoises the data:
The noise addition at each timestep t, as shown in Figure 4, progressively transforms the data distribution. Operating over 15 timesteps, the module generates synthetic samples via a class-conditional reverse diffusion process, focusing on minority classes defined as shown below.
where is the sample count for class . The augmented dataset is . As shown in Figure 5, Gaussian noise is progressively added during the forward diffusion process, while the reverse DDIM process reconstructs high-fidelity synthetic samples, with minority classes receiving additional augmentation.
Figure 4.
Noise addition at timestep t in the diffusion process.
Figure 5.
Workflow of the class-conditional diffusion augmentation module. The forward diffusion process progressively adds Gaussian noise over 15 timesteps (), while the reverse DDIM process generates high-fidelity synthetic samples (). A portion of the generated samples is specifically allocated to minority classes.
2.4. Multi-Scale Stripe Attention (MSSA)
The MSSA module captures spectral–spatial dependencies by partitioning aligned features into horizontal stripes at scales P = {4, 8, 16}, as illustrated in Figure 6 [55]. For each scale , the feature map is divided into patches of size 32/p × 32/p, and attention is computed:
where are derived via
with , and = 64. Outputs are concatenated and projected:
Figure 6.
Multi-scale stripe attention mechanism. Input feature maps are divided into stripes at scales P = {4, 8, 16}. Self-attention is computed within each stripe, and outputs are aggregated to form .
Scales 4, 8, and 16 in MSSA were empirically chosen to capture multi-level spectral-spatial dependencies in typical HSI patch sizes (9 × 9 to 17 × 17 pixels): Scale 4 for fine-grained local stripes, Scale 8 for mid-range object patterns, and Scale 16 for global scene coherence. This combination was optimized via preliminary experiments on validation sets, achieving the best accuracy-efficiency trade-off (+0.82% OA over alternatives like 3, 6, 12 or 5, 10, 20).
Regarding flexibility, MSSA can adaptively use different scales for varying feature map dimensions. For example, larger scales are automatically selected for high-resolution inputs like WHU-OHS (1024 × 1024). New ablation results (Table 2) confirm that adaptive scales maintain performance across datasets, demonstrating the module’s robustness and versatility.
Table 2.
Ablation study on MSSA scale selection (averaged over six datasets, 20% labeled samples). Best results in bold.
2.5. Graph Convolutional Network (GCN) and Classification Head
2.5.1. GCN
The GCN enhances spatial coherence by modeling pixel relationships as a sparse graph , where represents pixels from MSSA features and denotes edges based on cosine similarity (Figure 7):
where are pixel feature vectors. Two GCN layers refine features [62]:
where is the normalized adjacency matrix, , and is the weight matrix. Features are fused as
where balances MSSA and GCN contributions.
Figure 7.
GCN integration with classification head. A sparse graph is constructed from MSSA features using cosine similarity (>0.85). Features propagate through two GCN layers and are fused with MSSA features (). An MLP with softmax outputs class probabilities.
The GCN module constructs a sparse graph using cosine similarity among features of labeled training pixels only (k = 8 nearest neighbors, similarity threshold = 0.85). This graph is fixed during training and used inductively at test time: each test pixel independently computes similarity to the fixed training nodes to form its local neighborhood, without access to other test pixels or global test information.
Importantly, graph construction is strictly isolated to the training set, ensuring a purely inductive setting with no transductive information leakage from test pixels. This design enables fair comparison with fully inductive baselines (e.g., CNNs, ViTs, Mamba models) while maintaining scalability on large satellite images (e.g., WHU-OHS 1024 × 1024 patches).
2.5.2. Classification Head
A two-layer MLP with a 0.3 dropout rate processes fused features . Global average pooling reduces spatial dimensions to , and the MLP computes class probabilities:
where denotes the MLP parameters and is the predicted probability distribution over C classes.
2.5.3. Cross-Entropy Loss
The classification head is trained using categorical cross-entropy loss:
where is the ground truth.
Although TGDHTL integrates multiple components, each serves a distinct and complementary role, avoiding redundancy while addressing specific limitations of individual modules. The Multi-Scale Stripe Attention (MSSA) captures local fine-grained spectral-spatial stripe patterns within small neighborhoods, enhancing detailed texture discrimination. In contrast, the Graph Convolutional Network (GCN) enforces long-range global pixel coherence through sparse graph propagation, essential for preserving spatial consistency in large homogeneous regions and million-pixel satellite scenes (e.g., WHU-OHS 1024 × 1024 patches).
The extended ablation study tabel explicitly demonstrates non-redundancy: removing MSSA alone degrades OA by 1.57%, removing GCN by 1.24%, and removing both by 2.81%, while their combination yields +1.24% OA over the backbone. This targeted fusion resolves key shortcomings—Transformers lack global spatial modeling, diffusion models are computationally heavy without acceleration, and pure attention struggles with spectral fidelity—resulting in a lightweight yet highly effective architecture (12.4 M parameters, 11.9 GFLOPs).
2.6. Algorithm Flow
The TGDHTL framework follows a structured pipeline, as shown in Figure 8. It begins with HSI preprocessing, followed by feature extraction using a 3D CNN and MSSA. Synthetic samples are generated via DDIM to augment the training set, particularly for minority classes. The transformer-based domain adapter aligns RGB and HSI features, and fused MSSA-GCN features are used for classification. The steps are:
Figure 8.
Flowchart of the TGDHTL algorithm, illustrating the pipeline from data preprocessing to classification.
- Preprocessing: Normalize HSI data and apply PCA to reduce to 30 bands.
- Feature Extraction: Extract spectral–spatial features using a three-layer 3D CNN and MSSA (Figure 6).
- GCN Processing: Construct a graph and apply GCN layers to enhance spatial coherence (Figure 7).
- DDIM Augmentation: Generate synthetic samples using class-conditional DDIM with 15 timesteps (Figure 5) [61].
- Domain Adaptation: Align RGB and HSI features using a transformer-based adapter (Figure 2) [52].
- Feature Fusion: Combine MSSA and GCN features using the weight (Equation (15)).
- Classification: Train a classifier (e.g., softmax) on fused features and evaluate using 5-fold cross-validation.
3. Results
This section evaluates TGDHTL for hyperspectral image (HSI) classification, focusing on accuracy, efficiency, and robustness with limited labeled data. Experiments are conducted on six benchmark hyperspectral datasets: Indian Pines, University of Pavia, Kennedy Space Center (KSC), Salinas, HJ-1A, and WHU-OHS. We compare TGDHTL with state-of-the-art (SOTA) methods, analyze component contributions, assess cross-domain adaptation, and evaluate performance across labeled sample ratios (10%, 20%, 50%). All results are averaged over five-fold cross-validation with 95% confidence intervals, and statistical significance is assessed via paired t-tests () unless otherwise noted. As shown in Table 3, the framework employs a learning rate of 0.001, a batch size of 32, and a GCN threshold of 0.85, which together ensure stable training and effective feature fusion.
Table 3.
Core hyperparameters used in the TGDHTL framework.
3.1. Experimental Setup
3.1.1. Experimental Environment and Configuration
All experiments were conducted on a workstation equipped with an NVIDIA RTX 3090 GPU (24 GB VRAM, NVIDIA Corporation, Santa Clara, CA, USA), an Intel Core i9-12900K CPU, and 128 GB RAM. The software environment was configured as follows:
- Operating System: Ubuntu 22.04 LTS
- Python version: 3.9.18
- Deep learning framework: PyTorch 2.1.0 with CUDA 12.1
- Additional libraries: NumPy 1.24.4, SciPy 1.10.1, scikit-learn 1.3.0, OpenCV 4.8.0
- Visualization tools: Matplotlib 3.7.2, Seaborn 0.12.2, t-SNE (via scikit-learn)
For reproducibility, all random seeds were fixed to 42 across NumPy, PyTorch, and CUDA backends. Training utilized mixed precision (FP16) to reduce memory overhead. Each experiment was repeated five times using five-fold cross-validation. Hyperparameter tuning was performed via grid search, and all scripts were executed on a single GPU unless otherwise specified.
3.1.2. Datasets and Preprocessing
We evaluate TGDHTL on six benchmark hyperspectral datasets spanning agricultural, urban, coastal, and large-scale land cover monitoring domains:
- Indian Pine: ( pixels, 200 bands, 16 classes): Captured by AVIRIS over agricultural fields in Indiana, USA. After removing 20 noisy bands, the dataset includes crop and vegetation classes annotated via ground surveys.
- Salinas: ( pixels, 204 bands, 16 classes): Acquired by AVIRIS over Salinas Valley, California. It contains crop-specific classes with high spatial resolution and field-based annotations.
- University of Pavia: ( pixels, 103 bands, 9 classes): Captured by the ROSIS sensor over Pavia, Italy. Urban land-cover classes are annotated using aerial imagery and manual verification.
- Kennedy Space Center (KSC) ( pixels, 176 bands, 13 classes): Collected by AVIRIS over coastal wetlands in Florida. Classes include vegetation and soil types, annotated via ecological field studies [6,7,8,63].
- HJ-1A: Acquired by China’s HJ-1A satellite, with 115 bands (400–900 nm), approximately pixels per scene, and four classes (e.g., grassland, forest, water, urban), suitable for land cover classification [10].
- WHU-OHS: A large-scale urban dataset with 32 hyperspectral bands (400–1000 nm) from eight satellites at 10 m resolution, designed for daily Earth surface monitoring. With extensive archive coverage, WHU-OHS collects and archives large swaths of the Earth’s surface daily, offering greater insight into land use change analysis in urban scenes. Its 32 spectral bands improve the fidelity and accuracy of supervised and unsupervised image classifications [11].
To clarify class imbalance in the University of Pavia dataset, Table 4 presents per-class labeled sample counts. Minority classes are defined as , where (Meadows). This distribution informs the class-conditional augmentation strategy in Section 2.3.
Table 4.
Labeled sample counts per class in the University of Pavia dataset (Figure A1 presents a bar chart of per-class labeled sample counts, complementing this table).
As shown in Table 5, TGDHTL achieves the highest overall accuracy under all few-shot settings, with a notable margin of +6.4% over SpiralMamba in the 1-sample/class case.
Table 5.
Overall Accuracy (OA, %) under extreme few-shot settings (fixed number of labeled samples per class). Best results in bold.
Table 6 compares TGDHTL with recent Mamba-based models in terms of accuracy and efficiency.
Table 6.
Comparison with recent Mamba-based models and computational efficiency (20% labeled samples, averaged over six datasets).
Although we sample an equal number of labeled training patches per class (e.g., 100 patches/class for Pavia at 20% label ratio), the full dataset remains imbalanced. The diffusion module leverages global label statistics—not just training splits—to generate synthetic patches for minority classes (see Section 2.3).
3.2. Preprocessing Pipeline
- Normalization: Min–max scaling applied to each band to normalize values to [0, 1].
- Dimensionality Reduction: PCA reduces bands to 30, preserving 95% variance [56].
- Noise Removal: Noisy bands excluded (e.g., Indian Pines: 224 → 200; KSC: 224 → 176; HJ-1A: 115 → 100 after removing water absorption bands).
- Patch Extraction: Overlapping patches extracted with stride 12; followed by convolution to reduce channels to 64 [64].
- Data Splitting: A five-fold cross-validation approach is employed, with 10%, 20%, or 50% of labeled samples allocated for training, 10% for validation, and the remainder for testing in each fold. This ensures robust evaluation and reproducibility across experiments.
- Augmentation:
- -
- HSI: Spectral band mixing (4% permuted), Gaussian noise ().
- -
- RGB: Random cropping (), horizontal flipping, color jitter.
3.2.1. Hyperparameter Optimization and Sensitivity Analysis
To ensure optimal performance, hyperparameters were tuned using a grid search approach on the validation set of the University of Pavia dataset. The search space included:
- Learning Rate: Tested values in 0.0001, 0.0005, 0.001, 0.005, 0.01, with 0.001 yielding the highest overall accuracy (OA) due to stable convergence.
- Batch Size: Evaluated 16, 32, 64, with 32 balancing memory efficiency and training stability.
- GCN Threshold: Tested cosine similarity thresholds in {0.7, 0.75, 0.8, 0.85, 0.9}, with 0.85 providing the best trade-off between graph sparsity (average node degree ≈ 10) and classification accuracy.
- Diffusion Timesteps: Evaluated 10, 15, 20, 30, 50, with 15 timesteps achieving 97.89% OA on Pavia while reducing computational cost by 80% compared to 1000 timesteps used in traditional diffusion models [24].
The selected hyperparameters are summarized in Table 3. To assess robustness, a sensitivity analysis was conducted, as shown in Table 7, which reports the impact of varying GCN threshold and diffusion timesteps on OA for the University of Pavia dataset (20% labeled samples).
Table 7.
Sensitivity analysis of GCN cosine similarity threshold and diffusion timesteps on the University of Pavia dataset with 20% labeled samples (5-fold cross-validation).
Table 7 Result Analysis
The sensitivity analysis in Table 7 confirms that a GCN threshold of 0.85 maximizes OA (97.89%) by ensuring sufficient edge connectivity without introducing excessive noise, while 15 diffusion timesteps balance sample quality and computational efficiency (11.9 GFLOPs). A lower number of timesteps (e.g., 10) reduced spectral fidelity, resulting in a 1.2% OA drop, whereas higher timesteps (e.g., 50) increased computational cost (16.2 GFLOPs) without significant accuracy gains. These settings were applied consistently across all datasets for reproducibility and fair comparison with baselines.
3.2.2. Baseline Configurations
Table 8 presents the architectural configurations and computational complexity of seven baseline methods compared to TGDHTL, along with a brief description of their characteristics.
Table 8.
Baseline model configurations and hyperparameter settings used in all experiments (20% labeled samples unless otherwise noted).
Table 8 Result Analysis
Table 8 summarizes the computational complexity of TGDHTL and competing baselines. TGDHTL achieves the lowest resource requirements with only 12.4 million parameters and 11.9 GFLOPs, representing a 38–47% reduction in computational cost compared to the top-performing generative baselines (iHGAN: 28.7 M params, 22.5 GFLOPs; SDN: 34.2 M params, 19.8 GFLOPs) and Mamba models (SpiralMamba: 19 M params, 15.4 GFLOPs; HSI-Mamba: 22 M params, 16.1 GFLOPs).
This efficiency stems from several targeted design choices:
- The class-conditional DDIM operates with only 15 inference steps (vs. 20–1000 in SDN/iHGAN), drastically reducing diffusion overhead while maintaining high-fidelity augmentation.
- Multi-scale stripe partitioning in MSSA enables fine-to-coarse spectral–spatial modeling with minimal additional computation.
- The lightweight Transformer adapter (four layers, six heads) and sparse GCN (cosine threshold >0.85, k = 8) avoid the quadratic complexity of full self-attention and dense graph propagation.
In contrast, Transformer-only models (ViT, HyViT) incur significantly higher costs due to large hidden dimensions and multi-head attention, while generative baselines suffer from extensive sampling requirements. The moderate complexity of earlier methods (SSRN, GCN-HSI) comes at the expense of limited modeling capacity for global dependencies and domain shift.
Consequently, TGDHTL offers superior scalability for real-time and edge deployment on large-scale hyperspectral scenes (e.g., WHU-OHS with millions of pixels and HJ-1A satellite data), making it particularly suitable for resource-constrained operational environments.
3.2.3. Implementation Details
All experiments were conducted using PyTorch 2.1.0 on an NVIDIA RTX 3090 GPU with 24 GB memory. The AdamW optimizer [66] was used with a learning rate of , weight decay of , and a batch size of 32. The Transformer backbone followed a lightweight configuration with 6 layers, 384 hidden dimensions, and 6 attention heads. The GCN module used 3 layers with a hidden dimension of 256. The diffusion model was trained for 500 epochs with a cosine noise schedule [67]. Key hyperparameters, including the feature fusion weight and diffusion steps T, were tuned via grid search on the validation set. Specifically, was searched in the range [0.1, 0.9] with a step of 0.2, and T in the range [10, 50] with a step of 5. The final values were set to and based on optimal performance on the University of Pavia dataset. All models were trained for 200 epochs, with early stopping based on validation loss (patience of 20 epochs). Data augmentation included random flipping and rotation. Results were evaluated using five-fold cross-validation, with means and 95% confidence intervals reported.
3.2.4. Evaluation Metrics
We use standard HSI classification metrics [68,69], computed with 95% confidence intervals via five-fold cross-validation and paired t-tests () [70]. All results reported with the “±” symbol represent the mean ± 95% confidence interval unless otherwise specified. These metrics provide global and class-wise insights, particularly under low-label and imbalanced regimes:
- Overall Accuracy (OA): Proportion of correctly classified pixels:where is the number of correctly predicted pixels for class i, C is the number of classes, and N is the total number of test pixels.
- Average Accuracy (AA): Mean of per-class accuracies:where is the total number of pixels in class i.
- Kappa Coefficient (): Agreement between predicted and true labels, adjusted for chance:where and are row and column sums of the confusion matrix.
- F1-Score: Balances precision and recall for imbalanced datasets:with , .
- Spectral Angle Mapper (SAM): Evaluates spectral similarity:where are spectral vectors. Lower SAM indicates better spectral fidelity [71].
These metrics ensure robust evaluation of cross-domain generalization, spectral–spatial coherence, and class-wise discrimination. Unless otherwise specified, results are obtained using five-fold cross-validation, with 10%, 20%, or 50% of labeled samples allocated for training, 10% for validation, and the remainder for testing in each fold.
3.3. Sensitivity Analysis
To evaluate the robustness of our model to key hyperparameters, we conducted a sensitivity analysis for the feature fusion weight and the number of diffusion steps T on the University of Pavia dataset with 20% labeled samples, as shown in Table 9 and Figure 9. For , we tested values , which control the balance between Transformer and GCN features in the hybrid domain adaptation module. For T, we tested values , which determine the number of diffusion steps in the generative process. Results are reported as mean ± 95% confidence interval over five-fold cross-validation.
Table 9.
Sensitivity analysis for feature fusion weight and number of diffusion timesteps T on the University of Pavia dataset with 20% labeled samples (5-fold cross-validation).
Figure 9.
Sensitivity analysis plots for (a) feature fusion weight and (b) diffusion steps T on the University of Pavia dataset with 20% labeled samples, averaged over 5-fold cross-validation. Plots show OA and F1-Score for , and OA and SAM for T. Error bars represent 95% confidence intervals.
The results indicate that provides a balanced contribution from both Transformer and GCN features, achieving optimal OA and F1-Score. Values of below 0.3 or above 0.7 led to reduced performance, suggesting that over-reliance on either feature set degrades classification accuracy. For T, a value of 15 steps was optimal, balancing generative quality and computational efficiency. Lower values () resulted in insufficient diffusion, while higher values () increased computational cost without significant performance gains.
3.4. Comparison with State-of-the-Art Methods
TGDHTL is compared against seven baselines (Table 8) on six benchmark datasets at 10%, 20%, and 50% labeled samples, reporting OA, AA, , and GFLOPs. Table 10 present detailed results, with TGDHTL achieving top performance across all datasets. Figure 10 illustrates that TGDHTL achieves superior Overall Accuracy compared to baseline methods on the Indian Pines and University of Pavia datasets (20% labeled samples), and extends this superiority to HJ-1A and WHU-OHS.
Table 10.
Overall Accuracy (OA, %) and Kappa coefficient on all six benchmark datasets with 20% labeled samples per class (5-fold cross-validation). Best results are in bold.
Figure 10.
Bar chart comparing Overall Accuracy of TGDHTL and baseline methods on Indian Pines and University of Pavia datasets with 20% labeled samples. Similar trends observed on HJ-1A and WHU-OHS.
TGDHTL consistently outperforms baselines across all datasets, with gains of 1.2–4.4% in OA on HJ-1A and WHU-OHS, attributed to its efficient diffusion-based augmentation and cross-domain alignment. Paired t-tests confirm statistical significance () against all baselines.
3.4.1. Supervised Methods
Table 11 presents supervised classification results on the University of Pavia, HJ-1A, and WHU-OHS datasets with 20% labeled samples.
Table 11.
Comparison with recent state-of-the-art methods on University of Pavia, HJ-1A, and WHU-OHS datasets using 20% labeled samples (5-fold cross-validation). Best results are in bold.
Table 11 Result Analysis
Table 11 shows TGDHTL achieving the highest OA (97.89%, 95% CI: [97.51, 98.27]), significantly outperforming ViT (94.12%, ), HyViT (94.67%, ), iHGAN (94.34%, ), and SDN (94.45%, ). TGDHTL’s SAM of 0.11 radians indicates strong spectral fidelity, though SDN’s 0.09 radians is slightly better due to its higher diffusion timesteps, which increase computational cost (19.8 GFLOPs vs. TGDHTL’s 11.9 GFLOPs). TGDHTL’s efficiency stems from its optimized architecture, including fewer timesteps (15 vs. 20–50) and multi-scale patching.
Importantly, the Diffusion Module enhances minority class performance. For example, in the University of Pavia dataset with 20% labeled samples, TGDHTL achieves F1-Scores of 92.39% (Shadows) and 90.89% (Gravel), surpassing iHGAN (88.73% and 87.06%) and SDN (90.06% and 88.22%) by 2.3–2.7% (). This improvement is attributed to class-conditional synthetic sample generation, which strengthens representation of underrepresented classes and effectively addresses class imbalance. Similar gains are observed in WHU-OHS for urban minority classes (e.g., water bodies).
These advantages extend to large-scale datasets like WHU-OHS and HJ-1A, where TGDHTL maintains high accuracy with reduced computational overhead. Overall, these attributes position TGDHTL as ideal for real-time hyperspectral applications with constrained resources.
Table 12 compares generative models on the six benchmark datasets with 20% labeled samples.
Table 12.
Comparison with recent generative-based hyperspectral classification methods on all six benchmark datasets using 20% labeled samples (5-fold cross-validation). Best results are in bold.
Table 13 presents additional performance metrics, including F1-Score, Kappa, SAM, GFLOPs, Params, and Inference Time, averaged over six benchmark datasets with 20% labeled samples using 5-fold cross-validation.
Table 13.
Additional performance metrics (F1-Score, Kappa, SAM, GFLOPs, Params, Inference Time) averaged over the six benchmark datasets with 20% labeled samples (5-fold cross-validation). Best results are in bold.
Table 12 Result Analysis
Table 12 shows TGDHTL achieving higher OA (97.89%) and F1-Score (97.45%) than iHGAN (94.34%, 93.89%) and SDN (94.45%, 94.12%), with lower computational cost (11.9 GFLOPs vs. 22.5 and 19.8) and faster inference time (0.12 s vs. 0.20 and 0.18 s). These improvements () are due to TGDHTL’s optimized Diffusion Module and architecture, which use fewer timesteps and multi-scale patching, making it superior for resource-constrained settings, as illustrated in Figure 11. TGDHTL maintains this efficiency on large-scale datasets like WHU-OHS (96.4% OA at 11.9 GFLOPs).
Figure 11.
Overall Accuracy versus GFLOPs across six benchmark datasets (20% labeled samples), demonstrating TGDHTL’s efficiency.
3.4.2. Low-Label Regime
Table 14 presents results for the low-label regime (10% labeled samples) on the six benchmark datasets.
Table 14.
Performance comparison in the low-label regime (10% labeled samples per class) across all six benchmark datasets (5-fold cross-validation). Best results are in bold.
Table 14 Result Analysis
Table 14 and Figure 12 show TGDHTL achieving 95.67% OA (95% CI: [95.28, 96.06]), surpassing ViT (91.22%, ), HyViT (91.78%, ), and SDN (92.34%, ). The Diffusion Module’s synthetic samples improve minority class performance (e.g., 2.8% OA gain for Bare Soil in Salinas) [63], highlighting TGDHTL’s robustness in low-label regimes. This robustness extends to HJ-1A and WHU-OHS, with OA gains of 2.9% and 3.1% over SDN.
Figure 12.
Overall Accuracy versus labeled sample ratio (10–50%) for six benchmark datasets, illustrating TGDHTL’s performance trends across datasets.
As shown in Table 15, TGDHTL achieves the best performance with 95.12% AA and 0.943 Kappa, while requiring fewer GFLOPs and faster inference compared to SDN and iHGAN.
Table 15.
Additional metrics for generative-based methods in low-label regime (averaged over six datasets, 10% labeled samples). Best results are in bold.
3.5. Cross-Domain Adaptation Results
Table 16 presents OA for cross-domain adaptation with and without the feature adapter across six datasets. The font size in this table is increased for improved readability.
Table 16.
Cross-domain generalization performance with and without the proposed Transformer-based Feature Adapter (20% labeled samples, 5-fold cross-validation). Best results are in bold.
Table 17 summarizes the performance improvements achieved by the Transformer-based adapter over six benchmark datasets.
Table 17.
Adapter configuration and performance metrics compared to baseline.
Table 16 Result Analysis
Table 16 shows that the Cross-Domain Feature Adapter improves OA by 4.5–5.6% across datasets, with KSC exhibiting the largest gain (5.31%) due to its spectral complexity. On HJ-1A and WHU-OHS, the adapter yields gains of 5.11% and 4.67%, respectively, demonstrating strong generalization to large-scale and satellite-based HSI. This enhancement underscores the adapter’s ability to mitigate domain shift, enabling robust cross-domain performance.
3.6. Quantitative Results
Figure 13 presents the architectural comparison of TGDHTL with ViT [59], SSRN [29], and HyViT [13], emphasizing TGDHTL’s integrated design combining multi-scale spectral attention, Graph Convolutional Networks, and diffusion-based augmentation for superior performance and efficiency.
Figure 13.
Architectural comparison of TGDHTL–ViT [59], SSRN [29], and HyViT [13], highlighting TGDHTL’s integrated MSSA–GCN–diffusion design.
Table 18, Table 19, and Table 20 report OA across six benchmark datasets at 10%, 20%, and 50% labeled sample ratios using five-fold cross-validation for consistency.
Table 18.
Overall Accuracy (OA, %) on Indian Pines and University of Pavia datasets at different labeling ratios (5-fold cross-validation). Best results in bold.
Table 19.
Overall Accuracy (OA, %) on KSC and Salinas datasets at different labeling ratios (5-fold cross-validation). Best results in bold.
Table 20.
Overall Accuracy (OA, %) on HJ-1A and WHU-OHS datasets at different labeling ratios (5-fold cross-validation). Best results in bold.
Table 21 summarizes the comparative results under 20% labeled samples with 5-fold cross-validation.
Table 21.
Comprehensive performance metrics on HJ-1A and WHU-OHS datasets with 20% labeled samples (5-fold cross-validation). Best results are in bold.
Table 21 Result Analysis
Table 21 shows TGDHTL achieving F1-Scores of 94.80% (HJ-1A) and 96.00% (WHU-OHS), surpassing baselines by 2.5–6.5% (p < 0.01). TGDHTL’s OA (95.20% for HJ-1A, 96.40% for WHU-OHS) and Kappa (0.95 and 0.96) reflect robust performance in satellite and large-scale urban scenarios, driven by MSSA-GCN and diffusion augmentation. While SDN’s SAM (0.08 radians) is lower, TGDHTL’s 0.10 radians balances spectral fidelity with efficiency.
Table 22 provides class-wise accuracy for Indian Pines at 20% labeled samples.
Table 22.
Class-wise classification accuracy (%) on the Indian Pines dataset using TGDHTL with 20% labeled samples (5-fold cross-validation).
TGDHTL outperforms baselines by 4.1–8.2% in OA at 20% labeled samples (). For Indian Pines at 20% labeled samples, TGDHTL achieves 96.23% OA compared to HyViT’s 92.67% (). TGDHTL achieves 95.2% and 96.4% OA on HJ-1A and WHU-OHS, respectively, outperforming SDN by 1.2% and 0.9%. Table 22 highlights strong performance across all 16 classes, with minor challenges in minority classes like Oats (93.67%) and Stone-Steel-Towers (93.89%) due to limited sample counts. Classification maps, as shown in Figure 14, Figure 15, Figure 16, Figure 17, Figure 18 and Figure 19, demonstrate TGDHTL’s superior boundary delineation compared to ViT and GCN-HSI, attributed to its MSSA-GCN architecture and diffusion-based augmentation.
Figure 14.
Classification maps for Indian Pines (16 classes) using 10% labeled samples, showing improved boundary delineation by TGDHTL.
Figure 15.
Classification maps for University of Pavia (9 classes) using 10% labeled samples, highlighting TGDHTL’s superior class separation.
Figure 16.
Classification maps for Kennedy Space Center (KSC, 13 classes) using 10% labeled samples, demonstrating TGDHTL’s robustness.
Figure 17.
Classification maps for Salinas (16 classes) using 10% labeled samples, showcasing TGDHTL’s effective handling of class boundaries.
Figure 18.
Classification maps for HJ-1A (4 classes) using 10% labeled samples, showing improved boundary delineation by TGDHTL.
Figure 19.
Classification maps for WHU-OHS (32 bands) using 10% labeled samples, showing improved boundary delineation by TGDHTL.
As illustrated in Figure 15, TGDHTL achieves superior class separation compared to ViT and GCN-HSI under the 10% labeled sample setting.
As illustrated in Figure 16, TGDHTL achieves superior robustness compared to ViT and GCN-HSI under the 10% labeled sample setting.
As illustrated in Figure 17, TGDHTL demonstrates more precise handling of class boundaries compared to ViT and GCN-HSI under the 10% labeled sample setting.
As illustrated in Figure 18, TGDHTL achieves clearer boundary delineation compared to ViT and GCN-HSI under the 10% labeled sample setting.
As illustrated in Figure 19, TGDHTL achieves clearer boundary delineation compared to ViT and GCN-HSI under the 10% labeled sample setting.
Table 23 reports additional metrics for Pavia, Salinas, HJ-1A, and WHU-OHS at 20% labeled samples.
Table 23.
Comprehensive performance metrics on University of Pavia and Salinas datasets with 20% labeled samples (5-fold cross-validation). Best results are in bold.
Table 23 Result Analysis
Table 23 shows TGDHTL achieving F1-Scores of 97.45% (Pavia) and 97.67% (Salinas), surpassing baselines by 2.9–7.8% () [73]. TGDHTL’s OA (97.89% for Pavia, 98.12% for Salinas) and Kappa (0.97 for both) reflect robust performance, driven by its MSSA-GCN architecture and diffusion-based augmentation. While SDN’s SAM (0.09 radians) is lower, TGDHTL’s 0.11 radians balances spectral fidelity with lower computational cost (11.9 GFLOPs vs. 19.8). TGDHTL achieves 95.2% OA and 0.96 Kappa on HJ-1A, and 96.4% OA and 0.96 Kappa on WHU-OHS.
Table 24 quantifies the practical significance of TGDHTL’s improvements on the University of Pavia dataset (20% labeled samples) using Cohen’s d effect size:
Table 24.
Effect size (Cohen’s d) comparison for TGDHTL versus baseline methods on University of Pavia, HJ-1A, and WHU-OHS datasets with 20% labeled samples (5-fold cross-validation). All values indicate very large practical significance.
Table 24 Result Analysis
Table 24 demonstrates that TGDHTL’s improvements are not only statistically significant (p < 0.01) but also practically meaningful across all three datasets. Cohen’s d values range from 1.20 to 1.92, all exceeding the large effect threshold () [74]. The highest effect size is observed against SSRN on Pavia (), while HJ-1A and WHU-OHS show robust values of and , confirming TGDHTL’s superiority in satellite and large-scale urban HSI classification. These results validate the framework’s scalability and robustness under varying spectrals.
As illustrated in Figure 20, all Cohen’s d values exceed 1.2, confirming the large practical significance of TGDHTL’s improvements across diverse hyperspectral scenarios.
Figure 20.
Bar chart of Cohen’s d effect sizes comparing TGDHTL against baseline methods across all six benchmark datasets (20% labeled samples). All values exceed , indicating large practical significance of TGDHTL’s improvements in diverse HSI scenarios (agricultural, urban, satellite, large-scale).
As illustrated in Figure 21, TGDHTL achieves consistently high diagonal values, indicating robust classification performance across diverse hyperspectral datasets.
Figure 21.
Confusion matrices for all six datasets (Indian Pines, Pavia, Salinas, KSC, HJ-1A, WHU-OHS) using TGDHTL at 20% labeled samples, showing consistently high diagonal values and robust classification performance.
3.7. Feature Distribution Analysis
To provide a qualitative assessment of the learned feature representations and demonstrate TGDHTL’s superiority in class separability, we employ t-SNE visualizations on the University of Pavia dataset (20% labeled samples). Figure 22 compares the feature distributions for four key methods: ViT, HyViT, HSI-Mamba, and TGDHTL (ours). Each point represents a pixel’s embedded features, colored by its ground-truth class.
Figure 22.
t-SNE visualization of learned feature distributions on the University of Pavia dataset (20% labeled samples). (a) ViT, (b) HyViT, (c) HSI-Mamba, (d) TGDHTL (Ours). Each point represents a pixel, colored by ground-truth class. TGDHTL shows the most compact and separated clusters, with minimal overlap in minority classes.
As shown, ViT and HyViT (Panels a and b) exhibit considerable inter-class overlap and scattered clusters, especially for minority classes (e.g., Bitumen, Gravel, Shadows). HSI-Mamba (Panel c) shows moderate improvement but still has noticeable mixing in edge classes. In contrast, TGDHTL (Panel d) generates significantly more compact and well-separated clusters with minimal overlap, even for challenging classes (highlighted regions). This superior feature separability directly contributes to TGDHTL’s consistent accuracy gains and robustness across datasets, confirming the synergistic effect of MSSA-GCN fusion and domain-adaptive pretraining.
3.8. Efficiency
Table 25 presents efficiency metrics on the six benchmark datasets with 20% labeled samples.
Table 25.
Computational efficiency and accuracy comparison with state-of-the-art methods (20% labeled samples, averaged over all six benchmark datasets). Best results are in bold.
Table 25 Result Analysis
Table 25 shows TGDHTL achieving 97.89% OA with 11.9 GFLOPs, 35% lower than ViT (18.3 GFLOPs) and 47% lower than iHGAN (22.5 GFLOPs). Inference time for a patch is 0.12 s, 25% faster than ViT (0.16 s) [1]. The Cross-Domain Adapter (1.0 GFLOPs), MSSA (3.8 GFLOPs), and sparse GCN (3.2 GFLOPs, ) contribute to this efficiency. TGDHTL scales efficiently to large WHU-OHS patches (1024 × 1024), maintaining 0.12 s inference.
3.9. Qualitative Analysis of Classification Maps
To provide a detailed visual assessment of TGDHTL’s superiority in spatial consistency and noise reduction, Figure 23 presents zoomed-in views of three carefully selected Regions of Interest (ROIs) from the Indian Pines dataset (20% labeled samples). These ROIs were chosen based on the ground truth map and common challenges reported in hyperspectral literature to highlight boundary preservation, speckled noise reduction, and handling of minority classes:
Figure 23.
Qualitative comparison on three challenging ROIs from the Indian Pines dataset. Top row: full classification maps of top-performing baselines and TGDHTL. Bottom three rows: zoomed-in views of ROIs highlighting typical failure cases (noise, broken boundaries, misclassified minority classes) in baselines (red boxes/arrows) that are effectively resolved by TGDHTL.
- ROI1 (rows 30–90, columns 40–100; ≈60 × 60 pixels): Located in the central-lower part of the scene, focusing on complex, irregular boundaries between corn fields (Corn-notill/mintill) and soybean crops. This region is ideal for evaluatingboundary preservation and resistance to edge artifacts.
- ROI2 (rows 80–140, columns 20–80; ≈60 × 60 pixels): Covers large, relatively homogeneous soybean (Soybean-mintill/clean) and grass-pasture areas in the south-western section. It enables clear observation ofspeckled noise reduction in uniform regions.
- ROI3 (rows 0–60, columns 80–145; ≈60 × 65 pixels): Situated in the north-eastern part, containing mixed woods, corn, and man-made structures (Buildings–Grass–Trees–Drives). This heterogeneous area tests spatial consistency across small and complex classes.
As evident from Figure 23, Transformer-based baselines (ViT, HyViT) and recent Mamba models (SpiralMamba, HSI-Mamba) exhibit significant salt-and-pepper noise and fragmented boundaries, particularly in ROI1 and ROI2 (highlighted by red boxes). SDN shows moderate improvement but still contains scattered misclassifications in homogeneous areas. In contrast, TGDHTL produces markedly cleaner maps with sharp, accurate boundaries and virtually no isolated erroneous pixels across all ROIs. Quantitative analysis indicates that TGDHTL reduces speckled noise by 68–82% relative to ViT/HyViT and 31–47% relative to SpiralMamba/HSI-Mamba/SDN. These qualitative results complement the quantitative superiority reported earlier and confirm TGDHTL’s advanced spectral–spatial modeling in real-world agricultural scenarios.
3.10. Aggregated Performance Across Datasets
Table 26 reports average OA across six benchmark datasets at varying labeled sample ratios.
Table 26.
Average Overall Accuracy (OA, %) across all six benchmark datasets at different labeling ratios (10%, 20%, 50% labeled samples per class, 5-fold cross-validation). Best results are in bold.
Table 26 Result Analysis
Table 26 shows TGDHTL achieving 97.83% OA at 20% labeled samples (95% CI: [97.50, 98.16]), surpassing baselines by 4.1–8.2% (). The largest gains occur at 10% labels (95.22% vs. HyViT’s 91.45%), highlighting TGDHTL’s robustness in low-label regimes, as visualized in Figure 24. This consistency extends to HJ-1A and WHU-OHS, with TGDHTL averaging 95.8% OA at 20%.
Figure 24.
Average Overall Accuracy across six benchmark datasets for 10%, 20%, and 50% labeled samples, showing TGDHTL’s consistent superiority. A star (*) indicates statistical significance at compared to all baselines.
3.11. Cross-Domain Generalization Evaluation
To assess TGDHTL’s cross-domain generalization, we train on a source HSI dataset and evaluate on a distinct target dataset without fine-tuning, simulating real-world scenarios with unavailable target-domain labels.
Table 27 presents the cross-domain evaluation configurations, expanded to include HJ-1A and WHU-OHS.
Table 27.
Cross-domain experimental settings covering all six benchmark datasets. Source → Target transfer scenarios include diverse domain shifts (airborne → satellite, urban → agricultural, etc.).
TGDHTL is trained solely on the source domain and evaluated on the target domain’s full test split without parameter updates. Metrics include OA, AA, and Cohen’s Kappa, calculated via five-fold cross-validation.
3.11.1. Comparison with Baselines
Table 28 presents cross-domain classification results without fine-tuning.
Table 28.
Cross-domain generalization performance (OA, %) of TGDHTL and SOTA methods (20% labeled samples in target domain, no fine-tuning). Best results are in bold.
Table 28 Result Analysis
Table 28 shows TGDHTL achieving an OA of 89.57%, outperforming iHGAN (85.04%) by 4.5%, with higher AA (85.26%) and Kappa (0.86). This is driven by MMD-based feature alignment and the Cross-Domain Adapter, which mitigate domain shift. The pruned Transformer and ImageNet-pretrained ResNet backbone enhance cross-modality generalization, while the class-conditional diffusion module ensures balanced minority class representation, particularly on spectrally diverse datasets like KSC. On WHU-OHS to Salinas, TGDHTL achieves 88.2% OA, demonstrating scalability to large-scale urban-to-agricultural shifts.
3.12. Summary of Experimental Results
This subsection provides a structured summary of the experimental results, addressing key aspects of TGDHTL’s performance, as outlined below:
- Superior Classification Accuracy: TGDHTL achieves the highest OA across all six datasets (e.g., 97.89% on Pavia, 96.4% on WHU-OHS at 20% labels, Table 18 and Table 21), surpassing baselines by 3.2–8.2% (). This is driven by the synergistic integration of MSSA, GCN, and the Diffusion Module, as shown in Figure 13.
- Robustness in Low-Label Regimes: TGDHTL excels at 10% labeled samples (95.22% average OA, Table 26), with the Diffusion Module improving minority class performance (e.g., 2.8% OA gain for Bare Soil in Salinas, 3.1% for urban water in WHU-OHS).
- Component Contributions: The ablation study tabel and Figure confirms that the Diffusion Module, MSSA, GCN, and Adapter each contribute significantly, with OA drops of 1.5–2.5% when removed across all datasets.
- Academic and Practical Value: TGDHTL’s modular design, high accuracy, and efficiency make it ideal for remote sensing applications, addressing label scarcity, class imbalance, and domain shift, with reproducible results across six benchmark datasets.
These findings position TGDHTL as a state-of-the-art solution for hyperspectral image classification, with significant potential for real-world deployment and further research.
4. Discussion
The experimental results demonstrate that TGDHTL significantly advances hyperspectral image (HSI) classification, achieving 4.1–8.2% higher Overall Accuracy (OA) than state-of-the-art methods like ViT [59] and HyViT [13] across six benchmark datasets including HJ-1A and WHU-OHS (Table 26). This performance is driven by three key innovations: Multi-Scale Stripe Attention (MSSA), class-conditional diffusion augmentation, and Graph Convolutional Networks (GCNs), validated in the ablation study.
Data Efficiency. The Diffusion Module reduces labeled data requirements by 25%, enabling 95.67% OA on University of Pavia and 94.5% on WHU-OHS with only 10% labeled samples (Table 18 and Table 21). This is critical for real-world applications where labeled HSI data are scarce, such as precision agriculture [1]. The module’s allocation of 30% synthetic samples to minority classes (e.g., Shadows in Pavia, water bodies in WHU-OHS, Table 11) improves their OA by 2.5%, addressing class imbalance effectively compared to iHGAN [18] and SDN [75] (Table 12).
Generalization to Real-World Data.The robust performance of TGDHTL on benchmark datasets (e.g., Indian Pines, University of Pavia, HJ-1A, WHU-OHS) suggests strong potential for generalization to real-world hyperspectral datasets, such as Sentinel-2, AVIRIS, and HJ-1A satellite data. Sentinel-2, with its 13 broad spectral bands and 10–60 m spatial resolution, is widely used for large-scale environmental monitoring, while AVIRIS, with 224 narrow bands and ~20 m resolution, supports fine-grained material identification [1]. HJ-1A, with 115 bands and 100 m resolution, bridges satellite-scale monitoring. TGDHTL’s Multi-Scale Stripe Attention (MSSA) can adapt to varying spectral resolutions by capturing both local and global dependencies, making it suitable for Sentinel-2’s coarser spectral data, AVIRIS’s high-dimensional inputs, and HJ-1A’s moderate spectral-spatial scale. The Cross-Domain Feature Adapter further enhances generalization by aligning pretrained RGB features with diverse HSI domains, potentially mitigating domain shifts in real-world data. The Diffusion Module’s ability to generate class-balanced synthetic samples could address label scarcity in operational settings, such as Sentinel-2-based crop monitoring, HJ-1A-based land cover mapping, or AVIRIS-based mineral mapping. However, challenges like band-specific noise in AVIRIS or the limited spectral resolution of Sentinel-2 may require additional preprocessing, such as band selection or super-resolution techniques, to fully leverage TGDHTL’s capabilities. These adaptations are critical for deploying TGDHTL in practical applications like disaster response and precision agriculture.
Computational Efficiency. TGDHTL reduces computational complexity by 20% compared to ViT (11.9 vs. 18.3 GFLOPs, Table 25), driven by the pruned transformer in the Cross-Domain Adapter [42] and MSSA’s efficient attention mechanism [12]. Figure 11 illustrates TGDHTL’s superior accuracy–efficiency trade-off, making it suitable for deployment on resource-constrained platforms like edge devices in disaster response [31]. The 0.12 s inference time per patch supports real-time processing, unlike iHGAN’s 0.20 s [18]. TGDHTL maintains efficiency on large WHU-OHS patches (1024 × 1024), with no increase in GFLOPs. Recent works on diffusion models [3,24] and spatial–spectral feature extraction [25] highlight the computational challenges in hyperspectral image classification, which TGDHTL addresses through its optimized architecture. Practical Significance of Improvements. Beyond statistical superiority, TGDHTL’s performance gains are practically meaningful, as quantified by Cohen’s d effect sizes (Table 24). Figure 20 visualizes these effect sizes across University of Pavia, HJ-1A, and WHU-OHS, showing consistently large effects () against all baselines. The strongest impact is observed against SSRN ( on average), confirming that TGDHTL’s innovations—MSSA, diffusion augmentation, and domain adaptation—translate into substantial real-world benefits, particularly in challenging satellite and large-scale urban HSI classification tasks. Limitations. Despite its advantages, TGDHTL faces challenges. The GCN’s scalability is limited by graph construction complexity for large datasets (e.g., WHU-OHS, 1024 × 1024), increasing preprocessing time by 15% compared to ViT. The Diffusion Module’s 2.4 h generation time for 5000 samples, while faster than SDN (14.2 h), remains a bottleneck for rapid deployment. Additionally, performance on minority classes, while improved, still lags behind majority classes by 1.5–2.0% OA due to inherent data imbalances (Table 11).
Implications and Future Work.TGDHTL’s integration of MSSA, diffusion augmentation, and GCNs sets a new benchmark for HSI classification, particularly in low-label scenarios. Its applications extend to environmental monitoring, urban planning, and disaster response, where data efficiency is paramount [76]. Future work, as outlined in the Conclusion (Section 5), will explore adaptive graph pruning to enhance GCN scalability and optimize diffusion sampling to reduce generation time, potentially leveraging recent advances in denoising techniques [5,77]. Figure 14, Figure 15, Figure 16, Figure 17, Figure 18 and Figure 19 and Figure 21 further confirm the robustness of TGDHTL’s classification, as evidenced by sharp class boundaries and high diagonal values in the confusion matrix.
Ablation Study
Table 29 evaluates TGDHTL’s components on the University of Pavia, HJ-1A, and WHU-OHS datasets with 20% labeled samples, with results visualized in Figure 25.
Table 29.
Ablation study of TGDHTL components on University of Pavia, HJ-1A, and WHU-OHS datasets with 20% labeled samples (5-fold cross-validation). Best results in bold.
Figure 25.
Ablation study on the six benchmark datasets (20% labeled samples), illustrating the contribution of each component to TGDHTL’s performance.
Table 29 Result Analysis
Table 29 shows that removing the Diffusion Module reduces OA by 2.5% (97.89% to 95.39%, ), MSSA by 1.8% (96.09%, ), GCN by 1.5% (96.39%, ), and Cross-Domain Adapter by 2.0% (95.89%, ). The full model achieves 97.89% OA and 0.11 radians SAM at 11.9 GFLOPs, demonstrating the synergistic contribution of all components. On WHU-OHS, removing the Diffusion Module drops OA from 96.4% to 94.5%, underscoring its role in large-scale urban HSI.
5. Conclusions
This study introduces TGDHTL (Transformer-based Hyperspectral Transfer Learning), a novel framework for hyperspectral image (HSI) classification that effectively addresses the challenges of high-dimensional data, limited labeled samples, and computational complexity. By integrating Multi-Scale Stripe Attention (MSSA), class-conditional diffusion augmentation, and Graph Convolutional Networks (GCNs), TGDHTL delivers superior classification performance compared to existing methods. The MSSA-GCN fusion captures multi-scale spectral-spatial dependencies, enhancing accuracy across six diverse datasets. The diffusion-based augmentation generates high-fidelity synthetic samples, improving data efficiency, particularly for minority classes. Additionally, the cross-domain adaptation aligns RGB and HSI domains, enabling robust transfer learning. These components collectively position TGDHTL as an efficient and scalable solution for applications such as precision agriculture, environmental monitoring, and disaster response. The consistent large effect sizes (Figure 20) validate TGDHTL’s real-world deployability.
Future research will focus on enhancing TGDHTL’s capabilities by optimizing diffusion sampling to reduce generation time, improving GCN scalability through adaptive graph pruning, and exploring the integration of multi-modal data, such as LiDAR and SAR, to further boost classification accuracy in complex environments. Validation on real-world satellite data (e.g., HJ-1A, WHU-OHS) and large-scale urban scenes will be a key direction. These advancements will strengthen TGDHTL’s applicability to emerging challenges in remote sensing and environmental science.
Author Contributions
Conceptualization, Z.M. and A.K.; Methodology, Z.M., A.K. and G.F.; Software, Z.M. and G.F.; Validation, Z.M., N.A. and A.K.; Formal analysis, A.A. and M.A.D.; Investigation, N.A. and A.A.; Resources, G.F., A.A. and M.A.D.; Data curation, A.A.; Writing—original draft, Z.M. and G.F.; Writing—review & editing, N.A., A.K., A.A. and M.A.D.; Visualization, G.F.; Supervision, A.K.; Project administration, A.K.; Funding acquisition, N.A., A.A. and M.A.D. All authors have read and agreed to the published version of the manuscript.
Funding
The authors disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This work was supported by the Deanship of Scientific Research (DSR) at King Abdulaziz University, Jeddah (grant number IPP: 1308-830-2025).
Data Availability Statement
The datasets used in this study are publicly available as follows:—Indian Pines: https://www.kaggle.com/datasets/abhijeetgo/indian-pines-hyperspectral-dataset (accessed on 1 November 2025), —Salinas: https://www.kaggle.com/code/ardaorcun/salinas-hsi (accessed on 1 November 2025), —University of Pavia: https://www.kaggle.com/datasets/syamkakarla/pavia-university-hsi (accessed on 1 November 2025), —Kennedy Space Center (KSC): https://www.kaggle.com/datasets/samyabose/kennedy-space-center (accessed on 1 November 2025), —HJ-1A: https://space.oscar.wmo.int/satellites/view/hj_1a (accessed on 1 November 2025), —WHU-OHS: https://github.com/zjjerica/WHU-OHS-Pytorch (accessed on 1 November 2025). The source code for the TGDHTL framework can be obtained from the corresponding author upon reasonable request.
Acknowledgments
This project was funded by the Deanship of Scientific Research (DSR) at King Abdulaziz University, Jeddah, Saudi Arabia under grant no. (IPP: 1308-830-2025). The authors, therefore, acknowledge with thanks DSR for technical and financial support.
Conflicts of Interest
The authors declare no conflicts of interest.
Appendix A. Visualization of Class Imbalance
To illustrate the class imbalance in the University of Pavia and WHU-OHS datasets, Figure A1 presents a bar chart of per-class labeled sample counts, complementing Table 4. The significant disparity between classes like Meadows (18,649 samples) and Shadows (947 samples) in Pavia and urban buildings vs. water bodies in WHU-OHS highlights the need for class-conditional augmentation in TGDHTL.
Figure A1.
Barchart of per-class labeled sample counts for University of Pavia and WHU-OHS, highlighting class imbalance (e.g., Meadows vs. Shadows, urban vs. water).
References
- Gao, L.; Yang, C.; Feng, Y.; Xin, J.; Zhu, H. Multi-Domain Adaptive Unsupervised Learning for Cross-Scene Hyperspectral Image Classification Based on a Generative Network. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2025, 18, 21635–21652. [Google Scholar] [CrossRef] [Scilit]
- Sen, S.; Bhambu, P.; Kumar, R.S. Remote monitoring of nutrient stress in agricultural crops using hyperspectral image analysis. In Proceedings of the 15th International Conference on Computing Communication and Networking Technologies (ICCCNT), New Delhi, India, 18–22 June 2024; pp. 1–6. [Google Scholar]
- Deng, K.; Qian, Y.; Nie, J.; Zhou, J. Diffusion-model-based hyperspectral unmixing using spectral prior distribution. IEEE Trans. Geosci. Remote Sens. 2024, 62, 5519716. [Google Scholar] [CrossRef] [Scilit]
- Garavand, A.; Salehnasab, C.; Behmanesh, A.; Aslani, N.; Zadeh, A.H.; Ghaderzadeh, M. Efficient model for coronary artery disease diagnosis: A comparative study of several machine learning algorithms. J. Healthc. Eng. 2022, 2022, 5359540. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Yin, T.; Gharbi, M.; Park, T.; Zhang, R.; Shechtman, E.; Durand, F.; Freeman, B. Improved distribution matching distillation for fast image synthesis. Adv. Neural Inf. Process. Syst. 2024, 37, 47455–47487. [Google Scholar]
- Wang, Z.; Zhao, Z.; Yin, C. Fine crop classification based on UAV hyperspectral images and random forest. ISPRS Int. J. Geo-Inf. 2022, 11, 252:1–252:15. [Google Scholar] [CrossRef] [Scilit]
- Baumgardner, M.F.; Biehl, L.L.; Landgrebe, D.A. 220 Band AVIRIS Hyperspectral Image Data Set: June 12, 1992 Indian Pines Test Site 3. Purdue University Research Repository, 2015. Available online: https://purr.purdue.edu/publications/1947/about/1#citethis (accessed on 1 November 2025).
- Plaza, A.; Benediktsson, J.A.; Boardman, J.W.; Brazile, J.; Bruzzone, L.; Camps-Valls, G.; Chanussot, J.; Fauvel, M.; Gamba, P.; Gualtieri, A.; et al. Recent advances in techniques for hyperspectral image processing. Remote Sens. Environ. 2009, 113, S110–S122. [Google Scholar] [CrossRef] [Scilit]
- Sheykhmousa, M.; Mahdianpari, M.; Ghanbari, H.; Mohammadimanesh, F.; Ghamisi, P.; Homayouni, S. Support vector machine versus random forest for remote sensing image classification: A meta-analysis and systematic review. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2020, 13, 6308–6325. [Google Scholar] [CrossRef] [Scilit]
- Li, Y.; Wu, J.; Zhong, B.; Shi, X.; Xu, K.; Ao, K.; Sun, B.; Ding, X.; Wang, X.; Liu, Q.; et al. Methods of sandy land detection in a sparse-vegetation scene based on the fusion of HJ-2A hyperspectral and GF-3 SAR data. Remote Sens. 2022, 14, 1203. [Google Scholar] [CrossRef] [Scilit]
- Bai, H.; Xu, T.; Chen, H.; Liu, P.; Li, J. Content-driven magnitude-derivative spectrum complementary learning for hyperspectral image classification. IEEE Trans. Geosci. Remote Sens. 2024, 62, 5524914. [Google Scholar] [CrossRef] [Scilit]
- Hong, D.; Han, Z.; Yao, J.; Gao, L.; Zhang, B.; Plaza, A.; Chanussot, J. SpectralFormer: Rethinking hyperspectral image classification with transformers. IEEE Trans. Geosci. Remote Sens. 2021, 60, 5518615. [Google Scholar] [CrossRef] [Scilit]
- Yang, J.; Du, B.; Wu, C. Hybrid vision transformer model for hyperspectral image classification. In Proceedings of the IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Kuala Lumpur, Malaysia, 17–22 July 2022; pp. 1388–1391. [Google Scholar]
- Liu, S.; Li, H.; Jiang, C.; Feng, J. Spectral-spatial graph convolutional network with dynamic-synchronized multiscale features for few-shot hyperspectral image classification. Remote Sens. 2024, 16, 895:1–895:20. [Google Scholar] [CrossRef] [Scilit]
- Gong, H.; Farooque, G.; Khader, A.; Xiao, L. Multiscale semantic alignment graph convolution network for single-shot learning based hyperspectral image classification. In Proceedings of the 14th International Conference on Graphic and Image Processing (ICGIP), Nanjing, China, 21–23 October 2022; Volume 12705, pp. 462–473. [Google Scholar]
- Ye, Z.; Wang, J.; Liu, H.; Zhang, Y.; Li, W. Adaptive domain-adversarial few-shot learning for cross-domain hyperspectral image classification. IEEE Trans. Geosci. Remote Sens. 2023, 61, 5532017. [Google Scholar] [CrossRef] [Scilit]
- Wu, G.; Al-qaness, M.A.A.; Al-Alimi, D.; Dahou, A.; Elaziz, M.A.; Ewees, A.A. Hyperspectral image classification using graph convolutional network: A comprehensive review. Expert Syst. Appl. 2024, 257, 125106:1–125106:15. [Google Scholar] [CrossRef] [Scilit]
- Yu, Z.; Cui, W. Robust hyperspectral image classification using generative adversarial networks. Inf. Sci. 2024, 666, 120452:1–120452:15. [Google Scholar] [CrossRef] [Scilit]
- Yu, Y.; Pan, E.; Ma, Y.; Mei, X.; Chen, Q.; Ma, J. UnmixDiff: Unmixing-based diffusion model for hyperspectral image synthesis. IEEE Trans. Geosci. Remote Sens. 2024, 62, 5524018. [Google Scholar] [CrossRef] [Scilit]
- Mandal, D.J.; Pedersen, M.; George, S.; Boust, C. Comparison of pigment classification algorithms on non-flat surfaces using hyperspectral imaging. J. Imaging Sci. Technol. 2023, 67, 010401:1–010401:25. [Google Scholar] [CrossRef] [Scilit]
- Khader, A.; Xiao, L.; Yang, J. A model-guided deep convolutional sparse coding network for hyperspectral and multispectral image fusion. Int. J. Remote Sens. 2022, 43, 2268–2295. [Google Scholar] [CrossRef] [Scilit]
- Ma, L.; Liu, Y.; Zhang, X.; Ye, Y.; Yin, G.; Johnson, B.A. Deep learning in remote sensing applications: A meta-analysis and review. ISPRS J. Photogramm. Remote Sens. 2019, 152, 166–177. [Google Scholar] [CrossRef] [Scilit]
- Kumar, C.; Walton, G.; Santi, P.; Luza, C. Random Cross-Validation Produces Biased Assessment of Machine Learning Performance in Regional Landslide Susceptibility Prediction. Remote Sens. 2025, 17, 213. [Google Scholar] [CrossRef] [Scilit]
- Chen, N.; Yue, J.; Fang, L.; Xia, S. SpectralDiff: A generative framework for hyperspectral image classification with diffusion models. IEEE Trans. Geosci. Remote Sens. 2023, 61, 5522416. [Google Scholar] [CrossRef] [Scilit]
- Tang, X.; Yao, Y.; Ma, J.; Zhang, X.; Yang, Y.; Wang, B.; Jiao, L. SpiralMamba: Spatial-Spectral Complementary Mamba with Spatial Spiral Scan for Hyperspectral Image Classification. IEEE Trans. Geosci. Remote Sens. 2025, 63, 5510319. [Google Scholar] [CrossRef] [Scilit]
- Zhang, Z.; Huang, L.; Wang, Q.; Jiang, L.; Qi, Y.; Wang, S.; Shen, T.; Tang, B.H.; Gu, Y. UAV hyperspectral remote sensing image classification: A systematic review. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2024, 17, 3099–3124. [Google Scholar] [CrossRef] [Scilit]
- Zhao, X.; Li, S.; Geng, T.; Wang, X. GTransCD: Graph transformer-guided multitemporal information united framework for hyperspectral image change detection. IEEE Trans. Geosci. Remote Sens. 2023, 62, 5500313. [Google Scholar] [CrossRef] [Scilit]
- Bioucas-Dias, J.M.; Plaza, A.; Camps-Valls, G.; Scheunders, P.; Nasrabadi, N.M.; Chanussot, J. Hyperspectral Remote Sensing Data Analysis and Future Challenges. IEEE Geosci. Remote Sens. Mag. 2013, 1, 6–36. [Google Scholar] [CrossRef] [Scilit]
- Zhong, Z.; Li, J.; Luo, Z.; Chapman, M. Spectral-spatial residual network for hyperspectral image classification: A 3-D deep learning framework. IEEE Trans. Geosci. Remote Sens. 2017, 56, 847–858. [Google Scholar] [CrossRef] [Scilit]
- Li, M.; Fu, Y.; Zhang, T.; Liu, J.; Dou, D.; Yan, C.; Zhang, Y. Latent diffusion enhanced rectangle transformer for hyperspectral image restoration. IEEE Trans. Pattern Anal. Mach. Intell. 2024, 46, 549–564. [Google Scholar] [CrossRef] [Scilit]
- Li, N.; Wang, Z.; Cheikh, F.A. Discriminating spectral-spatial feature extraction for hyperspectral image classification: A review. Sensors 2024, 24, 2987:1–2987:20. [Google Scholar] [CrossRef] [Scilit]
- Zhang, L.; Zhang, L.; Du, B. Deep learning for remote sensing data: A technical tutorial on the state of the art. IEEE Geosci. Remote Sens. Mag. 2016, 4, 22–40. [Google Scholar] [CrossRef] [Scilit]
- Huang, S.; Xiao, W.; Chen, H.; Bejo, S.K.; Zhang, H. Hyperspectral image classification based on a locally enhanced transformer network. IEEE Trans. Geosci. Remote Sens. 2025; to be published.
- Hong, D.; Han, Z.; Yao, J.; Gao, L.; Zhang, B.; Plaza, A.; Chanussot, J. More Diverse Means Better: Multimodal Deep Learning Meets Remote-Sensing Imagery Classification. IEEE Trans. Geosci. Remote Sens. 2021, 59, 4340–4354. [Google Scholar] [CrossRef] [Scilit]
- Alsadik, B.; Ellsäßer, F.; Awawdeh, M.; Al-Rawabdeh, A.; Almahasneh, L.; Elberink, S.; Abuhamoor, D.; Asmar, Y. Remote sensing technologies using UAVs for pest and disease monitoring: A review centered on date palm trees. Remote Sens. 2024, 16, 4371. [Google Scholar] [CrossRef] [Scilit]
- Hong, D.; Gao, L.; Yao, J.; Zhang, B.; Plaza, A.; Chanussot, J. Graph convolutional networks for hyperspectral image classification. IEEE Trans. Geosci. Remote Sens. 2020, 59, 5966–5978. [Google Scholar] [CrossRef] [Scilit]
- Aleissaee, A.A.; Kumar, A.; Anwer, R.M.; Khan, S.; Cholakkal, H.; Xia, G.S.; Khan, F.S. Transformers in Remote Sensing: A Survey. Remote Sens. 2023, 15, 1860. [Google Scholar] [CrossRef] [Scilit]
- Wang, M.; Zhou, C.; Shi, J.; Lin, F.; Li, Y.; Hu, Y.; Zhang, X. Inversion of Water Quality Parameters from UAV Hyperspectral Data Based on Intelligent Algorithm Optimized Backpropagation Neural Networks of a Small Rural River. Remote Sens. 2025, 17, 119. [Google Scholar] [CrossRef] [Scilit]
- Wu, Y.; Jiao, L.; Liu, X.; Liu, F.; Yang, S.; Li, L. Domain adaptation-aware transformer for hyperspectral object tracking. IEEE Trans. Circuits Syst. Video Technol. 2024, 34, 8041–8052. [Google Scholar] [CrossRef] [Scilit]
- Zhou, L.; Ma, L. Extreme learning machine-based heterogeneous domain adaptation for classification of hyperspectral images. IEEE Geosci. Remote Sens. Lett. 2019, 16, 1781–1785. [Google Scholar] [CrossRef] [Scilit]
- Tuia, D.; Persello, C.; Bruzzone, L. Domain adaptation for the classification of remote sensing data: An overview of recent advances. IEEE Geosci. Remote Sens. Mag. 2016, 4, 41–57. [Google Scholar] [CrossRef] [Scilit]
- Pokale, K.; Chaudhri, S.N. Transfer learning and domain adaptation in hyperspectral image processing: An overview. In Proceedings of the International Conference on Machine Learning and Autonomous Systems (ICMLAS), Chennai, India, 10–12 March 2025; pp. 1208–1213. [Google Scholar]
- He, K.; Chen, X.; Xie, S.; Li, Y.; Dollár, P.; Girshick, R. Masked autoencoders are scalable vision learners. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA, 19–24 June 2022; pp. 16000–16009. [Google Scholar]
- Huang, L.; Chen, Y.; He, X. Spectral-spatial masked transformer with supervised and contrastive learning for hyperspectral image classification. IEEE Trans. Geosci. Remote Sens. 2023, 61, 5508718. [Google Scholar] [CrossRef] [Scilit]
- Shao, H.; Liu, C.; Xie, F.; Li, C.; Wang, J. Noise-sensitivity analysis and improvement of automatic retrieval of temperature and emissivity using spectral smoothness. Remote Sens. 2020, 12, 2295:1–2295:20. [Google Scholar] [CrossRef] [Scilit]
- Gong, Z.; Zhou, X.; Yao, W. MultiScale spectral-spatial convolutional transformer for hyperspectral image classification. IET Image Process. 2024, 18, 4328–4340. [Google Scholar] [CrossRef] [Scilit]
- Liu, H.; Li, W.; Xia, X.G.; Zhang, M.; Gao, C.Z.; Tao, R. Central attention network for hyperspectral imagery classification. IEEE Trans. Neural Netw. Learn. Syst. 2022, 34, 8989–9003. [Google Scholar] [CrossRef] [Scilit]
- Liao, J.; Wang, L. HyperspectralMamba: A novel state space model architecture for hyperspectral image classification. Remote Sens. 2025, 17, 2577. [Google Scholar] [CrossRef] [Scilit]
- Liu, H.; Li, W.; Xia, X.G.; Zhang, M.; Guo, Z.; Song, L. Seghsi: Semantic segmentation of hyperspectral images with limited labeled pixels. IEEE Trans. Image Process. 2024, 33, 6469–6482. [Google Scholar] [CrossRef] [Scilit]
- Liu, X.; Ng, A.H.M.; Lei, F.; Ren, J.; Liao, X.; Ge, L. Hyperspectral image classification using a multi-scale CNN architecture with asymmetric convolutions from small to large kernels. Remote Sens. 2025, 17, 1461. [Google Scholar] [CrossRef] [Scilit]
- Liu, L.; Chen, B.; Chen, H.; Zou, Z.; Shi, Z. Diverse hyperspectral remote sensing image synthesis with diffusion models. IEEE Trans. Geosci. Remote Sens. 2023, 61, 553261. [Google Scholar] [CrossRef] [Scilit]
- Wang, Z.; Zhao, S.; Zhao, G.; Song, X. Dual-branch domain adaptation few-shot learning for hyperspectral image classification. IEEE Trans. Geosci. Remote Sens. 2024, 62, 5506116. [Google Scholar] [CrossRef] [Scilit]
- Song, J.; Meng, C.; Ermon, S. Denoising diffusion implicit models. arXiv 2020, arXiv:2010.02502. [Google Scholar]
- Hu, X.; Liu, X.; Duan, Q.; Hong, D.; Zhang, D. Diffusion Model in Hyperspectral Image Processing and Analysis: A Review. arXiv 2025, arXiv:2505.11158. [Google Scholar] [CrossRef] [Scilit]
- Ahmad, M.; Butt, M.H.F.; Mazzara, M.; Distefano, S.; Khan, A.M.; Altuwaijri, H.A. Pyramid hierarchical spatial-spectral transformer for hyperspectral image classification. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2024, 17, 17681–17689. [Google Scholar] [CrossRef] [Scilit]
- Uddin, M.P.; Mamun, M.A.; Afjal, M.I.; Hossain, M.A. Information-theoretic feature selection with segmentation-based folded principal component analysis (PCA) for hyperspectral image classification. Int. J. Remote Sens. 2021, 42, 286–321. [Google Scholar] [CrossRef] [Scilit]
- Ahmad, M.; Mazzara, M.; Distefano, S.; Khan, A.M.; Wu, X. Self-supervised spatial-spectral transformer with Extreme Learning Machine for Hyperspectral Image Classification. Int. J. Remote Sens. 2025, 46, 5384–5407. [Google Scholar] [CrossRef] [Scilit]
- Deng, J.; Dong, W.; Socher, R.; Li, L.J.; Li, K.; Fei-Fei, L. ImageNet: A large-scale hierarchical image database. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA, 20–25 June 2009; pp. 248–255. [Google Scholar]
- Dosovitskiy, A.; Beyer, L.; Kolesnikov, A.; Weissenborn, D.; Zhai, X.; Unterthiner, T.; Dehghani, M.; Minderer, M.; Heigold, G.; Gelly, S.; et al. An image is worth 16x16 words: Transformers for image recognition at scale. arXiv 2020, arXiv:2010.11929. [Google Scholar]
- Sigger, N.; Vien, Q.T.; Nguyen, S.V.; Tozzi, G.; Nguyen, T.T. Unveiling the potential of diffusion model-based framework with transformer for hyperspectral image classification. Sci. Rep. 2024, 14, 8438. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Ding, C. Diffusion-Augmented Cross-Domain Prototypical Learning for Hyperspectral Image Classification. IEEE Trans. Geosci. Remote Sens. 2025, 63, S4804D. [Google Scholar] [CrossRef] [Scilit]
- Ge, Z.Z.; Ding, Z.; Wang, Y.; Bian, L.F.; Yang, C. Spectral domain strategies for hyperspectral super-resolution: Transfer learning and channel enhance network. Int. J. Appl. Earth Obs. Geoinf. 2024, 134, 104180. [Google Scholar] [CrossRef] [Scilit]
- Shi, Y.; Cui, H.; Yin, Y.; Song, H.; Li, Y.; Gamba, P. Transfer learning with nonlinear spectral synthesis for hyperspectral target detection. IEEE Trans. Geosci. Remote Sens. 2023, 61, 5532517. [Google Scholar] [CrossRef] [Scilit]
- Min, D.; Zhao, J.; Bodner, G.; Ali, M.; Li, F.; Zhang, X.; Rewald, B. Early decay detection in fruit by hyperspectral imaging—Principles and application potential. Food Control 2023, 152, 109830:1–109830:15. [Google Scholar] [CrossRef] [Scilit]
- Wang, Y.; Liu, L.; Xiao, J.; Yu, D.; Tao, Y.; Zhang, W. MambaHSI+: Multidirectional State Propagation for Efficient Hyperspectral Image Classification. IEEE Trans. Geosci. Remote Sens. 2025, 63, 4411414. [Google Scholar] [CrossRef] [Scilit]
- Loshchilov, I.; Hutter, F. Decoupled weight decay regularization. arXiv 2017, arXiv:1711.05101. [Google Scholar]
- Nichol, A.Q.; Dhariwal, P. Improved Denoising Diffusion Probabilistic Models. In Proceedings of the 38th International Conference on Machine Learning (ICML), Virtual Conference, 18–24 July 2021; PMLR, 2021; pp. 8162–8171. [Google Scholar]
- Islam, M.R.; Ahmed, B.; Hossain, M.A.; Uddin, M.P. Mutual information-driven feature reduction for hyperspectral image classification. Sensors 2023, 23, 657:1–657:20. [Google Scholar] [CrossRef] [Scilit]
- Congalton, R.G.; Green, K. Assessing the Accuracy of Remotely Sensed Data: Principles and Practices; CRC Press: Boca Raton, FL, USA, 2019. [Google Scholar]
- Pedregosa, F.; Varoquaux, G.; Gramfort, A.; Michel, V.; Thirion, B.; Grisel, O.; Blondel, M.; Prettenhofer, P.; Weiss, R.; Dubourg, V.; et al. Scikit-learn: Machine learning in Python. J. Mach. Learn. Res. 2011, 12, 2825–2830. [Google Scholar]
- Yuhas, R.H.; Goetz, A.F.H.; Boardman, J.W. Discrimination among semi-arid landscape endmembers using the spectral angle mapper (SAM) algorithm. In Proceedings of the 3rd Annual JPL Airborne Geoscience Workshop, Pasadena, CA, USA, 1–5 June 1992; pp. 147–149. [Google Scholar]
- He, Y.; Tu, B.; Liu, B.; Li, J.; Plaza, A. HSI-MFormer: Integrating Mamba and Transformer Experts for Hyperspectral Image Classification. IEEE Trans. Geosci. Remote Sens. 2025, 63, 5621916. [Google Scholar] [CrossRef] [Scilit]
- Ram, B.G.; Oduor, P.; Igathinathane, C.; Howatt, K.; Sun, X. A systematic review of hyperspectral imaging in precision agriculture: Analysis of its current state and future prospects. Comput. Electron. Agric. 2024, 222, 109037:1–109037:15. [Google Scholar] [CrossRef] [Scilit]
- Cohen, J. Statistical Power Analysis for the Behavioral Sciences, 2nd ed.; Routledge: New York, NY, USA, 2013. [Google Scholar]
- Zhang, Z.; Feng, H.; Zhang, C.; Ma, Q.; Li, Y. S2DCN: Spectral–Spatial Difference Convolution Network for Hyperspectral Image Classification. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2024, 17, 3053–3068. [Google Scholar] [CrossRef] [Scilit]
- Kucharczyk, M.; Hugenholtz, C.H. Remote sensing of natural hazard-related disasters with small drones: Global trends, biases, and research opportunities. Remote Sens. Environ. 2021, 264, 112577:1–112577:15. [Google Scholar] [CrossRef] [Scilit]
- Zhang, J.; Sun, Z.; Wang, K.; Wang, C.; Cheng, S.; Jiang, Y.; Bai, Q. Prognosis prediction based on liver histopathological image via graph deep learning and transformer. Appl. Soft Comput. 2024, 161, 111653:1–111653:15. [Google Scholar] [CrossRef] [Scilit]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.

























