When Lie Groups Meet Hyperspectral Images: Equivariant Manifold Network for Few-Shot HSI Classification
Highlights
- We propose EMNet, a Lie-group-guided framework that explicitly encodes geometric invariance for few-shot hyperspectral image classification, consisting of an SE(2)-based equivariance-guided module and an affine Lie-group feature-filtering convolution.
- Experiments on standard datasets (WHU-Hi-HongHu, Houston2013, Indian Pines) and real-world scenes (OHID-1, large-scale Xiongan New Area scene) show EMNet achieves consistent accuracy and robustness improvement over the DGPF-RENet baseline, with up to +3.34% OA, +6.01% AA, +4.14% Kappa under low-shot protocols, and +8.99% OA, +13.25% Kappa under 1% labeled-sample protocol.
- The proposed Lie-group-based framework effectively improves robustness to common geometric transformations, reducing feature drift and class confusion in complex agricultural and urban hyperspectral scenes.
- This work validates the strong generalization and scalability of EMNet under pronounced distribution shift and extreme long-tail class imbalance, providing an effective solution for few-shot hyperspectral image classification in real-world scarce-label scenarios.
Abstract
1. Introduction
- Problem-driven few-shot framework with hierarchical geometric robustness: Few-shot HSI classification is mainly challenged by (i) rigid pose variations (rotation/translation) under limited supervision and (ii) stronger affine deformations (scaling/shearing) that amplify spectral inconsistency and class entanglement. EMNet addresses both factors in a unified Lie-group framework: it enforces SE(2) equivariance for rigid motions and applies affine-aware feature refinement to accommodate scaling and shearing, yielding more stable and discriminative representations under few-shot supervision.
- First explicit Lie-group geometric paradigm for small-sample HSI: We introduce a Lie-group- and manifold-based mathematical modeling paradigm for few-shot HSI classification, moving beyond purely Euclidean assumptions and offering an interpretable geometric foundation for designing spectral–spatial learning operators.
- Strong empirical evidence on three benchmarks: Extensive experiments on WHU-Hi-HongHu, Houston2013, and Indian Pines under small-sample protocols consistently verify the effectiveness of EMNet, delivering improvements of up to +3.34% OA, +6.01% AA, and +4.14% Kappa over the strong DGPF-RENet baseline. Additional evaluations on OHID-1 and the large-scale Xiongan New Area dataset further confirm cross-scene generalization under strong distribution shift and extreme long-tail class imbalance, with clear gains under the 1% protocol on both datasets (e.g., Xiongan: 85.89% → 93.77%, +7.88% OA).
2. Related Work
2.1. Mathematical Modeling in Computer Vision: Progress and Limitations
2.2. Hyperspectral Image Classification
3. Methods
3.1. Overview of EMNet
3.2. Equivariance-Guided Module
3.3. Characteristic Filtering Convolution
4. Experiments
4.1. Experimental Environment
4.2. Data Description
4.2.1. WHU-Hi-HongHu
4.2.2. Houston2013
4.2.3. Indian Pines
4.3. Evaluation Metrics
4.4. Comparative Experiments
4.5. Experiment on Large-Scale Urban Scene Data
4.5.1. Motivation and Newly Introduced Datasets
4.5.2. Experimental Protocol
4.5.3. Experimental Results and Discussion
4.5.4. Per-Class Results
4.6. Statistical Analysis
4.6.1. Q-Statistic-Based Difference Analysis
4.6.2. Friedman Test and Nemenyi Post Hoc Analysis
4.6.3. Confidence Interval and Effect Size Analysis
4.7. Ablation Studies
4.7.1. Overall Ablation
4.7.2. Effectiveness of the Equivariant Guidance Module
4.7.3. Effectiveness of the Characteristic Filtering Convolution
5. Additional Robustness Analysis and Conclusions
5.1. Preliminary Experiment Under Synthetic Rain and Snow Perturbations
5.2. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
Abbreviations
| HSI | Hyperspectral image |
| EMNet | Equivariant Manifold Network |
| EGM | Equivariance-Guided Module |
| CFC | Characteristic Filtering Convolution |
| DGA | Decoupled gaze attention |
| REM | Redundancy elimination module |
| PFM | Phantom fractal module |
| SE(2) | Special Euclidean group in 2D |
| HiT | Hyperspectral Image Transformer |
| LeViT | Lightweight vision transformer architecture |
| FLOPs | Floating-point operations |
| ANN | Artificial neural network |
| GAN | Generative adversarial network |
| CNN | Convolutional neural network |
| DCNN | Deep convolutional neural network |
References
- Dosovitskiy, A.; Beyer, L.; Kolesnikov, A.; Kolesnikov, A.; Weissenborn, D.; Zhai, X.; Unterfthiner, T.; Dehghani, M.; Minderer, M.; Heigold, G.; et al. An Image Is Worth 16×16 Words: Transformers for Image Recognition at Scale. In Proceedings of the International Conference on Learning Representations (ICLR), Virtual Event, 3–7 May 2021. [Google Scholar]
- He, X.; Chen, Y.; Lin, Z. Spatial–Spectral Transformer for Hyperspectral Image Classification. Remote Sens. 2021, 13, 498. [Google Scholar] [CrossRef]
- Hu, W.; Huang, Y.; Wei, L.; Zhang, F.; Li, H. Deep Convolutional Neural Networks for Hyperspectral Image Classification. J. Sens. 2015, 2015, 258619. [Google Scholar] [CrossRef]
- Huang, L.; Chen, Y.; He, X. Spectral–Spatial Mamba for Hyperspectral Image Classification. Remote Sens. 2024, 16, 2449. [Google Scholar] [CrossRef]
- Heo, B.; Yun, S.; Han, D.; Chun, S.; Choe, J.; Oh, S.J. Rethinking Spatial Dimensions of Vision Transformers. arXiv 2021, arXiv:2103.16302. [Google Scholar] [CrossRef]
- Zhang, C.; Li, G.; Du, S.; Tan, W.; Gao, F. Three-Dimensional Densely Connected Convolutional Network for Hyperspectral Remote Sensing Image Classification. J. Appl. Remote Sens. 2019, 13, 016519. [Google Scholar] [CrossRef]
- Fang, L.; Liu, G.; Li, S.; Ghamisi, P.; Benediktsson, J.A. Hyperspectral Image Classification With Squeeze Multibias Network. IEEE Trans. Geosci. Remote Sens. 2019, 57, 1291–1301. [Google Scholar] [CrossRef]
- Zheng, X.; Fang, L.; He, X.; Jia, X.; Chanussot, J. Spatial and Spectral Structure-Aware Mamba Network for Hyperspectral Image Classification. Remote Sens. 2025, 17, 2489. [Google Scholar] [CrossRef]
- Mou, L.; Ghamisi, P.; Zhu, X.X. Deep Recurrent Neural Networks for Hyperspectral Image Classification. IEEE Trans. Geosci. Remote Sens. 2017, 55, 3639–3655. [Google Scholar] [CrossRef]
- Roy, S.; Krishna, G.; Dubey, S.; Chaudhuri, B. HybridSN: Exploring 3-D–2-D CNN Feature Hierarchy for Hyperspectral Image Classification. IEEE Geosci. Remote Sens. Lett. 2020, 17, 277–281. [Google Scholar] [CrossRef]
- Rezaei, H.; Shahdoosti, H.R.; Ghamisi, P. HyperLiteNet: Extremely Lightweight Non-Deep Parallel Network for Hyperspectral Image Classification. Remote Sens. 2022, 14, 866. [Google Scholar] [CrossRef]
- Zhang, H.; Li, Y.; Jiang, Y.; Wang, P.; Shen, Q.; Shen, C. Hyperspectral Classification Based on Lightweight 3-D-CNN with Transfer Learning (3-D-LWNet). arXiv 2020, arXiv:2012.03439. [Google Scholar]
- Liu, X.; Zhao, T.; Song, Z.; Chen, S. LiteDenseNet: A Lightweight Network for Hyperspectral Image Classification. arXiv 2020, arXiv:2004.08112. [Google Scholar]
- Zhan, D.; Shi, Y.; Lai, S.; Wu, J.; Li, P. LiteDepthwiseNet: A Lightweight Network for Hyperspectral Image Classification. IEEE Trans. Geosci. Remote Sens. 2022, 60, 5502915. [Google Scholar] [CrossRef]
- Yu, G.; Pang, Y.; Xiao, L.; Yu, Z. Dual-Semantic Graph Convolution Network for Hyperspectral Image Classification with Few Labeled Samples. IEEE Trans. Geosci. Remote Sens. 2025, 63, 5508815. [Google Scholar]
- Yang, X.; Cao, W.; Lu, Y.; Zhou, Y. Hyperspectral Image Transformer Classification Networks. IEEE Trans. Geosci. Remote Sens. 2022, 60, 5528715. [Google Scholar] [CrossRef]
- Zhou, D.; Kang, B.; Jin, X.; Yang, L.; Lian, X.; Jiang, Z.; Hou, Q.; Feng, J. DeepViT: Towards Deeper Vision Transformer. arXiv 2021, arXiv:2103.11886. [Google Scholar] [CrossRef]
- Yan, L.; Yu, J.; Yu, H.; Xie, S.; Ghamisi, P. A Lightweight Transformer Network for Hyperspectral Image Classification. IEEE Trans. Geosci. Remote Sens. 2023, 61, 5517617. [Google Scholar]
- Zhang, X.; Zhang, J.; Gao, X.; Teng, S.; Yang, J. A Synergistic CNN–Transformer Network with Pooling Attention Fusion for Hyperspectral Image Classification. Digit. Signal Process. 2025, 160, 105070. [Google Scholar] [CrossRef]
- Graham, B.; El-Nouby, A.; Touvron, H.; Stock, P.; Joulin, A.; Jégou, H. LeViT: A Vision Transformer in ConvNet’s Clothing for Faster Inference. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), Montreal, QC, Canada, 10–17 October 2021; pp. 12239–12249. [Google Scholar] [CrossRef]
- Yagshyyeva, C.; Kakyshov, E. Mathematical Methods in Image Processing and Computer Vision. In Proceedings of the Oguzhan Engineering and Technology University, Ashgabat, Turkmenistan, 5–12 June 2025; pp. 769–770. [Google Scholar]
- Bonneel, N.; Digne, J. A Survey of Optimal Transport for Computer Graphics and Computer Vision. Comput. Graph. Forum 2023, 42, 233–260. [Google Scholar] [CrossRef]
- Zhang, R.; Jiang, D.; Zhang, Y.; Lin, H.; Guo, Z.; Qiu, P.; Zhou, A.; Lu, P.; Chang, K.-W.; Qiao, Y.; et al. MATHVERSE: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems? arXiv 2024, arXiv:2403.14624. [Google Scholar]
- Wang, K.; Pan, J.; Shi, W.; Lu, Z.; Zhan, M.; Li, H. Measuring Multimodal Mathematical Reasoning with the Math-Vision Dataset. arXiv 2024, arXiv:2402.14804. [Google Scholar] [CrossRef]
- Sistaninejhad, B.; Rasi, H.; Nayeri, P. A Review Paper about Deep Learning for Medical Image Analysis. Comput. Math. Methods Med. 2023, 2023, 7091301. [Google Scholar] [CrossRef] [PubMed]
- Karobari, M.I.; Adil, A.H.; Basheer, S.N.; Murugesan, S.; Savadamoorthi, K.S.; Mustafa, M.; Abdulwahed, A.; Almokhatieb, A.A. Evaluation of the Diagnostic and Prognostic Accuracy of Artificial Intelligence in Endodontic Dentistry: A Comprehensive Review. Comput. Math. Methods Med. 2023, 2023, 7049360. [Google Scholar] [CrossRef] [PubMed]
- Kourounis, G.; Elmahmudi, A.A.; Thomson, B.; Hunter, J.; Ugail, H.; Wilson, C. Computer Image Analysis with Artificial Intelligence: A Practical Introduction to Convolutional Neural Networks for Medical Professionals. Postgrad. Med. J. 2023, 99, 1287–1294. [Google Scholar] [CrossRef]
- Grigorescu, S.M.; Trasnea, B.; Cocias, T.; Macesanu, G. A Survey of Deep Learning Techniques for Autonomous Driving. J. Field Robot. 2020, 37, 362–386. [Google Scholar] [CrossRef]
- Mahesh, R.M. Automated Wheat Stem Rust Detection Using Computer Vision. Master’s Thesis, University of Minnesota, Minneapolis, MN, USA, 2023. [Google Scholar]
- Valipoor, M.M.; de Antonio, A. Recent Trends in Computer Vision-Driven Scene Understanding for VI/Blind Users: A Systematic Mapping. Univ. Access Inf. Soc. 2023, 22, 983–1005. [Google Scholar] [CrossRef]
- Zhao, X.; Wang, L.; Zhang, Y.; Han, X.; Deveci, M.; Parmar, M. A Review of Convolutional Neural Networks in Computer Vision. Artif. Intell. Rev. 2024, 57, 99. [Google Scholar] [CrossRef]
- Upadhyay, A.; Chandel, N.S.; Singh, K.P.; Chakraborty, S.K.; Nandede, B.M.; Kumar, M.; Subeesh, A.; Upendar, K.; Salem, A.; Elbeltagi, A. Deep Learning and Computer Vision in Plant Disease Detection: A Comprehensive Review of Techniques, Models, and Trends in Precision Agriculture. Artif. Intell. Rev. 2025, 58, 92. [Google Scholar] [CrossRef]
- Wang, D.; Zhang, J.; Du, B.; Zhang, L.; Tao, D. DCN-T: Dual Context Network with Transformer for Hyperspectral Image Classification. IEEE Trans. Geosci. Remote Sens. 2023, 61, 5528304. [Google Scholar] [CrossRef]
- Wu, T.-Y.; Li, H.; Kumari, S.; Chen, C.-M. A Spectral Convolutional Neural Network Model Based on Adaptive Fick’s Law for Hyperspectral Image Classification. Comput. Mater. Contin. 2024, 79, 20–35. [Google Scholar] [CrossRef]
- Seydi, S.T.; Bozorgasl, Z.; Chen, H. Unveiling the Power of Wavelets: A Wavelet-Based Kolmogorov–Arnold Network for Hyperspectral Image Classification. arXiv 2024, arXiv:2406.07869v2. [Google Scholar]
- Scheibenreif, L.; Mommert, M.; Borth, D. Masked Vision Transformers for Hyperspectral Image Classification. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Vancouver, BC, Canada, 18–22 June 2023; pp. 2166–2172. [Google Scholar]
- Huang, L.; Chen, Y.; He, X. Spectral–Spatial Masked Transformer with Supervised and Contrastive Learning for Hyperspectral Image Classification. IEEE Trans. Geosci. Remote Sens. 2023, 61, 4958–4971. [Google Scholar] [CrossRef]
- He, Y.; Tu, B.; Liu, B.; Li, J.; Plaza, A. 3DSS-Mamba: 3D-Spectral-Spatial Mamba for Hyperspectral Image Classification. IEEE Trans. Geosci. Remote Sens. 2024, 62, 5534216. [Google Scholar] [CrossRef]
- Ahmad, M.; Butt, M.H.F.; Khan, A.M.; Mazzara, M.; Distefano, S.; Usama, M.; Roy, S.K.; Chanussot, J.; Hong, D. Spatial and Spatial–Spectral Morphological Mamba for Hyperspectral Image Classification. arXiv 2024, arXiv:2408.01372v3. [Google Scholar] [CrossRef]
- Zhang, Y.; Zhang, M.; Li, W.; Wang, S.; Tao, R. Language-Aware Domain Generalization Network for Cross-Scene Hyperspectral Image Classification. ISPRS J. Photogramm. Remote Sens. 2022, 189, 176–188. [Google Scholar] [CrossRef]
- Li, J.; He, Y.; Tu, B. Single-Source Domain Expansion Network for Cross-Scene Hyperspectral Image Classification. IEEE Trans. Geosci. Remote Sens. 2022, 60, 5528119. [Google Scholar] [CrossRef]
- Chen, N.; Yue, J.; Fang, L.; Xia, S. SpectralDiff: A Generative Framework for Hyperspectral Image Classification with Diffusion Models. IEEE Trans. Geosci. Remote Sens. 2023, 61, 5532867. [Google Scholar] [CrossRef]
- Yang, J.; Du, B.; Zhang, L. From Center to Surrounding: An Interactive Learning Framework for Hyperspectral Image Classification. ISPRS J. Photogramm. Remote Sens. 2023, 197, 145–166. [Google Scholar] [CrossRef]
- Chen, H.; Wang, T.; Chen, T.; Deng, W. Hyperspectral Image Classification Based on Fusing S3-PCA, 2D-SSA and Random Patch Network. Remote Sens. 2023, 15, 3402. [Google Scholar] [CrossRef]
- Ge, H.; Wang, L.; Liu, M.; Zhao, X.; Zhu, Y.; Pan, H.; Liu, Y. Pyramidal Multiscale Convolutional Network with Polarized Self-Attention for Pixel-Wise Hyperspectral Image Classification. IEEE Trans. Geosci. Remote Sens. 2023, 61, 5504018. [Google Scholar] [CrossRef]
- Liu, J.; Zhan, J.; Zhang, J.; Chen, J.; Song, Y.; Tang, L.; Zhou, L.; Du, C.; Wei, Y.; Guo, Y. Robust Scale Fusion and Edge-Aware Feature Attention Network for Remote Sensing UAV Road Detection under Harsh Weather. Results Eng. 2025, 27, 106172. [Google Scholar] [CrossRef]
- Zhong, X.; Zhan, J.; Xie, Y.; Zhang, L.; Zhou, G.; Liang, M.; Yang, K.; Guo, Z.; Li, L. Adaptive Deformation-Learning and Multiscale-Integrated Network for Remote Sensing Object Detection. IEEE Trans. Geosci. Remote Sens. 2025, 63, 5611619. [Google Scholar] [CrossRef]
- Zhan, J.; Bai, L.; Zhang, J.; Liu, T.; Shi, F.; Liu, Y.; Liu, L. Heterogeneous Binary Pixel Difference Networks for Remote Sensing Object Detection. IEEE Trans. Geosci. Remote Sens. 2025, 63, 5602619. [Google Scholar] [CrossRef]
- Zhang, Y.; Duan, P.; Liang, L.; Kang, X.; Li, J.; Plaza, A. PFS3F: Probabilistic Fusion of Superpixel-Wise and Semantic-Aware Structural Features for Hyperspectral Image Classification. IEEE Trans. Circuits Syst. Video Technol. 2025, 35, 8723–8737. [Google Scholar] [CrossRef]
- Liang, L.; Zhang, J.; Duan, P.; Kang, X.; Wu, T.X.; Li, J.; Plaza, A. LKMA: Learnable Kernel and Mamba With Spatial–Spectral Attention Fusion for Hyperspectral Image Classification. IEEE Trans. Geosci. Remote Sens. 2025, 63, 5530914. [Google Scholar] [CrossRef]
- Liang, L.; Xie, P.; Zhang, Y.; Li, J.; Zhang, Z.; Li, J.; Plaza, A. DBMLLA: Double-Branch Mamba-Like Linear Attention Network for Hyperspectral Image Classification. IEEE Trans. Geosci. Remote Sens. 2025, 63, 5524315. [Google Scholar] [CrossRef]
- Liang, L.; Zhang, Y.; Zhang, S.; Li, J.; Plaza, A.; Kang, X. Fast Hyperspectral Image Classification Combining Transformers and SimAM-Based CNNs. IEEE Trans. Geosci. Remote Sens. 2023, 61, 5522219. [Google Scholar] [CrossRef]
- Zhang, S.; Liu, Y.; Li, F.; Zheng, J.; Liang, L.; Plaza, A.; Deng, C.; Wang, S. Multiscale Spatial Graph-Regularized Hierarchical Sparse Unmixing Based on the Framelet Transform. IEEE Trans. Geosci. Remote Sens. 2025, 63, 5524620. [Google Scholar] [CrossRef]
- Liang, L.; Zhang, S.; Li, J. Multiscale DenseNet Meets With Bi-RNN for Hyperspectral Image Classification. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2022, 15, 5401–5415. [Google Scholar] [CrossRef]
- Liang, L.; Yuan, S.; Zeng, Y.; Lin, Y.; Zhang, Y.; Xie, P.; Wu, T.X. Cross-Stage Attention Edge Enhancement and Fourier-Wavelet Transformer Integrated Network for Hyperspectral Image Classification. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2025, 18, 28797–28811. [Google Scholar] [CrossRef]
- Li, T.; Zhan, J.; Liu, J.; Guo, J.; Xiong, X.; Cai, W.; Liu, E.; Wei, Y.; Hu, Y. Sorted Texture-Aware Glance and Gaze Network for Hyperspectral Image Classification With Low Training Samples. IEEE Trans. Geosci. Remote Sens. 2025, 63, 5518126. [Google Scholar] [CrossRef]
- Wang, D.; Hu, M.; Jin, Y.; Miao, Y.; Yang, J.; Xu, Y.; Qin, X.; Ma, J.; Sun, L.; Li, C.; et al. HyperSIGMA: Hyperspectral Intelligence Comprehension Foundation Model. IEEE Trans. Pattern Anal. Mach. Intell. 2025, 47, 6427–6444. [Google Scholar] [CrossRef]
- Hong, D.; Han, Z.; Yao, J.; Gao, L.; Zhang, B.; Plaza, A.; Chanussot, J. SpectralFormer: Rethinking Hyperspectral Image Classification With Transformers. IEEE Trans. Geosci. Remote Sens. 2022, 60, 5518615. [Google Scholar] [CrossRef]
- Yang, J.; Wu, C.; Du, B.; Zhang, L. Enhanced Multiscale Feature Fusion Network for HSI Classification. IEEE Trans. Geosci. Remote Sens. 2021, 59, 10328–10347. [Google Scholar] [CrossRef]
- Liu, R.; Liang, J.; Yang, J.; Hu, M.; He, J.; Zhu, P.; Zhang, L. DHSNet: Dual Classification Head Self-Training Network for Cross-Scene Hyperspectral Image Classification. IEEE Trans. Geosci. Remote Sens. 2025, 63, 5534515. [Google Scholar] [CrossRef]
- Cohen, T.S.; Welling, M. Group Equivariant Convolutional Networks. In Proceedings of the 33rd International Conference on Machine Learning (ICML), New York, NY, USA, 19–24 June 2016; Volume 48. [Google Scholar]
- Hu, X.; Zhong, Y.; Luo, C.; Wang, X. WHU-Hi: UAV-borne hyperspectral with high spatial resolution (H2) benchmark datasets for hyperspectral image classification. Remote Sens. Environ. 2020, 250, 112012. [Google Scholar] [CrossRef]
- Debes, C.; Merentitis, A.; Heremans, R.; Hahn, J.; Frangiadakis, N.; van Kasteren, T.; Liao, W.; Bellens, R.; Pizurica, A.; Gautama, S.; et al. The 2013 IEEE GRSS Data Fusion Contest: Fusion of hyperspectral and LiDAR data. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2014, 7, 2405–2418. [Google Scholar] [CrossRef]
- Baumgardner, M.F.; Biehl, L.L.; Landgrebe, D.A. 220 Band AVIRIS Hyperspectral Image Data Set: June 12, 1992 Indian Pine Test Site 3; Purdue University Research Repository (PURR): West Lafayette, Indiana, 1992; (Dataset); Available online: https://purr.purdue.edu/publications/1947 (accessed on 25 March 2026).
- Zhan, J.; Xie, Y.; Guo, J.; Hu, Y.; Zhou, G.; Cai, W.; Wang, Y.; Chen, A.; Xie, L.; Li, M.; et al. DGPF-RENet: A Low Data Dependence Network With Low Training Iterations for Hyperspectral Image Classification. IEEE Trans. Geosci. Remote Sens. 2023, 61, 5520521. [Google Scholar] [CrossRef]
- Lee, H.; Kwon, H. Contextual Deep CNN Based Hyperspectral Classification. In Proceedings of the IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Beijing, China, 10–15 July 2016. [Google Scholar] [CrossRef]
- Ouyang, E.; Li, B.; Hu, W.; Zhang, G.; Zhao, L.; Wu, J. When Multigranularity Meets Spatial–Spectral Attention: A Hybrid Transformer for Hyperspectral Image Classification. IEEE Trans. Geosci. Remote Sens. 2023, 61, 4401118. [Google Scholar] [CrossRef]
- Cortes, C.; Vapnik, V. Support-Vector Networks. Mach. Learn. 1995, 20, 273–297. [Google Scholar] [CrossRef]
- LeCun, Y.; Bottou, L.; Bengio, Y.; Haffner, P. Gradient-Based Learning Applied to Document Recognition. Proc. IEEE 1998, 86, 2278–2324. [Google Scholar] [CrossRef]
- He, M.; Li, B.; Chen, H. Multi-Scale 3D Deep Convolutional Neural Network for Hyperspectral Image Classification. In Proceedings of the IEEE International Conference on Image Processing (ICIP), Beijing, China, 17–20 September 2017; Available online: https://ieeexplore.ieee.org/document/8297014/ (accessed on 25 March 2026).
- Sharma, V.; Diba, A.; Tuytelaars, T.; Van Gool, L. Hyperspectral CNN for Image Classification and Band Selection, with Application to Face Recognition. arXiv 2016, arXiv:1602.02550. [Google Scholar]
- Wang, W.J.; Dou, S.G.; Jiang, Z.M.; Sun, L. A Fast Dense Spectral–Spatial Convolution Network Framework for Hyperspectral Images Classification. Remote Sens. 2018, 10, 1068. [Google Scholar] [CrossRef]
- Mani, A.; Gorbachev, S.; Yan, J.; Dixit, A.; Shi, X.; Li, L.; Sun, Y.; Chen, X.; Wu, J.; Deng, J.; et al. OHID-1: A New Large Hyperspectral Image Dataset for Multi-Classification. Sci. Data 2025, 12, 251. [Google Scholar] [CrossRef] [PubMed]
- Cen, Y.; Zhang, L.F.; Zhang, X.; Wang, Y.M.; Qi, W.C.; Tang, S.L.; Zhang, P. Aerial hyperspectral remote sensing classification dataset of Xiongan New Area (Matiwan Village). J. Remote Sens. 2020, 24, 1299–1306. [Google Scholar] [CrossRef]







| Section | Layer | Setting | Section | Layer | Setting |
|---|---|---|---|---|---|
| EGM branch | SE2Transform | theta + shift | CFC branch | LieGroupConv1D | k = 3, s = 1 |
| SE2 input | H × W × C | Filters | 64 | ||
| AttmFuse | 1 × 1, sigmoid | Affine params | scale + shift | ||
| AttmFuse out | H × W × 1 | Padding | same | ||
| SE2GraphFusion | H × W × 2C | Position | spectral Conv1D-2 | ||
| EGM output | H × W × 64 | Input patch | 19 × 19 × num_PC |
| Hardware Environment | Software Environment | ||
|---|---|---|---|
| CPU | Intel(R) Xeon(R) Platinum 8255C CPU @ 2.50 GHz | OS | Linux |
| RAM | 40 GB | CUDA | 9.2 |
| Video memory | 11 GB | Python | 3.6.5 |
| GPU | NVIDIA GeForce RTX 2080 Ti | Tensorflow | 1.10.0 |
| Server platform | autodl | Keras | 2.2.0 |
| Section | Parameter Setting | Section | Parameter Setting | ||
|---|---|---|---|---|---|
| Training method | Optimizer | RMSprop | Network settings | Fusion filters | 96 |
| Loss function | Categorical cross-entropy | RE-attention stages | 2 | ||
| Initial learning rate | 1 × 10−3 | First spectral layer | Conv1D | ||
| Decay strategy | Exponential decay | Classification head | Dense 256, Dropout 0.5, Softmax | ||
| Batch size | 64 | Spatial window size | Local patch size | 19 × 19 | |
| Training epochs | 64 | Input tensor shape | 19 × 19 × num_PC | ||
| Network settings | Backbone type | demo backbone | Other hyperparameters | Repeated runs | 10 |
| PFM branches | 6 | Train-test split | Non-disjoint | ||
| Filters per PFM branch | 64 | Evaluation target | Labeled pixels | ||
| PFM kernel sizes | 11, 7, 3, 3, 3, 3 | Output map | Saved | ||
| PFM stride | 2 | GPU memory setting | Fixed fraction and growth enabled | ||
| PFM padding | same | ||||
| Activation | ReLU | ||||
| Normalization | Batch normalization | ||||
| WHU-Hi-HongHu | Houston2013 | Indian Pines | |||
|---|---|---|---|---|---|
| Class | Samples | Class | Samples | Class | Samples |
| Re-ro | 14,041 | He-gr | 1251 | Alfalfa | 46 |
| Road | 3512 | St-gr | 1254 | Corn-notill | 1428 |
| Ba-so | 21,821 | Sy-gr | 697 | Corn-minti | 830 |
| Cotton | 163,285 | Trees | 1244 | Corn | 237 |
| Co-fi-wo | 6218 | Soil | 1242 | Gr-pasture | 483 |
| Rape | 44,557 | Water | 325 | Grass-trees | 730 |
| Ch-ca | 24,103 | Residential | 1268 | Gr-pa-mo | 28 |
| Pakchoi | 4054 | Commercial | 1244 | Hay-wi | 478 |
| Cabbage | 10,819 | Road | 1252 | Oats | 20 |
| Tu-mu | 12,394 | Highway | 1227 | So-no | 972 |
| Br-pa-en | 11,015 | Railway | 1235 | So-mi | 2455 |
| Br-ch | 8954 | Parking-1 | 1233 | So-cl | 593 |
| Sm-br-ch | 22,507 | Parking-2 | 469 | Wheat | 205 |
| La-sa | 7356 | Te-Co | 428 | Woods | 1265 |
| Celtuce | 1002 | Ru-Tr | 660 | Bu-G-Dr | 386 |
| Fil-co-le | 7262 | St-St-To | 93 | ||
| Ro-le | 3010 | ||||
| Carrot | 3217 | ||||
| Wh-ra | 8712 | ||||
| Ga-sp | 3486 | ||||
| Broad-be | 1328 | ||||
| Tree | 4040 | ||||
| (a) | |||||||||||
| Train Sample | Class | Model | |||||||||
| Lee | Hybrid | SVM_g | Vit | Cnn2D | He | Shar | FDSSC | DGPF | Ours | ||
| 50 per class | 1 | 74.23% | 94.23% | 81.29% | 90.29% | 88.69% | 73.29% | 87.87% | 87.06% | 95.04% | 97.06% |
| 2 | 8.96% | 87.80% | 9.08% | 9.36% | 85.11% | 10.00% | 9.85% | 10.24% | 92.74% | 98.05% | |
| 3 | 48.89% | 77.91% | 68.97% | 73.42% | 78.04% | 75.55% | 75.94% | 78.35% | 91.22% | 91.93% | |
| 4 | 42.24% | 22.60% | 76.73% | 96.19% | 65.61% | 89.24% | 95.53% | 93.11% | 95.28% | 97.41% | |
| 5 | 51.99% | 68.68% | 62.16% | 91.88% | 95.80% | 77.06% | 92.96% | 97.80% | 96.84% | 98.25% | |
| 6 | 5.92% | 90.00% | 75.66% | 68.48% | 87.86% | 82.35% | 87.67% | 85.89% | 95.85% | 97.32% | |
| 7 | 11.34% | 56.64% | 40.13% | 9.55% | 49.03% | 38.75% | 59.30% | 64.71% | 77.52% | 90.71% | |
| 8 | 51.37% | 10.46% | 31.27% | 76.60% | 49.83% | 31.54% | 67.71% | 60.34% | 92.55% | 97.58% | |
| 9 | 71.78% | 98.57% | 71.70% | 67.65% | 94.35% | 75.45% | 78.37% | 80.63% | 95.95% | 98.15% | |
| 10 | 31.27% | 70.55% | 38.10% | 35.23% | 70.69% | 31.49% | 73.97% | 66.12% | 85.83% | 93.57% | |
| 11 | 4.36% | 38.22% | 26.91% | 43.90% | 62.13% | 19.34% | 55.23% | 69.36% | 91.62% | 94.95% | |
| 12 | 41.45% | 57.55% | 46.21% | 48.84% | 17.77% | 15.88% | 68.01% | 74.26% | 82.48% | 91.35% | |
| 13 | 0.01% | 49.84% | 43.19% | 7.99% | 62.29% | 60.04% | 67.81% | 63.26% | 79.91% | 86.71% | |
| 14 | 60.81% | 70.40% | 50.22% | 58.23% | 72.45% | 40.77% | 73.82% | 73.86% | 91.99% | 95.93% | |
| 15 | 30.67% | 86.87% | 28.05% | 34.66% | 83.51% | 36.87% | 47.79% | 50.63% | 98.99% | 99.67% | |
| 16 | 26.38% | 32.32% | 56.33% | 56.84% | 72.75% | 66.99% | 72.41% | 78.22% | 97.02% | 97.72% | |
| 17 | 74.96% | 74.86% | 55.98% | 80.41% | 82.74% | 35.74% | 73.61% | 76.93% | 99.15% | 99.79% | |
| 18 | 62.36% | 56.14% | 42.97% | 57.53% | 91.73% | 48.12% | 74.36% | 92.77% | 98.58% | 98.57% | |
| 19 | 52.53% | 59.64% | 54.08% | 50.76% | 91.26% | 56.73% | 66.00% | 74.30% | 92.19% | 96.08% | |
| 20 | 62.51% | 84.58% | 47.85% | 48.95% | 78.90% | 58.12% | 66.73% | 69.44% | 97.58% | 98.83% | |
| 21 | 67.45% | 47.26% | 47.26% | 48.20% | 77.86% | 50.31% | 67.06% | 68.78% | 99.87% | 99.93% | |
| 22 | 0.69% | 71.70% | 61.05% | 74.96% | 91.45% | 81.80% | 85.86% | 89.22% | 98.74% | 99.46% | |
| OA | 34.74 ± 0.52% | 49.78 ± 0.39% | 64.84 ± 0.34% | 70.66 ± 0.58% | 70.47 ± 0.27% | 71.56 ± 0.24% | 82.95 ± 0.74% | 82.79 ± 0.43% | 92.43 ± 0.42% | 95.77 ± 0.19% | |
| AA | 42.54 ± 0.36% | 63.95 ± 0.26% | 50.69 ± 0.67% | 55.91 ± 0.68% | 74.99 ± 0.39% | 52.52 ± 0.77% | 70.36 ± 0.48% | 72.97 ± 0.28% | 93.04 ± 0.15% | 96.32 ± 0.08% | |
| Kap | 28.33 ± 0.38% | 45.85 ± 0.47% | 57.53 ± 0.21% | 63.43 ± 0.37% | 65.30 ± 0.28% | 64.86 ± 0.18% | 78.61 ± 0.49% | 78.57 ± 0.55% | 90.53 ± 0.35% | 94.67 ± 0.24% | |
| (b) | |||||||||||
| Train Sample | Class | Model | |||||||||
| Lee | Hybrid | SVM_g | Vit | Cnn2D | He | Shar | FDSSC | DGPF | Ours | ||
| 25 per class | 1 | 74.49% | 75.43% | 79.48% | 82.06% | 83.28% | 73.14% | 85.63% | 86.08% | 90.08% | 94.23% |
| 2 | 8.89% | 36.21% | 8.62% | 3.58% | 7.86% | 8.50% | 11.14% | 35.90% | 87.96% | 91.61% | |
| 3 | 69.72% | 66.96% | 67.23% | 62.03% | 30.88% | 74.77% | 73.50% | 71.80% | 84.95% | 88.67% | |
| 4 | 4.73% | 74.89% | 71.76% | 94.32% | 91.04% | 89.07% | 94.23% | 97.69% | 91.52% | 94.46% | |
| 5 | 51.27% | 71.35% | 48.49% | 87.86% | 93.22% | 70.21% | 91.18% | 93.67% | 93.36% | 95.46% | |
| 6 | 16.68% | 87.66% | 70.79% | 77.20% | 91.83% | 78.51% | 88.17% | 92.18% | 92.16% | 93.11% | |
| 7 | 0 | 38.87% | 35.97% | 37.51% | 57.41% | 40.44% | 45.55% | 46.03% | 71.82% | 78.93% | |
| 8 | 36.88% | 61.78% | 21.79% | 15.74% | 71.16% | 17.13% | 51.08% | 71.36% | 84.85% | 80.11% | |
| 9 | 78.08% | 61.47% | 70.80% | 75.66% | 79.43% | 63.44% | 78.66% | 76.36% | 94.33% | 95.71% | |
| 10 | 15.71% | 77.49% | 33.60% | 44.55% | 74.65% | 17.36% | 67.85% | 68.83% | 79.69% | 83.59% | |
| 11 | 3.28% | 25.21% | 21.43% | 29.17% | 55.61% | 18.78% | 56.84% | 67.92% | 80.42% | 88.47% | |
| 12 | 4.01% | 47.21% | 36.44% | 30.33% | 65.78% | 32.59% | 64.11% | 70.28% | 70.26% | 78.39% | |
| 13 | 0 | 46.91% | 39.39% | 53.29% | 67.47% | 50.94% | 59.97% | 63.70% | 65.94% | 76.51% | |
| 14 | 47.72% | 71.17% | 45.23% | 46.60% | 69.27% | 48.65% | 67.44% | 67.96% | 82.99% | 88.21% | |
| 15 | 28.86% | 13.82% | 26.71% | 12.38% | 41.86% | 42.17% | 38.18% | 51.48% | 98.33% | 98.96% | |
| 16 | 32.63% | 60.54% | 50.06% | 50.81% | 68.14% | 57.34% | 67.80% | 79.67% | 93.64% | 94.36% | |
| 17 | 59.40% | 93.53% | 58.39% | 68.68% | 88.48% | 79.10% | 79.50% | 83.92% | 95.16% | 99.17% | |
| 18 | 30.01% | 69.14% | 39.41% | 43.01% | 84.12% | 53.38% | 80.89% | 83.83% | 97.72% | 98.37% | |
| 19 | 20.52% | 47.33% | 49.26% | 24.67% | 67.90% | 42.18% | 63.00% | 69.33% | 87.41% | 90.22% | |
| 20 | 39.87% | 46.92% | 43.57% | 41.32% | 72.72% | 26.58% | 64.11% | 73.53% | 96.38% | 97.96% | |
| 21 | 56.10% | 42.21% | 43.82% | 65.31% | 89.33% | 43.05% | 60.32% | 71.53% | 98.84% | 99.53% | |
| 22 | 37.93% | 70.61% | 55.59% | 60.12% | 87.67% | 80.12% | 87.32% | 86.00% | 93.65% | 96.53% | |
| OA | 18.19 ± 0.59% | 67.84 ± 0.47% | 60.18 ± 0.54% | 72.00 ± 0.34% | 79.06 ± 0.37% | 69.54 ± 0.28% | 80.27 ± 0.37% | 83.87 ± 0.53% | 87.24 ± 0.48% | 90.98 ± 0.32% | |
| AA | 32.58 ± 0.24% | 58.49 ± 0.25% | 46.27 ± 0.38% | 50.28 ± 0.18% | 69.96 ± 0.33% | 50.34 ± 0.52% | 67.11 ± 0.28% | 73.14 ± 0.49% | 87.79 ± 0.23% | 91.48 ± 0.17% | |
| Kap | 15.99 ± 0.28% | 61.55 ± 0.63% | 52.46 ± 0.49% | 64.99 ± 0.29% | 74.04 ± 0.28% | 62.39 ± 0.46% | 75.34 ± 0.48% | 79.67 ± 0.35% | 84.18 ± 0.56% | 88.74 ± 0.38% | |
| - | Para | 0.48 M | 1.88 M | - | 2.73 M | 4.61 M | 7.67 M | 2.29 M | 1.61 M | 5.15 M | 5.22 M |
| Train Sample | Class | Model | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Lee | Hybrid | SVM_g | Vit | Cnn2D | He | Shar | FDSSC | DGPF | Ours | ||
| 50 per class | 1 | 46.71% | 95.19% | 54.89% | 96.04% | 83.64% | 32.46% | 39.97% | 61.89% | 94.62% | 97.34% |
| 2 | 54.72% | 82.16% | 43.22% | 88.77% | 98.03% | 33.62% | 46.57% | 66.21% | 96.18% | 97.77% | |
| 3 | 62.13% | 93.04% | 66.77% | 88.10% | 93.97% | 69.55% | 63.37% | 66.77% | 99.88% | 99.64% | |
| 4 | 0.00% | 88.44% | 24.46% | 90.95% | 90.20% | 17.50% | 32.08% | 58.63% | 96.28% | 98.29% | |
| 5 | 65.39% | 95.28% | 68.33% | 83.99% | 99.11% | 61.57% | 71.71% | 86.39% | 99.97% | 99.99% | |
| 6 | 22.55% | 85.45% | 22.55% | 70.18% | 90.18% | 26.18% | 32.36% | 69.82% | 99.16% | 99.29% | |
| 7 | 8.58% | 52.37% | 19.98% | 76.52% | 76.02% | 12.41% | 27.39% | 46.05% | 92.95% | 94.97% | |
| 8 | 7.35% | 67.61% | 27.61% | 70.17% | 74.19% | 20.09% | 52.05% | 78.21% | 86.35% | 92.84% | |
| 9 | 4.04% | 68.04% | 9.79% | 70.62% | 77.06% | 10.48% | 27.49% | 54.90% | 90.33% | 94.58% | |
| 10 | 32.54% | 63.98% | 44.77% | 31.18% | 80.29% | 52.76% | 68.14% | 89.97% | 97.08% | 98.59% | |
| 11 | 25.22% | 61.10% | 26.55% | 69.36% | 70.43% | 1.69% | 18.56% | 49.47% | 97.45% | 99.18% | |
| 12 | 14.03% | 54.27% | 27.90% | 16.74% | 78.95% | 43.36% | 39.81% | 50.89% | 93.88% | 96.62% | |
| 13 | 7.97% | 87.44% | 9.18% | 42.51% | 75.60% | 2.66% | 37.20% | 7.73% | 95.99% | 97.04% | |
| 14 | 47.88% | 100.00% | 41.27% | 94.44% | 95.77% | 52.91% | 56.08% | 67.46% | 99.97% | 100.00% | |
| 15 | 18.36% | 92.62% | 18.52% | 89.67% | 97.05% | 10.82% | 34.59% | 39.67% | 100.00% | 100.00% | |
| OA | 27.01 ± 0.28% | 76.00 ± 0.34% | 34.60 ± 0.43% | 71.03 ± 0.35% | 84.19 ± 0.30% | 29.51 ± 0.28% | 42.97 ± 0.54% | 61.76 ± 0.23% | 95.26 ± 0.21% | 97.37 ± 0.14% | |
| AA | 27.83 ± 0.56% | 79.13 ± 0.57% | 33.72 ± 0.37% | 71.95 ± 0.24% | 85.37 ± 0.34% | 29.87 ± 0.24% | 43.16 ± 0.32% | 59.60 ± 0.14% | 96.01 ± 0.35% | 97.74 ± 0.14% | |
| Kappa | 27.83 ± 0.45% | 74.10 ± 0.27% | 29.23 ± 0.12% | 68.71 ± 0.39% | 82.89 ± 0.52% | 24.44 ± 0.45% | 38.39 ± 0.33% | 58.57 ± 0.35% | 94.87 ± 0.11% | 97.16 ± 0.15% | |
| - | Params | 3.19 M | 1.87 M | - | 2.58 M | 4.59 M | 2.66 M | 2.25 M | 0.85 M | 3.49 M | 3.55 M |
| Train Sample | Class | Model | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Lee | Hybrid | SVM_g | Vit | Cnn2D | He | Shar | FDSSC | DGPF | Ours | ||
| 5% | 1 | 0.00% | 0.00% | 0.00% | 0.00% | 0.00% | 0.00% | 0.00% | 0.00% | 67.50% | 95.24% |
| 2 | 30.62% | 33.21% | 22.09% | 0.30% | 58.71% | 19.05% | 32.10% | 50.93% | 91.49% | 95.74% | |
| 3 | 0.00% | 4.45% | 8.54% | 41.42% | 54.98% | 0.36% | 5.34% | 17.79% | 92.50% | 94.04% | |
| 4 | 53.95% | 87.50% | 49.34% | 91.18% | 90.79% | 35.53% | 80.92% | 86.18% | 92.52% | 95.39% | |
| 5 | 30.12% | 47.89% | 30.72% | 77.57% | 75.30% | 33.13% | 26.81% | 33.43% | 93.75% | 93.86% | |
| 6 | 0.00% | 0.00% | 3.02% | 83.24% | 23.46% | 0.00% | 4.94% | 1.10% | 96.41% | 97.01% | |
| 7 | 0.00% | 100.00% | 0.00% | 0.00% | 100.00% | 0.00% | 0.00% | 0.00% | 66.30% | 95.38% | |
| 8 | 0.00% | 0.00% | 0.26% | 75.65% | 17.63% | 0.00% | 10.26% | 0.00% | 99.58% | 99.96% | |
| 9 | 0.00% | 0.00% | 0.00% | 0.00% | 0.00% | 0.00% | 0.00% | 0.00% | 68.95% | 87.78% | |
| 10 | 44.25% | 92.69% | 45.20% | 28.52% | 77.40% | 59.27% | 50.61% | 62.65% | 91.92% | 94.91% | |
| 11 | 0.00% | 0.89% | 31.77% | 78.91% | 59.92% | 16.53% | 46.83% | 57.42% | 95.78% | 96.69% | |
| 12 | 0.00% | 11.16% | 23.12% | 21.65% | 84.38% | 1.83% | 21.91% | 43.41% | 90.35% | 93.63% | |
| 13 | 1.41% | 100.00% | 3.52% | 69.68% | 98.59% | 0.00% | 0.00% | 52.82% | 97.23% | 96.98% | |
| 14 | 0.53% | 81.74% | 60.73% | 21.02% | 96.37% | 46.63% | 63.39% | 63.74% | 99.07% | 98.97% | |
| 15 | 6.21% | 0.00% | 7.45% | 33.56% | 50.31% | 0.00% | 13.66% | 34.78% | 97.38% | 94.30% | |
| 16 | 0.00% | 51.69% | 0.00% | 79.07% | 85.39% | 0.00% | 0.00% | 2.25% | 79.10% | 86.05% | |
| OA | 11.06 ± 0.45% | 31.06 ± 0.29% | 28.32 ± 0.47% | 47.40 ± 0.49% | 64.07 ± 0.50% | 20.78 ± 0.18% | 35.50 ± 0.20% | 45.31 ± 0.23% | 94.37 ± 0.11% | 96.09 ± 0.11% | |
| AA | 11.93 ± 0.24% | 43.66 ± 0.38% | 20.41 ± 0.25% | 53.98 ± 0.12% | 69.52 ± 0.22% | 15.17 ± 0.54% | 25.48 ± 0.38% | 36.18 ± 0.19% | 88.74 ± 0.30% | 94.75 ± 0.20% | |
| Kappa | 4.43 ± 0.16% | 25.21 ± 0.27% | 20.16 ± 0.28% | 38.61 ± 0.37% | 59.44 ± 0.48% | 13.26 ± 0.36% | 26.88 ± 0.18% | 37.68 ± 0.29% | 93.58 ± 0.26% | 95.54 ± 0.13% | |
| - | Params | 0.39 M | 1.88 M | - | 2.65 M | 4.60 M | 4.08 M | 2.26 M | 1.19 M | 4.23 M | 4.29 M |
| Xiongan | OHID-1 | ||
|---|---|---|---|
| Class | Samples | Class | Samples |
| Background | 2,247,890 | Building | 661,721 |
| Residential | 225,647 | Farmland | 438,849 |
| Commercial | 180,766 | Forest | 370,901 |
| Industrial | 15,353 | Road | 129,648 |
| Road | 452,144 | Water | 598,694 |
| Water | 475,591 | Bareland | 14,699 |
| Green space | 169,342 | Fishpond | 43,846 |
| Agricultural | 23,304 | ||
| Bare soil | 165,647 | ||
| Construction | 38,409 | ||
| Park | 193,830 | ||
| Forest | 5612 | ||
| Grassland | 59,165 | ||
| Wetland | 1,026,513 | ||
| Farmland | 7151 | ||
| Orchard | 91,072 | ||
| Vineyard | 29,148 | ||
| Facil agri | 1496 | ||
| Building | 421,790 | ||
| Structure | 65,514 | ||
| Other | 29,616 | ||
| Train Sample | Class | DGPF | Ours | Train Sample | Class | DGPF | Ours |
|---|---|---|---|---|---|---|---|
| 50 | 1 | 45.94% | 73.29% | 1% | 1 | 77.74% | 94.34% |
| 2 | 61.73% | 92.79% | 2 | 95.99% | 94.00% | ||
| 3 | 71.57% | 83.65% | 3 | 88.87% | 96.30% | ||
| 4 | 46.69% | 61.51% | 4 | 65.92% | 73.90% | ||
| 5 | 74.08% | 80.67% | 5 | 83.79% | 95.10% | ||
| 6 | 92.20% | 100.00% | 6 | 100.00% | 90.21% | ||
| 7 | 90.10% | 90.38% | 7 | 92.37% | 93.78% | ||
| OA | 59.65 ± 1.09% | 80.93 ± 0.45% | OA | 84.60 ± 0.11% | 93.59 ± 0.08% | ||
| AA | 68.91 ± 0.55% | 83.19 ± 0.46% | AA | 86.38 ± 0.13% | 91.09 ± 0.09% | ||
| Kappa | 49.02 ± 1.15% | 73.39 ± 0.55% | Kappa | 78.47 ± 0.15% | 91.72 ± 0.11% | ||
| Params | 2.01 M | 2.08 M | Params | 2.01 M | 2.08 M |
| Train Sample | Class | DGPF | Ours | Train Sample | Class | DGPF | Ours |
|---|---|---|---|---|---|---|---|
| 50 | 1 | 100.00% | 100.00% | 1% | 1 | 100.00% | 100.00% |
| 2 | 52.10% | 81.19% | 2 | 99.89% | 99.59% | ||
| 3 | 54.54% | 80.59% | 3 | 99.80% | 99.99% | ||
| 4 | 75.03% | 98.87% | 4 | 99.98% | 100.00% | ||
| 5 | 86.88% | 97.65% | 5 | 97.18% | 99.22% | ||
| 6 | 43.04% | 64.72% | 6 | 99.25% | 99.96% | ||
| 7 | 59.57% | 94.99% | 7 | 99.75% | 99.86% | ||
| 8 | 81.37% | 98.15% | 8 | 99.99% | 100.00% | ||
| 9 | 88.43% | 95.85% | 9 | 97.89% | 99.62% | ||
| 10 | 94.30% | 99.10% | 10 | 99.96% | 100.00% | ||
| 11 | 82.45% | 99.25% | 11 | 99.25% | 99.89% | ||
| 12 | 66.56% | 98.55% | 12 | 100.00% | 100.00% | ||
| 13 | 59.29% | 90.45% | 13 | 85.40% | 94.62% | ||
| 14 | 39.62% | 58.71% | 14 | 84.58% | 95.47% | ||
| 15 | 82.44% | 98.52% | 15 | 100.00% | 100.00% | ||
| 16 | 66.24% | 94.74% | 16 | 76.97% | 91.52% | ||
| 17 | 58.31% | 83.44% | 17 | 98.52% | 99.96% | ||
| 18 | 82.93% | 88.52% | 18 | 99.89% | 100.00% | ||
| 19 | 49.71% | 84.65% | 19 | 58.98% | 64.17% | ||
| 20 | 67.82% | 96.81% | 20 | 99.96% | 99.99% | ||
| 21 | 84.83% | 97.43% | 21 | 97.19% | 99.70% | ||
| OA | 57.02 ± 1.52% | 81.73 ± 0.86% | OA | 85.89 ± 0.11% | 93.77 ± 0.08% | ||
| AA | 70.26 ± 1.24% | 89.58 ± 1.13% | AA | 93.55 ± 0.16% | 97.31 ± 0.03% | ||
| Kappa | 52.47 ± 2.36% | 80.13 ± 1.26% | Kappa | 83.73 ± 0.13% | 92.68 ± 0.09% | ||
| Params | 4.97 M | 5.03 M | Params | 4.97 M | 5.03 M |
| Method | OA (%) Δ to EMNet | AA (%) Δ to EMNet | Kappa (%) Δ to EMNet |
|---|---|---|---|
| EMNet | 96.41% Δ +0.00 | 96.27% Δ +0.00 | 95.79% Δ +0.00 |
| DGPF | 94.02% Δ −2.39 | 92.60% Δ −3.67 | 92.99% Δ −2.80 |
| Cnn2D | 72.91% Δ −23.50 | 76.63% Δ −19.64 | 69.21% Δ −26.58 |
| FDSSC | 63.29% Δ −33.12 | 56.25% Δ −40.02 | 58.27% Δ −37.52 |
| Vit | 63.03% Δ −33.38 | 60.61% Δ −35.66 | 56.92% Δ −38.87 |
| Sharma | 53.81% Δ −42.60 | 46.33% Δ −49.94 | 47.96% Δ −47.83 |
| Hybrid | 52.28% Δ −44.13 | 62.25% Δ −34.02 | 48.39% Δ −47.40 |
| SVM_g | 42.59% Δ −53.82 | 34.94% Δ −61.33 | 35.64% Δ −60.15 |
| He | 40.62% Δ −55.79 | 32.52% Δ −63.75 | 34.19% Δ −61.60 |
| Lee | 24.27% Δ −72.14 | 27.43% Δ −68.84 | 20.20% Δ −75.59 |
| Method | WHU-Hi-HongHu | Houston2013 | Indian Pines | Weighted Avg. |
|---|---|---|---|---|
| EMNet | 1.000 | 1.000 | 1.000 | 1.000 |
| DGPF | 0.906 | 1.000 | 0.800 | 0.901 |
| Cnn2D | 0.753 | 0.765 | 0.000 | 0.529 |
| FDSSC | 0.180 | 0.765 | 0.471 | 0.433 |
| Vit | 0.180 | 0.379 | 0.471 | 0.324 |
| Sharma | −0.180 | 0.379 | 0.000 | 0.032 |
| Hybrid | 0.180 | 0.379 | 0.471 | 0.324 |
| SVM_g | −0.180 | 0.379 | 0.000 | 0.032 |
| He | −0.180 | 0.379 | 0.000 | 0.032 |
| Lee | 0.508 | 0.765 | 0.250 | 0.503 |
| Method | EMNet | DGPF | Cnn2D | FDSSC | Shar | Vit | Hybrid | He | SVM_g | Lee |
|---|---|---|---|---|---|---|---|---|---|---|
| Rank | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 |
| Average Rank | 1.00 | 2.00 | 4.50 | 4.50 | 5.00 | 5.25 | 7.00 | 7.50 | 8.25 | 10.00 |
| Dataset | Budget | DGPF OA | DGPF CI | EMNet OA | EMNet CI | ΔOA | Cohen’s d |
|---|---|---|---|---|---|---|---|
| OHID-1 | 50 | 59.65 ± 1.09% | [58.87, 60.43] | 80.93 ± 0.45% | [80.61, 81.25] | 21.28 pp | 25.52 |
| OHID-1 | 1% | 84.60 ± 0.11% | [84.52, 84.68] | 93.59 ± 0.08% | [93.53, 93.65] | 8.99 pp | 93.47 |
| Xiongan | 50 | 57.02 ± 1.52% | [55.93, 58.11] | 81.73 ± 0.86% | [81.11, 82.35] | 24.71 pp | 20.01 |
| Xiongan | 1% | 85.89 ± 0.11% | [85.81, 85.97] | 93.77 ± 0.08% | [93.71, 93.83] | 7.88 pp | 81.93 |
| OA | AA | Kappa | |
|---|---|---|---|
| DGPF-RENet(baseline) | 92.43% | 93.04% | 90.53% |
| DGPF-RENet + EGM | 92.71% | 93.14% | 90.86% |
| DGPF-RENet + CFC | 92.41% | 93.12% | 90.51% |
| DGPF-RENet + EGM + CFC | 95.77% | 96.32% | 94.67% |
| OA | AA | Kappa | |
|---|---|---|---|
| CFC | 92.41% | 93.12% | 90.51% |
| CFC + EMG_noAttnFuse | 92.63% | 93.22% | 90.77% |
| CFC + EMG_noTransform | 92.82% | 93.29% | 91.00% |
| CFC + EMG_noAttnFuse_noTransform | 92.64% | 93.16% | 90.78% |
| CFC + EMG | 95.77% | 96.32% | 94.67% |
| OA | AA | Kappa | |
|---|---|---|---|
| EMG | 92.71% | 93.14% | 90.86% |
| EMG + CFC(1) | 92.92% | 93.26% | 91.12% |
| EMG + CFC(2) | 95.77% | 96.32% | 94.67% |
| EMG + CFC(1) + (2) | 92.83% | 93.24% | 91.01% |
| Origin | Rain | Snow | ||||
|---|---|---|---|---|---|---|
| DGPF | Ours | DGPF | Ours | DGPF | Ours | |
| OA | 94.37 ± 0.11% | 96.09 ± 0.11% | 88.46 ± 0.16% | 94.90 ± 0.20% | 82.78 ± 1.03% | 93.73 ± 0.17% |
| AA | 88.74 ± 0.30% | 94.75 ± 0.20% | 76.84 ± 0.58% | 90.83 ± 0.68% | 67.64 ± 1.16% | 88.73 ± 0.21% |
| Kappa | 93.58 ± 0.26% | 95.54 ± 0.13% | 86.88 ± 0.17% | 94.19 ± 0.23% | 80.41 ± 1.18% | 92.86 ± 0.19% |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Ban, H.; Feng, J.; Liu, Z.; Jiang, Y.; Wang, Z.; Liu, J.; Hu, Y.; Lin, Y. When Lie Groups Meet Hyperspectral Images: Equivariant Manifold Network for Few-Shot HSI Classification. Sensors 2026, 26, 2117. https://doi.org/10.3390/s26072117
Ban H, Feng J, Liu Z, Jiang Y, Wang Z, Liu J, Hu Y, Lin Y. When Lie Groups Meet Hyperspectral Images: Equivariant Manifold Network for Few-Shot HSI Classification. Sensors. 2026; 26(7):2117. https://doi.org/10.3390/s26072117
Chicago/Turabian StyleBan, Haolong, Junchao Feng, Zejin Liu, Yue Jiang, Zhenxing Wang, Jialiang Liu, Yaowen Hu, and Yuanshan Lin. 2026. "When Lie Groups Meet Hyperspectral Images: Equivariant Manifold Network for Few-Shot HSI Classification" Sensors 26, no. 7: 2117. https://doi.org/10.3390/s26072117
APA StyleBan, H., Feng, J., Liu, Z., Jiang, Y., Wang, Z., Liu, J., Hu, Y., & Lin, Y. (2026). When Lie Groups Meet Hyperspectral Images: Equivariant Manifold Network for Few-Shot HSI Classification. Sensors, 26(7), 2117. https://doi.org/10.3390/s26072117

