Advances in Machine Learning Approaches for UAV-Based Remote Sensing in Data-Deficient Antarctic Environments
Highlights
- Task-specific methods continue to perform well in small-scale data regimes, but data scarcity means that Antarctic science continues to lag behind broader ML advances;
- A paradigm shift in Earth Observation (EO) towards foundation models is underway, but Antarctic scenes remain largely absent from global datasets and benchmarking efforts.
- Generalist EO models effectively support multimodal and multi-scale inputs, but remain limited by focusing on urban and agricultural satellite data;
- Integrating UAV-based polar data is essential for effective cross-domain adaptation to data-scarce Antarctic environments.
Abstract
1. Introduction
2. Methodology
2.1. Literature Search Strategy
- (“Antarctic*” OR “Arctic” OR “polar”);
- AND (“machine learning” OR “artificial intelligence” OR “AI” OR “deep learning”);
- AND (“remote sensing” OR “UAV” OR “uncrewed aerial vehicle” OR “unmanned aerial vehicle” OR “drone” OR “multispectral” OR “hyperspectral”).
2.2. Data Synthesis and Analysis
- Section 3 examines key factors relating to Antarctic RS, outlining the main problems that give rise to data scarcity.
- Section 4 analyses the challenges and opportunities for various ML methods applicable to RS, ranging from simple, task-specific techniques to computationally expensive and complex generalist methods.
- -
- Section 4.1 summarises manual feature engineering and rule-based strategies that work effectively with small Antarctic datasets;
- -
- Section 4.2 covers traditional ML techniques that remain domain-specific to Antarctic environments and datasets;
- -
- Section 4.3 analyses deep learning techniques adapted from natural language processing and computer vision for spectral data, including neural networks in Section 4.3.1 and transformers in Section 4.3.2; these studies use larger datasets and are discussed outside the polar domain;
- -
- Section 4.4 summarises physics and prior-based methods that incorporate physical laws and domain knowledge for ML techniques;
- -
- Section 4.5 discusses foundation models for EO, focusing on global generalist models that aim for transferability and generalisability across domains, sensors, and tasks.
- Section 5 surveys existing publicly accessible datasets that may be leveraged for techniques discussed previously.
- -
- Section 5.1 summarises large-scale satellite datasets primarily used for transformer-based foundation models that are intended to support pretraining;
- -
- Section 5.2 introduces accessible databases that provide a practical entry point for browsing EO data across many domains;
- -
- Section 5.3 overviews databases that provide access to Antarctic and polar data, including those hosted by Antarctic research organisations.
- Section 6 provides a discussion of these challenges, as well as opportunities for future work.
- Section 7 concludes with a summary of key points.
3. Data Collection for Antarctic Remote Sensing
3.1. Platforms of Data Collection for Antarctic Remote Sensing
3.2. Common Sensor Types for Antarctic Remote Sensing
3.3. Environmental and Technical Challenges for Antarctic Remote Sensing
4. Machine Learning for Remote Sensing
4.1. Manual Feature Engineering and Rule-Based
4.2. Traditional Machine Learning
4.3. Deep Learning
4.3.1. CNNs for Spectral Data
4.3.2. Transformers for Spectral Data
4.4. Physics-Based and Prior-Based Methods
4.5. Foundation Models for Earth Observation
5. Remote Sensing Datasets for Large-Scale Pretraining and Antarctic Fine-Tuning
5.1. Large-Scale EO Datasets
5.2. Global Dataset Databases
5.3. Antarctic Databases
6. Discussion
6.1. Key Unresolved Challenges
6.2. Emerging Opportunities and Implications
6.3. Priority Directions for Future Work
7. Conclusions
Author Contributions
Funding
Data Availability Statement
Acknowledgments
Conflicts of Interest
Abbreviations
| AADC | Australian Antarctic Data Centre |
| ADD | Antarctic Digital Database |
| AEF | AlphaEarth Foundations |
| AMD | Antarctic Metadata Directory |
| BAS | British Antarctic Survey |
| BRDF | Bidirectional Reflectance Distribution Function |
| CNN | Convolutional Neural Network |
| DEM | Digital Elevation Model |
| DOFA | Dynamic One-For-All |
| EO | Earth Observation |
| EOD | Earth Observation Database |
| EO-1 | Earth Observing-1 satellite |
| ESA | European Space Agency |
| fMoW | Functional Map of the World |
| FRM | Feature Reconstruction Module |
| GCN | Graph Convolutional Network |
| GF | Gaofen-5 satellite |
| GMM | Gaussian Mixture Model |
| GPT | Generative Pretrained Transformer |
| GRSS | The Geoscience and Remote Sensing Society |
| HSI | Hyperspectral Imaging |
| IEE | Institute of Electrical and Electronics Engineers |
| KNN | K-Nearest Neighbour |
| MAE | Masked Autoencoder |
| MIM | Masked Image Modelling |
| ML | Machine Learning |
| MLC | Maximum Likelihood Classifier |
| MLP | Multilayer Perceptron |
| MNF | Minimum Noise Fraction |
| MSI | Multispectral Imaging |
| MSSSFF | Multi-Scale Spatial–Spectral Feature Fusion |
| NADC | National Antarctic Data Centre |
| NASA | National Aeronautics and Space Administration |
| NIR | Near-Infrared |
| NDSI | Normalised Difference Snow Index |
| NDVI | Normalised Difference Vegetation Index |
| NSIDC | National Snow and Ice Data Center |
| NPDC | Norwegian Polar Data Centre |
| PDE | Partial Differential Equation |
| PPI | Pixel Purity Index |
| PIML | Physics-Informed Machine Learning |
| PINN | Physics-Informed Neural Network |
| RF | Random Forest |
| RGB | Red–Green–Blue |
| RS | Remote Sensing |
| RTB | Reduced Transformer Block |
| RTM | Radiative Transfer Model |
| SAC | Spectral Angle Classifier |
| SAM | Spectral Angle Mapper |
| SAR | Synthetic Aperture Radar |
| SCAR | Scientific Committee on Antarctic Research |
| SDI | Snow Darkening Index |
| SOOS | Southern Ocean Observing System |
| SRF | Spectral Response Function |
| SSR | Spectral Super-Resolution |
| STP | Space Time Precision |
| VM | Support Vector Machine |
| TiM | Thinking in Modalities |
| TVI | Triangular Vegetation Index |
| UAV | Uncrewed Aerial Vehicle |
| UTM | Universal Transverse Mercator |
| ViT | Vision Transformer |
References
- Burrows, J.L.; Lee, J.R.; Wilson, K.A. Evaluating the Conservation Impact of Antarctica’s Protected Areas. Conserv. Biol. 2023, 37, e14059. [Google Scholar] [CrossRef]
- Raniga, D.; Amarasingam, N.; Sandino, J.; Doshi, A.; Barthelemy, J.; Randall, K.; Robinson, S.A.; Gonzalez, F.; Bollard, B. Monitoring of Antarctica’s Fragile Vegetation Using Drone-Based Remote Sensing, Multispectral Imagery and AI. Sensors 2024, 24, 1063. [Google Scholar] [CrossRef]
- Anderson, R.; Chown, S.; Leihy, R. Continent-Wide Analysis of Moss Diversity in Antarctica. Ecography 2025, 2025, e07353. [Google Scholar] [CrossRef]
- Sandino, J.; Bollard, B.; Doshi, A.; Randall, K.; Barthelemy, J.; Robinson, S.A.; Gonzalez, F. A Green Fingerprint of Antarctica: Drones, Hyperspectral Imaging, and Machine Learning for Moss and Lichen Classification. Remote Sens. 2023, 15, 5658. [Google Scholar] [CrossRef]
- Pertierra, L.R.; Convey, P.; Barbosa, A.; Biersma, E.M.; Cowan, D.; Diniz-Filho, J.A.F.; de los Ríos, A.; Escribano-Álvarez, P.; Fraser, C.I.; Fontaneto, D.; et al. Advances and Shortfalls in Knowledge of Antarctic Terrestrial and Freshwater Biodiversity. Science 2025, 387, 609–615. [Google Scholar] [CrossRef] [PubMed]
- Pina, P.; Vieira, G. UAVs for Science in Antarctica. Remote Sens. 2022, 14, 1610. [Google Scholar] [CrossRef]
- Bollard, B.; Doshi, A.; Gilbert, N.; Poirot, C.; Gillman, L. Drone Technology for Monitoring Protected Areas in Remote and Fragile Environments. Drones 2022, 6, 42. [Google Scholar] [CrossRef]
- Lockhart, K.; Sandino, J.; Amarasingam, N.; Hann, R.; Bollard, B.; Gonzalez, F. Unmanned Aerial Vehicles for Real-Time Vegetation Monitoring in Antarctica: A Review. Remote Sens. 2025, 17, 304. [Google Scholar] [CrossRef]
- Sandino, J.; Barthelemy, J.; Doshi, A.; Randall, K.; Robinson, S.A.; Bollard, B.; Gonzalez, F. Drone Hyperspectral Imaging and Artificial Intelligence for Monitoring Moss and Lichen in Antarctica. Sci. Rep. 2025, 15, 27244. [Google Scholar] [CrossRef]
- Robinson, S.A.; Clarke, L.J.; King, D.; Ayre, D.J.; Hua, Q.; Fink, D.; Lucieer, A. Monitoring Impacts of a Changing Climate on Plant Communities of Continental Antarctica. In Proceedings of the British Ecological Society (BES) Annual Meeting 2010, Leeds, UK, 7–9 September 2010; University of Leeds: Leeds, UK, 2010. [Google Scholar]
- Amarasingam, N.; Sandino, J.; Doshi, A.; King, D.; Blackman, E.; Barthelemy, J.; Bollard, B.; Robinson, S.A.; Gonzalez, F. Detection and Mapping of Antarctic Lichen Using Drones, Multispectral Cameras, and Supervised Deep Learning. Int. J. Appl. Earth Obs. Geoinf. 2025, 141, 104577. [Google Scholar] [CrossRef]
- Platel, A.; Sandino, J.; Shaw, J.; Bollard, B.; Gonzalez, F. Advancing Sparse Vegetation Monitoring in the Arctic and Antarctic: A Review of Satellite and UAV Remote Sensing, Machine Learning, and Sensor Fusion. Remote Sens. 2025, 17, 1513. [Google Scholar] [CrossRef]
- Zhu, L.; Wu, J.; Biao, W.; Liao, Y.; Gu, D. SpectralMAE: Spectral Masked Autoencoder for Hyperspectral Remote Sensing Image Reconstruction. Sensors 2023, 23, 3728. [Google Scholar] [CrossRef]
- Yang, Y.; Zhao, H.; Huangfu, X.; Li, Z.; Wang, P. ViT-ISRGAN: A High-Quality Super-Resolution Reconstruction Method for Multispectral Remote Sensing Images. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2025, 18, 3973–3988. [Google Scholar] [CrossRef]
- Mohamed, S.; Haghighat, M.; Fernando, T.; Sridharan, S.; Fookes, C.; Moghadam, P. FactoFormer: Factorized Hyperspectral Transformers with Self-Supervised Pretraining. IEEE Trans. Geosci. Remote Sens. 2023, 62, 5501614. [Google Scholar] [CrossRef]
- Hong, D.; Han, Z.; Yao, J.; Gao, L.; Zhang, B.; Plaza, A.; Chanussot, J. SpectralFormer: Rethinking Hyperspectral Image Classification with Transformers. IEEE Trans. Geosci. Remote Sens. 2022, 60, 5518615. [Google Scholar] [CrossRef]
- Zhao, G.; He, Y.; Wang, Z.; Wu, H. Hybrid Transformer Architecture for Spectral Super-Resolution Reconstruction of Multispectral Images. In Proceedings of the IGARSS 2024—2024 IEEE International Geoscience and Remote Sensing Symposium, Athens, Greece, 7–12 July 2024; IEEE: New York, NY, USA, 2024; pp. 9468–9471. [Google Scholar] [CrossRef]
- Hong, D.; Zhang, B.; Li, X.; Li, Y.; Li, C.; Yao, J.; Yokoya, N.; Li, H.; Ghamisi, P.; Jia, X.; et al. SpectralGPT: Spectral Remote Sensing Foundation Model. IEEE Trans. Pattern Anal. Mach. Intell. 2024, 46, 5227–5244. [Google Scholar] [CrossRef]
- Xiong, Z.; Wang, Y.; Zhang, F.; Stewart, A.J.; Hanna, J.; Borth, D.; Papoutsis, I.; Saux, B.L.; Camps-Valls, G.; Zhu, X.X. Neural Plasticity-Inspired Multimodal Foundation Model for Earth Observation. arXiv 2024, arXiv:2403.15356. [Google Scholar] [CrossRef]
- Zhao, Z.; Ding, X.; Prakash, B.A. PINNsFormer: A Transformer-Based Framework for Physics-Informed Neural Networks. arXiv 2024, arXiv:2307.11833. [Google Scholar] [CrossRef]
- Tseng, G.; Fuller, A.; Reil, M.; Herzog, H.; Beukema, P.; Bastani, F.; Green, J.R.; Shelhamer, E.; Kerner, H.; Rolnick, D. Galileo: Learning Global & Local Features of Many Remote Sensing Modalities. arXiv 2025, arXiv:2502.09356. [Google Scholar] [CrossRef]
- Astruc, G.; Gonthier, N.; Mallet, C.; Landrieu, L. AnySat: One Earth Observation Model for Many Resolutions, Scales, and Modalities. In Proceedings of the 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA, 10–17 June 2025; IEEE: New York, NY, USA, 2025; pp. 19530–19540. [Google Scholar] [CrossRef]
- Wang, Q.; Doulgeris, A.P.; Eltoft, T. Physics-Aware Training Data to Improve Machine Learning for Sea Ice Classification from Sentinel-1 SAR Scenes. In Proceedings of the IGARSS 2022—2022 IEEE International Geoscience and Remote Sensing Symposium, Kuala Lumpur, Malaysia, 17–22 July 2022; IEEE: New York, NY, USA, 2022; pp. 4992–4995. [Google Scholar] [CrossRef]
- Jakubik, J.; Yang, F.; Blumenstiel, B.; Scheurer, E.; Sedona, R.; Maurogiovanni, S.; Bosmans, J.; Dionelis, N.; Marsocci, V.; Kopp, N.; et al. TerraMind: Large-Scale Generative Multimodality for Earth Observation. arXiv 2025, arXiv:2504.11171. [Google Scholar] [CrossRef]
- Brown, C.F.; Kazmierski, M.R.; Pasquarella, V.J.; Rucklidge, W.J.; Samsikova, M.; Zhang, C.; Shelhamer, E.; Lahera, E.; Wiles, O.; Ilyushchenko, S.; et al. AlphaEarth Foundations: An Embedding Field Model for Accurate and Efficient Global Mapping from Sparse Label Data. arXiv 2025, arXiv:2507.22291. [Google Scholar] [CrossRef]
- Maslanik, J.A.; Barry, R.G. Remote Sensing in Antarctica and the Southern Ocean: Applications and Developments. Antarct. Sci. 1990, 2, 105–121. [Google Scholar] [CrossRef]
- Husman, S.d.R.; Hu, Z.; Wouters, B.; Munneke, P.K.; Veldhuijsen, S.; Lhermitte, S. Remote Sensing of Surface Melt on Antarctica: Opportunities and Challenges. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2023, 16, 2462–2480. [Google Scholar] [CrossRef]
- Marques, A.L.; Moraes, M.M.; Arantes, R.M.E. Mapping Research Paths and Perspectives over the Fieldwork of Human Physiology in Antarctica: Reflections on the Integration of Science, Environment, and Subjectivity. An. Acad. Bras. Ciênc. 2022, 94, e20210396. [Google Scholar] [CrossRef] [PubMed]
- Ren, G.; Wang, J.; Lu, Y.; Wu, P.; Lu, X.; Chen, C.; Ma, Y. Monitoring Changes to Arctic Vegetation and Glaciers at Ny-Ålesund, Svalbard, Based on Time Series Remote Sensing. Remote Sens. 2021, 13, 3845. [Google Scholar] [CrossRef]
- Stewart, A.; Lehmann, N.; Corley, I.; Wang, Y.; Chang, Y.C.; Ait Ali Braham, N.A.; Sehgal, S.; Robinson, C.; Banerjee, A. SSL4EO-L: Datasets and Foundation Models for Landsat Imagery. In Proceedings of the Advances in Neural Information Processing Systems; Oh, A., Naumann, T., Globerson, A., Saenko, K., Hardt, M., Levine, S., Eds.; Curran Associates, Inc.: Red Hook, NY, USA, 2023; Volume 36, pp. 59787–59807. [Google Scholar] [CrossRef]
- Cannone, N.; Guglielmin, M.; Ponti, S. Suitability and Limitations of Ground-Based Imagery and Thermography for Long-Term Monitoring of Vegetation Changes in Victoria Land (Continental Antarctica). Ecol. Indic. 2023, 156, 111080. [Google Scholar] [CrossRef]
- Li, Y.; Qiao, G.; Popov, S.; Cui, X.; Florinsky, I.V.; Yuan, X.; Wang, L. Unmanned Aerial Vehicle Remote Sensing for Antarctic Research: A Review of Progress, Current Applications, and Future Use Cases. IEEE Geosci. Remote Sens. Mag. 2023, 11, 73–93. [Google Scholar] [CrossRef]
- Román, A.; Navarro, G.; Caballero, I.; Tovar-Sánchez, A. High-Spatial Resolution UAV Multispectral Data Complementing Satellite Imagery to Characterize a Chinstrap Penguin Colony Ecosystem on Deception Island (Antarctica). GISci. Remote Sens. 2022, 59, 1159–1176. [Google Scholar] [CrossRef]
- Román, A.; Tovar-Sánchez, A.; Fernández-Marín, B.; Navarro, G.; Barbero, L. Characterization of an Antarctic Penguin Colony Ecosystem Using High-Resolution UAV Hyperspectral Imagery. Int. J. Appl. Earth Obs. Geoinf. 2023, 125, 103565. [Google Scholar] [CrossRef]
- Moghadam, P.; Ward, D.; Goan, E.; Jayawardena, S.; Sikka, P.; Hernandez, E. Plant disease detection using hyperspectral imaging. In Proceedings of the 2017 International Conference on Digital Image Computing: Techniques and Applications (DICTA), Sydney, Australia, 29 November–1 December 2017; IEEE: New York, NY, USA, 2017; pp. 1–8. [Google Scholar]
- Jung, S.H.; Kwon, S.; Seo, I.W.; Kim, J.S. Comparison between Hyperspectral and Multispectral Retrievals of Suspended Sediment Concentration in Rivers. Water 2024, 16, 1275. [Google Scholar] [CrossRef]
- Manolakis, D.G.; Lockwood, R.B.; Cooley, T.W. Hyperspectral Imaging Remote Sensing: Physics, Sensors, and Algorithms, 1st ed.; Cambridge University Press: Cambridge, UK, 2016. [Google Scholar] [CrossRef]
- Fang, Z.; Savkin, A.V.; Fang, Z.; Savkin, A.V. Strategies for Optimized UAV Surveillance in Various Tasks and Scenarios: A Review. Drones 2024, 8, 193. [Google Scholar] [CrossRef]
- Huang, W.; Yu, A.; Xu, Q.; Sun, Q.; Guo, W.; Ji, S.; Wen, B.; Qiu, C.; Huang, W.; Yu, A.; et al. Sea Ice Extraction via Remote Sensing Imagery: Algorithms, Datasets, Applications and Challenges. Remote Sens. 2024, 16, 842. [Google Scholar] [CrossRef]
- Lampert, A.; Altstädter, B.; Bärfuss, K.; Bretschneider, L.; Sandgaard, J.; Michaelis, J.; Lobitz, L.; Asmussen, M.; Damm, E.; Käthner, R.; et al. Unmanned Aerial Systems for Investigating the Polar Atmospheric Boundary Layer—Technical Challenges and Examples of Applications. Atmosphere 2020, 11, 416. [Google Scholar] [CrossRef]
- Lucieer, A.; Turner, D.; King, D.H.; Robinson, S.A. Using an Unmanned Aerial Vehicle (UAV) to Capture Micro-Topography of Antarctic Moss Beds. Int. J. Appl. Earth Obs. Geoinf. 2014, 27, 53–62. [Google Scholar] [CrossRef]
- Attard, M.R.G.; Phillips, R.A.; Bowler, E.; Clarke, P.J.; Cubaynes, H.; Johnston, D.W.; Fretwell, P.T.; Attard, M.R.G.; Phillips, R.A.; Bowler, E.; et al. Review of Satellite Remote Sensing and Unoccupied Aircraft Systems for Counting Wildlife on Land. Remote Sens. 2024, 16, 627. [Google Scholar] [CrossRef]
- Bindschadler, R.; Vornberger, P.; Fleming, A.; Fox, A.; Mullins, J.; Binnie, D.; Paulsen, S.J.; Granneman, B.; Gorodetzky, D. The Landsat Image Mosaic of Antarctica. Remote Sens. Environ. 2008, 112, 4214–4226. [Google Scholar] [CrossRef]
- Black, M.; Fleming, A.; Riley, T.; Ferrier, G.; Fretwell, P.; McFee, J.; Achal, S.; Diaz, A.U.; Black, M.; Fleming, A.; et al. On the Atmospheric Correction of Antarctic Airborne Hyperspectral Data. Remote Sens. 2014, 6, 4498–4514. [Google Scholar] [CrossRef]
- Maniraj, S.P.; Rose, J.D.; Arunachalam, R.; Rangasamy, K.; Patil, V.R.; Kathirvelu, S. Polar Region Climate Dynamics: Deep Learning and Remote Sensing Integration for Monitoring Arctic and Antarctic Changes. Remote Sens. Earth Syst. Sci. 2024, 7, 582–595. [Google Scholar] [CrossRef]
- Zhao, C.; Kang, S.; Fan, Y.; Wang, Y.; He, Z.; Tan, Z.; Gao, Y.; Zhang, T.; He, Y.; Fan, Y.; et al. Unmanned Aerial Vehicle Technology for Glaciology Research in the Third Pole. Drones 2025, 9, 254. [Google Scholar] [CrossRef]
- Qi, M.; Gadd, M.; De Martini, D.; Davis, K.J.; Xiong, B.; Rosen, A.; Krishna Moorthy, S.M.; Hawes, N.; Salguero-Gómez, R. Biodiversity Research Requires More Motors in Air, Water and on Land. Methods Ecol. Evol. 2025, 1–15. [Google Scholar] [CrossRef]
- Huovinen, P.; Ramírez, J.; Gómez, I. Remote Sensing of Albedo-Reducing Snow Algae and Impurities in the Maritime Antarctica. ISPRS J. Photogramm. Remote Sens. 2018, 146, 507–517. [Google Scholar] [CrossRef]
- Chen, T.; Guestrin, C. XGBoost: A Scalable Tree Boosting System. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, New York, NY, USA, 13–17 August 2016; ACM: New York, NY, USA, 2016; pp. 785–794. [Google Scholar] [CrossRef]
- Ronneberger, O.; Fischer, P.; Brox, T. U-Net: Convolutional Networks for Biomedical Image Segmentation. In Proceedings of the Medical Image Computing and Computer-Assisted Intervention (MICCAI 2015); Springer: Berlin/Heidelberg, Germany, 2015; Volume 9351, pp. 234–241. [Google Scholar] [CrossRef]
- Hong, D.; Gao, L.; Yao, J.; Zhang, B.; Plaza, A.; Chanussot, J. Graph Convolutional Networks for Hyperspectral Image Classification. IEEE Trans. Geosci. Remote Sens. 2021, 59, 5966–5978. [Google Scholar] [CrossRef]
- Blair, J.D.; Gaynor, K.M.; Palmer, M.S.; Marshall, K.E. A Gentle Introduction to Computer Vision-Based Specimen Classification in Ecological Datasets. J. Anim. Ecol. 2024, 93, 147–158. [Google Scholar] [CrossRef] [PubMed]
- Wang, Y.; Wen, M.; Zhang, H.; Sun, J.; Yang, Q.; Zhang, Z.; Lu, H. HSIMAE: A Unified Masked Autoencoder with Large-Scale Pretraining for Hyperspectral Image Classification. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2024, 17, 14064–14079. [Google Scholar] [CrossRef]
- Ibañez, D.; Fernandez-Beltran, R.; Pla, F.; Yokoya, N. Masked Auto-Encoding Spectral–Spatial Transformer for Hyperspectral Image Classification. IEEE Trans. Geosci. Remote Sens. 2022, 60, 5542614. [Google Scholar] [CrossRef]
- Li, J.; Wu, C.; Song, R.; Li, Y.; Liu, F. Adaptive Weighted Attention Network with Camera Spectral Sensitivity Prior for Spectral Reconstruction from RGB Images. In Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Seattle, WA, USA, 14–19 June 2020; IEEE: New York, NY, USA, 2020; pp. 1894–1903. [Google Scholar] [CrossRef]
- Mahendren, S.; Fernando, T.; Sridharan, S.; Moghadam, P.; Fookes, C. Reduction of feature contamination for hyper spectral image classification. In Proceedings of the 2021 Digital Image Computing: Techniques and Applications (DICTA), Gold Coast, Australia, 29 November–1 December 2021; IEEE: New York, NY, USA, 2021; pp. 1–8. [Google Scholar]
- Zhao, Y.; Po, L.M.; Yan, Q.; Liu, W.; Lin, T. Hierarchical Regression Network for Spectral Reconstruction from RGB Images. In Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Seattle, WA, USA, 14–19 June 2020; IEEE: New York, NY, USA, 2020; pp. 1695–1704. [Google Scholar] [CrossRef]
- Xiong, Z.; Shi, Z.; Li, H.; Wang, L.; Liu, D.; Wu, F. HSCNN: CNN-Based Hyperspectral Image Recovery from Spectrally Undersampled Projections. In Proceedings of the 2017 IEEE International Conference on Computer Vision Workshops (ICCVW), Venice, Italy, 22–29 October 2017; IEEE: New York, NY, USA, 2017; pp. 518–525. [Google Scholar] [CrossRef]
- Shi, Z.; Chen, C.; Xiong, Z.; Liu, D.; Wu, F. HSCNN+: Advanced CNN-Based Hyperspectral Recovery from RGB Images. In Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Salt Lake City, UT, USA, 18–22 June 2018; IEEE: New York, NY, USA, 2018; pp. 1052–10528. [Google Scholar] [CrossRef]
- Roy, S.K.; Kar, P.; Hong, D.; Wu, X.; Plaza, A.; Chanussot, J. Revisiting Deep Hyperspectral Feature Extraction Networks via Gradient Centralized Convolution. IEEE Trans. Geosci. Remote Sens. 2022, 60, 5516619. [Google Scholar] [CrossRef]
- Vaswani, A.; Shazeer, N.; Parmar, N.; Uszkoreit, J.; Jones, L.; Gomez, A.N.; Kaiser, L.; Polosukhin, I. Attention Is All You Need. In Proceedings of the 31st International Conference on Neural Information Processing Systems (NIPS’17), Long Beach, CA, USA, 4–9 December 2017; NIPS: La Jolla, CA, USA, 2017; pp. 6000–6010. [Google Scholar]
- Dosovitskiy, A.; Beyer, L.; Kolesnikov, A.; Weissenborn, D.; Zhai, X.; Unterthiner, T.; Dehghani, M.; Minderer, M.; Heigold, G.; Gelly, S.; et al. An Image Is Worth 16 × 16 Words: Transformers for Image Recognition at Scale. arXiv 2021, arXiv:2010.11929. [Google Scholar] [CrossRef]
- Mohamed, S.; Fernando, T.; Sridharan, S.; Moghadam, P.; Fookes, C. Dual-Domain Masked Image Modeling: A Self-Supervised Pretraining Strategy Using Spatial and Frequency Domain Masking for Hyperspectral Data. In Proceedings of the IGARSS 2025—IEEE International Geoscience and Remote Sensing Symposium, Brisbane, Australia, 3–8 August 2025; IEEE: New York, NY, USA, 2025. [Google Scholar]
- Li, Z.; Li, L.; Liu, B.; Cao, Y.; Zhou, W.; Ni, W.; Yang, Z. Spectral-Learning-Based Transformer Network for the Spectral Super-Resolution of Remote-Sensing Degraded Images. IEEE Geosci. Remote Sens. Lett. 2023, 20, 5505705. [Google Scholar] [CrossRef]
- Ji, R.; Tan, K.; Wang, X.; Tang, S.; Sun, J.; Niu, C.; Pan, C. PatchOut: A Novel Patch-Free Approach Based on a Transformer-CNN Hybrid Framework for Fine-Grained Land-Cover Classification on Large-Scale Airborne Hyperspectral Images. Int. J. Appl. Earth Obs. Geoinf. 2025, 138, 104457. [Google Scholar] [CrossRef]
- Raza, A.; Hanif, F.; Mohammed, H.A. Analyzing the Enhancement of CNN-YOLO and Transformer Based Architectures for Real-Time Animal Detection in Complex Ecological Environments. Sci. Rep. 2025, 15, 39142. [Google Scholar] [CrossRef]
- Karniadakis, G.E.; Kevrekidis, I.G.; Lu, L.; Perdikaris, P.; Wang, S.; Yang, L. Physics-Informed Machine Learning. Nat. Rev. Phys. 2021, 3, 422–440. [Google Scholar] [CrossRef]
- Nghiem, T.X.; Drgoňa, J.; Jones, C.; Nagy, Z.; Schwan, R.; Dey, B.; Chakrabarty, A.; Di Cairano, S.; Paulson, J.A.; Carron, A.; et al. Physics-Informed Machine Learning for Modeling and Control of Dynamical Systems. In Proceedings of the 2023 American Control Conference (ACC), San Diego, CA, USA, 31 May–2 June 2023; IEEE: New York, NY, USA, 2023; pp. 3735–3750. [Google Scholar] [CrossRef]
- Yu, R.; Qiu, C.; Ladwig, R.; Hanson, P.; Xie, Y.; Jia, X. Physics-Guided Foundation Model for Scientific Discovery: An Application to Aquatic Science. In Proceedings of the Thirty-Ninth AAAI Conference on Artificial Intelligence and Thirty-Seventh Conference on Innovative Applications of Artificial Intelligence and Fifteenth Symposium on Educational Advances in Artificial Intelligence (AAAI’25/IAAI’25/EAAI’25); AAAI Press: Washington, DC, USA, 2025; Volume 39, pp. 28548–28556. [Google Scholar] [CrossRef]
- Bai, J.; Alzubaidi, L.; Wang, Q.; Kuhl, E.; Bennamoun, M.; Gu, Y. Utilising Physics-Guided Deep Learning to Overcome Data Scarcity. arXiv 2022, arXiv:2211.15664. [Google Scholar] [CrossRef]
- Zhang, J.; Su, R.; Fu, Q.; Ren, W.; Heide, F.; Nie, Y. A Survey on Computational Spectral Reconstruction Methods from RGB to Hyperspectral Imaging. Sci. Rep. 2022, 12, 11905. [Google Scholar] [CrossRef] [PubMed]
- Liu, Z.; Rahnemoonfar, M. Physics-Informed Spatio-Temporal Graph Neural Network for Efficient Deep Ice Layer Thickness Estimation in Radar Imagery. In Proceedings of the 2025 IEEE International Radar Conference (RADAR), Atlanta, GA, USA, 3–9 May 2025; IEEE: New York, NY, USA, 2025; pp. 1–6. [Google Scholar] [CrossRef]
- Rahnemoonfar, M.; Zalatan, B. Physics-Informed Machine Learning for Deep Ice Layer Tracing in SAR Images. In Proceedings of the IGARSS 2024—2024 IEEE International Geoscience and Remote Sensing Symposium, Athens, Greece, 7–12 July 2024; IEEE: New York, NY, USA, 2024; pp. 6938–6942. [Google Scholar] [CrossRef]
- Banerjee, C.; Nguyen, K.; Fookes, C.; George, K. Physics-Informed Computer Vision: A Review and Perspectives. ACM Comput. Surv. 2024, 57, 17:1–17:38. [Google Scholar] [CrossRef]
- Li, Z.; Xue, Z.; Jia, M.; Nie, X.; Wu, H.; Zhang, M.; Su, H. DEMAE: Diffusion-Enhanced Masked Autoencoder for Hyperspectral Image Classification with Few Labeled Samples. IEEE Trans. Geosci. Remote Sens. 2024, 62, 5527616. [Google Scholar] [CrossRef]
- Varshney, D.; Ibikunle, O.; Paden, J.; Rahnemoonfar, M. Learning Snow Layer Thickness Through Physics Defined Labels. In Proceedings of the IGARSS 2022—2022 IEEE International Geoscience and Remote Sensing Symposium, Kuala Lumpur, Malaysia, 17–22 July 2022; IEEE: New York, NY, USA, 2022; pp. 1233–1236. [Google Scholar] [CrossRef]
- Deng, J.; Dong, W.; Socher, R.; Li, L.J.; Li, K.; Fei-Fei, L. ImageNet: A Large-Scale Hierarchical Image Database. In Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA, 20–25 June 2009; IEEE: New York, NY, USA, 2009; pp. 248–255. [Google Scholar] [CrossRef]
- Lee, G.Y.; Dam, T.; Ferdaus, M.M.; Poenar, D.P.; Duong, V.N. Unlocking the Capabilities of Explainable Few-Shot Learning in Remote Sensing. Artif. Intell. Rev. 2024, 57, 169. [Google Scholar] [CrossRef]
- Wang, D.; Hu, M.; Jin, Y.; Miao, Y.; Yang, J.; Xu, Y.; Qin, X.; Ma, J.; Sun, L.; Li, C.; et al. HyperSIGMA: Hyperspectral Intelligence Comprehension Foundation Model. IEEE Trans. Pattern Anal. Mach. Intell. 2025, 47, 6427–6444. [Google Scholar] [CrossRef]
- Helber, P.; Bischke, B.; Dengel, A.; Borth, D. Introducing Eurosat: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classification. In Proceedings of the IGARSS 2018—2018 IEEE International Geoscience and Remote Sensing Symposium, Valencia, Spain, 22–27 July 2018; IEEE: New York, NY, USA, 2018; pp. 204–207. [Google Scholar] [CrossRef]
- Christie, G.; Fendley, N.; Wilson, J.; Mukherjee, R. Functional Map of the World. In Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA, 18–23 June 2018; IEEE: New York, NY, USA, 2018; pp. 6172–6180. [Google Scholar] [CrossRef]
- Sumbul, G.; Charfuelan, M.; Demir, B.; Markl, V. Bigearthnet: A Large-Scale Benchmark Archive for Remote Sensing Image Understanding. In Proceedings of the IGARSS 2019—2019 IEEE International Geoscience and Remote Sensing Symposium, Yokohama, Japan, 28 July–2 August 2019; IEEE: New York, NY, USA, 2019; pp. 5901–5904. [Google Scholar] [CrossRef]
- Haghighat, M.; Moghadam, P.; Mohamed, S.; Koniusz, P. Pre-training with random orthogonal projection image modeling. In Proceedings of the 12th International Conference on Learning Representations, ICLR 2024, Vienna, Austria, 7–11 May 2024. [Google Scholar]
- Schmitt, M.; Ahmadi, S.A.; Xu, Y.; Taşkin, G.; Verma, U.; Sica, F.; Hänsch, R. There Are No Data Like More Data: Datasets for Deep Learning in Earth Observation. IEEE Geosci. Remote Sens. Mag. 2023, 11, 63–97. [Google Scholar] [CrossRef]
- Roscher, R.; Russwurm, M.; Gevaert, C.; Kampffmeyer, M.; Dos Santos, J.A.; Vakalopoulou, M.; Hänsch, R.; Hansen, S.; Nogueira, K.; Prexl, J.; et al. Better, Not Just More: Data-centric Machine Learning for Earth Observation. IEEE Geosci. Remote Sens. Mag. 2024, 12, 335–355. [Google Scholar] [CrossRef]
- Xiao, A.; Xuan, W.; Wang, J.; Huang, J.; Tao, D.; Lu, S.; Yokoya, N. Foundation Models for Remote Sensing and Earth Observation: A Survey. IEEE Geosci. Remote Sens. Mag. 2025, 13, 297–324. [Google Scholar] [CrossRef]
- Sumbul, G.; de Wall, A.; Kreuziger, T.; Marcelino, F.; Costa, H.; Benevides, P.; Caetano, M.; Demir, B.; Markl, V. BigEarthNet-MM: A Large-Scale, Multimodal, Multilabel Benchmark Archive for Remote Sensing Image Classification and Retrieval [Software and Data Sets]. IEEE Geosci. Remote Sens. Mag. 2021, 9, 174–180. [Google Scholar] [CrossRef]
- Wang, Y.; Braham, N.A.A.; Xiong, Z.; Liu, C.; Albrecht, C.M.; Zhu, X.X. SSL4EO-S12: A Large-Scale Multimodal, Multitemporal Dataset for Self-Supervised Learning in Earth Observation [Software and Data Sets]. IEEE Geosci. Remote Sens. Mag. 2023, 11, 98–106. [Google Scholar] [CrossRef]
- Braham, N.A.A.; Albrecht, C.M.; Mairal, J.; Chanussot, J.; Wang, Y.; Zhu, X.X. SpectralEarth: Training Hyperspectral Foundation Models at Scale. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2025, 18, 16780–16797. [Google Scholar] [CrossRef]
- Velazquez, D.; López, P.R.; Alonso, S.; Gonfaus, J.M.; Gonzalez, J.; Richarte, G.; Marin, J.; Bengio, Y.; Lacoste, A. EarthView: A Large Scale Remote Sensing Dataset for Self-Supervision. In Proceedings of the 2025 IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW), Tucson, AZ, USA, 28 February–4 March 2025; IEEE: New York, NY, USA, 2025; pp. 1138–1147. [Google Scholar] [CrossRef]
- Schmitt, M.; Ghamisi, P.; Yokoya, N.; Hänsch, R. EOD: The IEEE GRSS Earth Observation Database. arXiv 2022, arXiv:2209.12480. [Google Scholar] [CrossRef]
- Lowe, S.C.; Misiuk, B.; Xu, I.; Abdulazizov, S.; Baroi, A.R.; Bastos, A.C.; Best, M.; Ferrini, V.; Friedman, A.; Hart, D.; et al. BenthicNet: A Global Compilation of Seafloor Images for Deep Learning Applications. Sci. Data 2025, 12, 230. [Google Scholar] [CrossRef] [PubMed]
- Cox, S.C.; Smith Lyttle, B.; Elkind, S.; Smith Siddoway, C.; Morin, P.; Capponi, G.; Abu-Alam, T.; Ballinger, M.; Bamber, L.; Kitchener, B.; et al. A Continent-Wide Detailed Geological Map Dataset of Antarctica. Sci. Data 2023, 10, 250. [Google Scholar] [CrossRef] [PubMed]
- Jiang, A.; Meng, X.; Huang, Y.; Shi, G. Using Deep Learning and Multi-Source Remote Sensing Images to Map Landlocked Lakes in Antarctica. Cryosphere 2024, 18, 5347–5364. [Google Scholar] [CrossRef]
- Xie, H.; He, S.; Cheng, X. A Convolution Neural Network-based Method for Sea Ice Remote Sensing Using GNSS-R Data. In Proceedings of the 2022 4th International Conference on Communications, Information System and Computer Engineering (CISCE), Shenzhen, China, 27–29 May 2022; IEEE: New York, NY, USA, 2022; pp. 284–289. [Google Scholar] [CrossRef]
- Ali, S.; Wang, J. MT-IceNet—A Spatial and Multi-Temporal Deep Learning Model for Arctic Sea Ice Forecasting. In Proceedings of the 2022 IEEE/ACM International Conference on Big Data Computing, Applications and Technologies (BDCAT), Vancouver, WA, USA, 6–9 December 2022; IEEE: New York, NY, USA, 2022; pp. 1–10. [Google Scholar] [CrossRef]
- Ren, Y.; Li, X. Predicting the Daily Sea Ice Concentration on a Subseasonal Scale of the Pan-Arctic During the Melting Season by a Deep Learning Model. IEEE Trans. Geosci. Remote Sens. 2023, 61, 4301315. [Google Scholar] [CrossRef]
- Shen, X.; Ke, C.Q.; Li, H. Snow Depth Product over Antarctic Sea Ice from 2002 to 2020 Using Multisource Passive Microwave Radiometers. Earth Syst. Sci. Data 2022, 14, 619–636. [Google Scholar] [CrossRef]
- Marsocci, V.; Jia, Y.; Bellier, G.L.; Kerekes, D.; Zeng, L.; Hafner, S.; Gerard, S.; Brune, E.; Yadav, R.; Shibli, A.; et al. PANGAEA: A Global and Inclusive Benchmark for Geospatial Foundation Models. arXiv 2025, arXiv:2412.04204. [Google Scholar] [CrossRef]
- Ghamisi, P.; Yu, W.; Marinoni, A.; Gevaert, C.M.; Persello, C.; Selvakumaran, S.; Girotto, M.; Horton, B.P.; Rufin, P.; Hostert, P.; et al. Responsible Artificial Intelligence for Earth Observation: Achievable and Realistic Paths to Serve the Collective Good. IEEE Geosci. Remote Sens. Mag. 2025, 13, 72–96. [Google Scholar] [CrossRef]
- Wehner, H.; Dietz, A.; Kounev, S.; Kuenzer, C.; Wehner, H.; Dietz, A.; Kounev, S.; Kuenzer, C. Systematic Review of Satellite-Based Earth Observation Applications for Wildlife Ecology Research in Terrestrial Polar and Mountain Regions. Remote Sens. 2025, 17, 2780. [Google Scholar] [CrossRef]
- Klein, N.; Carr, A.; Hampel-Arias, Z.; Zastrow, A.; Ziemann, A.; Flynn, E. Hyperspectral Target Identification Using Physics-Guided Neural Networks with Explainability and Feature Attribution. In Proceedings of the IGARSS 2023—2023 IEEE International Geoscience and Remote Sensing Symposium, Pasadena, CA, USA, 16–21 July 2023; IEEE: New York, NY, USA, 2023; pp. 946–949. [Google Scholar] [CrossRef]









| Platform | Spatial Resolution | Coverage and Accessibility | Key Characteristics |
|---|---|---|---|
| Satellite | Low to Moderate | High; global and repeatable | Broad spatial and temporal coverage; limited spatial detail; restricted polar revisit rates and cloud interference. |
| Manned aircraft | Moderate | Moderate to high; regional campaigns | High-quality data over targeted areas; supports heavy sensors; costly and logistically demanding; weather- and safety-dependent. |
| UAV | High | Moderate; local operations | Flexible deployment; very high spatial detail; constrained by battery life, payload, and environmental conditions. |
| Handheld Sensors | Very High | Low; point-based | Ground-truth precision; limited spatial extent; labour-intensive and weather-sensitive. |
| Constraint | Impact on Data | Implication for ML |
|---|---|---|
| Harsh weather, cloud cover | Incomplete or inconsistent imagery | Sparse, noisy input data |
| Short field seasons | Minimal opportunities to collect ground truth | Very limited labelled datasets |
| UAV battery, icing risk | Limited spatial coverage | Smaller datasets, high variation |
| Environmental regulations | Limited ground-based annotation | Lack of verified labels |
| Sensor trade-offs (HSI/MSI) | No sensor provides full resolution and coverage | Heterogeneous, unbalanced datasets |
| Category | Description |
|---|---|
| Section 4.1: Manual Feature Engineering and Rule-Based | Early approaches that rely on predefined indices, ratios, or spectral similarity measures. These methods use expert knowledge to design features and apply thresholding or matching rules for classification. |
| Section 4.2: Traditional Machine Learning | Algorithms that learn from handcrafted features to perform classification or clustering. They generally require smaller datasets, offer interpretability, but struggle with complex spectral–spatial patterns. |
| Section 4.3: Deep Learning | Data-driven methods that automatically learn hierarchical spectral–spatial features. Includes CNNs, RNNs, and transformers, offering high accuracy and flexibility but requiring larger training datasets. |
| Section 4.4: Physics-Based Methods | Approaches grounded in physical laws and domain knowledge. They exploit physical principles to invert surface parameters, simulate spectral responses, or guide loss functions. |
| Section 4.5: Foundation Models | Large pretrained models designed for generalisation across tasks, domains, and modalities. They leverage massive datasets and can be adapted to new applications with minimal labelled data. |
| Dataset | Key Features | Limitations/Relevance to Antarctic Work |
|---|---|---|
| fMoW (Functional Map of the World) [81] | 1M+ satellite images; global RGB and multispectral coverage; labelled for land use/object detection across 63 categories. | Excellent geographic diversity but no Antarctic imagery; biased toward urban and temperate regions. |
| EuroSAT [80] | Sentinel-2 multispectral imagery with 13 bands; 27k labelled patches for land-use/land-cover classification. | Limited to European climates; lacks high-latitude or polar scenes. |
| BigEarthNet/BigEarthNet-MM [82,87] | 590k Sentinel-based image pairs (S1 + S2); supports multimodal and multi-label learning. | Europe-centric; no time-series data; minor sensor artefacts; minimal relevance for Antarctic domains. |
| SSL4EO-S12 [88] | Self-supervised dataset (∼3M images) from Sentinel-1/2; covers multiple seasons and tasks. | Sparse polar coverage; urban sampling bias; limited sensor/modal diversity. |
| SSL4EO-L [30] | Landsat-based SSL dataset (>1M patches) supporting long-term temporal analysis. | Minimal polar coverage; therefore lack of Antarctic relevance. |
| HyperGlobal-450K [79] | ∼450k hyperspectral images (EO-1 + GF-5); cloud-filtered with 150–175 bands. | Regionally biased toward China; limited temporal continuity. |
| SpectralEarth [89] | 500k+ EnMAP hyperspectral patches (202 bands); partial 2022–2024 time-series data. | Sparse polar coverage; limited multi-year time depth. |
| EarthView [90] | Multimodal global dataset (SAR, RGB, NIR, HSI, elevation); designed for self-supervised learning. | Urban-area focus; minimal to no Antarctic representation. |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Gorry, B.; Sandino, J.; Moghadam, P.; Gonzalez, F.; Roberts, J. Advances in Machine Learning Approaches for UAV-Based Remote Sensing in Data-Deficient Antarctic Environments. Remote Sens. 2026, 18, 459. https://doi.org/10.3390/rs18030459
Gorry B, Sandino J, Moghadam P, Gonzalez F, Roberts J. Advances in Machine Learning Approaches for UAV-Based Remote Sensing in Data-Deficient Antarctic Environments. Remote Sensing. 2026; 18(3):459. https://doi.org/10.3390/rs18030459
Chicago/Turabian StyleGorry, Brittany, Juan Sandino, Peyman Moghadam, Felipe Gonzalez, and Jonathan Roberts. 2026. "Advances in Machine Learning Approaches for UAV-Based Remote Sensing in Data-Deficient Antarctic Environments" Remote Sensing 18, no. 3: 459. https://doi.org/10.3390/rs18030459
APA StyleGorry, B., Sandino, J., Moghadam, P., Gonzalez, F., & Roberts, J. (2026). Advances in Machine Learning Approaches for UAV-Based Remote Sensing in Data-Deficient Antarctic Environments. Remote Sensing, 18(3), 459. https://doi.org/10.3390/rs18030459

