DFGNet: A CropLand Change Detection Network Combining Deformable Convolution and Grouped Residual Self-Attention
Abstract
1. Introduction
2. Related Works
2.1. Change Detection Based on Traditional Methods
2.2. Change Detection Based on Deep Learning
3. Methodology
3.1. Overall Framework of the Proposed Network
3.2. Deformable FPN
3.3. Dynamic Low-Rank Fusion
Computational Complexity Analysis
3.4. Explainable AI (XAI)-Based Interpretation of DFGNet
4. Experiments
4.1. Dataset
4.2. Experimental Settings and Configuration
4.3. Evaluation Metrics
4.4. Comparative Experiments
4.5. Ablation Studies
4.6. Analysis of Global Attention in Model from the Perspective of Grad-CAM
4.7. Generalization Evaluation on the Jilin-1 Dataset
5. Discussion
6. Conclusions
Author Contributions
Funding
Data Availability Statement
Conflicts of Interest
Appendix A
Appendix A.1. GF-2 Satellite and CLCD Dataset Details
- (1)
- Feasibility and Conditions for Replicating Experiments with Other Optical Sensors
- (2)
- Data Public Availability, Licensing, and Replication Steps
Appendix A.2. Jilin-1 Satellite Dataset Details
- (1)
- Feasibility of Replicating Experiments with Globally Accessible High-Resolution Data Sources
- (2)
- Universal Experimental Reproduction Steps (Global Applicability)
References
- Varzakas, T.; Smaoui, S. Global Food Security and Sustainability Issues: The Road to 2030 from Nutrition and Sustainable Healthy Diets to Food Systems Change. Foods 2024, 13, 306. [Google Scholar] [CrossRef]
- Saidi, S.; Idbraim, S.; Karmoude, Y.; Masse, A.; Arbelo, M. Deep-Learning for Change Detection Using Multi-Modal Fusion of Remote Sensing Images: A Review. Remote Sens. 2024, 16, 3852. [Google Scholar] [CrossRef]
- Dalla Mura, M.; Prasad, S.; Pacifici, F.; Gamba, P.; Chanussot, J.; Benediktsson, J.A. Challenges and Opportunities of Multimodality and Data Fusion in Remote Sensing. Proc. IEEE 2015, 103, 1585–1601. [Google Scholar] [CrossRef]
- Peng, D.; Liu, X.; Zhang, Y.; Guan, H.; Li, Y.; Bruzzone, L. Deep Learning Change Detection Techniques for Optical Remote Sensing Imagery: Status, Perspectives and Challenges. Int. J. Appl. Earth Obs. Geoinf. 2025, 136, 104282. [Google Scholar] [CrossRef]
- Shafique, A.; Cao, G.; Khan, Z.; Asad, M.; Aslam, M. Deep Learning-Based Change Detection in Remote Sensing Images: A Review. Remote Sens. 2022, 14, 871. [Google Scholar] [CrossRef]
- Liu, X.; Zhou, Y.; Zhao, J.; Yao, R.; Liu, B.; Zheng, Y. Siamese convolutional neural networks for remote sensing scene classification. IEEE Geosci. Remote Sens. Lett. 2019, 16, 1200–1204. [Google Scholar] [CrossRef]
- Daudt, R.C.; Le Saux, B.; Boulch, A. Fully convolutional siamese networks for change detection. In Proceedings of the 2018 25th IEEE International Conference on Image Processing (ICIP), Athens, Greece, 7–10 October 2018; pp. 4063–4067. [Google Scholar] [CrossRef]
- Parmar, N.; Vaswani, A.; Uszkoreit, J.; Kaiser, L.; Shazeer, N.; Ku, A.; Tran, D. Image transformer. In Proceedings of the International Conference on Machine Learning; Stockholmsmassan, Stockholm, Sweden, 10–15 July 2018; pp. 4055–4064. [Google Scholar]
- Kitaev, N.; Kaiser, L.; Levskaya, A. Reformer: The efficient transformer. arXiv 2020, arXiv:2001.04451. [Google Scholar] [CrossRef]
- Yao, D.; Shao, Y. A data efficient transformer based on Swin Transformer. Vis. Comput. 2024, 40, 2589–2598. [Google Scholar] [CrossRef]
- Ferdous, G.J.; Sathi, K.A.; Hossain, M.A.; Hoque, M.M.; Dewan, M.A.A. LCDEiT: A linear complexity data-efficient image transformer for MRI brain tumor classification. IEEE Access 2023, 11, 20337–20350. [Google Scholar] [CrossRef]
- Chen, H.; Qi, Z.; Shi, Z. Remote sensing image change detection with transformers. IEEE Trans. Geoscience. Remote Sens. 2021, 60, 1–14. [Google Scholar] [CrossRef]
- Huo, X.; Sun, G.; Tian, S.; Wang, Y.; Yu, L.; Long, J.; Zhang, W.; Li, A. HiFuse: Hierarchical multi-scale feature fusion network for medical image classification. Biomed. Signal Process. Control. 2024, 87, 105534. [Google Scholar] [CrossRef]
- Wang, G.; Gan, X.; Cao, Q.; Zhai, Q. MFANet: Multi-scale feature fusion network with attention mechanism. Vis. Comput. 2023, 39, 2969–2980. [Google Scholar] [CrossRef]
- Tu, Y.; Wu, S.; Chen, B.; Weng, Q.; Bai, Y.; Yang, J.; Yu, L.; Xu, B. A 30 m annual cropland dataset of China from 1986 to 2021. Earth Syst. Sci. Data 2024, 16, 2297–2316. [Google Scholar] [CrossRef]
- Huang, Z.; Yang, X.; Liu, Y.; Wang, Z.; Ma, Y.; Jing, H.; Liu, X. Multi-Type Change Detection and Distinction of Cultivated Land Parcels in High-Resolution Remote Sensing Images Based on Segment Anything Model. Remote Sens. 2025, 17, 787. [Google Scholar] [CrossRef]
- Xie, Y.; Spawn-Lee, S.A.; Radeloff, V.C.; Yin, H.; Robertson, G.P.; Lark, T.J. Cropland Abandonment Between 1986 and 2018 Across the United States: Spatiotemporal Patterns and Current Land Uses. Environ. Res. Lett. 2024, 19, 044009. [Google Scholar] [CrossRef]
- Tufail, R.; Tassinari, P.; Torreggiani, D. Deep Learning Applications for Crop Mapping Using Multi-Temporal Sentinel-2 Data and Red-Edge Vegetation Indices: Integrating Convolutional and Recurrent Neural Networks. Remote Sens. 2025, 17, 3207. [Google Scholar] [CrossRef]
- Lin, T.-Y.; Dollar, P.; Girshick, R.; He, K.; Hariharan, B.; Belongie, S. Feature pyramid networks for object detection. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA, 21–26 July 2017; pp. 2117–2125. [Google Scholar] [CrossRef]
- Dai, J.; Qi, H.; Xiong, Y.; Li, Y.; Zhang, G.; Hu, H.; Wei, Y. Deformable convolutional networks. In Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy, 22–29 October 2017; pp. 764–773. [Google Scholar] [CrossRef]
- Li, Y.; Deng, Z.; Cao, Y.; Liu, L. GRFormer: Grouped residual self-attention for lightweight single image super-resolution. In Proceedings of the 32nd ACM International Conference on Multimedia, Melbourne, Australia, 28 October–1 November 2024; pp. 9378–9386. [Google Scholar] [CrossRef]
- Huang, W.; Zhang, Y.; Zheng, X.; Liu, Y.; Lin, J.; Yao, Y.; Ji, R. Dynamic low-rank sparse adaptation for large language models. arXiv 2025, arXiv:2502.14816. [Google Scholar] [CrossRef]
- Valipour, M.; Rezagholizadeh, M.; Kobyzev, I.; Ghodsi, A. DyLoRA: Parameter-Efficient Tuning of Pre-Trained Models Using Dynamic Search-Free Low-Rank Adaptation. In Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics, Dubrovnik, Croatia, 2–6 May 2023; pp. 3274–3287. [Google Scholar] [CrossRef]
- Liu, J.; Fan, X.; Jiang, J.; Liu, R.; Luo, Z. Learning a deep multi-scale feature ensemble and an edge-attention guidance for image fusion. IEEE Trans. Circuits Syst. Video Technol. 2021, 32, 105–119. [Google Scholar] [CrossRef]
- Lu, D.; Mausel, P.; Brondizio, E.; Moran, E. Change detection techniques. Int. J. Remote Sens. 2004, 25, 2365–2401. [Google Scholar] [CrossRef]
- Shivakumar, B.R. Change detection using image differencing: A study over area surrounding Kumta, India. In Proceedings of the 2017 Second International Conference on Electrical, Computer and Communication Technologies (ICECCT), Coimbatore, India, 22–24 February 2017; pp. 1–5. [Google Scholar] [CrossRef]
- Talukdar, S.; Singha, P.; Mahato, S.; Pal, S.; Liou, Y.-A.; Rahman, A. Land-use land-cover classification by machine learning classifiers for satellite observations-A review. Remote Sens. 2020, 12, 1135. [Google Scholar] [CrossRef]
- Hort, M.; Chen, Z.; Zhang, J.M.; Harman, M.; Sarro, F. Bias mitigation for machine learning classifiers: A comprehensive survey. ACM J. Responsible Comput. 2024, 1, 1–52. [Google Scholar] [CrossRef]
- Zhou, D.-X. Theory of deep convolutional neural networks: Downsampling. Neural Netw. 2020, 124, 319–327. [Google Scholar] [CrossRef]
- Yu, W.; Zhuo, L.; Li, J. GCFormer: Global context-aware transformer for remote sensing image change detection. IEEE Trans. Geosci. Remote Sens. 2024, 62, 4703212. [Google Scholar] [CrossRef]
- Zhao, J.; Jiao, L.; Wang, C.; Liu, X.; Liu, F.; Li, L.; Yang, S. GeoFormer: A geometric representation transformer for change detection. IEEE Trans. Geosci. Remote Sens. 2023, 61, 4410617. [Google Scholar] [CrossRef]
- Khan, A.; Rauf, Z.; Sohail, A.; Khan, A.R.; Asif, H.; Asif, A.; Farooq, U. A survey of the vision transformers and their CNN-transformer based variants. Artif. Intell. Rev. 2023, 56, 2917–2970. [Google Scholar] [CrossRef]
- Yuan, J.; Zhou, F.; Guo, Z.; Li, X.; Yu, H. HCformer: Hybrid CNN-transformer for LDCT image denoising. J. Digit. Imaging 2023, 36, 2290–2305. [Google Scholar] [CrossRef]
- Yang, X.; Xu, Z.; Xu, J. Large-scale group Delphi method with heterogeneous decision information and dynamic weights. Expert Syst. Appl. 2023, 213, 118782. [Google Scholar] [CrossRef]
- Xu, L.; Song, H.; Tian, L.; Wang, Z.; Wang, M. TAFP-ViT: A transformer accelerator via QKV computational fusion and adaptive pruning for vision transformer. ACM Trans. Embed. Comput. Syst. 2025, 24, 1–21. [Google Scholar] [CrossRef]
- Selvaraju, R.R.; Cogswell, M.; Das, A.; Vedantam, R.; Parikh, D.; Batra, D. Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization. In Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy, 22–29 October 2017; pp. 618–626. [Google Scholar] [CrossRef]
- Liu, M.; Chai, Z.; Deng, H.; Liu, R. A CNN-transformer network with multiscale context aggregation for fine-grained cropland change detection. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2022, 15, 4297–4306. [Google Scholar] [CrossRef]
- Hu, C.; Ma, M.; Ma, X.; Zhang, H.; Wu, D.; Gao, G.; Zhang, W. STANet: Spatiotemporal adaptive network for remote sensing images. In Proceedings of the 2023 IEEE International Conference on Image Processing (ICIP), Kuala Lumpur, Malaysia, 8–11 October 2023; pp. 3429–3433. [Google Scholar] [CrossRef]
- Bandara, W.G.C.; Patel, V.M. A transformer-based siamese network for change detection. In Proceedings of the IGARSS 2022—2022 IEEE International Geoscience and Remote Sensing Symposium, Kuala Lumpur, Malaysia, 17–22 July 2022; pp. 207–210. [Google Scholar] [CrossRef]
- He, X.; Zhang, S.; Xue, B.; Zhao, T.; Wu, T. Cross-modal change detection flood extraction based on convolutional neural network. Int. J. Appl. Earth Obs. Geoinf. 2023, 117, 103197. [Google Scholar] [CrossRef]
- Wu, Q.; Huang, L.; Tang, B.-H.; Cheng, J.; Wang, M.; Zhang, Z. CroplandCDNet: Cropland Change Detection Network for Multitemporal Remote Sensing Images Based on Multilayer Feature Transmission Fusion of an Adaptive Receptive Field. Remote Sens. 2024, 16, 1061. [Google Scholar] [CrossRef]
- Zhao, X.; Wu, Z.; Chen, Y.; Zhou, W.; Wei, M. Fine-Grained High-Resolution Remote Sensing Image Change Detection by SAM-UNet Change Detection Model. Remote Sens. 2024, 16, 3620. [Google Scholar] [CrossRef]
- Carvalho Júnior, O.A.; Guimarães, R.F.; Gillespie, A.R.; Silva, N.C.; Gomes, R.A.T. A New Approach to Change Vector Analysis Using Distance and Similarity Measures. Remote Sens. 2011, 3, 2473–2493. [Google Scholar] [CrossRef]
- Hinton, G.; Vinyals, O.; Dean, J. Distilling the knowledge in a neural network. arXiv 2015, arXiv:1503.02531. [Google Scholar] [CrossRef]
- Liu, Z.; Wang, T.; Zhu, F.; Chen, X.; Pelusi, D.; Vasilakos, A.V. Domain adaptive learning based on equilibrium distribution and dynamic subspace approximation. Expert Syst. Appl. 2024, 249, 123673. [Google Scholar] [CrossRef]








| Method | Limitations |
|---|---|
| CNN-based models | ➀ Poor ability to capture long-range dependencies ➁ Sensitive to geometric transformations ➂ Limited global context modeling |
| Transformer-based Models | ➀ High computational complexity ➁ Weak inductive bias ➂ Difficult to capture fine-grained local details |
| Hybrid Models | ➀ Redundant multi-scale features ➁ Incomplete detail preservation ➂ Lack of efficient fusion strategies |
| Category | Choice |
|---|---|
| Deep Learning Framework | Pytorch 2.0.0 |
| Hardware | GPU RTX 3090 |
| Optimizer | Adam |
| Learning Rate | 1 × 10−4 |
| Batch Size | 2 |
| Epochs | 100 |
| Input Size | 512 × 512 |
| Method | mIoU (%) | F1 (%) | Rec (%) | Pre (%) | Params (m) | FLOPs (G) |
|---|---|---|---|---|---|---|
| FC-EF | 43.11 | 43.19 | 53.96 | 68.42 | 14.23 | 58.61 |
| STANet | 46.37 | 58.13 | 62.47 | 72.15 | 15.07 | 57.62 |
| BiT | 46.88 | 53.89 | 58.19 | 50.18 | 16.75 | 58.81 |
| ChangeFormer | 52.61 | 51.43 | 60.61 | 70.10 | 17.33 | 59.91 |
| MSCANet | 53.55 | 69.75 | 65.88 | 74.10 | 16.42 | 59.20 |
| CMCDNet | 50.71 | 52.82 | 54.57 | 76.11 | 16.86 | 60.15 |
| DFGNet (Ours) | 57.57 | 72.42 | 71.41 | 77.93 | 16.24 | 58.63 |
| Method | mIoU (%) | F1 (%) | Pre (%) | Rec (%) |
|---|---|---|---|---|
| FPN | 53.55 | 69.75 | 74.10 | 65.88 |
| +DCN | 55.84 | 72.03 | 76.24 | 68.51 |
| +DLRF | 56.42 | 71.85 | 77.11 | 69.45 |
| DFGNet (Ours) | 57.57 | 72.42 | 77.93 | 71.41 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Feng, X.; Liu, X. DFGNet: A CropLand Change Detection Network Combining Deformable Convolution and Grouped Residual Self-Attention. Appl. Sci. 2025, 15, 13133. https://doi.org/10.3390/app152413133
Feng X, Liu X. DFGNet: A CropLand Change Detection Network Combining Deformable Convolution and Grouped Residual Self-Attention. Applied Sciences. 2025; 15(24):13133. https://doi.org/10.3390/app152413133
Chicago/Turabian StyleFeng, Xiangxi, and Xiaofang Liu. 2025. "DFGNet: A CropLand Change Detection Network Combining Deformable Convolution and Grouped Residual Self-Attention" Applied Sciences 15, no. 24: 13133. https://doi.org/10.3390/app152413133
APA StyleFeng, X., & Liu, X. (2025). DFGNet: A CropLand Change Detection Network Combining Deformable Convolution and Grouped Residual Self-Attention. Applied Sciences, 15(24), 13133. https://doi.org/10.3390/app152413133
