Figure 1.
The overall architecture of GWNet.
Figure 1.
The overall architecture of GWNet.
Figure 2.
Gated Mamba-CNN Module.
Figure 2.
Gated Mamba-CNN Module.
Figure 3.
Wavelet Boundary Optimization Module.
Figure 3.
Wavelet Boundary Optimization Module.
Figure 4.
Visualization results on the WHU dataset. (a–e) A–O denote the image, label, BRRNet, BuildFormerSegDP, CBRNet, HDNet, LiteSTNet, MA-FCN, MAP-Net, MFCNN, MSSDMPA-Net, UltraLight VM-UNet, UAGLNet, UANet, and our method, respectively. The red boxes indicate the regions that require particular attention.
Figure 4.
Visualization results on the WHU dataset. (a–e) A–O denote the image, label, BRRNet, BuildFormerSegDP, CBRNet, HDNet, LiteSTNet, MA-FCN, MAP-Net, MFCNN, MSSDMPA-Net, UltraLight VM-UNet, UAGLNet, UANet, and our method, respectively. The red boxes indicate the regions that require particular attention.
Figure 5.
Visualization results of boundary extraction from the WHU dataset. (a–e) A–O denote the image, label, BRRNet, BuildFormerSegDP, CBRNet, HDNet, LiteSTNet, MA-FCN, MAP-Net, MFCNN, MSSDMPA-Net, UltraLight VM-UNet, UAGLNet, UANet, and our method, respectively. The red boxes indicate the regions that require particular attention.
Figure 5.
Visualization results of boundary extraction from the WHU dataset. (a–e) A–O denote the image, label, BRRNet, BuildFormerSegDP, CBRNet, HDNet, LiteSTNet, MA-FCN, MAP-Net, MFCNN, MSSDMPA-Net, UltraLight VM-UNet, UAGLNet, UANet, and our method, respectively. The red boxes indicate the regions that require particular attention.
Figure 6.
Visualization results on the Massachusetts dataset. (a–e) A–O denote the image, label, BRRNet, BuildFormerSegDP, CBRNet, HDNet, LiteSTNet, MA-FCN, MAP-Net, MFCNN, MSSDMPA-Net, UltraLight VM-UNet, UAGLNet, UANet, and our method, respectively. The red boxes indicate the regions that require particular attention.
Figure 6.
Visualization results on the Massachusetts dataset. (a–e) A–O denote the image, label, BRRNet, BuildFormerSegDP, CBRNet, HDNet, LiteSTNet, MA-FCN, MAP-Net, MFCNN, MSSDMPA-Net, UltraLight VM-UNet, UAGLNet, UANet, and our method, respectively. The red boxes indicate the regions that require particular attention.
Figure 7.
Visualization results of boundary extraction from the Massachusetts dataset. (a–e) A–O denote the image, label, BRRNet, BuildFormerSegDP, CBRNet, HDNet, LiteSTNet, MA-FCN, MAP-Net, MFCNN, MSSDMPA-Net, UltraLight VM-UNet, UAGLNet, UANet, and our method, respectively. The red boxes indicate the regions that require particular attention.
Figure 7.
Visualization results of boundary extraction from the Massachusetts dataset. (a–e) A–O denote the image, label, BRRNet, BuildFormerSegDP, CBRNet, HDNet, LiteSTNet, MA-FCN, MAP-Net, MFCNN, MSSDMPA-Net, UltraLight VM-UNet, UAGLNet, UANet, and our method, respectively. The red boxes indicate the regions that require particular attention.
Figure 8.
Visualization results on the WHU Satellite I dataset. (a–e) A–O denote the image, label, BRRNet, BuildFormerSegDP, CBRNet, HDNet, LiteSTNet, MA-FCN, MAP-Net, MFCNN, MSSDMPA-Net, UltraLight VM-UNet, UAGLNet, UANet, and our method, respectively. The red boxes indicate the regions that require particular attention.
Figure 8.
Visualization results on the WHU Satellite I dataset. (a–e) A–O denote the image, label, BRRNet, BuildFormerSegDP, CBRNet, HDNet, LiteSTNet, MA-FCN, MAP-Net, MFCNN, MSSDMPA-Net, UltraLight VM-UNet, UAGLNet, UANet, and our method, respectively. The red boxes indicate the regions that require particular attention.
Figure 9.
Visualization results of boundary extraction from the WHU Satellite I dataset. (a–e) A–O denote the image, label, BRRNet, BuildFormerSegDP, CBRNet, HDNet, LiteSTNet, MA-FCN, MAP-Net, MFCNN, MSSDMPA-Net, UltraLight VM-UNet, UAGLNet, UANet, and our method, respectively.
Figure 9.
Visualization results of boundary extraction from the WHU Satellite I dataset. (a–e) A–O denote the image, label, BRRNet, BuildFormerSegDP, CBRNet, HDNet, LiteSTNet, MA-FCN, MAP-Net, MFCNN, MSSDMPA-Net, UltraLight VM-UNet, UAGLNet, UANet, and our method, respectively.
Figure 10.
Visualization results on the Potsdam dataset. (a–e) A–O denote the image, label, BRRNet, BuildFormerSegDP, CBRNet, HDNet, LiteSTNet, MA-FCN, MAP-Net, MFCNN, MSSDMPA-Net, UltraLight VM-UNet, UAGLNet, UANet, and our method, respectively.
Figure 10.
Visualization results on the Potsdam dataset. (a–e) A–O denote the image, label, BRRNet, BuildFormerSegDP, CBRNet, HDNet, LiteSTNet, MA-FCN, MAP-Net, MFCNN, MSSDMPA-Net, UltraLight VM-UNet, UAGLNet, UANet, and our method, respectively.
Figure 11.
Visualization results of boundary extraction from the Potsdam dataset. (a–e) A–O denote the image, label, BRRNet, BuildFormerSegDP, CBRNet, HDNet, LiteSTNet, MA-FCN, MAP-Net, MFCNN, MSSDMPA-Net, UltraLight VM-UNet, UAGLNet, UANet, and our method, respectively. The red boxes indicate the regions that require particular attention.
Figure 11.
Visualization results of boundary extraction from the Potsdam dataset. (a–e) A–O denote the image, label, BRRNet, BuildFormerSegDP, CBRNet, HDNet, LiteSTNet, MA-FCN, MAP-Net, MFCNN, MSSDMPA-Net, UltraLight VM-UNet, UAGLNet, UANet, and our method, respectively. The red boxes indicate the regions that require particular attention.
Figure 12.
(a–e) Visualization results of the ablation experiment.
Figure 12.
(a–e) Visualization results of the ablation experiment.
Table 1.
Parameter Settings.
Table 1.
Parameter Settings.
| Parameter Settings |
|---|
| Optimizer | Adam [23] |
| Initial learning rate | 0.0001 |
| Batch size | 4 |
| Epochs of the Massachusetts dataset | 200 |
| Epochs of the WHU dataset | 50 |
| Epochs of the Potsdam dataset | 50 |
| Epochs of the WHU Satellite I dataset | 200 |
Table 2.
Quantitative evaluation results of the WHU dataset.
Table 2.
Quantitative evaluation results of the WHU dataset.
| Methods | OA/% | P/% | R/% | IoU/% | F1/% | BIoU | SSIM |
|---|
| MFCNN [14] | 98.25 | 94.59 | 89.41 | 85.06 | 91.93 | 65.43 | 94.57 |
| MA-FCN [15] | 98.49 | 92.94 | 93.60 | 87.39 | 93.27 | 65.85 | 95.46 |
| MAP-Net [25] | 98.55 | 94.07 | 92.79 | 87.66 | 93.42 | 66.09 | 95.39 |
| BRRNet [26] | 98.41 | 94.04 | 91.55 | 86.52 | 92.77 | 65.48 | 95.09 |
| BuildFormer [27] | 98.48 | 93.03 | 93.31 | 87.21 | 93.17 | 65.58 | 95.19 |
| CBRNet [28] | 98.72 | 93.74 | 94.79 | 89.15 | 94.26 | 66.50 | 96.05 |
| LiteST-Net [29] | 98.58 | 93.84 | 93.36 | 87.97 | 93.60 | 66.67 | 95.63 |
| MSSDMPA-Net [30] | 98.57 | 94.63 | 92.36 | 87.76 | 93.48 | 65.84 | 95.60 |
| HD-Net [13] | 98.28 | 90.78 | 94.13 | 85.92 | 92.43 | 65.31 | 95.12 |
| UltraLight VM-UNet [16] | 97.23 | 87.09 | 88.22 | 78.02 | 87.65 | 61.72 | 92.50 |
| UAGLNet [31] | 98.30 | 91.90 | 92.95 | 85.91 | 92.42 | 65.51 | 95.00 |
| UANet [32] | 98.57 | 93.62 | 93.56 | 87.95 | 93.59 | 66.17 | 95.66 |
| GWNet | 98.91 | 94.99 | 95.23 | 90.68 | 95.11 | 66.88 | 96.36 |
Table 3.
Quantitative evaluation results of the Massachusetts dataset.
Table 3.
Quantitative evaluation results of the Massachusetts dataset.
| Methods | OA/% | P/% | R/% | IoU/% | F1/% | BIoU | SSIM |
|---|
| MFCNN [14] | 93.57 | 85.43 | 78.88 | 69.53 | 82.03 | 90.77 | 78.63 |
| MA-FCN [15] | 93.47 | 84.61 | 79.32 | 69.32 | 81.88 | 91.96 | 79.24 |
| MAP-Net [25] | 93.27 | 82.96 | 80.34 | 68.95 | 81.63 | 91.29 | 78.72 |
| BRRNet [26] | 93.09 | 85.53 | 75.68 | 67.09 | 80.31 | 90.76 | 78.63 |
| BuildFormer [27] | 92.72 | 81.01 | 79.52 | 67.02 | 80.25 | 91.32 | 77.55 |
| CBRNet [28] | 93.16 | 85.79 | 75.80 | 67.34 | 80.48 | 90.81 | 79.15 |
| LiteST-Net [29] | 93.02 | 85.68 | 75.04 | 66.68 | 80.01 | 90.49 | 78.54 |
| MSSDMPA-Net [30] | 92.86 | 85.26 | 74.50 | 66.00 | 79.52 | 90.70 | 78.11 |
| HD-Net [13] | 93.38 | 85.01 | 78.25 | 68.76 | 81.49 | 91.93 | 79.33 |
| UltraLight VM-UNet [16] | 90.24 | 79.14 | 64.58 | 55.18 | 71.12 | 80.98 | 73.80 |
| UAGLNet [31] | 91.85 | 83.33 | 70.27 | 61.61 | 76.24 | 88.34 | 76.47 |
| UANet [32] | 93.31 | 86.52 | 75.91 | 67.88 | 80.87 | 67.88 | 79.10 |
| GWNet | 94.20 | 84.47 | 84.35 | 73.02 | 84.41 | 93.19 | 80.98 |
Table 4.
Quantitative evaluation results of the WHU Satellite I dataset.
Table 4.
Quantitative evaluation results of the WHU Satellite I dataset.
| Methods | OA/% | P/% | R/% | IoU/% | F1/% | BIoU | SSIM |
|---|
| MFCNN [14] | 87.69 | 82.55 | 66.35 | 58.19 | 73.57 | 80.38 | 74.24 |
| MA-FCN [15] | 88.33 | 85.13 | 66.40 | 59.50 | 74.61 | 80.66 | 75.66 |
| MAP-Net [25] | 86.22 | 71.00 | 78.82 | 59.63 | 74.71 | 79.28 | 72.26 |
| BRRNet [26] | 86.85 | 74.93 | 73.71 | 59.13 | 74.31 | 79.75 | 71.83 |
| BuildFormer [27] | 87.49 | 80.32 | 68.24 | 58.47 | 73.79 | 79.95 | 73.85 |
| CBRNet [28] | 87.96 | 84.99 | 64.79 | 58.14 | 73.53 | 80.21 | 75.71 |
| LiteST-Net [29] | 88.02 | 81.17 | 69.79 | 60.07 | 75.05 | 81.21 | 74.94 |
| MSSDMPA-Net [30] | 86.07 | 80.05 | 61.33 | 53.20 | 69.45 | 76.15 | 71.40 |
| HD-Net [13] | 84.94 | 67.45 | 80.49 | 57.98 | 73.40 | 77.27 | 70.12 |
| UltraLight VM-UNet [16] | 81.39 | 64.46 | 62.20 | 46.32 | 63.31 | 68.61 | 65.52 |
| UAGLNet [31] | 85.29 | 71.62 | 71.26 | 55.57 | 71.44 | 76.87 | 70.49 |
| UANet [32] | 87.55 | 79.79 | 69.34 | 58.98 | 74.20 | 80.41 | 73.77 |
| GWNet | 88.71 | 78.62 | 77.29 | 63.86 | 77.94 | 83.77 | 74.71 |
Table 5.
Quantitative evaluation results of the Potsdam dataset.
Table 5.
Quantitative evaluation results of the Potsdam dataset.
| Methods | OA/% | P/% | R/% | IoU/% | F1/% | BIoU | SSIM |
|---|
| MFCNN [14] | 92.67 | 92.53 | 79.98 | 75.12 | 85.79 | 47.71 | 90.36 |
| MA-FCN [15] | 91.48 | 88.04 | 80.12 | 72.25 | 83.89 | 52.21 | 89.11 |
| MAP-Net [25] | 94.08 | 95.83 | 82.20 | 79.36 | 88.49 | 51.61 | 92.47 |
| BRRNet [26] | 92.10 | 88.80 | 81.78 | 74.13 | 85.14 | 50.18 | 89.38 |
| BuildFormer [27] | 93.95 | 92.79 | 84.75 | 79.51 | 88.59 | 56.06 | 92.36 |
| CBRNet [28] | 93.24 | 89.98 | 85.07 | 77.71 | 87.46 | 54.60 | 91.41 |
| LiteST-Net [29] | 92.19 | 92.33 | 78.31 | 73.52 | 84.74 | 48.03 | 89.17 |
| MSSDMPA-Net [30] | 91.14 | 82.25 | 86.74 | 73.06 | 84.43 | 53.89 | 89.25 |
| HD-Net [13] | 93.01 | 93.75 | 80.11 | 76.05 | 86.39 | 53.33 | 91.33 |
| UltraLight VM-UNet [16] | 90.11 | 87.16 | 75.40 | 67.86 | 80.85 | 41.71 | 87.54 |
| UAGLNet [31] | 94.27 | 94.10 | 84.62 | 80.36 | 89.11 | 56.91 | 92.64 |
| UANet [32] | 93.48 | 95.86 | 79.91 | 77.24 | 87.16 | 51.39 | 91.53 |
| GWNet | 95.11 | 94.48 | 87.46 | 83.21 | 90.83 | 58.96 | 93.61 |
Table 6.
Quantitative evaluation results of ablation experiments on the three datasets.
Table 6.
Quantitative evaluation results of ablation experiments on the three datasets.
| Methods | OA/% | P/% | R/% | IoU/% | F1/% | BIoU | SSIM |
|---|
| WHU | Base | 98.28 | 90.78 | 94.13 | 85.92 | 92.43 | 65.31 | 95.12 |
| Base+WBO | 98.69 | 95.72 | 92.37 | 88.70 | 94.01 | 66.57 | 96.01 |
| Base+GMC | 98.76 | 94.95 | 93.84 | 89.38 | 94.39 | 65.95 | 96.08 |
| GWNet | 98.91 | 94.99 | 95.23 | 90.68 | 95.11 | 66.88 | 96.36 |
| Massachusetts | Base | 93.38 | 85.01 | 78.25 | 68.76 | 81.49 | 91.93 | 79.33 |
| Base+WBO | 93.85 | 86.12 | 79.83 | 70.73 | 82.86 | 92.03 | 80.60 |
| Base+GMC | 93.93 | 85.97 | 80.57 | 71.21 | 83.19 | 91.78 | 80.61 |
| GWNet | 94.20 | 84.47 | 84.35 | 73.02 | 84.41 | 93.19 | 80.98 |
| WHU Satellite I | Base | 84.94 | 67.45 | 80.49 | 57.98 | 73.40 | 77.27 | 70.12 |
| Base+WBO | 87.73 | 77.26 | 74.33 | 60.99 | 75.77 | 81.24 | 74.63 |
| Base+GMC | 87.52 | 75.88 | 75.71 | 61.03 | 75.79 | 80.99 | 74.75 |
| GWNet | 88.71 | 78.62 | 77.29 | 63.86 | 77.94 | 83.77 | 74.71 |
Table 7.
Quantitative Evaluation of the Gate Mechanism and High-Frequency Filter Selection on the Massachusetts Dataset.
Table 7.
Quantitative Evaluation of the Gate Mechanism and High-Frequency Filter Selection on the Massachusetts Dataset.
| Methods | OA/% | P/% | R/% | IoU/% | F1/% | BIoU | SSIM | GFLOPs | Parameters |
|---|
| Base | 93.38 | 85.01 | 78.25 | 68.76 | 81.49 | 91.93 | 79.33 | 396 | 14.7 M |
| Base + GMC without Gate | 89.21 | 73.59 | 65.53 | 53.05 | 69.33 | 82.22 | 72.25 | 336 | 11.5 M |
| GWNet with Sobel | 92.57 | 81.32 | 78.00 | 66.15 | 79.63 | 90.34 | 77.61 | 337 | 11.4 M |
| GWNet with Laplacian | 91.84 | 78.54 | 77.28 | 63.81 | 77.91 | 88.74 | 76.49 | 336 | 11.7 M |
| GWNet | 94.20 | 84.47 | 84.35 | 73.02 | 84.41 | 93.19 | 80.98 | 336 | 11.6 M |