1. Introduction
In recent years, oriented object detection has made significant progress in high-resolution remote sensing image interpretation. Two-stage detectors usually achieve high localization accuracy by generating rotated proposals and aligning regional features. For example, RoI Transformer [
1] learns a spatial transformation to convert horizontal RoIs into rotated RoIs, thereby improving feature alignment for arbitrarily oriented objects. Oriented R-CNN [
2] designs a lightweight oriented RPN and combines it with Rotated RoIAlign to achieve efficient oriented object detection. In contrast, one-stage detectors pay more attention to detection efficiency. R3Det [
3] alleviates the mismatch between rotated bounding boxes and features through a feature refinement mechanism, while S
2A-Net [
4] improves oriented object representation by using feature alignment and orientation-aware detection modules. In addition, to address angle periodicity, boundary discontinuity, and parameter coupling in rotated box regression, CSL [
5], DCL [
6], GWD [
7], and KLD [
8] improve regression stability from the perspectives of angle encoding, label smoothing, and Gaussian geometric measurement. Multi-scale feature fusion structures, such as FPN [
9], PANet [
10], NAS-FPN [
11], BiFPN [
12], and ASFF [
13], have also been widely used to improve the detection of small and multi-scale objects in remote sensing images.
Although existing methods have achieved promising performance in orientation modeling, feature alignment, multi-scale fusion, and rotated box regression, the object–background confusion problem in complex scenes remains insufficiently addressed [
14,
15]. High-resolution remote sensing images often contain background structures whose visual patterns resemble those of real objects [
16,
17]. For example, dock edges and shorelines may be confused with ships, runway markings may interfere with aircraft detection, and road or industrial structures may trigger false-positive responses. Such object-like background patterns can lead to high-confidence false positives in complex scenes [
18,
19].
To address the above issues, this paper proposes BGD-Net, an object–background decoupled learning network for oriented object detection in complex remote sensing scenes. Different from existing methods that mainly improve detection performance through orientation modeling, multi-scale feature enhancement, or rotated box regression optimization, this work focuses on decoupling object features from background interference under complex background conditions. Specifically, we first construct a Background-Decoupled Feature Module (BDFM) on the multi-scale features output by FPN. BDFM separately models object-related regions and background interference regions through an object-response branch and a background-suppression branch, and enhances object responses while weakening background activations through a residual background purification mechanism. Second, considering that ordinary negative samples cannot sufficiently represent complex background interference, we design a Hard Background Mining (HBM) strategy to automatically select high-confidence and low-overlap confusing background samples according to foreground confidence and rotated IoU. Finally, we propose an Object–Background Contrastive Suppression Loss (OBCS Loss), which pulls same-class object features closer and pushes hard background features away in the feature space, thereby improving the discriminative ability of the model against complex background interference.
The main contributions of this paper are summarized as follows:
We propose BGD-Net, an object–background decoupled learning framework for oriented object detection in complex remote sensing scenes. It starts from the object–background coupling problem and reduces high-confidence false positives caused by complex background regions.
We design a Background-Decoupled Feature Module (BDFM), which separately models object regions and background interference regions through an object-response branch and a background-suppression branch, achieving object enhancement and background purification at the feature level.
We propose a Hard Background Mining (HBM) strategy, which automatically selects high-confidence and low-overlap confusing background samples according to foreground confidence and rotated IoU, enabling the model to focus more on hard backgrounds that are likely to cause false positives.
We introduce an Object–Background Contrastive Suppression Loss (OBCS Loss), which pulls same-class object features closer and pushes hard background features away in the feature space, improving the discriminative ability of the model from the optimization perspective.
3. Method
3.1. Overall Framework
To alleviate the strong coupling between object responses and background interference in complex remote sensing scenes, this paper proposes a background-decoupled oriented object detection network, namely BGD-Net. Different from existing methods that mainly focus on rotated box representation, orientation modeling, or feature alignment, the core objective of BGD-Net is to reduce high-confidence false positives caused by complex backgrounds from the feature, sample, and optimization levels. Overall, the proposed method consists of three key components: the Background-Decoupled Feature Module (BDFM), the Hard Background Mining (HBM) strategy, and the Object–Background Contrastive Suppression Loss (OBCS Loss).
As shown in
Figure 1, BGD-Net adopts a two-stage oriented object detection framework. Given an input image
, the backbone network first extracts multi-level features
. Then, the Feature Pyramid Network (FPN) fuses features from different levels and produces multi-scale feature representations
. A conventional FPN mainly performs cross-scale semantic fusion, but does not explicitly distinguish object responses from background interference. Therefore, BDFM is introduced after FPN to enhance object-related features and purify background interference. The purified features
are fed into the oriented Region Proposal Network (oriented RPN) to generate rotated candidate regions
. Rotated Region of Interest Align (Rotated RoIAlign) is then used to extract RoI features
, and the RoI Head performs classification and rotated box regression.
During training, HBM is further designed to select hard background samples with high foreground confidence and low rotated IoU from candidate regions. These samples are used as key negative samples in OBCS Loss. Therefore, BGD-Net not only suppresses background responses during forward propagation, but also explicitly enlarges the feature distance between real objects and hard backgrounds during optimization.
3.2. Background-Decoupled Feature Module
Conventional FPN features jointly encode object responses and background activations, leaving the subsequent RPN and RoI Head to distinguish them mainly through classification supervision. To reduce this feature-level coupling before proposal generation, BDFM is inserted between the FPN and the oriented RPN to purify the multi-scale feature representations, as illustrated in
Figure 2.
Unlike conventional attention mechanisms that generate a single weight map, BDFM constructs an object-response branch and a background-suppression branch simultaneously. These two branches learn object-related regions and background-interference regions separately, thereby achieving explicit object–background decoupling.
For the
l-th FPN feature
, BDFM contains two parallel branches: the object-response branch and the background-suppression branch. The object-response branch estimates the response intensity of each spatial location belonging to an object region:
where
denotes the object-response map,
denotes the Sigmoid function, and
is a lightweight convolutional mapping function.
The background-suppression branch estimates the response intensity of each spatial location belonging to a confusing background region:
where
denotes the background-suppression map, which is used to characterize the confounding background response that needs to be suppressed.
is the convolutional mapping function of the background branch. Both branches adopt a lightweight structure:
This design obtains the spatial distributions of object responses and background responses with only a small number of additional parameters.
3.2.1. Background-Decoupled Feature Generation
According to the object-response map and the background-suppression map, the object-enhanced feature and background-interference feature are obtained as follows:
where ⊙ denotes element-wise multiplication, and the response maps are broadcast along the channel dimension. Then, the background-decoupled feature is generated through differential modeling:
where
denotes the background suppression coefficient that controls the contribution of the background-response feature
during feature purification.
Considering that remote sensing images contain many small objects, directly suppressing background regions may accidentally weaken some weak object features. Therefore, a residual background purification mechanism is adopted:
where
is a learnable residual coefficient initialized to 0 and jointly optimized with the network parameters during training. It adaptively controls the contribution of the background-decoupled feature
to the original feature
.
Finally, BDFM outputs the background-purified multi-scale features . These features are then fed into Oriented RPN for proposal generation. Since background interference is weakened before candidate region generation, the false-positive pressure faced by the subsequent RoI Head is also reduced.
3.2.2. Auxiliary Supervision
To make the learning of the object-response map and background-suppression map more stable, background-decoupled auxiliary supervision is introduced. First, an object-region mask
is generated according to the ground-truth rotated boxes, where pixels inside rotated boxes are set to 1 and other locations are set to 0. The ordinary background mask can be written as
The object-response branch is supervised by the binary cross-entropy loss:
It should be noted that the ordinary background mask
is not directly used to supervise the background-suppression branch. The reason is that ordinary background regions contain many easy background samples. If all background regions are supervised equally, the model may overemphasize ineffective background responses and fail to highlight the truly confusing backgrounds that cause false positives. During training, HBM selects hard background samples from the candidate regions in the current batch and projects their rotated boxes onto the corresponding FPN feature maps to generate the hard-background mask
. Specifically, for an FPN level with stride
, the center coordinates and side lengths of each rotated box are scaled by
, while its orientation angle is preserved. The projected rotated box is then converted into its four corner points and rasterized as a binary polygon mask. Pixels covered by hard-background regions are assigned 1 and the remaining pixels are assigned 0; overlapping regions are merged by a logical OR operation. Based on this mask, the background supervision loss is defined as
The auxiliary supervision loss of BDFM is finally defined as
Through this differentiated supervision, the object-response branch is guided to focus on real object regions, while the background-suppression branch is guided to focus on hard background regions that are likely to cause false positives. This prevents the two branches from learning similar or redundant response maps.
3.3. Hard Background Mining Strategy
In object detection training, most background RoIs are easily classified and provide limited discriminative information. HBM therefore focuses on a small subset of high-risk background regions that receive high foreground confidence while maintaining low rotated overlap with ground-truth objects. These regions are subsequently used for classification reweighting and contrastive optimization, as illustrated in
Figure 3. Different from random negative sampling, HBM focuses on regions that “look like objects but are not objects”.
Let denote the set of sampled rotated RoIs obtained after proposal generation and RoI sampling. For each , the RoI classification branch predicts the class probabilities , where denotes the background probability. Its foreground confidence is defined as , where C denotes the number of foreground categories.
The maximum rotated IoU between this candidate region and all ground-truth boxes is defined as
where
denotes the
j-th ground-truth rotated box, and
denotes rotated IoU. The hard background score is defined as
When a candidate region has high foreground confidence but low overlap with real objects, becomes large, indicating that this region is more likely to be a hard background sample. This definition matches the typical characteristics of false positives in complex remote sensing scenes: they are easily regarded as objects by the model, but do not match any real object.
According to the rotated IoU threshold, background candidates are first selected as
where
is the background threshold and is usually set to 0.3. Then, the background candidates are sorted according to the hard background score
, and the top-
K samples are selected as the hard background set:
These hard background samples have two roles. First, they are used to reweight the classification loss, enabling the model to focus more on confusing backgrounds. Second, they are used as key negative samples in OBCS Loss for object–background contrastive learning. To enhance the learning of hard backgrounds, the classification loss is reweighted as
where
denotes the classification loss of the
i-th RoI, and
is the hard-background weighting coefficient. For samples selected in
, the classification weight is
, whereas
is set to 0 for the remaining RoIs so that their classification weights remain unchanged. Therefore, hard-background samples with larger
receive greater emphasis during training.
3.4. Object–Background Contrastive Suppression Loss
The classification loss distinguishes foreground and background at the label level, but it does not directly constrain their separation in the RoI embedding space. Consequently, hard background RoIs may remain close to object representations even after classification training, resulting in high-confidence false positives during inference. To address this issue, we propose the Object–Background Contrastive Suppression Loss (OBCS Loss), which uses the hard background samples mined by HBM as targeted negative samples. OBCS pulls same-class object features closer while pushing object features away from hard background features, thereby improving object–background discriminability in the embedding space.
For the
i-th candidate region feature
output by the RoI Head, a lightweight projection head is first used to map it into a low-dimensional embedding space:
where
denotes the projected RoI embedding feature. Then,
normalization is applied to reduce the influence of feature magnitude on similarity calculation:
After normalization, the similarity between any two samples
and
is computed by cosine similarity:
For an object anchor
, its positive sample set consists of object RoIs that belong to the same class and have high overlap with the corresponding ground-truth boxes:
where
and
denote the category labels of the anchor and the candidate positive sample, respectively.
denotes the rotated IoU between the candidate RoI and its matched ground-truth box, and
is the positive overlap threshold.
The negative sample set is composed of hard background samples selected by HBM:
Compared with randomly selected background samples, hard background samples usually have higher foreground confidence but lower overlap with real objects, making them closer to actual false-positive sources. Therefore, using them as negative samples in contrastive learning helps the model learn a more fine-grained decision boundary between real objects and confusing backgrounds.
Based on the above positive and negative sample sets, the OBCS Loss for the object anchor
is defined as
where
is the temperature coefficient used to adjust the smoothness of the similarity distribution. Minimizing this loss increases the similarity between the anchor and same-class object samples, while decreasing the similarity between the anchor and hard background samples. The final OBCS Loss is averaged over all valid object anchors:
where
denotes the number of valid object anchors participating in contrastive optimization. If the positive sample set of an anchor is empty, this anchor is excluded from the OBCS Loss calculation in the current batch. If no valid object anchor exists in a mini-batch, i.e.,
, the OBCS Loss is set to zero for that mini-batch. The network is then optimized using the detection loss and the BDFM auxiliary loss only.
By combining the basic detection loss, the background-decoupled auxiliary loss, and the object–background contrastive suppression loss, the overall training objective of BGD-Net is formulated as
where
is the background-decoupled auxiliary loss of BDFM, and
and
denote the weights of
and OBCS Loss, respectively.
is the basic oriented detection loss, which consists of the RPN loss and the RoI Head loss:
After introducing HBM, the RoI classification branch adopts the hard-background reweighted classification loss, namely
. Therefore, the basic oriented detection loss can be further written as
Through joint optimization, BDFM weakens background responses at the feature level, HBM mines high-risk background samples at the sample level, and OBCS Loss enlarges the feature distance between real objects and hard backgrounds in the embedding space. These components collaboratively improve the discriminative ability and detection robustness of the model in complex remote sensing scenes. The projection head and OBCS Loss are used only during training and are removed during inference; therefore, they do not introduce additional computational overhead during testing.
4. Experiments and Analysis
4.1. Experimental Settings
4.1.1. Datasets
To comprehensively evaluate the effectiveness of the proposed BGD-Net for oriented object detection in complex remote sensing scenes, experiments are conducted on three public datasets: DOTA-v1.0, HRSC2016, and DIOR-R. These datasets are used to evaluate the model from the perspectives of multi-class aerial object detection, harbor ship detection, and cross-dataset generalization under complex backgrounds, respectively.
DOTA-v1.0 is a large-scale aerial remote sensing dataset for oriented object detection. It contains 2806 high-resolution remote sensing images and 15 object categories, including plane (PL), baseball diamond (BD), bridge (BR), ground track field (GTF), small vehicle (SV), large vehicle (LV), ship (SH), tennis court (TC), basketball court (BC), storage tank (ST), soccer-ball field (SBF), roundabout (RA), harbor (HA), swimming pool (SP), and helicopter (HC). Objects in this dataset show arbitrary orientations, large-scale variations, dense distributions, and complex backgrounds, making it suitable for evaluating the comprehensive detection ability of the model in complex remote sensing scenes. Following the official data split, the original images are cropped into patches with an overlap of 200 pixels to reduce boundary truncation. DOTA-v1.0 is used as the main benchmark for quantitative comparison and ablation studies.
HRSC2016 is a high-resolution remote sensing dataset for ship detection. It mainly contains arbitrarily oriented ships in harbors, offshore areas, and nearshore regions. Although HRSC2016 is a single-class ship detection dataset, ships usually present elongated shapes, large aspect ratios, and diverse orientations. Meanwhile, dock edges, shorelines, ship shadows, and harbor facilities are easily confused with real ships. Therefore, this dataset is suitable for verifying the ability of the proposed method to suppress high-confidence false positives in harbor scenes. The original aspect ratio is preserved during resizing, where the short side is set to 800 pixels and the long side is no larger than 1333 pixels, without extra cropping, to preserve the geometric integrity of ship targets as much as possible.
DIOR-R is the rotated bounding box extension of the DIOR dataset. It contains 20 remote sensing object categories and covers various complex scenes, such as airports, harbors, urban roads, industrial areas, playgrounds, and dense building areas. Compared with DOTA-v1.0, DIOR-R has greater diversity in imaging conditions, spatial resolutions, scene types, and object appearances. It is used to further evaluate the adaptability and generalization ability of the model under different data distributions and complex backgrounds. In this dataset, the network architecture is kept unchanged, and the model is retrained using the same training strategy to verify whether BDFM, HBM, and OBCS Loss can still improve complex background discrimination under different data distributions.
4.1.2. Evaluation Metrics
The mean Average Precision (mAP), which is widely used in oriented object detection, is adopted as the main evaluation metric. For each category, a detection is considered correct according to the rotated IoU between the predicted rotated box and the ground-truth rotated box, and the AP of this category is computed from the precision–recall curve. The mAP over all categories is defined as
where
C denotes the number of categories. Different datasets adopt different evaluation protocols. DOTA-v1.0 follows the official evaluation protocol and reports mAP at an IoU threshold of 0.5, denoted as mAP@0.5. For HRSC2016, the VOC2007 11-point interpolation protocol is adopted to compute AP at an IoU threshold of 0.5. Since HRSC2016 contains only one object category, AP@0.5 is numerically equivalent to mAP@0.5; therefore, we report it as mAP@0.5 for consistency throughout the paper. DIOR-R is evaluated using mAP@0.5 under its standard evaluation protocol.
To further analyze the ability of the model to suppress false positives in complex backgrounds, the number of high-confidence hard false positives is counted and denoted as Hard-FP. Specifically, a prediction is counted as a Hard-FP if its confidence score is higher than 0.5 and its maximum rotated IoU with any ground-truth box is below a specified evaluation IoU threshold. Unless otherwise stated, an IoU threshold of 0.30 is used for the main Hard-FP results. To examine whether the evaluation is sensitive to this threshold, additional Hard-FP results under multiple evaluation IoU thresholds are reported in the
Section 4.8. In addition, Params and FLOPs are reported in the DOTA-v1.0 comparison to analyze model complexity.
4.1.3. Implementation Details
The proposed method adopts an Oriented R-CNN-style two-stage oriented object detection framework as the baseline detector, with ResNet-50-FPN as the backbone. The main implementation details are shown in
Table 1. The input image is first processed by the backbone and FPN to extract multi-scale features. Then, BDFM is inserted between FPN and oriented RPN to enhance object responses and suppress background interference on
. After oriented RPN generates rotated proposals, Rotated RoIAlign is used to extract instance-level RoI features, and the RoI Head performs classification and rotated box regression.
During training, HBM calculates the hard background score according to the foreground confidence and the maximum rotated IoU of each candidate region, and selects the Top-K high-risk background candidates as the hard background set . OBCS Loss constructs the positive object set and the hard background negative set using the embedding features from the RoI Head, and pulls same-class object features closer while pushing hard background features away.
For the reproduced Oriented R-CNN, ablation experiments, and BGD-Net, the same training and testing settings are adopted. Results of public methods are mainly cited from their original papers. SGD is used as the optimizer, with a momentum of 0.9 and a weight decay of 0.0001. DOTA-v1.0 and DIOR-R are trained for 12 epochs with an initial learning rate of 0.01, which is decayed at the 8th and 11th epochs. HRSC2016 is trained for 36 epochs with an initial learning rate of 0.005.
In BDFM, the background suppression coefficient is set to 0.5, and the learnable residual coefficient is initialized to 0 and jointly optimized with the network parameters. On DOTA-v1.0, reaches 0.249, 0.364, and 0.386 at epochs 4, 8, and 12, respectively, with progressively smaller changes in the later training stage, indicating a stable convergence tendency.
In HBM, and . Top-K is set to 128 on DOTA-v1.0 and DIOR-R, and 64 on HRSC2016. For OBCS Loss, the temperature coefficient is set to , the loss weight is set to 0.1, and the background-decoupled auxiliary loss weight is set to 0.5. During inference, HBM and OBCS Loss are not used, and only BDFM is retained; therefore, the additional inference overhead is limited.
4.2. Comparison on DOTA-v1.0
To evaluate the detection performance and model complexity of BGD-Net on the DOTA-v1.0 test set, several representative oriented object detection methods are selected for comparison. To improve table readability, the 15 category-wise AP values are not listed in the main table. Instead, detector type, backbone/configuration, multi-scale setting, parameters, FLOPs, and mAP@0.5 are reported. The table mainly adopts multi-scale training/testing results reported in public papers. The results of BGD-Net are obtained under the same multi-scale setting. Since some methods do not report parameters or computational cost in their original papers, “–” is used for unavailable values.
As shown in
Table 2, BGD-Net achieves 82.94% mAP@0.5 with the R-50-FPN backbone, obtaining the best performance among the listed methods. Compared with the baseline detector Oriented R-CNN, BGD-Net improves mAP@0.5 from 80.87% to 82.94%, with a gain of 2.07 percentage points. Since both methods use the same backbone, pre-training strategy, and multi-scale testing setting, this improvement directly demonstrates the effectiveness of the proposed background-decoupled learning mechanism.
In terms of model complexity, BGD-Net has 42.1M parameters and 204G FLOPs. Compared with Oriented R-CNN, it only introduces 1.0M additional parameters and 5G additional FLOPs. In other words, BGD-Net brings only about 2.43% parameter increase and 2.51% computational increase, while achieving a 2.07 percentage-point accuracy improvement. This result indicates that the proposed method can effectively improve oriented object detection performance in complex remote sensing scenes with limited additional computational cost.
Moreover, BGD-Net outperforms KFIoU, AOPG, RTMDet-R, and LSKNet-S by 2.01, 2.28, 2.40, and 1.30 percentage points, respectively, showing strong competitiveness in complex background scenes. Considering both accuracy and complexity, BGD-Net does not rely on a stronger backbone or a larger model scale. Instead, it alleviates object–background confusion through BDFM, HBM, and OBCS Loss from the feature, sample, and optimization levels, thereby achieving more robust detection performance.
To further evaluate practical inference efficiency, we measure the inference speed of Oriented R-CNN and BGD-Net under the same hardware and software environment. All experiments are conducted on a single NVIDIA Tesla T4 GPU with a batch size of 1 and an input size of . After 100 warm-up iterations, 500 inference runs are performed with CUDA synchronization, and the average inference speed is reported in frames per second (FPS).
As shown in
Table 3, BGD-Net achieves an inference speed of 19.65 FPS, compared with 20.58 FPS for Oriented R-CNN. Together with the small increases in parameters and FLOPs, this result indicates that BGD-Net maintains comparable practical inference efficiency while improving detection accuracy.
4.3. Comparison on HRSC2016
To verify the robustness of the proposed method under harbor complex backgrounds, experiments are further conducted on the HRSC2016 ship detection dataset.
Table 4 reports the ship detection results of different oriented object detection methods on HRSC2016. BGD-Net achieves 91.42% mAP@0.5 on HRSC2016, outperforming the Oriented R-CNN baseline of 90.50% by 0.92 percentage points. This result demonstrates that the proposed method remains effective for oriented ship detection under complex harbor backgrounds. Since HRSC2016 is close to performance saturation and the accuracy gaps among advanced methods are relatively small, this improvement indicates that the proposed method still provides stable gains under harbor complex backgrounds.
Ships in HRSC2016 usually have elongated shapes, diverse orientations, dense berthing patterns, and strong background interference. Dock edges, shipyard structures, shorelines, and shadow regions can be easily confused with real ships. BGD-Net suppresses complex background responses through BDFM, focuses on high-confidence hard background samples through HBM, and enlarges the feature distance between objects and hard backgrounds using OBCS Loss. Therefore, it further improves ship detection performance.
4.4. Generalization on DIOR-R
To evaluate the cross-dataset generalization ability of BGD-Net under complex background scenes, experiments are conducted on DIOR-R. DIOR-R contains various complex remote sensing scenes, including airports, harbors, urban roads, industrial areas, and dense buildings. The object appearances and background structures are more diverse, making it suitable for evaluating model generalization.
Table 5 shows the comparison results of different oriented object detection methods on DIOR-R. Since the original Oriented R-CNN paper does not report results on DIOR-R, Oriented R-CNN is reproduced under the same experimental setting and used as the baseline detector.
As shown in
Table 5, BGD-Net achieves 68.35% mAP@0.5, outperforming all compared methods. Compared with the reproduced Oriented R-CNN, BGD-Net improves mAP@0.5 from 64.36% to 68.35%, with a gain of 3.99 percentage points. In addition, BGD-Net also outperforms Oriented RepPoints, DCFL, and RQFormer, indicating that the proposed method has good generalization ability under different data distributions.
This result shows that BGD-Net is not only effective on DOTA-v1.0. Through the collaborative effect of BDFM, HBM, and OBCS Loss, the model can better distinguish real objects from complex backgrounds, thereby improving cross-dataset-oriented object detection performance in remote sensing images.
4.5. Ablation Study
To verify the effectiveness of BDFM, HBM, and OBCS Loss, ablation experiments are conducted on DOTA-v1.0 using Oriented R-CNN as the baseline detector. The results are shown in
Table 6. In addition to mAP@0.5, Hard-FP is further counted to measure the number of high-confidence false positives in complex background regions. A lower Hard-FP indicates stronger suppression ability against false positives caused by complex backgrounds.
As shown in
Table 6, all three modules bring stable improvements. When BDFM is added alone, mAP@0.5 increases from 80.87% to 81.68%, and Hard-FP decreases from 1128 to 926, indicating that BDFM can enhance object responses and weaken complex background interference. When HBM is added alone, mAP@0.5 increases to 81.32%, and Hard-FP decreases to 884, demonstrating that hard background mining can effectively reduce high-confidence background false positives. When OBCS Loss is added alone, mAP@0.5 reaches 81.41%, showing that object–background contrastive constraints can enhance the discriminability of RoI features.
When the three modules are jointly used, BGD-Net obtains the best result, achieving 82.94% mAP@0.5, which is 2.07 percentage points higher than Oriented R-CNN. Meanwhile, Hard-FP decreases to 694, corresponding to a reduction of about 38.48%. This demonstrates that BDFM, HBM, and OBCS Loss collaboratively alleviate object–background confusion from the feature, sample, and optimization levels.
Table 7 further verifies the advantage of BGD-Net on complex-background categories. Compared with Oriented R-CNN, the average AP of complex-background categories increases from 78.03% to 80.40%, with a gain of 2.37 percentage points. In particular, BGD-Net achieves clear improvements on categories that are easily affected by background structures, such as bridge, small vehicle, ship, soccer-ball field, roundabout, and harbor. This result indicates that the proposed method can effectively reduce false positives caused by complex backgrounds, such as dock edges, road textures, building structures, and circular facilities.
Overall, the ablation study demonstrates the effectiveness of BDFM, HBM, and OBCS Loss. The best performance is achieved when all three components are combined, verifying the rationality of the object–background decoupled learning mechanism in BGD-Net.
4.6. Counterfactual Substitution Experiments
To further verify whether the specific designs of BDFM, HBM, and OBCS Loss are more effective than conventional alternatives, we conduct counterfactual substitution experiments on DOTA-v1.0. In each experiment, only one proposed component is replaced while the remaining network architecture, training strategy, data augmentation, and testing settings are kept unchanged. Specifically, BDFM is replaced with CBAM [
37], HBM is replaced with OHEM [
42], and OBCS Loss is replaced with standard supervised contrastive loss (SupCon) [
46].
As shown in
Table 8, all three standard substitution variants improve over the Oriented R-CNN baseline, but remain inferior to the complete BGD-Net. Replacing BDFM with CBAM decreases mAP@0.5 from 82.94% to 82.28%, indicating that generic attention-based feature enhancement cannot fully replace the explicit object–background modeling of BDFM. Similarly, replacing HBM with OHEM results in 82.16% mAP@0.5, suggesting that selecting hard samples solely according to classification loss is less effective than jointly considering foreground confidence and rotated IoU.
When OBCS Loss is replaced with standard supervised contrastive learning, the model achieves 82.33% mAP@0.5, which is lower than the 82.94% achieved by the complete BGD-Net. These results indicate that the performance improvement is not merely caused by introducing attention, hard-example mining, or contrastive learning in a generic form. Instead, the specific formulations of BDFM, HBM, and OBCS are better suited to suppressing object–background confusion in complex remote sensing scenes.
4.7. Statistical Robustness Analysis
To evaluate the robustness of the reported improvements against random initialization, we repeated the baseline and the main BGD-Net variants using three independent random seeds under identical training and evaluation settings. For each method, we report the mean and standard deviation of mAP@0.5 and Hard-FP. The same set of random seeds was used for all compared methods to reduce the influence of seed-dependent variation.
As shown in
Table 9, BGD-Net achieves an average mAP@0.5 of 82.93 ± 0.07% across three independent runs, compared with 80.87 ± 0.08% for the Oriented R-CNN baseline. Meanwhile, the average Hard-FP is reduced from 1126.7 ± 14.6 to 695.0 ± 9.5. The relatively small standard deviations across the three runs indicate that the performance improvements are reproducible under different random initializations.
4.8. Hyperparameter Analysis
To analyze the influence of key hyperparameters on BGD-Net, parameter sensitivity experiments are conducted on DOTA-v1.0. A controlled-variable strategy is adopted, where only the corresponding parameters in each experiment are changed, while the network architecture, training strategy, and post-processing settings remain unchanged. The analyzed parameters include the background-decoupled auxiliary loss weight
, the object–background contrastive suppression loss weight
, the temperature coefficient
, the hard background sampling number Top-
K, and the background threshold
. The results are shown in
Figure 4.
Figure 4a,b show the joint influence of
and
on mAP@0.5 and Hard-FP reduction, respectively. Hard-FP reduction denotes the reduction ratio of hard false positives compared with the Oriented R-CNN baseline. When
and
, the model achieves the highest mAP@0.5 of 82.94%, while Hard-FP decreases from 1128 to 694, corresponding to a reduction of 38.48%. When the loss weights are too small, the auxiliary supervision and contrastive constraints are insufficient. When the weights are too large, they may interfere with the optimization of the basic classification and regression tasks.
Figure 4c analyzes the influence of the internal OBCS Loss parameters
and
. The model achieves the best performance when
and
. A smaller
makes the similarity distribution too sharp, causing gradients to concentrate on only a few hard samples. In contrast, a larger
over-smooths the similarity distribution and weakens the feature discrimination between real objects and hard backgrounds.
Figure 4d shows the influence of Top-K and
on HBM. The best result is obtained when Top-K = 128 and
. A too-small Top-K provides insufficient hard-background samples, whereas a too-large Top-K may introduce redundant or noisy samples. Similarly, a smaller
may exclude informative hard-background candidates, while a larger threshold may incorrectly include ambiguous or inaccurately localized object proposals in the background set.
Overall, the response surfaces generally increase toward the optimal region and then decrease or become saturated. This indicates that excessively small parameter values provide insufficient constraints, whereas overly large values may introduce excessive suppression or noise interference. Meanwhile, the relatively smooth variations around the optimum indicate that the selected parameters provide a reasonable operating region. Based on these experiments, the final settings are , , , Top-K = 128, and .
It should be noted that
is used for background candidate selection during HBM training. To further examine whether the observed Hard-FP reduction is specific to the IoU threshold of 0.30, we keep the trained models fixed and recalculate Hard-FP using different evaluation IoU thresholds of 0.10, 0.20, 0.30, 0.40, and 0.50. No model retraining or parameter tuning is performed during this evaluation. The corresponding results are reported in
Table 10.
As shown in
Table 10, BGD-Net consistently produces fewer Hard-FPs than the Oriented R-CNN baseline across all tested evaluation IoU thresholds. The Hard-FP reduction remains approximately 37–38% when the evaluation IoU threshold varies from 0.10 to 0.50. Importantly, the improvement is not restricted to the threshold of 0.30 used during HBM training. These results demonstrate that the reduction in high-confidence background false positives is maintained under different evaluation criteria.
4.9. Visualization Analysis
To intuitively verify the detection performance of BGD-Net in complex background scenes, harbor, airport, urban road, and industrial area scenes are selected for visualization comparison, as shown in
Figure 5. The first row shows the ground-truth annotations, and the second and third rows show the detection results of the Oriented R-CNN baseline and BGD-Net, respectively. Red circles indicate missed detections or false positives.
In the harbor scene, ships are densely berthed and close to dock edges. The baseline method is easily affected by pier edges and neighboring ships, resulting in missed detections or incomplete localization near image boundaries and dense regions. BGD-Net can more completely detect ships with different orientations and scales, and reduce false predictions caused by complex dock backgrounds. In the airport scene, the baseline method misclassifies some “H”-shaped ground markings as aircraft, while BGD-Net effectively suppresses such regular geometric background interference and retains real aircraft targets.
In the urban road scene, small vehicles are densely distributed along curved roads and intersections. The baseline method is affected by road markings, vehicle shadows, and building edges, producing some missed detections and false positives. BGD-Net detects vehicles along roadsides more continuously and stably. In the industrial area, storage tanks, building roofs, and other circular industrial structures have similar geometric appearances. The baseline method has more missed detections for small-scale and low-contrast objects. BGD-Net can more accurately localize storage tanks of different scales and reduce false positives caused by complex industrial backgrounds, although a few errors still exist in extremely dense or boundary-ambiguous regions.
Overall, BGD-Net shows better detection stability in different complex scenes. It especially alleviates object–background confusion caused by dock structures, airport markings, road textures, and industrial facilities. The visualization results are consistent with the quantitative and ablation results, indicating that the proposed background-decoupled learning strategy can effectively reduce missed detections and high-confidence false positives caused by complex backgrounds, and improve the adaptability of the model to dense objects, small-scale objects, and regular geometric background interference.
5. Discussion
The experimental results demonstrate that BGD-Net effectively alleviates object–background confusion in complex remote sensing scenes through coordinated optimization at the feature, sample, and embedding levels. Compared with the baseline, the proposed method consistently reduces high-confidence false positives while improving oriented object detection performance across multiple datasets. These results suggest that explicitly modeling background interference is beneficial for complex-scene oriented object detection.
The ablation results further show that BDFM, HBM, and OBCS Loss provide complementary contributions. BDFM reduces background interference before proposal generation, HBM emphasizes high-risk background regions during training, and OBCS Loss improves the separation between object and hard-background representations in the embedding space. Their combined use therefore improves object–background discrimination without relying solely on increased model capacity.
Nevertheless, the proposed method still has some limitations. First, the background threshold and Top-K value in HBM, as well as the temperature coefficient and loss weights in OBCS Loss, still need to be set according to different datasets. Second, OBCS Loss depends on candidate regions generated by the preceding stage. When very small objects, heavily occluded objects, or low-contrast objects are not effectively recalled, the subsequent contrastive constraint cannot fully compensate for the insufficient proposals. In addition, the current experiments are mainly conducted on optical remote sensing images and a two-stage detection framework. Its applicability to SAR images, multispectral data, and other detection frameworks still requires further verification.
HBM and OBCS Loss are used only during training, while BDFM is mainly retained during inference. Therefore, the additional inference overhead is limited. Future work will explore adaptive hard background selection, enhanced recall for very small objects, and cross-domain generalization. More fine-grained false-positive analysis will also be considered to further improve the adaptability of the model under different imaging conditions and complex scenes.