Next Article in Journal
The Convective Rainfall Rate from Cloud Physical Properties Algorithm for Meteosat Second-Generation Satellites: Microphysical Basis and Intercomparisons using an Object-Based Method
Previous Article in Journal
Long-Term Monitoring of Cork and Holm Oak Stands Productivity in Portugal with Landsat Imagery
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Multi-Scale Proposal Generation for Ship Detection in SAR Images

School of Information and Communication Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China
*
Author to whom correspondence should be addressed.
Remote Sens. 2019, 11(5), 526; https://doi.org/10.3390/rs11050526
Submission received: 11 January 2019 / Revised: 15 February 2019 / Accepted: 28 February 2019 / Published: 5 March 2019

Abstract

:
The classic ship detection methods in synthetic aperture radar (SAR) images suffer from an extreme variance of ship scale. Generating a set of ship proposals before detection operation can effectively alleviate the multi-scale problem. In order to construct a scale-independent proposal generator for SAR images, we suggest four characteristics of ships in SAR images and the corresponding four procedures in this paper. Based on these characteristics and procedures, we put forward a framework to explore multi-scale ship proposals. The designed framework mainly contains two stages: hierarchical grouping and proposal scoring. Firstly, we extract edges, superpixels and strong scattering components from SAR images. The ship proposals are obtained at hierarchical grouping stage by combining the strong scattering components with superpixel grouping. Considering the difference of edge density and the completeness and tightness of contour, we obtain the scores to measure the confidence that a proposal contains a ship. Finally, the ranking proposals are obtained. Extensive experiments demonstrate the effectiveness of the four procedures. Our method achieves 0.70 the average best overlap (ABO) score, 0.59 the area under the curve (AUC) score and 0.85 best recall on a challenging dataset. In addition, the recall of our method on three scale subsets are all above 0.80. Experimental results demonstrate that our algorithm outperforms the approaches previously used for SAR images.

1. Introduction

Ships are valuable transportation and used in many areas of human activity. As synthetic aperture radar (SAR) can provide images of the ocean in all weather operating conditions, automatic ship detection based on these data has attracted considerable attention [1].
Ship detection in SAR images experienced significant improvement in recent years. Previous studies on ship detection using SAR images can be categorized into four types: (1) the constant false-alarm rate-based (CFAR) detectors, (2) the generalized-likelihood ratio test-based (GLRT) detectors, (3) the saliency-based methods and (4) the deep learning-based methods. As we know, different classes of ships are of different lengths and widths, and different SAR images may have different resolution. Therefore, ships always have different scales in SAR images as shown in Figure 1. However, the above-mentioned methods either lose information of small objects or require a priori knowledge about the ship scale. They are inadequate to deal with multi-scale ship detection.
The detectors based on CFAR are widely used ship detection methods [2,3]. In order to improve ship detection performance, many studies attempt to modify the classic CFAR detector [4,5,6,7,8,9,10,11,12,13,14]. Like multilayer CFAR detectors, researchers integrate the idea of iterative censoring with traditional CFAR at pixel level [15,16]. Superpixels can retain the ship outline and reduce the influence of speckle noise. Thus, the conventional CFAR detector is modified at the superpixel level [17,18,19,20]. For example, the multi-scale superpixel and three superpixel-level dissimilarity are unified to design a detection algorithm for polarimetric SAR images in [20]. In order to improve the performance of ship detection in SAR images, many statistical models have also been researched to fit sea clutter [21,22,23]. The pixel-level CFAR detectors generally adopt a sliding window scheme that cannot cover the various ship sizes. The superpixel-level CFAR detectors have the probability of losing some components of large scale ships in the detection results.
The second type approach is based on GLRT [25]. Considering the electromagnetic aspects behind the interactions of SAR signals with the ship and the surrounding sea, Iervolino et al. present a closed form expression for the Radar Cross Section (RCS) backscattering of a ship and a new detector based on GLRT [26,27]. Similar to CFAR detectors, GLRT detectors require a priori knowledge about the ship scale and cannot handle the detection of multi-scale ships.
In recent years, several methods have employed the biologically inspired saliency model for ship detection [28,29,30,31,32]. For example, Wang et al. design a random-forest-based hierarchical sparse model for ship proposal selection. Then, the false alarms are filtered out by a dynamic CFAR-based contour saliency model [29]. The saliency-based methods pay attention to the ships that are relatively prominent. However, as shown in Figure 1, the prominent objects are those large scale ships and complex background. Small ships would be ignored by the saliency-based methods. With the development of deep learning, many detection approaches based on convolutional neural networks (CNNs) have been proposed. Fully convolutional networks (FCN) are used to separate the sea from the land [33,34]. The Faster-RCNN, cascade coupled CNN (3C2N) and the single shot multiBox detector (SSD) for SAR ship detection are reported in [35,36,37,38,39,40]. Furthermore, there are two SAR image datasets for marine surveillance and ship detection. OpenSARShip is a dataset dedicated to ship interpretation using Sentinel-1 images [41]. Li et al. construct a dataset named SAR Ship Detection Dataset (SSDD) to evaluate the performance of SAR ship detectors [42]. Besides the above-mentioned approaches, there are also several ship detectors for SAR images [43,44,45,46]. Generally, deep learning-based models adopt pooling and convolution operations. These operations lose information of small objects and confuse the localizations of densely distributed ships.
One way that can effectively alleviate the multi-scale problem is constructing a ship proposal generator before detection operation. This generator can rapidly search a set of candidate bounding boxes which are different sizes. These multi-scale candidate bounding boxes are called object proposals that cover all ship bounding boxes from a SAR image. Thus, proposal generator is a class-agnostic and scale-independent object detector that can solve the multi-scale ship detection effectively. It can speed up the computation and improve the ship detection accuracy by allowing the usage of more sophisticated learning schemes.
Recently, object proposal generation has become a superior technique in the computer vision field [47,48,49,50,51,52]. Object proposal generation methods can be divided into grouping proposal and windows scoring methods. For example, the selective search hierarchically merges superpixels to generate proposals [47]. The contour box uses the selective search to explore proposals and then rejects proposals without explicit contours [51]. We refer the reader to [53] for a survey of object proposal generation. SAR images are totally different from natural images that were processed by the computer vision field. There are few proposal generation methods for SAR images. Dai et al. train a linear SVM to learn objectness measure of ships [54]. The performance of this generator is limited since the proposal generator uses several fixed-size sliding windows.
Under the assumption that all ships share common visual properties that distinguish them from the background, we can design a generator that outputs a set of ship proposals. We argue that a desired SAR image-specific ship proposal generator should generate scale-independent proposals with high recall, and score highest for those proposals that fit a ship tightly. Therefore, the common visual properties of ships adopted by our proposal generator should be scale-independent. For example, in Figure 1c, we use the sliding windows with different scale and aspect ratio to explore initial proposals. This search strategy misses two small ships and cannot fit all ships tightly since it needs a prior knowledge of ship size and is scale-dependent. At ranking stage, we use saliency cues to measure the ship proposals. However, this scale-dependent cues result in ranking the non-ship but prominent proposals higher.
According to the above paragraph, we should design visual properties of ships which are scale-independent and common-shared before constructing a good ship proposal generator for SAR images. Thus, we propose that ships in SAR images have the following characteristics in this paper:
  • A ship generally has a different scattering characteristics from its surroundings;
  • A ship generally has some components with strong scattering;
  • There are edges between a ship and its surroundings;
  • A ship generally has a closed contour.
Our generator should be scale-independent at proposal extraction and scoring stage. Considering that the bottom-up strategy can search ships from small to large scales, we can utilize hierarchical grouping to extract multi-scale proposals. The scale-independent measures can be obtained using edge and contour information which are irrelevant with ship sizes. Therefore, we further propose four procedures that correspond to the four characteristics to explore multi-scale ship proposals:
  • The generator obtains components of ships by superpixel algorithm, and explores ships by hierarchical grouping;
  • The generator obtains proposals from the superpixels that contain at least one strong scattering component;
  • The generator measures a proposal by the difference of the edge density between the inside and near the borders of the proposal;
  • The generator measures a proposal by the completeness and the tightness of the contour.
The framework of our proposed method includes hierarchical grouping and proposal scoring stage. The information of strong scattering components is injected at hierarchical superpixel grouping stage. The hierarchical grouping stage generates ship proposals without scores. These proposals are further processed by the scoring stage, each of them is scored by edge and contour information. Finally, the ranking ship proposals are obtained.
The remainder of this paper is organized as follows. The suggested ship proposal generation method is discussed in detail in Section 2. In Section 3, we evaluate the effectiveness of the four procedures and compare the generator with the state-of-the-art methods. The results are discussed in Section 4. Section 5 presents the conclusions.

2. Ship Proposal Generator

The proposed methodology is described in detail in this section. The framework that combines all four procedures into one proposal generator are presented in Section 2.1. In Section 2.2, we put forward edge and superpixel extraction which are the foundation of our generator. The rest of this section introduces the two stages of the proposed method.

2.1. Framework

In Section 1, we propose the four characteristics of ships in SAR images and the corresponding four procedures. In this part, we further introduce the framework in detail. We need to extract edge and superpixel of SAR images firstly since the four procedures are based on edges and superpixels. Then, we need to combine all four procedures into one proposal generator. Scale-independent proposal extraction and scoring compose our method. In order to extract multi-scale initial proposals, superpixel hierarchical grouping is adopted. This bottom-up strategy can search proposals from small scale to large scale. Combining the strong scattering components information, we further reject non-ship proposals. This top-down strategy can reduce the number of initial proposals and the computation burden of proposal scoring. We use the edge information to rank initial proposals at proposal scoring stage. Specifically, edge score and contour score are used to measure ship proposals. This two scores only focus on the edge density, the contour completeness and the contour tightness which are independent of proposal scales. Therefore, the ranking results are scale-independent.
The framework of our proposed method is shown in Figure 2. Our framework including hierarchical grouping and proposal scoring. Firstly, we obtain initial proposals at the hierarchical grouping stage: the input SAR image is processed by superpixel and CFAR algorithm; then, the results are inputted into Algorithm 1 to acquire initial proposals. Then, we obtain a score for each proposal at the proposal scoring stage: the input SAR image is processed by our edge extraction scheme which will be introduced in Section 2.2. For each proposal, we can compute its score using contour scoring and edge scoring which will be introduced in Section 2.4. Finally, the ship proposals with scores are output.
Algorithm 1: Hierarchical Grouping using Superpixels and Strong Scattering Components.
Remotesensing 11 00526 i001

2.2. Edges and Superpixels

In the hope of exploring ship proposals using the four procedures mentioned above, we extract edges and superpixels firstly. We adopt the superpixel method proposed in [55] since it is robust for SAR images. The authors in [55] construct an energy function which includes two terms: data term defined by the statistical characteristic of SAR images and regularization term defined by ratio of mean intensity. The superpixel can be explored by graph cut based energy minimization method. There are few edge extraction algorithms with good generalization performance for SAR images. We construct an edge extraction scheme using an existing algorithm as shown in Figure 3. The ratio of exponentially weighted averages (ROEWA) detector is a classical edge detector for SAR images [56]. ROEWA is optimal under a stochastic multi-edge model. It computes a normalized ratio of exponentially weighted averages (ROEWA) on opposite sides of the central pixel. The magnitude on the horizontal and vertical direction construct the edge response of the central pixel. Finally, the authors in [56] apply a modified watershed algorithm to eliminate false edges response. Non-maximal suppression (NMS) can find edge peaks [52].
As shown in Figure 3, we filter the input SAR image by a non-local approach proposed in [57] firstly. In order to detect multi-scale edges, the filtered SAR image is utilized to construct an image pyramid: we resample the spatial resolution by a factor of 0.5 and 2. These two resampled images and the input image construct a image pyramid which include three octaves; each octave contains one interval. For each interval in each octave, we apply ROEWA to extract edges. Then, we can acquire three edge maps. We resample these maps to the original resolution of the input image. These resampled edge maps are added at pixel level. After normalization of these maps, the dense edge responses are obtained. We preform NMS to the edge responses and obtain final edge map.

2.3. Hierarchical Grouping

Compared to the complexity of natural targets, single frequency and single linear polarization SAR images contain limited information and cover a large area. Therefore, multi-scale ship proposal generation using SAR images is a challenging problem. The traditional idea to handle this problem is using sliding windows with different aspect ratios and scales. However, due to orientation and scale variations of ships in SAR images, the performance of sliding windows strategy is not good. According to the four characteristics mentioned in Section 1, we can obtain ships components by superpixels and search ships using a hierarchical grouping strategy similar to the selective search proposed in [47]. A strong scattering component does not always correspond to a semantic ship component. On the other hand, if a proposal does not contain a strong scattering component, it stands a high probability that this is a non-ship proposal. Therefore, different from the selective search, we take advantage of strong scattering components to censor useless proposals.
Our algorithm is shown in Algorithm 1. The algorithm can explore a list of ship proposals O u t B o x using an input SAR image. We adopt local CFAR to extract strong scattering components which are labeled in map L a b e l . The superpixels obtained by the method proposed in [55] are set as initial proposals P = { p 1 , p 2 , , p n } . Then, for each initial proposal in P, we find its neighbouring superpixels and compute the histogram similarity between each initial proposal and the neighbouring superpixels. Next, we find the pair of superpixels with maximal similarity in P and merge these two superpixels into one new proposal. If the new proposal does not contain any strong scattering components, then delete the new proposal. On the contrary, we retain this new proposal and delete the pair of superpixels from P. This procedure is repeated until there is no superpixel in P. The histogram similarity of two superpixels p i and p j is defined as follows:
s ( p i , p j ) = m = 1 N m i n ( h i m , h j m ) ,
where the h i and h j are histograms of superpixels p i and p j , respectively. In our method, we set the number of bins N = 32 .

2.4. Proposal Scoring

There are hundreds of ship proposals after hierarchical grouping. Only a few proposals contain real ships. In this section, we utilize the edge and contour scores to measure the confidence that a proposal contains a ship.

2.4.1. Edge Scoring

A ship has different scattering characteristics from its surroundings while its components have similar scattering characteristics. Therefore, there are dense edges near the border of ship proposals, and only a few weak edges inside the ship proposals. In this paper, we take advantage of edge density and edge density ratio to measure proposals.
As shown in Figure 4, the red boxes are ship proposals, and the yellow boxes are inner boxes of proposals. Edge density measures the density of edges near the ship proposals’ borders [50]. Given a ship proposal P and its inner box P i n , the edge density is calculated as the density of edges in the inner ring:
E d = p P P i n E ( p ) a r e a ( P ) a r e a ( P i n ) ,
where E is the edge map obtained in Section 2.2.
According to the ship characteristics in SAR images stated in Section 1, we suggest a ship proposal measure using edge density difference of the inner ring and the inner box. The edge density ratio is calculated as follows:
E r = 1 p P i n E ( p ) p P E ( p ) .
Finally, we obtain the edge score of the ship proposal P:
E s c o r e = E d + E r .
For fast computation, we use the integral image of E to calculate the sum of edges in a proposals.

2.4.2. Contour Scoring

Ships in SAR images generally have closed contours. A closed contour is defined in [51] using the completeness and tightness. The completeness of a contour is defined as follows:
C c o m p l e t e n e s s = max c c ϕ ( E ( x ) ) d x c 1 d x ,
where c is a closed curve, and the numerator is the length of c. We can explore a most closed contour using Equation (5). Here, the ϕ ( · ) is defined as:
ϕ ( x ) = x , x > τ , γ , x τ .
This function is adopted to adjust the edge map. According to [51], we set τ = 0.001 and γ = 1 .
A ship proposal should enclose a ship tightly. Therefore, the contour of a ship is near the proposal border. We explore a closed contour whose pixels are far from the center of the proposal. The tightness of a contour is defined as follows:
C t i g h t n e s s = max c c φ ( u ( x ) ) d x c 1 d x ,
where the distance to the center x 0 of the proposal is defined as:
u ( x ) = [ 2 / h , 2 / w ] · ( x x 0 ) ,
where w and h are respectively the width and height of the ship proposal. φ ( · ) is adopted to adjust the distance:
φ ( x ) = min ( x 2 , 0.7 ) .
Finally, the contour score of a proposal is as follows:
C s c o r e = C c o m p l e t e n e s s + C t i g h t n e s s .
We rank the ship proposals using both the edge and contour score:
P s c o r e = E s c o r e + C s c o r e .

3. Results

In this section, we evaluate the effectiveness of the procedures proposed in Section 2, and compare our method with the state-of-the-art methods. We use the SSDD dataset to test our method. The SSDD dataset includes 1160 SAR images with different resolution, scales, sea conditions, sensors and polarization. It is a challenging dataset. In order to evaluate the performance of our ship proposal generator, the dataset is divided into two parts (validation set and test set) with the proportion 7:3. Three measures are adopted here: the average best overlap (ABO), the area under the curve (AUC) and the recall measures. The AUC is the area under the curve measuring the recall versus numbers of ship proposals. The ABO between a ground truth set G and a proposal set P is calculated as follows:
A B O = 1 | S | G G max P P I o U ( G , P ) ,
where the intersection over union (IoU) can be obtained from the following equation:
I o U ( G , P ) = | G P | | G P | .
In the experiments here, we use the threshold I o U = 0.5 for evaluation.

3.1. Evaluation of Four Procedures

In order to generate multi-scale ship proposals, we suggest four procedures in Section 1. In this part, we evaluate the four procedures on validation set by comparing with the variation of our method.

3.1.1. Evaluation of Hierarchical Superpixels Grouping

The first procedure is hierarchical superpixels grouping. The generation of superpixels is the foundation of our method. Therefore, we firstly evaluate its performance under different initial superpixel size. We also evaluate the performance by replacing hierarchical superpixels grouping with other procedures.

Variation of Initial Superpixels Size

For our method, the initial size of superpixels mainly influences the recall of multi-scale ship proposals. In [55], the initial size of superpixels is defined as k; it is a main parameter used to generate superpixels. We explore variants of our approach by changing k. Specifically, we vary the initial size from k = 5 to k = 100 in steps of 5. The results are shown in Figure 5a–c. Figure 5a is the curves measuring the recall versus number of ship proposals under different initial superpixels size k. Figure 5b is the curves measuring the recall versus IoU under different initial superpixels size k. Figure 5c is the ABO scores and AUC versus different initial superpixels size k. In our paper, we adopt the results when k = 15 and k = 20 . Figure 5d shows the results. The orange curve is the recall versus number of ship proposals when k = 15 and k = 20 . The purple curve is the recall versus IoU when k = 15 and k = 20 .

Hierarchical Superpixels Grouping versus Multi-scale Superpixels Segmentation

We utilize hierarchical grouping for multi-scale ship proposals generation. In order to prove that the use of this strategy leads to better ship proposals, we evaluate the performance of hierarchical superpixels grouping here by comparing to multi-scale superpixels segmentation. In this experiment, we set four variants of multi-scale superpixels segmentation: (1) the k is varied from k = 5 to k = 50 in steps of 5; (2) the k is varied from k = 10 to k = 100 in steps of 10; (3) the k is varied from k = 10 to k = 50 in steps of 10; and (4) the k is varied from k = 5 to k = 45 in steps of 10. The four settings of k capture both small and large scale ships. For our method, we use the results when k = 15 and 20. The results are shown in Figure 6a,b. Figure 6a,b show the curves of the proposed method and multi-scale superpixels segmentation. Figure 6c,d show the curves of the proposed method and multi-scale sliding windows. Figure 6a,c are the curves measure the recall versus number of ship proposals. Figure 6b,d are the curves measuring the recall versus IoU.
The comparison of ABO scores, AUC and average number of ship proposals are shown in Table 1. Table 1 shows the ABO scores, AUC and average number of ship proposals for the proposed approach and various variants of our approach with different parameters.

Hierarchical Superpixels Grouping versus Sliding Windows

As a classic scheme to extract multi-scale target proposals, multi-scale sliding windows with different aspect ratios are compared with our method in this paper. For multi-scale sliding windows, the width w of the window are set as follows: (1) the w is varied from w = 5 to w = 50 in steps of 5; (2) the w is varied from w = 10 to w = 100 in steps of 10; (3) the w is varied from w = 10 to w = 50 in steps of 10; (4) the w is varied from w = 5 to w = 45 in steps of 10. The aspect ratios are set to 0.5, 1 and 2. Figure 6c,d show the recall rates when varying the number of ship proposals and the IoU, respectively. The ABO scores, AUC and average number of ship proposals are shown in Table 1.

3.1.2. Evaluation of Strong Scattering Components Information

Strong scattering components information is valid since ships in SAR images generally contain strong scattering. Therefore, we utilize this information for hierarchical superpixels grouping. In this section, we evaluate the value of utilization of this information. Specifically, we set k = 15 and k = 15 , 20 , respectively. The results of our method and the variants without utilization of strong scattering components information are shown in Figure 7 and Table 1. Figure 7 shows the recall of our method and the variants without utilization of strong scattering components information. Figure 7a shows the curves measuring the recall versus numbers of ship proposals. Figure 7b shows the curves measuring the recall versus IoU.

3.1.3. Evaluation of Edges Scoring and Contours Scoring

Edge scoring is adopted to rank the ship proposals in our method. We set k = 15 and k = 15 , 20 , and evaluate the performance of variants without edge scoring. The results are shown in Figure 8 and Table 1. We also evaluate the performance of two variants without contour scoring. The results are shown in Figure 9 and Table 1.
Figure 8 shows the recall of our method and the variants without utilization of edge scoring. Figure 8a is the curves measuring the recall versus numbers of ship proposals. Figure 8b is the curves measuring the recall versus IoU. Figure 9 shows the recall of our method and the variants without utilization of contour scoring. Figure 9a is the curves measuring the recall versus numbers of ship proposals. Figure 9b is the curves measuring the recall versus IoU.

3.1.4. Evaluation of Multi-Scale Ship Proposal Generation

In order to evaluate the performance of multi-scale ship proposal generation, the ground truth is clustered into three subsets. These subsets contain small, middle and large scale ships, respectively. The small, middle, and large scale ship subsets contain 1181, 407 and 226 ground truth ships, respectively. We evaluate the multi-scale proposal generation of our method and the variants on these subsets. The results are shown in Table 2 and Figure 10. Table 2 shows the results of the proposed method and various variants of our approach on multi-scale validation datasets using ABO scores, AUC and best recall. Figure 10 shows the recall of our method and the variants on multi-scale validation datasets. Figure 10a–c is the curves measuring the recall versus number of ship proposals on large, middle and small scale ships. Figure 10d–f is the curves measuring the recall versus IoU on large, middle and small scale ships.

3.2. Comparison with the State-of-the-Art Methods

In this section, we extensively compare our method with more state-of-the-art methods on the test set, including saliency filtering [29], local contrast variance weighted information entropy (LCVIWE) [1], information theory-based target detection (ITBTD) [3] and objectness learning [54]. For our method, we set k = 15 , 20 . For other methods, we adopt the outputs of ship candidate extraction as final ship proposals. The results are shown in Figure 11 and Table 3. Figure 11 shows the recall of our method and the state-of-the-art methods. Figure 11a is the curves measuring the recall versus numbers of ship proposals. Figure 11b is the curves measuring the recall versus IoU. Table 3 shows the ABO scores, AUC and best recall for the proposed method and the state-of-the-art methods on test datasets that contain multi-scale ships.
We further evaluate the performance of multi-scale ship proposal generation. Specifically, the ground truth of test data is clustered into small ships, middle ships and large ships’ subsets. These subsets contain 485, 179 and 62 ships, respectively. The results of all methods on three subsets are shown in Figure 12 and Table 3. Figure 12 shows the recall of our method and the state-of-the-art methods on multi-scale datasets. Figure 12a–c shows the curves measuring the recall versus numbers of ship proposals on test datasets that contain large, middle and small scale ships. Figure 12d–f shows the curves measuring the recall versus IoU on test datasets that contain large, middle and small scale ships.
The computational time of different methods is shown in Table 4. All experiments were implemented on Intel(R) Core(TM) i5-6500 CPU at 3.19 GHz and 8 GB RAM.
Finally, some results of the proposed method are shown in Figure 13. Blue bounding boxes are the closest produced object proposals to each ground truth. Green and red bounding boxes are ground truth bounding boxes. Green represents that a ship was found and red indicates that the ship was not found. The yellow numbers are the scores of bounding boxes.

4. Discussion

In this section, we discuss the effect of parameter and the four procedures. In addition, comparing with the state-of-the-art are also commented.
(1) The effect of parameter k. In the proposed method, the parameter k is very important. As show in Figure 5a–c, the performance is limited when k is set too small or too large since this setting cannot capture small or large scale ships. When k is set to 15 or 20, our method achieves a relatively good performance. The ABO scores are both higher than 0.6, and the AUC are both higher than 0.5. The best recall is 0.74642 when k = 15 . In order to obtain ship proposals with good quality, we vary the initial size of superpixels and combine the results using k = 15 and k = 20 . The performance of this combination is shown in Figure 5d. The ABO scores and the AUC are 0.70334 and 0.58, respectively.
(2) The effect of hierarchical superpixels grouping. The results of comparison with multi-scale superpixels segmentation and sliding windows are shown in Table 1 and Figure 6. The first and second variants of multi-scale superpixels segmentation both provide comparable results with our approach from Figure 6b. However, it can be observed that our method outperforms the four variants from the perspective of AUC and ABO scores. Note that our method generates a smaller number of proposals than other variants from Figure 6a and Table 1. This indicates that the ships can be efficiently detected within a smaller searching space using our method. We conclude that using all ship proposals generated by superpixel hierarchical grouping is much better than using multi-scale superpixel segmentation. As for sliding windows, it can be observed that the performance of four variants of sliding windows degrades quickly when the recall threshold is increased. Our method outperforms all four variants, and is much better at high IoU area. Moreover, our method obtains ship proposals with much better quality since the ABO score is the highest. We can conclude that sliding windows cannot handle the multi-scale ships proposal generation in SAR images. We attribute this to the high variation of ships size and orientation in SAR images.
(3) The effect of strong scattering components information. When comparing results over a variety of IoU thresholds (Figure 7b), we can see the recall of the variants are slightly higher than ours at low IoU area. As shown in Figure 7a, ours achieves competitive or higher recall when the number of proposals increases. It also can be observed that our method generates a high quality of proposals with higher ABO, AUC and less number of ship proposals. The results imply the effectiveness of strong scattering components information injection.
(4) The effect of edges scoring. As shown in Figure 8b, two variants have similar curves with our method over a variety of IoU thresholds. It is reasonable since edge scoring only influences the proposal scoring stage. Figure 8a shows that our method achieves competitive or higher recall with same number of proposals. A small drop in AUC can be observed in Table 1 when the edge scoring stage is removed. Therefore, edge scoring can perform better for true ship proposals.
(5) The effect of contour scoring. Similar to edge scoring, contour scoring is only used at a proposal scoring stage. Thus, our methods have similar curves with the two variants over a variety of IoU thresholds. Comparing to our methods, the two variants have a significant drop in AUC in Table 1. Figure 9a shows the recall when changing the number of ship proposals. Comparing to two variants, our methods show higher recall, especially when the number of ship proposals is less than 100. In conclusion, the performance of our method is significantly boosted with contour scoring.
(6) Multi-scale ship proposal generation. The performance of multi-scale sliding windows is the worst, especially on a large scale ship subset. We found the multi-scale superpixel segmentation to be unstable when k = 5 , 10 , , 50 . Although the multi-scale superpixel segmentation achieves higher best recall than ours on a large scale ship subset when k = 5 , 10 , , 50 , the performance of this variant degrades dramatically on a small scale ship subset, even worse than the multi-scale sliding windows. When k = 10 , 20 , , 100 , the performance of multi-scale superpixels segmentation is relatively stable. Our method can achieve comparable or better performance than these variants in terms of ABO, AUC and best recall. In contrast, our proposed method showed more stable and better behavior on both three subsets than other variants. Furthermore, as shown in Table 1, our method requires 868 ship proposals to achieve good results on three subsets, and multi-scale superpixels generates 12,603 ship proposals.
(7) Comparison with the state-of-the-art methods. The results in Figure 11a clearly illustrate that our approach achieves the highest best recall and AUC. The recall of LCVIWE and ITBTD increases slowly or remains unchangeable as the number of proposals increases. This is because these methods generally generate only a few proposals per image. The recall of objectness learning is significantly boosted with a large number of proposals. This is probably because the objectness measure cannot always score the highest for true ship proposals. It is found that saliency filtering performs slightly better than ours with a small number of proposals, but suffers from poor localization accuracy as can be seen from Figure 11b. From Table 3, it can be seen that our method explores proposals with the highest quality. In addition, our approach outperforms other methods and shows more stable behavior than others on all three subsets.

5. Conclusions

Currently, ship detection methods for SAR images suffer from an extreme variance of ship sizes. In this paper, we propose a ship proposal generator to explore multi-scale ship proposals. The proposed method utilizes four scale-independent characteristics and puts forward four corresponding procedures. Initial proposals are obtained by hierarchical superpixels grouping. Non-ship proposals are rejected using strong scattering components. At the scoring stage, we use contour and edge information to rank proposals. The four procedures in our method are scale-independent. Therefore, the final ship proposals are scale-irrelevant. In the experiments, we evaluate the effectiveness of the four procedures on a validation dataset. The results show that hierarchical superpixels grouping outperforms the classic multi-scale proposal extraction scheme. With strong scattering components, the AUC increases to 0.58 and the average number of proposals decreases to 868 per image. The experiments’ results also show the effectiveness of contour and edge scoring. We compare our approach with the state-of-the-art methods on the test dataset. The proposed method obtains the highest best recall and the highest quality of proposals. We can draw a conclusion that the proposed method outperforms other methods. The results also show that our method has more stable behavior and better performance on multi-scale datasets.

Author Contributions

Investigation, S.D.; Methodology, N.L.; Software, N.L.; Supervision, Z.C. (Zongjie Cao); Writing—Original Draft, N.L.; Writing–Review and Editing, Z.C. (Zongjie Cao), Z.C. (Zongyong Cui) and Y.P.

Funding

This research was funded by the National Natural Science Foundation of China Grant No. 61801098 and the Fundamental Research Funds for the Central Universities Grant No. 2672018ZYGX2018J013.

Acknowledgments

The authors would like to thank the Naval Aeronautical and Astronautical University for providing the SSDD dataset.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Huo, W.; Huang, Y.; Pei, J.; Zhang, Q.; Gu, Q.; Yang, J. Ship Detection from Ocean SAR Image Based on Local Contrast Variance Weighted Information Entropy. Sensors 2018, 18, 1196. [Google Scholar] [CrossRef] [PubMed]
  2. Song, S.; Xu, B.; Li, Z.; Yang, J. Ship Detection in SAR Imagery via Variational Bayesian Inference. IEEE Geosci. Remote Sens. Lett. 2016, 13, 319–323. [Google Scholar] [CrossRef]
  3. Liu, S.; Cao, Z.; Yang, H. Information theory-based target detection for high-resolution SAR image. IEEE Geosci. Remote Sens. Lett. 2016, 13, 404–408. [Google Scholar] [CrossRef]
  4. Leng, X.; Ji, K.; Xing, X.; Zhou, S.; Zou, H. Area Ratio Invariant Feature Group for Ship Detection in SAR Imagery. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2018, 11, 2376–2388. [Google Scholar] [CrossRef]
  5. Ao, W.; Xu, F.; Li, Y.; Wang, H. Detection and Discrimination of Ship Targets in Complex Background From Spaceborne ALOS-2 SAR Images. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2018, 11, 536–550. [Google Scholar] [CrossRef]
  6. Wang, C.; Bi, F.; Zhang, W.; Chen, L. An intensity-space domain CFAR method for ship detection in HR SAR images. IEEE Geosci. Remote Sens. Lett. 2017, 14, 529–533. [Google Scholar] [CrossRef]
  7. Gao, G.; Shi, G. CFAR ship detection in nonhomogeneous sea clutter using polarimetric SAR data based on the notch filter. IEEE Trans. Geosci. Remote Sens. 2017, 55, 4811–4824. [Google Scholar] [CrossRef]
  8. Tian, S.; Wang, C.; Zhang, H. An improved nonparametric CFAR method for ship detection in single polarization synthetic aperture radar imagery. In Proceedings of the 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Beijing, China, 10–15 July 2016; pp. 6637–6640. [Google Scholar]
  9. Leng, X.; Ji, K.; Yang, K.; Zou, H. A bilateral CFAR algorithm for ship detection in SAR images. IEEE Geosci. Remote Sens. Lett. 2015, 12, 1536–1540. [Google Scholar] [CrossRef]
  10. Xiang, X.; Ji, K.; Zou, H.; Sun, J. A fast ship detection algorithm in SAR imagery for wide area ocean surveillance. In Proceedings of the 2012 IEEE Radar Conference (RADAR), Atlanta, GA, USA, 7–11 May 2012; pp. 570–574. [Google Scholar]
  11. Gao, G.; Gao, S.; He, J.; Li, G. Ship Detection Using Compact Polarimetric SAR Based on the Notch Filter. IEEE Trans. Geosci. Remote Sens. 2018, 56, 5380–5393. [Google Scholar] [CrossRef]
  12. Schwegmann, C.P.; Kleynhans, W.; Salmon, B.P. Synthetic aperture radar ship detection using Haar-like features. IEEE Geosci. Remote Sens. Lett. 2017, 14, 154–158. [Google Scholar] [CrossRef]
  13. Wang, W.; Ji, Y.; Lin, X. A novel fusion-based ship detection method from Pol-SAR images. Sensors 2015, 15, 25072–25089. [Google Scholar] [CrossRef] [PubMed]
  14. Wang, X.; Chen, C. Ship detection for complex background SAR images based on a multiscale variance weighted image entropy method. IEEE Geosci. Remote Sens. Lett. 2017, 14, 184–187. [Google Scholar] [CrossRef]
  15. An, W.; Xie, C.; Yuan, X. An improved iterative censoring scheme for CFAR ship detection with SAR imagery. IEEE Trans. Geosci. Remote Sens. 2014, 52, 4585–4595. [Google Scholar]
  16. Hou, B.; Chen, X.; Jiao, L. Multilayer CFAR detection of ship targets in very high resolution SAR images. IEEE Geosci. Remote Sens. Lett. 2015, 12, 811–815. [Google Scholar]
  17. Li, T.; Liu, Z.; Xie, R.; Ran, L. An Improved Superpixel-Level CFAR Detection Method for Ship Targets in High-Resolution SAR Images. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2018, 11, 184–194. [Google Scholar] [CrossRef]
  18. Pappas, O.; Achim, A.; Bull, D. Superpixel-Level CFAR Detectors for Ship Detection in SAR Imagery. IEEE Geosci. Remote Sens. Lett. 2018, 15, 1397–1401. [Google Scholar] [CrossRef]
  19. Wang, Y.; Liu, H. PolSAR ship detection based on superpixel-level scattering mechanism distribution features. IEEE Geosci. Remote Sens. Lett. 2015, 12, 1780–1784. [Google Scholar] [CrossRef]
  20. He, J.; Wang, Y.; Liu, H.; Wang, N.; Wang, J. A Novel Automatic PolSAR Ship Detection Method Based on Superpixel-Level Local Information Measurement. IEEE Geosci. Remote Sens. Lett. 2018, 15, 384–388. [Google Scholar] [CrossRef]
  21. Liao, M.; Wang, C.; Wang, Y.; Jiang, L. Using SAR images to detect ships from sea clutter. IEEE Geosci. Remote Sens. Lett. 2008, 5, 194–198. [Google Scholar] [CrossRef]
  22. Gierull, C.H.; Sikaneta, I. A Compound-Plus-Noise Model for Improved Vessel Detection in Non-Gaussian SAR Imagery. IEEE Trans. Geosci. Remote Sens. 2018, 56, 1444–1453. [Google Scholar] [CrossRef]
  23. Gao, G.; Ouyang, K.; Luo, Y.; Liang, S.; Zhou, S. Scheme of parameter estimation for generalized gamma distribution and its application to ship detection in SAR images. IEEE Trans. Geosci. Remote Sens. 2017, 55, 1812–1832. [Google Scholar] [CrossRef]
  24. Sample Imagery. Available online: https://www.intelligence-airbusds.com/en/8262-sample-imagery (accessed on 4 March 2019).
  25. Marino, A.; Sanjuan-Ferrer, M.J.; Hajnsek, I.; Ouchi, K. Ship detection with spectral analysis of synthetic aperture radar: A comparison of new and well-known algorithms. Remote Sens. 2015, 7, 5416–5439. [Google Scholar] [CrossRef]
  26. Iervolino, P.; Guida, R.; Whittaker, P. A new GLRT-based ship detection technique in SAR images. In Proceedings of the 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Milan, Italy, 26–31 July 2015; pp. 3131–3134. [Google Scholar]
  27. Iervolino, P.; Guida, R. A novel ship detector based on the generalized-likelihood ratio test for SAR imagery. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2017, 10, 3616–3630. [Google Scholar] [CrossRef]
  28. Zhai, L.; Li, Y.; Su, Y. Inshore ship detection via saliency and context information in high-resolution SAR images. IEEE Geosci. Remote Sens. Lett. 2016, 13, 1870–1874. [Google Scholar] [CrossRef]
  29. Wang, S.; Wang, M.; Yang, S.; Jiao, L. New hierarchical saliency filtering for fast ship detection in high-resolution SAR images. IEEE Trans. Geosci. Remote Sens. 2017, 55, 351–362. [Google Scholar] [CrossRef]
  30. Yang, M.; Guo, C. Ship Detection in SAR Images Based on Lognormal ρ-Metric. IEEE Geosci. Remote Sens. Lett. 2018. [Google Scholar] [CrossRef]
  31. He, J.; Wang, Y.; Liu, H.; Wang, N. PolSAR ship detection using local scattering mechanism difference based on regression kernel. IEEE Geosci. Remote Sens. Lett. 2017, 14, 1725–1729. [Google Scholar] [CrossRef]
  32. Xu, L.; Zhang, H.; Wang, C.; Zhang, B.; Tian, S. Compact polarimetric SAR ship detection with m-δ decomposition using visual attention model. Remote Sens. 2016, 8, 751. [Google Scholar] [CrossRef]
  33. Liu, Y.; Zhang, M.H.; Xu, P.; Guo, Z.W. SAR ship detection using sea-land segmentation-based convolutional neural network. In Proceedings of the 2017 International Workshop on Remote Sensing with Intelligent Processing (RSIP), Shanghai, China, 18–21 May 2017; pp. 1–4. [Google Scholar]
  34. An, Q.; Pan, Z.; You, H. Ship Detection in Gaofen-3 SAR Images Based on Sea Clutter Distribution Analysis and Deep Convolutional Neural Network. Sensors 2018, 18, 334. [Google Scholar] [CrossRef] [PubMed]
  35. Kang, M.; Leng, X.; Lin, Z.; Ji, K. A modified faster R-CNN based on CFAR algorithm for SAR ship detection. In Proceedings of the 2017 International Workshop on Remote Sensing with Intelligent Processing (RSIP), Shanghai, China, 18–21 May 2017; pp. 1–4. [Google Scholar]
  36. Ren, S.; He, K.; Girshick, R.; Sun, J. Faster r-cnn: Towards real-time object detection with region proposal networks. In Advances in Neural Information Processing Systems 28; Curran Associates, Inc.: Red Hook, NY, USA, 2015; pp. 91–99. [Google Scholar]
  37. Zhao, J.; Zhang, Z.; Yu, W.; Truong, T.K. A Cascade Coupled Convolutional Neural Network Guided Visual Attention Method for Ship Detection from SAR Images. IEEE Access 2018, 6, 50693–50708. [Google Scholar] [CrossRef]
  38. Jiao, J.; Zhang, Y.; Sun, H.; Yang, X.; Gao, X.; Hong, W.; Fu, K.; Sun, X. A Densely Connected End-to-End Neural Network for Multiscale and Multiscene SAR Ship Detection. IEEE Access 2018, 6, 20881–20892. [Google Scholar] [CrossRef]
  39. Wang, Y.; Wang, C.; Zhang, H. Combining a single shot multibox detector with transfer learning for ship detection using sentinel-1 SAR images. Remote Sens. Lett. 2018, 9, 780–788. [Google Scholar] [CrossRef]
  40. Liu, W.; Anguelov, D.; Erhan, D.; Szegedy, C.; Reed, S.; Fu, C.Y.; Berg, A.C. Ssd: Single shot multibox detector. In European Conference on Computer Vision; Springer: Berlin/Heidelberg, Germany, 2016; pp. 21–37. [Google Scholar]
  41. Huang, L.; Liu, B.; Li, B.; Guo, W.; Yu, W.; Zhang, Z.; Yu, W. OpenSARShip: A dataset dedicated to Sentinel-1 ship interpretation. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2018, 11, 195–208. [Google Scholar] [CrossRef]
  42. Li, J.; Qu, C.; Shao, J. Ship detection in SAR images based on an improved faster R-CNN. In Proceedings of the SAR in Big Data Era: Models, Methods and Applications (BIGSARDATA), Beijing, China, 13–14 November 2017; pp. 1–6. [Google Scholar]
  43. Song, S.; Xu, B.; Yang, J. Ship Detection in Polarimetric SAR Images via Variational Bayesian Inference. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2017, 10, 2819–2829. [Google Scholar] [CrossRef]
  44. Zhang, T.; Yang, Z.; Xiong, H. PolSAR Ship Detection Based on the Polarimetric Covariance Difference Matrix. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2017, 10, 3348–3359. [Google Scholar] [CrossRef]
  45. Shi, H.; Zhang, Q.; Bian, M.; Wang, H.; Wang, Z.; Chen, L.; Yang, J. A Novel Ship Detection Method Based on Gradient and Integral Feature for Single-Polarization Synthetic Aperture Radar Imagery. Sensors 2018, 18, 563. [Google Scholar] [CrossRef] [PubMed]
  46. Fan, W.; Zhou, F.; Tao, M.; Bai, X.; Shi, X.; Xu, H. An automatic ship detection method for PolSAR data based on K-Wishart distribution. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2017, 10, 2725–2737. [Google Scholar] [CrossRef]
  47. Uijlings, J.R.; Van De Sande, K.E.; Gevers, T.; Smeulders, A.W. Selective search for object recognition. Int. J. Comput. Vis. 2013, 104, 154–171. [Google Scholar] [CrossRef]
  48. Krähenbühl, P.; Koltun, V. Geodesic object proposals. In European Conference on Computer Vision; Springer: Berlin/Heidelberg, Germany, 2014; pp. 725–739. [Google Scholar]
  49. Rantalankila, P.; Kannala, J.; Rahtu, E. Generating object segmentation proposals using global and local search. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA, 23–28 June 2014; pp. 2417–2424. [Google Scholar]
  50. Alexe, B.; Deselaers, T.; Ferrari, V. What is an object? In Proceedings of the 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), San Francisco, CA, USA, 13–18 June 2010; pp. 73–80. [Google Scholar]
  51. Lu, C.; Liu, S.; Jia, J.; Tang, C.K. Contour box: Rejecting object proposals without explicit closed contours. In Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile, 7–13 December 2015; pp. 2021–2029. [Google Scholar]
  52. Zitnick, C.L.; Dollár, P. Edge boxes: Locating object proposals from edges. In European Conference on Computer Vision; Springer: Berlin/Heidelberg, Germany, 2014; pp. 391–405. [Google Scholar]
  53. Hosang, J.; Benenson, R.; Dollár, P.; Schiele, B. What makes for effective detection proposals? IEEE Trans. Pattern Anal. Mach. Intell. 2016, 38, 814–830. [Google Scholar] [CrossRef] [PubMed]
  54. Dai, H.; Du, L.; Wang, Y.; Wang, Z. A modified CFAR algorithm based on object proposals for ship target detection in SAR images. IEEE Geosci. Remote Sens. Lett. 2016, 13, 1925–1929. [Google Scholar] [CrossRef]
  55. Feng, J.; Pi, Y.; Yang, J. SAR image superpixels by minimizing a statistical model and ratio of mean intensity based energy. In Proceedings of the 2013 IEEE International Conference on Communications Workshops (ICC), Budapest, Hungary, 9–13 June 2013; pp. 916–920. [Google Scholar]
  56. Fjortoft, R.; Lopes, A.; Marthon, P.; Cubero-Castan, E. An optimal multiedge detector for SAR image segmentation. IEEE Trans. Geosci. Remote Sens. 1998, 36, 793–802. [Google Scholar] [CrossRef] [Green Version]
  57. Deledalle, C.A.; Tupin, F.; Denis, L. A non-local approach for SAR and interferometric SAR denoising. In Proceedings of the 2010 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Honolulu, HI, USA, 25–30 July 2010; pp. 714–717. [Google Scholar]
Figure 1. Multi-scale ships in synthetic aperture radar (SAR) images. (a,b) can be downloaded at [24]. These two images were taken by Terra-SAR at Panama Canal: (a) resolution is 0.43 m. The acquisition date is 13 December 2013. Mode is Staring SpotLight; (b) resolution is 35 m. The acquisition date is 12 July 2013. The mode is Wide ScanSAR; (c) ship proposals obtained by scale-dependent properties.
Figure 1. Multi-scale ships in synthetic aperture radar (SAR) images. (a,b) can be downloaded at [24]. These two images were taken by Terra-SAR at Panama Canal: (a) resolution is 0.43 m. The acquisition date is 13 December 2013. Mode is Staring SpotLight; (b) resolution is 35 m. The acquisition date is 12 July 2013. The mode is Wide ScanSAR; (c) ship proposals obtained by scale-dependent properties.
Remotesensing 11 00526 g001
Figure 2. The framework of our suggested ship proposal generator.
Figure 2. The framework of our suggested ship proposal generator.
Remotesensing 11 00526 g002
Figure 3. The scheme of edge extraction.
Figure 3. The scheme of edge extraction.
Remotesensing 11 00526 g003
Figure 4. Edge scoring of ships. (a) original synthetic aperture radar (SAR) images; (b) edge map with ship proposals. The red boxes are ship proposals (P), and the yellow boxes are inner boxes of the proposals ( P i n ).
Figure 4. Edge scoring of ships. (a) original synthetic aperture radar (SAR) images; (b) edge map with ship proposals. The red boxes are ship proposals (P), and the yellow boxes are inner boxes of the proposals ( P i n ).
Remotesensing 11 00526 g004
Figure 5. The recall under different initial superpixel size. (a) the curves measuring the recall versus numbers of ship proposals under different k; (b) the curves measuring the recall versus the intersection over union (IoU) under different k; (c) the average best overlap (ABO) scores and the area under the curve (AUC) versus different k; (d) The recall using k = 15 and k = 20 .
Figure 5. The recall under different initial superpixel size. (a) the curves measuring the recall versus numbers of ship proposals under different k; (b) the curves measuring the recall versus the intersection over union (IoU) under different k; (c) the average best overlap (ABO) scores and the area under the curve (AUC) versus different k; (d) The recall using k = 15 and k = 20 .
Remotesensing 11 00526 g005
Figure 6. The recall using the proposed method, multi-scale superpixels segmentation and multi-scale sliding windows. Comparison of the proposed method to multi-scale superpixels segmentation: (a) the curves measuring the recall versus numbers of ship proposals; (b) the curves measuring the recall versus IoU. Comparison of hierarchical superpixels grouping to multi-scale sliding windows: (c) the curves measuring the recall versus numbers of ship proposals; (d) the curves measuring the recall versus IoU.
Figure 6. The recall using the proposed method, multi-scale superpixels segmentation and multi-scale sliding windows. Comparison of the proposed method to multi-scale superpixels segmentation: (a) the curves measuring the recall versus numbers of ship proposals; (b) the curves measuring the recall versus IoU. Comparison of hierarchical superpixels grouping to multi-scale sliding windows: (c) the curves measuring the recall versus numbers of ship proposals; (d) the curves measuring the recall versus IoU.
Remotesensing 11 00526 g006
Figure 7. The recall using our method and the variants without utilization of strong scattering components information. (a) the curves measuring the recall versus numbers of ship proposals; (b) the curves measuring the recall versus IoU.
Figure 7. The recall using our method and the variants without utilization of strong scattering components information. (a) the curves measuring the recall versus numbers of ship proposals; (b) the curves measuring the recall versus IoU.
Remotesensing 11 00526 g007
Figure 8. The recall using our method and the variants without utilization of edge scoring. (a) the curves measuring the recall versus numbers of ship proposals; (b) the curves measuring the recall versus IoU.
Figure 8. The recall using our method and the variants without utilization of edge scoring. (a) the curves measuring the recall versus numbers of ship proposals; (b) the curves measuring the recall versus IoU.
Remotesensing 11 00526 g008
Figure 9. The recall using our method and the variants without utilization of contour scoring. (a) the curves measuring the recall versus numbers of ship proposals; (b) the curves measuring the recall versus IoU.
Figure 9. The recall using our method and the variants without utilization of contour scoring. (a) the curves measuring the recall versus numbers of ship proposals; (b) the curves measuring the recall versus IoU.
Remotesensing 11 00526 g009
Figure 10. The recall using our method and the variants on validation datasets that contain multi-scale ships. (ac) the curves measuring the recall versus numbers of ship proposals on validation datasets that contain large, middle and small scale ships; (df) the curves measuring the recall versus IoU on validation datasets that contain large, middle and small scale ships.
Figure 10. The recall using our method and the variants on validation datasets that contain multi-scale ships. (ac) the curves measuring the recall versus numbers of ship proposals on validation datasets that contain large, middle and small scale ships; (df) the curves measuring the recall versus IoU on validation datasets that contain large, middle and small scale ships.
Remotesensing 11 00526 g010
Figure 11. The recall using our method and the state-of-the-art methods. (a) the curves measuring the recall versus numbers of ship proposals; (b) the curves measuring the recall versus IoU.
Figure 11. The recall using our method and the state-of-the-art methods. (a) the curves measuring the recall versus numbers of ship proposals; (b) the curves measuring the recall versus IoU.
Remotesensing 11 00526 g011
Figure 12. The recall using our method and the state-of-the-art methods on multi-scale datasets. (ac) the curves measuring the recall versus numbers of ship proposals on test datasets that contain large, middle and small scale ships; (df) the curves measuring the recall versus IoU on test datasets that contain large, middle and small scale ships.
Figure 12. The recall using our method and the state-of-the-art methods on multi-scale datasets. (ac) the curves measuring the recall versus numbers of ship proposals on test datasets that contain large, middle and small scale ships; (df) the curves measuring the recall versus IoU on test datasets that contain large, middle and small scale ships.
Remotesensing 11 00526 g012
Figure 13. Some results of the proposed method. Blue bounding boxes are the closest produced object proposals to each ground truth. Green and red bounding boxes are ground truth bounding boxes. Green represents a ship was found and red indicates that the ship was not found. The yellow numbers are the scores of bounding boxes.
Figure 13. Some results of the proposed method. Blue bounding boxes are the closest produced object proposals to each ground truth. Green and red bounding boxes are ground truth bounding boxes. Green represents a ship was found and red indicates that the ship was not found. The yellow numbers are the scores of bounding boxes.
Remotesensing 11 00526 g013
Table 1. The average best overlap (ABO) scores, the area under the curve (AUC) and average number of ship proposals for the proposed approach and various variants of our approach.
Table 1. The average best overlap (ABO) scores, the area under the curve (AUC) and average number of ship proposals for the proposed approach and various variants of our approach.
MethodsAUCABO ScoreAverage Proposals
Multi-scale Superpixels Segmentation k = 5 , 10 , , 50 0.530.686322031
k = 10 , 20 , , 100 0.540.6981012,603
k = 10 , 20 , , 50 0.510.64609862
k = 5 , 15 , , 45 0.490.628621208
Multi-scale Sliding Windows w = 5 , 10 , , 50 0.210.500695891
w = 10 , 20 , , 100 0.220.517102295
w = 10 , 20 , , 50 0.180.458263882
w = 5 , 15 , , 45 0.140.442921208
Without Strong Scattering Components Information k = 15 0.530.641501146
k = 15 , 20 0.550.698912288
Without Edges Scoring k = 15 0.540.63142260
k = 15 , 20 0.570.69363869
Without Contours Scoring k = 15 0.460.63121261
k = 15 , 20 0.460.70291869
Proposed method k = 15 0.550.62785261
k = 15 , 20 0.580.70334868
Table 2. Comparison of ABO scores, AUC and best recall for the proposed method and various variants of our approach on validation datasets that contain multi-scale ships.
Table 2. Comparison of ABO scores, AUC and best recall for the proposed method and various variants of our approach on validation datasets that contain multi-scale ships.
MethodskLarge ShipsMiddle ShipsSmall Ships
ABOAUCBest RecallABOAUCBest RecallABOAUCBest Recall
Multi Scale Sliding Windows 5 , 10 , , 50 0.320.010.070.530.220.610.550.240.61
10 , 20 , , 100 0.530.280.620.530.280.620.490.200.40
Multi-scale Superpixels Segmentation 5 , 10 , , 50 0.540.200.500.730.510.920.710.600.92
10 , 20 , , 100 0.690.330.820.720.540.910.670.580.86
Proposed Method150.570.320.600.650.590.810.630.580.75
15 , 20 0.690.370.840.730.610.930.680.610.84
Table 3. Comparison of ABO scores, AUC and best recall for the proposed method and the state-of-the-art methods on test datasets that contain multi-scale ships.
Table 3. Comparison of ABO scores, AUC and best recall for the proposed method and the state-of-the-art methods on test datasets that contain multi-scale ships.
MethodsLarge ShipsMiddle ShipsSmall ShipsAll Ships
ABOAUCBest RecallABOAUCBest RecallABOAUCBest RecallABOAUCBest Recall
Saliency Filtering [29]0.440.390.400.560.620.640.460.400.440.510.460.49
LCVIWE [1]0.440.440.440.430.440.440.140.050.050.330.180.18
ITBTD [3]0.410.290.320.360.130.160.250.060.080.320.090.12
Objectness Learning [54]0.530.070.370.530.140.450.540.210.520.520.180.49
Proposed Method0.750.410.940.740.640.940.670.590.810.700.590.85
Table 4. Comparison of average computational time for the proposed method and the state-of-the-art methods.
Table 4. Comparison of average computational time for the proposed method and the state-of-the-art methods.
MethodsSaliency FilteringLCVIWEITBTDObjectness LearningProposed Method
Time0.43492s0.01195s1.62894s15.99199s1.34954s

Share and Cite

MDPI and ACS Style

Liu, N.; Cao, Z.; Cui, Z.; Pi, Y.; Dang, S. Multi-Scale Proposal Generation for Ship Detection in SAR Images. Remote Sens. 2019, 11, 526. https://doi.org/10.3390/rs11050526

AMA Style

Liu N, Cao Z, Cui Z, Pi Y, Dang S. Multi-Scale Proposal Generation for Ship Detection in SAR Images. Remote Sensing. 2019; 11(5):526. https://doi.org/10.3390/rs11050526

Chicago/Turabian Style

Liu, Nengyuan, Zongjie Cao, Zongyong Cui, Yiming Pi, and Sihang Dang. 2019. "Multi-Scale Proposal Generation for Ship Detection in SAR Images" Remote Sensing 11, no. 5: 526. https://doi.org/10.3390/rs11050526

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop