Search Results (33)

Video Synthetic Aperture Radar (ViSAR) operates by continuously monitoring regions of interest to produce sequences of SAR imagery. The detection and tracking of ground-moving targets, through the analysis of their radiation properties and temporal variations relative to the background environment, represents a significant area of focus and innovation within the SAR research community. In this study, some key challenges in ViSAR systems are addressed, including the abundance of low-confidence shadow detections, high error rates in multi-target data association, and the frequent fragmentation of tracking trajectories. A multi-target tracking algorithm for ViSAR that utilizes re-identification (ReID) features and a multi-stage data association process is proposed. The algorithm extracts high-dimensional ReID features using the Dense-Net121 network for enhanced shadow detection and calculates a cost matrix by integrating ReID feature cosine similarity with Intersection over Union similarity. A confidence-based multi-stage data association strategy is implemented to minimize missed detections and trajectory fragmentation. Kalman filtering is then employed to update trajectory states based on shadow detection. Both simulation experiments and actual data processing experiments have demonstrated that, in comparison to two traditional video multi-target tracking algorithms, DeepSORT and ByteTrack, the newly proposed algorithm exhibits superior performance in the realm of ViSAR multi-target tracking, yielding the highest MOTA and HOTA scores of 94.85% and 92.88%, respectively, on the simulated spaceborne ViSAR data, and the highest MOTA and HOTA scores of 82.94% and 69.74%, respectively, on airborne field data. Full article

Existing convolution neural network (CNN)-based video synthetic aperture radar (SAR) moving target shadow detectors are difficult to model long-range dependencies, while transformer-based ones often suffer from greater complexity. To handle these issues, this paper proposes MambaShadowDet, a novel lightweight deep learning (DL) detector based on a state space model (SSM), dedicated to high-speed and high-accuracy moving target shadow detection in video SAR images. By introducing SSM with the linear complexity into YOLOv8, MambaShadowDet effectively captures the global feature dependencies while relieving computational load. Specifically, it designs Mamba-Backbone, combining SSM and CNN to effectively extract both global contextual and local spatial information, as well as a slim path aggregation feature pyramid network (Slim-PAFPN) to enhance multi-level feature extraction and further reduce complexity. Abundant experiments on the Sandia National Laboratories (SNL) video SAR data show that MambaShadowDet achieves superior moving target shadow detection performance with a detection accuracy of 80.32% F1 score and an inference speed of 44.44 frames per second (FPS), outperforming existing models in both accuracy and speed. Full article

This paper presents a polar-format algorithm (PFA)-based synthetic-aperture radar (SAR) processor that can be mounted on a small drone to support video SAR (ViSAR) imaging. For drone mounting, it requires miniaturization, low power consumption, and high-speed performance. Therefore, to meet these requirements, the processor design was based on a field-programmable gate array (FPGA), and the implementation results are presented. The proposed PFA-based SAR processor consists of both an interpolation unit and a fast Fourier transform (FFT) unit. The interpolation unit uses linear interpolation for high speed while occupying a small space. In addition, the memory transfer is minimized through optimized operations using SAR system parameters. The FFT unit uses a base-4 systolic array architecture, chosen from among various fast parallel structures, to maximize the processing speed. Each unit is designed as a reusable block (IP core) to support reconfigurability and is interconnected using the advanced extensible interface (AXI) bus. The proposed PFA-based SAR processor was designed using Verilog-HDL and implemented on a Xilinx UltraScale+ MPSoC FPGA platform. It generates an image 2048 × 2048 pixels in size within 0.766 s, which is 44.862 times faster than that achieved by the ARM Cortex-A53 microprocessor. The speed-to-area ratio normalized by the number of resources shows that it achieves a higher speed at lower power consumption than previous studies. Full article

The video synthetic aperture radar (ViSAR) system can utilize high-frame-rate scene motion target shadow information to achieve real-time monitoring of ground mobile targets. Modeling the characteristics of moving target shadows and analyzing shadow detection performance are of great theoretical and practical value for the optimization design and performance evaluation of ViSAR systems. Firstly, based on the formation mechanism and characteristics of video SAR moving target shadows, two types of shadow models based on critical size and shadow clutter ratio models are established. Secondly, for the analysis of moving target shadow detection performance in ViSAR systems, parameters such as the maximum detectable speed of moving targets, the minimum clutter backscatter coefficient, and the number of effective shadow pixels of moving targets are derived. Furthermore, the shadow characteristics of five typical airborne/spaceborne ViSAR systems are analyzed and compared. Finally, a set of simulation experiments on moving target shadow detection for the Hamas rocket launcher validates the correctness and effectiveness of the proposed models and methods. Full article

The unmanned aerial vehicle (UAV)-borne video synthetic aperture radar (SAR) possesses the characteristic of having high-continuous-frame-rate imaging, which is conducive to the real-time monitoring of ground-moving targets. The real-time imaging-processing system for UAV-borne video SAR (ViSAR) requires miniaturization, low power consumption, high frame rate, and high-resolution imaging. In order to achieve high-frame-rate real-time imaging on limited payload-carrying platforms, this study proposes a miniaturization design of a high-integration UAV-borne ViSAR real-time imaging-processing component (MRIPC). The proposed design integrates functions such as broadband signal generation, high-speed real-time sampling, and real-time SAR imaging processing on a single-chip FPGA. The parallel access mechanism using multiple sets of high-speed data buffers increases the data access throughput and solves the problem of data access bandwidth. The range-Doppler (RD) algorithm and map-drift (MD) algorithm are optimized using parallel multiplexing, achieving a balance between computing speed and hardware resources. The test results have verified that our proposed component is effective for the real-time processing of 2048 × 2048 single-precision floating-point data points to realize a 5 Hz imaging frame rate and 0.15 m imaging resolution, satisfying the requirements of real-time ViSAR-imaging processing. Full article

The UAV-borne video SAR (ViSAR) imaging system requires miniaturization, low power consumption, high frame rates, and high-resolution real-time imaging. In order to satisfy the requirements of real-time imaging processing for the UAV-borne ViSAR under limited memory and parallel computing resources, this paper proposes a method of embedded GPU-based real-time imaging processing for the UAV-borne ViSAR. Based on a parallel programming model of the compute unified device architecture (CUDA), this paper designed a parallel computing method for range-Doppler (RD) and map drift (MD) algorithms. By utilizing the advantages of the embedded GPU characterized with parallel computing, we improved the processing speed of real-time ViSAR imaging. This paper also adopted a unified memory management method, which greatly reduces data replication and communication latency between the CPU and the GPU. The data processing of 2048 × 2048 points took only 1.215 s on the Jetson AGX Orin platform to form a nine-consecutive-frame image with a resolution of 0.15 m, with each frame taking only 0.135 s, enabling real-time imaging at a high frame rate of 5 Hz. In actual testing, continuous mapping can be achieved without losing the scenes, intuitively obtaining the dynamic observation effects of the area. The processing results of the measured data have verified the reliability and effectiveness of the proposed scheme, satisfying the processing requirements for real-time ViSAR imaging. Full article

This article presents a high-precision airborne video synthetic aperture radar (SAR) raw echo simulation method aimed at addressing the issue of simulation accuracy in video SAR image generation. The proposed method employs separate techniques for simulating targets and ground clutter, utilizing pre-existing SAR images for clutter simulation and employing the shooting and bouncing rays (SBR) approach to generate target echoes. Additionally, the method accounts for target-generated shadows to enhance the realism of the simulation results. The fast simulation algorithm is implemented using the C++ programming language and the Accelerated Massive Parallelism (AMP) framework, providing a fusion technique for integrating clutter and target simulations. By combining the two types of simulated data to form the final SAR image, the method achieves efficient and accurate simulation technology. Experimental results demonstrate that this method not only improves computational speed but also ensures the accuracy and stability of the simulation outcomes. This research holds significant implications for the development of algorithms pertaining to video SAR target detection and tracking, providing robust support for practical applications. Full article

As a cutting-edge research direction in the field of radar imaging, video SAR has the capability of high-resolution and persistent imaging at any time and under any weather. Video SAR requires high computational efficiency of the imaging algorithm, and PFA has become the preferred imaging algorithm because of its applicability to the spotlight mode and relatively high computational efficiency. However, traditional PFA also has problems, such as low efficiency and limited scene size. To address the above problems, a generalized persistent polar format algorithm, called GPPFA, is proposed for airborne video SAR imaging that is applicable to the persistent imaging requirements of airborne video SAR under multitasking conditions. Firstly, the wavenumber domain resampling characteristics of video SAR PFA are analyzed, and a generalized resampling method is proposed to obtain higher efficiency. Secondly, for the problem of scene size limitation caused by wavefront curvature error, an efficient compensation method applicable to different scene sizes is proposed. GPPFA is capable of video SAR imaging at different wavebands, different slant ranges, and arbitrary scene sizes. Point target and extended target experiments verify the effectiveness and efficiency of the proposed method. Full article

Terahertz video synthetic aperture radar (THz-ViSAR) has tremendous research and application value due to its high resolution and high frame rate imaging benefits. However, it requires more efficient imaging algorithms. Thus, a novel multistage back projection fast imaging algorithm for the THz-ViSAR system is proposed in this paper to enable continuous playback of images like video. The radar echo data of the entire aperture is first divided into multiple sub-apertures, as with the fast-factorized back projection algorithm (FFBP). However, there are two improvements in sub-aperture imaging. On the one hand, the back projection algorithm (BPA) is replaced by the polar format algorithm (PFA) to improve the sub-aperture imaging efficiency. The imaging process, on the other hand, uses the global Cartesian coordinate system rather than the local polar coordinate system, and the wavenumber domain data of the full aperture are obtained step by step through simple splicing and fusion, avoiding the amount of two-dimensional (2D) interpolation operations required for local polar coordinate system transformation in FFBP. Finally, 2D interpolation for full-resolution images is carried out to image the ground object targets in the same coordinate system due to the geometric distortion caused by linear phase error (LPE) and the mismatch of coordinate systems in different imaging frames. The simulation experiments of point targets and surface targets both verify the effectiveness and superiority of the proposed algorithm. Under the same conditions, the running time of the proposed algorithm is only about 6% of FFBP, while the imaging quality is guaranteed. Full article

Video Synthetic Aperture Radar (SAR) has shown great potential in moving target detection and tracking. At present, most of the existing detection methods focus on the intensity information of the moving target shadow. According to the mechanism of shadow formation, some shadows of moving targets present low contrast, and their boundaries are blurred. Additionally, some objects with low reflectivity show similar features with them. These cause the performance of these methods to degrade. To solve this problem, this paper proposes a new moving target shadow detection method, which consists of background modeling and shadow detection based on intensity information and neighborhood similarity (BIIANS). Firstly, in order to improve the efficiency of image sequence generation, a fast method based on the Back-projection imaging algorithm (f-BP) is proposed. Secondly, due to the low-rank characteristics of stationary objects and the sparsity characteristics of moving target shadows presented in the image sequence, this paper introduces the low-rank sparse decomposition (LRSD) method to perform background modeling for obtaining better background (static objects) and foreground (moving targets) images. Because the shadows of moving targets appear in the same position in the original and the corresponding foreground images, the similarity between them is high and independent of their intensity. Therefore, using the BIIANS method can obtain better shadow detection results. Real W-band data are used to verify the proposed method. The experimental results reveal that the proposed method performs better than the classical methods in suppressing false alarms, missing alarms, and improving integrity. Full article

Shadow detection is a new method for video synthetic aperture radar moving target indication (ViSAR-GMTI). The shadow formed by the target occlusion will reflect its real position, preventing the defocusing or offset of the moving target from making it difficult to identify the target during imaging. To achieve high-precision shadow detection, this paper proposes a video SAR moving target shadow-detection algorithm based on low-rank sparse decomposition combined with trajectory area extraction. Based on the low-rank sparse decomposition (LRSD) model, the algorithm creates a new decomposition framework combined with total variation (TV) regularization and coherence suppression items to improve the decomposition effect, and a global constraint is constructed to suppress interference using feature operators. In addition, it cooperates with the double threshold trajectory segmentation and error trajectory elimination method to further improve the detection performance. Finally, an experiment was carried out based on the video SAR data released by Sandia National Laboratory (SNL); the results prove the effectiveness of the proposed method, and the detection performance of the method is proved by comparative experiments. Full article

Deformations affect the structural integrity of wind turbine towers. The health of such structures is thus assessed by monitoring. The majority of sensors used for this purpose are costly and require in situ installations. We investigated whether Multiple-Input Multiple-Output Synthetic Aperture Radar (MIMO-SAR) sensors can be used to monitor wind turbine towers. We used an automotive-grade, low-cost, off-the-shelf MIMO-SAR sensor operating in the W-band with an acquisition frequency of 100 $\mathrm{Hz}$ to derive Line-Of-Sight (LOS) deformation measurements in ranges up to about 175 $\mathrm{m}$. Time series of displacement measurements for areas at different heights of the tower were analyzed and compared to reference measurements acquired by processing video camera recordings and total station measurements. The results showed movements in the range of up to 1 $\mathrm{m}$ at the top of the tower. We were able to detect the deformations also with the W-band MIMO-SAR sensor; for areas with sufficient radar backscattering, the results suggest a sub-mm noise level of the radar measurements and agreement with the reference measurements at the mm- to sub-mm level. We further applied Fourier transformation to detect the dominant vibration frequencies and identified values ranging from 0.17 to 24 $\mathrm{Hz}$. The outcomes confirmed the potential of MIMO-SAR sensors for highly precise, cost-efficient, and time-efficient structural monitoring of wind turbine towers. The sensors are likely also applicable for monitoring other high-rise structures such as skyscrapers or chimneys. Full article

The automotive synthetic aperture radar (SAR) can obtain two-dimensional (2-D) high-resolution images and has good robustness compared with the other sensors. Generally, the 2-D high-resolution always conflicts with the real-time requirement in conventional SAR imaging. This article suggests an automotive video SAR (ViSAR) imaging technique based on sub-aperture spectrum fusion to address this issue. Firstly, the scene space variation problem caused by close observation distance in automotive SAR is analyzed. Moreover, the sub-aperture implementation method, frame rate and resolution of automotive ViSAR are also introduced. Then, the improved Range Doppler algorithm (RDA) is used to focus the sub-aperture data. Finally, a sub-aperture stitching strategy is proposed to obtain a high-resolution frame image. Compared with the available ViSAR imaging method, the proposed method is more efficient, performs better, and is more appropriate for automotive ViSAR. The simulation results and actual data of the automotive SAR validate the effectiveness of the proposed method. Full article

Video Synthetic Aperture Radar (ViSAR) operating in spotlight mode has received widespread attention in recent years because of its ability to form a sequence of SAR images for a region of interest (ROI). However, due to the heavy computational burden of data processing, the application of ViSAR is limited in practice. Although back projection (BP) can avoid unnecessary repetitive processing of overlapping parts between consecutive video frames, it is still time-consuming for high-resolution video-SAR data processing. In this article, in order to achieve the same or a similar effect to BP and reduce the computational burden as much as possible, a novel time-frequency sub-aperture technology (TFST) is proposed. Firstly, based on azimuth resampling and full aperture azimuth scaling, a time domain sub-aperture (TDS) processing algorithm is proposed to process ViSAR data with large coherent integration angles to ensure the continuity of ViSAR monitoring. Furthermore, through frequency domain sub-aperture (FDS) processing, multiple high-resolution video frames can be generated efficiently without sub-aperture reconstruction. In addition, TFST is based on the range migration algorithm (RMA), which can take into account the accuracy while ensuring efficiency. The results of simulation and X-band airborne SAR experimental data verify the effectiveness of the proposed method. Full article

Shadows are widely used in the tracking of moving targets by video synthetic aperture radar (video SAR). However, they always appear in groups in video SAR images. In such cases, track effects produced by existing single-target tracking methods are no longer satisfactory. To this end, an effective way to obtain the capability of multiple target tracking (MTT) is in urgent demand. Note that tracking by detection (TBD) for MTT in optical images has achieved great success. However, TBD cannot be utilized in video SAR MTT directly. The reasons for this is that shadows of moving target are quite different from in video SAR image than optical images as they are time-varying and their pixel sizes are small. The aforementioned characteristics make shadows in video SAR images hard to detect in the process of TBD and lead to numerous matching errors in the data association process, which greatly affects the final tracking performance. Aiming at the above two problems, in this paper, we propose a multiple target tracking method based on TBD and the Siamese network. Specifically, to improve the detection accuracy, the multi-scale Faster-RCNN is first proposed to detect the shadows of moving targets. Meanwhile, dimension clusters are used to accelerate the convergence speed of the model in the training process as well as to obtain better network weights. Then, SiamNet is proposed for data association to reduce matching errors. Finally, we apply a Kalman filter to update the tracking results. The experimental results on two real video SAR datasets demonstrate that the proposed method outperforms other state-of-art methods, and the ablation experiment verifies the effectiveness of multi-scale Faster-RCNN and SimaNet. Full article