Hyperspectral Images (HSIs) have been utilized in many fields which contain spatial and spectral features of objects simultaneously. Hyperspectral image matching is a fundamental and critical problem in a wide range of HSI applications. Feature descriptors for grayscale image matching are well studied, but few descriptors are elaborately designed for HSI matching. HSI descriptors, which should have made good use of the spectral feature, are essential in HSI matching tasks. Therefore, this paper presents a descriptor for HSI matching, called HOSG-SIFT, which ensembles spectral features with spatial features of objects. First, we obtain the grayscale image by dimensional reduction from HSI and apply it to extract keypoints and descriptors of spatial features. Second, the descriptors of spectral features are designed based on the histogram of the spectral gradient (HOSG), which effectively preserves the physical significance of the spectral profile. Third, we concatenate the spatial descriptors and spectral descriptors with the same weights into a new descriptor and apply it for HSI matching. Experimental results demonstrate that the proposed HOSG-SIFT performs superior against traditional feature descriptors. Full article

The paper proposes an analytical study regarding airborne radar imaging performances and accounts for a down-looking radar system moving along parallel lines far, in terms of probing wavelength, from the investigated domain and collecting multi-frequency and multi-monostatic data. The imaging problem is formulated in a constant depth plane by exploiting the Born approximation. Hence, a linear inverse scattering problem is faced by considering both the Adjoint and the Truncated Singular Value Decomposition reconstruction schemes. Analytical and simulated results are provided to state how the achievable performances depend on the measurement configuration. These results are of practical usefulness because, in operative conditions, it is unfeasible to plan a flight grid made up by a high number of closely (in terms of probing wavelength) spaced lines. Hence, the understanding of how the availability of under-sampled data affects the radar imaging allows for a trade-off between operative data collection constrains and reliable reconstructions of the scenario under test. Full article

Deep Learning (DL) has been recently introduced into the hyperspectral and multispectral image classification landscape. Despite the success of DL in the remote sensing field, DL models are computationally intensive due to the large number of parameters they need to learn. The high density of information present in remote sensing imagery with high spectral resolution can make the application of DL models to large scenes challenging. Methods such as patch-based classification require large amounts of data to be processed during the training and prediction stages, which translates into long processing times and high energy consumption. One of the solutions to decrease the computational cost of these models is to perform segment-based classification. Segment-based classification schemes can significantly decrease training and prediction times, and also offer advantages over simply reducing the size of the training datasets by randomly sampling training data. The lack of a large enough number of samples can, however, pose an additional challenge, causing these models to not generalize properly. Data augmentation methods are used to generate new synthetic samples based on existing data to increase the classification performance. In this work, we propose a new data augmentation scheme using data imputation and matrix completion methods for segment-based classification. The proposal has been validated using two high-resolution multispectral datasets from the literature. The results obtained show that the proposed approach successfully increases the classification performance across all the scenes tested and that data imputation methods applied to multispectral imagery are a valid means to perform data augmentation. A comparison of classification accuracy between different imputation methods applied to the proposed scheme was also carried out. Full article

Large sheets of high-density polyethene geomembrane are used as floating covers on some of the wastewater treatment lagoons at the Melbourne Water Corporation’s Western Treatment Plant. These covers provide an airtight seal for the anaerobic digestion of sewage and allow for harvesting the methane-rich biogas, which is then used to generate electricity. There is a potential for scum to develop under the covers during the anaerobic digestion of the raw sewage by microorganisms. Due to the nature of the operating environment of the lagoons and the vast size (450 m × 170 m) of these covers, a safe non-contact method to monitor the development and movement of the scum is preferred. This paper explores the potential of using a new thermographic approach to identify and monitor the scum under the covers. The approach exploits naturally occurring variations in solar intensity as a trigger for generating a transient thermal response that is then fitted to an exponential decay law to determine a cooling constant. This approach is investigated experimentally using a laboratory-scale test rig. A finite element (FE) model is constructed and shown to reliably predict the experimentally observed thermal transients and cooling constants. This FE model is then set up to simulate progressive scum accumulation with time, using a specified scumberg geometry and a stepwise change in thermal properties. The results indicate a detectable change in the cooling constant at different locations on the cover, thereby providing a quantitative basis for characterising the scum accumulation beneath the cover. The practical application and limitations of these results are briefly discussed. Full article

Seismic interferometry (SI) refers to the principle of generating new seismic responses using crosscorrelations of existing wavefield recordings. In this study, we report on the use of a specific interferometric approach, called seismic interferometry by multidimensional deconvolution (SI by MDD), for the purpose of retrieving surface-wave responses. In theory, SI by MDD suffers less from irregularities in the distribution of (passive) sources than conventional SI. Here, we confirm this advantage for the application to surface waves originating from regional earthquakes close to Central Chile. For that purpose, we use the Malargüe seismic array in Argentina. This T-shaped array consists of two perpendicular lines of stations, which makes it rather suitable for the application of SI by MDD. Comparing the responses retrieved through SI by MDD to the responses retrieved using conventional SI, we find that the application of SI by MDD results in surface-wave responses that are both more accurate and more stable than surface-wave responses that are retrieved using conventional SI. That is, our results demonstrate that SI by MDD suffers less from non-uniformly distributed earthquakes and differences in the power spectra of earthquake responses. In addition, we show that SI by MDD mitigates the effect of site amplification on the retrieved surface waves. Full article

Compared with traditional optical and multispectral remote sensing images, hyperspectral images have hundreds of bands that can provide the possibility of fine classification of the earth’s surface. At the same time, a hyperspectral image is an image that coexists with the spatial and spectral. It has become a hot research topic to combine the spatial spectrum information of the image to classify hyperspectral features. Based on the idea of spatial–spectral classification, this paper proposes a novel hyperspectral image classification method based on a segment forest (SF). Firstly, the first principal component of the image was extracted by the process of principal component analysis (PCA) data dimension reduction, and the data constructed the segment forest after dimension reduction to extract the non-local prior spatial information of the image. Secondly, the images’ initial classification results and probability distribution were obtained using support vector machine (SVM), and the spectral information of the images was extracted. Finally, the segment forest constructed above is used to optimize the initial classification results and obtain the final classification results. In this paper, three domestic and foreign public data sets were selected to verify the segment forest classification. SF effectively improved the classification accuracy of SVM, and the overall accuracy of Salinas was enhanced by 11.16%, WHU-Hi-HongHu by 15.89%, and XiongAn by 19.56%. Then, it was compared with six decision-level improved space spectrum classification methods, including guided filtering (GF), Markov random field (MRF), random walk (RW), minimum spanning tree (MST), MST+, and segment tree (ST). The results show that the segment forest-based hyperspectral image classification improves accuracy and efficiency compared with other algorithms, proving the algorithm’s effectiveness. Full article

Aquaculture in tropical and subtropical developing countries has expanded in recent years. This practice is controversial due to its potential for serious economic, food security, and environmental impacts—especially for intensive operations in and near mangrove ecosystems, where many shrimp species spawn. While considerable effort has been directed toward understanding aquaculture impacts, maps of spatial extent and multi-decade spatiotemporal dynamics remain sparse. This is in part because aquaculture ponds (ghers) can be challenging to distinguish from other shallow water targets on the basis of water-leaving radiance alone. Here, we focus on the Lower Ganges–Brahmaputra Delta (GBD), one of the most expansive areas of recent aquaculture growth on Earth and adjacent to the Sundarbans mangrove forest, a biodiversity hotspot. We use a combination of MODIS 16-day EVI composites and 45 years (1972–2017) of Landsat observations to characterize dominant spatiotemporal patterns in the vegetation phenology of the area, identify consistent seasonal optical differences between flooded ghers and other land uses, and quantify the multi-decade expansion of standing water bodies. Considerable non-uniqueness exists in the spectral signature of ghers on the GBD, propagating into uncertainty in estimates of spatial extent. We implement three progressive decision boundaries to explicitly quantify this uncertainty and provide liberal, moderate, and conservative estimates of flooded gher extent on three different spatial scales. Using multiple extents and multiple thresholds, we quantify the size distribution of contiguous regions of flooded gher extent at ten-year intervals. The moderate threshold shows standing water area within Bangladeshi polders to have expanded from less than 300 km² in 1990 to over 1400 km² in 2015. At all three scales investigated, the size distribution of standing water bodies is increasingly dominated by larger, more interconnected networks of flooded areas associated with aquaculture. Much of this expansion has occurred in immediate proximity to the Bangladeshi Sundarbans. Full article

Hyper-DRELIO (Hyperspectral DRone for Environmental and LIttoral Observations) is a custom, mini-UAV (unmanned aerial vehicle) platform (<20 kg), equipped with a light push broom hyperspectral sensor combined with a navigation module measuring position and orientation. Because of the particularities of UAV surveys (low flight altitude, small spatial scale, and high resolution), dedicated pre-processing methods have to be developed when reconstructing hyperspectral imagery. This article presents light, easy-implementation, in situ methods, using only two Spectralon^® and a field spectrometer, allowing performance of an initial calibration of the sensor in order to correct “vignetting effects” and a field standardization to convert digital numbers (DN) collected by the hyperspectral camera to reflectance, taking into account the time-varying illumination conditions. Radiometric corrections are applied to a subset of a dataset collected above mudflats colonized by pioneer mangroves in French Guiana. The efficiency of the radiometric corrections is assessed by comparing spectra from Hyper-DRELIO imagery to in situ spectrometer measurements above the intertidal benthic biofilm and mangroves. The shapes of the spectra were consistent, and the spectral angle mapper (SAM) distance was 0.039 above the benthic biofilm and 0.159 above the mangroves. These preliminary results provide new perspectives for quantifying and mapping the benthic biofilm and mangroves at the scale of the Guianese intertidal mudbanks system, given their importance in the coastal food webs, biogeochemical cycles, and the sediment stabilization. Full article

Synthetic Aperture Radar (SAR), an active remote sensing imaging radar technology, has certain surface penetration ability and can work all day and in all weather conditions. It is widely applied in ship detection to quickly collect ship information on the ocean surface from SAR images. However, the ship SAR images are often blurred, have large noise interference, and contain more small targets, which pose challenges to popular one-stage detectors, such as the single-shot multi-box detector (SSD). We designed a novel network structure, a combinational fusion SSD (CF-SSD), based on the framework of the original SSD, to solve these problems. It mainly includes three blocks, namely a combinational fusion (CF) block, a global attention module (GAM), and a mixed loss function block, to significantly improve the detection accuracy of SAR images and remote sensing images and maintain a fast inference speed. The CF block equips every feature map with the ability to detect objects of all sizes at different levels and forms a consistent and powerful detection structure to learn more useful information for SAR features. The GAM block produces attention weights and considers the channel attention information of various scale feature information or cross-layer maps so that it can obtain better feature representations from the global perspective. The mixed loss function block can better learn the positions of the truth anchor boxes by considering corner and center coordinates simultaneously. CF-SSD can effectively extract and fuse the features, avoid the loss of small or blurred object information, and precisely locate the object position from SAR images. We conducted experiments on the SAR ship dataset SSDD, and achieved a 90.3% mAP and fast inference speed close to that of the original SSD. We also tested our model on the remote sensing dataset NWPU VHR-10 and the common dataset VOC2007. The experimental results indicate that our proposed model simultaneously achieves excellent detection performance and high efficiency. Full article

Currently, video observation systems are actively used for volcano activity monitoring. Video cameras allow us to remotely assess the state of a dangerous natural object and to detect thermal anomalies if technical capabilities are available. However, continuous use of visible band cameras instead of special tools (for example, thermal cameras), produces large number of images, that require the application of special algorithms both for preliminary filtering out the images with area of interest hidden due to weather or illumination conditions, and for volcano activity detection. Existing algorithms use preselected regions of interest in the frame for analysis. This region could be changed occasionally to observe events in a specific area of the volcano. It is a problem to set it in advance and keep it up to date, especially for an observation network with multiple cameras. The accumulated perennial archives of images with documented eruptions allow us to use modern deep learning technologies for whole frame analysis to solve the specified task. The article presents the development of algorithms to classify volcano images produced by video observation systems. The focus is on developing the algorithms to create a labelled dataset from an unstructured archive using existing and authors proposed techniques. The developed solution was tested using the archive of the video observation system for the volcanoes of Kamchatka, in particular the observation data for the Klyuchevskoy volcano. The tests show the high efficiency of the use of convolutional neural networks in volcano image classification, and the accuracy of classification achieved 91%. The resulting dataset consisting of 15,000 images and labelled in three classes of scenes is the first dataset of this kind of Kamchatka volcanoes. It can be used to develop systems for monitoring other stratovolcanoes that occupy most of the video frame. Full article

The potential of hyperspectral measurements for early disease detection has been investigated by many experts over the last 5 years. One of the difficulties is obtaining enough data for training and building a hyperspectral training library. When the goal is to detect disease at a previsible stage, before the pathogen has manifested either its first symptoms or in the area surrounding the existing symptoms, it is impossible to objectively delineate the regions of interest containing the previsible pathogen growth from the areas without the pathogen growth. To overcome this, we propose an image labelling and segmentation algorithm that is able to (a) more objectively label the visible symptoms for the construction of a training library and (b) extend this labelling to the pre-visible symptoms. This algorithm is used to create hyperspectral training libraries for late blight disease (Phytophthora infestans) in potatoes and two types of leaf rust (Puccinia triticina and Puccinia striiformis) in wheat. The model training accuracies were compared between the automatic labelling algorithm and the classic visual delineation of regions of interest using a logistic regression machine learning approach. The modelling accuracies of the automatically labelled datasets were higher than those of the manually labelled ones for both potatoes and wheat, at 98.80% for P. infestans in potato, 97.69% for P. striiformis in soft wheat, and 96.66% for P. triticina in durum wheat. Full article

The usage of a hypersonic platform for remote sensing application has promising prospects, especially for hypersonic platform-borne synthetic aperture radar (SAR) imaging. However, the high-speed of hypersonic platform will lead to extreme friction between the platform and air, which will cause the ionization of air. The ionized gas forms the plasma sheath wrapped around the hypersonic platform. The plasma sheath will severely affect the propagation of SAR signal and further affect the SAR imaging. Therefore, hypersonic platform-borne SAR imaging should be studied from a physical perspective. In this paper, hypersonic platform-borne SAR imaging under plasma sheath is analyzed. The SAR signal propagation in plasma sheath is computed using scatter matrix method. The proposed SAR signal model is verified by using a ground experiment system. Moreover, the effect of attenuation caused by plasma sheath on SAR imaging is studied under different SAR parameters and plasma sheath. The result shows that attenuation caused by plasma sheath will degrade the SAR imaging quality and even cause the point and area targets to be submerged into the noise. The real SAR images under plasma sheath also illustrate this phenomenon. Furthermore, by studying imaging results under different SAR and plasma parameters, it can be concluded that the severe degradation of SAR imaging quality appears at condition of high plasma sheath electron density and low SAR carrier frequency. The work in this paper will be beneficial for the study of hypersonic platform-borne SAR imaging and design of hypersonic SAR imaging systems in the future. Full article

The aim of image-based localization (IBL) is to localize the real location of query image by matching reference image in database with GNSS-tags. Popular methods related to IBL commonly use street-level images, which have high value in practical application. Using street-level image to tackle IBL task has the primary challenges: existing works have not made targeted optimization for urban IBL tasks. Besides, the matching result is over-reliant on the quality of image features. Methods should address their practicality and robustness in engineering application, under metropolitan-scale. In response to these, this paper made following contributions: firstly, given the critical of buildings in distinguishing urban scenes, we contribute a feature called Building-Aware Feature (BAF). Secondly, in view of negative influence of complex urban scenes in retrieval process, we propose a retrieval method called Patch-Region Retrieval (PRR). To prove the effectiveness of BAF and PRR, we established an image-based localization experimental framework. Experiments prove that BAF can retain the feature points that fall on the building, and selectively lessen the feature points that fall on other things. While this effectively compresses the storage amount of feature index, we can also improve recall of localization results; implemented in the stage of geometric verification, PRR compares matching results of regional features and selects the best ranking as final result. PRR can enhance effectiveness of patch-regional feature. In addition, we fully confirmed the superiority of our proposed methods through a metropolitan-scale street-level image dataset. Full article

An inertial platform is the key component of a remote sensing system. During service, the performance of the inertial platform appears in degradation and accuracy reduction. For better maintenance, the inertial platform system is checked and maintained regularly. The performance change of an inertial platform can be evaluated by detection data. Due to limitations of detection conditions, inertial platform detection data belongs to small sample data. In this paper, in order to predict the performance of an inertial platform, a prediction model for an inertial platform is designed combining a sliding window, grey theory and neural network (SGMNN). The experiments results show that the SGMNN model performs best in predicting the inertial platform drift rate compared with other prediction models. Full article

Due to the complexity of scene interference and the variability of ship scale and position, automatic ship detection in remote sensing images makes for challenging research. The existing deep networks rarely design receptive fields that fit the target scale based on training data. Moreover, most of them ignore the effective retention of position information in the feature extraction process, which reduces the contribution of features to subsequent classification. To overcome these limitations, we propose a novel ship detection framework combining the dilated rate selection and attention-guided feature representation strategies, which can efficiently detect ships of different scales under the interference of complex environments such as clouds, sea clutter and mist. Specifically, we present a dilated convolution parameter search strategy to adaptively select the dilated rate for the multi-branch extraction architecture, adaptively obtaining context information of different receptive fields without sacrificing the image resolution. Moreover, to enhance the spatial position information of the feature maps, we calculate the correlation of spatial points from the vertical and horizontal directions and embed it into the channel compression coding process, thus generating the multi-dimensional feature descriptors which are sensitive to direction and position characteristics of ships. Experimental results on the Airbus dataset demonstrate that the proposed method achieves state-of-the-art performance compared with other detection models. Full article