Information about the availability of solar irradiance for crops is of high importance for improving management practices of agricultural ecosystems such as agroforestry systems (AFS). Hence, the development of a high-resolution model that allows for the quantification of tree shading on a diurnal and annual time scale is highly demanded to generate realistic estimations of the shading dynamics in a given AFS. We describe an approach using 3D data derived from a terrestrial laser scanner and the steps undertaken to develop a vector-based model that quantifies and visualizes the shadow cast by single trees at daily, monthly, seasonal or annual levels with the input of cylinder-based tree models. It is able to compute the shadow of given tree models in time intervals of 10 min. To simulate seasonal growth and shedding of leaves, ellipsoids as replacement for leaves can be added to the tips of the tree model’s branches. The shadow model is flexible in its input of location (latitude, longitude), tree architecture and temporal resolution. Due to the possibility to feed this model with factual climate data such as cloud covers, it represents the first 3D tree model that enables the user to retrospectively analyze the shadow regime below a given tree, and to quantify shadow-related developments in AFS. Full article

Clouds and their associated shadows are major obstacles to most land surface remote sensing applications. Meanwhile, solar-cloud-satellite geometry (SCSG) makes the effect of clouds and shadows on derived land surface biophysical parameters more complicated. However, in most existing studies, the SCSG effect has been frequently neglected although it is pointed out by many works that SCSG effect is a noticeable problem, especially in the field of land surface radiation budget. Taking shortwave downward radiation (SWDR) as a testing variable, this study quantified the SCSG effect on the derived SWDR, and proposed an operational scheme to correct the big effect. The results demonstrate that the proposed correcting scheme is very effective and works very well. It is revealed that a significant under- or overestimation is detected in retrieved SWDR if the SCSG effect is ignored. Typically, the induced error in SWDR can reach up to 80%. The scheme and findings of this study are expected to be inspirational for the land surface remote sensing community, wherein solar-cloud-satellite geometry is an unavoidable issue. Full article

In this paper, we used Landsat imagery for water body identification to create a novel 36-year surface area extent time series for lakes Azuei (Haiti) and Enriquillo (Dominican Republic) aimed at illuminating the dramatic temporal changes of these two lakes not just at yearly but at monthly or even sub-monthly scales. We used the Normalized Difference Water Index (NDWI) to extract water features and we also used spatial differentiation and thresholding techniques to remove clouds and associated shadows from the scene that were then passed through gap filling algorithms to complete and extract the lake extent polygons. We also explored the challenges that arrive from trying to combine RS-based Digital Elevation Model data with locally collected bathymetric data to yield a seamless representation of the topographic features of the rift valley that contains the two lakes. This “bathtub” model was then meshed with the lake extent polygons to compute lake volumes, maximum depths, and geospatially referenced lake levels rating curves. We used this data to examine the lakes and their geospatial characteristics in the context of the lakes’ growth/shrinking patterns. While we did not carry out a full hydrologic analysis we attempted to illuminate how specific lake levels cause what type of flooding and especially answered the questions if (a) Lake Azuei would ever spill into Lake Enriquillo, and (b) what the maximum lake levels need to be before spilling into neighboring watersheds. Full article

Classification of clouds, cirrus, snow, shadows and clear sky areas is a crucial step in the pre-processing of optical remote sensing images and is a valuable input for their atmospheric correction. The Multi-Spectral Imager on board the Sentinel-2’s of the Copernicus program offers optimized bands for this task and delivers unprecedented amounts of data regarding spatial sampling, global coverage, spectral coverage, and repetition rate. Efficient algorithms are needed to process, or possibly reprocess, those big amounts of data. Techniques based on top-of-atmosphere reflectance spectra for single-pixels without exploitation of external data or spatial context offer the largest potential for parallel data processing and highly optimized processing throughput. Such algorithms can be seen as a baseline for possible trade-offs in processing performance when the application of more sophisticated methods is discussed. We present several ready-to-use classification algorithms which are all based on a publicly available database of manually classified Sentinel-2A images. These algorithms are based on commonly used and newly developed machine learning techniques which drastically reduce the amount of time needed to update the algorithms when new images are added to the database. Several ready-to-use decision trees are presented which allow to correctly label about $91\%$ of the spectra within a validation dataset. While decision trees are simple to implement and easy to understand, they offer only limited classification skill. It improves to $98\%$ when the presented algorithm based on the classical Bayesian method is applied. This method has only recently been used for this task and shows excellent performance concerning classification skill and processing performance. A comparison of the presented algorithms with other commonly used techniques such as random forests, stochastic gradient descent, or support vector machines is also given. Especially random forests and support vector machines show similar classification skill as the classical Bayesian method. Full article

The development of robust and accurate methods for automatic building detection and regularisation using multisource data continues to be a challenge due to point cloud sparsity, high spectral variability, urban objects differences, surrounding complexity, and data misalignment. To address these challenges, constraints on object’s size, height, area, and orientation are generally benefited which adversely affect the detection performance. Often the buildings either small in size, under shadows or partly occluded are ousted during elimination of superfluous objects. To overcome the limitations, a methodology is developed to extract and regularise the buildings using features from point cloud and orthoimagery. The building delineation process is carried out by identifying the candidate building regions and segmenting them into grids. Vegetation elimination, building detection and extraction of their partially occluded parts are achieved by synthesising the point cloud and image data. Finally, the detected buildings are regularised by exploiting the image lines in the building regularisation process. Detection and regularisation processes have been evaluated using the ISPRS benchmark and four Australian data sets which differ in point density (1 to 29 points/m²), building sizes, shadows, terrain, and vegetation. Results indicate that there is 83% to 93% per-area completeness with the correctness of above 95%, demonstrating the robustness of the approach. The absence of over- and many-to-many segmentation errors in the ISPRS data set indicate that the technique has higher per-object accuracy. While compared with six existing similar methods, the proposed detection and regularisation approach performs significantly better on more complex data sets (Australian) in contrast to the ISPRS benchmark, where it does better or equal to the counterparts. Full article

The use of passive satellite sensor data in shallow waters is complicated by the combined atmospheric, water, and bottom signals. Accurate determination of water depth is important for monitoring underwater topography and detection of moved sediments and in support of navigation. A Worldview 2 (WV2) image was used to develop high-resolution bathymetric maps (four meters) that were validated using bathymetry from an active sensor Light Detection and Ranging (LiDAR). The influence of atmospheric corrections in depth retrievals was evaluated using the Dark Substract, Fast Line-of-Sight Atmospheric Analysis of Spectral Hypercubes (FLAASH) and the Cloud Shadow Approach (CSA) atmospheric corrections. The CSA combined with a simple band ratio (Band2/Band3) provided the best performance, where it explained 82% of model values. The WV2 depth model was validated at another site within the image, where it successfully retrieved depth values with a coefficient of determination (r²) of 0.90 for all the depth values sampled, and an r² of 0.70, for a depth range to 20 m. The WV2 bands in the visible region were useful for testing different band combinations to derive bathymetry that, when combined with a robust atmospheric correction, provided depth retrievals even in areas with variable bottom composition and near the limits of detection. Full article

The U.S. Geological Survey is developing new Landsat science products. One, named Dynamic Surface Water Extent (DSWE), is focused on the representation of ground surface inundation as detected in cloud-/shadow-/snow-free pixels for scenes collected over the U.S. and its territories. Characterization of DSWE uncertainty to facilitate its appropriate use in science and resource management is a primary objective. A unique evaluation dataset developed from data made publicly available through the Everglades Depth Estimation Network (EDEN) was used to evaluate one candidate DSWE algorithm that is relatively simple, requires no scene-based calibration data, and is intended to detect inundation in the presence of marshland vegetation. A conceptual model of expected algorithm performance in vegetated wetland environments was postulated, tested and revised. Agreement scores were calculated at the level of scenes and vegetation communities, vegetation index classes, water depths, and individual EDEN gage sites for a variety of temporal aggregations. Landsat Archive cloud cover attribution errors were documented. Cloud cover had some effect on model performance. Error rates increased with vegetation cover. Relatively low error rates for locations of little/no vegetation were unexpectedly dominated by omission errors due to variable substrates and mixed pixel effects. Examined discrepancies between satellite and in situ modeled inundation demonstrated the utility of such comparisons for EDEN database improvement. Importantly, there seems no trend or bias in candidate algorithm performance as a function of time or general hydrologic conditions, an important finding for long-term monitoring. The developed database and knowledge gained from this analysis will be used for improved evaluation of candidate DSWE algorithms as well as other measurements made on Everglades surface inundation, surface water heights and vegetation using radar, lidar and hyperspectral instruments. Although no other sites have such an extensive in situ network or long-term records, the broader applicability of this and other candidate DSWE algorithms is being evaluated in other wetlands using this work as a guide. Continued interaction among DSWE producers and potential users will help determine whether the measured accuracies are adequate for practical utility in resource management. Full article

This paper presents the SPOT-4 (Take 5) experiment, aimed at providing time series of optical images simulating the repetitivity, the resolution and the large swath of Sentinel-2 images. The aim was to help users set up and test their applications and methods, before Sentinel-2 mission data become available. In 2016, when both Sentinel-2 satellites are operational, and for at least fifteen years, users will have access to high resolution time series of images systematically acquired every five days, over the whole Earth land surfaces. Thanks to Sentinel-2’s high revisit frequency, a given surface should be observed without clouds at least once a month, except in the most cloudy periods and regions. In 2013, the Centre National d’Etudes Spatiales (CNES) lowered the orbit altitude of SPOT-4, to place it on a five-day repeat cycle orbit for a duration of five months. This experiment started on 31 January 2013 and lasted until 19 June 2013. SPOT-4 images were acquired every fifth day, over 45 sites scattered in nearly all continents and covering very diverse biomes for various applications. Two ortho-rectified products were delivered for each acquired image that was not fully cloudy, expressed either as top of atmosphere reflectance (Level 1C) or as surface reflectance (Level 2A). An extensive validation campaign was held to check the performances of these products with regard to the multi-temporal registration, the quality of cloud masks, the accuracy of aerosol optical thickness estimates and the quality of surface reflectances. Despite high a priori geo-location errors, it was possible to register the images with an accuracy better than 0.5 pixels in the large majority of cases. Despite the lack of a blue band on the SPOT-4 satellite, the cloud and shadow detection yielded good results, while the aerosol optical thickness was measured with a root mean square error better than 0.06. The surface reflectances after atmospheric correction were compared with in situ data and other satellite data showing little bias and the standard deviation of surface reflectance errors in the range (0.01–0.02). The Take 5 experiment is being repeated in 2015 with the SPOT-5 satellite with an enhanced resolution. Full article

Urban areas play a very important role in global climate change. There is increasing need to understand global urban areas with sufficient spatial details for global climate change mitigation. Remote sensing imagery, such as medium resolution Landsat daytime multispectral imagery and coarse resolution Defense Meteorological Satellite Program/Operational Linescan System (DMSP/OLS) nighttime light imagery, has provided a powerful tool for characterizing and mapping cities, with advantages and disadvantages. Here we propose a framework to merge cloud and cloud shadow-free Landsat Normalized Difference Vegetation Index (NDVI) composite and DMSP/OLS Night Time Light (NTL) to characterize global urban areas at a 30 m resolution, through a Normalized Difference Urban Index (NDUI) to make full use of them while minimizing their limitations. We modify the maximum NDVI value multi-date image compositing method to generate the cloud and cloud shadow-free Landsat NDVI composite, which is critical for generating a global NDUI. Evaluation results show the NDUI can effectively increase the separability between urban areas and bare lands as well as farmland, capturing large scale urban extents and, at the same time, providing sufficient spatial details inside urban areas. With advanced cloud computing facilities and the open Landsat data archives available, NDUI has the potential for global studies at the 30 m scale. Full article

Knowledge of impervious surface areas (ISA) and on their changes in magnitude, location, geometry and morphology over time is significant for a range of practical applications and research alike from local to global scales. Despite this, use of Earth Observation (EO) technology in mapping ISAs within some European Union (EU) countries, such as the United Kingdom (UK), is to some extent scarce. In the present study, a combination of methods is proposed for mapping ISA based on freely distributed EO imagery from Landsat TM/ETM+ sensors. The proposed technique combines a traditional classifier and a linear spectral mixture analysis (LSMA) with a series of Landsat TM/ETM+ images to extract ISA. Selected sites located in Wales, UK, are used for demonstrating the capability of the proposed method. The Welsh study areas provided a unique setting in detecting largely dispersed urban morphology within an urban-rural frontier context. In addition, an innovative method for detecting clouds and cloud shadow layers for the full area estimation of ISA is also presented herein. The removal and replacement of clouds and cloud shadows, with underlying materials is further explained. Aerial photography with a spatial resolution of 0.4 m, acquired over the summer period in 2005 was used for validation purposes. Validation of the derived products indicated an overall ISA detection accuracy in the order of ~97%. The latter was considered as very satisfactory and at least comparative, if not somehow better, to existing ISA products provided on a national level. The hybrid method for ISA extraction proposed here is important on a local scale in terms of moving forward into a biennial program for the Welsh Government. It offers a much less subjectively static and more objectively dynamic estimation of ISA cover in comparison to existing operational products already available, improving the current estimations of international urbanization and soil sealing. Findings of our study provide important assistance towards the development of relevant EO-based products not only inaugurate to Wales alone, but potentially allowing a cost-effective and consistent long term monitoring of ISA at different scales based on EO technology. Full article

As the demand for cloud computing continues to increase, cloud service providers face the daunting challenge to meet the negotiated SLA agreement, in terms of reliability and timely performance, while achieving cost-effectiveness. This challenge is increasingly compounded by the increasing likelihood of failure in large-scale clouds and the rising impact of energy consumption and CO2 emission on the environment. This paper proposes Shadow Replication, a novel fault-tolerance model for cloud computing, which seamlessly addresses failure at scale, while minimizing energy consumption and reducing its impact on the environment. The basic tenet of the model is to associate a suite of shadow processes to execute concurrently with the main process, but initially at a much reduced execution speed, to overcome failures as they occur. Two computationally-feasible schemes are proposed to achieve Shadow Replication. A performance evaluation framework is developed to analyze these schemes and compare their performance to traditional replication-based fault tolerance methods, focusing on the inherent tradeoff between fault tolerance, the specified SLA and profit maximization. The results show that Shadow Replication leads to significant energy reduction, and is better suited for compute-intensive execution models, where up to 30% more profit increase can be achieved due to reduced energy consumption. Full article

The use of Landsat data to answer ecological questions is greatly increased by the effective removal of cloud and cloud shadow from satellite images. We develop a novel algorithm to identify and classify clouds and cloud shadow, SPARCS: Spatial Procedures for Automated Removal of Cloud and Shadow. The method uses a neural network approach to determine cloud, cloud shadow, water, snow/ice and clear sky classification memberships of each pixel in a Landsat scene. It then applies a series of spatial procedures to resolve pixels with ambiguous membership by using information, such as the membership values of neighboring pixels and an estimate of cloud shadow locations from cloud and solar geometry. In a comparison with FMask, a high-quality cloud and cloud shadow classification algorithm currently available, SPARCS performs favorably, with substantially lower omission errors for cloud shadow (8.0% and 3.2%), only slightly higher omission errors for clouds (0.9% and 1.3%, respectively) and fewer errors of commission (2.6% and 0.3%). Additionally, SPARCS provides a measure of uncertainty in its classification that can be exploited by other algorithms that require clear sky pixels. To illustrate this, we present an application that constructs obstruction-free composites of images acquired on different dates in support of a method for vegetation change detection. Full article

Detecting clouds in satellite imagery is becoming more important with increasing data availability, however many earth observation sensors are not designed for this task. In Satellite pour l’Observation de la Terre 5 (SPOT5) High Resolution Geometrical (HRG) imagery, the reflectance properties of clouds are very similar to common features on the earth’s surface, in the four available bands (green, red, near-infrared and shortwave-infrared). The method presented here, called SPOTCASM (SPOT cloud and shadow masking), deals with this problem by using a series of novel image processing steps, and is the first cloud masking method to be developed specifically for SPOT5 HRG imagery. It firstly detects marker pixels using image specific threshold values, and secondly grows segments from these markers using the watershed-from-markers transform. The threshold values are defined as lines in a 2-dimensional histogram of the image surface reflectance values, calculated from two bands. Sun and satellite angles, and the similarity between the area of cloud and shadow objects are used to test their validity. SPOTCASM was tested on an archive of 313 cloudy images from across New South Wales (NSW), Australia, with 95% of images having an overall accuracy greater than 85%. Commission errors due to false clouds (such as highly reflective ground), and false shadows (such as a dark water body) can be high, as can omission errors due to thin cloud that is very similar to the underlying ground surface. These errors can be quickly reduced through manual editing, which is the current method being employed in the operational environment in which SPOTCASM is implemented. The method is being used to mask clouds and shadows from an expanding archive of imagery across NSW, facilitating environmental change detection. Full article

A new water index for SPOT5 High Resolution Geometrical (HRG) imagery normalized to surface reflectance, called the linear discriminant analysis water index (LDAWI), was created using training data from New South Wales (NSW), Australia and the multivariate statistical method of linear discriminant analysis classification. The index uses all four image bands, and is better at separating water and non-water pixels than the two commonly used variations of the normalized difference water index (NDWI), which each only use two image bands. Compared across 2,400 validation pixels, from six images spanning four years, the LDAWI attained an overall accuracy of 98%, a producer’s accuracy for water of 100%, and a user’s accuracy for water of 97%. These accuracy measures increase to 99%, 100% and 98% if cloud shadow and topographic shadow masks are applied to the imagery. The NDWI achieved consistently lower accuracies, with the NDWI calculated from the green and shortwave infrared (IR) bands performing slightly better (91% overall accuracy) than the NDWI calculated from the green and near IR bands (89% overall accuracy). The LDAWI is now being routinely used on an archive of over 2,000 images from across NSW, as part of an operational environmental monitoring program. Full article

A two-component fully automated flood monitoring system is described and evaluated. This is a result of combining two individual flood services that are currently under development at DLR’s (German Aerospace Center) Center for Satellite based Crisis Information (ZKI) to rapidly support disaster management activities. A first-phase monitoring component of the system systematically detects potential flood events on a continental scale using daily-acquired medium spatial resolution optical data from the Moderate Resolution Imaging Spectroradiometer (MODIS). A threshold set controls the activation of the second-phase crisis component of the system, which derives flood information at higher spatial detail using a Synthetic Aperture Radar (SAR) based satellite mission (TerraSAR-X). The proposed activation procedure finds use in the identification of flood situations in different spatial resolutions and in the time-critical and on demand programming of SAR satellite acquisitions at an early stage of an evolving flood situation. The automated processing chains of the MODIS (MFS) and the TerraSAR-X Flood Service (TFS) include data pre-processing, the computation and adaptation of global auxiliary data, thematic classification, and the subsequent dissemination of flood maps using an interactive web-client. The system is operationally demonstrated and evaluated via the monitoring two recent flood events in Russia 2013 and Albania/Montenegro 2013. Full article

The mixed grassland in Canada is characterized by low to medium green vegetation cover, with a large amount of canopy background, such as non-photosynthetic vegetation residuals (litter), bare soil, and ground level biological crust. It is a challenge to extract the canopy information from satellite images because of the influence of canopy background. Therefore, this study aims to extract a soil line, a representation of bare soil with litter and soil crust in the surface, from Landsat images to reduce the background effect. Field work was conducted in the West Block of Grasslands National Park (GNP) in Canada, which represents the northern mixed grassland from late June to early July 2005. Six TM images with either no or only a small amount of cloud content were collected in 2005. In this study, soil lines were extracted directly from images by quantile regression and the (R, NIR_min) method. The results show that, (1) both cloud and cloud shadow have obvious influence on simulating soil line automatically from images; (2) green up and late senescence seasons are relatively better for soil line simulation; (3) the (R, NIR_min) method is better for soil line simulation than quantile regression to extract green biomass or green cover information. Full article