You are currently viewing a new version of our website. To view the old version click .
Climate
  • Article
  • Open Access

25 June 2018

The Effect of Building Facades on Outdoor Microclimate—Reflectance Recovery from Terrestrial Multispectral Images Using a Robust Empirical Line Method

,
and
1
Faculty of Built Environment, The University of New South Wales (UNSW), Sydney NSW 2052, Australia
2
CRC for Low Carbon Living Ltd, Tyree Energy Technology Building—UNSW, Sydney NSW 2052, Australia
3
School of Architecture and Built Environment, The University of Adelaide, Adelaide SA 5005, Australia
*
Author to whom correspondence should be addressed.
This article belongs to the Special Issue Urban Overheating - Progress on Mitigation Science and Engineering Applications

Abstract

Climate change and the urban heat island effect pose significant health, energy and economic risks. Urban heat mitigation research promotes the use of reflective surfaces to counteract the negative effects of extreme heat. Surface reflectance is a key parameter for understanding, modeling and modifying the urban surface energy balance to cool cities and improve outdoor thermal comfort. The majority of urban surface studies address the impacts of horizontal surface properties at the material and precinct scales. However, there is a gap in research focusing on individual building facades. This paper analyses the results of a novel application of the empirical line method to calibrate a terrestrial low-cost multispectral sensor to recover spectral reflectance from urban vertical surfaces. The high correlation between measured and predicted mean reflectance values per waveband (0.940 (Red) < rs > 0.967 (NIR)) confirmed a near-perfect positive agreement between pairs of samples of ranked scores. The measured and predicted distributions exhibited no statistically significant difference at the 95% confidence level. Accuracy measures indicate absolute errors within previously reported limits and support the utility of a single-target spectral reflectance recovery method for urban heat mitigation studies focusing on individual building facades.

1. Introduction

Anthropogenic alterations to the optical, thermal, moisture and aerodynamic properties of city surfaces generate distinct urban climates, typically characterized by the urban heat island (UHI) effect [1]. The UHI effect refers to hotter air (and surface) temperatures observed in cities compared to non-urban surroundings [2]. UHI spatial and temporal characteristics are influenced by synoptic weather conditions [3,4] but UHI formation is attributed to differences in urban surface structure (3-D geometry), cover (land use and permeability), fabric (optical and thermal properties of materials) and metabolism (human activity) compared to non-urban surroundings [5,6]. Geometric and surface characteristics regulate the partitioning of the surface energy balance (SEB) [2] and at any given location surface temperature—and near-surface air temperature under calm conditions [7,8]—is controlled by the surface’s SEB [9].
UHIs develop in most cities regardless of climate [10] and have been observed globally in over 400 urban areas [4]. The magnitude of the screen height air temperature difference between urban and non-urban locations, or between different Local Climate Zones [10], is quantified by the “UHI intensity” which is most pronounced during calm, clear summer nights [2]. The average maximum UHI intensity for 87 European cities has been reported to be almost 6.2 K within a range of 2.8 K to 12 K [11]. Similar magnitude UHI intensities were reported for 101 Asian and Australian cities [12].
The superimposition of inadvertent urban heating (i.e., UHIs) and global warming, including more frequent, longer and intense heat waves [13,14,15] elevates the risk of heat-related mortality and illness in cities [16,17,18] and extreme urban heat has detrimental outdoor comfort, economic and building energy impacts [19,20,21]. The intentional modification of urban surface geometry, cover and fabric to reduce urban heat and decouple heat waves from amplified UHIs [22,23] is now a policy priority for many cities [24,25].

1.1. Urban Heat Mitigation—Current Status and Cooling Magnitude

In summer, solar absorption by urban surfaces is the dominant cause of the UHI effect [5]. Recent efforts to mitigate the formation of urban heat at different spatial scales have focused on changes to urban surface geometry and fabric [26,27,28] with the primary aim of controlling the absorption of solar radiation and increasing moisture availability [22,29]. However, due to the significant urban surface and air temperature reduction potential of reflective technologies [19,30] heat mitigation solely focusing on “cool” materials—those with high solar reflectance and high infrared emittance [31,32,33]—applied to building envelopes (roofs and walls) and urban structures (roads, squares and footpaths) dominates current scientific research and the global implementation of UHI mitigation technologies [34].
An analysis of 75 simulation studies using reflective materials on roofs and pavements reported average peak and absolute maximum screen-height air temperature reductions of 1.43 K and 3.4 K respectively for their combinations [35]. The same study reported average reductions in air temperature of 0.23 K and 0.27 K per 10% increase in albedo for cool roofs and cool pavement technologies respectively. However, despite widespread acceptance of the cooling benefits of reflective technologies and the implementation of numerous large-scale projects using reflective roof and pavement materials [36], more rigorous experimental monitoring, consistent metadata reporting and detailed information on their reduced performance over time and potential outdoor comfort impacts are still required [37,38,39].

1.2. Urban Heat Mitigation—Principles of Reflective Technology

The primary summer daytime energy input into the urban canopy layer (UCL) is solar radiation, which is reflected or absorbed by solar-exposed terrestrial surfaces [1]. Depending on surface characteristics, solar radiation is partitioned into radiative, sensible, latent or storage heat fluxes [2,40,41]. Radiative and sensible heat fluxes dominate the SEB in the absence of moisture [42,43]. Sensible heat—or the perceptible rise in air temperature—is amplified when the difference between surface and ambient temperatures is large [44,45]. A reduction in the surface’s surface temperature, which is achieved by shade or increasing the surface’s reflectance [46,47] constrains the convective transfer intensity to the surrounding air [44], thus limiting the transfer of heat to the adjacent air volume [42,43,48] although the relationship between surface and near-surface air temperature is complex [49].
Conversely, surfaces with lower solar reflectance absorb more solar energy, thereby heating the surface, and through strengthened convective transfer [45], warm the adjacent air volume [46,50]. Additionally, via long-wave radiative transfer, hotter surfaces emit infrared radiation to cooler objects within view [51]. In summary, increasing surface reflectance—which in the solar spectrum is referred to as the surface’s albedo—potentially reduces the surface’s surface temperature, the convective transfer intensity to the air and the emitted infrared radiation to surfaces in view.
However, higher solar reflectance within cities may also increase reflected solar radiation to near-surface facets and people [37,51,52,53,54,55,56,57,58,59] although the magnitude of reflected solar radiation and its impact on human outdoor thermal comfort is highly context-dependent [37,53,60] and few studies have been experimentally determined [52,54].

1.3. Methods for Measuring Solar Reflectance—Nomenclature

The albedo of a surface is defined as its hemispherical and wavelength-integrated reflectance [50] and broadband albedo is the ratio of reflected to incident (direct and diffuse) solar radiation (250–3000 nm), or the fraction of incident sunlight reflected by the surface quantified from 0 to 1 [61]. The albedo of a terrestrial surface may vary with the wavelength (λ) of incident radiation (spectral dependence), the angle of incidence (θ) of radiation (angular dependence of direct and diffuse components) and the surface’s surface structure and roughness [61,62].
In remote sensing and field measurements reflectance quantities are acquired under sky conditions and surface albedo is influenced by atmospheric turbidity, solar position, surface orientation and the geometry and optical properties of the surrounding urban form [62,63]. Solar irradiance consists of both direct beam and diffuse components and therefore the solar reflectance of a surface is variable in time and place (as atmospheric conditions and solar position change) and constant albedo values assume spectral and angular independence [62].
The use of laboratory, field or remote sensing methods for the measurement of surface reflectance is determined by the experimental design, material characteristics (e.g., sample size, etc.), spatial scale and wavelength and directional parameters of interest [64,65,66]. Reflectance nomenclature describes measured reflectance values first by the incident, and secondly by the reflected, angular distribution of radiation [63]. Levinson et al. [66] provide a comprehensive review of standard reflectance measurement methods and only remotely-sensed reflectance methods are briefly discussed further here.

1.4. Methods for Measuring Solar Reflectance—Remote Sensing of Urban Surfaces Using Narrow Field of View (FOV) Sensors

The standards-based laboratory [67] and field methods [68,69] for albedo measurement provide single reflectance quantities of small (0.1–5 cm2), flat, homogenous surfaces or the hemispherically-integrated value of larger (>1 m2) horizontal and low-sloped homogeneous diffusely-reflecting surfaces or the aggregate quantity of non-uniform horizontal surfaces [70] with relatively high accuracy (error <2%) [66]. However, the aforementioned methods have several limitations when applied to real urban surfaces [64,66,71,72].
Since the microclimate impacts of urban vertical surfaces are spatially dependent [54,73,74,75,76] and may be significantly influenced by microstructure heterogeneity [77] the ability to compute the spatial and geometric distribution of reflectance at sub-facet scale (<10 m) is desirable [78,79,80,81,82]. Satellite, aerial and ground-based remote sensing technologies permit increasing spatial, spectral, radiometric and temporal resolution with greater spatial coverage [48,83,84]. Ground-based imaging sensors are lightweight and mobile enabling in-canyon observations of surfaces with relative operational simplicity [85].
Remote sensors record wavelength-dependent energy emanating from a surface within the sensor’s FOV. At short path lengths near the ground (<100–200 m) atmospheric absorption may be considered to be negligible [84,86,87]. Image data from image sensors are composed of discrete picture elements (pixels) each with a potentially unique brightness (or digital number, DN) value and ground resolution or instantaneous field of view (IFOV) determined by the sensor optics [84]. Depending on target distance, a ground-based image of a building wall or horizontal urban surface is “automatically” resolved into sub-facet (IFOV) scale surface brightness values that, once calibrated to spectral radiance [63] and geolocated, can be used to derive spatially-registered per-pixel spectral reflectance quantities based on the experimentally determined correlation between surface reflectance and at-sensor radiance [48,88,89].
Obtaining reflectance data in both the visible and NIR wavelengths improves surface albedo estimates, since many urban materials strongly reflect in the NIR region [31,48,90]. Multispectral (MS) sensors are spectrally selective and simultaneously record reflected radiation in several discrete narrow bandwidths, for example in Green (520–600 nm), Red (630–690 nm) and NIR (760–920 nm) [91,92]. Reflectance quantities derived from ground-based sensors with narrow FOV (and with knowledge of the surfaces’ spectral and angular dependence [48]) are “hemispherical-canonical” reflectance values (per [63]) where direct and diffuse sky radiation is reflected into a narrow sensor viewing geometry [63]. A maximum absolute error of 14% has been reported for remotely measured albedo values of horizontal and low-sloped urban roofs from radiometrically calibrated high-resolution (1 m) aerial imagery with a smaller error (<2%) for low albedo (<0.2) surfaces [48].

1.5. Methods for Measuring Solar Reflectance—Overview of the Emprical Line (EL) Method

Remotely sensed image data of reflected energy received by a passive sensor is typically represented by a matrix of pixels containing DNs that are in value proportional to the intensity of energy reflected by the surface within view [92]. However, the proportionality relationship between image DNs and physical units such as surface reflectance is influenced by camera characteristics (i.e., the spectral response curve and analogue-to-digital signal conversion of the sensor [92]), sun-surface-sensor geometry (i.e., anisotropy of reflected radiation and illumination conditions [93]) and, for larger path distances, atmospheric transmittance [48]. Hence, DNs alone contain little meaningful quantitative information about surface reflectance unless the sensor is radiometrically calibrated [88].
Empirical (or “vicarious”) radiometric calibration using in-situ reference targets of known spectral reflectance correlated to at-sensor radiance for each sensor waveband robustly accounts for atmospheric and illumination effects and produces acceptable radiance-to-reflectance conversion results [48,88]. Despite its widespread use the method is error prone if implemented without logistical and methodological considerations [88,94]. For many inexpensive, commercially available MS cameras the relationship between at-sensor spectral radiance and image DNs is not readily available [95,96], is onerous to obtain [48,97] and may be non-linear [98] and the unique camera response function—the gain and offset coefficients used to convert the radiance-as-electrical signal to output digital numbers [92]—requires determination before DNs can be converted to reflectance units [99,100]. In this case, the reflectance-based calibration method can be used to predict at-sensor radiance (expressed as image DNs) by measuring the reflectance of a calibration target [94,100].
Typically, an ordinary least squares (OLS) regression equation of spectral reflectance (y-axis) against DNs (x-axis) is computed for each sensor waveband from the mean spectral reflectance values of at least two spectrally distinct ground calibration targets and the mean DNs from the corresponding region of interest (ROI) in the image [88]. The EL equation is then validated in the field using spectral reflectance values measured by a field spectrometer or supplementary targets of known reflectance [86,99]. Mean DNs retrieved from remotely sensed MS images are then used as input data to the per-waveband predictive equations to generate per-pixel spectral reflectance values [86,96,101,102]. Several authors have developed simplified protocols using vicarious calibration methods to reduce the number of high-cost, in-situ and in-image targets [86,98].
While studies using EL methods for reflectance recovery are increasingly common to derive vegetation characteristics in open fields ([86] and references therein) the use of the EL method for reflectance recovery from urban surfaces is less common due to logistical and methodological challenges posed by urban areas [5] but interest in applications to man-made and urban surfaces is growing [94,103,104].

1.6. Purpose and Significance of the Work

Surface properties and impacts of cool roof and paving technologies have been extensively studied and applied [19,26,32,36,46,105,106,107]. However, research into the microclimate impacts of urban vertical surfaces and the effect of building facade geometry and fabric remain relatively underdeveloped [44]. While research into the optical properties, thermal and energy performance and outdoor thermal comfort impacts of cool materials for use in building envelopes is more advanced [36,37,54,72,73,108,109,110,111,112,113], the conceptualisation of building facades as more than merely an ensemble of material “facets” (or discrete, homogenous, surfaces [5]) and the development of climate sensitive architectural design applications that progress beyond a singular focus on cool and smart material specification [114,115,116] are still emerging (e.g., [117,118,119,120]).
While microclimate modelling and simulation tools exist and are fundamentally useful [121,122,123] comparatively few have been validated in the field [124] and none explicitly provide architects with meaningful “thermo-semantics”—the synthesis of building envelope thermal and optical performance computation and architectural design—at scales and interests commensurate with architects’ decision-making [125].
This paper is part of ongoing research into the development of a thermo-semantic tool intended to assist architects to evaluate the outdoor thermal impacts of building facade design based on a vertical surface thermal typology supported by a predictive statistical model. The reflectance recovery method described here was applied to multispectral image panoramas of sampled building facades to create reflectance datasets for input to a probabilistic model.
The development of low-cost, replicable methods for reflectance recovery from real urban vertical surfaces within the UCL addresses the need for improved observation, understanding and transdisciplinary communication of urban atmospheric process at multiple scales and particularly at the street-level human scale [126] and contributes to the development of a predictive science of microclimatology [125]. Close-range ground-based reflectance recovery complements but also has some advantages over emerging unmanned aerial vehicle (UAV) technologies, particularly in relation to the statutory height and air-space restrictions applicable to UAVs in dense urban areas [86,127].

2. Materials and Methods

2.1. Overview of Method

To recover per-pixel spectral reflectance from MS digital images the relationship between known reflectance values per camera waveband and image DN distributions was statistically modelled as EL equations [88]. Two sets of alternative camera calibration targets were used to derive the theoretical constant “camera response function” and a second calibration target of higher reflectance was used to derive the variable “slope coefficient” [98]. The reflectance recovery method was evaluated by comparing known reflectance values of common building materials used in building facades with those derived from the final empirical line equations applied in ArcMap (ArcGIS by ESRI) to colour-processed MS images of the same materials. Predictive model precision and accuracy measures [128,129] were used to determine the optimum equations for later application to recover per-pixel spectral reflectance from MS panoramas of sixty mid-rise building facades (not discussed further here).

2.2. Camera Description

Tetracam Inc.’s Agricultural Digital Camera (ADC) (Table 1 and Table 2) was used to capture images of the calibration targets. Images were stored using an uncompressed 10-bit per-pixel RAW (RAW) file format in automatic exposure mode (set to average).
Table 1. Tetracam ADC multispectral camera specifications 1.
Table 2. Tetracam ADC camera waveband, bandwidth and colour channel specifications 1.

2.3. Camera Calibration Target Sets and Spectrophotometer Measurements

Two sets of camera calibration targets were used to develop the optimal EL model of the camera response function that describes the theoretical minimum reflectance per waveband detectable by the sensor [98]. Set 1 consisted of twelve A4-size stiff cardboard cards factory-painted with selected Dulux acrylic colours. The cards had a wide range (approx. 13% to 100%) of mean near-normal beam hemispherical spectral reflectance values (Refer Table 3, Figure 1) measured using a Perkins Elmer Lambda 950 UV/VIS/NIR spectrophotometer over a 250–1000 nm range at 5 nm intervals with a 150 mm integrating sphere calibrated with a 99% Spectralon certified reflectance standard in compliance with [67].
Table 3. Dulux colour card IDs and measured mean spectral reflectance values 1.
Figure 1. Dulux colour cards reflectance curves 450–1000 nm at 5 nm intervals.
The Dulux cards were selected for conformity to the recommended calibration target qualities of uniform, matte surface (assumed here to be diffusely reflecting or Lambertian), near-uniform reflectance over the bandwidths of interest and with high spectral contrast [88]. Measuring spectral reflectance at 5 nm intervals adequately records the spectral characteristics of most surfaces [66].
Camera calibration target Set 2 consisted of one 127 × 127 mm Spectralon multi-step diffuse calibration target (Labsphere Inc., North Sutton, NH, USA) with four side-by-side vertical panels of 12%, 25%, 50% and 99% nominal spectral reflectance values measured at 1 nm intervals from 250 to 2500 nm using a Perkins Elmer Lambda 900B UV/VIS/NIR dual beam spectrophotometer with 150 mm integrating sphere that collects 8-degree beam hemispherical reflectance (spectral and diffuse) calibrated with a Spectralon reflectance standard [130] (Refer Table 4, Figure 2).
Table 4. Spectralon multi-step target ID and mean spectral reflectance values 1.
Figure 2. Spectralon multi-step reflectance curves 450–1000 nm at 1 nm intervals.

2.4. Camera Calibration Image Acquisition

The Dulux cards and the Spectralon multi-step target were placed vertically on a horizontal ledge adjacent a sun-exposed building wall (Figure 3).
Figure 3. Dulux colour cards (a) and Spectralon multi-step calibration target (striped) (b).
Images were taken of the calibration targets outdoors under clear-sky conditions on 15 October 2016 between 12:00 and 12:15 p.m. The solar altitude and azimuth at 12:05 p.m. were 63°23′06′′ and 20°09′15′′ respectively at 33°55′00′′ south latitude and 151°13′00′′ east longitude [131]. Multiple images were taken normal to the Dulux and Spectralon targets at distances of 3.2 m and 1 m respectively. The target sizes satisfied the recommendations in the literature to be a minimum 3 to 10 times the sensor IFOV [87,88,89,90,91,92,93,94,95,96,97,98,132] to ensure that as many pixels as possible associated with each calibration target were selected [88] and to avoid atmospheric effects [87]. Each Dulux panel and the Spectralon target measured 293 (h) × 210 mm (w) and 127 × 127 mm respectively (with a single multi-step column measuring 30 mm (w) × 120 mm (h)). Table 5 lists the camera calibration target distances, IFOV and minimum recommended target sizes.
Table 5. Camera calibration target distances and IFOV to satisfy target size requirements.

2.5. Multispectral Image Pre-Processing

The ADC image data were stored in RAW format on a single SanDisk compact flash card and downloaded via a card reader for processing on a PC. The ADC is supplied with a camera-specific colour process file (CPF) that evaluates each RAW pixel value using a colour processing algorithm to extract NIR (760–920 nm), Red (630–690 nm) and Green (520–600 nm) waveband values for each pixel [133]. Colour-processed images were analysed in 10-bit RAW format and later saved in 8-bit JPEG format for import into ArcMap.
To minimize the effects of saturation on the colour processed images the “Auto Adjust Scaling” (AAS) box was checked on the Matrix page of the proprietary image editing software PixelWrenchII (PW2) [133]. As previously reported, saturation of the Tetracam ADC images may occur for high reflectance surfaces when the DNs exceed 256 resulting in the actual reflectance values exceeding the dynamic range of the sensor [98,134].

2.6. Derivation of Camera Calibration Equations

The mean DN per waveband was calculated from a uniform polygon region of interest (ROI) within the borders of the colour-processed image of each calibration target using the Histogram Tool in PW2. For each calibration sample the spectrophotometer-measured mean spectral reflectance per-waveband (on the y-axis) was regressed against the corresponding mean DN (on the x-axis) to derive the per-waveband “camera response function” or empirical line 1 (EL1) using the curve estimation function in the statistical software IBM SPSS. The OLS regression equations and scatter plots are shown in Table 6 and Table 7 and Figure 4 and Figure 5 below.
Table 6. OLS equations (EL1) of camera response function per waveband for Dulux samples.
Table 7. OLS equations (EL1) of camera response function per waveband for Spectralon samples.
Figure 4. Plots of: Green (a); Red (b); and NIR (c) camera response functions for the Dulux targets.
Figure 5. Plots of: Green (a); Red (b); and NIR (c) camera response functions for the Spectralon targets.
The plots of spectral reflectance against sensor DN for the Dulux targets depict a strong positive linear relationship for all three wavebands as measured by Pearson’s correlation coefficient (0.986red < RDulux > 0.989green). For all sensor wavebands the coefficient of determination exceeds 0.971. The plots of spectral reflectance against sensor DN for the Spectralon calibration target depict a strong linear correlation for Red and NIR wavebands (R = 0.999) and an exponential relationship for the Green waveband. R2 for Red and NIR were both 0.998 and lowest at 0.964 for Green.

Assessment of Camera Calibration Equations

When the x-intercept (DN) equals 0 the corresponding y-intercept values are theoretically the minimum reflectance values detectable by the unique image sensor per waveband [98]. Comparative results of the Dulux and Spectralon-derived camera response equations (Table 6 and Table 7) indicate that in this instance, the y-intercept is not a true “constant calibration parameter” [98], since under identical illumination conditions the minimum possible detectable mean spectral reflectance varies depending on the properties of the calibration target [92,135].
In consideration that the spectral curves of both calibration target sets (Figure 1 and Figure 2) indicate near-uniform reflectance over the bandwidths of interest and the Spectralon target is a diffuse reflector, the difference between the camera response to the calibration target sets may be accounted for, in part, by the non-Lambertian reflectance and material properties of the Dulux cards [86,88,136] although this reflectance anisotropy has not been experimentally verified.

2.7. Derivation of “Slope Coefficient” from In-Situ Calibration Target—Theory and Method

When two or more calibration targets with large spectral contrast are used the EL method permits the computation of the sensor-specific relationship between image DNs and surface spectral reflectance [88]. In many instances, however, it is impractical or expensive to acquire every image containing its own calibration targets [86]. Wang and Myint [98] developed a simplified method to convert image DNs to spectral reflectance by constructing an EL equation per image waveband that consists of the theoretically minimum possible detectable reflectance or “constant calibration parameter” and one additional coordinate—the “slope coefficient”—derived from a single field calibration target of higher reflectance. The slope coefficient accounts for the variable illumination effects on sensor DNs when the camera settings are invariant [98].
The MS images of the target building facades included a mobile meteorological station crowned by an aluminium “calibration bracket” (CB) measuring 97 (w) × 95 mm (h) with a white powder-coated low-sheen finish. The CB dimensions satisfied the target distance recommendations in the literature for this validation study and final reflectance recovery from images of building facades (Table 8).
Table 8. Facade target distance and IFOV to satisfy minimum target size requirement.
The mean near-normal beam hemispherical spectral reflectance values per waveband of the CB were measured using a Perkins Elmer Lambda 1050 UV/VIS/NIR spectrophotometer over a 250–2500 nm range at 1 nm intervals with a 150 mm integrating sphere calibrated with a 99% Spectralon certified reflectance standard compliant with [67] (Table 9 and Figure 6).
Table 9. Calibration bracket (CB) mean spectral reflectance values 1 per camera waveband.
Figure 6. Calibration bracket reflectance curve 250–1000 nm at 1 nm intervals.
The following equations derived from [98] constitute the final EL equations per waveband:
%Rλ = m × DNave(λ) + Ay
m = slope = ΔY/ΔX = (ByAy)/Bx
where Ay is the y-intercept of EL1, when Ax = 0. By is the measured mean spectral reflectance of the calibration bracket and Bx is the mean DN corresponding to By.
Multispectral images of the CB were acquired at the same time as those of the material validation samples. The mean DN per waveband for the CB (Table 10) was calculated from a uniform polygon ROI within the borders of the colour-processed image of the CB using the Histogram Tool in PW2 software.
Table 10. Calibration bracket mean digital number (DN) values 1 per camera waveband.
The final EL equations per waveband (“EL2”) derived from the intercept obtained from EL1 equations and the slope coefficient derived from the slope values calculated from Equation (2) above are summarized in Table 11 and Table 12 below. These equations were then applied in ArcGIS to the colour-processed MS images of the validation samples to recover per-pixel per-waveband spectral reflectance and then compared to the values obtained using ASTM E903-12 [67].
Table 11. EL2 equations from Dulux targets and calibration bracket per camera waveband.
Table 12. EL2 equations from Spectralon targets and calibration bracket per camera waveband.

2.8. Validation Using Material Samples of Known Reflectance Values

2.8.1. Part 1: Validation Sample Image Acquisition and Reflectance Measurement

To validate the EL equations, 13 samples of common building materials were used to compare spectrophotometer-measured [67] spectral reflectance values with reflectance quantities recovered from the EL2 equations.
Plywood-mounted material validation samples, several full-size samples of the same materials and two calibration brackets were placed vertically on a horizontal ledge adjacent a sun-exposed building wall (Figure 7).
Figure 7. Plywood-mounted and full size validation samples and CBs.
Multispectral images were taken of the validation samples outdoors under clear-sky conditions on 9 February 2017 between 12:00 and 12:15 p.m. The solar altitude and solar azimuth at 12:10 p.m. were 66°32′25′′ and 38°27′47′′ respectively at 33°55′00′′ south latitude and 151°13′00′′ east longitude [131]. Images were taken normal to the calibration samples at a distance of 2.9 m. The target sizes satisfied the recommendations in the literature [88] (Table 13).
Table 13. Validation sample target distance and IFOV to satisfy minimum target size requirements.
The validation samples had a wide range (approx. 7% to 78%) of mean spectral reflectance values measured using a Perkins Elmer Lambda 1050 UV/VIS/NIR spectrophotometer over a 250–2500 nm range at 2.5 nm intervals with a 150 mm integrating sphere calibrated with a 99% Spectralon certified reflectance standard compliant with Reference [67] (Table 14 and Figure 8).
Table 14. Material validation sample ID and measured mean spectral reflectance values 1.
Figure 8. Validation samples reflectance curves 450–1000 nm at 2.5 nm intervals.

2.8.2. Part 2: Reflectance Recovery from MS Images in ArcMap

The multispectral images of the validation samples were pre-processed in accordance with the method previously outlined. The colour-processed images were imported in JPEG format into ArcMap for further processing. Discrete ROI raster files were created for each material sample (from a composite image) using the “Clip” function in ArcMap. These files were used as inputs into a raster algebra expression of the empirical line equations (EL2 from Table 11 and Table 12) to create spectral reflectance raster files per waveband.

3. Results

The measured (M) and predicted (P) mean spectral reflectance values of the 13 validation samples for all camera wavebands using the Dulux-derived EL2 are shown in Table 15 below. Common statistical measures of correlation (Pearson’s r and Spearman’s rho), predictive precision (coefficient of determination, R2), distribution difference (Mann-Whitney’s U test) and prediction accuracy (Willmott’s index of agreement d, root mean square (RMSE) and mean absolute error (MAE)) are shown in Table 16 for evaluation of model performance [128,129,137] based on the OLS regression of measured against EL2-predicted reflectance values [138].
Table 15. Measured (M) and EL2-predicted (P) mean spectral reflectance (%) of 13 validation samples using EL1Dulux intercept.
Table 16. Rank correlation and OLS regression statistics M-P from Table 15 data.
Plots of the measured and Dulux EL2 equation-predicted mean spectral reflectance values of the 13 validation samples are shown in Figure 9 and Figure 10 below.
Figure 9. M (red line) and P reflectance plots for G (a); R (b) and NIR (c) bands from EL2Dulux.
Figure 10. Ascending order M (red line) and P reflectance plots for G (a); R (b) and NIR (c) bands from EL2Dulux.
The OLS plots of measured (M) regressed against predicted (P) reflectance values per camera waveband are shown in Figure 11 below.
Figure 11. OLS regression of M against P reflectance per sample for G (a); Red (b) and NIR (c) from EL2Dulux.
The measured and predicted mean spectral reflectance values of the 13 validation samples for the three camera wavebands using the intercept value from the Spectralon-derived EL2 equation and prediction model evaluation statistics are shown in Table 17 and Table 18 below.
Table 17. Measured (M) and EL2-predicted (P) mean spectral reflectance (%) of 13 validation samples using EL1Spectralon intercept.
Table 18. Rank correlation and OLS regression statistics M-P from Table 17 data.
Plots of the measured and Spectralon EL2 equation-predicted mean spectral reflectance values of the 13 validation samples are shown in Figure 12 and Figure 13 below.
Figure 12. M (red line) and P reflectance plots for G (a); R (b) and NIR (c) bands from EL2Spect.
Figure 13. Ascending order M (red line) and P plots for G (a); R (b) and NIR (c) bands from EL2Spect.
The OLS plots of measured (M) regressed against predicted (P) reflectance values per camera waveband are shown in Figure 14 below.
Figure 14. OLS regression of M against P reflectance per sample for G (a); Red (b) and NIR (c) from EL2Spect.
In addition to linear covariance tests (r, R2, intercept a and slope b), OLS model prediction error was evaluated using supplementary measures recommended by [128,129]. These include the systematic root mean square error (RMSEs) and the unsystematic root mean square error (RMSEu). For “good” model performance the RMSE should be low, RMSEs should tend to zero, RMSEu should approach RMSE and Willmott’s index of agreement (d), a measure of prediction accuracy, should approach unity [128]. MAE provides an estimate of mean differences between measured and predicted values and is an “intuitive”, reliable measure of average model prediction error [139]. While RMSE is a widely reported measure of average model error, it is less reliable than MAE since it exaggerates differences due to higher sensitivity of RMSE to outliers [129,140] and due to the inconsistent variance of RMSE with average error [139]. Table 19 below summarizes the performance of both models per waveband to evaluate the most accurate and precise predictive EL equations.
Table 19. Summary statistics of EL2-equations and OLS model performance.
Comparing the model results for the Green waveband, the lower Spectralon-derived OLS equation RMSEs and MAE, higher RMSEu with higher d in agreement with higher regression R2 indicate its unambiguous predictive superiority (bold in Table 19). Comparing the model results for the Red waveband, considering equivalence of linear regression measures RMSEs, MAE and d, the lower Dulux-derived EL2-equation MAE (lowest of all wavebands) and regression parameters (intercept a (−4.81) and slope b (0.922)) closer to the ideal 1:1 correspondence line (when a = 0 and, more importantly, b = 1) for goodness of fit [141] indicate its superior predictive precision and accuracy (bold in Table 19). The above interpretation was supported when comparing the additive and proportional components [128] of the MSEs for each model.
Comparing the results for the NIR waveband, despite a lower MAE for the EL2-Spectralon equation estimates and considering the equivalence of OLS correlation and difference measures, the significantly lower RMSEu for Spectralon-derived OLS suggests that the Dulux-derived EL2 equation contains proportionally less systematic error overall and hence improved accuracy (bold in Table 19). This conclusion is augmented by computation of the ratio MSEs/MSE [129] that indicates that the Dulux-derived NIR predictive model contains a significantly lower proportion (54.4% vs. 85.5%) of systematic error and hence greater comparative model accuracy.
In summary, the optimal predictive models per waveband indicate a strong monotonic agreement (0.940 < Spearman’s Rho > 0.967) and linear association (0.900 < Pearson’s r > 0.966) between the measured and EL2-predicted reflectance values that confirm a near-perfect positive agreement between pairs of samples of ranked scores and a strong linear correlation [142]. The regression measures imply distribution near-equivalence and high confidence in trend predictions [143]. Regardless of the residual magnitudes, the distributions (Figure 9, Figure 10, Figure 12 and Figure 13) show a strong positive agreement that supports reflectance predictions on a relative (high/low) scale. The non-parametric Mann-Whitney U-test for difference between two independent groups exhibits no statistically significant difference in distributions at the 95% confidence level, reinforcing the above interpretation [144]. The coefficients of determination (R2) of the OLS models for all wavebands exceed 81% (NIR). Green and Red band R2 exceed 92.2%. This suggests stronger agreement in the visible bands between measured and predicted values and higher confidence in the precision of the linear covariance between measured and predicted values [138].

Comparative Assessment of Measured and EL2 Predicted Reflectance Distributions

The mean bias error (MBE) [139] between measured and Dulux-derived EL2 equation predicted reflectance values for all wavebands indicates a systematic overestimation of measured values (Figure 9 and Figure 10), a trend corroborated by the regression model (Figure 11) and regression slope and intercept parameters (Table 16). The overestimation bias derives from the camera calibration model (Table 6). However, higher reflectance samples (V3 (nominal reflectance 70%); V4 (75%) and V5 (60%) in Table 15) underestimate measured values. Underestimation of high-albedo surfaces by the EL method has been reported previously [94]. Sample V13, red Granite stone (nom. reflectance 20%) exhibits the largest absolute residual for the Green and Red wavebands. The high error may be theoretically accounted for by the reflectance anisotropy common to natural materials [135] in combination with artifacts of the prediction model. However, the low absolute residual magnitude of the Spectralon-derived estimate for the same sample (Table 17) implicates the latter. The largest absolute residual for the NIR waveband (Dulux-derived) occurs for sample V11, 5 mm Clear Glass (nom. reflectance 8%). The specular behaviour of glass at oblique incident angles (as occurred in the validation experiment, where the solar altitude exceeded 65°) may account for the larger difference in the NIR region [48]. Further, the low measured reflectance of glass falls outside the reflectance data range used to build the EL equations which may increase prediction error for this sample [98].
The MBE between measured and Spectralon-derived EL2 equation predicted reflectance values for the Green and Red wavebands indicates a systematic underestimation of measured values (Figure 12 and Figure 13), a trend corroborated by the regression model (Figure 14) and regression slope and intercept parameters (Table 18). The underestimation bias derives from the camera calibration model (Table 7). MBE for the NIR waveband indicates marginal average overestimation of measured reflectance values, with some exceptions. Sample V13, red granite stone, is overestimated in all three wavebands and largest for the Red waveband. The highest reflectance sample, Sample V4 (powder coated aluminium, cream colour, nominal reflectance 75%), exhibits the largest absolute residual for all camera wavebands and is overestimated in the Red and NIR bands. The Spectralon model prediction of maximum error per sample is inconsistent with the Dulux-derived response to maximum error but consistent with prior studies that found predictions of high albedo surfaces have higher errors than low albedo surfaces [48].
The range of measured mean spectral reflectance values (approx. 7% to 78%) of the validation samples across all wavebands was comfortably within the upper reflectance limit of the calibration targets used in the development of the predictive equations (approx. 99% for EL1 and 89% for EL2). However, the two glass samples had measured reflectance values below the lower limit of the model data range (approx. 12% for EL1). For all samples (excluding glass) the predicted values were interpreted within the limits of the calibration equations [88,98].

4. Discussion

In this study a terrestrial application of the EL method [88] was developed to radiometrically calibrate and validate close-range remotely sensed images of vertical surface materials obtained from a narrow FOV MS camera using a single in-situ calibration target [98]. The y-intercept of the camera response function, although variable with camera calibration target properties, was shown to be the minimum reflectance detectable by the camera sensor per waveband and was used as the lower data point. The second coordinate of the EL equation was derived from the per-waveband spectral reflectance values and DNs of the CB. While the CB was assumed to be Lambertian, the spectrophotometer measurements of the CB indicated that mean spectral reflectance was unequal across sensor wavebands (Table 9) with a declining reflectance trend observed from shorter (visible) to longer (NIR) wavelengths (Figure 6) necessitating a separate EL equation for each waveband [98]. The optimal EL2 equations per waveband (Table 19) strongly linearly correlated (0.900 < r > 0.979) per-pixel spectral reflectance to image DNs with absolute prediction accuracies (7.728% < MAE > 10.108%) within the range reported in the literature [88,94].
Theoretically, improvements in accuracy are achievable if the calibration target is accurately characterized [136] and more than one in-situ calibration target is used [132] and future experimental design could, without much logistical effort, incorporate additional portable near-Lambertian targets, selected for spectral uniformity within sensor wavebands [135]. Instrument characteristics have been identified as a common source of experimental uncertainty [145]. Accuracy improvements may result from the optimisation of camera settings (i.e., manual exposure) within the limitations of the sensor radiometric resolution [92,98,134] and from corrections for sensor background noise and vignetting [87]. However, the anticipated absolute accuracy improvements are not crucial for the “relative magnitude” of elements of the scene approach adopted here where distribution equivalence is more highly prized.
The variable per-waveband mean spectral reflectance of the CB, characterized by greater reflectance in the visible band (Table 9), its smooth, low-sheen surface finish (potentially with a non-negligible specular component at large incident angles [48,146]) and the non-uniform Tetracam ADC CMOS sensor response function to different sensor bandwidths (with lowest sensitivity in the Green waveband) may account for the relative distribution of errors per waveband [86,87]. Importantly, due to near-horizontal viewing geometry, it is speculated that the accuracy of the reflectance recovery computations is strongly influenced by angular and adjacency effects (in particular from ground reflections) [75,85] and the impacts of in-situ spectral, diffuse and direct effects that are not explicitly accounted for in the laboratory measurements [62,146,147].
The majority of prior ground- or UAV-based studies utilising the vicarious EL method with narrow FOV MS sensors for reflectance recovery have been concerned with horizontal vegetated surfaces [86,87,95,96,102] and fewer with horizontal urban surfaces [48,104]. Furthermore, the use of the EL method applied to terrestrial close-range MS sensors with near-horizontal viewing geometry of urban building facades has not been previously reported. However, there is growing interest in the use of ground-based, close range narrow FOV sensors for retrieval of the spatio-temporal optical and thermal characteristics of vertical surfaces at the facet and sub-facet scales for building damage assessment [148], geological surveys [85] and urban climatology [78].
As there is a gap in the literature addressing, and no standard method exists for, facet and sub-facet scale terrestrial reflectance recovery from real building facades, the value of this paper is its contribution to the development of a logistically simple, replicable, validated reflectance recovery method, with explicit error magnitude and source estimation, suitable for climatology studies of building facades using a single mobile calibration target and high-resolution close-range images obtained from a relatively low-cost MS camera. However, since each camera has a unique sensor response-function [92] and irradiance may vary under different environmental conditions, the determination of the relationship between reflectance and DNs necessitates the computation of new equations for each new sensor and every unique environment [98].

5. Conclusions

This paper described a novel application of the EL method for radiometric calibration of a relatively low-cost MS sensor applied to close-range images of vertical urban surface materials. The performance of the single-target EL calibration equations was evaluated and quantified using validation samples of common building materials. Confidence in the precision and accuracy of the EL equations per-waveband was assessed using covariance statistics and error measures [128,129,137] and absolute prediction accuracies (7.728% < MAE > 10.108%) were within the range reported in the literature [88,94,149] and above prediction accuracies (15–20%) reported for single-target calibration methods [88,103].
Based on the optimum equations (Table 19) the results are encouraging and indicate that the prediction equations (Table 11 and Table 12) satisfactorily characterize the per waveband reflectance differences of commonly used materials found on Australian building facades. For example, dry-pressed clay bricks (samples V7, V8, and V9, Table 14) are frequently used in low to medium-rise construction of residential buildings in Sydney and are satisfactorily predicted in the green waveband within a range of 1.24% to 6.68% absolute error (AE) (Table 17) and OLS model absolute residuals (OMAR) of 0.27%, 3.9% and 1.8% respectively. Importantly, the NIR waveband reflectance values are satisfactorily predicted within a range of 2.48% to 5.19% AE (Table 15) and OMAR in the range of 5.4% to 6.2%. This relative predictive strength is significant since dry-pressed clay bricks are both pervasive and more reflective in the NIR region (Table 14 and Figure 8).
Dark-grey pre-painted steel sheeting (sample V2) is another prevalent material used for building facade cladding that is more reflective in the NIR region (Table 14 and Figure 8). Green and NIR waveband reflectance values are satisfactorily predicted with a 0.32% and 0.71% AE (Table 17) and OMAR of 1.96% and 1.84% respectively. Glass (samples V10 and V11) is reasonably well predicted in the visible spectrum with a 1.06% and 4.84% AR in the Green (Table 17) and Red (Table 15) bands with an OMAR of 1.24% and 0.53% respectively for sample V10.
While the results confirm the findings of prior studies supporting the utility of a single in-situ target for radiometric calibration [86,98] it may be concluded from method and model evaluation that improvements in measurement protocols and calibration target specification would reduce prediction model error, although the anticipated absolute accuracy improvements are not warranted here since the “relative magnitude” of elements of the scene and distribution equivalence are desired for the development of a larger statistical model. The regression statistics (Table 16, Table 18 and Table 19) imply distribution near-equivalence between measured and predicted reflectance values and high confidence in trend predictions. This demonstrates that a single-target EL method can be applied to recover spectral reflectance from terrestrial close-range MS images of vertical surfaces with satisfactory results.

Author Contributions

Conceptualization; Methodology; Validation; Formal Analysis; Investigation; Writing-Original Draft Preparation; Writing-Review & Editing and Funding Acquisition, J.F.; Resources; Funding Acquisition; Writing-Review & Editing; Supervision, P.O.; Resources; Supervision and Funding Acquisition, A.P.

Funding

This research was funded by the Cooperative Research Centre (CRC) for Low Carbon Living, project number RP2005, and the Australian Government Research Training Program (RTP) Scholarship.

Acknowledgments

The authors wish to acknowledge Bill Joe, Research Support Engineer at the School of Material Science and Engineering, UNSW, and Alan Yee, Professional Officer at the School of Photovoltaics and Renewable Energy Engineering (SPREE), UNSW, for their technical support during the laboratory-based spectrophotometer measurements.

Conflicts of Interest

The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, and in the decision to publish the results.

References

  1. Oke, T.R. Boundary Layer Climates, 2nd ed.; Methuen: London, UK, 1987; ISBN 0-416-04422-0. [Google Scholar]
  2. Oke, T.R. The energetic basis of the urban heat island. Q. J. R. Meteorol. Soc. 1982, 108, 1–24. [Google Scholar] [CrossRef]
  3. He, B.-J. Potentials of meteorological characteristics and synoptic conditions to mitigate urban heat island effects. Urban Clim. 2018, 24, 26–33. [Google Scholar] [CrossRef]
  4. Santamouris, M.; Haddad, S.; Fiorito, F.; Wang, R. Urban Heat Island and Overheating Characteristics in Sydney, Australia. An Analysis of Multiyear Measurements. Sustainability 2017, 9, 712. [Google Scholar] [CrossRef]
  5. Oke, T.R.; Mills, G.; Christen, A.; Voogt, J.A. Urban Climates; Cambridge University Press: Cambridge, UK, 2017; ISBN 978-0-521-84950-0. [Google Scholar]
  6. Oke, T.R. Towards a better scientific communication in urban climate. Theor. Appl. Climatol. 2006, 84, 179–190. [Google Scholar] [CrossRef]
  7. Karimi, M.; Vant-Hull, B.; Nazari, R.; Mittenzwei, M.; Khanbilvardi, R. Predicting surface temperature variation in urban settings using real-time weather forecasts. Urban Clim. 2017, 20, 192–201. [Google Scholar] [CrossRef]
  8. Doulos, L.; Santamouris, M.; Livada, I. Passive cooling of outdoor urban spaces. The role of materials. Sol. Energy 2004, 77, 231–249. [Google Scholar] [CrossRef]
  9. Roth, M.; Oke, T.R.; Emery, W.J. Satellite-derived urban heat islands from three coastal cities and the utilization of such data in urban climatology. Int. J. Remote Sens. 1989, 10, 1699–1720. [Google Scholar] [CrossRef]
  10. Stewart, I.D.; Oke, T.R. Local Climate Zones for Urban Temperature Studies. BAMS 2012, 93, 1879–1900. [Google Scholar] [CrossRef]
  11. Santamouris, M. Innovating to zero the building sector in Europe: Minimising the energy consumption, eradication of the energy poverty and mitigating the local climate change. Sol. Energy 2016, 128, 61–94. [Google Scholar] [CrossRef]
  12. Santamouris, M. Analyzing the heat island magnitude and characteristics in one hundred Asian and Australian cities and regions. Sci. Total. Environ. 2015, 512–513, 582–598. [Google Scholar] [CrossRef] [PubMed]
  13. Mora, C.; Dousset, B.; Caldwell, I.R.; Powell, F.E.; Geronimo, R.C.; Bielecki, C.R.; Counsell, C.W.; Dietrich, B.S.; Johnston, E.T.; Louis, L.V.; et al. Global risk of deadly heat. Nat. Clim. Chang. 2017, 7, 501–506. [Google Scholar] [CrossRef]
  14. Intergovernmental Panel on Climate Change (IPCC). Summary for policymakers. In Climate Change 2014: Impacts, Adaptation, and Vulnerabilit; Contribution of Working Group II to the Fifth Assessment Report of the Intergovernmental Panel on Climate Change; Cambridge University Press: Cambridge, UK, 2014. [Google Scholar]
  15. Steffen, W.; Hughes, L.; Perkins, S. Heatwaves: Hotter, Longer, More Often; Climate Council of Australia: Sydney, Australia, 2014; ISBN 978-0-9924142-2-1. [Google Scholar]
  16. Paravantis, J.; Santamouris, M.; Cartalis, C.; Efthymiou, C.; Kontoulis, N. Mortality associated with high ambient temperatures, heatwaves, and the urban heat island in Athens, Greece. Sustainability 2017, 9, 606. [Google Scholar] [CrossRef]
  17. Heaviside, C.; Macintyre, H.; Vardoulakis, S. The urban heat island: Implications for health in a changing environment. Curr. Environ. Health Report 2017, 4, 296–305. [Google Scholar] [CrossRef] [PubMed]
  18. Tan, J.; Zheng, Y.; Tang, X.; Guo, C.; Li, L.; Song, G.; Zhen, X.; Yuan, D.; Kalkstein, A.J.; Li, F. The urban heat island and its impact on heat waves and human health in Shanghai. Int. J. Biometeorol. 2010, 54, 75–84. [Google Scholar] [CrossRef] [PubMed]
  19. Akbari, H.; Cartalis, C.; Kolokotsa, D.; Muscio, A.; Pisello, A.L.; Rossi, F.; Santamouris, M.; Synnefa, A.; Wong, N.H.; Zinzi, M. Local climate change and urban heat island mitigation techniques—The state of the art. J. Civ. Eng. Manag. 2016, 22, 1–16. [Google Scholar] [CrossRef]
  20. Santamouris, M.; Kolokotsa, D. (Eds.) Urban Climate Mitigation Techniques; Routledge: New York, NY, USA, 2016; ISBN 978-0-415-71213-2. [Google Scholar]
  21. Santamouris, M. Regulating the damaged thermostat of the cities—Status, impacts and mitigation strategies. Energy Build. 2015, 91, 43–56. [Google Scholar] [CrossRef]
  22. Sun, T.; Kotthaus, S.; Li, D.; Ward, H.C.; Gao, Z.; Ni, G.H.; Grimmond, C.S.B. Attribution and mitigation of heat wave-induced urban heat storage change. Environ. Res. Lett. 2017, 12, 114007. [Google Scholar] [CrossRef]
  23. Founda, D.; Santamouris, M. Synergies between urban heat island and heat waves in Athens (Greece), during and extremely hot summer. Sci. Rep. 2017, 7, 10973. [Google Scholar] [CrossRef] [PubMed]
  24. Gunawardena, K.R.; Wells, M.J.; Kershaw, T. Utilising green and bluespace to mitigate urban heat island intensity. Sci. Total Environ. 2017, 584–585, 1040–1055. [Google Scholar] [CrossRef] [PubMed]
  25. Georgescu, M.; Morefield, P.E.; Bierwagen, B.G.; Weaver, C.P. Twenty-first century megapolitan expansion. Proc. Natl. Am. Sci. USA 2014, 111, 2909–2914. [Google Scholar] [CrossRef] [PubMed]
  26. Kyriakodis, G.-E.; Santamouris, M. Using reflective pavements to mitigate urban heat island in warm climates—Results from a large-scale urban mitigation project. Urban Clim. 2017, 24, 326–339. [Google Scholar] [CrossRef]
  27. Chatzidimitriou, A.; Yannas, S. Microclimate design for open spaces: Ranking urban design effects on pedestrian thermal comfort in summer. Sustain. Cities Soc. 2016, 26, 27–47. [Google Scholar] [CrossRef]
  28. Takebayashi, H. High-Reflectance Technology on Building Façades: Installation Guidelines for Pedestrian Comfort. Sustainability 2016, 8, 785. [Google Scholar] [CrossRef]
  29. Santamouris, M. Urban warming and mitigation: Actual status, impacts and challenges. In Urban Climate Mitigation Techniques; Santamouris, M., Kolokotsa, D., Eds.; Routledge: New York, NU, USA, 2016; pp. 1–25. ISBN 978-0-415-71213-2. [Google Scholar]
  30. Morini, E.; Touchaei, A.-G.; Rossi, F.; Cotana, F.; Akbari, H. Evaluation of albedo enhancement to mitigate impacts of urban heat island in Rome (Italy) using WRF meteorological model. Urban Clim. 2017, 24, 551–566. [Google Scholar] [CrossRef]
  31. Muscio, A. The solar reflectance index as a tool to forecast the heat released to the urban environment: Potentiality and assessment issues. Climate 2018, 6, 12. [Google Scholar] [CrossRef]
  32. Santamouris, M.; Synnefa, A.; Karlessi, T. Using advanced cool materials in the urban built environment to mitigate heat islands and improve thermal comfort conditions. Sol. Energy 2011, 85, 3085–3102. [Google Scholar] [CrossRef]
  33. Bretz, S.E.; Akbari, H.; Rosenfeld, A. Practical issues for using solar-reflective materials to mitigate urban heat islands. Atmos. Environ. 1998, 32, 95–101. [Google Scholar] [CrossRef]
  34. Aleksandrowicz, O.; Vuckovic, M.; Kiesel, K.; Mahdavi, A. Current trends in urban heat island mitigation research: Observations based on a comprehensive research repository. Urban Clim. 2017, 21, 1–26. [Google Scholar] [CrossRef]
  35. Santamouris, M.; Ding, L.; Fiorito, F.; Synnefa, A. Passive and active cooling for the outdoor environment—An analysis and assessment of the cooling potential of mitigation technologies using performance data from 220 large-scale projects. Sol. Energy 2017, 154, 14–33. [Google Scholar] [CrossRef]
  36. Pisello, A.L. State of the art on the development of cool coatings for buildings and cities. Sol. Energy 2017, 144, 660–680. [Google Scholar] [CrossRef]
  37. Lee, H.; Mayer, H. Thermal comfort of pedestrians in an urban street canyon is affected by increasing albedo of building wall. Int. J. Biometeorol. 2018. [Google Scholar] [CrossRef] [PubMed]
  38. Lontorfos, V.; Efthymiou, C.; Santamouris, M. On the time varying mitigation performance of reflective geoengineering technologies in cities. Renew. Energy 2018, 115, 926–930. [Google Scholar] [CrossRef]
  39. Yang, J.; Wang, Z.H.; Kaloush, K.E. Environmental impacts of reflective materials: Is high albedo a “silver bullet” for mitigating urban heat island? Renew. Sustain. Energy Rev. 2015, 47, 830–843. [Google Scholar] [CrossRef]
  40. Nunez, M.; Oke, T.R. The energy balance of an urban canyon. J. Appl. Meteorol. 1977, 16, 11–19. [Google Scholar] [CrossRef]
  41. Anandakumar, K. A study on the partition of net radiation into heat fluxes on a dry asphalt surface. Atmos. Environ. 1999, 33, 3911–3918. [Google Scholar] [CrossRef]
  42. Brownlee, J.; Ray, P.; Tewari, M.; Tan, H. Relative role of turbulent and radiative flux on the near-surface temperature in a single-layer urban canopy model over Houston. J. Appl. Meteorol. Climatol. 2017, 56, 2173–2187. [Google Scholar] [CrossRef]
  43. Qin, Y.; Hiller, J.E. Understanding pavement-surface energy balance and its implications on cool pavement development. Energy Build. 2014, 85, 389–399. [Google Scholar] [CrossRef]
  44. Synnefa, A.; Santamouris, M. Mitigating the urban heat with cool materials for the building’s fabric. In Urban Climate Mitigation Techniques; Santamouris, M., Kolokotsa, D., Eds.; Routledge: New York, NY, USA, 2016; pp. 67–91. ISBN 978-0-415-71213-2. [Google Scholar]
  45. Costanzo, V.; Evola, G.; Marletta, L.; Gagliano, A. Proper evaluation of the external convective heat transfer for the thermal analysis of cool roofs. Energy Build. 2014, 77, 467–477. [Google Scholar] [CrossRef]
  46. Akbari, H.; Kolokotsa, D. Three decades of urban heat islands and mitigation technologies research. Energy Build. 2016, 133, 834–842. [Google Scholar] [CrossRef]
  47. Takebayashi, H.; Moriyama, M. Relationships between the properties of an urban street canyon and its radiant environment: Introduction of appropriate urban heat island mitigation technologies. Sol. Energy 2012, 86, 2255–2262. [Google Scholar] [CrossRef]
  48. Ban-Weiss, G.A.; Woods, J.; Levinson, R. Using remote sensing to quantify albedo of roofs in seven California cities, Part 1: Methods. Sol. Energy 2015, 115, 777–790. [Google Scholar] [CrossRef]
  49. Crum, S.M.; Jenerette, G.D. Microclimate Variation among Urban Land Covers: The Importance of Vertical and Horizontal Structure in Air and Land Surface Temperature Relationships. J. Appl. Meteorol. Climatol. 2017, 56, 2531–2543. [Google Scholar] [CrossRef]
  50. Taha, H. Urban climates and heat islands: Albedo, evapotranspiration, and anthropogenic heat. Energy Build. 1997, 25, 99–103. [Google Scholar] [CrossRef]
  51. Levinson, R.M. Near-Ground Cooling Efficacies of Trees and High-Albedo Surfaces. Ph.D. Thesis, University of California, Berkeley, CA, USA, 1997. [Google Scholar]
  52. Lee, I.; Voogt, J.A.; Gillespie, T.J. Analysis and comparison of shading strategies to increase human thermal comfort in urban areas. Atmosphere 2018, 9, 91. [Google Scholar] [CrossRef]
  53. Taleghani, M. The impact of increasing urban surface albedo on outdoor summer thermal comfort within a university campus. Urban Clim. 2018, 24, 175–184. [Google Scholar] [CrossRef]
  54. Rosso, F.; Golasi, I.; Castaldo, V.L.; Piselli, C.; Pisello, A.L.; Salata, F.; Ferrero, M.; Cotana, F.; de Lieto Vollaro, A. On the impact of innovative materials on outdoor thermal comfort of pedestrians in historical urban canyons. Renew. Energy 2018, 118, 825–839. [Google Scholar] [CrossRef]
  55. Taleghani, M.; Berardi, U. The effect of pavement characteristics on pedestrians’ thermal comfort in Toronto. Urban Clim. 2017, 24, 449–459. [Google Scholar] [CrossRef]
  56. Hardin, A.W.; Vanos, J.K. The influence of surface type on the absorbed radiation by a human under hot, dry conditions. Int. J. Biometeorol. 2018, 62, 43–56. [Google Scholar] [CrossRef] [PubMed]
  57. Yoshida, S.; Yumino, S.; Uchida, T.; Mochida, A. Numerical Analysis of the Effects of Windows with Heat Ray Retro-reflective Film on the Outdoor Thermal Environment within a Two-dimensional Square Cavity-type Street Canyon. Procedia Eng. 2016, 169, 384–391. [Google Scholar] [CrossRef]
  58. Salata, F.; Golasi, I.; Vollaro, E.D.L.; Bisegna, F.; Nardecchia, F.; Coppi, M.; Gugliermetti, F.; Vollaro, A.D.L. Evaluation of different urban microclimate mitigation strategies through a PMV analysis. Sustainability 2015, 7, 9012–9030. [Google Scholar] [CrossRef]
  59. Erell, E.; Pearlmutter, D.; Boneh, D.; Kutiel, P.B. Effect of high-albedo materials on pedestrian heat stress in urban street canyons. Urban Clim. 2014, 10, 367–386. [Google Scholar] [CrossRef]
  60. Laureti, F.; Martinelli, L.; Battisti, A. Assessment and mitigation strategies to counteract overheating in urban historical areas in Rome. Climate 2018, 6, 18. [Google Scholar] [CrossRef]
  61. Coakley, J.A. Reflectance and albedo, surface. In Encyclopedia of Atmospheric Sciences; Holton, J.R., Ed.; Academic Press: Oxford, UK, 2003; pp. 1914–1923. ISBN 9780122270901. [Google Scholar]
  62. Levinson, R.M.; Akbari, H.; Berdahl, P. Measuring solar reflectance—Part 1: Defining a metric that accurately predicts solar heat gain. Sol. Energy 2010, 84, 1717–1744. [Google Scholar] [CrossRef]
  63. Schaepman-Strub, G.; Schaepman, M.E.; Painter, T.H.; Dangel, S.; Martonchik, J.V. Reflectance quantities in optical remote sensing—definitions and case studies. Remote Sens. Environ. 2006, 103, 27–42. [Google Scholar] [CrossRef]
  64. Sailor, D.J.; Resh, K.; Segura, D. Field measurement of albedo for limited extent test surfaces. Sol. Energy 2006, 80, 589–599. [Google Scholar] [CrossRef]
  65. Qin, Y.; He, H. A new simplified method for measuring the albedo of limited extent targets. Sol. Energy 2017, 157, 1047–1055. [Google Scholar] [CrossRef]
  66. Levinson, R.; Akbari, H.; Berdahl, P. Measuring solar reflectance—Part 2: Review of practical methods. Sol. Energy 2010, 84, 1745–1759. [Google Scholar] [CrossRef]
  67. ASTM International. ASTM E903-12, Standard Test Method for Solar Absorptance, Reflectance and Transmittance of Materials Using Integrating Spheres; ASTM International: West Conshohocken, PA, USA, 2012. [Google Scholar]
  68. ASTM International. ASTM C1549-16, Standard Test Method for Determination of Solar Reflectance Near Ambient Temperature Using a Portable Solar Reflectometer; ASTM International: West Conshohocken, PA, USA, 2016. [Google Scholar]
  69. ASTM International. ASTM E1918-16, Standard Test Method for Measuring Solar Reflectance of Horizontal and Low-Sloped Surfaces in the Field; ASTM International: West Conshohocken, PA, USA, 2016. [Google Scholar]
  70. Akbari, H.; Levinson, R.; Berdahl, P. Cool materials rating instrumentation and testing. In Advances in the Development of Cool Materials for the Built Environment; Kolokotsa, D., Santamouris, M., Akbari, H., Eds.; Bentham Science Publishers: Oak Park, IL, USA, 2013; pp. 47–76. ISBN 978-1-60805-597-5. [Google Scholar]
  71. Mei, G.; Wu, B.; Ma, S.; Qin, Y. A simplified method for the solar reflectance of a finite surface in field. Measurement 2017, 110, 211–216. [Google Scholar] [CrossRef]
  72. Qin, Y.; Liang, J.; Tan, K.; Li, F. A side-by-side comparison of the cooling effect of building blocks with retro-reflective and diffuse-reflective walls. Sol. Energy 2016, 133, 172–179. [Google Scholar] [CrossRef]
  73. Rossi, F.; Castellani, B.; Presciutti, A.; Morini, E.; Filipponi, M.; Nicolini, A.; Santamouris, M. Retroreflective façades for urban heat island mitigation: Experimental investigation and energy evaluations. Appl. Energy 2015, 145, 8–20. [Google Scholar] [CrossRef]
  74. Pisello, A.L.; Goretti, M.; Cotana, F. A method for assessing buildings’ energy efficiency by dynamic simulation and experimental activity. Appl. Energy 2012, 97, 419–429. [Google Scholar] [CrossRef]
  75. Voogt, J.A.; Oke, T.R. Radiometric temperatures of urban canyon walls obtained from vehicle traverses. Theor. Appl. Climatol. 1998, 60, 199–217. [Google Scholar] [CrossRef]
  76. Johnson, G.T.; Watson, I.D. The Determination of View-Factors in Urban Canyons. J. Clim. Appl. Meteorol. 1984, 23, 329–335. [Google Scholar] [CrossRef]
  77. Krayenhoff, E.S.; Voogt, J.A. Daytime thermal anisotropy of urban neighbourhoods: Morphological causation. Remote Sens. 2016, 8, 108. [Google Scholar] [CrossRef]
  78. Adderley, C.A.; Christen, A.; Voogt, J.A. The effect of radiometer placement and view on inferred directional and hemispheric radiometric temperatures of an urban canopy. Atmos. Meas. Tech. Discuss. 2015, 8, 2699–2714. [Google Scholar] [CrossRef]
  79. Hénon, A.; Mestayer, P.G.; Lagouarde, J.P.; Voogt, J.A. An urban neighborhood temperature and energy study from the CAPITOUL experiment with the Solene model. Part 2: Influence of building surface heterogeneities. Theor. Appl. Climatol. 2012, 110, 197–208. [Google Scholar] [CrossRef]
  80. Christen, A.; Meier, F.; Scherer, D. High-frequency fluctuations of surface temperatures in an urban environment. Theor. Appl. Climatol. 2012, 108, 301–324. [Google Scholar] [CrossRef]
  81. Lagouarde, J.P.; Hénon, A.; Kurz, B.; Moreau, P.; Irvine, M.; Voogt, J.; Mestayer, P. Modelling daytime thermal infrared directional anisotropy over Toulouse city centre. Remote Sens. Environ. 2010, 114, 87–105. [Google Scholar] [CrossRef]
  82. Voogt, J.A. Assessment of an urban sensor view model for thermal anisotropy. Remote Sens. Environ. 2008, 112, 482–495. [Google Scholar] [CrossRef]
  83. Allen, M.A.; Voogt, J.A.; Christen, A. Time-Continuous hemispherical urban surface temperatures. Remote Sens. 2018, 10, 3. [Google Scholar] [CrossRef]
  84. Richards, J.A. Remote Sensing Digital Image Analysis, an Introduction, 5th ed.; Springer: Heidelberg, Germany, 2013; ISBN 978-3-642-30062-2. [Google Scholar]
  85. Kurz, T.H.; Buckley, S.J.; Howell, J.A. Close-range hyperspectral imaging for geological field studies: Workflow and methods. Int. J. Remote Sens. 2013, 34, 1798–1822. [Google Scholar] [CrossRef]
  86. Iqbal, F.; Lucieer, A.; Barry, K. Simplified radiometric calibration for UAS-mounted multispectral sensor. Eur. J. Remote Sens. 2018, 51, 301–313. [Google Scholar] [CrossRef]
  87. Del Pozo, S.; Rodríguez-Gonzálvez, P.; Hernández-López, D.; Felipe-García, B. Vicarious radiometric calibration of a multispectral camera on board an unmanned aerial system. Remote Sens. 2014, 6, 1918–1937. [Google Scholar] [CrossRef]
  88. Smith, G.M.; Milton, E.J. The use of the empirical line method to calibrate remotely sensed data to reflectance. Int. J. Remote. Sens. 1999, 20, 2653–2662. [Google Scholar] [CrossRef]
  89. Brest, C.L.; Goward, S.N. Deriving surface albedo measurements from narrow band satellite data. Int. J. Remote Sens. 2007, 8, 351–367. [Google Scholar] [CrossRef]
  90. Synnefa, A.; Santamouris, M.; Apostolakis, K. On the development, optical properties and thermal performance of cool colored coatings for the urban environment. Sol. Energy 2007, 81, 488–497. [Google Scholar] [CrossRef]
  91. Tetracam Inc. Agricultural Digital Camera (ADC) Specifications. 2016. Available online: www.tetracam.com (accessed on 25 November 2015).
  92. Del Pozo, S.; Sánchez-Aparicio, L.J.; Rodríguez-Gonzálvez, P.; Herrero-Pascual, J.; Muñoz-Nieto, A.; González-Aguilera, D.; Hernández-López, D. Multispectral imaging: Fundamentals, principles and methods of damage assessment in constructions. In Non-Destructive Techniques for the Evaluation of Structures and Infrastructure; Riveiro, B., Solla, M., Eds.; CRC Press: London, UK, 2016; pp. 139–166. ISBN 9781315685151. [Google Scholar]
  93. Corripio, J.G. Snow surface albedo estimation using terrestrial photography. Int. J. Remote Sens. 2004, 25, 5705–5729. [Google Scholar] [CrossRef]
  94. Pompilio, L.; Marinangeli, L.; Amitrano, L.; Pacci, G.; D’andrea, S.; Iacullo, S.; Monaco, E. Application of the empirical line method (ELM) to calibrate the airborne Daedalus-CZCS scanner. Eur. J. Remote Sens. 2018, 51, 33–46. [Google Scholar] [CrossRef]
  95. Berra, E.F.; Gaulton, R.; Barr, S. Commercial off-the-shelf digital cameras on unmanned aerial vehicles for multi-temporal monitoring of vegetation reflectance and NDVI. IEEE Trans. Geosci. Remote Sens. 2017, 55, 4878–4886. [Google Scholar] [CrossRef]
  96. Mathews, A.J. A practical UAV remote sensing methodology to generate multispectral orthophotos for vineyards: Estimation of spectral reflectance using compact digital cameras. Int. J. Appl. Geospace Res. 2015, 6, 65–87. [Google Scholar] [CrossRef]
  97. Stow, D.; Hope, A.; Nguyen, A.T.; Phinn, S.; Benkelman, C.A. Monitoring detailed land surface changes using an airborne multispectral digital camera system. IEEE Trans. Geosci. Remote Sens. 1996, 34, 1191–1203. [Google Scholar] [CrossRef]
  98. Wang, C.; Myint, S.W. A Simplified empirical line method of radiometric calibration for small unmanned aircraft systems-based remote sensing. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2015, 8, 1876–1885. [Google Scholar] [CrossRef]
  99. Herrero-Huerta, M.; Hernández-López, D.; Rodriguez-Gonzalvez, P.; González-Aguilera, D.; González-Piqueras, J. Vicarious radiometric calibration of a multispectral sensor from an aerial trike applied to precision agriculture. Comput. Electron. Agric. 2014, 108, 28–38. [Google Scholar] [CrossRef]
  100. Honkavaara, E.; Arbiol, R.; Markelin, L.; Martinez, L.; Cramer, M.; Bovet, S.; Chandelier, L.; Ilves, R.; Klonus, S.; Marshal, P.; et al. Digital airborne photogrammetry—A new tool for quantitative remote sensing?—A state-of-the-art review on radiometric aspects of digital photogrammetric images. Remote Sens. 2009, 1, 577–605. [Google Scholar] [CrossRef]
  101. Zaman, B.; Austin, J.; Clemens, S.; McKee, M. Retrieval of spectral reflectance of high-resolution multispectral imagery acquired with an autonomous unmanned aerial vehicle: Aggieair™. Photogramm. Eng. Remote Sens. 2014, 80, 1139–1150. [Google Scholar] [CrossRef]
  102. Laliberte, A.S.; Goforth, M.A.; Steele, C.M.; Rango, A. Multispectral remote sensing from unmanned aircraft: Image processing workflows and applications for rangeland environments. Remote Sens. 2011, 3, 2529–2551. [Google Scholar] [CrossRef]
  103. Mei, A.; Bassani, C.; Fortinovo, G.; Salvatori, R.; Allegrini, A. The use of suitable pseudo-invariant targets for MIVIS data calibration by the empirical line method. ISPRS J. Photogramm. Remote Sens. 2016, 114, 102–114. [Google Scholar] [CrossRef]
  104. Gaitani, N.; Burud, I.; Thiis, T.; Santamouris, M. High-resolution spectral mapping of urban thermal properties with Unmanned Aerial Vehicles. Build. Environ. 2017, 121, 215–224. [Google Scholar] [CrossRef]
  105. Qin, Y.; Liang, J.; Tan, K.; Li, F. The amplitude and maximum of daily pavement surface temperature increase linearly with solar absorption. Road Mater. Pavement Des. 2017, 18, 440–452. [Google Scholar] [CrossRef]
  106. Kolokotsa, D.D.; Giannariakis, G.; Gobakis, K.; Giannarakis, G.; Synnefa, A.; Santamouris, M. Cool roofs and cool pavements application in Acharnes, Greece. Sustain. Cities Soc. 2018, 37, 466–474. [Google Scholar] [CrossRef]
  107. Qin, Y. A review on the development of cool pavements to mitigate urban heat island effect. Renew. Sustain. Energy Rev. 2015, 52, 445–459. [Google Scholar] [CrossRef]
  108. Pisello, A.L.; Castaldo, V.L.; Piselli, C.; Fabiani, C.; Cotana, F. Thermal performance of coupled cool roof and cool façade: Experimental monitoring and analytical optimization procedure. Energy Build. 2017, 157, 35–52. [Google Scholar] [CrossRef]
  109. Zinzi, M. Exploring the potentialities of cool facades to improve the thermal response of Mediterranean residential buildings. Sol. Energy 2016, 135, 386–397. [Google Scholar] [CrossRef]
  110. Zinzi, M. Characterisation and assessment of near infrared reflective paintings for building facade applications. Energy Build. 2016, 114, 206–213. [Google Scholar] [CrossRef]
  111. Rossi, F.; Pisello, A.L.; Nicolini, A.; Filipponi, M.; Palombo, M. Analysis of retro-reflective surfaces for urban heat island mitigation: A new analytical model. Appl. Energy 2014, 114, 621–631. [Google Scholar] [CrossRef]
  112. Hernández-Pérez, I.; Álvarez, G.; Xamán, J.; Zavala-Guillén, I.; Arce, J.; Simá, E. Thermal performance of reflective materials applied to exterior building components—A review. Energy Build. 2014, 80, 81–105. [Google Scholar] [CrossRef]
  113. Georgakis, C.; Zoras, S.; Santamouris, M. Studying the effect of “cool” coatings in street urban canyons and its potential as a heat island mitigation technique. Sustain. Cities Soc. 2014, 13, 20–31. [Google Scholar] [CrossRef]
  114. Fiorito, F.; Santamouris, M. High performance technologies and the future of architectural design. TECHNE J. Technol. Archit. Environ. 2017, 80, 72–76. [Google Scholar] [CrossRef]
  115. Sung, D. A New Look at Building Facades as Infrastructure. Engineering 2016, 2, 63–68. [Google Scholar] [CrossRef]
  116. Libbra, A.; Muscio, A.; Siligardi, C. Energy performance of opaque building elements in summer: Analysis of a simplified calculation method in force in Italy. Energy Build. 2013, 64, 384–394. [Google Scholar] [CrossRef]
  117. Halawa, E.; Ghaffarianhoseini, A.; Ghaffarianhoseini, A.; Trombley, J.; Hassan, N.; Baig, M.; Yusoff, S.Y.; Ismail, M.A. A review on energy conscious designs of building façades in hot and humid climates: Lessons for (and from) Kuala Lumpur and Darwin. Renew. Sustain. Energy Rev. 2018, 82, 2147–2161. [Google Scholar] [CrossRef]
  118. Castaldo, V.L.; Pisello, A.L.; Piselli, C.; Fabiani, C.; Cotana, F.; Santamouris, M. How outdoor microclimate mitigation affects building thermal-energy performance: A new design-stage method for energy saving in residential near-zero energy settlements in Italy. Renew. Energy 2018, 127, 920–935. [Google Scholar] [CrossRef]
  119. Lamarca, C.; Quense, J.; Henríquez, C. Thermal comfort and urban canyons morphology in coastal temperature climate, Conception, Chile. Urban Clim. 2018, 23, 159–172. [Google Scholar] [CrossRef]
  120. Song, D.; Han, S. The Analysis of Reactive Factors between Architectural Envelop Condition and Urban Microclimate. Procedia Eng. 2016, 169, 125–132. [Google Scholar] [CrossRef]
  121. Garuma, G.M. Review of urban surface parameterizations for numerical climate models. Urban Clim. 2017, 24, 830–851. [Google Scholar] [CrossRef]
  122. Bozonnet, E.; Musy, M.; Calmet, I.; Rodriguez, F. Modeling methods to assess urban fluxes and heat island mitigation measures from street to city scale. Int. J. Low-Carbon Technol. 2015, 10, 62–77. [Google Scholar] [CrossRef]
  123. Best, M.J.; Grimmond, C.S.B. Key conclusions of the first international urban land surface model comparison project. BAMS 2015, 96, 805–819. [Google Scholar] [CrossRef]
  124. Velasco, E. Go to field, look around, measure and then run models. Urban Clim. 2018, 24, 231–236. [Google Scholar] [CrossRef]
  125. Page, J.K. The fundamental problems of building climatology considered from the point of view of decision-making by the architect or urban designer. In Building Climatology, Proceedings of the Symposium on Urban Climates and Building Climatology; WMO Technical Note 10; WHO: Switzerland, Geneva, 1968; Volume 2, pp. 9–21. [Google Scholar]
  126. Barlow, J.; Best, M.; Bohnenstengel, S.I.; Clark, P.; Grimmond, S.; Lean, H.; Christen, A.; Emeis, S.; Haeffelin, M.; Harman, I.N. Developing a research strategy to better understand, observe and simulate urban atmospheric processes at kilometre to sub-kilometre scales. BAMS 2017, 98, ES261–ES264. [Google Scholar] [CrossRef]
  127. Australian Government Civil Aviation Safety Authority. CASR Part 101—Unmanned Aircraft and Rockets. Available online: https://www.casa.gov.au/standard-page/casr-part-101-unmanned-aircraft-and-rocket-operations (accessed on 2 April 2018).
  128. Willmott, C.J. On the validation of models. Phys. Geogr. 1981, 2, 184–194. [Google Scholar] [CrossRef]
  129. Willmott, C.J. Some comments on the evaluation of model performance. BAMS 1982, 63, 1309–1313. [Google Scholar] [CrossRef]
  130. Labsphere Inc. 8°/Hemispherical Reflectance Multi-Step Target Certificate; Serial number MS050-0916-6020; Labsphere Inc.: North Sutton, NH, USA, 2016. [Google Scholar]
  131. Geoscience Australia, Commonwealth of Australia. Available online: http://www.ga.gov.au/geodesy/astro/smpos.jsp (accessed on 3 June 2017).
  132. Baugh, W.M.; Groeneveld, D.P. Empirical proof of the empirical line. Int. J. Remote Sens. 2008, 29, 665–672. [Google Scholar] [CrossRef]
  133. PixelWrench II, Proprietary Image Editing Software, version 1.2.1.8; Tetracam Inc.: Chatsworth, CA, USA, 2015.
  134. Huang, Y.; Thomson, S.J.; Lan, Y.; Maas, S.J. Multispectral imaging systems for airborne remote sensing to support agricultural production management. Int. J. Agric. Biol. Eng. 2010, 3, 50–62. [Google Scholar] [CrossRef]
  135. Honkavaara, E.; Hakala, T.; Peltoniemi, J.; Suomalainen, J.; Ahokas, E.; Markelin, L. Analysis of properties of reflectance reference targets for permanent radiometric test sites of high resolution airborne imaging systems. Remote Sens. 2010, 2, 1892–1917. [Google Scholar] [CrossRef]
  136. Moran, M.S.; Bryant, R.; Thome, K.; Ni, W.; Nouvellon, Y.; Gonzalez-Dugo, M.P.; Qi, J.; Clarke, T.R. A refined empirical line approach for reflectance factor retrieval from Landsat-5 TM and Landsat-7 ETM+. Remote Sens. Environ. 2001, 78, 71–82. [Google Scholar] [CrossRef]
  137. Willmott, C.J.; Ackleson, S.G.; Davis, R.E.; Feddema, J.J.; Klink, K.M.; Legates, D.R.; O’donnell, J.; Rowe, C.M. Statistics for the evaluation and comparison of models. J. Geophys. Res. 1985, 90, 8995–9005. [Google Scholar] [CrossRef]
  138. Piñeiro, G.; Perelman, S.; Guerschman, J.P.; Paruelo, J.M. How to evaluate models: Observed vs. predicted or predicted vs. observed? Ecol. Model. 2008, 216, 316–322. [Google Scholar] [CrossRef]
  139. Willmott, C.J.; Matsuura, K. Advantages of the mean absolute error (MAE) over the root mean square error (RMSE) in assessing average model performance. Clim. Res. 2005, 30, 79–82. [Google Scholar] [CrossRef]
  140. Hyslop, N.P.; White, W.H. Estimating Precision Using Duplicate Measurements. J. Air Waste Manag. Assoc. 2009, 59, 1032–1039. [Google Scholar] [CrossRef] [PubMed]
  141. Smith, E.P.; Rose, K.A. Model goodness-of-fit analysis using regression and related techniques. Ecol. Model. 1995, 77, 49–64. [Google Scholar] [CrossRef]
  142. Chen, P.Y.; Popovich, P.M. Correlation: Parametric and Non-Parametric Measures; Sage University Paper Series on Quantitative Applications in the Social Sciences, Series No. 07-139; Sage: Irvine, CA, USA, 2002; ISBN 0761922288. [Google Scholar]
  143. Lewis-Beck, M.S. Data Analysis, an Introduction; Sage University Paper Series on Quantitative Applications in the Social Sciences, Series No. 07-103; Sage: Irvine, CA, USA, 1995; ISBN 0803957726. [Google Scholar]
  144. Gibbons, J.D. Nonparametric Statistics: An Introduction; Sage University Paper Series on Quantitative Applications in the Social Sciences, Series No. 07-090; Sage: Irvine, CA, USA, 1993; ISBN 0803946643. [Google Scholar]
  145. Hueni, A.; Damm, A.; Kneubuehler, M.; Schlapfer, D.; Schaepman, M.E. Field and airborne spectroscopy cross validation—Some considerations. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2017, 10, 1117–1135. [Google Scholar] [CrossRef]
  146. Zinzi, M.; Carnielo, E.; Rossi, G. Directional and angular response of construction materials solar properties: Characterisation and assessment. Sol. Energy 2015, 115, 52–67. [Google Scholar] [CrossRef]
  147. Dangel, S.; Verstraete, M.M.; Schopfer, J.; Kneubuhler, M.; Schaepman, M.; Itten, K.I. Toward a direct comparison of field and laboratory goniometer measurements. IEEE Trans. Geosci. Remote Sens. 2005, 43, 2666–2675. [Google Scholar] [CrossRef]
  148. Del Pozo, S.; Herrero-Pascual, J.; Felipe-García, B.; Hernández-López, D.; Rodríguez-Gonzálvez, P.; González-Aguilera, D. Multispectral radiometric analysis of façades to detect pathologies from active and passive remote sensing. Remote Sens. 2016, 8, 80. [Google Scholar] [CrossRef]
  149. Honkavaara, E. Calibrating Digital Photogrammetric Airborne Imaging Systems Using a Test Field. Ph.D. Thesis, University of Technology Espoo, Espoo, Finland, 2008. [Google Scholar]

Article Metrics

Citations

Article Access Statistics

Multiple requests from the same IP address are counted as one view.