4.2. Data Re-Assessment
The images were re-investigated and grouped into categories relating to sun glint and time differences between acquisitions. The 18 match-ups at LJCO and the three in north west Australia have quite different waters and environments, as well as instruments and processing methods used. The north west of Western Australia data have been adequately discussed in [
23] and only the LJCO match-up site has
AOD550 and Ångström slope observations from AERONET. Therefore, only the internally consistent LJCO time series is used in this final analysis. The LJCO site can have quite severe sun glint, especially during mid-summer, when the satellite sensor is viewing more towards the sun glint field. The maximum sun glint statistic (see
Appendix A for its calculation) was helpful in assessing images for potential sun glint. The statistic arises because for every situation of given sun and sensor view angles (
θS, θV, ϕ), considered as a function of wind speed, there is a “maximum sun glint”. The wind speed at which it occurs can be called the “maximum wind speed”. For wind speeds less than or greater than the maximum case, the sun glint level is lower. For low sun glint cases, (e.g., in winter scenes), the wind speed at which maximum sun glint occurs is large. When the maximum sun glint is high, the wind speed corresponding to it is always small (including commonly occurring speeds). Maximum sun glint does not depend on wavelength, but only on the relative satellite and sun geometries as well as wind speed.
Figure 4 and
Table 4 show the computed maximum sun glints and wind speeds for the 18 Landsat images for the LJCO match-up site based on the sun and view angles at the time of data acquisition.
Table 4 also includes an estimate for sun glint, which is obtained by averaging the surface reflectance of two SWIR bands after removing the sky glint for these bands
and
in Equation (12)). This is because, for the SWIR bands,
ρw should be close to zero and the fraction of direct sun radiation is
.
There is a wide spread of sun glint levels and the highest values all occur near to December (Austral summer, see
Figure 4 and
Table 4 for details) when the sun is south of the latitude of Lucinda. The lowest values in almost for all cases are in Austral winter. One value reaches the maximum sun glint, but it is a rare occurrence.
Figure 4b shows the relationship between maximum sun glint and maximum wind (m/s). In winter, the maximum sun glint is only obtained with very rough waters (
Figure 4b and
Table 4) and is possibly never achieved, since the wind speed to reach maximum sun glint could be as high as 45 m/sec. In summer, normally occurring wind speeds (e.g., 7–10 m/s) flare the sun glint and wind speeds as low as 5 m/s can create the (high) maximum sun glint. Some cases (e.g., cases 6 and 18) occur where the estimated sun glint is much lower (e.g., less than 200) than the maximum (e.g., more than 400). It probably means that the local wind speed is either much lower or possibly greater than the maximum wind. Cases where wind speed is above the maximum wind can be hard to process, as the image of the water surface may be rough but dull. Both situations seem to occur at LJCO.
Table 1 shows that there were no cases where the SeaPRISM data were measured at the time of the Landsat morning overpass (approximately 10 a.m. local time in Australia). Most were 3.5–4.5 h later in the early afternoon. This occurred because of the limitations previously described in
Section 3.1 for the SeaPRISM to sample suitable water areas in the morning due to the Jetty infrastructure. However, it is quite significant for the re-analysis. The Landsat samples were assessed for potential sun glint in the Landsat data using the maximum sun glint at the overpass time. Taking into account the time difference between acquisition of satellite data and surface observations, maximum sun glint, the SWIR values and visual assessment, it is found that there are: (i) three cases with time difference between image and in situ data > 6 h (maximum > 7 h); (ii) six cases of low sun glint; (iii) six cases of medium sun glint (one medium/low); (iv) three cases of very high sun glint,; and (v) one anomalous image (very different, case 16) which is already among the low sun glint cases.
The statistics for the match-up are valid, despite the time difference, if the water mass remains stable and does not change significantly between the two observations. Three samples with time differences of more than 6 h (later than 4 p.m. local time) have been removed from the further assessment of aerosol and sun glint. The first one of these (case 1) in
Table 4 was a totally different water signature (the high AOD and Ångström data in
Table 2 also indicated a possible wide area dust storm), although the other two are quite well aligned. It is unwise to remove samples only because the values are “very different”. So, in this study, it is reasonable not to use data when ΔT > 6 h. For the others, it seems that they are the same water mass, although their values can be different within the natural variation of the water mass and may sometimes be extreme. The six low sun glint cases are important data. They are not as confounded by the sun glint as are the others. The three very high sun glint cases only provided a small sample, but they were still valuable to use in order to compare the effect of sun glint strategies in more extreme cases. One “anomalous” sample (case 16) was eventually removed for the comparisons, as it had a normal shape but very low values indicating a big change between acquisitions. It was a low sun glint case, so that the number of low sun glint samples retained was only five. Overall, however, the remaining 14 cases form a very good set of samples with different strengths, sun glint conditions and a range of values for comparison.
The 14 images were re-analyzed using the three options of aerosol processing listed in
Table 3 (versions 4, 5 and 6 with sun glint corrected). The two sun glint estimations of Equations (13) and (14) were used to provide de-trending for the models.
Table 5 lists four different sun glint strategies based on the two primary methods.
The cases Gs1_av and Gs2_av are primarily used to analyze the different aerosol strategies of
Table 3 with a common sun glint correction. Gs1 and Gs2 have three different sun glint correction results, each corresponding to aerosol differences, and are best used for comparisons between match-up accuracy and sun glint correction. The average is used for aerosol comparisons as the individual estimates in Gs1 and Gs2 can vary with aerosol type and parameters. To establish the link to the initial results,
Figure 3f corresponds to using the Gs1 strategy and the AERONET aerosol data.
The results from using the Gs1_av and Gs2_av sun glint strategies are shown in
Figure 5. The statistics for
Figure 5 are provided in
Table 6 by regressing the Landsat data on the SeaPRISM data over all bands. In
Table 6, offset and slope are the parameters of a linear regression (not the 1-1 line). A significant difference from zero offset and/or slope of 1.0 indicates bias. The column labelled “R2_adj” is adjusted R-squared correlation. NSR is 100/sqrt(F) where F is the F-ratio in the analysis of variance for the regression. In the same way as the adjusted R-squared, F and NSR are adjusted for degrees of freedom [
51]. NSR is the ratio of the RMS error to the RMS model and is used here as an estimate of percent error as zero and negative values can occur from path radiance and sun glint corrections. Finally, the last column labelled “SE” is the standard error of the regression.
The Gs1_av resulted in quite high offsets indicating bias; R2-adj values are less than 0.9 and there are relatively high NSR (5%) and SE (56) values. This result is equivalent to the closest results in
Figure 3d–f. The differences here are that these statistics have been based only on LJCO data with the few extreme points removed. However, the results of the Gs2_av are all significantly better than those of the Gs1_av in each statistic. The NSR (3.8%) and SE (39.2) for the best performing aerosol strategy, AERONET, represent less than 0.4% absolute reflectance (i.e., 0.004 reflectance or 0.00127
sr−1 Rrs) in SE, or 3.8% relative error as estimated by NSR. The Gs2_av sun glint strategy also shows clearer distinctions between the aerosol strategies. AERONET is best (
Table 6), which is what might be expected. The ANN and GA climatology are not as close, but still performed well.
If the AERONET case is used to look at the potential accuracy of the sun glint estimates, it is only necessary to compare the results for the two base sun glint strategies, Gs1 and Gs2. However, as Gs1_av is equivalent to the best matching result in the match-up project result in
Figure 3f, it is included as a basis for comparison. As was the case before, using the AERONET information makes extrapolating the results to other situations conditional on having good aerosol information. The results are plotted in
Figure 6 and the resulting statistics listed in
Table 7. It is clear that Gs1_av and Gs1 provide lower accuracy than Gs2, with Gs2 (red diamonds) as overall the best result. Gs1_av and Gs1 clearly have a higher bias offset value.
The best result in SE for Gs2 represents a difference (SE) between Landsat 8 and the SeaPRISM values of less than 0.004 reflectance or 0.00127 sr−1 Rrs estimated over the 14 overpasses. The NSR of 3.76% is a degrees-of-freedom-adjusted estimate for the percent error, and is also small in comparison to the other error budgets. However, as the data sieving would have lowered this estimate, an estimate based on 17 samples, with only the first sample removed, was computed, and this resulted in a SE of 0.0044 or NSR of 4.0%. It has been used to report the best statistical fit to data. The final results also include the independent natural variation in the water mass, as none of the LJCO match-ups are for SeaPRISM data collected at the same time as the Landsat overpass. The inevitable differences between the Landsat and SeaPRISM data sets means the “fit” needs to be statistical, rather than case by case, for each match-up.
The SeaPRISM data were all observed in the afternoon of local time. As previously discussed, the first match-up sample was 7.6 h different, and was a quite different water mass. As the LJCO site is a dynamic tidal mixing area between the coastal and estuarine land side and the open waters of the GBR lagoon, match-up samples were carefully selected. The continuous in-water absorption and scattering optical measurements, including sea and sky webcam imagery at this site, allow an assessment of water mass stability and, therefore, stability of the radiometric observations even at larger time differences. However, taking into account uncertainties from calibration, data processing and environmental perturbations, it has been estimated by [
52] that the SeaPRISM uncertainty is 4–5% in the blue and green bands at 443 and 555 nm, respectively, and around 10% at 665 nm. These findings indicate that the accuracy limits with which marine reflectance can be estimated from the Landsat observations at this site have been reached.
It seems that the significant differences in offset bias between the statistics for strategies Gs1 and Gs2 are from the same source as the bias in
Figure 3. To isolate the source and nature of the differences, it is useful to consider average results for the match between Gs1 and Gs2 and the SeaPRISM average data (
Figure 7). Three groups of averages have been taken. The first is over all of the 14 values used in the previous statistics (
Figure 7a). The second is over five low sun glint cases, plus the mid-low sun glint (
Figure 7b) and the third is over three high sun glint cases (
Figure 3c). The
Figure 7a shows a systematic bias for the average of case Gs1 compared with the SeaPRISM average. The difference is likely to be the systematic trend seen in the match-up data. The difference is not “nature” as it is too systematic to be random. It also appears similar in shape to the fraction of diffuse radiation. In the case of Gs2, the difference is small and not as systematic. The match between means shows that the result for Gs2 in
Figure 7a is close to unbiased. This is an important observation as, because of the time differences between observations, there will be unavoidable “random” differences at each specific match-up event that could only be reduced in averaging.
Figure 7b shows the average results of six low sun glint cases. Low sun glint does not mean that there is no sun glint, but most are low in both the SWIR and the maximum sun glint statistic. The Gs1 and Gs2 “corrections” were used for the six (days) samples which resulted in signatures that appear to be a little too low due to the forcing of the mean SWIR to zero. There is little difference between applying Gs1 and Gs2, and the systematic bias observed in
Figure 7a with Gs1 is not present.
Figure 7b also plots another case called “No_sunglint”. This has no sun glint removed and is a little higher than the SeaPRISM data, indicating that some of the samples have some sun glint, albeit small. It also indicates that atmospheric correction is effective even though sun glint correction may need some adjustments in low sun glint situations. For the three high sun glint cases, the averages over the three days are shown in
Figure 7c. In
Figure 7c, the Gs1 bias is much higher than that in
Figure 7a but the Gs2 result is similar to that in
Figure 7a. Three samples are too small to obtain the stability of
Figure 7a but
Figure 7c certainly shows that the bias is systematic and persistent in shape.
Table 8 lists the statistics of the difference between the estimates and the SeaPRISM observations for each of the cases. The mean, RMS and correlation for the “all” and the “high” cases using the Gs1 strategy have large values for each statistic. To achieve some perspective on size, for land targets, a value of 10 (0.1% absolute reflectance or 0.001) is sometimes regarded as almost zero and 20 is very small. Gs1 has a bias significantly correlated with the diffuse fraction. The accuracy of the match-up for Gs2 in all of the studies indicates the underlying accuracy of the atmospherically corrected product – provided sun glint is handled effectively and aerosol is well chosen.
In
Table 8, the strong correlation between the “all” samples fraction of diffuse radiation and Gs1 indicates that the shape of systematic bias is that of the diffuse radiation. This means that the bias is likely in the estimate for the sky glint component of the equations and the RMS indicates it is also likely correlated in magnitude with the sun glint.