Comparison and Validation of Long Time Serial Global GEOV 1 and Regional Australian MODIS Fractional Vegetation Cover Products Over the Australian Continent

Fractional vegetation cover (FVC) is one of the most critical parameters in monitoring vegetation status. Comprehensive assessment of the FVC products is critical for their improvement and use in land surface models. This study investigates the performances of two major long time serial FVC products: GEOV1 and Australian MODIS. The spatial and temporal consistencies of these products were compared during the 2000–2012 period over the main biome types across the Australian continent. Their accuracies were validated by 443 FVC in-situ measurements during the 2011–2012 period. Our results show that there are strong correlations between the GEOV1 and Australian MODIS FVC products over the main Australian continent while they exhibit large differences and uncertainties in the coastal regions covered by dense forests. GEOV1 and Australian MODIS describe similar seasonal variations over the main biome types with differences in magnitude, while Australian MODIS exhibit unstable temporal variations over grasslands and shifted seasonal variations over evergreen broadleaf forests. The GEOV1 and Australian MODIS products overestimate FVC values over the biome types with high vegetation density and underestimate FVC in sparsely vegetated areas and grasslands. Overall, the GEOV1 and Australian MODIS FVC products agree with in-situ FVC values with a RMSE around 0.10 over the Australian continent. OPEN ACCESS Remote Sens. 2015, 7 5719


Introduction
Fractional vegetation cover (FVC), as first introduced by Deardorff [1], is defined as the percentage of the vertical projected area of vegetation (including leaves, stems and branches) within the total statistical area [2].It characterizes the horizontal density of live vegetation and vegetation quality [3].FVC is an important element in vegetation monitoring [4], numerical weather prediction [5], regional and global climate modeling [6]and global change monitoring [7].Accurate estimation of FVC is important for modeling earth system processes.
Current remote sensing FVC products are summarized in [8] over the regional and global scales.Several FVC data sets have been produced from NOAA/AVHRR including that of [3,5] and [7].More recently, two global FVC products have been derived from SPOT/VEGETATION: CYCLOPES from 1999 to 2007 [9] and GEOV1/BioPar from December 1998 to May 2014 [10].Other FVC data sets have been produced for a limited period of time including one derived from Polarization and Directionality of the Earth's Reflectances (ADEOS/POLDER)during the period 1996-1997, 2003 [4,11].Although having a limited spatial coverage, Spinning-Enhanced Visible and Infrared Imager (MSG/SEVIRI) sensors deliver operationally in Land-SAF FVC over Africa and Europe for the period of 2006-2013 [12].European FVC product has been generated from Medium Resolution Imaging Spectrometer (ENVISAT/MERIS) since 2003 [13].Australian fractional covers of bare soil (BS), photosynthetic vegetation (PV) and nonphotosynthetic vegetation (NPV) have been delivered from MODIS/Terra from 2000 to now.
To properly use the FVC products in further studies, the assessment of the accuracies and uncertainties among them is crucial.The Committee Earth Observing Satellite (CEOS) established the Land Product Validation Subgroup (LPV), which was mandated to define standard guidelines and protocols to validate land products.Direct validation, comparing satellite products with in-situ measurements, is restricted by the existing validation data sets, which are limited in time and space for the time-consuming procedures of ground measurements [14].On the contrary, the comparison of different products contributes to the evaluation of the temporal and spatial consistency among products over a number of representative sites avoiding the need for concurrent ground data sets.The combination of comparison and validation of remote sensing products provides a comprehensive understanding of the FVC products for users and developers, leading to improvement in product accuracy.
Previous comparison and validation activities mainly focus on LAI and FAPAR products at the regional scale or global scale [14][15][16][17][18]. Independent comparison and validation of FVC products are currently limited to few products over relatively short periods of time or limited regions [19][20][21].Studies indicate that CYCLOPES showed a systematic underestimation of ground data over Europe and Africa [19,21].The CYCLOPES and GEOV1 FVC products showed consistent temporal variations, with CYCLOPES systematically lower than GEOV1 during the 2003-2005 periods [20].GEOV1 FVC agreed with the ground measurements, yet there was some dispersion for intermediate values [20].GEOV1 FVC generally overestimated FVC by up to 0.2 compared with the reference FVC over croplands [22].A simple comparison with in-situ measurements of six VALERI sites illustrated that MERIS FVC provided a good estimation of FVC with a RMSE of 0.098 over Europe [23].In general, most of the FVC validation work was coupled with the validation of LAI or FAPAR without extensive and independent investigations [20,24].Moreover, the FVC validations were mostly carried out in Europe or Africa [19,21].The accuracies and uncertainties of FVC products in other regions still require validation.Regional scale FVCs have been developed for regional application [25,26].The Australian MODIS FVC product consists of the fractional covers of three end-member classes: PV, NPV and BS, which are derived from the normalized difference vegetation index (NDVI) and cellulose absorption index (CAI) which is sensitive to dry/woody vegetation matter [26].FVC products have been used in a number of applications including land-surface processes, climate change, numerical weather predictions, natural resource management and so on [5].All these application require FVC products with typical target accuracy around 0.05 (RMSE).
The objective of this paper is to evaluate the global GEOV1 and regional Australian MODIS FVC products, across the Australian continent.The spatial variations and the temporal consistencies of GEOV1 and Australian MODIS will be investigated during the 2000-2012 period over a series of homogeneous and representative sites selected based on the GlobeCover 2009 land cover map.The uncertainties of the GEOV1 and Australian MODIS FVC products will be validated using an extensive database of in-situ Australian FVC during the 2011-2012 period.

The GEOV1 FVC and the Australian MODIS FVC Products
The GEOV1 FVC product is available in open access through the GEOV1 web portal (http://www.GEOV1.eu).This product is derived from the SPOT-VEGETATION sensor at 1/112° spatial sampling interval and at 10-day frequency, in a Plate Carr é projection for the period 1999-May 2014.The GEOV1 FVC algorithm relies on neural network trained to generate the "best estimates" of FVC obtained by scaling the CYCLOPES FVC product [9].The input data of the neural network are top of canopy normalized reflectances.Studies show that the GEOV1 FVC product presents reliable spatial distribution and smooth temporal profiles over the 32 sites of BELMAIP-2 (Benchmark Land Multisite Analysis and Intercomparison of Products-2) site during the period 2003-2005 [21].The GEOV1 FVC product shows a very strong linear correlation with the CYCLOPES FVC product and overcomes the significant bias in the CYCLOPES FVC product [21].
The Australian MODIS FVC V3.0.1 product is developed by the Environmental Earth Observation Group, CSIRO land and Water and can be downloaded from http://www-data.wron.csiro.au/rs/MODIS/products/Guerschman_etal_RSE2009/data.The product is derived from the Terra-MODIS satellite data.The FVC was estimated using a linear unmixing approach involving NDVI and CAI.Regression analysis found an alternate index for the CAI in the simple ratio of MODIS bands 7 (~2100 nm) and 6 (~1650 nm) that is sensitive to spectral characteristics of dry/woody vegetation matter in the short-wave infrared (SWIR) spectral region [26].The NDVI and the simple ratio of MODIS bands 7 and 6 were used to generate fraction cover of PV, NPV and BS from MODIS nadir bidirectional reflectance distribution function-adjusted reflectance data.This methodology was originally developed for the Australian tropical savannas and validated against grass curing measurements.
The main characteristics of the GEOV1 and Australian MODIS FVC products are summarized in Table 1.The spatial variations and the temporal consistencies of the GEOV1 and Australian MODIS FVC were compared during 2000-2012.Validations of the GEOV1 and Australian MODIS products were performed for the period of 2011-2012, which corresponded to the full period of availability of the in-situ FVC.Previous studies suggested comparing remote sensing products at a substantially larger spatial resolution than their native resolutions to reduce potential coregistration errors among products [15,27].In this study, the FVC data sets were first mosaicked and then resampled to a 0.05° spatial resolution using the mean filter in the Plate Carr é projection.The FVC data sets were aggregated into a monthly time step using the averaging method for the FVC products have different temporal compositing periods, which enabled the comparisons of the products.The GEOV1 and Australian MODIS FVC data sets with original resolutions were validated by the in-situ measurements.Note: VGT, ANN, CYC, NDVI and CAI stand for "VEGETATION", "artificial neural network", "CYCLOPES", "Normalized vegetation index", and "cellulose absorption index" respectively.

Australian Ground FVC Database
An extensive database of ~400 FVC estimates across Australia was obtained from the Australian Bureau of Agricultural and Resource Economics and Sciences (Figure 1) during the period 2011-2012.The data set consists of estimates of PV, NPV and BS cover at three defined vegetation levels: Ground cover, mid-story vegetation and over-story vegetation.Typical sampling areas were 100 m × 100 m.The presence/absence of PV, NPV or BS along a transect at 1 m intervals was determined for each vegetation level.Exposed cover was the first cover seen when looking down on the transect point and estimated the view seen by the satellite.In this study, we only used the exposed cover of PV.Detailed introductions of the sampling strategy applied were described in [18,28,29].The in-situ exposed cover of PV was used to validate the GEOV1 and Australian MODIS FVC products.

Evaluating Units
The main biome types over the Australian continent are rainfed croplands (RC), closed to open broadleaved evergreen forest (COBEF), open broadleaved deciduous forest (OBDF), closed to open shrubland (COS), closed to open grassland (COG), and sparse vegetation (SV).Six evaluating units corresponding to the above biome types were determined.Each evaluating unit was composed of 10 homogeneous sites which were manually selected based on the Glob Cover 2009 land cover map with a spatial resolution of 0.003° [30] and uniformly distributed over the biome types to represent the regional variability.Each site had an area of 0.15° × 0.15° (Figure 1).The spatial and temporal variations of FVC over Australia were investigated based on these six evaluating units.

Comparison Metrics
Three statistical indicators were computed between the GEOV1 FVC product (FVCGEO) and Australian MODIS FVC product (FVCAus) over the common period of 2000-2012.The Pearson correlation coefficient (R), the mean difference (Bias) and the root mean squared error (RMSE) were calculated.The equations for the calculation of the three indicators are as follows [31]: where the overbar denotes the mean operator, and n is the number of FVC data.

Spatial Variations
Figure 2a shows the annual mean derived from the Australian MODIS FVC product for the period 2000-2012.The features in Figure 2a 2b-d.Figure 2b shows that robust positive correlations between GEOV1 and Australian MODIS are found over most of the Australian continent.Weak correlation (R < 0.2) is depicted over the Western Plateau and the eastern coastal area.This is partly because the algorithm of the Australian MODIS FVC product was developed in northern Australia which is mainly covered by medium to high vegetation cover [26].The spatial distributions of bias and RMSE between GEOV1 and Australian MODIS are similar.Low bias and RMSE values are found in in the Central Australia and Western Plateau drainage basins.Australian MODIS provides much larger FVC estimations than GEOV1 over the northern and eastern coast of Australia.The RMSE between Australian MODIS and GEOV1 is also higher over there than over other regions.Previous study shows that GEOV1 provides lower values over the dense forests with large differences [20].

Biome Types Consistency
The following scatterplots are used to assess the consistencies between the FVC products, which are generated over the six evaluating units, using the mean values of each evaluating unit from the months of the 2000-2012 period, for the main biome types over the Australian continent (Figure 3).
Australian MODIS provides larger FVC estimates than GEOV1 over all the biome types.No significant scattering (low SD) is observed between these FVC products.GEOV1 and Australian MODIS are better correlated over RC and COS with higher R 2 values than over other biome types.Relatively low biases are observed between GEOV1 and Australian MODIS (B = 0.04 for RC and 0.05 for COS).Similar agreement is achieved for these two biome types (RMSE = 0.09 for RC and 0.08 for COS).
The comparison between GEOV1 and Australian MODIS provides low agreement over COBEF and OBDF (RMSE = 0.09 for COBEF and RMSE = 0.11 for OBDF) with relatively high biases (B = 0.06 for COBEF and 0.10 for OBDF) mainly coming from the lower GEOV1 FVC values over dense forests [20].
Over COG and SV, the best agreements between GEOV1 and Australian MODIS are reached with the lowest RMSE (RMSE = 0.06 for COG and 0.07 for SV).Australian MODIS shows relatively low correlations with GEOV1 over SV (R 2 = 0.46).This may be due to the fact that the Australian MODIS FVC algorithm was proposed over the Australian tropical savanna region, which introduces differences in the FVC estimations over sparsely vegetated areas with substantial sub-pixel heterogeneity [26].Over RC, the GEOV1 and Australian MODIS FVC products show similar seasonal variations, however, with differences in magnitude.The peak values of GEOV1 are higher than Australian MODIS and the valley values are lower than Australian MODIS.The peak values are captured in September for the cultivation of winter crops.These two products properly capture interannual variability.Similar temporal variations are also derived over COS with the FVC values of GEOV1 lower than Australian MODIS.Over the COBEF sites, GEOV1 shows realistic seasonal profiles while the seasonal trajectory derived from the Australian MODIS FVC product is relatively shifted.This is due to that the algorithm for Australian MODIS FVC product may not properly describe the characteristic of evergreen vegetation [26].Over the OBDF biome type, the Australian MODIS and GEOV1 FVC depict similar seasonal trajectories with much higher values than GEOV1.The largest temporal inconsistencies are observed over COG as compared to other biome types.The Australian MODIS FVC displays very noisy profiles.This is due to the spatial heterogeneity of COG resulting in sub-pixel heterogeneity and multiple scattering.Nonlinear mixing due to multiple scattering produced uncertainties in estimation of FVC [26].Over SV, GEOV1 describes low interannual variations such as no differences of FVC values in 2002, 2005, and 2008, which is possibly due to residual cloud or atmospheric effects.

Temporal Consistency of the Three FVC Products
In summary, these two FVC products generally capture the temporal variations and present seasonal evolutions with higher values in the wet season and lower values in the dry season.The Australian

Direct Validations of GEOV1 and Australian MODIS FVC Products
Ground FVC measurements were distributed in Australia across a wide range of geographical areas.The sampled biome types in the data set included RC, OBDF, MFS (mosaic forest-shrublands), COS, COG, SV.Half of the sampled points are distributed over SV (n = 165).The FVC values in the data set range from 9.76% 8.53% for COG to 38% 26.42% for COBEF.Vegetation classes with the highest FVC values are in the order of COBEF > OBDF > RC > COS, whereas those with the lowest FVC values are in the order of COG < MFS < SV.Only the GEOV1 and Australian MODIS FVC products are validated by the in-situ data set because the temporal coverage of CYCLOPES FVC product is from 2000-2007.The FVC products with the original spatial resolutions and temporal compositing period that are close to the range of time for the in-situ measurement acquisition were selected and directly compared with the in-situ FVC values.The numbers of validated points are similar for the GEOV1 and Australian MODIS FVC products.Compared with the ground FVC, the Australian MODIS product overestimates the FVC of OBDF and COS biome types (Figure 5).For RC, COG, and SV biome types, the Australian MODIS product estimates lower values than the field values.The Australian MODIS product is more consistent with the field FVC than the GEOV1 product over MFS.The FVC values of the OBDF derived from the GEOV1 FVC product agree well with the field measurements.The GEOV1 FVC product overestimates the FVC values of RC, MFS, and COS while underestimating the values of COG and SV.The uncertainty of each product is quantified by the RMSE computed against the ground FVC data set.Figures 6 and 7 show scatterplots between FVC products and the ground FVC measurements.Neither product produces ~1:1 relationship with the in-situ FVC.These two products show different degrees of correlations with the in-situ FVC over the six biome types.GEOV1 and Australian MODIS present good agreements with the in-situ FVC over RC, OBDF, and COS with similar R 2 and RMSE.For the Australian MODIS, overestimations are observable for OBDF and COS.Over MFS, a low R 2 possibly attributes to the spatial heterogeneity of the surface for the existing forests and shrubs.The same uncertainties (RMSE = 0.12) are achieved by GEOV1 and Australian MODIS.Both of the FVC products underestimate FVC for high values.Obvious outliers are observed over COG for GEOV1 and Australian MODIS for the lowest R 2 (R 2 < 0.1) values are achieved.This could be explained by a poor description of the surface spatial variability and scale effect.GEOV1 achieves the best performance with a RMSE value of 0.08 over OBDF biome type followed closely by Australian MODIS (RMSE = 0.10).The agreement of the Australian MODIS with the ground measurements is better over SV (RMSE = 0.09) than over other biome types.Across all the biome types, GEOV1 and Australian MODIS provide similar agreement with the in-situ data set (R 2 GEO = 0.38, RMSEGEO = 0.11; R 2 Aus = 0.35, RMSEAus = 0.10).The overall RMSE of GEOV1 and Australian are about 0.10, which is lower than the expected accuracy 0.05 [19].The uncertainties in ground measurements, limited number and spatial representativeness of ground measurements also impact the accuracy of the FVC products.

Discussion
The comparison of global FVC product (the GEOV1 FVC product) with the regional product (the Australian MODIS FVC) showed that these two products display similar spatiotemporal variations over the Australian continent.The Australian MODIS FVC and GEOV1 show large uncertainties over RC and COS.The accuracies of the two FVC products are sensitive to biome types.The reliabilities and accuracies of the FVC products for different biome types need to be intensively validated.The development of FVC algorithm should focus on the sensitivity of the algorithm to vegetation types with emphasis on vegetation density.Studies showed that a change of as much as 100 W•m −2 in latent heat flux (LE) can occur when varying FVC by 0.2 while keeping all other factors invariant [32,33].Therefore, accurate FVC product is important for application to land surface models.For GEOV1 and Australian MODIS, the results of validation show that the accuracies ranged from 0.08 to 0.14, lower than the expected target accuracy of 0.05 [19].High accuracies for the FVC products are necessary for further application.The development and validation of regional FVC products for proper local application should be conducted.
Standard ground measurement is one of the most important steps to the validation of FVC.One of the uncertainties introduced by direct validation is the mismatch of spatial scales.In this study, our results are limited by a possible lack of sampling points in ground measurement and small sampling units.Each field unit measures approximately an extent of 100 m × 100 m, which is much smaller than a pixel of the FVC products (1 km × 1 km).There is a scale effect for the point-to-pixel comparison between the FVC products and the ground measured FVC values [34].Therefore, higher resolution images (20 m or 30 m) are generally chosen to generate reference maps as a bridge to validate coarse resolution remote sensing products [16,35].This strategy is recommended for further validation of the FVC products [24].Moreover, the validation data set used in this work was sampled mostly at a single growth stage that did not properly represent the seasonal variability of land surface types.The ground measurements limited the validation of the FVC products at other growing stages.Mu et al. [22] showed that the biases between the GEOV1 and reference FVC was observed from 0.051 to 0.219 in the growing season of corn.Ground sampling over the whole growth period is required for cropland and sparsely vegetated areas since they are temporally more variable than other vegetation classes [36].

Conclusion
This study presented the performances of the global GEOV1 and regional Australian MODIS FVC products over the Australian continent.Spatial comparison of GEOV1 and Australian MODIS indicated that robust correlations between GEOV1 and Australian MODIS were found over most of the Australian continent, while high RMSE and biases were recorded in the highly vegetated coastal areas.The analysis of the temporal variations showed that these three FVC products generally captured seasonal evolutions with higher values in the wet season and lower values in the dry season.GEOV1 and Australian MODIS presented similar seasonal variations over most biome types with differences in magnitude.Direct validation using the ground FVC measurements showed that GEOV1 and Australian MODIS present similar accuracies across all the biome types.Both FVC products overestimated FVC over OBDF, COS, and MFS, yet underestimated FVC over COG and SV.
The results of this study indicate that several aspects of the FVC products need to be improved.A higher version of the FVC product is necessary for further application.The accuracy of GEOV1 and the Australian MODIS FVC is around 0.1 lower than the expected accuracy of 0.05.Global algorithms could be supplemented by multiple regional algorithms as currently applied for Australian or multiple biome algorithms considering the sensitivity of FVC algorithms to biome types.A global intensive ground measurement of FVC spanning the growing season among different vegetation types is recommended to improve the validation of the FVC products.

Figure 1 .
Figure 1.Spatial coverage of the evaluating units and in-situ fractional vegetation covers.The base map is the Glob Cover 2009 land cover map.
Figure2ashows the annual mean derived from the Australian MODIS FVC product for the period 2000-2012.The features in Figure2aindicate the Australian drainage divisions.Each division consists

Figure 3 .
Figure 3. Scatterplots of the two products over the main biome types in Australia for the 2000-2012 period.The terms B and SD represent the bias and the standard deviation of the differences between the FVC retrievals.

Figure 4 Figure 4 .
Figure4shows the interannual and seasonal variations of the two FVC products for each biome type over the six evaluating units for the 2000-2012 period.
FVC show similar seasonal profiles over most biome types.The values of GEOV1 are systematically lower than Australian MODIS.

Figure 5 .
Figure 5.Comparison of GEOV1 and Australia FVC mean values within-situ FVC for each biome types.Error bars represent +1 standard deviation.The number of in-situ observations for each biome is shown in the parenthesis.

Table 1 .
Characteristics of the three remote sensing FVC products under study.