The Evaluation of Single-Sensor Surface Soil Moisture Anomalies over the Mainland of the People ’ s Republic of China

In recent years, different space agencies have launched satellite missions that carry passive microwave instruments on-board that can measure surface soil moisture. Three currently operational missions are the Soil Moisture and Ocean Salinity (SMOS) mission developed by the European Space Agency (ESA), the Advanced Microwave Scanning Radiometer 2 (AMSR2) developed by the Japan Aerospace Exploration Agency (JAXA), and the Microwave Radiation Imager (MWRI) from China’s National Satellite Meteorological Centre (NSMC). In this study, the quality of surface soil moisture anomalies derived from these passive microwave instruments was sequentially assessed over the mainland of the People’s Republic of China. First, the impact of a recent update in the Land Parameter Retrieval Model (LPRM) was assessed for MWRI observations. Then, the soil moisture measurements retrieved from the X-band observations of MWRI were compared with those of AMSR2, followed by an internal comparison of the multiple frequencies of AMSR2. Finally, SMOS retrievals from two different algorithms were also included in the comparison. For each sequential step, processing and verification chains were specifically designed to isolate the impact of algorithm (version), observation frequency or instrument characteristics. Two verification techniques are used: the statistical Triple Collocation technique is used as the primary verification tool, while the precipitation-based Rvalue technique is used to confirm key results. Our results indicate a consistently better performance throughout the entire study area after the implementation of an update of the LPRM. We also find that passive microwave observations in the AMSR2 C-band frequency (6.9 GHz) have an advantage over the AMSR2 X-band frequency (10.7 GHz) over moderate to densely vegetated regions. This finding is in line with theoretical expectations as emitted soil radiation will become masked under a dense canopy with stricter thresholds for higher passive microwave frequencies. Both AMSR2 and MWRI make X-band observations; a direct comparison between them reveals a consistently higher quality obtained by AMSR2, specifically over semi-arid climate regimes. Unfortunately, Radio Frequency Interference hampers the usefulness of soil moisture products for the SMOS L-band mission, leading to a significantly reduced revisit time over the densely populated eastern part of the country. Nevertheless, our analysis demonstrates that soil moisture products from a number of multi-frequency microwave sensors are credible alternatives for this dedicated L-band mission over the mainland of the People’s Republic of China.


Introduction
Surface soil moisture is an important variable in hydrological and climate systems as it controls the interaction between the land surface and atmosphere.Soil moisture impacts the partitioning of incoming energy over the land surface, dividing this energy into soil, sensible and latent heat fluxes.Remotely sensed surface soil moisture products have been available since the early 2000s (e.g., [1,2]) and were used in numerous applications such as global change monitoring [3], surface runoff predictions [4], improved vegetation predictions [5] and studying complex feedback mechanisms and land-atmosphere interactions (e.g., [6,7]).The important role of soil moisture was acknowledged by the Global Climate Observing System [8] in 2010, endorsing soil moisture as one of the 50 Essential Climate Variables (ECVs).In response to the need for a long-term remotely sensed soil moisture record, the European Space Agency (ESA) established the Climate Change Initiative (CCI) for soil moisture (www.esa-soilmoisture-cci.org),which has the goal of merging single-sensor soil moisture datasets into a consistent, multi-decadal soil moisture dataset (ECV-SM; [9]).Nowadays, this ECV-SM has found its way to more than 3000 users and has been readily adopted in a wide range of disciplines.The ECV-SM product is a record based on a component from both active and passive microwave sensors.In this study, our focus is solely on the passive microwave component to isolate and better understand the consequences of different retrieval algorithms and algorithm versions, as well as observation frequencies and instrument characteristics.Enhanced knowledge of such isolated impacts will provide feedback on the further integration of surface soil moisture retrievals from various passive microwave instruments into the existing ECV-SM framework.
Another soil moisture initiative by the ESA is the Soil Moisture Ocean Salinity (SMOS; [10]) mission, which was launched in 2009.SMOS observes the Earth's surface in the L-band frequency (1.4 GHz), which is theoretically optimal for soil moisture detection, and has an overpass time at 6 am for the ascending orbit, which is the optimal moment in the diurnal cycle due to thermodynamic equilibrium.Higher-frequency bands (6.9 and 10.7 GHz, respectively C-and X-band) have been used in the past and can serve as an alternative source for surface soil moisture information [11].A sensor that has been widely used for surface soil moisture retrievals from passive microwave observations is the Advanced Microwave Scanning Radiometer for Earth Observing System (AMSR-E; [12]).AMSR-E was mounted on the National Aeronautics Space Administration (NASA) Aqua satellite and continuously observed the Earth's surface and atmosphere in a wide range of microwave frequencies for almost a decade (May 2002-October 2011).The Advanced Microwave Scanning Radiometer 2 (AMSR2) is the improved successor of AMSR-E and entered operational status in July 2012.Another alternative for soil moisture detection comes from a less known source, the Microwave Radiation Imager (MWRI) on-board the Chinese Fengyun-3B satellite [13,14].China's National Satellite Meteorological Centre (NSMC) leads an extensive, operational space program and has polar orbiting satellites in the so-called Fengyun series since 1988.The Fengyun-3B satellite is the second satellite in the third Fengyun series and carries a multi-frequency passive microwave radiometer on-board, the MWRI.
In the last decades, the rapid economic development and population growth in the People's Republic of China has placed increasing pressure on the natural hydrological system as well as agricultural production.Timely observations of soil moisture are crucial in providing early warnings of drought and flood onset, and monitoring states of crops and pasture.A thorough understanding of the individual qualities of such datasets over the People's Republic of China is crucial for effective use.Therefore, this study focuses on the comparison of soil moisture products from different passive microwave instruments over the entire mainland.These surface soil moisture products were evaluated over recent years (2012 until 2015) and include retrievals from the MWRI, AMSR2 and SMOS.Data processing and verification chains were specifically designed to isolate the impact of the different retrieval algorithms and their recent versions, observation frequencies and instrumental characteristics.
The paper is ordered as follows: Section 2 describes the main characteristics of the datasets (sensors and retrieval algorithms) followed by a description of the methodology through the proposed sequential evaluation and the verification techniques (Section 3).The results are presented in Section 4 and extensively discussed in Section 5. Finally, the conclusions and outlook for future research are presented (Section 6).

Passive Microwave Sensors
The main focus of this study is on soil moisture anomalies from three different passive microwave sensors, MWRI (Section 2.1.1),AMSR2 (Section 2.1.2) and SMOS (Section 2.1.3).The satellite and sensor characteristics relevant for surface soil moisture retrievals are discussed first, followed by a comprehensive overview presented in Table 1.The Chinese Fenyun-3B satellite was launched on 4 November 2010 and carries a passive microwave radiometer that observes the Earth's surface in 10 microwave channels in both horizontal and vertical polarizations.The satellite reached its operational status in July 2011 and orbits at an altitude of 836 km.The radiometer makes observations in the frequency range between 10.7 and 89.0 GHz and scans with an incidence angle of 55. 4 • resulting in 1400 km wide swaths.As a result, a fixed point on the ground is observed roughly twice every three days, but the exact revisit times depend on the latitude.The local equatorial overpass time of the Fengyun-3B satellite is 01:30 am and 01:30 pm for the descending and ascending paths, respectively.
Of specific relevance for soil moisture retrievals and their associated quality indicators [15] is the lowest frequency of the MWRI, since lower-frequency microwave observations have a higher sensitivity to surface soil moisture [16].For MWRI, this is the 10.7 GHz channel, which has a bandwidth of 0.18 GHz and a sensor accuracy of 0.5 degrees Kelvin.Finally, Radio Frequency Interference (RFI) is a known issue for all passive microwave observations (e.g., [17][18][19]), but the X-band frequency of MWRI remains relatively unaffected with the exception of The United Kingdom and Italy [19].Finally, it should also be noted that the vertically polarized Ka-band channel (36.5 GHz) was used to retrieve land surface temperature [20] as an input for a selection of the soil moisture retrieval algorithm (Section 2.2).

GCOM-W AMSR2
AMSR2 is the successor of AMSR-E and these sensors share similarities in their frequency range from 6.9 to 89.0 GHz in both horizontal and vertical polarization.Since significant RFI issues in the 6.9 GHz channel were encountered over the United States, Middle East and Japan [17], a neighbouring frequency channel (7.3 GHz) was added to AMSR2 which successfully mitigates this issue [19].Another similarity between these sensors, as well as with the MWRI on-board Fengyun-3B, is their local equatorial overpass time of 01:30 am and 01:30 pm, again for the descending and ascending paths, respectively.AMSR2 is mounted on-board the Global Change Observation Mission on Water (GCOM-W), which was developed by the Japan Aerospace Exploration Agency (JAXA) and reached its operational status in July 2012.As a result, AMSR2 was only considered from this date onwards.GCOM-W orbits at an altitude of 700 km and AMSR2 scans with an incidence angle of 55 • , resulting in 1445 km wide swaths.In line with the MWRI, a fixed point on the ground is observed roughly twice every three days.
Again of relevance for soil moisture retrievals is the lowest frequency of AMSR2, the 6.9 GHz channel, which has a bandwidth of 0.35 GHz and a sensor accuracy of 0.3 degrees Kelvin.Additionally, the 10.7 GHz channel that AMSR2 shares with MWRI has only slightly different characteristics as the bandwidth for AMSR2 is 0.10 GHz with a sensor accuracy of 0.6 degrees Kelvin.Radio Frequency Interference (RFI) is also a known issue for AMSR2 [19] and the vertically polarized Ka-band channel (36.5 GHz) was again used to retrieve land surface temperature [20].

SMOS MIRAS
SMOS is the first satellite mission that makes global observations in the L-band frequency.These observations are made by the Microwave Imaging Radiometer using the Aperture Synthesis (MIRAS) instrument, which is a 2D interferometric radiometer.MIRAS observes the Earth's surface at a single frequency but makes observations in a range of incidence angles (from 0 • to 65 • ) that have an average spatial resolution of 43 km (depending on the incidence angle).Fengyun-3B and GCOM-W were not specifically designed for soil moisture purposes but SMOS is dedicated to this; therefore, SMOS makes observations at the optimal moment in a diurnal cycling (ascending orbit; 06:00 am).SMOS has a revisit time of roughly three days at the equator at 06:00 am and 06:00 pm, for the ascending and descending overpasses, respectively [10].
SMOS observations (1.4 GHz) are made with a bandwidth of 0.20 GHz, the sensor accuracy also depends on the incidence angle and ranges between 2 and 5 degrees Kelvin [21].The SMOS satellite entered its operational status in July 2010; it orbits at an altitude of 760 km and the swath width is 1000 km wide.Additionally, an adverse issue for SMOS observations relates to RFI (e.g., [18]), which is likely further hampered by the synthetic design of the sensor that allows for spatial amplification of such artificial sources.In this study, a data flagging procedure was applied that removes SMOS brightness temperature observations with an RFI probability exceeding a threshold (0.20).This specific threshold is in line with guidance and standards for SMOS data as well as a recent study that focuses on surface soil moisture products from this satellite mission [22].A comprehensive overview of all satellites and sensor characteristics relevant for this study, including the Advanced Scatterometer (ASCAT; see Section 2.3.1), is provided in Table 1.

Passive Microwave Retrieval Algorithms
Two different soil moisture retrieval algorithms for passive microwave observations are used in this study, the Land Parameter Retrieval Model (LPRM; Section 2.2.1) and the L-band Microwave Emission of the Biosphere Model (L-MEB; Section 2.2.2).Two different versions of the LPRM have been used, including the current algorithm that is used for the publicly available soil moisture dataset as well as the version that was recently updated through an improved parameterization and a vegetation correction [22,23].

The Land Parameter Retrieval Model
LPRM is one of the most widely used soil moisture retrieval algorithms.It has been continuously developed and is also extensively documented in the literature (e.g., [11,15,[22][23][24][25][26][27]).LPRM soil moisture products also play a key role in the existing multi-decadal ECV-SM dataset (e.g., [9,28]) due to their applicability to a wide range of low microwave frequencies and the complementarity with soil moisture data from active microwave observations [29].In this section, a brief overview of the LPRM is provided by presenting the key elements of the algorithm while referring to the existing literature for further details.This brief overview is followed by a more detailed description of recent algorithmic improvements [22].
The LPRM retrieves both vegetation optical depth and soil moisture from low frequency microwave observations and is based on the widely used radiative transfer equation [30].Vegetation optical depth is derived through an analytical solution [24] and land surface temperature comes from an external, stand-alone algorithm based on observations of the vertically polarized Ka-band channel (36.5 GHz; [20]) in case this channel is available.The LPRM uses a forward modelling approach that runs over the widest possible soil moisture range, followed by an internal optimization procedure to minimize the difference between the simulated and observed brightness temperatures.The LPRM approach is unique for each location at each time step, and specifically aims to minimize the impact of ancillary datasets (e.g., [15,22]) to better facilitate its role in climate studies [31].Various studies already detailed the LPRM model, to which readers are directed to for more information.In particular [26] provides a detailed overview of the version of the LPRM that is currently used for the publicly available soil moisture datasets and also their associated sub-modules.This version of the algorithm is from now on referred to as LPRM v05 .
A recent study [22] further builds on this established approach by further improving the internal parameterization and a vegetation correction obtained through a primary run.The internal parameterization (single scattering albedo and roughness) was empirically tuned at the global scale to match the dynamics (i.e., the long-term mean and amplitude range) of soil moisture retrievals from SMOS [23].While optimal results were found through a fixed value of the single scattering albedo (in both space and time), the roughness parameterization performed optimally when dependency on soil moisture was introduced.Additionally, in order to further correct for vegetation and roughness influences, the roughness parameterization was also updated with a vegetation correction.This vegetation correction is based on the vegetation optical depth from a primary run that further corrects roughness influences in a final run [22].This updated version of the LPRM will be referred to from now on as LPRM v06 .Van der Schalie et al. [22] demonstrated significant improvements in AMSR-E soil moisture from LPRM v06 against ground data compared to LPRM v05 , which was confirmed through a large-scale precipitation based verification technique.

The L-Band Microwave Emission of the Biosphere
The standard approach to convert multi-angle SMOS brightness temperatures into surface soil moisture is through the L-MEB model [32].L-MEB and LPRM share the same background through employing the radiative transfer equation [30] and they are also based on a forward modelling approach; however, there are also several key differences.L-MEB considers different parametrization schemes for different land cover types and vegetation optical depth is determined through a scaling parameter that depends on frequency, polarization, incidence angle and vegetation structure and is the so-called 'b-parameter ' [33].The variation of vegetation optical depth over the different incidence angles is further tuned through a number of parameters related to vegetation structure in L-MEB.For brightness temperatures in so-called mixed pixels, the internal pixel heterogeneity is considered and computed as the linear combination of the brightness temperatures of each land cover type.The atmospheric effects and contributions to the brightness temperatures are also considered.Finally, although the dedicated soil modelling modules of L-MEB and LPRM have many similarities and differences, they ultimately seek the same goal of solving the reflectivity of the soil and water mixture that can be integrated in the forward model.For more detailed information on the L-MEB model, readers are referred to [32], while key differences between L-MEB and the LPRM are further detailed in [23].

MetOp-ASCAT and the Change Detection Algorithm
The primary validation tool used in this study is the Triple Collocation technique, which requires three soil moisture products with independent error structures.The conventional product combination to evaluate passive microwave surface soil moisture through this technique is using an additional active microwave source (Section 2.3.1)complemented with the top layer of a reanalysis model (Section 2.3.2).The ESA also developed MetOp, a series of polar orbiting meteorological satellites operated by the Exploitation of Meteorological Satellites (EUMETSAT).These satellites carry various different scientific instruments including ASCAT, a real aperture radar instrument that operates in the C-band frequency (5.3 GHz).ASCAT scans with three antennae on each site of the satellite, resulting in two swaths of 550 km each.As a result, each location is scanned from three different angles, which allows for the estimation of soil moisture conditions.In line with the passive microwave sensors, ASCAT also makes observations in both the horizontal and vertical polarizations.The MetOp satellites orbit at an altitude of 837 km and the local equatorial overpass time of MetOp is 09:30 am and 09:30 pm for the descending and ascending paths, respectively.
ASCAT soil moisture was determined through the change detection algorithm developed by the Technical University, Vienna, which converts the backscatter measurements in a time series format into relative soil moisture values.This product comes in a percentage of saturation of field capacity ranging between the wilting point and porosity and represents the top (0-2 cm) surface layer.ASCAT soil moisture data was projected on a global 0.25 • grid and soil moisture data from the ascending and descending grids were combined [34].More details on the change detection algorithm are provided by [1,35].

Re-Analysis Surface Soil Moisture from MERRA-2
The third surface soil moisture product required for the Triple Collocation technique is the Modern Era Retrospective-analysis for Research and Applications-2 (MERRA-2) product.MERRA-2 is an atmospheric reanalysis model that produces various water-and energy-related variables at multiple depths of both the saturated and unsaturated zone and was recently updated (from MERRA and MERRA-Land).Compared to its predecessors, MERRA-2 was further advanced through a data assimilation system that allows for the integration of hyperspectral and microwave observations and Ozone observations were also included from 2005 onwards.Finally, MERRA-2 is the only multi-decadal global reanalysis model that assimilates observations of aerosols and their complex interactions with related components in the climate system.In this study, surface soil moisture from the top surface layer (0-2 cm) of MERRA-2 was extracted.This product was, along with the ASCAT soil moisture dataset, used as a fixed input for the Triple Collocation technique.Finally, both these fixed inputs for the Triple Collocation (i.e., ASCAT and MERRA-2) have a unique spatial quality, for which we refer to Al-Yaari et al. [36].This existing study provides a thorough quality analysis of such surface soil moisture products.While this is an important issue for the Triple Collocation technique, our analysis is based on (a) the conventional Triple Collocation approach with its corresponding prerequisites (see Section 3.1) and (b) key results were confirmed by the R value verification technique that operates independent from the ASCAT and MERRA-2 surface soil moisture products.

Precipitation
The secondary verification technique that was used in this study is the so-called R value technique (e.g., [27,37,38]).This technique is based on the assimilation of remotely sensed soil moisture into a water balance model and requires precipitation as an input.Therefore, Tropical Rainfall Monitoring Mission (TRMM) 3B42 v. 7 [39], which is based on measurements from the Visible and Infrared Scanner and Microwave Imager instruments, was used.These observations are used to adjust infrared observations from various geostationary satellite platforms into precipitation rates.Then, the adjusted merged Infrared products at a 0.25 • spatial resolution at three hourly time-steps are aggregated into daily representations.The TRMM satellite used to orbit is in a constant plane relative to the sun, covering the latitudes between 50 • North and 50 • South.A consequence for our study area, the mainland of the People's Republic of China, is that the northern tip of the county could not be considered in the R value verification.Besides its use in the R value verification, TRMM 3B42 (v.7) precipitation data was also used as supporting information to better understand our results, hence the annual mean precipitation over the study area was presented in Figure 1a.Scanner and Microwave Imager instruments, was used.These observations are used to adjust infrared observations from various geostationary satellite platforms into precipitation rates.Then, the adjusted merged Infrared products at a 0.25° spatial resolution at three hourly time-steps are aggregated into daily representations.The TRMM satellite used to orbit is in a constant plane relative to the sun, covering the latitudes between 50° North and 50° South.A consequence for our study area, the mainland of the People's Republic of China, is that the northern tip of the county could not be considered in the Rvalue verification.Besides its use in the Rvalue verification, TRMM 3B42 (v.7) precipitation data was also used as supporting information to better understand our results, hence the annual mean precipitation over the study area was presented in Figure 1a.

Normalized Difference Vegetation Index
Finally, a commonly used vegetation index was used to further understand the quality of the remotely sensed anomalies spatially.The quality of remotely sensed soil moisture is known to decrease with an increase in overlying vegetation canopy (e.g., [15,27,34]).This limitation is well known for microwave based soil moisture and is caused by the attenuation of the soil (moisture) emission with increasing vegetation and the difficulties in correctly parameterizing for vegetation influences.In this study, Normalized Difference Vegetation Index (NDVI) obtained from the Moderate Resolution Imaging Spectrometer is used as an indicator of the vegetation density.NDVI is determined through visible and near-infrared observations and is linked to vegetation greenness.It should be noted that we explicitly use NDVI instead of microwave-based vegetation optical depth [24], which can serve the same purpose.The reason for using NDVI over microwave-based vegetation optical depth is its independency of the soil moisture retrievals, which are determined through the same passive microwave observations that have been used for soil moisture retrieval.NDVI data were used in a binning procedure in which verification results from the two techniques were binned over the NDVI range (0.10 < NDVI < 0.85).Monthly NDVI images were aggregated into a global 0.25° grid and used to further analyse the outputs of the large-scale verification techniques.Within this study, NDVI data were used to better understand and interpret the results, of which the mean NDVI over the study period was presented in Figure 1b.

Data Pre-Processing
Our analysis is based on soil moisture anomalies relative to their long-term climatology.This processing step is a relatively standard decomposition (e.g., [27,29,37,40]) in which the climatology on the particular day of interest was determined through a 31-day centred moving window and removed from the original data.The reason for this processing step is that the unique surface layer observed from space as well as the unique layer in applications that use these data both have unique climatology.In order to make optimal use of the independency that the remote sensing dataset has to offer, systematic differences have to be minimized, hence remotely sensed soil moisture anomalies are generally scaled into the model's climatology.

Normalized Difference Vegetation Index
Finally, a commonly used vegetation index was used to further understand the quality of the remotely sensed anomalies spatially.The quality of remotely sensed soil moisture is known to decrease with an increase in overlying vegetation canopy (e.g., [15,27,34]).This limitation is well known for microwave based soil moisture and is caused by the attenuation of the soil (moisture) emission with increasing vegetation and the difficulties in correctly parameterizing for vegetation influences.In this study, Normalized Difference Vegetation Index (NDVI) obtained from the Moderate Resolution Imaging Spectrometer is used as an indicator of the vegetation density.NDVI is determined through visible and near-infrared observations and is linked to vegetation greenness.It should be noted that we explicitly use NDVI instead of microwave-based vegetation optical depth [24], which can serve the same purpose.The reason for using NDVI over microwave-based vegetation optical depth is its independency of the soil moisture retrievals, which are determined through the same passive microwave observations that have been used for soil moisture retrieval.NDVI data were used in a binning procedure in which verification results from the two techniques were binned over the NDVI range (0.10 < NDVI < 0.85).Monthly NDVI images were aggregated into a global 0.25 • grid and used to further analyse the outputs of the large-scale verification techniques.Within this study, NDVI data were used to better understand and interpret the results, of which the mean NDVI over the study period was presented in Figure 1b.

Data Pre-Processing
Our analysis is based on soil moisture anomalies relative to their long-term climatology.This processing step is a relatively standard decomposition (e.g., [27,29,37,40]) in which the climatology on the particular day of interest was determined through a 31-day centred moving window and removed from the original data.The reason for this processing step is that the unique surface layer observed from space as well as the unique layer in applications that use these data both have unique climatology.In order to make optimal use of the independency that the remote sensing dataset has to offer, systematic differences have to be minimized, hence remotely sensed soil moisture anomalies are generally scaled into the model's climatology.
Additionally, several studies (e.g., [25,34,38,41]) separately assessed the quality of remotely sensed soil moisture products for their satellite paths explicitly.Diurnal variations in several related variables, for example land surface temperature ([26,27,38]), can lead to a contrast in quality that depends on the local overpass time as well as the algorithm used to link brightness temperatures to soil moisture.In particular, [34] demonstrated this for passive microwave products from SMOS (L-MEB) and AMSR-E (LPRM), which are commonly based on the radiative transfer equation [30].Even though progress towards consistency between satellite paths was recently demonstrated [27], this study only focuses on the descending path of MWRI and AMSR2 (both 01:30 am) and the ascending path of SMOS (06:00 am).These are theoretically preferred overpass times based on thermodynamic equilibrium, in which the temperature of the soil can be assumed equal to the temperature of the canopy, generally outperforming their daytime counterparts (01:30 pm for MWRI and AMSR2, and 06:00 pm for SMOS).All datasets used in this study have been identically processed; they were re-gridded on 0.25 • regular grids from their native footprint size (see Table 1) through nearest neighbour re-sampling and all datasets were evaluated based on daily sampling intervals.

Methodology
The primary verification technique was used in this study is the Triple Collocation technique (Section 3.1), while the independent precipitation based R value technique (Section 3.2) is used to confirm key results.While remotely sensed surface soil moisture products are traditionally compared against ground observations, we explicitly rely on these two independent and large-scale verification techniques.The primary reason for this choice is the aim to evaluate the different product combinations over the widest areal extent possible.This is in contrast with ground observations that are only available at specific monitoring sites.Besides this key advantage, ground observations generally represent a different vertical layer than remotely sensed products; ground observations over our study area are generally limited in their temporal availability and the considered spatial heterogeneity of surface soil moisture complicates a direct comparison.The entire evaluation follows a sequential structure that starts with product combination A, a direct comparison between the two versions of the LPRM as applied to MWRI observations in the X-band frequency.The processing and verification chains were identical, with the only modification being the parameterization and a vegetation correction (LPRM v06 ) over the standard approach (LPRM v05 ).The following step (product combination B) is to compare the MWRI-LPRM v06 soil moisture product against the same algorithm version but then applied to AMSR2 X-band observations.Again, identical processing-and verification chains were used, with the only difference being the transition from the MWRI X-band retrievals to the AMSR2 X-band retrievals.In the next product combination (C) AMSR2 retrievals from the X-and C-band frequencies were evaluated, which allows for isolating impacts of observation frequency.Again, the processing and verification chains were identical, with the only modification being the AMSR2 frequencies.When transitioning to the following product combination (D) that includes SMOS, it is not possible to isolate a single component as different radiometers (AMSR2 and SMOS) with different frequencies (C-and L-band) had to be considered.However, the impact of algorithmic differences was minimized by relying on the LPRM v06 retrieval algorithm.Finally, in the last step (product combination E) SMOS soil moisture products were compared as obtained by LPRM v06 and L-MEB.Table 2 presents a detailed overview of the sequential evaluation that was followed in this study, including the product combinations A-E.This sequential evaluation aims to understand the consequences of isolated differences between the products that have been used and were evaluated and processed through identical chains.

The Triple Collocation Technique
Triple Collocation is a statistical verification technique that has been extensively used for the validation of remotely sensed soil moisture anomalies (e.g., [27,29,34,38]).This technique estimates the root mean square error (RMSE) versus true conditions for three linearly related (soil moisture) datasets that have independent error structures.The conventional product combination in large-scale surface soil moisture evaluation studies is soil moisture from an active and passive microwave source, complemented by the top layer of a reanalysis model.Results from the Triple Collocation technique were validated against ground observations [42], while [29] demonstrated that RMSE estimates are only marginally influenced by the choice of the reanalysis model.This study follows the conventional Triple Collocation approach, which is extensively documented in the literature ( [27,29,34,38]).Of specific relevance for the Triple Collocation analysis is the number of collocated samples being set to N > 100, which is a standard number that was adopted from Parinussa et al. [38].
This study sequentially examines the relative quality of the five soil moisture product combinations (A to E) in a common framework.Therefore, our input sources from ASCAT and MERRA-2 are fixed throughout, while passive microwave products were swapped and evaluated.Finally, since the true soil moisture conditions are unknown, ASCAT soil moisture was arbitrarily chosen as a reference product but this will not affect subsequent conclusions regarding the relative performance of all passive microwave products and the product combinations.Triple Collocation produces an error metrics, hence higher numbers indicate lower quality; this is in contrast with R value , which is a performance metrics.Figure 2a presents a Triple Collocation example as applied to MWRI observations from the Fengyun-3B satellite using the LPRM v06 algorithm.

The Rvalue Technique
The baseline of the Rvalue technique was presented by Crow and Zhan [43] and uses the connection between precipitation and the subsequent changes in soil moisture.Crow et al. [37] adapted the approach to run on anomalies and validated Rvalue as a robust representation of (anomaly) correlation-based skill in satellite soil moisture retrieval.Rvalue relies on contrasts in the quality of rainfall products to evaluate the degree to which analysis increments (derived via the sequential assimilation of soil moisture into a simple water balance model) accurately compensate for known rainfall errors.In this study, the approach presented by [27] and [44] was followed, which artificially deteriorates the gauge-corrected TRMM 3B42 precipitation product to generate these rainfall errors.There are known limitations ( [22,27,38]) with Rvalue verification over extremely arid climates that have to do with the requirement of a sufficient number of precipitation events that cannot be met under such conditions.These regions were masked in our analysis and are indicated by "Not enough precipitation".In line with this limitation is a known limitation of remotely sensed algorithms under very dense vegetation canopies, which was indicated in the figures by "Soil moisture loses skills".In this study, Rvalue has been used as a secondary verification tool to confirm the initial findings.For more detailed information on this technique, readers are directed to [27,37,38].Rvalue is a performance metrics, hence higher numbers indicate better quality, again in contrast with an error metrics.An example of Rvalue verification for the MWRI-LPRMv06 soil moisture product is presented in Figure 2b.

Results
In this section, results from the Triple Collocation for our five product combinations (A to E) are first presented (Figure 3), followed by the results from the Rvalue analysis (Figure 4).Then, a final exercise to determine the agreement between these independent verification techniques is also presented (Figure 5).It should be emphasized that Figure 3 is a central source of information throughout this entire section.This central role can be explained by the significantly large data analysis over the entire People's Republic of China that was summarized for all evaluated product combinations and presented in Figure 3. RMSE from the six passive microwave soil moisture products were binned and presented.Results for these specific product combinations (A to E) are extensively discussed in Section 5, while the explicit product combinations (A to E) discussed later have been highlighted here.Additionally, a brief note on the modifications from the Triple Collocation analysis (Figure 3) to the Rvalue analysis (Figure 4) is also provided.
In the first product comparison (A; Table 2), the Triple Collocation results from the algorithm update were compared: the baseline algorithm (▬ LPRMv05) was compared against the updated algorithm (▬ LPRMv06).In the next product comparison (B; Table 2), the Triple Collocation results from the MWRI-LPRMv06 (▬) were compared against AMSR2-LPRMv06 (▬).Then, the focus shifts to the different frequencies observed by AMSR2 (C; Table 2), where the entire processing and

The R value Technique
The baseline of the R value technique was presented by Crow and Zhan [43] and uses the connection between precipitation and the subsequent changes in soil moisture.Crow et al. [37] adapted the approach to run on anomalies and validated R value as a robust representation of (anomaly) correlation-based skill in satellite soil moisture retrieval.R value relies on contrasts in the quality of rainfall products to evaluate the degree to which analysis increments (derived via the sequential assimilation of soil moisture into a simple water balance model) accurately compensate for known rainfall errors.In this study, the approach presented by [27] and [44] was followed, which artificially deteriorates the gauge-corrected TRMM 3B42 precipitation product to generate these rainfall errors.There are known limitations ( [22,27,38]) with R value verification over extremely arid climates that have to do with the requirement of a sufficient number of precipitation events that cannot be met under such conditions.These regions were masked in our analysis and are indicated by "Not enough precipitation".In line with this limitation is a known limitation of remotely sensed algorithms under very dense vegetation canopies, which was indicated in the figures by "Soil moisture loses skills".In this study, R value has been used as a secondary verification tool to confirm the initial findings.For more detailed information on this technique, readers are directed to [27,37,38].R value is a performance metrics, hence higher numbers indicate better quality, again in contrast with an error metrics.An example of R value verification for the MWRI-LPRM v06 soil moisture product is presented in Figure 2b.

Results
In this section, results from the Triple Collocation for our five product combinations (A to E) are first presented (Figure 3), followed by the results from the R value analysis (Figure 4).Then, a final exercise to determine the agreement between these independent verification techniques is also presented (Figure 5).It should be emphasized that Figure 3 is a central source of information throughout this entire section.This central role can be explained by the significantly large data analysis over the entire People's Republic of China that was summarized for all evaluated product combinations and presented in Figure 3. RMSE from the six passive microwave soil moisture products were binned and presented.Results for these specific product combinations (A to E) are extensively discussed in Section 5, while the explicit product combinations (A to E) discussed later have been highlighted here.Additionally, a brief note on the modifications from the Triple Collocation analysis (Figure 3) to the R value analysis (Figure 4) is also provided.
In the first product comparison (A;

Discussion
For product comparison A (MWRI-LPRMv05 ▬ versus MWRI-LPRMv06 ▬), the results for the LPRM retrieval algorithm update were compared.The overall patterns that these two products show over the increasing NDVI range (from left to right) correspond well.The Triple Collocation results (Figure 3) demonstrate consistently lower RMSE values for LPRMv06 (▬) compared to LPRMv05 (▬), while the Rvalue results (Figure 4) consistently demonstrate higher Rvalue results for LPRMv06 (▬) compared to LPRMv05 (▬) over the entire NDVI range.Hence, both these metrics clearly demonstrate a superior performance of LPRMv06 and lend further support to the improved LPRM approach presented by van der Schalie et al. [22].Additionally, the generally decreasing quality of the LPRM

The Rvalue Technique
The baseline of the Rvalue technique was presented by Crow and Zhan [43] and uses the connection between precipitation and the subsequent changes in soil moisture.Crow et al. [37] adapted the approach to run on anomalies and validated Rvalue as a robust representation of (anomaly) correlation-based skill in satellite soil moisture retrieval.Rvalue relies on contrasts in the quality of rainfall products to evaluate the degree to which analysis increments (derived via the sequential assimilation of soil moisture into a simple water balance model) accurately compensate for known rainfall errors.In this study, the approach presented by [27] and [44] was followed, which artificially deteriorates the gauge-corrected TRMM 3B42 precipitation product to generate these rainfall errors.There are known limitations ( [22,27,38]) with Rvalue verification over extremely arid climates that have to do with the requirement of a sufficient number of precipitation events that cannot be met under such conditions.These regions were masked in our analysis and are indicated by "Not enough precipitation".In line with this limitation is a known limitation of remotely sensed algorithms under very dense vegetation canopies, which was indicated in the figures by "Soil moisture loses skills".In this study, Rvalue has been used as a secondary verification tool to confirm the initial findings.For more detailed information on this technique, readers are directed to [27,37,38].Rvalue is a performance metrics, hence higher numbers indicate better quality, again in contrast with an error metrics.An example of Rvalue verification for the MWRI-LPRMv06 soil moisture product is presented in Figure 2b.

Results
In this section, results from the Triple Collocation for our five product combinations (A to E) are first presented (Figure 3), followed by the results from the Rvalue analysis (Figure 4).Then, a final exercise to determine the agreement between these independent verification techniques is also presented (Figure 5).It should be emphasized that Figure 3 is a central source of information throughout this entire section.This central role can be explained by the significantly large data analysis over the entire People's Republic of China that was summarized for all evaluated product combinations and presented in Figure 3. RMSE from the six passive microwave soil moisture products were binned and presented.Results for these specific product combinations (A to E) are extensively discussed in Section 5, while the explicit product combinations (A to E) discussed later have been highlighted here.Additionally, a brief note on the modifications from the Triple Collocation analysis (Figure 3) to the Rvalue analysis (Figure 4) is also provided.
In the first product comparison (A; Table 2), the Triple Collocation results from the algorithm update were compared: the baseline algorithm (▬ LPRMv05) was compared against the updated algorithm (▬ LPRMv06).In the next product comparison (B; Table 2), the Triple Collocation results from the MWRI-LPRMv06 (▬) were compared against AMSR2-LPRMv06 (▬).Then, the focus shifts to the different frequencies observed by AMSR2 (C; Table 2), where the entire processing and LPRM v06 ).In the next product comparison (B;

The Rvalue Technique
The baseline of the Rvalue technique was presented by Crow and Zhan [43] and uses the connection between precipitation and the subsequent changes in soil moisture.Crow et al. [37] adapted the approach to run on anomalies and validated Rvalue as a robust representation of (anomaly) correlation-based skill in satellite soil moisture retrieval.Rvalue relies on contrasts in the quality of rainfall products to evaluate the degree to which analysis increments (derived via the sequential assimilation of soil moisture into a simple water balance model) accurately compensate for known rainfall errors.In this study, the approach presented by [27] and [44] was followed, which artificially deteriorates the gauge-corrected TRMM 3B42 precipitation product to generate these rainfall errors.There are known limitations ( [22,27,38]) with Rvalue verification over extremely arid climates that have to do with the requirement of a sufficient number of precipitation events that cannot be met under such conditions.These regions were masked in our analysis and are indicated by "Not enough precipitation".In line with this limitation is a known limitation of remotely sensed algorithms under very dense vegetation canopies, which was indicated in the figures by "Soil moisture loses skills".In this study, Rvalue has been used as a secondary verification tool to confirm the initial findings.For more detailed information on this technique, readers are directed to [27,37,38].Rvalue is a performance metrics, hence higher numbers indicate better quality, again in contrast with an error metrics.An example of Rvalue verification for the MWRI-LPRMv06 soil moisture product is presented in Figure 2b.

Results
In this section, results from the Triple Collocation for our five product combinations (A to E) are first presented (Figure 3), followed by the results from the Rvalue analysis (Figure 4).Then, a final exercise to determine the agreement between these independent verification techniques is also presented (Figure 5).It should be emphasized that Figure 3 is a central source of information throughout this entire section.This central role can be explained by the significantly large data analysis over the entire People's Republic of China that was summarized for all evaluated product combinations and presented in Figure 3. RMSE from the six passive microwave soil moisture products were binned and presented.Results for these specific product combinations (A to E) are extensively discussed in Section 5, while the explicit product combinations (A to E) discussed later have been highlighted here.Additionally, a brief note on the modifications from the Triple Collocation analysis (Figure 3) to the Rvalue analysis (Figure 4) is also provided.In the first product comparison (A; Table 2), the Triple Collocation results from the algorithm update were compared: the baseline algorithm (▬ LPRMv05) was compared against the updated algorithm (▬ LPRMv06).
In the next product comparison (B; Table 2), the Triple Collocation results from the MWRI-LPRMv06 (▬) were compared against AMSR2-LPRMv06 (▬).Then, the focus shifts to the different frequencies observed by AMSR2 (C; Table 2), where the entire processing and

The Rvalue Technique
The baseline of the Rvalue technique was presented by Crow and Zhan [43] and uses the connection between precipitation and the subsequent changes in soil moisture.Crow et al. [37] adapted the approach to run on anomalies and validated Rvalue as a robust representation of (anomaly) correlation-based skill in satellite soil moisture retrieval.Rvalue relies on contrasts in the quality of rainfall products to evaluate the degree to which analysis increments (derived via the sequential assimilation of soil moisture into a simple water balance model) accurately compensate for known rainfall errors.In this study, the approach presented by [27] and [44] was followed, which artificially deteriorates the gauge-corrected TRMM 3B42 precipitation product to generate these rainfall errors.There are known limitations ( [22,27,38]) with Rvalue verification over extremely arid climates that have to do with the requirement of a sufficient number of precipitation events that cannot be met under such conditions.These regions were masked in our analysis and are indicated by "Not enough precipitation".In line with this limitation is a known limitation of remotely sensed algorithms under very dense vegetation canopies, which was indicated in the figures by "Soil moisture loses skills".In this study, Rvalue has been used as a secondary verification tool to confirm the initial findings.For more detailed information on this technique, readers are directed to [27,37,38].Rvalue is a performance metrics, hence higher numbers indicate better quality, again in contrast with an error metrics.An example of Rvalue verification for the MWRI-LPRMv06 soil moisture product is presented in Figure 2b.

Results
In this section, results from the Triple Collocation for our five product combinations (A to E) are first presented (Figure 3), followed by the results from the Rvalue analysis (Figure 4).Then, a final exercise to determine the agreement between these independent verification techniques is also presented (Figure 5).It should be emphasized that Figure 3 is a central source of information throughout this entire section.This central role can be explained by the significantly large data analysis over the entire People's Republic of China that was summarized for all evaluated product combinations and presented in Figure 3. RMSE from the six passive microwave soil moisture products were binned and presented.Results for these specific product combinations (A to E) are extensively discussed in Section 5, while the explicit product combinations (A to E) discussed later have been highlighted here.Additionally, a brief note on the modifications from the Triple Collocation analysis (Figure 3) to the Rvalue analysis (Figure 4) is also provided.
In the first product comparison (A; Table 2), the Triple Collocation results from the algorithm update were compared: the baseline algorithm (▬ LPRMv05) was compared against the updated algorithm (▬ LPRMv06).In the next product comparison (B; Table 2), the Triple Collocation results from the MWRI-LPRMv06 (▬) were compared against AMSR2-LPRMv06 (▬).Then, the focus shifts to the different frequencies observed by AMSR2 (C; Table 2), where the entire processing and ).Then, the focus shifts to the different frequencies observed by AMSR2 (C; Table 2), where the entire processing and verification chains were identical, with the only modification being the selection of the C-( Remote Sens. 2017, 9, 149 11 of 17 verification chains were identical, with the only modification being the selection of the C-(▬) and X-band (▬) frequencies.For product combination D, the results from AMSR2 C-band (▬) and SMOS (▬) retrieved through LPRMv06 were compared.This product combination is the only combination that cannot isolate a single characteristic within the processing chain as we have to consider the frequency difference between AMSR2 (C-band) and SMOS (L-band) but the two sensors on-board the satellites also have different characteristics.Finally, in product combination E, SMOS L-MEB (▬) was compared against SMOS LPRMv06 (▬).As previously noted, Rvalue is a performance metric, while Triple Collocation produces an error metric, meaning that these metrics are reversed (i.e. higher RMSE indicates lower quality while higher Rvalue indicates better quality).Since the SMOS soil moisture products fail to meet Triple Collocation sample size requirements (see Section 5), these products were not taken into further consideration.Figure 4 presents the results obtained through the Rvalue verification with an approach completely aligned to Figure 3, with removing the SMOS products as the only modification.Likewise, Figure 4 also has a central role that again can be explained by the significantly large data analysis over the entire study area that had to be summarized.) and X-band ( hina that was summarized for all evaluated product SE from the six passive microwave soil moisture for these specific product combinations (A to E) are xplicit product combinations (A to E) discussed later a brief note on the modifications from the Triple lysis (Figure 4) is also provided.
2), the Triple Collocation results from the algorithm m (▬ LPRMv05) was compared against the updated mparison (B; Table 2), the Triple Collocation results against AMSR2-LPRMv06 (▬).Then, the focus shifts to R2 (C; Table 2), where the entire processing and were compared.This product combination is the only combination that cannot isolate a single characteristic within the processing chain as we have to consider the frequency difference between AMSR2 (C-band) and SMOS (L-band) but the two sensors on-board the satellites also have different characteristics.Finally, in product combination E, SMOS L-MEB (▬) was compared against SMOS LPRMv06 (▬).As previously noted, Rvalue is a performance metric, while Triple Collocation produces an error metric, meaning that these metrics are reversed (i.e. higher RMSE indicates lower quality while higher Rvalue indicates better quality).Since the SMOS soil moisture products fail to meet Triple Collocation sample size requirements (see Section 5), these products were not taken into further consideration.Figure 4 presents the results obtained through the Rvalue verification with an approach completely aligned to Figure 3, with removing the SMOS products as the only modification.Likewise, Figure 4 also has a central role that again can be explained by the significantly large data analysis over the entire study area that had to be summarized.verification chains were identical, with the only modification being the selection of the C-(▬) and X-band (▬) frequencies.For product combination D, the results from AMSR2 C-band (▬) and SMOS (▬) retrieved through LPRMv06 were compared.This product combination is the only combination that cannot isolate a single characteristic within the processing chain as we have to consider the frequency difference between AMSR2 (C-band) and SMOS (L-band) but the two sensors on-board the satellites also have different characteristics.Finally, in product combination E, SMOS L-MEB (▬) was compared against SMOS LPRMv06 (▬).As previously noted, Rvalue is a performance metric, while Triple Collocation produces an error metric, meaning that these metrics are reversed (i.e. higher RMSE indicates lower quality while higher Rvalue indicates better quality).Since the SMOS soil moisture products fail to meet Triple Collocation sample size requirements (see Section 5), these products were not taken into further consideration.Figure 4 presents the results obtained through the Rvalue verification with an approach completely aligned to Figure 3, with removing the SMOS products as the only modification.Likewise, Figure 4 also has a central role that again can be explained by the significantly large data analysis over the entire study area that had to be summarized.) retrieved through LPRM v06 were compared.This product combination is the only combination that cannot isolate a single characteristic within the processing chain as we have to consider the frequency difference between AMSR2 (C-band) and SMOS (L-band) but the two sensors on-board the satellites also have different characteristics.Finally, in product combination E, SMOS L-MEB ( 11 of 17 selection of the C-(▬) and SR2 C-band (▬) and SMOS on is the only combination s we have to consider the t the two sensors on-board ination E, SMOS L-MEB (▬) performance metric, while cs are reversed (i.e. higher lity).Since the SMOS soil ents (see Section 5), these e results obtained through , with removing the SMOS tral role that again can be tudy area that had to be his section.Results were , observation frequencies etected by the MWRI and cation.
) was compared against SMOS LPRM v06 ( Remote Sens. 2017, 9, 149 verification chains were identical, with the only modification bei X-band (▬) frequencies.For product combination D, the results fro (▬) retrieved through LPRMv06 were compared.This product com that cannot isolate a single characteristic within the processing c frequency difference between AMSR2 (C-band) and SMOS (L-ban the satellites also have different characteristics.Finally, in product was compared against SMOS LPRMv06 (▬).As previously noted, Rv Triple Collocation produces an error metric, meaning that these RMSE indicates lower quality while higher Rvalue indicates bett moisture products fail to meet Triple Collocation sample size re products were not taken into further consideration.Figure 4   ).As previously noted, R value is a performance metric, while Triple Collocation produces an error metric, meaning that these metrics are reversed (i.e., higher RMSE indicates lower quality while higher R value indicates better quality).Since the SMOS soil moisture products fail to meet Triple Collocation sample size requirements (see Section 5), these products were not taken into further consideration.Figure 4 presents the results obtained through the R value verification with an approach completely aligned to Figure 3, with removing the SMOS products as the only modification.Likewise, Figure 4 also has a central role that again can be explained by the significantly large data analysis over the entire study area that had to be summarized.
Remote Sens. 2017, 9, 149 11 of 17 verification chains were identical, with the only modification being the selection of the C-(▬) and X-band (▬) frequencies.For product combination D, the results from AMSR2 C-band (▬) and SMOS (▬) retrieved through LPRMv06 were compared.This product combination is the only combination that cannot isolate a single characteristic within the processing chain as we have to consider the frequency difference between AMSR2 (C-band) and SMOS (L-band) but the two sensors on-board the satellites also have different characteristics.Finally, in product combination E, SMOS L-MEB (▬) was compared against SMOS LPRMv06 (▬).As previously noted, Rvalue is a performance metric, while Triple Collocation produces an error metric, meaning that these metrics are reversed (i.e. higher RMSE indicates lower quality while higher Rvalue indicates better quality).Since the SMOS soil moisture products fail to meet Triple Collocation sample size requirements (see Section 5), these products were not taken into further consideration.Figure 4 presents the results obtained through the Rvalue verification with an approach completely aligned to Figure 3, with removing the SMOS products as the only modification.Likewise, Figure 4 also has a central role that again can be explained by the significantly large data analysis over the entire study area that had to be summarized.verification chains were identical, with the only modification being the selection of the C-(▬) and X-band (▬) frequencies.For product combination D, the results from AMSR2 C-band (▬) and SMOS (▬) retrieved through LPRMv06 were compared.This product combination is the only combination that cannot isolate a single characteristic within the processing chain as we have to consider the frequency difference between AMSR2 (C-band) and SMOS (L-band) but the two sensors on-board the satellites also have different characteristics.Finally, in product combination E, SMOS L-MEB (▬) was compared against SMOS LPRMv06 (▬).As previously noted, Rvalue is a performance metric, while Triple Collocation produces an error metric, meaning that these metrics are reversed (i.e. higher RMSE indicates lower quality while higher Rvalue indicates better quality).Since the SMOS soil moisture products fail to meet Triple Collocation sample size requirements (see Section 5), these products were not taken into further consideration.Figure 4 presents the results obtained through the Rvalue verification with an approach completely aligned to Figure 3, with removing the SMOS products as the only modification.Likewise, Figure 4 also has a central role that again can be explained by the significantly large data analysis over the entire study area that had to be summarized.

Discussion
For product comparison A (MWRI-LPRMv05 ▬ versus MWRI-LPRMv06 ▬), the results for the LPRM retrieval algorithm update were compared.The overall patterns that these two products show over the increasing NDVI range (from left to right) correspond well.The Triple Collocation results (Figure 3) demonstrate consistently lower RMSE values for LPRMv06 (▬) compared to LPRMv05 (▬), while the Rvalue results (Figure 4) consistently demonstrate higher Rvalue results for LPRMv06 (▬) compared to LPRMv05 (▬) over the entire NDVI range.Hence, both these metrics clearly demonstrate a superior performance of LPRMv06 and lend further support to the improved LPRM approach presented by van der Schalie et al. [22].Additionally, the generally decreasing quality of the LPRM soil moisture products with increasing NDVI values (from left to right) seamlessly aligns with a number of existing studies (e.g., [41]).These studies found a high performance of LPRMv05 over arid climate regions through a comparison against in situ observations, which was later confirmed through several alternative verification techniques such as Triple Collocation (e.g., [29]).The marginal room for improvement of LPRMv05 over these arid regions was further demonstrated by Parinussa et al. [15,38], which is in contrast with the significant room for improvement over more densely vegetated areas, as presented in these studies.Again, similar findings were recently confirmed in a study using soil moisture retrievals based on AMSR-E observations ( [22]).As the relative improvements vary over the entire NDVI range, these improvements determined by the Triple Collocation technique were spatially expressed over our study area.Figure 6 presents these spatial patterns, which demonstrate that improvements are most profound in densely populated eastern part of the People's Republic of China, with RMSE reductions of around 15%, while the RMSE over arid climate regimes towards the western part of the country is only marginally reduced.
In the next step (product comparison B), the Triple Collocation results from the MWRI-LPRMv06 (▬) were compared against AMSR2-LPRMv06 (▬).For NDVI values at the lower end of the vegetation range (NDVI < 0.45), results obtained by both techniques are clear and consistent with each other.Within this NDVI range, the Triple Collocation technique indicates consistently lower RMSE for AMSR2-LPRMv06 compared to MWRI-LPRMv06.This result is confirmed by the higher numbers

For product comparison A (MWRI-LPRM v05
Remote Sens. 2017, 9, 149 12 of 17 Figure 5 presents a final exercise to further confirm the mutual agreement of these verification techniques.This figure presents a direct comparison of both verification techniques for the soil moisture anomalies from Fengyun-3B MWRI, which reveals a very high coefficient of determination (R 2 : 0.81).Colours relate to the corresponding NDVI value, over which both metrics were binned.This mutual agreement, together with the many similarities obtained by Figure 3

Discussion
For product comparison A (MWRI-LPRMv05 ▬ versus MWRI-LPRMv06 ▬), the results for the LPRM retrieval algorithm update were compared.The overall patterns that these two products show over the increasing NDVI range (from left to right) correspond well.The Triple Collocation results (Figure 3) demonstrate consistently lower RMSE values for LPRMv06 (▬) compared to LPRMv05 (▬), while the Rvalue results (Figure 4) consistently demonstrate higher Rvalue results for LPRMv06 (▬) compared to LPRMv05 (▬) over the entire NDVI range.Hence, both these metrics clearly demonstrate a superior performance of LPRMv06 and lend further support to the improved LPRM approach presented by van der Schalie et al. [22].Additionally, the generally decreasing quality of the LPRM soil moisture products with increasing NDVI values (from left to right) seamlessly aligns with a number of existing studies (e.g., [41]).These studies found a high performance of LPRMv05 over arid climate regions through a comparison against in situ observations, which was later confirmed through several alternative verification techniques such as Triple Collocation (e.g., [29]).The marginal room for improvement of LPRMv05 over these arid regions was further demonstrated by Parinussa et al. [15,38], which is in contrast with the significant room for improvement over more densely vegetated areas, as presented in these studies.Again, similar findings were recently confirmed in a study using soil moisture retrievals based on AMSR-E observations ( [22]).As the relative improvements vary over the entire NDVI range, these improvements determined by the Triple Collocation technique were spatially expressed over our study area.Figure 6 presents these spatial patterns, which demonstrate that improvements are most profound in densely populated eastern part of the People's Republic of China, with RMSE reductions of around 15%, while the RMSE over arid climate regimes towards the western part of the country is only marginally reduced.
In the next step (product comparison B), the Triple Collocation results from the MWRI-LPRMv06 (▬) were compared against AMSR2-LPRMv06 (▬).For NDVI values at the lower end of the vegetation range (NDVI < 0.45), results obtained by both techniques are clear and consistent with each other.Within this NDVI range, the Triple Collocation technique indicates consistently lower RMSE for AMSR2-LPRMv06 compared to MWRI-LPRMv06.This result is confirmed by the higher numbers

versus MWRI-LPRM v06
The baseline of the Rvalue technique was pr connection between precipitation and the subseq adapted the approach to run on anomalies and (anomaly) correlation-based skill in satellite soil m quality of rainfall products to evaluate the degre sequential assimilation of soil moisture into a sim for known rainfall errors.In this study, the approac artificially deteriorates the gauge-corrected TRM rainfall errors.There are known limitations ([22,2 climates that have to do with the requirement of cannot be met under such conditions.These region by "Not enough precipitation".In line with this lim algorithms under very dense vegetation canopie moisture loses skills".In this study, Rvalue has been the initial findings.For more detailed informat [27,37,38].Rvalue is a performance metrics, hence h contrast with an error metrics.An example of Rvalu product is presented in Figure 2b.

Results
In this section, results from the Triple Collocat first presented (Figure 3), followed by the results exercise to determine the agreement between th presented (Figure 5).It should be emphasized t throughout this entire section.This central role c analysis over the entire People's Republic of Chin combinations and presented in Figure 3. RMSE products were binned and presented.Results for extensively discussed in Section 5, while the expli have been highlighted here.Additionally, a br Collocation analysis (Figure 3) to the Rvalue analysis In the first product comparison (A; Table 2), update were compared: the baseline algorithm ( algorithm (▬ LPRMv06).In the next product compa from the MWRI-LPRMv06 (▬) were compared again the different frequencies observed by AMSR2 ( ), the results for the LPRM retrieval algorithm update were compared.The overall patterns that these two products show over the increasing NDVI range (from left to right) correspond well.The Triple Collocation results (Figure 3) demonstrate consistently lower RMSE values for LPRM v06 ( country could not be evaluated through the Rvalue.

The Rvalue Technique
The baseline of the Rvalue technique was presented connection between precipitation and the subsequent ch adapted the approach to run on anomalies and valida (anomaly) correlation-based skill in satellite soil moisture quality of rainfall products to evaluate the degree to wh sequential assimilation of soil moisture into a simple wat for known rainfall errors.In this study, the approach prese artificially deteriorates the gauge-corrected TRMM 3B42 rainfall errors.There are known limitations ([22,27,38]) w climates that have to do with the requirement of a suffic cannot be met under such conditions.These regions were by "Not enough precipitation".In line with this limitation algorithms under very dense vegetation canopies, whic moisture loses skills".In this study, Rvalue has been used a the initial findings.For more detailed information on [27,37,38].Rvalue is a performance metrics, hence higher n contrast with an error metrics.An example of Rvalue verific product is presented in Figure 2b.

Results
In this section, results from the Triple Collocation for o first presented (Figure 3), followed by the results from th exercise to determine the agreement between these ind presented (Figure 5).It should be emphasized that Fig throughout this entire section.This central role can be e analysis over the entire People's Republic of China that w combinations and presented in Figure 3. RMSE from t products were binned and presented.Results for these sp extensively discussed in Section 5, while the explicit prod have been highlighted here.Additionally, a brief note Collocation analysis (Figure 3) to the Rvalue analysis (Figure In the first product comparison (A; Table 2), the Trip update were compared: the baseline algorithm (▬ LPRM algorithm (▬ LPRMv06).
In the next product comparison ( from the MWRI-LPRMv06 (▬) were compared against AMS the different frequencies observed by AMSR2 (C; Tab

Discussion
For product comparison A (MWRI-LPRMv05 ▬ versus MWRI-LP LPRM retrieval algorithm update were compared.The overall patte show over the increasing NDVI range (from left to right) correspond results (Figure 3) demonstrate consistently lower RMSE values for LPRM (▬), while the Rvalue results (Figure 4) consistently demonstrate higher compared to LPRMv05 (▬) over the entire NDVI range.Hence, both these a superior performance of LPRMv06 and lend further support to the presented by van der Schalie et al. [22].Additionally, the generally dec soil moisture products with increasing NDVI values (from left to rig number of existing studies (e.g., [41]).These studies found a high perfo climate regions through a comparison against in situ observations, through several alternative verification techniques such as Triple marginal room for improvement of LPRMv05 over these arid regions w Parinussa et al. [15,38], which is in contrast with the significant room densely vegetated areas, as presented in these studies.), while the R value results (Figure 4) consistently demonstrate higher R value results for LPRM v06 ( TRMM precipitation only cov country could not be evaluate

The Rvalue Technique
The baseline of the Rvalue connection between precipitat adapted the approach to run (anomaly) correlation-based sk quality of rainfall products to sequential assimilation of soil m for known rainfall errors.In thi artificially deteriorates the gau rainfall errors.There are know climates that have to do with cannot be met under such cond by "Not enough precipitation" algorithms under very dense moisture loses skills".In this st the initial findings.For more [27,37,38].Rvalue is a performan contrast with an error metrics.product is presented in Figure 2b 4. Results In this section, results from first presented (Figure 3), follo exercise to determine the agr presented (Figure 5).It shoul throughout this entire section.analysis over the entire People combinations and presented i products were binned and pre extensively discussed in Sectio have been highlighted here.Collocation analysis (Figure 3) In the first product compa update were compared: the b algorithm (▬ LPRMv06).
In the n from the MWRI-LPRMv06 (▬) w the different frequencies obse and lend further support to the improved LPRM approach by van der Schalie et al. [22].Additionally, the generally decreasing quality of the LPRM re products with increasing NDVI values (from left to right) seamlessly aligns with a existing studies (e.g., [41]).These studies found a high performance of LPRMv05 over arid ions through a comparison against in situ observations, which was later confirmed veral alternative verification techniques such as Triple Collocation (e.g., [29]).The oom for improvement of LPRMv05 over these arid regions was further demonstrated by et al. [15,38], which is in contrast with the significant room for improvement over more getated areas, as presented in these studies.Again, similar findings were recently in a study using soil moisture retrievals based on AMSR-E observations ( [22]).As the provements vary over the entire NDVI range, these improvements determined by the ocation technique were spatially expressed over our study area.Figure 6  ) over the entire NDVI range.Hence, both these metrics clearly demonstrate a superior performance of LPRM v06 and lend further support to the improved LPRM approach presented by van der Schalie et al. [22].Additionally, the generally decreasing quality of the LPRM soil moisture products with increasing NDVI values (from left to right) seamlessly aligns with a number of existing studies (e.g., [41]).These studies found a high performance of LPRM v05 over arid climate regions through a comparison against in situ observations, which was later confirmed through several alternative verification techniques such as Triple Collocation (e.g., [29]).The marginal room for improvement of LPRM v05 over these arid regions was further demonstrated by Parinussa et al. [15,38], which is in contrast with the significant room for improvement over more densely vegetated areas, as presented in these studies.Again, similar findings were recently confirmed in a study using soil moisture retrievals based on AMSR-E observations ( [22]).As the relative improvements vary over the entire NDVI range, these improvements determined by the Triple Collocation technique were spatially expressed over our study area.

The Rvalue Technique
The baseline of the Rvalue technique was presented by Crow and Zhan [43] and uses the connection between precipitation and the subsequent changes in soil moisture.Crow et al. [37] adapted the approach to run on anomalies and validated Rvalue as a robust representation of (anomaly) correlation-based skill in satellite soil moisture retrieval.Rvalue relies on contrasts in the quality of rainfall products to evaluate the degree to which analysis increments (derived via the sequential assimilation of soil moisture into a simple water balance model) accurately compensate for known rainfall errors.In this study, the approach presented by [27] and [44] was followed, which artificially deteriorates the gauge-corrected TRMM 3B42 precipitation product to generate these rainfall errors.There are known limitations ( [22,27,38]) with Rvalue verification over extremely arid climates that have to do with the requirement of a sufficient number of precipitation events that cannot be met under such conditions.These regions were masked in our analysis and are indicated by "Not enough precipitation".In line with this limitation is a known limitation of remotely sensed algorithms under very dense vegetation canopies, which was indicated in the figures by "Soil moisture loses skills".In this study, Rvalue has been used as a secondary verification tool to confirm the initial findings.For more detailed information on this technique, readers are directed to [27,37,38].Rvalue is a performance metrics, hence higher numbers indicate better quality, again in contrast with an error metrics.An example of Rvalue verification for the MWRI-LPRMv06 soil moisture product is presented in Figure 2b.

Results
In this section, results from the Triple Collocation for our five product combinations (A to E) are first presented (Figure 3), followed by the results from the Rvalue analysis (Figure 4).Then, a final exercise to determine the agreement between these independent verification techniques is also presented (Figure 5).It should be emphasized that Figure 3 is a central source of information throughout this entire section.This central role can be explained by the significantly large data analysis over the entire People's Republic of China that was summarized for all evaluated product combinations and presented in Figure 3. RMSE from the six passive microwave soil moisture products were binned and presented.Results for these specific product combinations (A to E) are extensively discussed in Section 5, while the explicit product combinations (A to E) discussed later have been highlighted here.Additionally, a brief note on the modifications from the Triple Collocation analysis (Figure 3) to the Rvalue analysis (Figure 4) is also provided.In the first product comparison (A; Table 2), the Triple Collocation results from the algorithm update were compared: the baseline algorithm (▬ LPRMv05) was compared against the updated algorithm (▬ LPRMv06).
In the next product comparison (B; Table 2), the Triple Collocation results from the MWRI-LPRMv06 (▬) were compared against AMSR2-LPRMv06 (▬).Then, the focus shifts to the different frequencies observed by AMSR2 (C; Table 2), where the entire processing and value Technique baseline of the Rvalue technique was presented by Crow and Zhan [43] and uses the n between precipitation and the subsequent changes in soil moisture.Crow et al. [37] the approach to run on anomalies and validated Rvalue as a robust representation of ) correlation-based skill in satellite soil moisture retrieval.Rvalue relies on contrasts in the f rainfall products to evaluate the degree to which analysis increments (derived via the l assimilation of soil moisture into a simple water balance model) accurately compensate n rainfall errors.In this study, the approach presented by [27] and [44] was followed, which y deteriorates the gauge-corrected TRMM 3B42 precipitation product to generate these rrors.There are known limitations ( [22,27,38]) with Rvalue verification over extremely arid that have to do with the requirement of a sufficient number of precipitation events that met under such conditions.These regions were masked in our analysis and are indicated nough precipitation".In line with this limitation is a known limitation of remotely sensed s under very dense vegetation canopies, which was indicated in the figures by "Soil loses skills".In this study, Rvalue has been used as a secondary verification tool to confirm l findings.For more detailed information on this technique, readers are directed to .Rvalue is a performance metrics, hence higher numbers indicate better quality, again in ith an error metrics.An example of Rvalue verification for the MWRI-LPRMv06 soil moisture presented in Figure 2b.
s is section, results from the Triple Collocation for our five product combinations (A to E) are ented (Figure 3), followed by the results from the Rvalue analysis (Figure 4).Then, a final to determine the agreement between these independent verification techniques is also (Figure 5).It should be emphasized that Figure 3 is a central source of information ut this entire section.This central role can be explained by the significantly large data ver the entire People's Republic of China that was summarized for all evaluated product ions and presented in Figure 3. RMSE from the six passive microwave soil moisture were binned and presented.Results for these specific product combinations (A to E) are ly discussed in Section 5, while the explicit product combinations (A to E) discussed later n highlighted here.Additionally, a brief note on the modifications from the Triple on analysis (Figure 3) to the Rvalue analysis (Figure 4) is also provided.e first product comparison (A; Table 2), the Triple Collocation results from the algorithm ere compared: the baseline algorithm (▬ LPRMv05) was compared against the updated (▬ LPRMv06).In the next product comparison (B; Table 2), the Triple Collocation results MWRI-LPRMv06 (▬) were compared against AMSR2-LPRMv06 (▬).Then, the focus shifts to rent frequencies observed by AMSR2 (C; Table 2), where the entire processing and ).For NDVI values at the lower end of the vegetation range (NDVI < 0.45), results obtained by both techniques are clear and consistent with each other.Within this NDVI range, the Triple Collocation technique indicates consistently lower RMSE for AMSR2-LPRM v06 compared to MWRI-LPRM v06 .This result is confirmed by the higher numbers obtained through the R value technique within this lower end of the vegetation range.The only diverging result between the two verification techniques found in this study was demonstrated for the comparison when NDVI values exceed 0.45.While Triple Collocation consistently demonstrates better performance for AMSR2-LPRM v06 ( determine the agreement between these independent verification techniques is also Figure 5).It should be emphasized that Figure 3 is a central source of information this entire section.This central role can be explained by the significantly large data r the entire People's Republic of China that was summarized for all evaluated product s and presented in Figure 3. RMSE from the six passive microwave soil moisture ere binned and presented.Results for these specific product combinations (A to E) are discussed in Section 5, while the explicit product combinations (A to E) discussed later highlighted here.Additionally, a brief note on the modifications from the Triple analysis (Figure 3) to the Rvalue analysis (Figure 4) is also provided.irst product comparison (A; Table 2), the Triple Collocation results from the algorithm e compared: the baseline algorithm (▬ LPRMv05) was compared against the updated LPRMv06).In the next product comparison (B; Table 2), the Triple Collocation results WRI-LPRMv06 (▬) were compared against AMSR2-LPRMv06 (▬).Then, the focus shifts to t frequencies observed by AMSR2 (C; Table 2), where the entire processing and ), the R value indicates a relatively similar performance between AMSR2-LPRM v06 ( followed by the results from the Rvalue analysis (Figure 4).Then, a final agreement between these independent verification techniques is also hould be emphasized that Figure 3 is a central source of information ction.This central role can be explained by the significantly large data ople's Republic of China that was summarized for all evaluated product ted in Figure 3. RMSE from the six passive microwave soil moisture d presented.Results for these specific product combinations (A to E) are ection 5, while the explicit product combinations (A to E) discussed later ere.Additionally, a brief note on the modifications from the Triple re 3) to the Rvalue analysis (Figure 4) is also provided.omparison (A; Table 2), the Triple Collocation results from the algorithm the baseline algorithm (▬ LPRMv05) was compared against the updated the next product comparison (B; Table 2), the Triple Collocation results (▬) were compared against AMSR2-LPRMv06 (▬).Then, the focus shifts to observed by AMSR2 (C; Table 2), where the entire processing and ) and MWRI-LPRM v06 ( In this section, results from the Triple Collocation for our five produc first presented (Figure 3), followed by the results from the Rvalue analys exercise to determine the agreement between these independent veri presented (Figure 5).It should be emphasized that Figure 3 is a cen throughout this entire section.This central role can be explained by t analysis over the entire People's Republic of China that was summarize combinations and presented in Figure 3. RMSE from the six passive products were binned and presented.Results for these specific product extensively discussed in Section 5, while the explicit product combinatio have been highlighted here.Additionally, a brief note on the mod Collocation analysis (Figure 3) to the Rvalue analysis (Figure 4) is also prov In the first product comparison (A; Table 2), the Triple Collocation update were compared: the baseline algorithm (▬ LPRMv05) was comp algorithm (▬ LPRMv06).In the next product comparison (B; Table 2), the from the MWRI-LPRMv06 (▬) were compared against AMSR2-LPRMv06 (▬ the different frequencies observed by AMSR2 (C; Table 2), where ) above this threshold.While the exact reason for this discrepancy remains unknown, several reasons might have an impact.The generally better performance of AMSR2-LPRM v06 ( ection, results from the Triple Collocation for our five product combinations (A to E) are d (Figure 3), followed by the results from the Rvalue analysis (Figure 4).Then, a final etermine the agreement between these independent verification techniques is also igure 5).It should be emphasized that Figure 3 is a central source of information this entire section.This central role can be explained by the significantly large data r the entire People's Republic of China that was summarized for all evaluated product s and presented in Figure 3. RMSE from the six passive microwave soil moisture re binned and presented.Results for these specific product combinations (A to E) are iscussed in Section 5, while the explicit product combinations (A to E) discussed later ighlighted here.Additionally, a brief note on the modifications from the Triple nalysis (Figure 3) to the Rvalue analysis (Figure 4) is also provided.rst product comparison (A; Table 2), the Triple Collocation results from the algorithm compared: the baseline algorithm (▬ LPRMv05) was compared against the updated LPRMv06).In the next product comparison (B; Table 2), the Triple Collocation results RI-LPRMv06 (▬) were compared against AMSR2-LPRMv06 (▬).Then, the focus shifts to t frequencies observed by AMSR2 (C; Table 2), where the entire processing and ) against MWRI-LPRM v06 (

Results
In this section, results from the Triple Collocation fo first presented (Figure 3), followed by the results from exercise to determine the agreement between these in presented (Figure 5).It should be emphasized that Fi throughout this entire section.This central role can be analysis over the entire People's Republic of China that combinations and presented in Figure 3. RMSE from products were binned and presented.Results for these extensively discussed in Section 5, while the explicit pro have been highlighted here.Additionally, a brief no Collocation analysis (Figure 3) to the Rvalue analysis (Figu In the first product comparison (A; Table 2), the Tr update were compared: the baseline algorithm (▬ LPR algorithm (▬ LPRMv06).
In the next product comparison from the MWRI-LPRMv06 (▬) were compared against AM the different frequencies observed by AMSR2 (C; Ta ) is an interesting finding and somewhat unexpected when satellite and sensor characteristics are taken into consideration, as frequency, bandwidth and sensor accuracy are relatively similar.Nonetheless, several other factors can play a role as the LPRM v06 algorithm update [22] was solely developed for AMSR-E observations, which better match AMSR2 than MWRI characteristics.Even though these different sensor characteristics are only slightly different, they can potentially penalize MWRI when directly compared to AMSR2.Besides this single discrepancy, further agreement between the remaining findings is striking.

Conclusions
This study sequentially evaluates a number of surface soil moisture products observed by three different passive microwave sensors with unique characteristics.Different retrieval algorithms, observations frequencies and radiometer characteristics were taken into consideration and the analysis relies on the independent Triple Collocation and Rvalue techniques.Key results were almost consistently confirmed throughout, and the vast majority of the findings are supported by theory; this adds significant credibility to the retrieval algorithms and both verification techniques.Our results indicate that SMOS is significantly affected by RFI over our study area and therefore generally not appropriate to use as sample size requirements could not be met.SMOS revisit times are significantly reduced through the application of the standard RFI filters over the western part of the People's Republic of China and are virtually absent over the densely populated eastern part of the country.Our results furthermore indicate that the AMSR2 soil moisture retrievals (for both observation frequencies) consistently perform better than the SMOS soil moisture retrievals (for LPRMv06 and L-MEB) over our study area.Furthermore, the transition from LRPMv05 to LPRMv06 the only modification being the selection of the C-(▬) and bination D, the results from AMSR2 C-band (▬) and SMOS mpared.This product combination is the only combination tic within the processing chain as we have to consider the (C-band) and SMOS (L-band) but the two sensors on-board eristics.Finally, in product combination E, SMOS L-MEB (▬) ▬).As previously noted, Rvalue is a performance metric, while etric, meaning that these metrics are reversed (i.e. higher igher Rvalue indicates better quality).Since the SMOS soil Collocation sample size requirements (see Section 5), these onsideration.Figure 4 presents the results obtained through completely aligned to Figure 3, with removing the SMOS kewise, Figure 4 also has a central role that again can be data analysis over the entire study area that had to be ) and X-band ( country could not be evaluated through the Rvalue. .

The Rvalue Technique
The baseline of the Rvalue technique was presented by Crow and Zhan [43] and uses the nnection between precipitation and the subsequent changes in soil moisture.Crow et al. [37] apted the approach to run on anomalies and validated Rvalue as a robust representation of nomaly) correlation-based skill in satellite soil moisture retrieval.Rvalue relies on contrasts in the ality of rainfall products to evaluate the degree to which analysis increments (derived via the quential assimilation of soil moisture into a simple water balance model) accurately compensate r known rainfall errors.In this study, the approach presented by [27] and [44] was followed, which tificially deteriorates the gauge-corrected TRMM 3B42 precipitation product to generate these infall errors.There are known limitations ([22,27,38]) with Rvalue verification over extremely arid mates that have to do with the requirement of a sufficient number of precipitation events that nnot be met under such conditions.These regions were masked in our analysis and are indicated "Not enough precipitation".In line with this limitation is a known limitation of remotely sensed gorithms under very dense vegetation canopies, which was indicated in the figures by "Soil oisture loses skills".In this study, Rvalue has been used as a secondary verification tool to confirm e initial findings.For more detailed information on this technique, readers are directed to 7,37,38].Rvalue is a performance metrics, hence higher numbers indicate better quality, again in ntrast with an error metrics.An example of Rvalue verification for the MWRI-LPRMv06 soil moisture oduct is presented in Figure 2b.

Results
In this section, results from the Triple Collocation for our five product combinations (A to E) are st presented (Figure 3), followed by the results from the Rvalue analysis (Figure 4).Then, a final ercise to determine the agreement between these independent verification techniques is also esented (Figure 5).It should be emphasized that Figure 3 is a central source of information roughout this entire section.This central role can be explained by the significantly large data alysis over the entire People's Republic of China that was summarized for all evaluated product mbinations and presented in Figure 3. RMSE from the six passive microwave soil moisture oducts were binned and presented.Results for these specific product combinations (A to E) are tensively discussed in Section 5, while the explicit product combinations (A to E) discussed later ve been highlighted here.Additionally, a brief note on the modifications from the Triple llocation analysis (Figure 3) to the Rvalue analysis (Figure 4) is also provided.
In the first product comparison (A; Table 2), the Triple Collocation results from the algorithm date were compared: the baseline algorithm (▬ LPRMv05) was compared against the updated gorithm (▬ LPRMv06).In the next product comparison (B; Table 2), the Triple Collocation results m the MWRI-LPRMv06 (▬) were compared against AMSR2-LPRMv06 (▬).Then, the focus shifts to e different frequencies observed by AMSR2 (C; Table 2), where the entire processing and ) frequencies observed by the AMSR2 sensor and converted to surface soil moisture through the LPRM v06 algorithm (product comparison C).In line with previous results of the LPRM retrieval algorithm update (product comparison A), results are again very clear.According to both verification techniques, the soil moisture products from the C-( 11 of 17 selection of the C-(▬) and SR2 C-band (▬) and SMOS on is the only combination s we have to consider the t the two sensors on-board ination E, SMOS L-MEB (▬) performance metric, while cs are reversed (i.e. higher lity).Since the SMOS soil ents (see Section 5), these e results obtained through , with removing the SMOS tral role that again can be tudy area that had to be was presented by Crow and Zhan [43] and uses the subsequent changes in soil moisture.Crow et al. [37] lies and validated Rvalue as a robust representation of te soil moisture retrieval.Rvalue relies on contrasts in the e degree to which analysis increments (derived via the o a simple water balance model) accurately compensate approach presented by [27] and [44] was followed, which d TRMM 3B42 precipitation product to generate these s ( [22,27,38]) with Rvalue verification over extremely arid ent of a sufficient number of precipitation events that e regions were masked in our analysis and are indicated this limitation is a known limitation of remotely sensed canopies, which was indicated in the figures by "Soil as been used as a secondary verification tool to confirm formation on this technique, readers are directed to hence higher numbers indicate better quality, again in of Rvalue verification for the MWRI-LPRMv06 soil moisture ollocation for our five product combinations (A to E) are results from the Rvalue analysis (Figure 4).Then, a final een these independent verification techniques is also sized that Figure 3 is a central source of information l role can be explained by the significantly large data of China that was summarized for all evaluated product RMSE from the six passive microwave soil moisture lts for these specific product combinations (A to E) are e explicit product combinations (A to E) discussed later y, a brief note on the modifications from the Triple nalysis (Figure 4) is also provided.ble 2), the Triple Collocation results from the algorithm rithm (▬ LPRMv05) was compared against the updated t comparison (B; Table 2), the Triple Collocation results ed against AMSR2-LPRMv06 (▬).Then, the focus shifts to MSR2 (C; Table 2), where the entire processing and were compared.This product combination is the only combination te a single characteristic within the processing chain as we have to consider the ence between AMSR2 (C-band) and SMOS (L-band) but the two sensors on-board have different characteristics.Finally, in product combination E, SMOS L-MEB (▬) gainst SMOS LPRMv06 (▬).As previously noted, Rvalue is a performance metric, while n produces an error metric, meaning that these metrics are reversed (i.e. higher lower quality while higher Rvalue indicates better quality).Since the SMOS soil ts fail to meet Triple Collocation sample size requirements (see Section 5), these ot taken into further consideration.Figure 4 presents the results obtained through tion with an approach completely aligned to Figure 3, with removing the SMOS only modification.Likewise, Figure 4 also has a central role that again can be e significantly large data analysis over the entire study area that had to be ) remains relatively stable (with some fluctuations) at higher NDVI values, the RMSE values for the X-band frequency (

The Rvalue Technique
The baseline of the Rvalue technique was presented by Crow and Zhan [43] and uses the connection between precipitation and the subsequent changes in soil moisture.Crow et al. [37] adapted the approach to run on anomalies and validated Rvalue as a robust representation of (anomaly) correlation-based skill in satellite soil moisture retrieval.Rvalue relies on contrasts in the quality of rainfall products to evaluate the degree to which analysis increments (derived via the sequential assimilation of soil moisture into a simple water balance model) accurately compensate for known rainfall errors.In this study, the approach presented by [27] and [44] was followed, which artificially deteriorates the gauge-corrected TRMM 3B42 precipitation product to generate these rainfall errors.There are known limitations ([22,27,38]) with Rvalue verification over extremely arid climates that have to do with the requirement of a sufficient number of precipitation events that cannot be met under such conditions.These regions were masked in our analysis and are indicated by "Not enough precipitation".In line with this limitation is a known limitation of remotely sensed algorithms under very dense vegetation canopies, which was indicated in the figures by "Soil moisture loses skills".In this study, Rvalue has been used as a secondary verification tool to confirm the initial findings.For more detailed information on this technique, readers are directed to [27,37,38].Rvalue is a performance metrics, hence higher numbers indicate better quality, again in contrast with an error metrics.An example of Rvalue verification for the MWRI-LPRMv06 soil moisture product is presented in Figure 2b.

Results
In this section, results from the Triple Collocation for our five product combinations (A to E) are first presented (Figure 3), followed by the results from the Rvalue analysis (Figure 4).Then, a final exercise to determine the agreement between these independent verification techniques is also presented (Figure 5).It should be emphasized that Figure 3 is a central source of information throughout this entire section.This central role can be explained by the significantly large data analysis over the entire People's Republic of China that was summarized for all evaluated product combinations and presented in Figure 3. RMSE from the six passive microwave soil moisture products were binned and presented.Results for these specific product combinations (A to E) are extensively discussed in Section 5, while the explicit product combinations (A to E) discussed later have been highlighted here.Additionally, a brief note on the modifications from the Triple Collocation analysis (Figure 3) to the Rvalue analysis (Figure 4) is also provided.
In the first product comparison (A; Table 2), the Triple Collocation results from the algorithm update were compared: the baseline algorithm (▬ LPRMv05) was compared against the updated algorithm (▬ LPRMv06).In the next product comparison (B; Table 2), the Triple Collocation results from the MWRI-LPRMv06 (▬) were compared against AMSR2-LPRMv06 (▬).Then, the focus shifts to the different frequencies observed by AMSR2 (C; Table 2), where the entire processing and ) steadily rise and depart from their C-band ( 11 of 17 modification being the selection of the C-(▬) and D, the results from AMSR2 C-band (▬) and SMOS his product combination is the only combination the processing chain as we have to consider the and SMOS (L-band) but the two sensors on-board inally, in product combination E, SMOS L-MEB (▬) viously noted, Rvalue is a performance metric, while aning that these metrics are reversed (i.e. higher lue indicates better quality).Since the SMOS soil n sample size requirements (see Section 5), these on.Figure 4 presents the results obtained through ely aligned to Figure 3, with removing the SMOS igure 4 also has a central role that again can be ysis over the entire study area that had to be were compared.This product combination is the only combination that cannot isolate a single characteristic within the processing chain as we have to consider the frequency difference between AMSR2 (C-band) and SMOS (L-band) but the two sensors on-board the satellites also have different characteristics.Finally, in product combination E, SMOS L-MEB (▬) was compared against SMOS LPRMv06 (▬).As previously noted, Rvalue is a performance metric, while Triple Collocation produces an error metric, meaning that these metrics are reversed (i.e. higher RMSE indicates lower quality while higher Rvalue indicates better quality).Since the SMOS soil moisture products fail to meet Triple Collocation sample size requirements (see Section 5), these products were not taken into further consideration.Figure 4 presents the results obtained through the Rvalue verification with an approach completely aligned to Figure 3, with removing the SMOS products as the only modification.Likewise, Figure 4 also has a central role that again can be explained by the significantly large data analysis over the entire study area that had to be summarized.
) departures from X-band ( erification techniques that were used in this study: the RMSE from the ror metric; and the precipitation-based Rvalue (b), a performance metric.vers until 50° North (see Section 2.3.3),hence the northeastern part of the ted through the Rvalue.
ue technique was presented by Crow and Zhan [43] and uses the tion and the subsequent changes in soil moisture.Crow et al. [37] n on anomalies and validated Rvalue as a robust representation of kill in satellite soil moisture retrieval.Rvalue relies on contrasts in the evaluate the degree to which analysis increments (derived via the moisture into a simple water balance model) accurately compensate is study, the approach presented by [27] and [44] was followed, which uge-corrected TRMM 3B42 precipitation product to generate these n limitations ( [22,27,38]) with Rvalue verification over extremely arid the requirement of a sufficient number of precipitation events that ditions.These regions were masked in our analysis and are indicated ".In line with this limitation is a known limitation of remotely sensed vegetation canopies, which was indicated in the figures by "Soil study, Rvalue has been used as a secondary verification tool to confirm e detailed information on this technique, readers are directed to nce metrics, hence higher numbers indicate better quality, again in .An example of Rvalue verification for the MWRI-LPRMv06 soil moisture b. m the Triple Collocation for our five product combinations (A to E) are owed by the results from the Rvalue analysis (Figure 4).Then, a final reement between these independent verification techniques is also ld be emphasized that Figure 3 is a central source of information .This central role can be explained by the significantly large data e's Republic of China that was summarized for all evaluated product in Figure 3. RMSE from the six passive microwave soil moisture esented.Results for these specific product combinations (A to E) are on 5, while the explicit product combinations (A to E) discussed later Additionally, a brief note on the modifications from the Triple to the Rvalue analysis (Figure 4) is also provided.arison (A; Table 2), the Triple Collocation results from the algorithm baseline algorithm (▬ LPRMv05) was compared against the updated next product comparison (B; Table 2), the Triple Collocation results ere compared against AMSR2-LPRMv06 (▬).Then, the focus shifts to erved by AMSR2 (C; Table 2), where the entire processing and ) result.This is a finding that perfectly aligns with theoretical expectations and adds credibility to the retrieval algorithm and both verification techniques.
For product combination D, the results from AMSR2-LPRM v06 C-band ( were compared.This product combination is the only combination that cannot isolate a single characteristic within the processing chain as we have to consider the frequency difference between AMSR2 (C-band) and SMOS (L-band) but the two sensors on-board the satellites also have different characteristics.Finally, in product combination E, SMOS L-MEB (▬) was compared against SMOS LPRMv06 (▬).As previously noted, Rvalue is a performance metric, while Triple Collocation produces an error metric, meaning that these metrics are reversed (i.e. higher RMSE indicates lower quality while higher Rvalue indicates better quality).Since the SMOS soil moisture products fail to meet Triple Collocation sample size requirements (see Section 5), these products were not taken into further consideration.Figure 4 presents the results obtained through the Rvalue verification with an approach completely aligned to Figure 3, with removing the SMOS verification chains were identical, with the only modification being the selection of the C-(▬) and X-band (▬) frequencies.For product combination D, the results from AMSR2 C-band (▬) and SMOS (▬) retrieved through LPRMv06 were compared.This product combination is the only combination that cannot isolate a single characteristic within the processing chain as we have to consider the frequency difference between AMSR2 (C-band) and SMOS (L-band) but the two sensors on-board the satellites also have different characteristics.Finally, in product combination E, SMOS L-MEB (▬) was compared against SMOS LPRMv06 (▬).As previously noted, Rvalue is a performance metric, while Triple Collocation produces an error metric, meaning that these metrics are reversed (i.e. higher RMSE indicates lower quality while higher Rvalue indicates better quality).Since the SMOS soil moisture products fail to meet Triple Collocation sample size requirements (see Section 5), these products were not taken into further consideration.Figure 4 presents the results obtained through the Rvalue verification with an approach completely aligned to Figure 3, with removing the SMOS products as the only modification.Likewise, Figure 4 also has a central role that again can be ) were compared.An obvious finding is that RMSE values for SMOS-LPRM v06 are significantly and consistently higher than AMSR2-LPRM v06 .Also, SMOS retrievals are not available over the entire NDVI range considered in the evaluation.The absence of evaluation results for SMOS is related to RFI issues [18], therefore it limits further analysis over the mainland of the People's Republic of China.The standard data flagging procedure that was applied removes too many SMOS data points, such that the Triple Collocation sample size requirements (e.g., [29,38,45]) could not be met.In order to get a better hold on such coverage issues, Figure 7 presents the percentage of days that each of the microwave sensors can be converted to surface soil moisture over the entire analysis period.MWRI (a) and AMSR2 (b) show overall high numbers on the order of 50%, with the exception of the Tibetan plateau, which is at very high elevations and regularly experiences frost at night.In contrast, SMOS (c) is virtually absent over the entire country, with the exception of the far west of the country and a small patch in the northeastern part of the country.

Conclusions
This study sequentially evaluates a number of surface soil moisture products observed by three different passive microwave sensors with unique characteristics.Different retrieval algorithms, observations frequencies and radiometer characteristics were taken into consideration and the analysis relies on the independent Triple Collocation and Rvalue techniques.Key results were almost consistently confirmed throughout, and the vast majority of the findings are supported by theory; this adds significant credibility to the retrieval algorithms and both verification techniques.Our results indicate that SMOS is significantly affected by RFI over our study area and therefore generally not appropriate to use as sample size requirements could not be met.SMOS revisit times are significantly reduced through the application of the standard RFI filters over the western part of the People's Republic of China and are virtually absent over the densely populated eastern part of the country.Our results furthermore indicate that the AMSR2 soil moisture retrievals (for both observation frequencies) consistently perform better than the SMOS soil moisture retrievals (for LPRMv06 and L-MEB) over our study area.Furthermore, the transition from LRPMv05 to LPRMv06 demonstrates consistent improvements over our study area, with improved skills in the order of 5%-10% on average.Our analysis also indicates a generally better performance of AMSR2-LPRMv06 against MWRI-LPRMv06, specifically when the Triple Collocation technique is considered.Then, soil moisture anomalies from the C-and X-band of the AMSR2 sensor were also compared and confirm our theoretical expectations in relation to vegetation density.Specifically, the reduced errors in the AMSR2-LPRMv06 C-band product compared to its X-band equivalent for NDVI values above 0.55 support the retrieval algorithm and both verification techniques.Finally, SMOS results should be interpreted with care due to RFI issues and it was demonstrated that soil moisture retrieval from the MWRI and AMSR2 sensors is a credible alternatives over the mainland of the People's Republic of China.Future studies will aim to further evaluate these products over areas not impacted by RFI.That would further advance the ranking of these passive microwave products against each other.The daytime soil moisture products can also be included in future studies, as well as soil moisture Finally, even though care should be taken with product combination E, SMOS L-MEB consistently performs better than SMOS LPRM v06 .It should be noted that these results are not in line with findings from earlier studies ( [22,23]), which demonstrated similar performance for these two SMOS products.

Conclusions
This study sequentially evaluates a number of surface soil moisture products observed by three different passive microwave sensors with unique characteristics.Different retrieval algorithms, observations frequencies and radiometer characteristics were taken into consideration and the analysis relies on the independent Triple Collocation and R value techniques.Key results were almost consistently confirmed throughout, and the vast majority of the findings are supported by theory; this adds significant credibility to the retrieval algorithms and both verification techniques.Our results indicate that SMOS is significantly affected by RFI over our study area and therefore generally not appropriate to use as sample size requirements could not be met.SMOS revisit times are significantly reduced through the application of the standard RFI filters over the western part of the People's Republic of China and are virtually absent over the densely populated eastern part of the country.Our results furthermore indicate that the AMSR2 soil moisture retrievals (for both observation frequencies) consistently perform better than the SMOS soil moisture retrievals (for LPRMv06 and L-MEB) over our study area.Furthermore, the transition from LRPM v05 to LPRM v06 demonstrates consistent improvements over our study area, with improved skills in the order of 5%-10% on average.Our analysis also indicates a generally better performance of AMSR2-LPRM v06 against MWRI-LPRM v06 , specifically when the Triple Collocation technique is considered.Then, soil moisture anomalies from the C-and X-band of the AMSR2 sensor were also compared and confirm our theoretical expectations in relation to vegetation density.Specifically, the reduced errors in the AMSR2-LPRM v06 C-band product compared to its X-band equivalent for NDVI values above 0.55 support the retrieval algorithm and both verification techniques.Finally, SMOS results should be interpreted with care due to RFI issues and it was demonstrated that soil moisture retrieval from the MWRI and AMSR2 sensors is a credible alternatives over the mainland of the People's Republic of China.Future studies will aim to further evaluate these products over areas not impacted by RFI.That would further advance the ranking of these passive microwave products against each other.The daytime soil moisture products can also be included in future studies, as well as soil moisture from the recent and dedicated Soil Moisture Active and Passive mission once this data record is sufficiently long.

Figure 1 .
Figure 1.Additional datasets used in this study that were provided as supporting information for interpretation purposes include (a) the annual mean TRMM 3B42 (v.7) precipitation product (mm); and (b) NDVI data [-] over the mainland of the People's Republic of China.

Figure 1 .
Figure 1.Additional datasets used in this study that were provided as supporting information for interpretation purposes include (a) the annual mean TRMM 3B42 (v.7) precipitation product (mm); and (b) NDVI data [-] over the mainland of the People's Republic of China.

Figure 2 .
Figure 2. Examples of the verification techniques that were used in this study: the RMSE from the Triple Collocation (a), an error metric; and the precipitation-based Rvalue (b), a performance metric.TRMM precipitation only covers until 50° North (see Section 2.3.3),hence the northeastern part of the country could not be evaluated through the Rvalue.

Figure 2 .
Figure 2. Examples of the verification techniques that were used in this study: the RMSE from the Triple Collocation (a), an error metric; and the precipitation-based R value (b), a performance metric.TRMM precipitation only covers until 50 • North (see Section 2.3.3),hence the northeastern part of the country could not be evaluated through the R value .

Figure 5
Figure 5 presents a final exercise to further confirm the mutual agreement of these verification techniques.This figure presents a direct comparison of both verification techniques for the soil moisture anomalies from Fengyun-3B MWRI, which reveals a very high coefficient of determination (R 2 : 0.81).Colours relate to the corresponding NDVI value, over which both metrics were binned.This mutual agreement, together with the many similarities obtained by Figure 3 (Triple Collocation) and Figure 4 (Rvalue), further demonstrates their reliability.

Figure 5 .
Figure 5.A direct comparison of the Triple Collocation and Rvalue techniques for the soil moisture anomalies from MWRI-LPRMv06.Colours correspond to NDVI values, which demonstrate a reduced performance by both metrics under increasing vegetation density.

17 Figure 2 .
Figure 2. Examples of the verification techniques that were used in this study: the RMSE from the Triple Collocation (a), an error metric; and the precipitation-based Rvalue (b), a performance metric.TRMM precipitation only covers until 50° North (see Section 2.3.3),hence the northeastern part of the country could not be evaluated through the Rvalue.

Figure 2 .
Figure 2. Examples of the verification techniques that were used in this study: the RMSE from the Triple Collocation (a), an error metric; and the precipitation-based Rvalue (b), a performance metric.TRMM precipitation only covers until 50° North (see Section 2.3.3),hence the northeastern part of the country could not be evaluated through the Rvalue.

) 17 Figure 2 .
Figure 2. Examples of the verification techniques that were used in this study: the RMSE from the Triple Collocation (a), an error metric; and the precipitation-based Rvalue (b), a performance metric.TRMM precipitation only covers until 50° North (see Section 2.3.3),hence the northeastern part of the country could not be evaluated through the Rvalue.

Figure 3 .
Figure 3. Results from the Triple Collocation that play a central role in this section.Results were further analysed and several influencing factors such as retrieval algorithms, observation frequencies and radiometer characteristics were isolated.

Figure 4 .
Figure 4. Results from the Rvalue technique for the soil moisture anomalies detected by the MWRI and AMSR2 radiometers in an attempt to confirm findings from the Triple Collocation.

)
frequencies.For product combination D, the results from AMSR2 C-band ( Remote Sens. 2017, 9, 149 11 of 17 verification chains were identical, with the only modification being the selection of the C-(▬) and X-band (▬) frequencies.For product combination D, the results from AMSR2 C-band (▬) and SMOS (▬) retrieved through LPRMv06

Figure 3 .
Figure 3. Results from the Triple Collocation that play a central role in this section.Results were further analysed and several influencing factors such as retrieval algorithms, observation frequencies and radiometer characteristics were isolated.

Figure 4 .
Figure 4. Results from the Rvalue technique for the soil moisture anomalies detected by the MWRI and AMSR2 radiometers in an attempt to confirm findings from the Triple Collocation.

Figure 3 .
Figure 3. Results from the Triple Collocation that play a central role in this section.Results were further analysed and several influencing factors such as retrieval algorithms, observation frequencies and radiometer characteristics were isolated.

Figure 4 .
Figure 4. Results from the Rvalue technique for the soil moisture anomalies detected by the MWRI and AMSR2 radiometers in an attempt to confirm findings from the Triple Collocation.
pres the Rvalue verification with an approach completely aligned to Fig products as the only modification.Likewise, Figure 4 also has explained by the significantly large data analysis over the en summarized.

Figure 3 .
Figure 3. Results from the Triple Collocation that play a central ro further analysed and several influencing factors such as retrieval algo and radiometer characteristics were isolated.

Figure 3 .
Figure 3. Results from the Triple Collocation that play a central role in this section.Results were further analysed and several influencing factors such as retrieval algorithms, observation frequencies and radiometer characteristics were isolated.

Figure 4 .
Figure 4. Results from the Rvalue technique for the soil moisture anomalies detected by the MWRI and AMSR2 radiometers in an attempt to confirm findings from the Triple Collocation.

Figure 3 .
Figure 3. Results from the Triple Collocation that play a central role in this section.Results were further analysed and several influencing factors such as retrieval algorithms, observation frequencies and radiometer characteristics were isolated.

Figure 3 .
Figure 3. Results from the Triple Collocation that play a central role in this section.Results were further analysed and several influencing factors such as retrieval algorithms, observation frequencies and radiometer characteristics were isolated.

Figure 4 .
Figure 4. Results from the Rvalue technique for the soil moisture anomalies detected by the MWRI and AMSR2 radiometers in an attempt to confirm findings from the Triple Collocation.

Figure 4 .
Figure 4. Results from the R value technique for the soil moisture anomalies detected by the MWRI and AMSR2 radiometers in an attempt to confirm findings from the Triple Collocation.

Figure 5
Figure5presents a final exercise to further confirm the mutual agreement of these verification techniques.This figure presents a direct comparison of both verification techniques for the soil moisture anomalies from Fengyun-3B MWRI, which reveals a very high coefficient of determination (R 2 : 0.81).Colours relate to the corresponding NDVI value, over which both metrics were binned.This mutual agreement, together with the many similarities obtained by Figure3(Triple Collocation) and Figure4(Rvalue), further demonstrates their reliability.

Figure 5 .
Figure 5.A direct comparison of the Triple Collocation and Rvalue techniques for the soil moisture anomalies from MWRI-LPRMv06.Colours correspond to NDVI values, which demonstrate a reduced performance by both metrics under increasing vegetation density.

Figure 5 .
Figure 5.A direct comparison of the Triple Collocation and R value techniques for the soil moisture anomalies from MWRI-LPRM v06 .Colours correspond to NDVI values, which demonstrate a reduced performance by both metrics under increasing vegetation density.

Figure 5
Figure 5 presents a final exercise to further confirm the mutual agreement of these verification techniques.This figure presents a direct comparison of both verification techniques for the soil moisture anomalies from Fengyun-3B MWRI, which reveals a very high coefficient of determination (R 2 : 0.81).Colours relate to the corresponding NDVI value, over which both metrics were binned.This mutual agreement, together with the many similarities obtained by Figure 3 (Triple Collocation) and Figure 4 (R value ), further demonstrates their reliability.
Figure5presents a final exercise to further confirm the mutual agreement of these verification techniques.This figure presents a direct comparison of both verification techniques for the soil moisture anomalies from Fengyun-3B MWRI, which reveals a very high coefficient of determination (R 2 : 0.81).Colours relate to the corresponding NDVI value, over which both metrics were binned.This mutual agreement, together with the many similarities obtained by Figure3(Triple Collocation) and Figure4(Rvalue), further demonstrates their reliability.

Figure 5 .
Figure 5.A direct comparison of the Triple Collocation and Rvalue techniques for the soil moisture anomalies from MWRI-LPRMv06.Colours correspond to NDVI values, which demonstrate a reduced performance by both metrics under increasing vegetation density.

)Figure 5
Figure 5 presents a final exercise to further confirm the mutual ag techniques.This figure presents a direct comparison of both verifica moisture anomalies from Fengyun-3B MWRI, which reveals a very high (R 2 : 0.81).Colours relate to the corresponding NDVI value, over whic This mutual agreement, together with the many similarities obt Collocation) and Figure 4 (Rvalue), further demonstrates their reliability.

Figure 5 .
Figure 5.A direct comparison of the Triple Collocation and Rvalue techni anomalies from MWRI-LPRMv06.Colours correspond to NDVI values, wh performance by both metrics under increasing vegetation density.
Again, sim confirmed in a study using soil moisture retrievals based on AMSR-E relative improvements vary over the entire NDVI range, these impro Triple Collocation technique were spatially expressed over our study spatial patterns, which demonstrate that improvements are most pro eastern part of the People's Republic of China, with RMSE reduction RMSE over arid climate regimes towards the western part of the country In the next step (product comparison B), the Triple Collocation resu (▬) were compared against AMSR2-LPRMv06 (▬).For NDVI values at the range (NDVI < 0.45), results obtained by both techniques are clear and Within this NDVI range, the Triple Collocation technique indicates c AMSR2-LPRMv06 compared to MWRI-LPRMv06.This result is confirm final exercise to further confirm the mutual agreement of these verification .This figure presents a direct comparison of both verification techniques for the soil nomalies from Fengyun-3B MWRI, which reveals a very high coefficient of determination olours relate to the corresponding NDVI value, over which both metrics were binned.al agreement, together with the many similarities obtained by Figure 3 (Triple ) and Figure 4 (Rvalue), further demonstrates their reliability.5.A direct comparison of the Triple Collocation and Rvalue techniques for the soil moisture lies from MWRI-LPRMv06.Colours correspond to NDVI values, which demonstrate a reduced ance by both metrics under increasing vegetation density.on roduct comparison A (MWRI-LPRMv05 ▬ versus MWRI-LPRMv06 ▬), the results for the ieval algorithm update were compared.The overall patterns that these two products the increasing NDVI range (from left to right) correspond well.The Triple Collocation ure 3) demonstrate consistently lower RMSE values for LPRMv06 (▬) compared to LPRMv05 he Rvalue results (Figure 4) consistently demonstrate higher Rvalue results for LPRMv06 (▬) to LPRMv05 (▬) over the entire NDVI range.Hence, both these metrics clearly demonstrate performance of LPRMv06 presents these terns, which demonstrate that improvements are most profound in densely populated rt of the People's Republic of China, with RMSE reductions of around 15%, while the arid climate regimes towards the western part of the country is only marginally reduced.next step (product comparison B), the Triple Collocation results from the MWRI-LPRMv06 mpared against AMSR2-LPRMv06 (▬).For NDVI values at the lower end of the vegetation VI < 0.45), results obtained by both techniques are clear and consistent with each other.

Figure 6 17 Figure 2 .
Figure 2. Examples of the verification techniques that were used in this study: the RMSE from the Triple Collocation (a), an error metric; and the precipitation-based Rvalue (b), a performance metric.TRMM precipitation only covers until 50° North (see Section 2.3.3),hence the northeastern part of the country could not be evaluated through the Rvalue.

) 17 re 2 .
were compared against AMSR2-LPRM v06 ( .2017, 9, 149 10 of Examples of the verification techniques that were used in this study: the RMSE from the e Collocation (a), an error metric; and the precipitation-based Rvalue (b), a performance metric.M precipitation only covers until 50° North (see Section 2.3.3),hence the northeastern part of the try could not be evaluated through the Rvalue.

17 Figure 6 .
Figure 6.Spatial patterns representing the RMSE reduction over the study area after the LPRM algorithm update (LPRMv06) compared to the baseline (LPRMv05) for Fengyun-3B MWRI.

Figure 7 .
Figure 7.The percentage of days in which microwave sensors can be converted to surface soil moisture over the entire analysis period (2012-2015) for the three passive microwave sensors considered in this study: MWRI (a), AMSR2 (b) and SMOS (c).

Figure 6 .
Figure 6.Spatial patterns representing the RMSE reduction over the study area after the LPRM algorithm update (LPRM v06 ) compared to the baseline (LPRM v05 ) for Fengyun-3B MWRI.
) and ( niques that were used in this study: the RMSE from the the precipitation-based Rvalue (b), a performance metric.orth (see Section 2.3.3),hence the northeastern part of the e Rvalue.
) X-band frequencies perform equally well until NDVI values of approximately 0.55.In more densely vegetated regions, in which NDVI exceeds this threshold, the results obtained by both verification techniques demonstrate a contrasting performance of these two frequency bands.While the RMSE obtained through the C-band frequency ( 149 11 of 17 ns were identical, with the only modification being the selection of the C-(▬) and encies.For product combination D, the results from AMSR2 C-band (▬) and SMOS ough LPRMv06

Figure 2 .
Figure 2. Examples of the verification techniques that were used in this study: the RMSE from the Triple Collocation (a), an error metric; and the precipitation-based Rvalue (b), a performance metric.TRMM precipitation only covers until 50° North (see Section 2.3.3),hence the northeastern part of the country could not be evaluated through the Rvalue.

)
equivalent.The mutual agreement between the RMSE and the R value has a striking correspondence with a similar NDVI threshold (NDVI > 0.55), at which C-band ( Remote Sens. 2017, 9, 149 11 of 17 verification chains were identical, with the only modification being the selection of the C-(▬) and X-band (▬) frequencies.For product combination D, the results from AMSR2 C-band (▬) and SMOS (▬) retrieved through LPRMv06 identical, with the only modification being the selection of the C-(▬) and X-band (▬) frequencies.For product combination D, the results from AMSR2 C-band (▬) and SMOS (▬) retrieved through LPRMv06

Figure 6 .
Figure 6.Spatial patterns representing the RMSE reduction over the study area after the LPRM algorithm update (LPRMv06) compared to the baseline (LPRMv05) for Fengyun-3B MWRI.

Figure 7 .
Figure 7.The percentage of days in which microwave sensors can be converted to surface soil moisture over the entire analysis period (2012-2015) for the three passive microwave sensors considered in this study: MWRI (a), AMSR2 (b) and SMOS (c).

Figure 7 .
Figure 7.The percentage of days in which microwave sensors can be converted to surface soil moisture over the entire analysis period (2012-2015) for the three passive microwave sensors considered in this study: MWRI (a), AMSR2 (b) and SMOS (c).

Table 1 .
A comprehensive overview of satellite-and sensor characteristics relevant for this study.Columns 2 to 4 present the characteristics of the passive microwave sensors, whereas the 5th column presents those of the active microwave sensor.

Table 2 .
This table provides an overview of all surface soil moisture products that were evaluated, including the sequential steps from product combinations A-E following a number of isolated focus points that include algorithms, satellite platform and observation frequencies.

Table 2
), the Triple Collocation results from the algorithm update were compared: the baseline algorithm ( Remote Sens. 2017, 9, 149 12 of 17