1. Introduction
Satellite-based microwave sounder is a key payload that can obtain the global distribution of atmospheric humidity and temperature profiles by using an inversion algorithm to convert the satellite-based observations to the temperature and humidity profiles [
1]. The atmospheric humidity and temperature profiles retrieved from the microwave sounders are essential atmospheric parameters for the research of climate change, numerical weather prediction, meteorological disaster monitoring and forecasting, and other atmospheric applications [
2,
3,
4]. The retrieval of high-precision temperature and humidity profiles based on passive microwave observations has always been a research hotspot in many meteorological and climate research groups [
5,
6,
7], and the accuracy validation of the retrieved temperature and humidity profiles has attracted considerable attention from researchers and users in the field of atmospheric science.
The retrieval accuracy of the atmospheric profiles using the data of a satellite-based microwave sounder can be affected by many types of factors, such as the data quality of the microwave sounder, the retrieval algorithm, and the seasonal factors related to solar radiation [
8,
9]. However, the validation method is the key point to validate the accuracy and reliability of the retrieved profile. The atmospheric humidity and temperature profiles retrieved by microwave radiometers need to be verified with the value of real profiles. However, the true value of the global atmospheric humidity and temperature profiles is insufficient. In general, the validation of the retrieved profiles is performed by the comparison between the retrieved profiles and other reference profile data such as the reanalysis dataset produced by the assimilation system (e.g., the Reanalysis dataset from the European Center for Medium-Range Weather Forecasts (ECMWF) and the Reanalysis dataset from the National Center for Environmental Prediction (NCEP)), the direct measurement of the atmospheric humidity and temperature profiles detected by the radiosonde, and the retrieved profiles of other instruments that are operated at other frequencies [
10,
11,
12]. Typically, the bias between the retrieved profiles and the reference profile data as well as the root mean square error (RMSE) are key indices to evaluate the retrieval results of the atmospheric humidity and temperature profiles. However, the reference data are also biased against the truth value of the real atmosphere, which may cause an unwanted bias for the validation of the retrieved profiles using reference data.
The reanalysis dataset, which is generated by the assimilation system with input data from multi-observation frequency and methods, is difficult to represent the real atmospheric parameters due to the unremovable errors of the assimilation system. The radiosonde is a balloon-borne instrument working in the atmosphere that sounds the atmospheric parameters including pressure, temperature, moisture, wind, etc. However, the radiosonde observations (RAOB) can have a large bias compared to real atmospheric data or are even invalid due to the systematic errors of the instruments, the drift of the balloon with the wind and other adverse weather conditions. In addition, there is no available RAOB in desert and marine areas that are inaccessible to humans. As for the drawback of setting the retrieved atmospheric temperature and humidity profiles using other instruments such as microwave and infrared sounders as the reference data for the validation, the error of the instruments and the retrieval algorithm used for obtaining these profiles can lead to the bias of these profiles compared to the real profile values. Therefore, the reliability of the validation results can be doubtful when the retrieved atmospheric profiles are verified using the above-mentioned reference data that deviate from the real atmospheric state. For instance, when using the reanalysis data to verify the retrieved atmospheric temperature and humidity profile of a specific pressure layer, the level of the bias between these two types of temperature and humidity profiles can be calculated, while it is hard to determine whether the reanalysis data or the inversion data are closer to the real temperature and humidity profiles.
To obtain more reliable validation results for the retrieved atmospheric temperature and humidity profiles observed by the microwave sounders, the selection of the reference data is of great importance. The microwave sounders sound the atmospheric parameters by measuring the radiation of atmospheric parameters during the emission, absorption, and scattering processes in the atmosphere. Therefore, the observations of microwave sounders reveal the real conditions of the Earth’s atmosphere, although it includes uncertainty caused by the instrument’s systematic, imperfect calibration, unfavorable atmospheric conditions, etc. Based on the literature review, the validation method of the retrieved atmospheric profile typically uses the reanalysis data, RAOB, or the retrieval results of other sounders working at different frequencies, or the combination of the above-mentioned multiple types of data, to improve the reliability of the validation results [
7,
13,
14]. However, there are no reports on using microwave sounder observations as reference data to verify the retrieved results.
This study proposes to use the observation of microwave sounders as the reference data to perform the validation of the retrieved atmospheric profiles of microwave sounders for the purpose of providing more verification results for the application of microwave sounder retrieval of temperature and humidity profiles. First, the microwave observations and the atmospheric temperature and humidity profiles of the reanalysis dataset are fed into the statistical retrieval algorithm to retrieve the atmospheric temperature and humidity profiles. Then, the retrieved atmospheric profiles and the collocated profiles of the reanalysis dataset are fed into the radiative transfer model to calculate the simulated brightness temperatures, respectively, and these two types of simulated brightness temperatures are compared with the observed brightness temperatures of microwave sounder. Finally, the accuracy of these two types of simulated brightness temperatures and the weight function distribution characteristics of the microwave sounder channels are studied to verify whether the atmospheric humidity and temperature profiles retrieved by the microwave sounder or obtained from the reanalysis dataset are closer to the real data in a specific atmospheric pressure range.
The Fengyun-3D satellite is one of China’s second generation of polar-orbiting operational meteorological series satellites, which can achieve 3D observation of the atmosphere and obtain global and quantitative atmospheric and surface parameters under all-weather conditions [
13]. The Fengyun-3D satellite has played an important role in global environment monitoring, disaster monitoring, and climate assessment. microwave temperature sounder-II (MWTS-II), which is used for the detection of atmospheric temperature profiles [
14], and microwave humidity and temperature sounder (MWHTS), which is used for the simultaneous detection of atmospheric humidity and temperature profiles [
15], are two primary passive microwave radiometers onboard Fengyun-3D satellite. In this paper, the validation tests are performed for the atmospheric profiles retrieved from the MWTS-II and MWHTS observations, respectively. The rest of this paper is organized as follows.
Section 2 introduces the data and the preparation method used for this study.
Section 3 presents the retrieval algorithm of the atmospheric temperature and humidity profiles, which is followed by the proposed validation method of the retrieved atmospheric profiles in
Section 4.
Section 5 provides the test results, and the conclusion is summarized in
Section 6.
3. Retrieval Algorithm
In general, the retrieval algorithms for microwave remote sensing consist the physics-based and statistics-based retrievals. Physics-based retrieval is the direct inversion study of the radiative transfer equation, which has the advantages of clear physical principle and high inversion accuracy and is the fundamental way to improve the accuracy of retrieved atmospheric parameters by satellite-based microwave sounders [
31,
32,
33]. The statistics-based retrieval uses the principle of data statistics and does not involve any physical modeling, which makes the statics-based retrieval method have the advantages of low computational effort and high computational efficiency, and easy to build [
34,
35,
36]. However, it should be noted that the statistical inversion method has a strong dependence on the historical data. The low representativeness of historical data or insufficient data volume will lead to poor retrieval accuracy of the statistical retrieval method or even failure in retrieval [
1]. As statistical tools develop by leaps and bounds, the employment of the statistics-based retrieval algorithm in microwave remote sensing has shown great potential and has been widely used for the retrieval of atmospheric profiles using microwave sounders.
Considering that the physical retrieval method needs to use the simulated brightness temperature calculated by the radiation transfer model to fit the observed brightness temperature of the satellite-based microwave sounder, and the verification method we proposed here also needs to use the radiation transfer model to calculate the simulated brightness temperature; to avoid the error transmission caused by the radiation transfer model, the statistical retrieval method is selected. The neural network algorithm is representative of the statistical inversion method. He et al. conducted a comparative study on the performance of the shallow neural network and deep neural network (DNN) in the retrieval of atmospheric parameters by a satellite-borne microwave sounder and verified that the DNN can obtain higher retrieval accuracy and higher stability in retrieval using microwave sounder data [
1]. In this study, the DNN, which has outstanding performance in nonlinear modeling, is studied and developed as a statistics-based retrieval model for the inversion of atmospheric profiles using microwave sounder observations.
Taking the retrieval study of atmospheric temperature and humidity profiles using MWHTS observations as an example, the observed brightness temperature in the analysis dataset for MWHTS built in
Section 2 is set as the input for training the DNN-based retrieval model, while the outputs of the DNN model are the corresponding atmospheric temperature and humidity profiles. For testing the trained DNN-based retrieval model, the observed brightness temperature in the validation dataset for MWHTS is used, and retrieved atmospheric temperature and humidity profiles can be obtained. The RMSE between the temperature and humidity profiles in the analysis dataset for MWHTS and the DNN’s predictions of the temperature and humidity profiles during training is used as an evaluation criterion to optimize and configure the parameters of the DNN during the training of the DNN. The input layer of DNN used in the DNN-based retrieval model has 15 neurons, which receive the observations of 15 channels of MWHTS, and the output layer has 74 neurons, which output the temperature and humidity profiles corresponding to the observations in the input layer. There is one hidden layer in the DNN and 1024 neurons in the hidden layer of the DNN. This configuration is selected after extensive testing with smaller and larger numbers of neurons. In the extensive testing, the trained DNN produces the best result in terms of reproducing the temperature and humidity profiles, which is evaluated by the RMSE between the predictions of the temperature and humidity profiles and the temperature and humidity profiles in the testing dataset. The rectified linear unit (ReLU) is selected as the activation function. RMSprop is selected as the optimizer, which is an adaptive learning rate algorithm for gradient-based optimization, and the learning rate is set to be 0.001. A sufficiently large number of epochs and an early stop method are used during the training of the DNN model to avoid underfitting and overfitting, respectively, in which 20% of the testing samples are used for the monitoring of RMSE in the early stop method. The training will be stopped if the RMSE is stable within 150 adjacent epochs. The flow chart of the DNN-based retrieval algorithm for the retrieval of atmospheric temperature and humidity profiles using MWHTS observations is shown in
Figure 2.
Similarly, the DNN-based retrieval model for MWTS-II can be developed using the observed brightness temperature and temperature profiles in the analysis dataset for MWTS-II built in
Section 2. The settings of the DNN model for MWTS-II are nearly the same as those of the DNN model for MWHTS, except the number of neurons of the input layer, hidden layer, and output layer of the DNN model of MWTS-II, which is set to be 13, 512 and 37. The atmospheric temperature profiles can be retrieved when the observed brightness temperature in the validation dataset for MWTS-II is fed into the DNN retrieval model for MWTS-II.
5. Retrieval Results and Validation
In order to realize the validation of the atmospheric profile retrieved by the microwave sounder based on the microwave sounder observations, multiple experiments are carried out here including the MWTS-II retrieval experiment of temperature profiles, validation experiment of MWTS-II retrieval results, MWHTS retrieval experiment of temperature and humidity profiles and validation experiment of MWHTS retrieval results. This section presents the validation results of retrieved atmospheric profiles of microwave sounders by comparing the traditional validation methods using the reanalysis data as the reference data and the proposed validation method using the microwave sounder observations as the reference data. In particular, four types of validation results are included: (1) the validation results of the retrieved temperature profile of MWTH-II using the ERA5 temperature profiles as the reference data and using the MWTS-II observed brightness temperature as the reference data, respectively, and (2) the validation results of temperature and humidity profiles of MWHTS using ERA5 temperature and humidity profiles as the reference data and using MWHTS observed brightness temperature as the reference data, respectively.
5.1. Validation Results of Temperature Profile Retrieved by MWTS-II
The observed brightness temperature data in the validation dataset for MWTS-II are fed into the retrieval model of MWTS-II to obtain 113,833 sets of retrieved temperature profiles. Then, the ERA5 temperature profiles in the validation dataset for MWTS-II are set as reference values to validate the retrieval values of the temperature profile.
Figure 5 shows the comparison results between the retrieval values from three randomly selected cases of temperature profiles and the reference values of corresponding temperature profiles.
It can be observed from
Figure 5 that the small variations in the structure of the reference temperature profiles can be captured by the three retrieved temperature profiles. For example, the retrieved temperature profiles at 100 hPa can follow the reference temperature profiles in terms of complex structural variations. This result indicates that the developed DNN-based retrieval algorithm is reliable to obtain the retrieved profiles which can be accord with practical physics. Meanwhile, it can be also observed that there are some sort of deviations between retrieved profiles and reference profiles in each case, for example, the difference between the retrieved profile 3 and the reference profile 3 is about 3.6 K at 550 hPa. To analyze the deviations between all the retrieved values of temperature profiles and the reference values, the mean bias and RMSE between the temperature profile reference values and the retrieved values are calculated and shown in
Figure 6.
It can be seen from
Figure 6 that the bias of MWTS-II between the retrieved temperature profiles and the reference temperature profiles is within 1 K, and the largest bias is about 0.9 K at around 5 hPa. As for the RMSE between the retrieved values and the reference values, except for the large value near the top of the atmosphere, the other pressures’ values remain around 2 K. Among them, the RMSE around 200 hPa has the largest value of 2.7 K. It is noted that the results of the retrieved temperature profiles of MWTS-II are validated by using ERA5 reanalysis data, rather than the real profiles, which means that the retrieved temperature profile may be more closed to the real profile compared with the EAR5 temperature profile. Thus, the observed brightness temperature of MWTS-II is further used as the reference data to validate the results of the temperature profile retrieved by MWTS-II.
Based on the validation method developed in
Section 4, 113,833 samples are obtained from the retrieved RSBT calculated by MWTS-II retrieved temperature profile and the RSBT calculated by RA data, respectively. The RMSEs between these two types of simulated brightness temperature and observed brightness temperature are shown in
Figure 7.
Figure 7 shows that the RMSE accuracy of the retrieved RSBT and the RSBT is close to each other for channels 1 to 10 of MWTS-II with a difference within 0.1 K. The accuracy of retrieved-based simulations is greater than that of reference simulations, and the differences are around 0.18 K, 0.26 K, and 1.2 K in channels 11 to 13, respectively. These results indicate that the retrieved temperature profiles of channels 1 to 10 of MWTS-II within the main detection pressure ranges are equivalent to the accuracy of ERA5 temperature profiles. Meanwhile, within the main detection pressure range of channels 11 to 13 of MWTS-II, the retrieved temperature profiles are closer to the real temperature profiles compared to the ERA5 temperature profiles. The channel weighting function of MWTS-II is calculated by using the reference atmospheric data in the analysis dataset for MWTS-II, and a total of 681,844 cases of weighting function calculation results are obtained.
Table 1 shows the main detection pressure range of each channel determined by the analysis of the peak distribution height of the weighting function in each channel.
In this study, the distribution range of weighting function peak values is set as the main detection pressure range of each channel. However, the distribution of the weighting functions of each channel overlaps as shown in
Figure 1, and the shapes and distributed peak values of the channel weighting function could be varied due to the change in weather conditions. Thus, it is possible that the same pressure range can be detected by different channels. It can be observed from
Table 1 that the MWTS-II channels 1–10 have overlapped in the main detection range in some ways, especially the low-altitude detection channels 1–4 of MWTS-II.
The overlapping phenomenon of the main detection range of microwave sounder channels is not conducive to determining whether the retrieved temperature profile or the reference temperature profile is closer to the real profile within the specific pressure range through the comparison results between the retrieved RSBT and the RSBT. However, based on the retrieved RSBT and the RSBT comparison results shown in
Figure 7 and the main detection range of each channel, the validation results can be provided by the comparison between the MWTS-II retrieved temperature profile and the reference temperature profile. In specific, the retrieved accuracy of the temperature profile by MWTS-II is equivalent to the accuracy of the reference temperature profile within the 30–1000 hPa pressure range due to the similar accuracies between the retrieved RSBT of MWTS-II from channel 1 to channel 10 and the corresponding RSBT. Since the accuracy of the retrieved RSBT of MWTS-II from channel 11 to channel 13 is greater than that of the RSBT, the accuracy of the retrieved temperature profile of MWTS-II is also greater than that of the reference temperature profile.
5.2. Validation Results of Temperature and Humidity Profiles Retrieved by MWHTS
A total of 177,199 data cases of retrieved temperature profiles and humidity profiles can be obtained by the MWHTS retrieval model when the observed brightness temperature of the validation dataset for MWHTS is fed into the model, and the temperature profiles and humidity profiles of the reference atmospheric data in the MWHTS validation dataset is used to validate the retrieved values.
Figure 8 shows the comparison results between the retrieved values and the reference values by the three sets of randomly selected temperature and humidity profiles.
Based on the three retrieval cases discussed before, retrieving the humidity profile is more difficult than retrieving the temperature profile in terms of capturing the small changes in the profile structure. The main reason is that the spatial–temporal change in temperature is generally static while that of humidity profile is drastic, and it is difficult to describe the drastic changes in spatial–temporal chrematistics. To analyze the deviation level between the retrieved temperature and humidity profiles and the reference temperature and humidity profiles, the bias and RMSE between the reference values and the retrieved values are calculated and shown in
Figure 9.
As for the temperature profile, the bias between the MWHTS retrieved profiles and the corresponding reference profiles is typically less than 3 K, except for that of the top of the atmosphere. The RMSE between the MWHTS retrieved profiles and the corresponding reference profiles are typically less than 3 K, except for those of the top of the atmosphere and the pressure of 400 hPa with the RMSE of 6 and 4 K, respectively. As for the humidity profile, the bias between the MWHTS retrieved profiles and the corresponding reference profiles is typically less than 4%, except for those of the pressure level ranging from 150 to 225 hPa with a bias of about 6%. The RMSE between the MWHTS retrieved profiles and the corresponding reference profiles is typically less than 20%. It should be noted that the above validation of the MWHTS retrievals of the temperature and humidity profiles uses the ERA5 reanalysis data, rather than the real profiles.
Next, the MWHTS observed brightness temperature is used to further validate the temperature and humidity profiles retrieved by MWHTS. The 177,199 data cases including RSBT and retrieved-based RSBT are calculated and obtained by using RA data and retrieved-based RA data in the validation dataset for MWHTS.
Figure 10 shows the RSME results between these two types of simulated brightness temperature and the observed brightness temperature.
It can be seen from
Figure 10 that the accuracy of RSBT is greater than that of retrieved RSBT in channels 1 to 10. For the temperature detection in channels 2 to 9, except for channels 3 and 6, the accuracy of RSBT is higher than that of retrieval RSBT. Among them, channels 7 to 9 are higher than 0.5 K while channels 2 and 4 are higher than 1 K. In humidity detection channels 11 to 15, the accuracy of the retrieved RSBT is higher than that of the RSBT, where the accuracies in channels 11 and 12 are the most obvious values of 1.18 K and 1.35 K, respectively. According to the accuracy comparison discussed above, the retrieved temperature profiles within the main detection range of channel 3 and channel 6 are closer to the real temperature profiles compared to the reference temperature profiles. However, in the remaining pressure range, the retrieved temperature profiles are not as good as the reference temperature profiles close to the real temperature profiles.
The main detection pressure range of each MWHTS channel is determined by the statistics using the peak distribution of weight function calculated by the analysis dataset for MWHTS, which can further provide the validation results of retrieved temperature and humidity profiles from MWHTS from the perspective of pressure.
Table 2 shows the main detection pressure range of each channel of MWHTS.
According to the comparison results between of the retrieved RSBT and the RSBT of MWHTS, the accuracy of the retrieved RSBT from the temperature detection channel 6 is higher, and the main detection range of channel 6 is from 250 hPa to 775 hPa. The main detection range overlaps with the main detection pressure range of channel 5 and channels 7 to 9, and the accuracy of retrieved RSBT in these channels is not as good as the RSBT. Thus, this comparison result of channel 6 to evaluate the retrieval accuracy of the temperature profile cannot be used. Based on the accuracy of the retrieved RSBT in channel 3 being higher, and the main detection range of this channel being around 50 hPa, it is indicated that the retrieved temperature profile near 50 hPa is closer to the real temperature profile than the reference temperature profile, while the accuracy of the retrieved temperature profile is worse than the reference temperature profile in the rest of pressure range. Due to the accuracy of the retrieved RSBT being greater than that of the RSBT in humidity channels 11 to 15 of MWHTS, the humidity profiles retrieved by MWHTS are closer to the real humidity profiles than the reference humidity profiles in channels 11 to 15 within 350 hPa to 925 hPa.
Based on the above analysis, when the observed brightness temperature of the microwave sounder is used as the reference data to validate the retrieved results of the microwave sounder, more references on the validation results of the reference data based on reanalysis data can be provided. Specifically, when the temperature profile retrieved by MWTS-II is validated through the observed brightness temperature of MWTS-II within the pressure range of 30 hPa to 1000 hPa, the accuracy of the temperature profile retrieved by MWTS-II is basically the same as the accuracy of the temperature profile of ERA5. Then, the accuracy of the temperature profile retrieved by MWTS-II is higher than that of the temperature profile of ERA5 within the pressure range from 3 hPa to 30 hPa. When the temperature and humidity profiles retrieved by MWHTS are validated through the observed brightness temperature of MWHTS within the pressure around 15 hPa, the accuracy of the temperature profile retrieved by MWHTS is higher than the accuracy of the temperature profile of ERA5, while the accuracy of the retrieved temperature profile is lower than that of the temperature profile of ERA5 under the rest of the pressure range. Meanwhile, the accuracy of the humidity profile retrieved by MWHTS is higher than that of the humidity profile of ERA5 under the pressure range of 350 hPa to 925 hPa.
6. Conclusions
This study uses microwave sounder observations to validate the accuracy of the atmospheric temperature and humidity profiles retrieved by microwave sounders. The simulated brightness temperature using the retrieved profiles of the microwave sounder and the reference atmospheric profiles of the ERA5 reanalysis dataset are compared and the main detection range of the atmospheric pressure is determined to perform the comparison study of the retrieved profiles and the ERA5 profiles in specific pressure range, which provide a good reference for the application of the retrieved atmospheric profiles. The validation experimental results show that the retrieved temperature profiles of MWTS-II have higher accuracy compared to the temperature profiles of ERA5 in the atmospheric pressure range of 3–30 hPa, and the accuracy of the rest of the pressure range is comparable between the profiles of ERA5 and the retrieved profiles. And the retrieved temperature profiles of MWHTS have higher accuracy compared to the temperature profiles of ERA5 in the atmospheric pressure level around 50 hPa and lower accuracy in the rest of the pressure levels. In addition, the retrieved humidity profiles of MWHTS have higher accuracy compared to the humidity profiles of ERA5 in the atmospheric pressure range of 350–925 hPa. According to the research results of this study, it can be concluded that the method of using spaceborne microwave sounder observations as the reference data to verify the retrieved profiles of satellite-based microwave sounders is feasible, and it can provide valuable references for the application of satellite-based microwave sounders to invert atmospheric parameters.
It is noted that the validation method of the retrieved profiles using microwave observations is essentially a comparison of the retrieved atmospheric profiles with the corresponding profiles in ERA5 reanalysis data. If we have more reference data such as the RAOB or other retrieved data from satellite-based instruments, more valuable and promising validation results may be obtained. Meanwhile, the results are obtained from the validation study of retrieved results of MWTS-II and MWHTS within the selected geographical range. Carrying out the verification of satellite-borne microwave sounder inversion parameters on a global scale is a systematic project, and it is also of great significance for the application of satellite-borne microwave sounder observations. Therefore, more types of reference atmospheric profile data will be induced to perform the validation for the retrieved atmospheric profiles, and more verification will be performed over a wider geographical area, which is the focus of our next research topic. In addition, the validation study is performed for the retrieval results of microwave sounder under all weather conditions and the study under specific weather conditions will be performed in the future, which can be promising to obtain more interesting validation results.