Due to the direct interference of noise behavior on the SSR retrieval results in this article, compared with the application scenario, the noise characteristics of the water-tank experiment scenario are more significant, which is suitable for analyzing model performance. Therefore, in this section, we use water-tank experiment scenario data to conduct SSR retrieval discussion.
4.1. Noise Analysis
We analyzed the interference of noise on the SSR retrieval results. When there is no noise behavior, (18) can be written as follows:
According to (19), the results of using image digital signals to retrieve SSR are the same as the results of using radiation to retrieve SSR. Compare the results of (18) and (19). Using the parameters in
Table 3 and
Figure 2, the results of using two angle images to retrieve SSR without noise behavior are shown in
Table 5. The comparison of the results of using multi angle visible spectrum images to retrieve and fit SSR is shown in
Figure 4.
It can be seen from
Table 5 that when the simulated SSR values are 0.02, 0.03, 0.04, and 0.05, according to (19) and using two angle images retrieval method, the relative errors of retrieved SSRs using CMOS imaging system are 7.0%, 6.7%, 7.8%, and 9.0%, respectively, and the relative errors of retrieved SSRs using TDI-CCD imaging system are 9.5%, 8.3%, 9.0%, and 10.2%, respectively. Compared with the results in
Table 3, the relative errors retrieved using CMOS imaging system decreased by 4.0%, 2.7%, 2.3%, and 2.0%, while the relative errors retrieved using TDI-CCD imaging system decreased by 6.5%, 4.3%, 3.7%, and 3.2% after introducing noise behavior.
It can be seen from
Figure 4 that when using multi angle visible spectrum images retrieval method, the retrieval accuracy of the fitted SSRs according to (18) is higher than that according to (19). When the simulated SSR values are 0.02, 0.03, 0.04, and 0.05, the relative errors of fitted SSRs using CMOS imaging system are 8.5%, 7.0%, 8.0%, and 9.4%, and the relative errors of fitted SSRs using TDI-CCD imaging system are 10.0%, 8.7%, 9.3%, and 10.0% according to (19). The relative errors retrieved using CMOS imaging system decreased by 5.0%, 2.7%, 2.5%, and 2.0%, while the relative errors retrieved using TDI-CCD imaging system decreased by 7.0%, 5.0%, 4.3%, and 3.2%.
Simulation experiment results for noise analysis show that as the simulated SSR increases, the difference in relative error of retrieved SSR before and after introducing noise interference tends to decrease. Introducing noise behavior into the multi angle SSR retrieval model can effectively improve retrieval accuracy.
It should be pointed out that the data analyzed in this article is image data obtained by CMOS or TDI-CCD sensors. The characteristic of these data is that random noise accumulates on the original signal, which also affects the consistent positive bias characteristics of our SSR retrieval results. Although the retrieval accuracy of the fitted SSR using (18) is higher than that of the SSR based on (19), the randomness of noise still leads to deviations between the retrieval results and the simulated SSR.
Analyze the interference of different noise levels on model accuracy. Using simulated SSR of 0.02 as an example for discussion. For TDI-CCD and CMOS sensors, assuming that the lighting conditions and imaging parameters in
Section 3.1. remain unchanged, and the shot noise remains unchanged, we artificially increase the calculated values of readout noise and dark current noise by two, three, and four times, and represent these four noise levels as
Ndr1,
Ndr2,
Ndr3, and
Ndr4. The retrieved SSRs under different noise levels were calculated using both two angle and multi angle methods, and the results are shown in
Table 6. It can be seen from
Table 6 that there is not much difference in the accuracy of SSR retrieval for four different noise levels, and the retrieval results using two view zenith angles of 20° and 40° are approximately consistent. The results retrieved from the other two angles showed no significant difference. However, there are cases where the signal-to-noise ratio of imaging at certain angles is low, and the increase in noise causes certain retrieval bias, resulting in a decrease in the retrieval accuracy of multi angle fitting. Overall, the increase in dark current and readout noise will lead to a certain decrease in retrieval accuracy, but the overall results are still better than the model results without considering noise behavior.
Keep the calculated values of readout noise and dark current noise unchanged, and change the solar radiation value to affect the level of shot noise. Using four solar radiation levels of 5 W/m
2, 10 W/m
2, 15 W/m
2, and 20 W/m
2, the corresponding noise levels were represented as
Ns1,
Ns2,
Ns3, and
Ns4 for SSR retrieval. The results are shown in
Table 7. It can be seen from
Table 7 that when using two view zenith angles of 20° and 40° for retrieval, the approximate results of SSR are consistent. When using multi angle fitting to retrieve results, different levels of noise can lead to differences in retrieval accuracy. Among the four selected noise levels, the lower the solar radiation, the lower the SSR retrieval accuracy. Although an increase in solar radiation brings more shot noise, the number of signal electrons also increases, and the decrease in the proportion of noise keeps the retrieval accuracy stable and improves at some angles. Overall, under different levels of noise, the performance of the SSR retrieval model is still better than that without considering noise behavior. In summary, the proposed model has a certain degree of robustness to different levels of noise.
4.2. Angle Analysis
Sensitivity analysis was conducted on the impact of view zenith angles on SSR retrieval accuracy. Firstly, we fitted SSRs using different numbers of view zenith angles to analyze their impact on the SSR fitted accuracy.
Assuming the solar zenith angle is 30°, the solar azimuth angle is 270° and the view azimuth angle is 45°. We use combinations of three view zenith angles, four view zenith angles, and five view zenith angles to calculate and analyze SSRs. Among them, six representative combinations of three view zenith angles were selected, namely (20°, 30°, 40°), (25°, 35°, 45°), (20°, 25°, 30°), (25°, 30°, 35°), (30°, 35°, 40°), and (35°, 40°, 45°). By combining every two view zenith angles, three pairs of images and three retrieval SSRs can be obtained. Six representative combinations of four view zenith angles were selected, namely (20°, 25°, 30°, 35°), (25°, 30°, 35°, 40°), (30°, 35°, 40°, 45°), (20°, 25°, 40°, 45°), (20°, 25°, 30°, 40°), and (20°, 30°, 40°, 45°). By combining every two view zenith angles, six pairs of images and six retrieval SSRs can be obtained. Six representative combinations of five view zenith angles were selected, namely (20°, 25°, 30°, 35°, 40°), (20°, 30°, 35°, 40°, 45°), (20°, 25°, 35°, 40°, 45°), (20°, 25°, 30°, 40°, 45°), (20°, 25°, 30°, 35°, 45°), and (25°, 30°, 35°, 40°, 45°). By combining every two view zenith angles, 10 pairs of images and 10 retrieval SSRs can be obtained. The fitting operation was performed on the SSR retrieval results obtained from image pairs at different angles, and fitted SSRs using different numbers of angles are shown in
Figure 5. Calculate the mean and standard deviation of fitted SSRs at different numbers of angles, as shown in
Table 8 and
Table 9.
From
Figure 5 and
Table 8 and
Table 9, it can be seen that the selection of the number of view zenith angles has a certain impact on the results of our model, whether for CMOS or TDI-CCD. The more view zenith angles selected, the more stable the fitted SSR data obtained. The reason for the above pattern is due to the relatively large errors in SSR values retrieved from individual angles before fitting. When the number of angles is insufficient, the SSR retrieval results with large errors will interfere with the final fitting results. When the number of angles increases, the fitting method adopted in this article can effectively avoid the interference of outliers and maintain stable fitting accuracy to the maximum extent. When the sea surface roughness level increases, the retrieval error will increase, and a smaller number of view zenith angles may cause significant errors. For example, when the simulated SSR is 0.05, the standard deviation of SSRs fitted with three angles reaches 0.0015. When the three view zenith angles are (20°, 25°, 30°), the fitted SSR is 0.0574. When adding one angle to (20°, 25°, 30°, 35°), the fitted SSR increases to 0.0550. And when adding another angle to (20°, 25°, 30°, 35°, 40°), the fitted SSR increases to 0.0538. Therefore, for higher levels of sea surface roughness, using more angles to fit SSR can achieve better retrieval accuracy and stability.
Using different numbers of retrieved SSRs for SSR fitting, and analyze their impact on fitting accuracy. From the SSR retrieval results obtained from 15 view zenith angles (20°, 25°, 30°, 35°, 40°, 45°), 3~14 sets (including 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14) of data from different view zenith angles were randomly selected for SSR fitting. The fitting operation was repeated 10 times for each set, and the data used in each repeated experiment was inconsistent. The fitted SSRs with different numbers of retrieved SSRs are shown in
Figure 6 and
Figure 7. Analyze the fitted SSRs in
Figure 6 and
Figure 7, and the mean and standard deviation of fitted SSRs using different numbers of retrieved SSRs are shown in
Table 10 and
Table 11.
From
Figure 6 and
Figure 7, and
Table 10 and
Table 11, it can be seen that the numbers of retrieved SSRs have a certain impact on the results of our method, whether for CMOS or TDI-CCD. Consistent with the empirical pattern of data fitting, the more retrieved SSRs there are, the better the stability of fitting SSRs. When the number of retrieved SSRs is few, there may be results with a small mean but a large standard deviation, which means that when one of the fitted SSR values is taken as the retrieval result, there may be a significant error in that value. However, when the number of angles increases, the fitting method used in this article can effectively avoid the interference of outliers and maintain the maximum stability of fitting accuracy. However, when there are a large number of retrieved SSRs, the error value is relatively controllable. From the ratio of the standard deviation to its mean, when randomly using five or more sets of retrieved SSRs for data fitting, the impact of error is relatively small. When the simulated SSR is 0.05, the standard deviation is on the order of 3.0000 × 10
−4 or below. It should be pointed out that the results in
Figure 6 and
Figure 7,
Table 10 and
Table 11 are statistical values obtained through 10 rounds of random sampling. The mean and standard deviation obtained here may differ from the results in
Figure 5 and
Table 8 and
Table 9. The results in
Figure 5 and
Table 8 and
Table 9 are special cases of the results in
Figure 6 and
Figure 7 and
Table 10 and
Table 11.
In addition, a comparison of the data in
Table 10 and
Table 11 shows that the standard deviation of TDI-CCD is smaller than that of CMOS, mainly due to the higher signal-to-noise ratio of TDI-CCD after multiple noise accumulations. However, when the retrieved SSRs are 3 and 4, the data shows that the standard deviation of CMOS seems to be smaller. The main reason for this pattern is that the data used in each repeated experiment needs to be consistent, while the retrieved SSRs of TDI-CCD have the same values in many angles, which leads to fewer selectable angle combinations and an increase in standard deviation.
In summary, whether using different numbers of angles or different numbers of retrieved SSRs, the model can exhibit better stability when using more fitting data. However, in practical applications, it is more difficult to obtain images from more angles, so it is necessary to make a reasonable selection of the number of fitting data based on an acceptable range of error.
4.3. Sensor Parameter Analysis
Local and global sensitivity analysis were conducted to quantify how parameter uncertainties impact SSR retrieval. The key parameters and their uncertainties considered for CMOS and TDI-CCD sensors are shown in
Table 12 and
Table 13. It should be noted that in order to quantify the impact of parameter uncertainty on the proposed model, we added 10% uncertainty to all key parameters. However, in practical applications, the baseline values and uncertainties of relevant parameters may differ, so calculations can be made based on the specific parameter values of the detector.
The basis of the model proposed in this article is two angles model, therefore the retrieval results of the view zenith angles of 20° and 40° are used for analysis. Using the One-at-a-time method for local sensitivity analysis, the impact of single parameter uncertainty on SSR retrieval results was analyzed by calculating the SSR retrieval results corresponding to each parameter under +10% and −10% uncertainty. The relative error of SSR retrieval results (all results were calculated as absolute values) was used as the sensitivity indicator for evaluation. The local sensitivity analysis results for CMOS and TDI-CCD sensors are shown in
Table 14 and
Table 15, respectively.
It can be seen from
Table 14 and
Table 15 that using two view zenith angles of 20° and 40° for retrieval, for CMOS sensors, the error interference between F-Number and full well capacity is relatively large, while the error interference between optical system transmission and quantum efficiency is relatively small. For TDI-CCD sensors, the error interference between F-Number and full well capacity is relatively large, while the error interference between optical system transmittance, average spectral responsivity, charge conversion factor, and total charge transfer efficiency is relatively small. Overall, the uncertainty of parameters in both CMOS and TDI-CCD sensors can interfere with the accuracy of SSR retrieval. From the function of the proposed model, it can be seen that due to the randomness of noise, the interference of parameter uncertainty also has a certain degree of randomness, and the degree of interference is also related to the signal-to-noise ratio of the data used. Overall, under ±10% uncertainty, the relative error of SSR retrieval accuracy caused by a single parameter is within 0.80%.
We perform global sensitivity analysis using Monte Carlo method. We conducted 2000 random samplings within the uncertainty range of [−10%, +10%] to analyze the global interference of parameters uncertainty within ±10% on SSR retrieval results. The sensitivity indicators were evaluated based on the maximum relative error (all results were calculated in absolute value) and average relative error (all results were calculated in absolute value) of SSR retrieval results. The global sensitivity analysis results for CMOS and TDI-CCD sensors are shown in
Figure 8.
It can be seen from
Figure 8 that according to the simulation parameters we selected, for both CMOS and TDI-CCD sensors, the random sampling retrieval results within the uncertainty range of [−10%, +10%] show that the maximum relative error of SSR retrieval accuracy is within 1.40%, and the average relative error is within 0.70%. It should be pointed out that
Table 14 and
Table 15 and
Figure 8 show a trend of decreasing relative error values in SSR retrieval results with increasing SSR. The main reason for this trend is that the calculation process of relative error is to divide the absolute error by the SSR baseline value. The larger the SSR value, the smaller the relative error.