3.1. GMEC Accuracy Validation
Both the Global Mean Electron Content derived from podTc2 data (POD GMEC) and the Global Mean Electron Content derived from ionPrf data (PROF GMEC) demonstrate significantly improved accuracy compared to the GMEC derived from the IRI-2020 model.
Figure 7a presents the daily mean error time series for the 2024 test dataset, where CODE GMEC is used as the reference, and the error profiles of POD GMEC, PROF GMEC, and IRI-derived GMEC (IRI GMEC) are compared.
Figure 7b shows the daily mean time series of CODE GMEC in 2024. As shown in the figure, the IRI GMEC error exhibits pronounced high-frequency and large-amplitude fluctuations throughout the test period, and the fluctuation amplitude shows a clear correlation with the magnitude of the CODE GMEC, with peak errors occasionally exceeding 10 TECU. In contrast, the errors of both PROF GMEC and POD GMEC exhibit minor fluctuations around 0 TECU, maintaining relatively stable amplitude variations. The pattern of their error peaks and troughs shows a certain degree of correlation with CODE GMEC. During the period from September to November, when CODE GMEC errors reach higher magnitudes, the errors of PROF GMEC and POD GMEC also peak, slightly exceeding 5 TECU. These results demonstrate that both COSMIC-2–based models are capable of accurately estimating GMEC, closely aligning with the reference CODE GMEC values. Moreover, they effectively capture the overall temporal dynamics of the global ionosphere.
Table 3 summarizes the statistical performance of the three GMEC approaches over the entire test period. The IRI-2020 model yields a mean absolute error (MAE) of 5.5 TECU and a root mean square error (RMSE) of 6.8 TECU. In comparison, the POD model achieves an MAE of 2.2 TECU and an RMSE of 3.5 TECU, representing improvements of 60.0% and 48.5%, respectively. The PROF model records an MAE of 2.5 TECU and an RMSE of 3.5 TECU, corresponding to improvements of 54.5% and 48.5%, respectively.
Figure 8 displays the error scatter density plot and error distribution histogram for the GMEC estimates derived from the IRI-2020 model, POD model, and PROF model, compared with the reference CODE GMEC values during the 2024 test period. The color bar indicates the kernel density estimation (KDE) of the scatter plot, representing the relative density of data points in the two-dimensional space. The linear correlation between the IRI GMEC and the CODE GMEC is relatively weak, with a correlation coefficient of 0.691. The scatter plot shows a higher number of outliers, and the points are more widely dispersed away from the diagonal, validating the limitations of this model in estimating GMEC. In contrast, the POD GMEC shows a strong linear relationship with the CODE GMEC, with a correlation coefficient of 0.918. The density scatter plot indicates that the POD model provides highly accurate and stable GMEC estimates in most periods, with minimal estimation errors and dense scatter points clustered near the diagonal. In comparison, the PROF model exhibits a slightly lower correlation coefficient of 0.883, indicating a slightly weaker linear relationship than the POD model. The scatter plot for the PROF model shows a relatively more dispersed trend, suggesting that its GMEC estimation accuracy is somewhat lower. The estimation errors for both the POD and PROF models are generally stable and concentrated. The error distribution for the POD GMEC and the PROF GMEC is centered around 0 TECU, with most errors falling within the range of ±10 TECU, exhibiting characteristics close to a Gaussian distribution. In contrast, the error distribution for the IRI GMEC is more dispersed, with larger errors ranging from −10 TECU to 20 TECU, and the error is not centered around 0 TECU, indicating significant systematic bias.
Overall, as an empirical ionospheric model, IRI-2020 exhibits significant limitations in accurately representing GMEC. Among the two proposed modeling approaches, the POD model demonstrates superior performance, offering the highest prediction accuracy and strongest correlation with the reference values, while the PROF model shows slightly lower performance by comparison.
3.2. GMEC Response to Geomagnetic Storms
The occurrence of geomagnetic storms leads to significant ionospheric disturbances worldwide, with GMEC serving as an important indicator of these disturbances. To assess the responsiveness of the POD GMEC and the PROF GMEC to geomagnetic storms, a case study was conducted on the POD and PROF models during three major geomagnetic disturbance events in 2024.
Figure 9 presents the time series of GMEC values alongside the Dst index during these three storm periods. Specifically,
Figure 9a–c correspond to the geomagnetic storms that occurred on 10–13 May, 28–29 June, and 10–11 October of 2024, respectively. The minimum Dst values during these events reached –412 nT, –335 nT, and –105 nT, indicating strong storm intensities. The vertical dashed lines in the figure indicate the times of the maximum and minimum values of the CODE GMEC, highlighting the key moments of ionospheric disturbances during each geomagnetic storm. All three events were triggered by coronal mass ejections impacting the Earth’s magnetosphere. Prior to the onset of the storms, the geomagnetic field remained relatively stable with Dst values near zero. Following each storm event, the Dst value gradually recovers back to near zero, indicating the restoration of the geomagnetic field. Notably, significant disturbances in GMEC were observed during each of the three storm periods. A clear correlation was found between storm intensity and GMEC fluctuation magnitude—stronger geomagnetic storms were associated with more pronounced GMEC variations.
The CODE GMEC clearly characterizes both the positive and negative phase disturbances of the ionospheric storm induced by geomagnetic storms. Before the storm occurs, the Dst index remains near zero with minor fluctuations, and during this period, the fluctuations in the CODE GMEC are also relatively small. In the initial phase of the storm, the Dst index briefly increases, followed by a rapid decline into the main storm phase, where the Dst index drops sharply into negative values. During this rapid decline in the Dst index, the CODE GMEC also shows a temporary increase, followed by a distinct downward trend. Compared to the Dst index, there is a slight delay in the time at which the CODE GMEC reaches its minimum value. In the recovery phase of the storm, as the Dst value gradually rises back toward zero, the CODE GMEC similarly recovers to a state close to its pre-storm condition. The response of GMEC exhibits a lag effect relative to changes in the magnetic field.
The overall fluctuation trends and intensity changes of the POD GMEC and PROF GMEC before and after geomagnetic storms are consistent with those of the CODE GMEC. During the storm, however, there is a numerical discrepancy between the PROF GMEC and CODE GMEC in terms of the magnitude of the positive phase peak and the negative phase trough. Specifically, after the storm begins, as the Dst index rapidly decreases, both the POD GMEC and PROF GMEC show a positive phase peak. However, the positive phase peak for both the POD GMEC and PROF GMEC is generally lower than that of the CODE GMEC. Once the Dst index reaches its minimum value, the POD GMEC and PROF GMEC also exhibit a minimum value after a brief lag. It is noteworthy that the positive phase peak of the POD GMEC and PROF GMEC after the storm is significantly lower than that of the CODE GMEC, which may be related to the limited coverage of occultation observations. The three geomagnetic storms were caused by coronal mass ejections reaching Earth, with high-energy ions entering the ionosphere through the polar regions. Therefore, after the storm, the CODE GMEC shows a positive phase peak. However, since COSMIC-2’s observational range is limited between latitudes 45° N and 45° S, it is unable to effectively capture ionospheric anomalies in the polar regions, resulting in a smaller response during this phase.
Compared to the CODE GMEC, both the POD GMEC and PROF GMEC exhibit more pronounced fluctuations, with the POD GMEC showing greater instability than the PROF GMEC. This instability may stem from the limited number of radio occultation events available for modeling within each one-hour observation window, making the model more susceptible to the influence of individual measurements. Additionally, the PROF product is derived under the assumption of spherical symmetry, which inherently introduces inversion errors. Despite these factors, the POD GMEC demonstrates better agreement with the CODE GMEC than the PROF GMEC, exhibiting smaller discrepancies in both the timing and magnitude of the minimum values.
3.3. IRI-2020 Model Calibration
To verify the calibration capability of the convolutional neural network with additional GMEC features on the empirical global ionospheric model, the CODE GIM product was used as the reference. Accuracy analysis was performed on the IRI-2020 global TEC map (IRI TEC) and the model corrected using GMEC during both a quiet period (5 January 2024) and a geomagnetic storm period (28 June 2024). Since the POD GMEC has slightly higher accuracy than the PROF GMEC, operates at a lower product level, and does not rely on the spherically symmetric inversion process, only the POD GMEC-Calibrated IRI Global TEC Model (referred to as GCIRI TEC) was analyzed.
During the ionospheric quiet period, the GCIRI TEC shows a significant improvement in accuracy compared to the IRI TEC model.
Figure 10 illustrates the TEC distribution maps for the CODE TEC, IRI TEC, and GCIRI TEC over six-hour intervals on 5 January 2024, during the geomagnetic quiet period, along with the error distribution maps for IRI TEC and GCIRI TEC. From the global TEC distribution, the GCIRI TEC is closer to the CODE TEC than the IRI TEC, both in terms of overall distribution and local details. This is particularly evident in regions of stronger ionospheric activity (higher TEC values), where the GCIRI TEC more accurately reflects the true TEC values. Further analysis of the TEC error distribution shows that the corrected IRI TEC model significantly reduces estimation errors worldwide, with notable improvements in both underestimated and overestimated areas.
Figure 11 presents the error distribution histograms for the GCIRI TEC model and the IRI TEC model over the entire day of 5 January 2024, during the geomagnetic quiet period. The error distribution of the GCIRI TEC model is centered around 0 TECU, with most error values concentrated within ±10 TECU, showing a more focused distribution compared to the IRI TEC model. In contrast, the original IRI TEC model exhibits a more dispersed error distribution with larger errors. The average error (Mean), mean absolute error (MAE), and root mean square error (RMSE) for the IRI TEC model are −0.4 TECU, 6.7 TECU, and 8.8 TECU, respectively. For the GCIRI TEC model, the Mean, MAE, and RMSE are −0.8 TECU, 3.2 TECU, and 4.4 TECU, respectively. The GCIRI TEC model shows improvements of 52.09% and 50.07% in the MAE and RMSE metrics, respectively, indicating a significant increase in accuracy. The experimental results demonstrate that the corrected IRI TEC model exhibits higher accuracy and predictive capability in estimating ionospheric TEC, showing a clear advantage over the original IRI-2020 model.
Figure 12 presents the variation in RMSE for the GCIRI TEC and IRI TEC relative to the CODE TEC over Universal Time (UT) on 5 January 2024, during a geomagnetically quiet period. Given the stable geomagnetic conditions on that day, the ionosphere remained relatively undisturbed, resulting in minor fluctuations in the TEC. Overall, the RMSE fluctuations of the GCIRI TEC and IRI TEC are both less than 2 TECU, and the temporal variation patterns of RMSE with respect to UT were largely consistent between the two models. Notably, the GCIRI consistently achieved a 4–5 TECU reduction in RMSE compared to IRI, which aligns well with the calibration performance observed in the four representative time periods presented in
Figure 10.
Figure 13 presents RMSE statistics across different latitudes. The IRI TEC exhibits substantial latitudinal variability in RMSE, ranging from 3.8 TECU to 14.1 TECU, with notably inferior performance in low-latitude regions and high-latitude areas of the Southern Hemisphere. In contrast, the GCIRI TEC demonstrates significant accuracy improvements, maintaining RMSE values between 2.6 TECU and 6.7 TECU. Elevated errors for the GCIRI are primarily confined to equatorial latitudes (−20° to 20°), while the most pronounced accuracy enhancements occur at mid-to-high Southern Hemisphere latitudes.
Similarly, during the geomagnetic storm period, the GCIRI TEC also shows a significant improvement in accuracy compared to IRI TEC.
Figure 14 presents the difference maps between the IRI TEC, GCIRI TEC, and CODE TEC over six-hour intervals during the geomagnetic storm on 28 June 2024. During the geomagnetic disturbance, the IRI TEC failed to accurately reflect global ionospheric TEC variations, resulting in significant discrepancies with the CODE TEC. Specifically, the error maps revealed substantial regions of both underestimation and overestimation. This indicates that the IRI TEC model exhibits considerable errors in capturing ionospheric changes during geomagnetic storms. In contrast, the GCIRI TEC more accurately mirrors the true global ionospheric TEC variations, with its distribution aligning more closely with the CODE TEC. Additionally, the GCIRI TEC model significantly reduced the areas of underestimation and overestimation in the error maps, demonstrating a higher level of accuracy.
Figure 15 presents the error distribution histograms for the GCIRI TEC and IRI TEC models throughout the entire day during the geomagnetic storm on 28 June 2024. Compared to the original IRI TEC model, the GCIRI TEC model aligns more closely with the CODE TEC. The error distribution of the IRI TEC model has a broader range, spanning from −50 TECU to +50 TECU, while the error distribution of the corrected IRI TEC model is notably narrower, indicating an improvement in accuracy. The IRI TEC model has a Mean, MAE, and RMSE of −1.9 TECU, 9.2 TECU, and 12.1 TECU, respectively. In contrast, the GCIRI TEC model has a Mean, MAE, and RMSE of −2.8 TECU, 6.9 TECU, and 9.8 TECU. The GCIRI TEC model shows improvements of 24.9% in MAE and 19.2% in RMSE, demonstrating enhanced accuracy.
Figure 16 presents the variation in RMSE of the GCIRI TEC and IRI TEC relative to the CODE TEC over UT time during the geomagnetic storm period on 28 June 2024. Under geomagnetically disturbed conditions, ionospheric activity intensifies significantly, resulting in larger fluctuations, with RMSE reaching 12–16 TECU for IRI and 8–13 TECU for GCIRI. Overall, GCIRI exhibits lower RMSE values compared to IRI, with a consistent improvement of approximately 1 to 4 TECU, indicating that GCIRI maintains a certain degree of robustness even under strong geomagnetic disturbances. Notably, starting from 00:00, the RMSE of both models increases gradually, reaching a peak around 09:00, and declining to stabilized low-error levels after 17:00 UT. This diurnal variation closely aligns with the trend of Dst index, reflecting a typical ionospheric response to geomagnetic storm activity.
Since the variation in TEC is closely related to both latitude and longitude, and the observational coverage of the COSMIC-2 satellite constellation is geographically constrained, the performance of the GCIRI TEC varies across different regions. In the low- and mid-latitude bands (−45° to 45°), where ionospheric activity is more intense, the IRI model tends to significantly overestimate TEC. In contrast, the GCIRI model demonstrates substantial improvements in this region, providing a more accurate representation of localized ionospheric structures such as equatorial anomalies. At higher latitudes, where ionospheric variability is relatively mild, the IRI model often underestimates TEC. However, due to the limited COSMIC-2 data availability in these regions, the performance gains of GCIRI in high-latitude areas are comparatively modest. In the longitudinal direction, GCIRI exhibits relatively consistent improvements across different longitudes, with no significant variation, primarily because COSMIC-2 observations are uniformly distributed in longitude.
It is worth noting that the GCIRI TEC model exhibits an uneven structure in the polar regions. This may be due to the non-smooth edges of the IRI TEC in the polar regions during geomagnetic storms, a feature that the convolutional neural network captures and amplifies in the reconstructed image. The new model shows limitations in overcoming this non-smooth edge effect, which should be taken into consideration during its application. In addition,
Figure 10 and
Figure 14 reveal noticeable small-scale variations in the GCIRI TEC, along with slight numerical discontinuities. These features highlight a current limitation of the CNN model. Nevertheless, the accuracy of the GCIRI TEC model during geomagnetic storms is significantly superior to that of the original IRI TEC model. Overall, the GCIRI TEC model demonstrates relatively good performance both during geomagnetic quiet periods and storm periods.
Figure 17 displays latitude-dependent RMSE distributions for the selected day. The IRI TEC exhibits substantial RMSE variability (5–22 TECU) across latitudes, with degraded accuracy particularly evident in low- and high-latitude regions. Similarly, the GCIRI TEC demonstrates significant accuracy improvements at mid–low latitudes (−20° to 40°). However, GCIRI underperforms IRI in polar regions beyond ±70° latitude—a limitation likely attributable to COSMIC-2’s observational gap in these areas.
Furthermore, the accuracy of the IRI TEC and GCIRI TEC throughout the year 2024 was compared.
Figure 18 presents a time series histogram of the monthly average RMS differences between the IRI-2020 model and CODE GIM, before and after calibration. As shown in the figure, the RMS values after calibration are consistently lower than those before calibration. This improvement is particularly notable during the peak months of September, October, and November. Before calibration, the monthly RMS values ranged from a minimum of 11.5 TECU to a maximum of 22.9 TECU, with an annual mean of 15.8 TECU. After calibration, the RMS values were significantly reduced, with a minimum of 5.2 TECU, a maximum of 17.1 TECU, and an annual mean of 11.1 TECU. Overall, the RMS was improved by 29.9% over the course of 2024. These results demonstrate that the calibrated model significantly enhances the accuracy of the IRI-2020 model, improves its performance under complex ionospheric conditions, and substantially reduces discrepancies with the CODE GIM. This highlights the effectiveness of the calibration in refining empirical ionospheric modeling.