Next Article in Journal
Sources and Variability of Plutonium in Chinese Soils: A Statistical Perspective with Moving Average
Next Article in Special Issue
Comparison between Multi-Physics and Stochastic Approaches for the 20 July 2021 Henan Heavy Rainfall Case
Previous Article in Journal
Impact of Environmental Regulation on Efficiency of Green Innovation in China
Previous Article in Special Issue
Evidence for Intensification in Meteorological Drought since the 1950s and Recent Dryness–Wetness Forecasting in China
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Application of Affinity Propagation Clustering Method in Medium and Extended Range Forecasting of Heavy Rainfall Processes in China

National Meteorological Center, China Meteorological Administration, Beijing 100081, China
*
Author to whom correspondence should be addressed.
Atmosphere 2022, 13(5), 768; https://doi.org/10.3390/atmos13050768
Submission received: 3 April 2022 / Revised: 26 April 2022 / Accepted: 7 May 2022 / Published: 9 May 2022
(This article belongs to the Special Issue Meteorological Extremes in China)

Abstract

:
Based on the precipitation data of an ensemble forecast from the European Centre for Medium-Range Weather Forecasts, we establish a clustering model named EOF_AP by using the empirical orthogonal function decomposition and the affinity propagation clustering method. Then, using EOF_AP, we conducted research on the identification and classification of the characteristics of medium and extended range forecasts on 11 heavy rainfall events in the middle–lower reaches of the Yangtze River, North China, and the Huanghuai region, from June to September in 2021. We then selected two representative cases to analyze the common characteristics in detail to evaluate the effect of the model. The results show that the EOF_AP clustering model can better identify and classify the main rainfall pattern characteristics, and their corresponding occurrence probability of heavy rainfall processes, on the basis of comprehensively retaining the main forecast information of ensemble members with a few representative types. The rainfall pattern characteristics of some types with low occurrence probability can be identified, such as the extreme type. The distributions of rainfall patterns of the same type are basically consistent, whereas those among different types are distinct. Moreover, through the comparison of the forecast results with different starting times, we analyze the forecast performance of ensemble members and the variation trend of forecast results. We hope this study can provide a reference for the probability forecast of medium and extended range heavy rainfall process.

1. Introduction

Heavy rainfall is one of the main significant disastrous weather events in China, and it can induce severe floods, geological disasters, and urban waterlogging [1], such as the torrential rain on 21 July 2012 in Beijing [2], and the extreme rainfall on 20 July 2021 in Henan [3]. Both events resulted in serious economic losses and casualties. The key to reduce heavy rainfall disaster and its secondary disasters is to improve the accuracy of heavy rainfall forecast. At present, numerical models, as the basis of modern weather forecast operation, have played a very important role in the heavy rainfall forecast; however, many factors can affect the forecast of heavy rainfall, so heavy rain forecasting is one of the most difficult challenges of numerical forecasts [4,5], and the forecasting skill improves slowly [6,7]. In addition, with the increase of forecast leading time, the forecast uncertainties of heavy rainfall in the model increase rapidly, which results in the significant decrease of forecast reliability [8,9,10,11].
In recent years, in order to improve the accuracy of the heavy rainfall forecast, weather forecast centers in many countries around the world are vigorously developing ensemble forecast and high-resolution numerical forecast systems [12,13,14]. The advantage of the ensemble model lies in revealing the nonlinear uncertainty of weather processes, which is especially suitable in medium-term forecast [15]; however, the advantage of the ensemble model also brings new difficulties. One difficulty concerns how the forecaster can quickly and efficiently extract highly valuable information from the massive data produced by the ensemble model, so as to improve the precipitation forecast skill, especially when forecasting heavy rainfall [16,17].
In the real-time quantitative precipitation forecast business of the National Meteorological Center of China, a variety of statistical post-processing methods have been established, such as the probability matching average, quantile mapping, and some machine learning methods (logistic regression [18], support vector machine [19] and Bayes-o-Bayesian [20,21]). In addition, the National Meteorological Center also studies the application of deep learning methods [22,23,24,25,26] in precipitation forecasting, which currently have achieved a good effect in the nowcasting/short-term forecast. Dai et al. [12] classified the post-processing methods and pointed out that different methods should be used to correct deviations based on different correction purposes and application scenarios. In operational applications, most of the post-processing methods of ensemble forecasting simply integrate the results of ensemble members to form an objective single-value forecast, which improves the skill of a single-value forecast but loses part of the forecast information.
At present, the post-processing method finds it difficult to correct the inherent defects of the numerical models [12], and the effect of these methods depends on the prediction performance of the models. The research of Dai et al. [27] and Wang et al. [28] on the extreme heavy rainfall process in North China from 19 to 20 July 2016, shows that the high-resolution deterministic forecasts and most ensemble forecast members have obvious deviation in the medium-range forecast. Moreover, although the forecast performance has significantly improved in terms of the short-range forecast, it is hard to correct such changes using post-processing technology. Williams et al. [29] and Liu et al. [30] also found that the post-processing technology capacity of heavy rainfall is not good due to the low occurrence frequency, and the general distribution model cannot effectively reflect its precipitation characteristics. From this point of view, for the medium and extended range forecast, the forecast information should be retained as much as possible, so that the forecaster can make a comprehensive judgment for the occurrence probability of heavy rainfall and its possible distribution characteristics. Compared with the deterministic forecast results with large deviations, the ensemble forecast should be more meaningful for disaster prevention and mitigation.
In the products of the ensemble forecast, the stamp map can integrate the forecast information of all members on one map. For precipitation, the stamp map presents all the forecast information, such as the position and intensity of the relevant rainbands of all ensemble members [31], thus fully covering the forecast information; however, in this process, the results of each member are only simply integrated, so the information points are scattered and interfered with each other, resulting in low forecast analysis efficiency. Especially for the medium and extended range forecast, there would be a variety of possible rainband distributions with a large difference among them. As a result, it is difficult to extract effective information; therefore, we need a method that can not only preserve the forecast information of each ensemble member, but also have a high forecast analysis efficiency.
Clustering analysis is a branch of the big data analysis, and it can reveal the inherent nature and law of data through the learning of unlabeled training samples. It is widely used in unsupervised learning, which is a branch of machine learning, and has also been widely used in meteorological fields for diagnostic analysis and weather forecasting [32,33,34,35]. The commonly used clustering methods include partition clustering, hierarchical clustering, density clustering, grid clustering, fuzzy clustering, spectral clustering, and so on [36]. From the needs of the operational weather forecast, the affinity propagation (AP) clustering is selected in this study, which belongs to the partition clustering method. AP clustering was proposed by Frey and Delbert Dueck [37]. Its characteristics include that all data points have the same possibility to become cluster exemplars, and the number of clusters and initial cluster centers are not pre-specified. The cluster centers can be composed of the data samples themselves, and no composite is required. At the same time, they are not sensitive to the initial value. Under the same parameter settings, the algorithm results are exactly the same [38]. AP clustering has been applied to many fields and has achieved some good results [39], such as image recognition, segmentation, retrieval, and text mining. In addition, in order to extract the main information of the ensemble members, the original ensemble forecast data are preprocessed by using the empirical orthogonal function (EOF) decomposition before the clustering analysis [40].
Based on the precipitation data of the ensemble forecast from the European Centre for Medium-Range Weather Forecast (ECMWF), the EOF decomposition, and the AP clustering method, we establish an EOF_AP clustering model to study the identification and classification of the characteristics of the medium and extended range forecasts on heavy rainfall processes. Moreover, the application evaluation of the EOF_AP clustering model is conducted. We hope this study can provide a reference for the medium and extended range forecast on heavy rainfall processes.

2. Data and Method

2.1. Data

The observational precipitation data are the 24 h accumulated precipitation data at 00:00 (UTC; the same below) at 2413 intensified observation stations from June to September in 2021.
The ensemble forecast data are the ensemble forecast precipitation data from the ECMWF global ensemble forecast model initialed at 12:00 every day. The data is from June to September of 2021. The data domain is 70–150° E, 0–60° N, with a spatial resolution of 0.5° × 0.5°. The number of ensemble members is 51.
This study mainly focuses on the heavy precipitation processes in the middle and lower reaches of the Yangtze River with a domain of 110–125° E, 25–35° N, and in the North China and Huanghuai Region with a domain of 110–125° E, 30–45° N, from June to September of 2021.

2.2. Method

2.2.1. Principle of AP Clustering Method

AP clustering has a high-efficiency classification effect, its purpose is to find several optimal cluster exemplars, so that the sum of the similarity of their represented objects is the largest [41]. AP clustering does not need to specify the number of clusters. In addition, it is not sensitive to the initial value. With comprehensive consideration given, compared with other clustering algorithms, AP clustering is more suitable for the research of this study. The specific algorithm is as follows.
In the initial stage of AP clustering, all samples are regarded as potential cluster centers, and the responsibility information of each sample point to other sample points is established, which is the similarity matrix, s . For any i and j , the similarity matrix s is calculated by s i , j = x i y j 2 [41]. In addition, the AP clustering algorithm involves three important parameters, i.e., preference parameter, responsibility and availability.
The preference parameter p i represents the tendency of the data point i to be selected as the cluster center and can be initially assigned a prior value.
The responsibility r i , k points to point k from sample i, which indicates the tendency of sample k to be the cluster center of sample i .
The availability   a i , k indicates the appropriateness of sample i to select sample k as the cluster center, and it considers the appropriateness for all the other samples to select k as the cluster center.
r i , k s i , k max a i , k + s i , k k k ,  
a i , k m i n [ 0 , r k , k + i s . t .   i i , k r ( i , k ) ] ,  

2.2.2. EOF_AP Clustering Model

The EOF decomposition is widely used in the meteorological field. It can be used to analyze the characteristic vector and time function of a physical quantity, and to eliminate noise in data [40]. In order to identify the characteristics of heavy rainfall forecasts from 51 ensemble members, the EOF_AP clustering model is adopted in this study, which is based on the EOF decomposition. It regards the ensemble member sequence as a time series, and obtains the spatial mode and member function of ensemble precipitation forecast after the EOF decomposition. Then, the AP clustering method is used to analyze and classify the time (member) function sequence of the selected main modes, so as to identify the main types of ensemble precipitation forecast and their occurrence probability. Figure 1 shows the technology roadmap of the EOF_AP clustering model and the specific steps are as follows.
In step 1, for a certain rainfall process, the EOF decomposition is carried out on the rainfall forecast data of 51 ensemble members with the same forecast leading time and the same starting time, and the error range of the characteristic vector is used for the significance test [42]. The time (member) function of the EOF spatial modes is used as a sample of clustering factors; therefore, the number of selected modes will also affect the clustering results. After comparison, it is found that the clustering effect is best when the time (member) functions of the first two modes are selected. Continuing to increase the modes will cause information interference, thus reducing the clustering effect. At the same time, the first two modes can generally pass the significance test, but the third mode sometimes fails to pass the significance test. Overall, the time (member) functions of the first two modes of EOF decomposition with a total of 102 (51 × 2) samples are used as the clustering factor samples in this study, to achieve the dimensionality reduction and denoising of original ensemble forecast data.
In step 2, the preference parameter p i is set to be twice the minimum value in the similarity matrix s , the parameters r and a are set to 0 at the beginning of the algorithm, and then the iterative calculation is carried out until convergence. Based on the AP clustering model, the 102 samples obtained in step 1 are subjected to clustering analysis, and each cluster center and the cluster members are obtained. According to its index in each ensemble member, the identification and clustering of the main rainfall types of the ensemble forecast are realized.
At different start times, steps 1 and 2 are repeated. Then, the main rainfall types of the ensemble forecast are obtained. Furthermore, the results are compared and analyzed. As a result, the predictable information of the heavy rainfall processes in the ensemble model can be extracted quickly and efficiently.

3. Application Effect of EOF_AP Clustering

In this section, a total of 11 heavy rainfall events (Table 1) that occurred in the middle and lower reaches of the Yangtze River, and in North China and the Huanghuai region, from June to September of 2021, are selected. The EOF_AP clustering model is used to identify and classify the rainfall types of heavy rainfall processes forecasted by the ensemble model, and to extract the predictable information of the ensemble model. We select two representative heavy rainfall processes (from 29 June to 2 July in the middle and lower reaches of the Yangtze River, and from 19 July to 21 July in the North China and Huanghuai region) to analyze their similarities and differences in detail.

3.1. Application Effect for the Heavy Rainfall Process in the Middle and Lower Reaches of the Yangtze River

In this section, five heavy rainfall processes occurred in the middle and lower reaches of the Yangtze River in 2021 and are analyzed. Among them, is the heavy rainfall process from 29 June to 2 July, which had a wide range and strong intensity. The heavy rainfall occurred in the northern regions south of the Yangtze River, east of Jianghan and southwest of Jianghuai, with accumulated precipitation of 50–200 mm and up to 300–400 mm in local regions (Figure 2). This process is taken as an example to illustrate the specific application of the EOF_AP clustering model in the heavy rainfall processes in the middle and lower reaches of the Yangtze River, and the forecasting effect is also discussed.
Based on the forecast data of the ECMWF ensemble model, its forecast effect on this heavy rainfall process is analyzed. The forecast starting time is at 12:00 on 20–28 June 2021, and the rolling forecast leading time is 300 h–108 h. The analysis of the stamp map of the ensemble forecast for the accumulated precipitation (not shown), with different starting times, shows that the uncertainty of the rainband in this process is relatively large, and the longer the forecast leading time is, the greater the differences among the ensemble members will be. The differences mainly include three aspects. The first is the location and orientation of the rainband. The second is the north–south width of the rainband, and some members even have two rainbands. The third is the intensity of the rainband center. As the number of members is large, the members are independent of each other, and the differences are large, it is impossible to directly classify each member, which is not conducive to the rapid and efficient extraction of the predictability information of ensemble forecast.
Therefore, the EOF_AP clustering model is used to classify the ensemble members with different forecast leading times, and the effect of this model is judged by the comparison of the consistency among the same types and the differences among different types. Figure 3 shows the clustering results of the accumulated precipitation from 29 June to 2 July of the ECMWF ensemble forecasts with the start time at 12:00 on 22 June. There are 12 types of clustering results. The analysis of Figure 3 shows that the EOF_AP clustering results have the following general characteristics. Firstly, the rainfall pattern characteristics of each clustering member are relatively consistent for the same clustering type. Taking type 1 as an example (the value of clustering center index is 1, and the clustering members include (1,19,27,45)), the heavy rainfall areas are located in the south of the Yangtze River. The rainbands are all almost in a quasi east–west orientation, and the rainfall intensity is relatively consistent among different members. The forecasted local accumulated precipitation in some areas of northern Jiangxi reaches more than 300 mm. Secondly, there are obvious differences in rainfall pattern between different types. For example, the locations of the clustering centers and the forecasted rainbands of the type 2 (the value of clustering center index is 9) members are more northward, which are located in the Yangtze River and its northern region, with weaker intensity and a wider north–south width. The characteristics of type 12 (the value of clustering center index is 51) are opposite to those of type 2. The locations of the clustering centers and the rainbands are more southward, which are located in the central and southern regions of the Yangtze River. The third is the identification of anomalous or discrete distribution types. The accumulated rainfall in the rainband center exceeds 600 mm in type 4 (the value of clustering center index is 17), suggesting that there might be some extremity for the heavy rainfall processes.
The above results show that the EOF_AP clustering model can identify and classify the rainfall pattern characteristics of the heavy rainfall process forecasted by each ensemble member well, and can provide the member information and statistical information of each type, which is convenient for rapid analysis and judgment. The feature of being relatively consistent in the same type and obviously different in different types indicates its good clustering performance.
At the same time, the anomalous rainfall patterns with small occurrence probabilities can be extracted, which gives a certain indication of extreme rainfall. Of course, this model cannot give a direct correction result. Its main feature is to summarize the possible situations and provide the occurrence probability, so as to provide a reference for forecasters to quickly grasp the main characteristics of ensemble forecasts and make corresponding subjective corrections.
Figure 4 shows a rolling comparison of clustering results of the ensemble forecasts with different start time from 20 to 28 June. Each row has the same start time and is arranged in a descending order of the number of cluster members. The analysis shows that, for the heavy rainfall process, in the clustering results of ECMWF ensemble forecasts with different start times, there are certain forecasts close to observations (marked by the red box). On one hand, it shows that the ensemble forecast has the ability to predict this process. On the other, it also reflects that EOF_AP clustering can effectively extract this information. By analyzing the characteristics of the EOF_AP clustering results of each start time, it is found that among the clustering results forecasted before 27 June, most of the forecast types close to the observations are those with low occurrence probabilities due to the long forecast leading time. Moreover, as the forecast leading time is shortened, the occurrence probability does not increase steadily. For the clustering results of the forecasts initiated on 27 and 28 June, the discreteness of the rainbands in the main clustering centers gradually decrease, and the probability of the forecasts close to observations increases significantly.
In this section, the EOF_AP clustering model is used to analyze the five heavy rainfall processes in the middle and lower reaches of the Yangtze River, and the rainfall process from 29 June to 2 July, which had one of the largest heavy rainfall areas and rainfall intensities, is taken as an example to analyze the application effect. Overall, there are some common features, which are as following: from the perspective of forecasting, for heavy rainfall processes, the advantage of an ensemble forecast in medium and extended range forecasts does not lie in the forecast accuracy, but in providing a variety of occurrence possibilities and their probabilities. Furthermore, in a long-term forecast, the members with a small occurrence probability often contain the forecast information closest to observations. The EOF_AP clustering model can better identify and classify the main information of each ensemble member. It can especially retain and distinguish the member types with a low occurrence probability, which effectively realizes the rapid and efficient extraction of predictable information from the ensemble model. As a result, it could provide an early warning for disaster prevention and decision-making.

3.2. Application Effect for Heavy Rainfall Processes in North China and the Huanghuai Region

The six heavy rainfall processes which occurred in North China and the Huanghuai region in 2021 are analyzed, and the extreme heavy rainfall process which occurred in Henan from 19 to 21 July is taken as an example to illustrate the forecast effect of EOF_AP clustering. During this rainfall process, heavy rainstorms occurred in the central and northern parts of the Henan province for three consecutive days. The accumulated rainfall generally exceeded 400 mm, and the maximum rainfall during the process was 1122.6 mm. The daily rainfall of 20 national meteorological stations in Zhengzhou, Xinxiang, Hebi, and Anyang has broken the historical record (Figure 5). The ECMWF ensemble forecasts that began at 12:00 on 10 to 18 July 2021 are selected. Due to the extreme intensity of rainfall in this process, there are obvious differences in the location and intensity of rainfall forecasted by each ensemble member (figure omitted), which is not conducive for direct classification statistics. In light of this, the EOF_AP clustering model is used to classify the members with different forecast start times, and the consistency in the same type and the difference in the different types are also compared. The results show that the EOF_AP clustering model has the same classification effect for this process. That is, the rainfall pattern characteristics of each clustering member in the same type are relatively consistent, and the rainfall patterns in different types have obvious differences. At the same time, the extreme rainfall can be identified (figure omitted). It also indicates that the clustering effect of this model is relatively stable for heavy rainfall processes in different regions with different characteristics.
In order to further analyze the application effect of EOF_AP clustering, Figure 6 shows the rolling comparison of clustering results of ensemble forecasts initiated at different times during 10–18 July. Each row has the same start time and is arranged in descending order of the number of clustering members. Considering the extreme situation and distribution characteristics of the rainfall in Henan, in order to facilitate the statistical analysis of the clustering effect, the clustering results of the ensemble forecasts are marked according to their matching degree with the observational rainfall, as shown in Figure 6. The main analysis results are as follows.
In this paragraph, we analyze the forecast effect of the extremity. The extreme rainfall, as a low probability event, is also a type with low occurrence probability among the ensemble forecast members. In the clustering results shown in Figure 6, if the extreme characteristics are measured by whether the forecasted accumulated rainfall exceeds 400 mm, most of the results with different start times have types that can reflect the extreme characteristics (indicated by red and yellow boxes). Moreover, there are certain types that can provide a better forecast with the rainband location, that are closer to observations, and can present the extremity well. For example, the accumulated rainfall with a start date of 10 July, forecasted by type 13, is more than 600 mm in southwestern Henan, and the accumulated rainfall with a start time of 12 July, forecasted by types 11 and 12, is 500–800 mm and above in western and northern Henan. The accumulated rainfall with a start time of 16 July, forecasted by types 8, 9, and 11, is 600–800 mm and above in western and central Henan. This means that in most of the forecasts, the extremity of the rainfall process has been reflected in different start times. The EOF_AP clustering model can effectively identify and extract such members with low occurrence probability.
In addition, two points need to be explained. First, in Figure 6, the locations of extreme rainfall, forecasted by types with a start time from 13–15 July, are all located in the Hubei area, and there are certain deviations from the observations. In the clustering results of the forecasts initiated on 18 July, there is no forecast type with a rainfall intensity over 400 mm, and the overall rainfall intensity is noticeably underestimated. By comparison with the original ensemble members, the above situations basically conform to the forecast of the original ensemble members (figure omitted). This also suggests that the core of the EOF_AP clustering model is not to correct the model results, but to recombine the model results, and the performance of EOF_AP clustering model depends on the performance of ensemble model. The EOF_AP clustering model can effectively extract the forecast information of each ensemble member. Second, in the operational medium and extended range forecast, although there are some deviations in terms of the location of extreme rainfall, there is still some useful information on the variation trend of rainfall intensity.
In this paragraph we analyze the forecast effect of rainband location. According to the location forecast of the heavy rainfall shown in Figure 6, if we judge the performance of rainband location forecast by whether the rainfall center (wherein the accumulated rainfall must exceed 200 mm) is located in Henan, most of the results have types that can reflect the rainfall location close to the observations (indicated by red and blue boxes). As the forecast leading time is shortened, in the results that started before 16 July, the members of each type with a rainband location close to the observation are relatively lesser, that is, the occurrence probability is low. In the results that started after 16 July, the members of each type with the rainband location close to the observation increase significantly, and the occurrence probability increases significantly. Note that the results that started on 18 July are not marked in the figure due to the weak rainfall intensity of less than 200 mm in many types, but the locations of the rainfall center of each type are close to observations. This feature shows that, unlike the extremity forecast, which always has a low probability, when the forecast leading time is shortened, the occurrence probability for the relatively accurate rainband location forecast increases, and the predictability is improved; however, it should be noted that the occurrence probability does not gradually increase as the forecast leading time is shortened. For example, the occurrence probability in the clustering results of the forecasts starting on 13–15 July does not increase significantly, nor are they even lower than before. A similar phenomenon also appears in other rainfall processes.
To sum up, under the premise of covering the main forecast information of each ensemble member, the EOF_AP clustering model can quickly and efficiently identify and classify the main characteristics of rainbands during heavy rainfall processes forecasted by the ensemble members, such as location, intensity, extremity, and occurrence probability. The clustering results are reasonable with a high consistency between the same types of rainbands and obvious differences between different types. In addition, through the comparison of forecast results with different forecast start times, it is found that the ensemble model can predict rainfall patterns that are close to observations at a long forecast leading times, including low probability events such as extreme rainfall. Through the EOF_AP cluster analysis, this low-probability event can be extracted and used as one of the feature types. From this point of view, it is equivalent to amplifying the prediction characteristics of low-probability events in the 51 members, which is more convenient for forecasters to analyze. At the same time, with changes to forecast leading time, the ensemble model also has certain common characteristics in the variation trend of forecasting heavy rainfall processes. That is, with a long forecast leading time, the forecast type that is close to observations generally appears in the type with a low occurrence probability, which has low predictability. As the forecast leading time is shortened, the improvement of the occurrence probability for a type with a better forecast of rainband location is higher than that of rainband intensity forecast.

4. Discussions

4.1. Main Findings

Compared with deterministic forecasts, ensemble forecasts are more suitable for medium-extended range forecasting of heavy rainfall processes, with the advantages of revealing the nonlinear uncertainties of weather processes, and providing a variety of possible precipitation forecasts. In addition, at present, the accuracy of deterministic prediction is still low. Moreover, the advantage of an ensemble forecast in a heavy rainfall forecast has also been confirmed in this study, that is, in a medium-extended range forecast, there are always some members whose forecasts will be close to the actual precipitation, especially extreme precipitation, but the number of members is too small and easy to be ignored. At the same time, forecasters tend to believe in the prediction results of most ensemble members in the actual prediction work, which is usually feasible in the short-term prescription; however, in the medium-extended range, the characteristics represented by most members of the prescription do not accurately reflect the actual heavy precipitation, and often deviate greatly from the actual heavy precipitation. From this point of view, the information of each forecast member should not be paid attention to, including the information represented by a few members; therefore, extracting the main types of precipitation features efficiently and amplifying the characteristics of a few members has a great demand in the actual prediction business. The EOF_AP clustering model in this study preliminarily realizes this function.

4.2. Limitations of Study Approach

In the two case analyses of this study, the judgment of whether the main precipitation types in the model forecast are close to the actual situation is based on subjective conditions, and there is no objective judgment basis to judge the similarity between the forecast and the actual situation. In addition, the EOF_AP clustering model can extract the main rainfall types and their occurrence probability, but it cannot correct the prediction performance deviation of the model itself. In the future, if we can use the historical forecast data or the reforecast data of the ensemble model, combined with the historical actual data, analyze the actual hit probability of the ensemble model when predicting a certain rainfall type, and then compare it with the occurrence probability of this type predicted by the real-time forecast model, it may provide more referential prediction tips.

5. Conclusions

Based on the precipitation data of ECMWF ensemble forecast, the EOF_AP clustering model is adopted in this study to identify and classify a total of 11 heavy rainfall events in the middle and lower reaches of the Yangtze River, and in North China and the Huanghuai region from June to September of 2021. The main conclusions are as follows.
The EOF_AP clustering model has a better identification and clustering effect on the heavy rainfall forecasted by the ECMWF ensemble model. On one hand, it can comprehensively retain and extract the main forecast features of each ensemble member, including highly valuable information such as the location, intensity, and extremity of rainbands. On the other hand, in the EOF_AP clustering results, the forecasted rainbands in the same type are quite consistent and the rainbands in different types are obviously different. The clustering results are highly credible.
In the medium and extended range forecast, due to the low predictability of heavy rainfall processes, the members with a low occurrence probability often contain important forecast information. This type of member can be extracted by the EOF_AP clustering model and used as one of the minor feature types, which has the indirect effect of amplifying the forecasting features of low-probability events; therefore, it is convenient for comparison and analysis in the operational forecasting service.
In different forecast leading times, the forecasts of ensemble members have different characteristics in the occurrence probabilities of the rainband location and intensity forecasts that are close to observations. In the long-term forecast, the forecast type with the location and intensity of rainband close to observations, generally with low occurrence probability, has a low predictability. As the forecast leading time is shortened, the occurrence probability of a type with a better forecast of rainband location significantly increases, although there is inconsistency in the trend forecast of rainfall intensity.
Under the needs of disaster prevention and mitigation, the deterministic prediction conclusion for the medium and extended range of a heavy rainfall forecast may cause deviations in the deployment of disaster prevention and mitigation, which could affect the efficiency of resource allocation; therefore, there is an option to establish a classification plan for disaster prevention and mitigation based on the probability prediction. The identification and clustering research on forecasts of heavy rainfall processes carried out in this study can provide support for this work.

Author Contributions

Conceptualization, W.H.; methodology, Y.L.; formal analysis, Y.L. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Natural Science Foundation of China (grant number U2142207).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Li, Y.; Jin, R.H.; Zhou, N.F. An analysis on characteristics of heavy rainfall Processes during the Meiyu season in Jianghuai region. Acta Meteorol. Sin. 2017, 75, 717–728. [Google Scholar]
  2. Yun, C.; Jun, S.; Jun, X.; Shunan, Y.; Zhiping, Z.; Tao, C.; Chong, F.; Jie, S. Analysis and Thinking on the Extremes of the 21 July 2012 Torrential Rain in Beijing Part I: Observation and Thinking. Meteorol. Mon. 2012, 38, 1255–1266. [Google Scholar]
  3. Yin, J.F.; Gu, H.D.; Liang, X.D. A Possible Dynamic Mechanism for Rapid Production of the Extreme Hourly Rainfall in Zhengzhou City on 20 July 2021. J. Meteor. Res. 2022, 36, 6–25. [Google Scholar] [CrossRef]
  4. Golding, B.W. Quantitative precipitation forecasting in the UK. J. Hydrol. 2000, 239, 286–305. [Google Scholar] [CrossRef]
  5. Ebert, E.E.; Damrath, U.; Wergen, W.; Baldwin, M.E. The WGNE assessment of short-term quantitative precipitation forecasts. Bull. Amer. Meteor. Soc. 2003, 84, 481–492. [Google Scholar] [CrossRef]
  6. Bi, B.G.; Dai, K.; Wang, Y.; Fu, J.L.; Cao, Y.; Liu, C.H. Advances in Techniques of Quantitative Precipitation Forecast. J. Appl. Meteorol. Sci. 2016, 27, 534–549. [Google Scholar]
  7. Applequist, S.; Gahrs, G.E.; Pfeffer, R.L.; Niu, X.F. Comparison of methodologies for probabilistic quantitative precipitation forecasting. Wea Forecast. 2002, 17, 783–799. [Google Scholar] [CrossRef]
  8. Chen, J.; Jiao, M.Y.; Gong, J.D. The Impact of Diabatic Physics on the Uncertainty of Heavy Rainfall Ensemble Simulations in Beijing. J. Appl. Meteorol. Sci. 2006, 17, 18–27. [Google Scholar]
  9. Li, Y. Performance Analysis on Extended-Range Ensemble Prediction over Middle and Lower Reaches of Yangtze River in Meiyu Period of 2011. Meteorol. Mon. 2016, 42, 1114–1123. [Google Scholar]
  10. Xueshun, S.; Yong, S.; Jianglin, H.; Jincheng, W.; Jian, S.; Jishan, X.; Wei, H.; Hongliang, Z.; Huijuan, L.; Hua, Z.; et al. Development and Operation Transformation of GRAPES Global Middle-range Forecast System. J. Appl. Meteorol. Sci. 2017, 28, 1–10. [Google Scholar]
  11. Zhao, L.N.; Wu, H.; Tian, F.Y.; Qi, D.; Di, J.Y.; Duan, Q.Y.; Wang, Z. Assessment of Probabilistic Precipitation Forecasts for the Huaihe Basin Using TIGGE Data. Meteorol. Mon. 2010, 36, 133–142. [Google Scholar]
  12. Dai, K.; Zhu, Y.J.; Bi, B.G. The review of statistical post-process technologies for quantitative precipitation forecast of ensemble prediction system. Acta Meteorol. Sin. 2018, 76, 493–510. [Google Scholar]
  13. Molteni, F.; Buizza, R.; Palmer, T.N.; Petroliagis, T. The ECMWF ensemble prediction system: Methodology and validation. Q. J. R. Meteorol. Soc. 1996, 122, 73–119. [Google Scholar] [CrossRef]
  14. Toth, Z.; Kalnay, E. Ensemble forecasting at the NMC: The generation of perturbations. Bull. Amer. Meteor. Soc. 1993, 74, 2317–2330. [Google Scholar] [CrossRef] [Green Version]
  15. Kang, Z.M.; Bao, Y.Y.; Zhou, N.F. Current Situation and Development of Medium-Range and Extended-Range Weather Forecast in China. Adv. Meteorol. Sci. Technol. 2013, 3, 18–24. [Google Scholar]
  16. Dai, K.; Cao, Y.; Qian, Q.F.; Gao, S.; Zhao, S.G.; Chen, Y.; Qian, C.H. Situation and Tendency of Operational Technologies in Short- and Medium-Range Weather Forecast. Meteorol. Mon. 2016, 42, 1445–1455. [Google Scholar]
  17. Zhu, Y.X.; Huang, J.Y.; Ding, Y.H. Some New Advances in Application of Statistical Methods to Numerical Models. Meteorol. Mon. 2016, 42, 456–465. [Google Scholar]
  18. Wang, K.; Jiang, N.; Li, M.; Li, J.; Zhang, S.M.; Chen, T.; Peng., X.Y. The potential forecast for short-term heavy precipitation in Jiangsu Province based on SMOTE and logistic regression combination algorithm. Sci. Technol. Eng. 2020, 20, 11447–11454. [Google Scholar]
  19. Huang, W.; Niu, R.Y. The Medium-term Multi-Model Integration Forecast Experimentation for Heavy Rainfall Based on Support Vector Machine. Meteorol. Mon. 2017, 43, 1110–1116. [Google Scholar]
  20. Kleiber, W.; Raftery, A.E.; Gneiting, T. Geostatistical model Averaging for locally calibrated probabilistic quantitative precipitation forecasting. J. Am. Stat. Assoc. 2011, 106, 1291–1303. [Google Scholar] [CrossRef]
  21. Marty, R.; Fortin, V.; Kuswanto, H.; Favre, A.C.; Parent, E. Com bining the Bayesian processor of output with Bayesian model averaging for reliable ensemble forecasting. Roy Stat. Soc. 2015, 64, 75–92. [Google Scholar]
  22. Shi, X.; Gao, Z.; Lausen, L.; Wang, H.; Yeung, D.Y.; Wong, W.K.; Woo, W.C. Deep Learning for Precipitation Nowcasting: A Benchmark and a New Model. In Proceedings of the 31st International Conference on Neural Information Processing Systems, Long Beach, CA, USA, 4–9 December 2017. [Google Scholar]
  23. Krizhevsky, A.; Sutskever, I.; Hinton, G. ImageNet Classification with Deep Convolutional Neural Networks. Adv. Neural Inf. Process. Syst. 2012, 25, 1097–1105. [Google Scholar] [CrossRef]
  24. Simonyan, K.; Zisserman, A. Very deep convolutional networks for large-scale image recognition. arXiv 2014, arXiv:1409.1556. [Google Scholar]
  25. He, K.; Zhang, X.; Ren, S. Deep Residual Learning for Image Recognition. In Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA, 27–30 June 2016. [Google Scholar]
  26. Li, Y.J.; Guo, P.W. Application of downscaling forecast for the North of Zhejiang precipitation in summer based on the BP neural network model. Trans. Atmos. Sci. 2017, 40, 425–432. [Google Scholar]
  27. Dai, K.; Bi, B.G.; Zhu, Y.J. Investigation of the medium-range forecast errors for the extreme rainfall event in North China during 19–20 July 2016. Chin. Sci. Bull. 2018, 63, 340–355. [Google Scholar] [CrossRef]
  28. Wang, Y.; Ma, J.; Dai, K. Ensemble-Based Analysis of Medium-Range Forecast Change and Uncertainty for the 20 July 2016 Severe Heavy Rainfall over North China. Meteorol. Mon. 2018, 44, 53–64. [Google Scholar]
  29. Williams, R.M.; Ferro, C.A.T.; Kwasniok, F. A comparison of ensemble post-processing methods for extreme events. Quart. J. Roy Meteor. Soc. 2014, 140, 1112–1120. [Google Scholar] [CrossRef]
  30. Liu, L.; Chen, J.; Wang, J.Y. A study on medium-range objective weather forecast technology for persistent heavy rainfall events based on T639 ensemble forecast. Acta Meteor. Sin. 2018, 76, 228–240. [Google Scholar]
  31. Du, J. Present situation and prospects of ensemble numerical prediction. Q. J. Appl. Meteorol. 2002, 13, 16–28. [Google Scholar]
  32. Jin, R.H.; Tian, W.H.; Jiao, M.Y. Product Development for the Operational Ensemble Prediction System Based on Ward Analysis in China. Meteorol. Mon. 2007, 33, 9–15. [Google Scholar]
  33. Du, L.M.; Ke, Z.J.; Liu, C.Z.; Xiao, Y.; Liu, L. Summer Precipitation Prediction Models Based on the Clustering Regionalization in China. Meteorol. Mon. 2016, 42, 89–96. [Google Scholar]
  34. Han, W.; Zhai, P.M. Three Cluster Methods in Regionalization of Temperature Zones in China. Clim. Environ. Res. 2015, 20, 111–118. [Google Scholar]
  35. Chen, G.Y.; Zhao, Z.G. Assessment methods of Short Range Climate Prediction and their Operational Application. Q. J. Appl. Meteorol. 1998, 9, 178–185. [Google Scholar]
  36. Sun, J.G.; Zhao, X. Image segmentation algorithm based on improved affinity propagation clustering. Comput. Eng. Appl. 2017, 53, 178–182. [Google Scholar]
  37. Frey, B.J.; Dueck, D. Clustering by passing messages between data points. Science 2007, 315, 972–976. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  38. Guo, X.J.; Chen, Y. Analysis and Application on AP Clustering Algorithm. J. Jilin Jianzhu Univ. 2013, 30, 58–61. [Google Scholar]
  39. Zhao, Y.; Chen, Q. Affinity propagation clustering algorithm based on neighborhood similarity. Comput. Eng. Des. 2018, 39, 1883–1888. [Google Scholar]
  40. Wang, L.; Ren, H.L.; Zhu, J.; Huang, B. Improving prediction of two ENSO types using a multi-model ensemble based on stepwise pattern projection model. Clim. Dyn. 2020, 54, 3229–3243. [Google Scholar] [CrossRef] [Green Version]
  41. Fu, Y.D.; Lan, J.L. Kernel-based adaptation for affinity propagation clustering algorithm. Appl. Res. Comput. 2012, 29, 1644–1650. [Google Scholar]
  42. Huang, J.Y. Statistic Analysis and Forecast Methods in Meteorology; China Meteorological Press: Beijing, China, 1990; pp. 105–111. [Google Scholar]
Figure 1. Technology roadmap of EOF_AP clustering model.
Figure 1. Technology roadmap of EOF_AP clustering model.
Atmosphere 13 00768 g001
Figure 2. Distribution of observed accumulated rainfall from 29 June to 2 July 2021.
Figure 2. Distribution of observed accumulated rainfall from 29 June to 2 July 2021.
Atmosphere 13 00768 g002
Figure 3. EOF_AP clustering results of the accumulated rainfall from 29 June to 2 July forecasted by the ECMWF ensemble model with the start time at 12:00 on 22 June. indicates the member of the clustering center, and the left subscript number indicates the index in original ensemble members.
Figure 3. EOF_AP clustering results of the accumulated rainfall from 29 June to 2 July forecasted by the ECMWF ensemble model with the start time at 12:00 on 22 June. indicates the member of the clustering center, and the left subscript number indicates the index in original ensemble members.
Atmosphere 13 00768 g003
Figure 4. EOF_AP clustering results of the accumulated rainfall from 29 June to 2 July forecasted by the ECMWF ensemble model with a start time at 12:00 from 20 to 28 June (the clustering type close to observation is marked by the red box). Each row has the same start time, is arranged in descending order of the number of cluster members, and the string “Ci/Nj” at the bottom corresponds to the cluster center and the member number of each type.
Figure 4. EOF_AP clustering results of the accumulated rainfall from 29 June to 2 July forecasted by the ECMWF ensemble model with a start time at 12:00 from 20 to 28 June (the clustering type close to observation is marked by the red box). Each row has the same start time, is arranged in descending order of the number of cluster members, and the string “Ci/Nj” at the bottom corresponds to the cluster center and the member number of each type.
Atmosphere 13 00768 g004
Figure 5. Distribution of observed accumulated rainfall from 19 to 21 July 2021.
Figure 5. Distribution of observed accumulated rainfall from 19 to 21 July 2021.
Atmosphere 13 00768 g005
Figure 6. EOF_AP clustering results of the accumulated rainfall from 19 to 21 June of the ECMWF ensemble forecasts, with a rolling start time from 12:00 on 10 to 18 July. The red box indicates that the maximum accumulated rainfall exceeds 400 mm in Henan, and is forecasted by this member. The yellow box indicates that the maximum accumulated rainfall exceeds 400 mm in the forecast area without Henan. The blue box indicates that the maximum accumulated rainfall is between 200 mm and 400 mm in Henan. If there are members which satisfy various conditions, they will be marked with the priority of red, yellow, and blue.
Figure 6. EOF_AP clustering results of the accumulated rainfall from 19 to 21 June of the ECMWF ensemble forecasts, with a rolling start time from 12:00 on 10 to 18 July. The red box indicates that the maximum accumulated rainfall exceeds 400 mm in Henan, and is forecasted by this member. The yellow box indicates that the maximum accumulated rainfall exceeds 400 mm in the forecast area without Henan. The blue box indicates that the maximum accumulated rainfall is between 200 mm and 400 mm in Henan. If there are members which satisfy various conditions, they will be marked with the priority of red, yellow, and blue.
Atmosphere 13 00768 g006
Table 1. The eleven heavy rainfall events from June to September of 2021.
Table 1. The eleven heavy rainfall events from June to September of 2021.
RegionPeriod
The middle and lower reaches of the Yangtze River 26–28 June29–2 July4–6 July14–17 July11–13 August
North China and Huanghuai region11–13 July17–18 July19–21 July28–31 August18–20 September24–26 September
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Huang, W.; Li, Y. Application of Affinity Propagation Clustering Method in Medium and Extended Range Forecasting of Heavy Rainfall Processes in China. Atmosphere 2022, 13, 768. https://doi.org/10.3390/atmos13050768

AMA Style

Huang W, Li Y. Application of Affinity Propagation Clustering Method in Medium and Extended Range Forecasting of Heavy Rainfall Processes in China. Atmosphere. 2022; 13(5):768. https://doi.org/10.3390/atmos13050768

Chicago/Turabian Style

Huang, Wei, and Yong Li. 2022. "Application of Affinity Propagation Clustering Method in Medium and Extended Range Forecasting of Heavy Rainfall Processes in China" Atmosphere 13, no. 5: 768. https://doi.org/10.3390/atmos13050768

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop