Next Article in Journal
An Integrated Approach for Studying the Hydrology of the Ljubljansko Polje Aquifer in Slovenia and Its Simulation
Next Article in Special Issue
Urban Flood Hazard Modeling Using Self-Organizing Map Neural Network
Previous Article in Journal
Engaging with Flows: Embodied Cognition in Water Provision
Previous Article in Special Issue
Identifying Key Hydrological Processes in Highly Urbanized Watersheds for Flood Forecasting with a Distributed Hydrological Model
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Optimize Short-Term Rainfall Forecast with Combination of Ensemble Precipitation Nowcasts by Lagrangian Extrapolation

School of Civil, Environmental and Architectural Engineering, College of Engineering, Korea University, Seoul 02841, Korea
*
Author to whom correspondence should be addressed.
Water 2019, 11(9), 1752; https://doi.org/10.3390/w11091752
Submission received: 25 June 2019 / Revised: 14 August 2019 / Accepted: 19 August 2019 / Published: 22 August 2019
(This article belongs to the Special Issue Flash Floods in Urban Areas)

Abstract

:
The rainfall forecasts currently available in Korea are not sufficiently accurate to be directly applied to the flash flood warning system or urban flood warning system. As the lead time increases, the quality becomes even lower. In order to overcome this problem, this study proposes an ensemble forecasting method. The proposed method considers all available rainfall forecasts as ensemble members at the target time. The ensemble members are combined based on the weighted average method, where the weights are determined by applying the two conditions of the unbiasedness and minimum error variance. The proposed method is tested with McGill Algorithm for Precipitation Nowcasting by Lagrangian Extrapolation (MAPLE) rainfall forecasts for four storm events that occurred during the summers of 2016 and 2017 in Korea. In Korea, rainfall forecasts are generated every 10 min up to six hours, i.e., there are always a total of 36 sets of rainfall forecasts. As a result, it is found that just six ensemble members is sufficient to make the ensemble forecast. Considering additional ensemble members beyond six does not significantly improve the quality of the ensemble forecast. The quality of the ensemble forecast is also found to be better than that of the single forecast, and the weighted average method is found to be better than the simple arithmetic average method.

1. Introduction

Recently, there have been growing concerns of urban flooding and flash flooding that appear to be related to the rapid population growth and climate change. More of the population has been living in some specific urban areas [1,2,3,4,5], and people are leaving these areas for outdoor activities such as camping in very scenic mountain valleys, particularly during the hot summer season [6,7,8]. Global warming is believed to change the climate continuously. Very localized and severe rainfall events are also believed to be increasing [9,10,11,12,13]. The combination of all of these changes unfortunately increases the risk of urban flooding and flash flooding, which is also expected to worsen in the future. Although the definitions of urban floods and flash floods differ, they share some unique characteristics, such as a localized area, short response time, high risk, and so forth.
Urban and/or flash floods occur within one or two hours, sometimes shorter, following severe rainfall [14,15,16,17,18]. Thus, in this case, the rainfall measurements on the ground may not be applicable for flood warnings. Put simply, sufficient lead time cannot be secured to warn people in the pruned area of such flooding. This is an important reason to use the rainfall forecast for this purpose. For example, the Flash Flood Guidance System (FFGS) in the US that uses rainfall forecasts based on both satellite and radar observation is used for flash flood warning [19]. The European Flood Awareness System (EFAS) also uses ensemble rainfall forecasts for flood warning [20]. The flash flood warning system in Korea also uses the rainfall forecast as input [21,22].
Various models have been developed for the purpose of producing rainfall forecasts. Auto NowCaster (ANC) is a model developed by the National Center for Atmospheric Research (NCAR) for convective storm forecasting [23]. The Thunderstorm Identification, Tracking, Analysis, and Nowcasting (TITAN) was also developed for convective storm forecasting [24]. The Japan Meteorological Administration (JMA) uses a Mesoscale Model (MSM), which is a numerical weather prediction model, for the same purpose [25,26]. The Korea Local Analysis and Prediction System (KLAPS) and McGill Algorithm for Precipitation Nowcasting by Lagrangian Extrapolation (MAPLE) are models used in Korea for very short time rainfall forecasting [27,28,29,30].
The quality of flash flood warning is clearly very dependent on the rainfall forecast used. However, it is also well known that the quality of rainfall forecasts is not very satisfactory [31,32,33]. Various ensemble techniques have been applied in attempts to improve rainfall forecasting [34,35,36]. The quality of rainfall forecasts can be significantly improved, and the effective lead time of the rainfall forecast can also be increased by applying the ensemble technique [37,38,39,40]. The ensemble technique has also been adopted as an aspect of operational rainfall forecasting in many countries [37,41,42,43,44].
Various methods of generating ensemble members have been proposed. First, it is possible to control the input data. The observed data can be varied by introducing time lag [45,46,47,48]. It is also possible to introduce some amount of perturbation to the observed input data [49,50,51,52]. In general, randomly generated noise is added to the observed data. One important advantage of using this method of controlling the input data is that it is based on observed data, that is, realistic data. The second method involves controlling the parameters of the forecasting model [53,54,55]. Here, the model parameters are assumed to be stochastic. Under the assumption that the multivariate probability distribution function governing the model parameters is known, as many parameter sets as possible can easily be generated to be used to generate rainfall forecasts, i.e., ensemble members. This method is particularly effective when the forecasting model is very competitive. Recently, several models have been considered simultaneously for the same purpose of rainfall forecasting [56,57,58,59]. Each rainfall forecast from a different model is assumed to be an ensemble member. As no model is complete with each having pros and cons, the use of various models must have some benefits to generate ensemble members.
However, it is also possible to imagine a situation in which none of the above methods of generating ensemble members is applicable. Basically, the users of the rainfall forecast do not handle the forecasting model. Every hour, the generated rainfall forecast is transferred to the registered users. It is the same case for flood warning. Particularly in the case that the rainfall forecast is of low quality, something must be done to improve it. This is what this study addresses.
The objective of this study is to develop an ensemble forecasting method based on the rainfall forecast generated every hour. For example, the rainfall forecast generated every hour may include the rainfall data for the following one to six hours. If the target time is three hours later, four different rainfall forecasts are available at that target time. That is, the three-hour forecast made at the current time, the four-hour forecast made in the previous hour, the five-hour forecast made two hours prior, and the six-hour forecast made three hours prior. All four of these four forecasts are considered as ensemble members to make the ensemble forecast in this study. The ensemble members are going to be combined based on the weighted average method, where the weights should also be determined reasonably. The ensemble forecast should also have higher quality than the simple rainfall forecast. Several issues arise when using this ensemble forecasting method: the first involves the optimal number of ensemble members, the second involves the determination of the weights, and finally, it is important to evaluate how the ensemble forecast compares to the single rainfall forecast. This study attempts to solve these problems one by one. As examples, this study will consider several storm events that occurred during the summers of 2016 and 2017 in Korea.

2. Theoretical Framework

2.1. Ensemble Forecast and the Lagged Average Forecast

An ensemble forecast is a collection of two or more forecasts at a certain target time [60]. Ensemble forecasting is applied to reduce the uncertainty of deterministic forecasting such as the numerical weather prediction (NWP) [34,35,61]. The uncertainty of the NWP increases significantly, mostly due to the incompleteness of the initial conditions as well as the incompleteness of the numerical model itself [62]. Thus, the purpose of the ensemble forecasting is to probabilistically combine multiple forecasts to yield more reliable results. By setting different initial conditions, physical processes, and boundary conditions, various forecasts of future weather conditions can be generated [50,63].
Ensemble forecasting has many advantages compared with NWP. The uncertainty of NWP forecasts is assumed to be considerably large, and its error varies in time and space [64,65,66]. However, ensemble forecasting considers all available forecasts which could statistically occur. The use of ensemble forecasting provides not only improved forecasting results over a long lead time, but also information about its uncertainty. This information about forecasting uncertainty is particularly important to forecasters who should make an appropriate decision [67].
Ensemble forecasting techniques can be divided into three types: the first involves controlling the input data. Some amount of perturbation is added to the observed input data [68,69,70,71], or various time lags are applied to the observed input data [72,73,74]. The second is to control the model parameters. Many ensemble members are generated by applying various parameter sets to a model [53,55,75,76]. The last type involves diversifying models or systems. This is also called the multimodel ensemble [56,77,78,79]. There also exists the concept of a super ensemble, which is a combination of the three types [80,81,82].
It is also possible to use all of the forecasts available at a specific target time. These forecasts are those made at different times in the past. The quality of the ensemble forecast can be improved simply by averaging all available forecasts [83]. This method is called the lagged average forecast (LAF). The LAF has both advantages and disadvantages; its most important advantage is that it is easy to apply. No special skills are needed to generate the perturbations. Additionally, the generated perturbation is not simply random but rather based on the hidden dynamics at each time step. However, as the LAF is based on a limited number of ensemble members, the representativeness of the ensemble forecast can be weak. In order to lessen this weakness, the appropriate weight to be applied to each ensemble member should be determined. Hoffman and Kalnay (1983) presented a method to consider the expected error for each ensemble member [72].
Due to its simple application, the LAF has frequently been applied to various forecasting problems [46,47,84,85,86,87,88,89,90,91,92,93]. For example, Brankovic et al. (1990) applied the LAF to medium and long-term forecasts operated by the European Center for Medium Range Weather Forecasts (ECMWF) [46]. The ensemble forecasts were generated using nine prior forecasts with a six-hour interval. The Root Mean Square Error (RMSE) and the Anomaly Correlation Coefficient (ACC) of the LAF ensemble forecasts were compared with those of each single forecast, with the results indicating that the LAF ensemble forecasts were superior in all seasons. Lu et al. (2007) evaluated the forecasts of several meteorological factors such as air temperature, wind speed, and relative humidity, generated by the Rapid Update Cycle (RUC) model of the National Oceanic and Atmospheric Administration (NOAA) [85]. They found that the LAF ensemble forecasts were superior to a single deterministic forecast, even for a short-term forecasting from 1 h to 3 h. Mittermaier (2007) also showed that LAF ensemble forecasting reduced uncertainty in high-resolution rainfall forecasting [47]. The ensemble forecasts of rainfall amount, maximum rainfall amount, and rainfall occurrence probability were generated using five rainfall forecasts with a six-hour interval from Met Office 4 km UM (Unified Model) as the ensemble members. They found that the LAF not only improved the forecasting quality for the rainfall amount, but also significantly reduced the error in forecasting rainfall occurrence.

2.2. Method of Averaging

The ensemble forecast is made by averaging the ensemble members. That is,
R t = i = 1 n w i M i
where Rt is an ensemble forecast made at the target time t, wi is a weight for the ensemble member Mi, and n is the number of ensemble members.
To date, various averaging methods have been proposed. A relatively simple averaging method is the simple average method (SA method). In this method, an equal weight is simply applied to each ensemble member. That is, the weight wi in Equation (1) is determined to be 1/n. Although it is very simple without any deep theoretical background, the SA method has been applied in various studies [77,80,94]. The weighted average method (WA method) is a statistical method which can consider the uncertainty of each ensemble member [95,96,97]. The weight is generally determined to be inversely proportional to its uncertainty. The application of a linear regression is another method that can be used to determine the weights of ensemble members [98]. In this method, a linear function is derived by considering the multiple ensemble members as independent variables. A nonlinear function approach such as the artificial neural network (ANN) has also been proposed [99]. Additionally, a so-called time-varying mergence method (TV method) has been proposed in an attempt to consider the temporal change of weights [97,100,101]. Among the TV methods, a time-varying sum of square root error method (TVSSE method), first proposed by Granger and Newbold (1977), may be the most popular [97].
Among many averaging methods, this study selected the weighted average method (WA method). The WA method is believed to be one which can consider the statistical characteristics of ensemble members. Specifically, this study adopted the variance–covariance method [95], which combines the unbiased ensemble members based on the concept of minimum error variance of the ensemble forecast. As an example, in the case of considering two ensemble members F1 and F2 generated for the true value of F,
F 1   =   F   +   Z 1
F 2   =   F   +   Z 2
where Z1 and Z2 represent the stochastic errors involved in the generation of ensemble members. Here, the two stochastic errors are assumed to follow the Gaussian distribution, but they are not assumed to be independent of each other.
Based on the linear assumption, the optimal estimate can be expressed as follows.
F ^   =   c 1 F 1   +   c 2 F 2
where c1 and c2 are the optimal weights to be determined by considering the uncertainty of the ensemble members of F1 and F2. Generally, the weights are estimated by applying the two conditions of the unbiasedness and minimum error variance. That is, the bias of the estimate F ^ should be zero, and the error variance of the estimate F ^ should be minimized as well [98]. By applying these two conditions, one can derive the weights as follows.
c 1 = σ 2 2 σ 12 σ 1 2 + σ 2 2 2 σ 12
c 2 = σ 1 2 σ 12 σ 1 2 + σ 2 2 2 σ 12
where σ 1 2 and σ 2 2 are the variances of the two forecasts and σ 12 is the covariance between the two forecasts. If the two forecasts are independent, the covariance becomes zero. However, if they are dependent on each other, the covariance should be considered to determine the weights.
A generalization of the above result to the case of considering m forecasts is as follows.
W ^ = 1 u u T 1 u
where W ^ is a column vector of the weights of m ensemble members and u is a unit column vector (i.e., u = [ 1 ,   1 , ,   1 ] T ). Σ is an m × m covariance matrix consisting of the forecasting errors. The weight for each ensemble member can be calculated using the covariance matrix of forecasts, as given in Equation (7). Further, the variance of the ensemble forecast can be derived as follows.
σ c = 1 u T 1 u
This variance represents the quality of the ensemble forecasts, which generally becomes smaller as the number of ensemble members increases.

2.3. Optimal Number of Ensemble Members and Quality of Ensemble Forecast

In this study, the number of ensemble members was determined based on the quality of the ensemble forecast. Basically, as the number of the ensemble members increases, the forecasting quality improves. However, the forecasting quality can also become stagnated if the number of ensemble members exceeds a certain limit. In this study, the optimal number of ensemble members was determined as the minimum number of ensemble members that significantly improved the quality of the ensemble forecast. The difference between the ensemble forecast and the observed data, as well as the variance of the ensemble forecast were considered to determine the optimal number of ensemble members.
Once the optimal number of ensemble members has been determined, the ensemble forecast can be produced by applying the weight to each ensemble member. The forecasting quality of the produced ensemble forecast is then evaluated by comparing it with the observed data. Two evaluation factors are used to evaluate the forecasting quality: the root mean square error (RMSE) represents the mean difference between the ensemble forecast and the observed data, while the pattern correlation coefficient R is used to quantify the similarity of the ensemble forecast and the observed data. The pattern correlation coefficient R is calculated using Equation (9).
R   =   m   =   1 M n   =   1 N ( P m , n P ¯ ) ( O m , n O ¯ ) ( m   =   1 M n   =   1 N ( P m , n P ¯ ) 2 ) ( m   =   1 M n   =   1 N ( O m , n O ¯ ) 2 )
where Pm,n and Om,n are the ensemble forecast and observed data, respectively, at each grid point (m, n). Further, P ¯ and O ¯ are the mean values of the ensemble forecast and observed data, respectively. Similar to the ordinary correlation coefficient, the pattern correlation is high when the value of R is near to 1 or −1.

3. Data

3.1. Rainfall Forecast of MAPLE

MAPLE (McGill Algorithm for Precipitation Nowcasting by Lagrangian Extrapolation) is a very short term rainfall forecasting model. The basic concept of the MAPLE rainfall forecasting was first described by Germann and Zawadzki (2002) [28]. The MAPLE provides the forecasts of precipitation echoes, which are made using storm moving vectors. The storm moving vectors are derived from past and current radar reflectivity images by applying the variational echo tracking (VET) technique [102]. In order to generate nowcasts over several hours, the MAPLE uses a semi-Lagrangian method, which is based on the cross-correlation of the rainfall patterns at different times. The MAPLE is known to have the ability to forecast with consideration of the life cycles of various rainstorms. It has also been revised consistently to overcome various limitations and problems [29,103,104,105].
The MAPLE rainfall forecasting system operated by KMA has two limitations: First, as it is a nondynamic forecasting model, it does not involve any process to consider the growth and decay of precipitation echoes. Aside from the probabilistic analysis of the rainstorm size, the initial information of precipitation echoes does not change. Second, the initial echo moving vectors are applied to every lead time. If the precipitation echo moving vectors change abruptly, the forecasting quality can be decreased significantly. This limitation is particularly relevant when extending the lead time; if the lead time is longer than three hours, the forecasting quality of the rainfall forecasts is known to be decreased abruptly [106].
The MAPLE rainfall forecast is generated as a form of a composite radar map, showing the entire Korean Peninsula and the surrounding region (Figure 1). Its lead time ranges from 10 min to 360 min (i.e., six hours). That is, each MAPLE rainfall forecast contains one set of observed data and 36 forecasts with a 10 min interval. It is composed of 1024 × 1024 grids with a resolution of 1 km × 1 km, as a type of matrix. The original format of the MAPLE rainfall forecast is a binary gzip, but for use in this study, it is changed into the ASCII format using the Geographic Information System (GIS) program.

3.2. Storm Events

This study used the MAPLE rainfall forecasts of four major storm events that occurred in 2016 and 2017. Figure 2 shows radar images of the selected storm events, which are available at the weather radar center portal (www://radar.kma.go.kr). These radar images show basic information about the size, intensity, and movement of these storm events.
The selected major storm events have different characteristics (Table 1). For a specific example, consider the second event, Typhoon Chaba. Typhoon Chaba caused severe damage in several cities located in the southern part of the Korean Peninsula. This storm event was recorded as the worst typhoon that occurred in October among those that landed in the Korean Peninsula. The maximum rainfall intensity, 104.2 mm/hr and total rainfall depth of 266.0 mm were recorded at the Ulsan rain gauge station [107]. The fourth event was Typhoon Talim. This storm event landed on the Korean Peninsula on 10 September 2017 with a lot of rainfall, and decayed the next day at the Jeolla Province. The first and third events are those that occurred during the monsoon seasons in 2016 and 2017, respectively. In this study, 10 target times were selected in total to generate the weighted average ensemble forecasts. Each storm event contains two or three target times, which were those at which relatively high rainfall intensity occurred. Table 1 summarizes detailed information about the rainfall that occurred at these 10 target times.

4. Results

4.1. Weighted Average Ensemble Forecast

The structure of the covariance is the key factor for determining the weight for each forecast. First, the cross-correlation coefficient was estimated to consider the difference in lead time among ensemble members. In this estimation process, the unit time lag was assumed to be 10 min. For example, the time lag between the 30 min forecast and the 90 min forecast corresponds to lag-6, and the time lag between the 60 min forecast and the 120 min forecast also corresponds to lag-6. As there were many cases corresponding to a given time lag, their average was assumed to be the represented value.
Figure 3 shows the change in the cross-correlation coefficient in terms of the time lag, derived from the forecasts collected at the 10 target times. Further, the solid thick line represents their average. As can be expected, the cross-correlation coefficient decays slowly and stagnates after some time lag. It is obvious that a higher cross-correlation coefficient is expected for short time lags, but a lower one is expected for long time lags. This also indicates that the diagonal components of the covariance matrix are the highest.
The covariance matrix was derived separately for each storm event. For example, Figure 4 shows the covariance matrix derived from all of the available rainfall forecasts on 04:30, 11 September 2017. This figure includes the results for cases with ensemble members 2, 3, 6, 9, 18, and 36. Regardless of which ensemble members were considered, the diagonal components of the covariance matrix were always higher than the other components. This indicates that the quality of the rainfall forecast drops as the lead time increases. The correlation also becomes lower as the lead time increases.
As explained previously, the weights to be applied to the ensemble members (i.e., the rainfall forecasts available at a given target time) are derived by analyzing the covariance matrix. This study considered three different forecasting times; one, two, and three hours. For example, the case with the forecasting time of one hour considered all of the rainfall forecasts with a lead time longer than or equal to one hour. This procedure was repeated 10 times by considering all of the 10 different target times listed in Table 1. The weights were estimated independently for each case, and the final weights were determined as their arithmetic average. Figure 5 compares the final weights determined for the cases with the following numbers of ensemble members: 2, 3, 4, 6, and 9. The solid line represents the final weights determined for each case.
The characteristics of the determined weights were as expected. For example, the weight of the most recently made forecast was higher than that of the older one. The difference among weights was larger when a smaller number of ensemble members were considered. As the number of ensemble members considered increased, the weights became more similar to each other. That is, the simple arithmetic averaging could be a valid method when considering a large number of ensemble members. For example, Figure 5a shows the determined weights for the case considering four ensemble members. The weight of the first ensemble member (i.e., rainfall forecast with a lead time of one hour) was determined to be 0.4235, while that of the second one (i.e., rainfall forecast with a lead time of one hour and 10 min) was 0.2337. The third and fourth weights were determined to be much smaller at 0.1739 and 0.1689, respectively.
However, the above characteristics become rather weakened when a longer forecasting time is considered. For example, the weight of the first ensemble member for the forecasting time of three hours (see Figure 5c) was determined to be substantially smaller than that for the forecasting time of one hour. On the other hand, the weights of the other ensemble members became slightly higher. The case for the forecasting time of two hours is in between the two forecasting times of one hour and three hours. This indicates independence among the ensemble members, which becomes stronger when considering a longer forecasting time. This result is also consistent with the characteristics of the covariance matrix. The cross-correlation coefficient was found to be negligible when the difference in lead time was longer than 150 min.
In general, the quality of the ensemble forecast increases as more ensemble members are considered. However, it is not economical to simply consider as many ensembles as possible. The optimal number of ensembles is determined as the minimum number of ensembles which guarantees a similar quality of ensemble forecast. The uncertainty (or variance) of the ensemble forecast is analyzed to determine the optimal number of ensemble members. In this study, for the forecasting times of one, two, and three hours, the behavior of the RMSE of the ensemble forecast was examined in terms of the number of ensemble members. In order to consider together all of the RMSEs estimated for each of the 10 target times evaluated in this study, the RMSE estimated for each target time was also normalized by the RMSE for the case of considering just one ensemble member (i.e., the biggest RMSE). The optimal number of ensemble members was determined as that near the inflection point of the RMSE curve.
Figure 6 shows the behavior of the RMSEs estimated for the 10 target times. The solid thick line represents their average. The two red dashed lines represent the tangent lines from the beginning and from the end. These two lines meet at the inflection point. As shown in this figure, the optimal number of ensemble members is around six. This result was the same regardless of the forecasting time. The ensemble forecast hereafter is made by considering a total of six ensemble members.

4.2. Quality of Weighted Average Ensemble Forecast

In the previous section, the optimal number of ensemble members was determined to be six. For the case of a forecasting time of one hour, as an example, six rainfall forecasts made from the prior 60 min to the prior 110 min were used to make the ensemble forecast. For the case of a forecasting time of two hours, six rainfall forecasts made from the prior 120 min to the prior 170 min were used, and for the case of a forecasting time of three hours, six rainfall forecasts made from the prior 180 min to the prior 230 min were used to make the ensemble forecast. Table 2 summarizes the weights to be used to make the weighted average (i.e., ensemble forecast based on the weighted average method) with these six ensemble members. The weight for the first ensemble member (the most recent rainfall forecast among the ensemble members considered) was the highest, and the weight dropped as the time gap increased.
The quality of the MAPLE rainfall forecast decreases with longer lead time. Figure 7 shows six rainfall forecasts made at 09:00 8 July 2017 for the lead times from 60 min to 110 min. On this basis of these rainfall forecasts, the storm center was predicted to move to the bottom of the right-hand side. These forecasts also indicate that the forecasting quality decreases with increasing lead time, which is also a crucial factor for the practical use of rainfall forecasts.
The quality of the ensemble forecast was first evaluated at the target time by comparing it with the observed rainfall field (Figure 8). Comparisons with the ensemble forecast based on the simple arithmetic average method and the single forecast at the target time (i.e., the case with just one ensemble member) were also conducted in order to emphasize the usefulness of the ensemble forecast. As shown in Figure 8, the storm center of the observed rainfall field is located around 36°10′ N~36°20′ N and 128°30′ E~128°40′ E. A similar pattern could also be found in the ensemble forecasts based on the weighted average method as well as the simple average method. Both of the results were similar. On the other hand, in the single forecast, the overall pattern was found to be somewhat different from the observed result. Two storm centers were found: one around 36°0′ N~36°10′ N and 128°10′ E~128°25′ E and another around 36°20′ N~36°30′ N and 128°40′ E~128°50′ E.
The quality of the ensemble forecast was also quantitatively evaluated according to the pattern correlation coefficient R and the root mean square error RMSE. These measures of the ensemble forecast were also compared with those of the single forecast and the ensemble forecast based on the simple arithmetic average method. For example, the evaluation result at the target time of 09:00 8 July 2017 shows that the ensemble forecast based on the weighted average method is most similar to the observed. For the case of a forecasting time of one hour, R and RMSE of ensemble forecast based on the weighted average method were 0.42 and 6.85, respectively. On the other hand, those of the single forecast were estimated to be 0.25 and 9.66, while those of the ensemble forecast based on simple arithmetic averaging were 0.39 and 7.14, respectively. Overall, the ensemble forecast was found to be better than the single forecast, and the weighted average method was found to be better than the simple arithmetic average method. Similar results were derived for the forecasting times of two and three hours, as summarized in Table 3.
The above evaluation process was repeated for all 10 target times considered in this study, and the results are summarized in Table 4. Basically, the same result was derived for all 10 target times. That is, the ensemble forecast was found to be better than the single forecast, and the weighted average method was found to be better than the simple arithmetic average method. In addition, the evaluation result was found to be slightly deteriorated as the forecasting time increased. That is, the evaluation result for the case of a forecasting time of one hour was mostly better than that of the forecasting time of two or three hours. Further, the evaluation result for the case of a forecasting time of two hours was mostly better than that of a forecasting time of three hours. There were some exceptions, but this trend was seen in all three different forecasts: the ensemble forecast based on the weighted average method, the ensemble forecast based on the simple arithmetic average method, and the single forecast. It should also be noted that, as the forecasting time increased, the evaluation result of the single forecast became substantially worse than that of the ensemble forecast. This result seems to be based on the fact that the ensemble forecast was made by considering the uncertainty of rainfall propagation, i.e., by considering more feasible cases of rainfall propagation. Also, this limitation, which is the quality of three hour forecast is far lower than that of one hour and two hours can be found in the previous studies in Korea [108,109,110].

5. Summary and Conclusions

This study proposed an ensemble forecasting method based on the rainfall forecast generated every hour. The ensemble members (i.e., the available rainfall forecasts at the target time) were combined using the weighted average method. Three issues were raised with this ensemble forecasting method: the first involved the optimal number of ensemble members, the second was concerned with the determination of the weights, and the last one involved the quality of the ensemble forecast. One by one, this study showed possible solutions to these issues, with example applications to four storm events that occurred during the summers of 2016 and 2017 in Korea.
First, the weights were determined by analyzing the covariance matrix of the rainfall forecasts under the two conditions of the unbiasedness and minimum error variance. As expected, the weight of the most recently made forecast was higher than that of older ones. The difference among weights was also larger when a smaller number of ensemble members were considered. As the number of ensemble members increased, the weights became similar to each other. That is, the simple arithmetic averaging could be a valid method when considering a large number of ensemble members. However, this trend was rather weakened when considering a longer forecasting time. For example, the weight of the first ensemble member for the forecasting time of three hours was determined to be substantially smaller than that for the forecasting time of one hour. On the other hand, the weights of the other ensemble members became slightly higher. This indicates independence among the ensemble members, which becomes stronger when considering a longer forecasting time.
Second, the optimal number of ensembles was determined to be the minimum number of ensembles which guarantee a similar quality of ensemble forecast. The uncertainty (or variance) of the ensemble forecast was analyzed, and the optimal number of ensemble members was determined as that near the inflection point of the RMSE curve. In this study, the optimal number of ensemble members was determined to be around six. This result was the same regardless of the forecasting time.
Third, the quality of the ensemble forecast was quantitatively evaluated by the pattern correlation coefficient R and the root mean square error RMSE. These measures of the ensemble forecast were also compared with those of the single forecast and the ensemble forecast based on the simple arithmetic average method. The results indicated that the ensemble forecast was better than the single forecast, and that the weighted average method was better than the simple arithmetic average method.
Finally, it was also found that the evaluation result was slightly deteriorated as the forecasting time increased. That is, the evaluation result for the case of a forecasting time of one hour was mostly better than that of a forecasting time of two or three hours. However, it should be mentioned that, as the forecasting time increased, the evaluation result of the single forecast became substantially worse than that of the ensemble forecast. This result underscores the usefulness of the ensemble forecast. In fact, this is a fundamental problem which cannot be solved immediately. However, even though the results for the lead times of two or three were confusing, the rainfall prediction based on the weighted average method was superior to that based on the simple arithmetic average method.
The ensemble forecasting method proposed in this study may help increase the usefulness of the rainfall forecast one step further. The rainfall forecasts that are currently available in Korea are not sufficiently accurate to be directly applied to the flash flood warning system or urban flood warning system. The quality becomes even lower as the lead time increases. However, by introducing the ensemble technique, this problem could be alleviated a bit. The usefulness of the proposed ensemble forecasting method can be even higher in the near future if more accurate rainfall forecasts become available.

Author Contributions

C.Y. conceived and designed the idea of this research and wrote the manuscript. W.N. collected the rainfall forecasts and rain gauge data, and conducted the ensemble forecasting.

Funding

This work was supported by Korea Environment Industry & Technology Institute (KEITI) through Water Management Research Program, funded by Korea Ministry of Environment (MOE) (127559).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. United Nations (UN). World Urbanization Prospects: The 2007 Revision; Department of Economic and Social Affairs, Population Division, UN: New York, NY, USA, 2008. [Google Scholar]
  2. Kalnay, E.; Cai, M. Impact of urbanization and land-use change on climate. Nature 2003, 423, 528–531. [Google Scholar] [CrossRef] [PubMed]
  3. Satterthwaite, D. Cities’ contribution to global warming: Notes on the allocation of greenhouse gas emissions. Environ. Urban. 2008, 20, 539–549. [Google Scholar] [CrossRef]
  4. Satterthwaite, D. The implications of population growth and urbanization for climate change. Environ. Urban. 2009, 21, 545–567. [Google Scholar] [CrossRef] [Green Version]
  5. Zhou, L.M.; Dickinson, R.E.; Tian, Y.H.; Fang, J.Y.; Li, Q.X.; Kaufmann, R.K.; Tucker, C.J.; Myneni, R.B. Evidence for a significant urbanization effect on climate in China. Proc. Natl. Acad. Sci. USA. 2004, 101, 9540–9544. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  6. Kron, W. Flood risk = hazard• values• vulnerability. Water Int. 2005, 30, 58–68. [Google Scholar] [CrossRef]
  7. Nicholls, S. Climate change, tourism and outdoor recreation in Europe. Manag. Leis. 2006, 11, 151–163. [Google Scholar] [CrossRef]
  8. Steiger, R.; Abegg, B.; Jänicke, L. Rain, rain, go away, come again another day. Weather preferences of summer tourists in mountain environments. Atmosphere 2016, 7, 63. [Google Scholar] [CrossRef]
  9. Intergovernmental Panel on Climate Change (IPCC). Climate Change 2007: The Physical Science Basis: Summary for Policymakers; IPCC: Geneva, Switzerland, 2007. [Google Scholar]
  10. Coumou, D.; Rahmstorf, S. A decade of weather extremes. Nat. Clim. Change 2012, 2, 491. [Google Scholar] [CrossRef]
  11. Groisman, P.Y.; Knight, R.W.; Karl, T.R.; Easterling, D.R.; Sun, B.; Lawrimore, J.H. Contemporary changes of the hydrological cycle over the contiguous United States: Trends derived from in situ observations. J. Hydrometeorol. 2004, 5, 64–85. [Google Scholar] [CrossRef]
  12. Knutson, T.R.; McBride, J.L.; Chan, J.; Emanuel, K.; Holland, G.; Landsea, C.; Held, I.; Kossin, J.P.; Srivastava, A.; Sugi, M. Tropical cyclones and climate change. Nat. Geosci. 2010, 3, 157. [Google Scholar] [CrossRef]
  13. Trenberth, K.E. Changes in precipitation with climate change. Clim. Res. 2011, 47, 123–138. [Google Scholar] [CrossRef] [Green Version]
  14. Georgakakos, K.P. On the design of national, real-time warning systems with capability for site-specific, flash-flood forecasts. Bull. Am. Meteorol. Soc. 1986, 67, 1233–1239. [Google Scholar] [CrossRef]
  15. Jonkman, S.N. Global perspectives on loss of human life caused by floods. Nat. Hazards 2005, 34, 151–175. [Google Scholar] [CrossRef]
  16. National Weather Service (NWS). NCRFC Flash Flood Guidance; Office of Hydrologic Development, National Weather Service, National Oceanic and Atmospheric Administration: Silver Spring, MD, USA, 1998. [Google Scholar]
  17. American Meteorological Society (AMS). Policy statement: Prediction and mitigation of flash floods. Bull. Am. Meteor. Soc. 2000, 81, 1338–1340. [Google Scholar] [CrossRef]
  18. Sweeney, T.L. Modernized Areal Flash Flood Guidance; National Oceanic and Atmospheric Administration: Silver Spring, MD, USA, 1992. [Google Scholar]
  19. Georgakakos, K.; Graham, R.; Jubach, R.; Modrick, T.; Shamir, E.; Spencer, C.; Sperfslage, J. Global Flash Flood Guidance System, Phase I. HRC Technical Report; Hydrologic Research Center: San Diego, CA, USA, 2013. [Google Scholar]
  20. Smith, P.; Pappenberger, F.; Wetterhall, F.; del Pozo, J.T.; Krzeminski, B.; Salamon, P.; Muraro, D.; Kalas, M.; Baugh, C. On the Operational Implementation of the European Flood Awareness System (EFAS). In Flood Forecasting: A Global Perspective; Academic Press: Cambridge, MA, USA, 2016; pp. 313–348. [Google Scholar]
  21. Korea Meteorological Administration (KMA). Development of Monitoring and Prediction Technology for Severe Weather (Heavy Rainfall) over the Korean Peninsula; KMA: Seoul, Korea, 2006. [Google Scholar]
  22. National Disaster Management Research Institue (NDMI). Advancement of Mountain Flash Flood Prediction System & Development of Decision-Making Supporting System; NDMI: Seoul, Korea, 2010. [Google Scholar]
  23. Mueller, C.; Saxen, T.; Roberts, R.; Wilson, J.; Betancourt, T.; Dettling, S.; Oien, N.; Yee, J. NCAR auto-nowcast system. Weather Forecast. 2003, 18, 545–561. [Google Scholar] [CrossRef]
  24. Dixon, M.; Wiener, G. TITAN: Thunderstorm identification, tracking, analysis, and nowcasting—A radar-based methodology. J. Atmos. Ocean. Technol. 1993, 10, 785–797. [Google Scholar] [CrossRef]
  25. Saito, K.; Fujita, T.; Yamada, Y.; Ishida, J.-I.; Kumagai, Y.; Aranami, K.; Ohmori, S.; Nagasawa, R.; Kumagai, S.; Muroi, C. The operational JMA nonhydrostatic mesoscale model. Mon. Weather Rev. 2006, 134, 1266–1298. [Google Scholar] [CrossRef]
  26. Terada, M. The Development of Short-Term Rainfall Prediction System in Mountainous Region by the Combination of Extrapolation Model and Mesoscale Atmosphereic Model. In Proceedings of the 6th International Symposium on Hydrological Applications of Weather Radar, Melbourne, Australia, 2–4 February 2004. [Google Scholar]
  27. Korea Meteorological Administration (KMA). Study on the Weather Radar Application (II); KMA: Seoul, Korea, 2008. [Google Scholar]
  28. Germann, U.; Zawadzki, I. Scale-dependence of the predictability of precipitation from continental radar images. Part I: Description of the methodology. Mon. Weather Rev. 2002, 130, 2859–2873. [Google Scholar] [CrossRef]
  29. Radhakrishna, B.; Zawadzki, I.; Fabry, F. Predictability of precipitation from continental radar images. Part V: Growth and decay. J. Atmos. Sci. 2012, 69, 3336–3349. [Google Scholar] [CrossRef]
  30. National Institute of Meteorological Sciences (NIMS). Development of Very Short-Range Prediction System for Severe Weather; NIMS: Seoul, Korea, 2009. [Google Scholar]
  31. Zahrei, A.; Hsu, K.L.; Sorroshian, S.; Gourley, J.J.; Lakshmanan, V.; Hong, Y.; Bellerby, T. Quantitative precipitation nowcasting: A Lagrangian pixel-based approach. Atmos. Res. 2012, 118, 418–434. [Google Scholar] [CrossRef]
  32. Wang, G.; Wong, W.; Hong, Y.; Liu, L.; Dong, J.; Xue, M. Improvement of forecast skill for severe weather by merging radar-based extrapolation and storm-scale NWP corrected forecast. Atmos. Res. 2015, 154, 14–24. [Google Scholar] [CrossRef]
  33. Yu, W.; Nakakita, E.; Kim, S.; Yamaguchi, K. Improvement of rainfall and flood forecasts by blending ensemble NWP rainfall with radar prediction considering orographic rainfall. J. Hydrol. 2015, 531, 494–507. [Google Scholar] [CrossRef]
  34. Migliorini, S.; Dixon, M.; Bannister, R.; Ballard, S. Ensemble prediction for nowcasting with a convection-permitting model—I: Description of the system and the impact of radar-derived surface precipitation rates. Tellus A Dyn. Meteorol. Oceanogr. 2011, 63, 468–496. [Google Scholar] [CrossRef]
  35. Done, J.; Craig, G.; Gray, S.; Clark, P.A. Case-to-case variability of predictability of deep convection in a mesoscale model. Q. J. R. Meteorol. Soc. 2012, 138, 638–648. [Google Scholar] [CrossRef]
  36. Kühnlein, C.; Keil, C.; Craig, G.; Gebhardt, C. The impact of downscaled initial condition perturbations on convective-scale ensemble forecasts of precipitation. Q. J. R. Meteorol. Soc. 2014, 140, 1552–1562. [Google Scholar] [CrossRef]
  37. Molteni, F.; Buizza, R.; Palmer, T.N.; Petroliagis, T. The ECMWF ensemble prediction system: Methodology and validation. Q. J. R. Meteorol. Soc. 1996, 122, 73–119. [Google Scholar] [CrossRef]
  38. Hewitt, C.D. Ensembles-based predictions of climate changes and their impacts. Eos Trans. Am. Geophys. Union 2004, 85, 566. [Google Scholar] [CrossRef]
  39. Hanley, K.; Kirshbaum, D.; Belcher, S.; Roberts, N.; Leoncini, G. Ensemble predictability of an isolated mountain thunderstorm in a high-resolution model. Q. J. R. Meteorol. Soc. 2011, 137, 2124–2137. [Google Scholar] [CrossRef]
  40. Kober, K.; Craig, G.; Keil, C.; Dörnbrack, A. Blending a probabilistic nowcasting method with a high-resolution numerical weather prediction ensemble for convective precipitation forecasts. Q. J. R. Meteorol. Soc. 2012, 138, 755–768. [Google Scholar] [CrossRef]
  41. Richardson, D.S. Skill and relative economic value of the ECMWF ensemble prediction system. Q. J. R. Meteorol. Soc. 2000, 126, 649–667. [Google Scholar] [CrossRef]
  42. Marsigli, C.; Boccanera, F.; Montani, A.; Paccagnella, T. The COSMO-LEPS mesoscale ensemble system: Validation of the methodology and verification. Nonlinear Process. Geophys. 2005, 12, 527–536. [Google Scholar] [CrossRef]
  43. Bowler, N.E.; Arribas, A.; Mylne, K.R.; Robertson, K.B.; Beare, S.E. The MOGREPS short-range ensemble prediction system. Q. J. R. Meteorol. Soc. 2008, 134, 703–722. [Google Scholar] [CrossRef]
  44. Kay, J.K.; Kim, H.M.; Park, Y.-Y.; Son, J. Effect of doubling the ensemble size on the performance of ensemble prediction in the warm season using MOGREPS implemented at the KMA. Adv. Atmos. Sci. 2013, 30, 1287–1302. [Google Scholar] [CrossRef]
  45. Dalchér, A.; Kalnay, E.; Hoffman, R.N. Medium range lagged average forecasts. Mon. Weather Rev. 1988, 116, 402–416. [Google Scholar] [CrossRef]
  46. Branković, Č.; Palmer, T.; Molteni, F.; Tibaldi, S.; Cubasch, U. Extended-range predictions with ECMWF models: Time-lagged ensemble forecasting. Q. J. R. Meteorol. Soc. 1990, 116, 867–912. [Google Scholar] [CrossRef]
  47. Mittermaier, M.P. Improving short-range high-resolution model precipitation forecast skill using time-lagged ensembles. Q. J. R. Meteorol. Soc. 2007, 133, 1487–1500. [Google Scholar] [CrossRef]
  48. Scheufele, K.; Kober, K.; Craig, G.C.; Keil, C. Combining probabilistic precipitation forecasts from a nowcasting technique with a time-lagged ensemble. Meteorol. Appl. 2014, 21, 230–240. [Google Scholar] [CrossRef]
  49. Buizza, R.; Tribbia, J.; Molteni, F.; Palmer, T. Computation of optimal unstable structures for a numerical weather prediction model. Tellus A 1993, 45, 388–407. [Google Scholar] [CrossRef]
  50. Toth, Z.; Kalnay, E. Ensemble forecasting at NMC: The generation of perturbations. Bull. Am. Meteorol. Soc. 1993, 74, 2317–2330. [Google Scholar] [CrossRef]
  51. Evensen, G. Sequential data assimilation with a nonlinear quasi-geostrophic model using Monte Carlo methods to forecast error statistics. J. Geophys. Res. Oceans 1994, 99, 10143–10162. [Google Scholar] [CrossRef]
  52. Houtekamer, P.; Derome, J. Methods for ensemble prediction. Mon. Weather Rev. 1995, 123, 2181–2196. [Google Scholar] [CrossRef]
  53. Kuczera, G.; Parent, E. Monte Carlo assessment of parameter uncertainty in conceptual catchment models: The Metropolis algorithm. J. Hydrol. 1998, 211, 69–85. [Google Scholar] [CrossRef]
  54. Gebhardt, C.; Theis, S.; Paulat, M.; Bouallègue, Z.B. Uncertainties in COSMO-DE precipitation forecasts introduced by model perturbations and variation of lateral boundaries. Atmos. Res. 2011, 100, 168–177. [Google Scholar] [CrossRef]
  55. Shiogama, H.; Watanabe, M.; Ogura, T.; Yokohata, T.; Kimoto, M. Multi-parameter multi-physics ensemble (MPMPE): A new approach exploring the uncertainties of climate sensitivity. Atmos. Sci. Lett. 2014, 15, 97–102. [Google Scholar] [CrossRef]
  56. Duan, Q.; Ajami, N.K.; Gao, X.; Sorooshian, S. Multi-model ensemble hydrologic prediction using Bayesian model averaging. Adv. Water Resour. 2007, 30, 1371–1386. [Google Scholar] [CrossRef] [Green Version]
  57. Boer, G.; Lambert, S. Multi-model decadal potential predictability of precipitation and temperature. Geophys. Res. Lett. 2008, 35. [Google Scholar] [CrossRef]
  58. Fowler, H.; Ekström, M. Multi-model ensemble estimates of climate change impacts on UK seasonal precipitation extremes. Int. J. Climatol. 2009, 29, 385–416. [Google Scholar] [CrossRef]
  59. Mailhot, A.; Beauregard, I.; Talbot, G.; Caya, D.; Biner, S. Future changes in intense precipitation over Canada assessed from multi-model NARCCAP ensemble simulations. Int. J. Climatol. 2012, 32, 1151–1163. [Google Scholar] [CrossRef]
  60. Sivillo, J.K.; Ahlquist, J.E.; Toth, Z. An ensemble forecasting primer. Weather Forecast. 1997, 12, 809–818. [Google Scholar] [CrossRef]
  61. Baker, L.; Rudd, A.; Migliorini, S.; Bannister, R. Representation of model error in a convective-scale ensemble prediction system. Nonlinear Process. Geophys. 2014, 21, 19–39. [Google Scholar] [CrossRef] [Green Version]
  62. Collier, C. Flash flood forecasting: What are the limits of predictability? Q. J. R. Meteorol. Soc. 2007, 133, 3–23. [Google Scholar] [CrossRef]
  63. Anderson, J.L. A method for producing and evaluating probabilistic forecasts from ensemble model integrations. J. Clim. 1996, 9, 1518–1530. [Google Scholar] [CrossRef]
  64. Zhu, Y.; Iyengar, G.; Toth, Z.; Tracton, M.; Marchok, T. Objective evaluation of the NCEP global ensemble forecasting system. In Proceedings of the Conference on Weather Analysis and Forecasting, Norfolk, VA, USA, 19–23 August 1996; pp. J79–J82. [Google Scholar]
  65. Buizza, R. Potential forecast skill of ensemble prediction and spread and skill distributions of the ECMWF ensemble prediction system. Mon. Weather Rev. 1997, 125, 99–119. [Google Scholar] [CrossRef]
  66. Hamill, T.M.; Colucci, S.J. Evaluation of Eta–RSM ensemble probabilistic precipitation forecasts. Mon. Weather Rev. 1998, 126, 711–724. [Google Scholar] [CrossRef]
  67. Leutbecher, M.; Palmer, T.N. Ensemble forecasting. J. Comput. Phys. 2008, 227, 3515–3539. [Google Scholar] [CrossRef]
  68. Epstein, E.S. Stochastic dynamic prediction. Tellus 1969, 21, 739–759. [Google Scholar] [CrossRef]
  69. Leith, C. Theoretical skill of Monte Carlo forecasts. Mon. Weather Rev. 1974, 102, 409–418. [Google Scholar] [CrossRef]
  70. Tribbia, J.J.; Baumhefner, D.P. Estimates of the predictability of low-frequency variability with a spectral general circulation model. J. Atmos. Sci. 1988, 45, 2306–2318. [Google Scholar] [CrossRef]
  71. Schubert, S.D.; Suarez, M. Dynamical predictability in a simple general circulation model: Average error growth. J. Atmos. Sci. 1989, 46, 353–370. [Google Scholar] [CrossRef]
  72. Hoffman, R.N.; Kalnay, E. Lagged average forecasting, an alternative to Monte Carlo forecasting. Tellus A Dyn. Meteorol. Oceanogr. 1983, 35, 100–118. [Google Scholar] [CrossRef]
  73. Ebisuzaki, W.; Kalnay, E. Ensemble Experiments with a New Lagged Analysis Forecasting Scheme. Research Activities in Atmospheric and Oceanic Modelling; WMO: Geneva, Switzerland, 1991. [Google Scholar]
  74. Tracton, M.S.; Kalnay, E. Operational ensemble prediction at the National Meteorological Center: Practical aspects. Weather Forecast. 1993, 8, 379–398. [Google Scholar] [CrossRef]
  75. Beven, K.; Binley, A. The future of distributed models: Model calibration and uncertainty prediction. Hydrol. Process. 1992, 6, 279–298. [Google Scholar] [CrossRef]
  76. Vrugt, J.A.; Gupta, H.V.; Bouten, W.; Sorooshian, S. A Shuffled Complex Evolution Metropolis algorithm for optimization and uncertainty assessment of hydrologic model parameters. Water Resour. Res. 2003, 39. [Google Scholar] [CrossRef] [Green Version]
  77. Shamseldin, A.Y.; O’Connor, K.M.; Liang, G. Methods for combining the outputs of different rainfall–runoff models. J. Hydrol. 1997, 197, 203–229. [Google Scholar] [CrossRef]
  78. Shamseldin, A.Y.; O’Connor, K.M. A real-time combination method for the outputs of different rainfall-runoff models. Hydrol. Sci. J. 1999, 44, 895–912. [Google Scholar] [CrossRef]
  79. Georgakakos, K.P.; Seo, D.-J.; Gupta, H.; Schaake, J.; Butts, M.B. Towards the characterization of streamflow simulation uncertainty through multimodel ensembles. J. Hydrol. 2004, 298, 222–241. [Google Scholar] [CrossRef]
  80. Vislocky, R.L.; Fritsch, J.M. Improved Model Output and Statistics through Model Consensus. Bull. Am. Meteorol. Soc. 1995, 76, 1157–1164. [Google Scholar] [CrossRef]
  81. Krishnamurti, T.; Kishtawal, C.; LaRow, T.E.; Bachiochi, D.R.; Zhang, Z.; Williford, C.E.; Gadgil, S.; Surendran, S. Improved weather and seasonal climate forecasts from multimodel superensemble. Science 1999, 285, 1548–1550. [Google Scholar] [CrossRef]
  82. Krishnamurti, T.N.; Kishtawal, C.; Zhang, Z.; LaRow, T.; Bachiochi, D.; Williford, E.; Gadgil, S.; Surendran, S. Multimodel ensemble forecasts for weather and seasonal climate. J. Clim. 2000, 13, 4196–4216. [Google Scholar] [CrossRef]
  83. Miyakoda, K.; Talagrand, O. The assimilation of past data in dynamical analysis. I. Tellus 1971, 23, 310–317. [Google Scholar] [CrossRef]
  84. Lawrence, A.R.; Hansen, J.A. A transformed lagged ensemble forecasting technique for increasing ensemble size. Mon. Weather Rev. 2007, 135, 1424–1438. [Google Scholar] [CrossRef]
  85. Lu, C.; Yuan, H.; Schwartz, B.E.; Benjamin, S.G. Short-range numerical weather prediction using time-lagged ensembles. Weather Forecast. 2007, 22, 580–595. [Google Scholar] [CrossRef]
  86. Buizza, R. Comparison of a 51-member low-resolution (TL399L62) ensemble with a 6-member high-resolution (TL799L91) lagged-forecast ensemble. Mon. Weather Rev. 2008, 136, 3343–3362. [Google Scholar] [CrossRef]
  87. Trilaksono, N.J.; Otsuka, S.; Yoden, S. A time-lagged ensemble simulation on the modulation of precipitation over west Java in January–February 2007. Mon. Weather Rev. 2012, 140, 601–616. [Google Scholar] [CrossRef]
  88. Jie, W.; Wu, T.; Wang, J.; Li, W.; Liu, X. Improvement of 6–15 day precipitation forecasts using a time-lagged ensemble method. Adv. Atmos. Sci. 2014, 31, 293–304. [Google Scholar] [CrossRef]
  89. Ushiyama, T.; Sayama, T.; Tatebe, Y.; Fujioka, S.; Fukami, K. Numerical simulation of 2010 Pakistan flood in the Kabul River basin by using lagged ensemble rainfall forecasting. J. Hydrometeorol. 2014, 15, 193–211. [Google Scholar] [CrossRef]
  90. Vogel, H.; Förstner, J.; Vogel, B.; Hanisch, T.; Mühr, B.; Schättler, U.; Schad, T. Time-lagged ensemble simulations of the dispersion of the Eyjafjallajökull plume over Europe with COSMO-ART. Atmos. Chem. Phys. 2014, 14, 7837–7845. [Google Scholar] [CrossRef]
  91. Raynaud, L.; Pannekoucke, O.; Arbogast, P.; Bouttier, F. Application of a Bayesian weighting for short-range lagged ensemble forecasting at the convective scale. Q. J. R. Meteorol. Soc. 2015, 141, 459–468. [Google Scholar] [CrossRef]
  92. Du, Y.; Qi, L.; Cao, X. Selective ensemble-mean technique for tropical cyclone track forecast by using time-lagged ensemble and multi-centre ensemble in the western North Pacific. Q. J. R. Meteorol. Soc. 2016, 142, 2452–2462. [Google Scholar] [CrossRef]
  93. Wang, Y.; Min, J.; Chen, Y.; Huang, X.-Y.; Zeng, M.; Li, X. Improving precipitation forecast with hybrid 3DVar and time-lagged ensembles in a heavy rainfall event. Atmos. Res. 2017, 183, 1–16. [Google Scholar] [CrossRef]
  94. Fritsch, J.; Hilliker, J.; Ross, J.; Vislocky, R. Model consensus. Weather Forecast. 2000, 15, 571–582. [Google Scholar] [CrossRef]
  95. Bates, J.M.; Granger, C.W. The combination of forecasts. J. Oper. Res. Soc. 1969, 20, 451–468. [Google Scholar] [CrossRef]
  96. Schweppe, F.C. Uncertain Dynamic Systems; Prentice Hall: Upper Saddle River, NJ, USA, 1973. [Google Scholar]
  97. Granger, C.W.; Newbold, P. Identification of Two-Way Causal Systems. In Frontiers of Quantitative Economics; North-Holland: Amsterdam, The Netherlands, 1977. [Google Scholar]
  98. Granger, C.W.; Ramanathan, R. Improved methods of combining forecasts. J. Forecast. 1984, 3, 197–204. [Google Scholar] [CrossRef]
  99. Haykin, S. Neural Networks: A Comprehensive Foundation; Prentice Hall: Upper Saddle River, NJ, USA, 1994. [Google Scholar]
  100. Newbold, P.; Granger, C.W. Experience with forecasting univariate time series and the combination of forecasts. J. R. Stat. Soc. Ser. A (Gen.) 1974, 137, 131–146. [Google Scholar] [CrossRef]
  101. Diebold, F.X.; Pauly, P. Structural change and the combination of forecasts. J. Forecast. 1987, 6, 21–40. [Google Scholar] [CrossRef]
  102. Bellon, A.; Austin, G. The evaluation of two years of real-time operation of a short-term precipitation forecasting procedure (SHARP). J. Appl. Meteorol. 1978, 17, 1778–1787. [Google Scholar] [CrossRef]
  103. Germann, U.; Zawadzki, I. Scale dependence of the predictability of precipitation from continental radar images. Part II: Probability forecasts. J. Appl. Meteorol. 2004, 43, 74–89. [Google Scholar] [CrossRef]
  104. Turner, B.; Zawadzki, I.; Germann, U. Predictability of precipitation from continental radar images. Part III: Operational nowcasting implementation (MAPLE). J. Appl. Meteorol. 2004, 43, 231–248. [Google Scholar] [CrossRef]
  105. Germann, U.; Zawadzki, I.; Turner, B. Predictability of precipitation from continental radar images. Part IV: Limits to prediction. J. Atmos. Sci. 2006, 63, 2092–2108. [Google Scholar] [CrossRef]
  106. Ministry of Land, Infrastructure and Transport (MOLIT). Application of Rainfall Forecast with MAPLE; MOLIT: Seoul, Korea, 2009. [Google Scholar]
  107. Korea Meteorological Administration (KMA). Annual Climatological Report; KMA: Seoul, Korea, 2016. [Google Scholar]
  108. Bellon, A.; Zawadzki, I.; Kilambi, A.; Lee, H.C.; Lee, Y.H.; Lee, G. McGill algorithm for precipitation nowcasting by Lagrangian extrapolation (MAPLE) applied to the South Korean radar network. Part I: Sensitivity studies of the Variational Echo Tracking (VET) technique. Asia Pac. Atmos. Sci. 2010, 46, 369–381. [Google Scholar] [CrossRef]
  109. Lee, H.C.; Lee, Y.H.; Ha, J.C.; Chang, D.E.; Bellon, A.; Zawadzki, I.; Lee, G. McGill algorithm for precipitation nowcasting by Lagrangian extrapolation (MAPLE) applied to the South Korean radar network. Part II: Real-time verification for the summer season. Asia Pac. Atmos. Sci. 2010, 46, 383–391. [Google Scholar] [CrossRef]
  110. Yoon, S.S. Adaptive blending method of radar-based and numerical weather prediction QPFs for urban flood forecasting. Remote Sens. 2019, 11, 642. [Google Scholar] [CrossRef]
Figure 1. The entire domain of MAPLE forecast (red-lined box), with 60 min lead time forecast generated at 01:00 5 July 2016. MAPLE: McGill Algorithm for Precipitation Nowcasting by Lagrangian Extrapolation.
Figure 1. The entire domain of MAPLE forecast (red-lined box), with 60 min lead time forecast generated at 01:00 5 July 2016. MAPLE: McGill Algorithm for Precipitation Nowcasting by Lagrangian Extrapolation.
Water 11 01752 g001
Figure 2. Radar images of the selected four major storm events that occurred in 2016 and 2017.
Figure 2. Radar images of the selected four major storm events that occurred in 2016 and 2017.
Water 11 01752 g002
Figure 3. Change of the cross-correlation coefficient with respect to the time lag derived with the forecasts collected at the 10 target times and their average.
Figure 3. Change of the cross-correlation coefficient with respect to the time lag derived with the forecasts collected at the 10 target times and their average.
Water 11 01752 g003
Figure 4. Covariance matrix derived from all the available rainfall forecasts with ensemble members 2, 3, 6, 9, 18, and 36 on 04:30, 11 September 2017.
Figure 4. Covariance matrix derived from all the available rainfall forecasts with ensemble members 2, 3, 6, 9, 18, and 36 on 04:30, 11 September 2017.
Water 11 01752 g004
Figure 5. Final weights determined from the 10 different target times for the cases with the numbers of ensemble members 2, 3, 4, 6, and 9.
Figure 5. Final weights determined from the 10 different target times for the cases with the numbers of ensemble members 2, 3, 4, 6, and 9.
Water 11 01752 g005
Figure 6. Behavior of the RMSEs (root mean square errors) estimated for the 10 target times and their average.
Figure 6. Behavior of the RMSEs (root mean square errors) estimated for the 10 target times and their average.
Water 11 01752 g006
Figure 7. Rainfall forecasts made at 09:00 8 July 2017 for the lead times from 60 min to 110 min.
Figure 7. Rainfall forecasts made at 09:00 8 July 2017 for the lead times from 60 min to 110 min.
Water 11 01752 g007
Figure 8. Comparison of the ensemble forecast based on the weighted averaging with the ensemble forecast based on the simple arithmetic average method, for the single forecast and the observed at 09:00 8 July 2017.
Figure 8. Comparison of the ensemble forecast based on the weighted averaging with the ensemble forecast based on the simple arithmetic average method, for the single forecast and the observed at 09:00 8 July 2017.
Water 11 01752 g008
Table 1. Characteristics of the selected storm events in this study.
Table 1. Characteristics of the selected storm events in this study.
CharacteristicsStorm 1Storm 2Storm 3Storm 4
Dates2016/07/04–052016/10/04–052017/07/082017/09/10–11
Duration (hrs)20161713
Maximum rainfall intensity (mm/hr)42.8104.278.973.4
TypeMonsoonTyphoonMonsoonTyphoon
RegionCentralSouthernCentralSouthern
Direction
Target times
(rainfall intensity)
07/05 02:30
(42.8 mm/hr)
07/05 03:00
(34.5 mm/hr)
10/05 08:00
(57.7 mm/hr)
10/05 09:00
(98.3 mm/hr)
10/05 10:00
(104.2 mm/hr)
07/08 07:00
(66.2 mm/hr)
07/08 08:00
(78.9 mm/hr)
07/08 09:00
(71.2 mm/hr)
09/11 04:30
(68.1 mm/hr)
09/11 06:00
(73.4 mm/hr)
Table 2. Weights to be used to make the ensemble forecast with six ensemble members.
Table 2. Weights to be used to make the ensemble forecast with six ensemble members.
No.Forecasting Time
1 h2 h3 h
10.30400.26350.2465
20.17050.18900.2450
30.17110.16280.1739
40.16970.15190.1475
50.12710.12920.1058
60.05760.10370.0813
Table 3. Evaluation of the single forecast, the ensemble forecast based on the simple arithmetic averaging, and the ensemble forecast based on the weighted averaging at 09:00 July 8, 2017.
Table 3. Evaluation of the single forecast, the ensemble forecast based on the simple arithmetic averaging, and the ensemble forecast based on the weighted averaging at 09:00 July 8, 2017.
MeasureTypeForecasting Time
1 h2 h3 h
RSingle forecast0.250.310.09
Ensemble forecast based on the simple arithmetic averaging0.390.250.09
Ensemble forecast based on the weighted averaging0.420.300.13
RMSESingle forecast9.668.6910.56
Ensemble forecast based on the simple arithmetic averaging7.147.128.50
Ensemble forecast based on the weighted averaging6.856.908.23
Table 4. Evaluation of the single forecast, the ensemble forecast based on the simple arithmetic averaging, and the ensemble forecast based on the weighted averaging at 10 target times.
Table 4. Evaluation of the single forecast, the ensemble forecast based on the simple arithmetic averaging, and the ensemble forecast based on the weighted averaging at 10 target times.
MeasureTypeForecasting Time
1 h2 h3 h
RSingle forecast0.260.190.18
Ensemble forecast based on the simple arithmetic averaging0.270.210.19
Ensemble forecast based on the weighted averaging0.270.220.20
RMSESingle forecast7.057.958.20
Ensemble forecast based on the simple arithmetic averaging6.076.296.53
Ensemble forecast based on the weighted averaging5.976.366.57

Share and Cite

MDPI and ACS Style

Na, W.; Yoo, C. Optimize Short-Term Rainfall Forecast with Combination of Ensemble Precipitation Nowcasts by Lagrangian Extrapolation. Water 2019, 11, 1752. https://doi.org/10.3390/w11091752

AMA Style

Na W, Yoo C. Optimize Short-Term Rainfall Forecast with Combination of Ensemble Precipitation Nowcasts by Lagrangian Extrapolation. Water. 2019; 11(9):1752. https://doi.org/10.3390/w11091752

Chicago/Turabian Style

Na, Wooyoung, and Chulsang Yoo. 2019. "Optimize Short-Term Rainfall Forecast with Combination of Ensemble Precipitation Nowcasts by Lagrangian Extrapolation" Water 11, no. 9: 1752. https://doi.org/10.3390/w11091752

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop