Next Article in Journal
The Similarity of the Action of Franklin and ESE Lightning Rods under Natural Conditions
Previous Article in Journal
Estimation of the Impact of Ozone on Four Economically Important Crops in the City Belt of Central Mexico
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Application of Intelligent Dynamic Bayesian Network with Wavelet Analysis for Probabilistic Prediction of Storm Track Intensity Index

College of Meteorology and Oceanography, National University of Defense Technology, Nanjing 211101, China
*
Author to whom correspondence should be addressed.
Atmosphere 2018, 9(6), 224; https://doi.org/10.3390/atmos9060224
Submission received: 3 May 2018 / Revised: 3 June 2018 / Accepted: 8 June 2018 / Published: 11 June 2018
(This article belongs to the Section Meteorology)

Abstract

:
The effective prediction of storm track (ST) is greatly beneficial for analyzing the development and anomalies of mid-latitude weather systems. For the non-stationarity, nonlinearity, and uncertainty of ST intensity index (STII), a new probabilistic prediction model was proposed based on dynamic Bayesian network (DBN) and wavelet analysis (WA). We introduced probability theory and graph theory for the first time to quantitatively describe the nonlinear relationship and uncertain interaction of the ST system. Then a casual prediction network (i.e., DBN) was constructed through wavelet decomposition, structural learning, parameter learning, and probabilistic inference, which was used for expression of relation among predictors and probabilistic prediction of STII. The intensity prediction of the North Pacific ST with data from 1961–2010 showed that the new model was able to give more comprehensive prediction information and higher prediction accuracy and had strong generalization ability and good stability.

Graphical Abstract

1. Introduction

One of the primary features of mid- and high-latitude atmospheric circulation (AC) is transient variability, which is closely related to the growth and decay of daily weather systems. In the 1970s, Blackmon [1] found sub-weekly (2.5–6 days) transient eddies over the North Pacific and North Atlantic with filtering data. He defined the two zonal-extended regions with the most intensive transient variability as “storm track” (ST), which can be divided, respectively, into North Pacific ST (NPST) and North Atlantic ST (NAST). ST corresponds significantly with cyclone and anticyclone activities, which can be the indication of the development of weather systems. Moreover, as a contacting link of heat and kinetic energy between ocean and atmosphere, ST plays an important role in the maintenance of AC and climate change [2].
ST is crucial to the short-term anomaly of AC with interactions between ST and low-frequency circulation. So far, many studies have revealed the interaction. Lau [3] studied the seasonal variation of ST and pointed out that the main mode of the variation was related to the teleconnection pattern of the low-frequency circulation in the northern hemisphere. Straus et al. [4] discovered that the ST anomaly was closely related to the sea surface temperature (SST) anomaly in the Kuroshio area. Zhu et al. [5] summarized the correlation between the winter NPST and the Pacific-North America teleconnection pattern (PNA) and Western Pacific teleconnection pattern (WP). Ren et al. [6] used the empirical orthogonal function (EOF) to analyze the temporal and spatial variability of the winter NPST and explained its coupled pattern with the mid-latitude air-sea system. Liu et al. [7] determined the correlation and potential influencing mechanisms between the Polar vortex intensity and NPST. Both observational research and theoretical studies have indicated the symbiotic relationship between ST and large-scale AC in the Northern Hemisphere. However, most studies are just diagnostic analysis about ST variability and correlation. To grasp the evolvement role of ST, prediction is becoming an urgent area of research.
However, ST is a highly nonlinear system due to nonlinear processes in the air-sea system. There is relatively little research on the numerical forecasting or statistical forecasting of ST both at home and abroad. That may result from the diversity of influencing factors and the complexity of correlation mechanisms. In addition, strong transients and uncertain rules have also caused difficulties in ST prediction. In meteorological prediction, climate indexes are often used as predictands and predictors to explain the behavior of future climate. Therefore, how to quantify the intensity and spatial-temporal variation as indexes is the premise of ST prediction. At present, there are several indexes that can indicate the possible evolution of ST, whose calculation methods with filtering variance includes the central point representation [8,9], regional average [10], and EOF [11]. The above studies achieve the quantitative description of the nonlinear ST system by establishing an index. Thus, we can predict the temporal and spatial variation of ST with the ST index.
The prediction of ST index belongs to the prediction of nonlinear time-series. In the field of meteorology and oceanology, data-driven models (i.e., statistical models) are suitable predicting tools due to their rapid development times, as well as low information requirements compared to physical-based models. Hong et al. [12] introduced the inversion idea and used genetic algorithm to reconstruct the nonlinear forecasting model of the subtropical high index from historical data. Liu et al. [13] integrated the EOF, wavelet decomposition and support vector machine (SVM) method to predict the 500 hPa geopotential height in summer. Zhu et al. [14] conducted a short-term forecast experiment of the tropical atmospheric seasonal oscillation (MJO) index, using both the singular spectrum analysis and auto-regression model. Jia et al. [15] applied the correlation analysis and optimal subset regression to select predictors and established a statistical prediction model for the subtropical high index. The above statistical methods require a large amount of historical data, but their efficiency on processing big data is low. Most importantly, these methods have weak ability to mine and express the internal relations from data quantitatively. Therefore, the above models are still flawed for prediction of ST index.
With the rapid development of computer technology and information acquisition technology, machine learning (ML) and data mining (DM) have opened a new era—artificial intelligence. Breakthroughs have been made by the application of ML and DM in the fields of biology, finance, and medicine [16,17,18], and they have also brought opportunities for the development of predicting technology in meteorology and oceanology. Many scholars have applied ML and DM to meteorological prediction: Yang et al. [19] used the association rules mining to analyze the data set of North Atlantic hurricane history trace and predicted the intensity of the North Atlantic hurricane based on the mining results. Royston et al. [20] applied the semantic decision tree to conduct regular mining and forecast modeling with water level and meteorological data, to forecast the storm surge of Thames Estuary. Gordon et al. [21] constructed a meteorological prediction model using neural network (NN) and frequency domain algorithm to implement 24-hour refined prediction. Teng [22] extracted highly relevant factors and used the stepwise regression and SVM to establish the medium-term prediction model of the tropical cyclone path in the Western Pacific.
To a certain extent, ML and DM can overcome the shortcomings of the above statistical methods and achieve data mining and reasoning with rapid development times. However, the above ML algorithms are all deterministic methods, that is, give a certain value for a certain predicting moment. Please note that ST is affected by the nonlinear action of various weather systems and has strong uncertainties. When the intensity and position of ST fluctuate greatly, deterministic single-point prediction may not achieve the desired accuracy. In contrast, the probabilistic prediction method could give the result in the form of probability distribution, covering more complete prediction information.
As a new branch of ML theory, Bayesian network (BN) makes it feasible for the probabilistic prediction of ST index, which has been initially used in the field of meteorology and hydrology [23,24]. The emerging dynamic Bayesian Network (DBN) adds time information to the classical BN, which becomes a new probabilistic expression and reasoning tool owing to the ability to deal with uncertainties. Correspondingly, ST is affected by many factors in the mid-latitude air-sea system. There are random and non-linear interactions between these factors at same and different time. The features coincide exactly with the DBN, thus DBN is a powerful theoretical tool for probabilistic prediction of ST index. Additionally, note that time-series of the ST index is non-stationary. This limitation with non-stationary data has led to the recent formation of hybrid models, where data is preprocessed for non-stationary characteristics and then run through a predicting method such as ML algorithms to cope with the nonlinearity. Wavelet analysis (WA), an effective tool to deal with non-stationary data, has recently been applied to meteorological forecast. We will combine WA with DBN to achieve scientific and accurate prediction of ST index.
In this paper, we constructed the WA-DBN model to predict the winter PST intensity index. To deal with the non-stationarity, nonlinearity, and uncertainty, we introduced DBN theory innovatively and combined WA to establish a data-driven model for predicting the monthly STII using large-scale climate indexes as the predictors. We first selected the climate indexes significantly related to ST as predictors. Then based on wavelet decomposition, a WA-DBN probabilistic prediction model was constructed through structure learning, parameter learning and probabilistic reasoning. Finally, a deeper comparative analysis of model performance is conducted with key statistical indicators.

2. Theory and Method

2.1. Definition of Storm Track Intensity Index

To quantitatively describe the intensity of ST and its spatial-temporal variation, we refer to the existing definition method to calculate the intensity index. We identify the ST as the sub-weekly transient of the 500 hPa geopotential height. First sub-weekly transient eddies are derived from the geopotential height based on 31 symmetrical digital filter [25]. Then we calculate the monthly average band-pass filtering variance, selecting all grid points with the filtering variance greater than a certain fixed threshold, of which the mean value is defined as the ST intensity index (STII). The fixed threshold is usually taken as 20 dagpm 2 .

2.2. Dynamic Bayesian Network Theory

Bayesian Network (BN) was proposed by Judea Pearl in 1988, including the static Bayesian Network (SBN) and the dynamic Bayesian Network (DBN). Based on probability theory and graph theory, DBN integrates the time dimension into SBN to represent the temporal correlation, which forms a dynamic reasoning model with dynamic analysis and prediction of temporal information [26].
According to Bayesian theory, BN is a directed acyclic graph expressing the probabilistic relation between variables. It is mainly composed of nodes, directed arcs, and conditional probability distribution (CPT). DBN is an extension of SBN in the time dimension, and can be explained by a bigram < B 0 , B > :
  • B 0 denotes the initial network, that is the SBN of each time slice. It contains the network structure and probability distribution of nodes at the same time;
  • B denotes the transition network. It contains the causal link and the transition probability distribution of nodes in different time slice.
Define a variable set X = [ X 1 , X 2 , , X n ] and a finite time segment [ 0 , 1 , , T ] , then the joint probability distribution of X 0 , , X T is
P ( X 0 , , X T ) = P ( X 0 ) t = 1 T i = 1 N P [ X i t | π ( X i t ) ] .
where X i t denotes the node i located in t time slice, π ( X i t ) denotes the parent of X i t . Formula (1) denotes the probabilistic reasoning of different time slices and different node states.
The construction of DBN includes structure learning and parameter learning: the former needs to construct B 0 and B ; the latter needs to determine the initial probability P ( X 0 ) , the observation conditional probability P [ X i t | π ( X i t ) ] , and the transition conditional probability P ( X t | X t 1 ) . There are two common learning technologies for DBN: manual construction based on expert knowledge and automatic learning based on intelligent algorithms [27]. We adopt a combination of subjective and objective methods for DBN learning. Expert knowledge is used for structural learning while objective data is used for parameter learning.

2.3. Wavelet Analysis

Wavelet analysis (WA) is a mathematical function that can be used for the analysis of time-series that contain non-stationarities [28]. WA of the input variables can analyze various similarities within the dataset by decomposing data into different levels. Large-scale frequencies are checked with approximation series, while small-scale frequencies are checked by details (4–5 levels of decomposition). Wavelet decomposition gives time frequency representation of a signal at different temporal domains, providing considerable information about the physical structure of the data. Wavelet reconstruction can synthesize the different frequency signals to achieve information integration. The application of WA in meteorology and oceanology is relatively mature [29,30], therefore this paper will not give unnecessary details.

3. Probabilistic Prediction Model Based on WA and DBN

The STII prediction model based on WA and DBN (WA-DBN) was proposed for two problems: First, the time-series of intensity index is nonlinear due to strong transient; second, both ST intensity and predictors contain probabilistic uncertainties. Figure 1 displays the technical structure of WA-DBN model.
Seen from Figure 1, the WA-DBN prediction model includes two modules: WA module and DBN prediction module. WA is used for the decomposition and reconstruction of non-stationary time series. DBN is used for probabilistic prediction through structure learning, parameter learning and inference calculation, which is the core of this prediction model.

3.1. Structural Learning

The DBN structure describing the casual relation between various weather systems and the STII is the basis of intensity index prediction. The structural learning includes the selection of node variables and the determination of the dependencies among nodes. We adopt an expert-constructed method for structural learning. Based on professional knowledge, the predictors are selected as child nodes of the DBN and a causal topology is constructed, including the initial network and the transition network.

3.1.1. Node Determination—Predictor Selection

We choose key factors that have significant influence on the ST as network nodes. Winter ST relates to many members in the North Pacific atmosphere-ocean system. Limpasuvan et al. [31] pointed out that the weakening of the stratospheric polar vortex would affect the changes of the ST and jet; Gao [32] conducted a preliminary exploration of the relationship between winter NPST and Arctic Oscillation (AO) index, and discovered that AO and NPST had the same phase of strong and weak variation; Gu et al. [33] determined the relationship between NPST anomaly in winter and the AC in East Asia. In addition, the NPST intensity is closely related to the atmospheric system, such as the WP and PNA teleconnection patterns, jet flow anomaly, monsoon activity, the Aleutian low pressure, Siberian high, and the ocean circulation and SST anomaly [34,35,36,37,38,39].
A time-delayed correlation analysis between the above AC indexes and the STII has been made, and the 9 most relevant indexes are chosen as predictors: AL index, AO index, PVI (polar vortex intensity) index, PVA (polar vortex area) index, KI index (Kuroshio SST), NINO index (Niño-3.4 SST), PNA index, SH (Siberian high pressure) index and WP index, respectively denoted as AL ,   AO ,   PVI ,   PVA ,   KI ,   NINO ,   PNA ,   SH , and WP . The complete DBN node set is:
  • Child node set (predictor) = { AL ,   AO ,   PVI ,   PVA ,   KI ,   NINO ,   PNA ,   SH ,   WP }
  • Parent node set (predictand) = { STII }

3.1.2. Construction of Initial Network and Transition Network

The definition of causality is the premise to express the transfer rules between different nodes. Based on the network nodes and the analysis in Section 3.1.1, we define the following causality:
{ P ( AL , AO , PVI , PVA , KI , NINO , PNA , SH , WP | STII ) P ( STII [ t + 1 ] | STII [ t ] )
Figure 2 shows the DBN topology structure between two adjacent time slices, including the initial network and transition network.

3.2. Parameter Learning

The aim of node parameters determination is to extract the probability distribution from the historical data that truly reflects the causality among variables. The learning steps includes determining the states taken by the node and training parameters by intelligent algorithms. Under the complete historical data, we choose the Expectation-Maximization (EM) algorithm to learn the parameters.

3.2.1. Determination of Node States

As DBN is better at processing discrete data, the continuous data is required to be discretized to determine the number of states taken by the node. We analyze the historical data over a period and discretize the node states according to the maximum and minimum values. Consequently, discrete state space of each node is obtained used the equal interval division method [40].

3.2.2. Calculation of Probability Distribution

First initialize the probability distribution of each node, including prior probability, observation probability, and transition probability. Then, based on the inference mechanism and training data, use EM algorithm to learn parameters and correct the initial probability distribution, to get the probability distribution that matches the objective data. The idea of the EM algorithm is to replace the actual statistics with the expected statistics, whose learning process is iterative and involves two steps:
  • E step: Infer the distribution P ( Z | X , θ t ) of hidden variable Z with the current parameter θ t and observed variables X , and calculate the expectation of log likelihood L L ( θ t | Z , X ) for Z :
    Q ( θ | θ t ) = E Z | X , θ t [ L L ( θ | X , Z ) ] ,
  • M step: Find the parameter to maximize the expectation likelihood:
    θ t + 1 = argmax [ Q ( θ | θ t ) ] .

3.3. Probabilistic Inference of Prediction Distribution

Based on the DBN structure and node parameters, the probability distribution calculation in the predicted time slice belongs to the probabilistic reasoning problem of BN. Bayesian inference algorithm includes exact algorithm and approximate algorithm. Approximate algorithm is more applied to large-scale network structure to solve the problem of excessive computation. Considering the scale of the network in our research, we apply the exact algorithm-joint tree inference algorithm to accurate reasoning [41]. Each predictor data is input as evidence into the DBN and the joint probability distribution is calculated, then it is marginalized to obtain the prediction distribution of STII.

4. Prediction Experiment of STII

We use the WA-DBN probabilistic prediction model to predict STII and all experiments are performed with MATLAB (R2012a, The MathWorks, Natick, MA, USA). Both the wavelet decomposition and DBN construction are conducted with Wavelet Tool-Box and FullBNT Tool-Box (v1.0.4) [42].

4.1. Data Introduction

In this research, the study area is taken as [30° N–60° N, 120° E–120° W]. Winter data (November to March) of the 500 hPa geopotential height at a horizontal resolution of 2.5° × 2.5° are obtained from the National Center for Environment Prediction (NECP) and National Center for Atmospheric Research (NCAR) of United States of American for the period 1961–2010. Data sources of the predictors are shown in Table 1, and the coverage period is the same. We calculate the STII according to the definition in Section 2.1 and get a single time-series of each variable with 250 months. The first 240 months are chosen as training data and the last 10 months are test data.

4.2. Construction of WA-DBN Prediction Model

4.2.1. Wavelet Decomposition Module

We apply wavelet decomposition to original STII time-series (first 240 months) with Daubechies orthogonal mother wavelet [43]. As a result, a total of seven detailed components and one level of approximation are acquired as shown in Figure 3.
Modes d 1 d 3 contain the noise information in the original sequence. d 4 d 7 are the detail modes with gradually increasing period and decreasing amplitude, containing the significant information of the original sequence. Mode a 7 indicates the linear trend of the original sequence.

4.2.2. DBN Prediction Module

DBN is applied to predict each sub-mode, and the final probabilistic prediction of STII is obtained by integrating each prediction result with a reconstruction algorithm.
(1) Data Process
According to historical records, we select reasonable interval division steps for 9 predictors and 8 sub-modes and denote them with consecutive numbers. The discretization standard is shown in Table 2. Then we discretize the predictors and sub-modes with equal interval to obtain training data of each modes (See Table S1 in Supplementary Material).
(2) Network Construction and Parameter Learning
Based on the node variables and causality determined in Section 3.1, the DBN structure is generated with MATLAB. In Figure 4, Node 1 denotes each sub-mode ( d 1 d 7 ,   a 7 ) of the predictand (STII) and nodes 2–10 denote predictors. Nodes 1–10 are in the previous time slice while nodes 11–20 are in the latter time slice.
After constructing the network structure, EM algorithm is used to learn parameters, i.e., the prior probability, conditional probability, and transition probability of the nodes. Where the transition probability is shown in Table A1 in Appendix A.

4.3. Reasoning Prediction and Result Analysis

Following the determination of structure and parameters, we discretize the test data of predictors (later 10 months) according to Table 2 and input the discrete value into DBN to reason and predict the probability distribution of each sub-mode in the last 10 months. The results are shown in Table A2 in Appendix A. Take the median of the most probable interval as the predictand of each sub-mode, then apply the wavelet reconstruction to get the composite predictand of STII. Figure 5 plots the monthly predicted and actual STII in the test period together with the prediction absolute error (PAE) yield of the WA-DBN model for each tested month.
At present, most of the common evaluation indicators for prediction accuracy in the literature are the following: average sum error, average absolute error, average relative error, root mean square error, etc. [44]. All of them can measure the deviation between the predicted value and the actual value.
To statistically test the performance of WA-DBN model, three prediction score metrics are employed: root mean square error (RMSE), mean relative error (MRE) and correlation coefficient (R). The RMSE of the prediction result is 2.8954, the MRE is 0.0794, and the R value is 0.6579. The prediction variation of the STII is less and the changing tendency agrees with that in reality.
Different from previous prediction models, the WA-DBN model could provide a casual graph and conditional probability. Therefore, it can intuitively and quantitatively express the relationship between STII and climate indexes, which could deal with the uncertainty and nonlinearity to improve prediction accuracy. In contrast with the certain mapping relationship, the model could establish the probabilistic mapping between predictands and predictors and offer the comprehensive prediction information with probability distribution.

5. Model Analysis and Discussion

To make a further test for the WA-DBN prediction model, we conduct another prediction experiment, the regression fitting experiment, and the comparison experiment with NN and Poisson regression (P-regression). Moreover, the error analysis of the prediction results is performed and discussed.

5.1. Model Experiment and Discussion

5.1.1. Prediction Experiment

(1) Contrast experiment with the Poisson regression
To test the prediction capacity of this model, a prediction experiment with the classic P-regression is conducted for comparison [44]. We also use the first 240 months for training and the last 10 months for predicting in Section 4. Figure 6 and Table 3 show the comparative results and error analysis. As evidence by higher R and smaller RMSE, the WA-DBN model has better prediction ability than P-regression.
(2) Prediction experiment with different training samples
In accordance with the experiment steps in Section 4, we use 4 sets of data with different time-series length (i.e., 200 months, 210 months, 220 months, and 230 months) to train the model respectively, then successively predict for 10 months. The prediction result is shown in Figure 7 and error analysis is shown in Table 4.
The RMSE of four groups of prediction results are all around 3.5, MRE is around 0.1, and R is around 0.6, indicating that the model has good prediction accuracy, good correlation, and high stability. More importantly, the prediction of extremums is more accurate, which is meaningful for ST prediction. However, there are also outliers of predictions, such as the large deviations in the prediction results from month 6 to 7 in Figure 7a and from month 1 to 3 in Figure 7c.

5.1.2. Fitting Experiment

We train the model with the first 240-month data and input the corresponding predictor data for return fitting, comparing the fitting result with NN [45]. The comparison result and error analysis are shown in Figure 8 and Table 5.
From Table 5, the single-point fitting accuracy with the WA-DBN probabilistic prediction model is significantly better than the deterministic NN method. When there are large fluctuations in the data, the error increases significantly for NN, but the DBN can give a probability distribution relatively close to the reality according to the transition between different states of the STII in the historical data. All states of STII are presented in the probability distribution without loss of results.
To further test the time-validity of WA-DBN model over short- and long-term prediction, we input the first month data and the first 10-month data of predictors when performing regression fitting experiments. Figure 9 (a) indicates that only the first month data is input, the results of the subsequent three months are more effective, but the other predictions have greater errors; (b) indicates that when input the first 10-month data, the results of the subsequent five months are more effective. Although the predictable time extends when the input time is increased from 1 to 10 months, the predictable time is still short. Thus, the model is not suitable for medium- and long-term prediction. The reason may be that the probabilistic inference of DBN depends on the priori probability of nodes. When only the finite priori probability is given, such as one month or ten months, the reasoning error increases as the predicted time increases.

5.1.3. Expending Experiment for NAST Intensity Index Prediction

To further verify the generalization ability of this model, we perform a prediction experiment of NAST (35° N–70° N, 90° W–0° W). The NAST intensity index is also calculated with the same definition in Section 2.1. A time-delayed correlation analysis between the AC indexes [46] and the NAST intensity index has also been made. Different from NPST, 6 most relevant indexes are chosen as predictors: AO index, North Atlantic Oscillation (NAO) index, Atlantic Decadal Oscillation (ADO) index, East Atlantic (EA) index, West Atlantic index (WAI), and North American Jet Stream (NAJ) index, respectively denoted as AO , NAO , ADO , EA , WAI and NAJ . The DBN network with above nodes is constructed as shown in Figure 10.
According to the integrated steps in Section 4, we conduct the same prediction experiment of NAST. Figure 11 displays the monthly predicted intensity index of NAST.
We calculate the evaluation indicators for prediction accuracy: the RMSE is 3.1717, the MRE is 0.1104, and the R value is 0.5568. Therefore, it is reasonable to generalize the WA-DBN model for other mid-latitude ST regions and the predicted results are reliable. This prediction model has adaptive ability owing to the flexible modeling features of DBN.

6. Conclusions

Effective short-term prediction of STII is significant for researches of mid-latitude weather systems, especially the analysis of abnormal changes. In this study, we have applied the state-of-the art artificial intelligence to predict the monthly intensity index of NPST with WA-DBN probabilistic prediction model. Considering the non-stationarity, nonlinearity, and uncertainty of the STII time-series, we first used the WA to decompose the intensity index into the sub-modes with different frequency domains. Then we applied the DBN to make a probabilistic prediction for each sub-mode. Finally, the independent prediction results of each mode were integrated with the wavelet reconstruction.
To further illustrate the advantages of the model, we conducted multiple sets of STII prediction experiments, fitting experiments, and comparison experiments. The results show that predicting correlation coefficient reached about 0.6 and fitting correlation coefficient reached 0.97. Moreover, this model is good at predicting extremums. Therefore, the WA-DBN model exhibits relatively better performance in prediction of nonlinear uncertainties, as evidence by higher R and smaller RMSE. The improved performance of the WA-DBN model is attributable to two aspects:
  • The input dataset of predictand is decomposed into separate components based on different frequencies with WA, allowing removal of noisy data and revealing the quasi-periodic components in the original time-series.
  • Both the relationship between the predictand and the predictors at the same time and that in adjacent time slices are considered with DBN model. The expression of casual relationship with network structure and probability distribution can better deal with the uncertainty of prediction.
We summarize that the WA-DBN model developed and tested in this study has good prediction skills of monthly STII, which is of great scientific guidance to study the abnormal changes of ST and its mechanisms. Above all, we propose a new intelligent prediction model based on graph theory and probability theory, which has wide application prospects with strong generalization ability and good stability.
Although the WA-DBN probabilistic predicting model works well, there are still some problems. First, the selection of the predictors of the ST intensity index needs to be further improved. The existing studies indicate that if the number of predictors exceeds 10, the predicting calculation will be complex, and the accuracy will not increase significantly with more predictors. If fewer predictors are selected such as 5, the accuracy will become poor due to loss of information. In this research, we chose 9 most relevant indicators as predictors. However, the selection of predictors is crucial to prediction, and we need to improve this work. Second, the accuracy of the long-term prediction in this model is low. These are also the focus of future work.

Supplementary Materials

The following are available online at https://www.mdpi.com/2073-4433/9/6/224/s1, Table S1: Discrete training data (Take d 1 as an example).

Author Contributions

M.L. and K.L. conceived and designed the experiments; M.L. performed the experiments; M.L. and K.L. analyzed the data; M.L. wrote the paper.

Funding

This research was funded by the Chinese National Natural Science Fund (Nos. 41375002, 51609254) and the Natural Science Fund (BK20161464) of Jiangsu Province.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

This section contains Table A1 and Table A2 supplemental to the main text.
Table A1. Transition probability of DBN (Take d 1 as an example).
Table A1. Transition probability of DBN (Take d 1 as an example).
d 1 [t + 1]State of Node d 1
d 1 [t] 123456789101112131415
State of node d 1 10.02160.09450.12610.10340.03000.05950.03330.04570.02090.09580.03330.14330.10690.05840.0273
20.04870.02650.02370.08100.02570.04960.03630.07540.06220.10890.13220.24140.00000.05660.0874
30.08420.12040.00610.05950.06740.04580.03400.04800.05320.10580.05740.15930.01590.00080.1423
40.04210.10650.07590.12510.04340.01180.04620.00960.00630.03420.04220.03540.26440.03660.1205
50.10110.04690.00060.06460.11250.01720.06940.04890.04830.03180.16560.14310.04700.04710.0559
60.04790.00600.03660.00470.07320.03110.08290.07970.04380.03170.06460.10560.15330.16850.0702
70.04510.00160.02620.01490.02980.02980.00190.08220.08740.12500.07420.14620.18620.14230.0072
80.01910.04830.00180.07520.05010.01220.09390.05150.12130.13630.04830.12390.00360.07700.1375
90.02110.04640.02240.04430.03040.06750.09850.04920.00970.01610.06390.06720.28430.17670.0024
100.01190.06050.06500.05930.00310.04740.03640.00840.03480.00950.04400.21520.20970.01480.1800
110.05810.05580.00320.02640.05730.00280.02670.03680.10840.07310.02080.03340.12950.06850.2992
120.05670.00780.01590.00210.08020.06490.02040.04090.07750.09190.01180.04240.05380.40250.0312
130.03480.01210.04730.00700.00040.05060.03560.05180.03560.08090.04730.00130.30530.16810.1219
140.05310.01960.00710.02050.05250.05590.01400.04700.09660.01540.16700.20830.06270.07900.1014
150.05440.02690.09200.02930.08750.00580.00460.00540.05010.10550.05220.10920.22520.02710.1248
Table A2. Monthly predicted probability distribution of d 1 (The maximum probability of probability distribution for each month is highlighted).
Table A2. Monthly predicted probability distribution of d 1 (The maximum probability of probability distribution for each month is highlighted).
Month12345678910
State
11.77 × 10−311.84 × 10−222.58 × 10−387.61 × 10−284.06 × 10−331.96 × 10−325.13 × 10−312.42 × 10−312.75 × 10−341.44 × 10−35
24.30 × 10−156.15 × 10−259.92 × 10−301.16 × 10−95.74 × 10−231.62 × 10−212.34 × 10−131.86 × 10−302.09 × 10−211.18 × 10−27
31.23 × 10−82.95 × 10−71.30 × 10−261.78 × 10−121.42 × 10−143.85 × 10−221.48 × 10−153.50 × 10−151.23 × 10−54.82 × 10−8
43.71 × 10−50.966075721.86 × 10−100.047111851.99 × 10−84.68 × 10−123.71 × 10−91.30 × 10−119.51 × 10−86.19 × 10−6
51.15 × 10−90.000242911.51 × 10−83.08 × 10−50.615595231.19 × 10−71.18 × 10−70.000599510.000215330.7366376
60.000171270.033681070.996708298.29 × 10−50.359149730.130902912.02 × 10−50.997374560.999071770.18456279
70.999689799.37 × 10−123.18 × 10−60.124815690.000222970.001311730.999864094.70 × 10−90.000700030.00034761
80.000101751.07 × 10−122.85 × 10−197.14 × 10−51.30 × 10−50.867785126.07 × 10−52.12 × 10−151.59 × 10−144.45 × 10−13
92.23 × 10−81.89 × 10−150.003288510.827887330.02501911.14 × 10−78.20 × 10−90.002025934.30 × 10−70.07844577
105.79 × 10−89.98 × 10−271.97 × 10−151.45 × 10−122.37 × 10−133.61 × 10−195.49 × 10−51.01 × 10−141.10 × 10−181.92 × 10−15
119.39 × 10−246.20 × 10−316.15 × 10−301.18 × 10−312.45 × 10−252.17 × 10−182.93 × 10−271.45 × 10−336.63 × 10−334.81 × 10−31
121.82 × 10−183.21 × 10−351.52 × 10−324.61 × 10−292.24 × 10−211.40 × 10−313.40 × 10−298.46 × 10−354.39 × 10−218.99 × 10−28
132.66 × 10−271.18 × 10−301.63 × 10−374.44 × 10−238.72 × 10−311.06 × 10−315.38 × 10−301.75 × 10−332.64 × 10−249.63 × 10−31
141.77 × 10−312.35 × 10−352.58 × 10−381.50 × 10−321.43 × 10−358.70 × 10−351.17 × 10−317.75 × 10−352.75 × 10−345.76 × 10−36
151.75 × 10−262.35 × 10−352.29 × 10−291.50 × 10−271.43 × 10−308.70 × 10−351.17 × 10−217.87 × 10−305.63 × 10−295.76 × 10−31

References

  1. Blackmon, M.L. A Climatological Spectral Study of the 500 mb Geopotential Height of the Northern Hemisphere. J. Atmos. Sci. 1976, 33, 1607–1623. [Google Scholar] [CrossRef] [Green Version]
  2. Zhu, W.J.; Li, Y. Characteristics of the interdecadal variability of the North Pacific storm track and its possible influencing mechanism. J. Meteorol. 2010, 68, 477–486. [Google Scholar]
  3. Lau, N.C. Variability of the observed midlatitude storm tracks in relation to low-frequency changes in the circulation pattern. J. Atmos. Sci. 1988, 45, 2718–2743. [Google Scholar] [CrossRef]
  4. Straus, D.M.; Shukla, J. Variations of midlatitude transient dynamics associated with ENSO. J. Atmos. Sci. 1997, 54, 777–790. [Google Scholar] [CrossRef]
  5. Zhu, W.J.; Sun, Z.B. Interannual variation of the North Pacific storm track in winter and its relationship with 500hPa height and SST in the Tropical and North Pacific Oceans. Acta Meteorol. Sin. 2000, 58, 309–320. [Google Scholar]
  6. Ren, X.J.; Yang, X.Q.; Han, B. Variation characteristics of the North Pacific storm track and its coupling with mid-latitude ocean-atmosphere. Chin. J. Geophys. 2007, 50, 92–100. [Google Scholar] [CrossRef]
  7. Liu, M.Y.; Zhu, W.J.; Gao, J. Effect of Northern Hemisphere polar vortex intensity on North Pacific storm track. Chin. J. Atmos. Sci. 2013, 36, 297–308. [Google Scholar]
  8. Sun, Z.B.; Zhu, W.J. A modelling study of Northwest Pacific SSTA effect on Pacific storm track during winter. J. Meteorol. Res. 2000, 14, 416–425. [Google Scholar]
  9. Zhu, W.J.; Yuan, K.; Chen, Y.N. The temporal and spatial evolution of the storm track in the eastern North Pacific Ocean. Chin. J. Atmos. Sci. 2013, 37, 65–80. [Google Scholar]
  10. Ding, Y.F.; Ren, X.J.; Han, B. A Preliminary study on the climate characteristics and changes of the North Pacific storm track. Sci. Meteorol. Sin. 2006, 26, 237–243. [Google Scholar]
  11. Li, Y.; Zhu, W.J.; Wei, J.S. Assessment and improvement of the North Pacific storm track index in winter. Chin. J. Atmos. Sci. 2010, 34, 1001–1010. [Google Scholar]
  12. Hong, M.; Zhang, R.; Wu, G.X. Nonlinear dynamic model for reconstruction of subtropical high-pressure characteristic index using genetic algorithm. Chin. J. Atmos. Sci. 2007, 31, 164–170. [Google Scholar]
  13. Liu, K.F.; Zhang, R.; Hong, M. Prediction model of subtropical high based on least square support vector machines. J. Appl. Meteorol. 2009, 20, 354–359. [Google Scholar]
  14. Zhu, H.R.; Jiang, Z.H.; Zhang, Q. MJO index prediction model experiment Based on SSA-AR model. J. Trop. Meteorol. 2010, 26, 371–378. [Google Scholar]
  15. Jia, Y.J.; Hu, Y.J.; Zhong, Z. Statistical forecasting model of summer subtropical high in the Western Pacific. Plateau Meteorol. 2015, 34, 1369–1378. [Google Scholar]
  16. Yang, X.F. Research on Biomedical Data Processing Method Based on Machine Learning. Master’s Thesis, University of Chinese Academy of Sciences, Huairou, China, 2014. [Google Scholar]
  17. Li, F.; Han, Z.H.; Feng, E.Y. Analysis of financial data based on machine learning. Sci. Wealth 2016, 6, 65–72. [Google Scholar]
  18. Qin, Y.B. Design of medical learning medical diagnosis and treatment system based on the core thinking of traditional Chinese medicine. Chin. J. Tradit. Chin. Med. 2015, 52, 2188–2191. [Google Scholar]
  19. Yang, R.; Tang, J.; Sun, D. Association rule data mining applications for Atlantic tropical cyclone intensity changes. Weather Forecast. 2010, 26, 337–353. [Google Scholar] [CrossRef]
  20. Royston, S.; Lawry, J.; Horsburgh, K. A linguistic decision tree approach to predicting storm surge. Fuzzy Sets Syst. 2013, 215, 90–111. [Google Scholar] [CrossRef]
  21. Reikard, G. Combining frequency and time domain models to forecast space weather. Adv. Space Res. 2013, 52, 622–632. [Google Scholar] [CrossRef]
  22. Teng, W.P.; Hu, B.; Teng, Z. Application of SVM regression in Western Pacific tropical cyclone route forecasting. Sci. Bull. 2012, 28, 49–53. [Google Scholar]
  23. Yu, J.; Song, Z.; Kusiak, A. Very short-term wind speed forecasting with Bayesian structural break model. Renew. Energy 2013, 50, 637–647. [Google Scholar]
  24. Voyant, C.; Darras, C.; Muselli, M. Bayesian rules and stochastic models for high accuracy prediction of solar radiation. Appl. Energy 2014, 114, 218–226. [Google Scholar] [CrossRef] [Green Version]
  25. Li, Y.; Zhu, W.J. Performance comparison of different digital filtering methods in the study of storm track. Chin. J. Atmos. Sci. 2009, 32, 565–573. [Google Scholar]
  26. Zhou, Z.H. Machine Learning; Tsinghua University Press: Beijing, China, 2016. [Google Scholar]
  27. Cussens, J. Bayesian network learning with cutting planes. arXiv, 2012; arXiv:1202.3713. [Google Scholar]
  28. Mallat, S. A Wavelet Tour of Signal Processing; China Machine Press: Beijing, China, 2010. [Google Scholar]
  29. Wang, N.; Lu, C. Two-dimensional continuous wavelet analysis and its application to meteorological data. J. Atmos. Ocean. Technol. 2010, 27, 652–666. [Google Scholar] [CrossRef]
  30. Jin, F.R.; Wang, W.R. Analysis and simulation of meteorological wind fields based on wavelet transform. Appl. Mech. Mater. 2014, 490–491, 1228–1236. [Google Scholar] [CrossRef]
  31. Limpasuvan, V.; Jeev, K.; Hartmann, D.L. Anomalous vortex intensification and associated stratosphere-troposphere evolution. In AGU Fall Meeting Abstracts; American Geophysical Union: Washington, DC, USA, 2004. [Google Scholar]
  32. Gao, Q. The Spatio-Temporal Evolution of the North Pacific Storm Track in Winter and Its Relationship with AO. Master’s Thesis, Nanjing University of Information Science and Technology, Nanjing, China, 2006. [Google Scholar]
  33. Gu, P.X. Relationship between the North Pacific Storm Track and East Asian Winter Monsoon. Master’s Thesis, Nanjing University of Information Science & Technology, Nanjing, China, 2013. [Google Scholar]
  34. Athanasiadis, P.; Wallace, J.M.; Wettstein, J.J. Patterns of jet stream wintertime variability and their relation to the storm tracks. J. Atmos. Sci. 2009, 67, 1361–1381. [Google Scholar] [CrossRef]
  35. Chang, E.K. Interdecadal variations in Northern Hemisphere winter storm track intensity. J. Clim. 2002, 15, 642–658. [Google Scholar] [CrossRef]
  36. Tan, B.; Wen, C. Progress in the study of the dynamics of extratropical atmospheric teleconnection patterns and their impacts on East Asian climate. J. Meteorol. Res. 2014, 28, 780–802. [Google Scholar] [CrossRef]
  37. Mächel, H.; Kapala, A.; Flohn, H. Behaviour of the centres of action above the Atlantic since 1881. Part I: Characteristics of seasonal and interannual variability. Int. J. Climatol. 2015, 18, 1–22. [Google Scholar] [CrossRef]
  38. Wettstein, J.J.; Wallace, J.M. Observed patterns of month-to-month storm-track variability and their relationship to the background flow. J. Atmos. Sci. 2010, 67, 1420–1437. [Google Scholar] [CrossRef]
  39. Yang, D.X. A decadal abruption of midwinter storm tracks over North Pacific from 1951 to 2010. Atmos. Ocean. Sci. Lett. 2016, 9, 235–245. [Google Scholar] [CrossRef]
  40. Hong, W.U.; Wang, W.P.; Feng, Y. Discretization method of continuous variables in Bayesian network parameter learning. Syst. Eng. Electron. 2012, 34, 2157–2162. [Google Scholar]
  41. Liao, W.; Zhang, W.; Ji, Q. A factor tree inference algorithm for Bayesian networks and its applications. In Proceedings of the 16th IEEE International Conference on Tools with Artificial Intelligence, Boca Raton, FL, USA, 15–17 November 2004; pp. 652–656. [Google Scholar]
  42. FullBNT-1.0.4. Available online: https://download.csdn.net/download/b08514/6942975 (accessed on 3 June 2018).
  43. Huang, W.Q.; Dai, Y.X.; Quan, H.M. Harmonic analysis algorithm based on Daubechies wavelet. Chin. J. Electr. Eng. 2006, 21, 45–46. [Google Scholar]
  44. Bai, C.Z.; Zhang, R.; Bao, S.L. Forecasting the tropical cyclone genesis over the Northwest Pacific through identifying the casual factors in the cyclone-climate interactions. J. Atmos. Ocean. Technol. 2018, 35, 247–258. [Google Scholar] [CrossRef]
  45. Deo, R.C.; Şahin, M. Application of the artificial neural network model for prediction of monthly standardized precipitation and evapotranspiration index using hydrometeorological parameters and climate indices in eastern Australia. Atmos. Res. 2015, 161–162, 65–81. [Google Scholar] [CrossRef]
  46. Zhou, X.Y.; Zhu, W.J.; Gu, C. The possible impact of winter north Atlantic storm track anomaly on cold wave activity of China. Atmos. Sci. 2015, 39, 978–990. [Google Scholar]
Figure 1. Technical structure of WA-DBN probabilistic prediction model.
Figure 1. Technical structure of WA-DBN probabilistic prediction model.
Atmosphere 09 00224 g001
Figure 2. DBN structure between two adjacent time slices of STII prediction.
Figure 2. DBN structure between two adjacent time slices of STII prediction.
Atmosphere 09 00224 g002
Figure 3. Modes of wavelet decomposition for STII time-series (First 240 months).
Figure 3. Modes of wavelet decomposition for STII time-series (First 240 months).
Atmosphere 09 00224 g003aAtmosphere 09 00224 g003b
Figure 4. DBN structure of STII prediction under MATLAB.
Figure 4. DBN structure of STII prediction under MATLAB.
Atmosphere 09 00224 g004
Figure 5. Monthly prediction of STII in the test period.
Figure 5. Monthly prediction of STII in the test period.
Atmosphere 09 00224 g005
Figure 6. Comparative results of STII prediction between WA-DBN and P-regression.
Figure 6. Comparative results of STII prediction between WA-DBN and P-regression.
Atmosphere 09 00224 g006
Figure 7. STII Prediction with WA-DBN model learned by different training data.
Figure 7. STII Prediction with WA-DBN model learned by different training data.
Atmosphere 09 00224 g007
Figure 8. Comparative fitting results between WA-DBN and NN.
Figure 8. Comparative fitting results between WA-DBN and NN.
Atmosphere 09 00224 g008aAtmosphere 09 00224 g008b
Figure 9. Test experiment of predictable time with different inputting data. (The effective predictions are highlighted with dotted line).
Figure 9. Test experiment of predictable time with different inputting data. (The effective predictions are highlighted with dotted line).
Atmosphere 09 00224 g009aAtmosphere 09 00224 g009b
Figure 10. DBN structure between two adjacent time slices of NAST prediction.
Figure 10. DBN structure between two adjacent time slices of NAST prediction.
Atmosphere 09 00224 g010
Figure 11. Monthly Prediction of NAST intensity index in the test period.
Figure 11. Monthly Prediction of NAST intensity index in the test period.
Atmosphere 09 00224 g011
Table 1. Data sources of 9 predictors in STII prediction.
Table 1. Data sources of 9 predictors in STII prediction.
PredictorData Source
AO ,   PNA ,   WP NOAA Climate Prediction Center
AL ,   SH Calculation with sea level pressure data from NCEP/NCAR
NINO Hadley Center
KI Calculation with SST data from Hadley Center
PVI ,   PVA 74 circulation characteristics from the National Climate Center
Table 2. Discretization standard for predictors and modes of STII.
Table 2. Discretization standard for predictors and modes of STII.
PredictorInterval StepState NumberSub-ModeInterval StepState Number
AL 11–23 d 1 11–15
AO 0.11–78 d 2 11–14
CVI 101–16 d 3 11–8
CVS 101–29 d 4 11–6
KU 0.11–63 d 5 0.11–32
NINO 0.11–48 d 6 0.11–20
PNA 0.11–46 d 7 0.11–14
SH 11–24 a 7 0.11–23
WP 0.11–59---
Table 3. Error analysis of WA-DBN and P-regression.
Table 3. Error analysis of WA-DBN and P-regression.
IndicatorRMSEMRER
Model
WA-DBN2.89540.07940.6579
P-regression6.17030.17780.1981
Table 4. Error analysis of WA-DBN prediction model with different training data.
Table 4. Error analysis of WA-DBN prediction model with different training data.
Training Data200 Months210 Months220 Months230 MonthsMean
Indicator
RMSE3.69563.85483.97342.79213.5789
MRE0.08180.11190.11520.08810.0993
R0.63410.68060.52450.53460.5935
Table 5. Error analysis of WA-DBN and NN.
Table 5. Error analysis of WA-DBN and NN.
IndicatorRMSEMRER
Model
WA-DBN3.73110.23150.9771
NN18.74542.18490.2237

Share and Cite

MDPI and ACS Style

Li, M.; Liu, K. Application of Intelligent Dynamic Bayesian Network with Wavelet Analysis for Probabilistic Prediction of Storm Track Intensity Index. Atmosphere 2018, 9, 224. https://doi.org/10.3390/atmos9060224

AMA Style

Li M, Liu K. Application of Intelligent Dynamic Bayesian Network with Wavelet Analysis for Probabilistic Prediction of Storm Track Intensity Index. Atmosphere. 2018; 9(6):224. https://doi.org/10.3390/atmos9060224

Chicago/Turabian Style

Li, Ming, and Kefeng Liu. 2018. "Application of Intelligent Dynamic Bayesian Network with Wavelet Analysis for Probabilistic Prediction of Storm Track Intensity Index" Atmosphere 9, no. 6: 224. https://doi.org/10.3390/atmos9060224

APA Style

Li, M., & Liu, K. (2018). Application of Intelligent Dynamic Bayesian Network with Wavelet Analysis for Probabilistic Prediction of Storm Track Intensity Index. Atmosphere, 9(6), 224. https://doi.org/10.3390/atmos9060224

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop