Next Article in Journal
Influence Factors on Carbon Monoxide Accumulation in Biomass Pellet Storage
Previous Article in Journal
Simulation-Based Comparison Between the Thermal Behavior of Coaxial and Double U-Tube Borehole Heat Exchangers
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Short-Term Wind Speed Prediction Based on Variational Mode Decomposition and Linear–Nonlinear Combination Optimization Model

Department of Economics and Management, North China Electric Power University, 689 Huadian Road, Baoding 071000, China
*
Author to whom correspondence should be addressed.
Energies 2019, 12(12), 2322; https://doi.org/10.3390/en12122322
Submission received: 8 May 2019 / Revised: 13 June 2019 / Accepted: 13 June 2019 / Published: 17 June 2019

Abstract

:
Wind power, one of renewable energy resources, is a fluctuating source of energy that prevents its further participation in the power market. To improve the stability of the wind power injected into the power grid, a short-term wind speed predicting model is proposed in this work, named VMD-P-(ARIMA, BP)-PSOLSSVM. In this model, variational mode decomposition (VMD) is combined with phase space reconstruction (P) as data processing method to determine intrinsic mode function (IMF) and its input–output matrix in the prediction model. Then, the linear model autoregressive integrated moving average model (ARIMA) and typical nonlinear model back propagation neural network (BP) are adopted to forecast each IMF separately and get the prediction of short-term wind speed by adding up the IMFs. In the final stage, particle swarm optimization least squares support vector machine (PSOLSSVM) uses the prediction results of the two separate models from previous step for the secondary prediction. For the proposed method, the PSOLSSVM employs different mathematical principles from ARIMA and BP separately, which overcome the shortcoming of using just single models. The proposed combined optimization model has been applied to two datasets with large fluctuations from a northern China wind farm to evaluate the performance. A performance comparison is conducted by comparing the error from the proposed method to six other models using single prediction techniques. The comparison result indicates the proposed combined optimization model can deliver more accurate and robust prediction than the other models; meanwhile, it means the power grid dispatching work can benefit from implementing the proposed predicting model in the system.

1. Introduction

With the continuous reduction of traditional fossil energy and the salient environmental pollution problem, the global energy crisis is becoming more and more serious. From the dual demand of human society for energy and environmental protection, renewable energy is bound to become the direction of future energy due to its advantages of being clean, pollution-free, and recyclable. As a sort of renewable energy, wind energy has the advantages of wide source and convenient development, but it also exhibits strong volatility, intermittent, and non-control characteristics, which pose great challenges to the safety and stability of grid system. Accurate and reliable short-term wind speed prediction not only minimizes the economic losses caused by wind power grid connection, but also reduces the risk of grid dispatch and grid transmission [1].
Considering the development of the wind speed prediction method, the principle gradually changes from the physical method to the statistical, and the prediction method is developed from linear prediction to nonlinear. In recent years, the intelligent algorithm has been adopted and optimized gradually. Wanting to improve the accuracy of prediction and make up for the shortcomings of separate methods, more and more scholars have explored combined prediction methods. In summary, the wind speed prediction methods can be roughly divided into five categories: (a) Physical methods, (b) spatial correlation, (c) conventional statistical methods, (d) artificial intelligence algorithms, (e) combined methods.
The input indexes of the physical methods are geographical information of the wind farm such as meteorological message, topographical features, surface roughness, obstacles, etc. [2], then analyzing and calculating the input comprehensively can obtain the wind speed and direction of the fan hub height [3]. Physical methods regard NWP (numerical weather prediction system) as the chief technology, which has excellent performance in medium- and long-term wind speed prediction [4], but NWP has some disadvantages including complex calculation, time-consuming, and high accuracy requirements for basic physical quantities [5]. The position of the spatial correlation methods in the wind speed prediction field has been raised to the same height as physical methods and statistical methods since 2014 [6]. Spatial correlation believes that the wind speed of a certain place has a high correlation with the wind speed of neighborhood spaces, making it possible to use the weather and other information of the surrounding areas to improve the local wind speed prediction effect [7]. The key in spatial correlation prediction is establishing mapping relationship through the regression analysis method, so the optimizations of the method mean all of it.
The statistical models predict future wind speed by analyzing historical statistics [8]. Conventional statistical methods include AR (autoregressive) model [9], ARMA (autoregressive moving average) model [10], ARIMA (autoregressive integral moving average) model [11], and SARIMA (seasonal autoregressive integral moving average) model [12]. The most notable method is the ARIMA method proposed by Box-Jenkins [13], which has the advantages of a simple principle and high precision. Because ARIMA can effectively extract linear features of data [14] and improve the adaptability of time-series models [15], it performed well in wind speed prediction. Torres et al. [16] compared the ARIMA with the persistence model and found that the ARIMA always performed better in the prediction. The deformation of the ARIMA model has also been widely used already. Liu et al. [17] used ARIMA to determine the parameters of the KF (Kalman Filter) to optimize the model and improve the performance. Based on the ARIMA model, Erdem et al. [18] presented four prediction methods: Component ARMA, link AMRA, VAR (vector autoregressive), and restricted VAR, and applied them to forecast wind speed and direction of two wind farms in North Dakota, USA.
Yuan et al. [19] confirmed that wind speed has obvious chaotic fractal characteristics by using chaos theory, which means wind speed is nonlinear to some extent. Therefore, using the model with a strong ability to extract the nonlinear information can predict the wind speed accurately; meanwhile, the machine model is generally considered to display complex nonlinear relationships well because of its strong robustness and fault tolerance to noise. According to these, a lot of studies have verified that machine models have good pertinence and adaptability to wind speed prediction. In order to interconnect the chaos theory and machine model, Sun et al. [20] performed phase space reconstruction on the decomposed wind speed to determine the input and output matrix of BP. Nowadays, artificial intelligence techniques for predicting wind speed are divided into two categories according to different principles: ANN (artificial neural networks) and SVM (support vector machines). ANN mainly covers BP [21], ELM (extreme learning machines) [22], RBF (radial basis function neural networks) [23], RNN (recurrent neural networks) [24], and so on. As the main representative of ANN, BP has strong nonlinear mapping ability and is used in wind speed prediction widespread research. Qu et al. [25] optimized BP with FPA (flower-pollination algorithm) to predict the wind speed components and obtain excellent results. Yang et al. [26] combined Broyden family with wind driven optimization to determine initial weights and thresholds of BP, and the result proved that optimization increase the prediction precision and reliability effectively. The core of SVM is kernel function which avoids selecting the structure of neural network and handles local minimum points of BP. Kernel function and penalty factor are two important parameters of SVM, so many optimization algorithms are combined with the SVN to select the best parameters, such as cuckoo search algorithm [27] and improved chicken algorithm [28]. The PSO (particle swarm optimization) combined with LSSVM (least squares support vector machine) was proved have advantages of short training time and high precision according to the research of Zhang et al. [29].
Intending to extract effective information from wind speed series, the original signal is usually decomposed into stable sequences in the widespread wind speed prediction researche [30]. Existing decomposition techniques mainly contains WD (wavelet decomposition) and EMD (empirical mode decomposition). Liu et al. [31] proposed three hybrid models based on WD for wind speed prediction, which regard wavelet and wavelet packet as decomposition algorithms. Hu et al. [32] applied the data processed by WD to LSSVM for single-step and multi-step wind speed prediction. Additionally, Liu H et al. [33] used FEEMD (fast ensemble empirical mode decomposition) to process wind speed and established the FEEMD-MEA-MLP model to demonstrate its excellent effect. Wang et al. [22] put forward a hybrid model that amalgamates EMD with Elman neural network for wind speed prediction and confirmed that the proposed method has the smallest MAE (mean absolute error), RMSE (root mean square error), and MAPE (mean absolute proportional error) among the compared models. However, WD has to set the mother wavelet function artificially, while EMD exists as some intractable problems such as lacking mathematical theory, interpolation selection, and modal aliasing phenomenon [34]. In contrast, the VMD method proposed by Konstantin Dragomiretskiy [35] in 2014 not only overcomes the mode mixing, but also decomposes components of different frequencies adaptively. Both Ali Akbar Abdoos [36] and Ali M [37] have proved the outstanding performance of VMD in the wind speed data processing.
Correlation study of Bates et al. [38] evidenced the combined prediction is capable of breaking the limitations of separate prediction models, absorbing the advantages of two or more methods, and reducing the difficulty of model selection, thus, the results of combined prediction tend to be more accurate. According to the combination mode of separate models, it is usually to divide the combined model into series and parallel methods. The series method is making the second prediction of the first results or error correction of first residual by regarding the result or residual as the input of another model, such as [39] and [40]. Similarly, the parallel method uses several models to predict original data separately and then weight the results of the separate prediction models by other methods to form the combination prediction results such as [41] and [42]. Furthermore, more studies combine different signal decomposition techniques into predictions and various optimization algorithms. For example, Liu et al. [43] employed WPD (wavelet packet decomposition) and EMD to decompose the wind speed in turn to make the sequences more stable and then use ELM to make the prediction. Jiang et al. [44] combined BA (bat algorithm), FA (firefly algorithm), and CS (cuckoo search) to optimize the weight coefficients of the three neural networks in order to obtain higher prediction accuracy.
On account of the superiority of the parallel combination and the features of the wind speed being linear accompanied with chaotic, this study put forward a new combined prediction optimization model named VMD-P-(ARIMA, BP)-PSOLSSVM to forecast the wind speed in the short term. The novel model combines the emerging signal decomposition technology, chaos theory, with linear and nonlinear prediction technology to make contributions as follow: (a) Intending to collect the usable information from the original wind speed, a signal processing method based on VMD and phase space reconstruction is invented for the first time. Firstly, the raw data is decomposed into several stable sequences by using VMD, which has been newly proposed in recent years. Then, phase space reconstruction method based on the chaos principle is used to determine the input and output matrix of the prediction model to upgrade the prediction ability. (b) In order to express the strength of the separate models, the research adopts a parallel way to combine the typical linear prediction model and ANN model. Specifically, the processed components and residuals are predicted by ARIMA and BP, respectively, to obtain the predicted values by summing the IMFs. (c) In this study, two results predicted by ARIMA and BP in parallel are used as the input of the LSSVM optimized by PSO for the secondary prediction to obtain the final combined result. PSOLSSVM is a completely different model from the ARIMA and BP from the principle aspect and using this model to make secondary prediction can overcome the limitations of separate models. (d) The excellent performance of the new combined model is evaluated by comparing the prediction results to six other models. Moreover, another set of data was collected to repeat the same experiment and the result confirmed the versatility and application of the proposed model.
The schedule of the paper is showed as follow: Section 2 presents the rationales of VMD, phase space reconstruction, ARIMA, BP, and PSOLSSVM; the construction process of the combination model is given in Section 3; Section 4 uses the proposed model to predict the wind speed in the short term; Section 5 analyzes and discusses the results of Section 4; Section 6 demonstrates the repeatability of the experiment with different cases; Section 7 draws conclusions from two experiments.

2. Materials and Methods

2.1. Variational Mode Decomposition

As a novel non-recursive decomposition method based on the variational problem, VMD decompose nonlinear or non-stationary signals excellently. Compared with WD and EMD, VMD can not only determine the relevant band adaptively, but also avoid the modal aliasing phenomenon, which, because of VMD, has complete and rigorous mathematical theory system and balances the error between modes properly [45]. The existence of the variational problem is getting the bandwidth of each mode and specific construction process is expressed as: (a) Hilbert transform calculates the correlation analysis signal to obtain the unilateral spectrum. (b) Unilateral spectrum should be exponential, tuned to the corresponding estimated center frequency, and moved to the “baseband”. (c) Estimate the bandwidth by demodulating the Gaussian smoothness of the signal. The constrained variational problem established as follows:
m i n { u k } , { ω k } { k t [ ( δ ( t ) + j π t ) u k ( t ) ] e j ω k t 2 2 } s . t . k u k = f
where { u k } : = { u 1 , . u k } and { ω k } : = { ω 1 , . ω k } implicate the shorthand for the sets and center frequencies of modes respectively, k denotes the total number of modes, f implicates the original signal, and is the convolution operator. At the same time, k : = k = 1 K denotes the sum of all modes.
Using the second penalty term and augmented lagrangian can unrestrain the above problem and express it as:
( { u k } , { ω k } , λ ) : = α k t [ ( δ ( t ) + j π t ) u k ( t ) ] e j ω k t 2 2 + f ( t ) k u k ( t ) 2 2 + λ ( t ) , f ( t ) k u k ( t )
where α is the equilibrium parameter of the required data fidelity constraint.
Solving the variational problem is in need of ADMM (alternate direction method of multipliers), which is capable of finding the saddle point in Equation (2) to minimize Equation (1). The key points of ADMM is iteratively update the u k and ω k , and the process of u k can be expressed as:
u ^ k n + 1 ( ω ) = f ^ ( ω ) i k u ^ k ( ω ) + λ ^ ( ω ) 2 1 + 2 α ( ω ω k ) 2
where n implicates the iteration times, u ^ k n + 1 , f ^ ( ω ) , u ^ k ( ω ) , λ ^ ( ω ) are the Fourier transform of u k n + 1 , f ( ω ) , u k ( ω ) , λ ( ω ) , respectively. Similarly, the update of the center frequency ω k is expressed as:
ω k n + 1 = 0 ω | u ^ k ( ω ) | 2 d w 0 | u ^ k ( ω ) | 2 d w   .
The specific calculation steps of VMD can be referred to in [46].

2.2. Phase Space Reconstruction

Chaotic time series is an analysis method that applies chaos theory to nonlinear time series [47], and phase space reconstruction is a crucial procedure of it to analyze and process. The foundation of applying the phase space reconstruction to wind speed prediction is the embedded theorem proposed by Takens. The theorem indicates it is possible to reconstruct a one-dimensional chaotic time series into multi-dimensional time series, and according to this the input and output matrix of prediction model could be determined. Reconstruction of one-dimensional time series x = { x i , i = 1 , 2 , 3 , N } based on embedded theorem can obtain the multi- dimensional input vector like Equation (5) as follows:
X = { X i | X i = [ x i , x i + τ , , x i + ( m 1 ) τ ] T } ,     i = 1 , 2 , N  
where τ denotes time delay, m implicates embedding dimension, X i is the phase point in the m-dimensional phase space, and the corresponding output vector is { x i + 1 + ( m 1 ) τ } . It can be seen that m and τ have a great influence on the reconstruction quality and as soon as they are determined, a phase space can be reconstructed [48]. Nowadays, there are two viewpoints of determining m and τ , one thinks that two parameters are completely independent and can be selected separately. The other point believes they are associated and must be defined simultaneously. In this paper, the two important parameters of the reconstructed phase space are jointly calculated according to the C-C method, and the values are determined at the same time.
C-C method is a statistical one based on associated integrals [49]; it needs to divide the time series x ( i ) , i = 1 , 2 , , N into t disjoint time subsequences { x ( t ) , x ( t + t ) , x ( 2 t + t ) , } , t = 1 , 2 , , t , of which length is I = [ N / t ] ( [ · ] means rounding and N is the total length of the time series). Then, calculate the statistic S ( m , N , r , τ ) of each subsequence separately.
S ( m , N , r , τ ) = 1 t l = 1 I { C I ( m , N / t , r , τ ) [ C I ( 1 , N / t , r , τ ) ] m }
where C I is the associated integral of the Ith subsequence, which indicates the probability that the distance between two points in the phase space is less than the radius of the domain. The defined is as follows:
C ( m , N , r , τ ) = 2 M ( M 1 ) 1 i < j M θ ( r X i X j )
where r is the radius of the domain, M = N ( m 1 ) τ denotes the number of phase points in the phase space, and θ ( · ) represents the Heaviside unit function (defined as θ ( x ) = 0 , i f   x < 0 ; θ ( x ) = 1 ,     i f   x 0 ). If N , Equation (6) can be expressed as Equation (8):
S ( m , r , τ ) = 1 t l = 1 I { C I ( m , r , τ ) [ C I ( 1 , r , τ ) ] m }
In the light of the BDS statistical theory, if the time series are i.i.d., S ( m , r , τ ) can reflect the autocorrelation property of it. Thus, the values of three indicators showed below can be calculated.
S ¯ ( t ) = 1 16 m = 2 5 j = 1 4 S ( m , r j , t )
Δ S ¯ ( t ) = 1 4 m = 2 5 Δ S ( m , t )
S c o r ( t ) = Δ S ¯ ( t ) + | S ¯ ( t ) |
The existing research on C-C considers that the first zero point of S ¯ ( t ) or the first local minimum point of Δ S ¯ ( t ) is the optimal delay time τ , and the global minimum point of S c o r ( t ) is the embedded window width τ w . Employing the optimal delay time τ and embedded window width τ w can figure embedding dimension m by Equation (12).
τ w = ( m 1 ) · τ

2.3. Autoregressive Integrated Moving Average Model

ARIMA is developed from the statistical model ARMA. Regarding the time series as a random sequence and expressing it as an approximate mathematical is the main content of the ARIMA, and it is available to employ the established ARIMA model to predict the future. ARIMA is displayed as ARIMA (p, d, q) generally, where d represents the number of differences for non-stationary sequences, p denotes the autoregressive order, and q is the moving average order. The mathematical expression of ARIMA is as follows:
{ ϕ ( B ) d x t = θ ( B ) ε t E ( ε t ) = 0 , V a r ( ε t ) = σ ε 2 , E ( ε t ε s ) = 0 .   s t E ( x s ε t ) = 0 , s < t
where ε t and x t represent the actual observations and white noise at time t, respectively. B is a lag operator,   B x t = x t 1 , d = ( 1 B ) d , and ϕ ( B ) = 1 ϕ 1 B ϕ 2 B 2 ϕ p B p denote the autoregressive coefficient polynomial. θ ( B ) = 1 θ 1 B θ 2 B 2 θ q B q is a moving average coefficient polynomial.
There are four main steps of modeling using ARIMA: (a) Verifying the stability of the data; (b) determining the number of differences d to smooth the data if necessary; (c) using the differential data to determine q and p according to the trailing or truncation of ACF (autocorrelation function) and PACF (partial autocorrelation function), respectively; and (d) exploiting the model with definitive parameters to predict short-term wind speed.

2.4. Back Propagation Neural Network

BP is a classic ANN model with multi-layer feed-forward topology, so it has a wide application in time series prediction [50,51]. The difference between BP and other ANNs is the forward propagation of information and the back propagation of error. Due to the structure of BP as an input layer, an output layer, and one or more hidden layers, it has many interacting neurons to connect all layers. For example, the activation function of the j neuron is l j , j as the associated neuron is the output signal o j , if using ω j j to represent the weight between the two neurons, the activation process of j can be showed as Equation (14).
o j = l j ( j ω j j o j )
Because the method adopted in the error back propagation program of BP is gradient descent, it can continuously correct the weight and threshold of the neural network. It has been proved that the unique structure of BP enhances the applicability and makes it good at distributing storage and fault tolerance. On account of the fact that BP has capacity for expressing complex nonlinear relationships, it performs well in the field of wind speed prediction.

2.5. Particle Swarm Optimization Least Squares Support Vector Machine

In essence, SVM is a classifier and apply it to regression problem is mapping the initial input to the high-dimensional feature space through the nonlinear function, and then performs linear regression on the high feature space. Kernel function is the core content of SVM when solving nonlinear problems and the center of each training samples. If the objective function is minimizing the structural risk, it is essential to choose a subset from all kernel functions during the training process. LSSVM [52] introduces the least squares linear theory into SVM and replaces the vector machine with traditional quadratic programming to solve the problem of function estimation. Caused by above, the inequality constraint of SVM becomes an equality constraint, meanwhile linear regression function and objective function of LSSVM change into Equations (15) and (16).
y ( x ) = ω T ϕ ( x ) + b
m i n ω , b , e ( ω , e ) = 1 2 ω T ω + 1 2 γ i = 1 N e i 2
where ϕ ( · ) denotes nonlinear transformation mapping function; ω , b , e i represent weight vector, offset, and error amount, respectively; γ as the regularization parameter must satisfy the requirement of greater than zero. Then, the constraints of the above objective function become Equation (17).
y i = ω T ϕ ( x i ) + b + e i , i = 1 , 2 , , N
As the major parameters affecting the learning and generalization ability of LSSVM, kernel function σ and regularization parameter γ can improve the prediction effect of the model if they get optimal combination. PSO (particle swarm optimization) is an optimization algorithm proposed by American scholar Kennedy [53] based on group bird foraging in 1995. Applying global search strategy of PSO to optimize the parameters is a mature method. In order to combine PSO with LSSVM, it is scientific to regard σ and γ of LSSVM as two particles of PSO. Each particle continuously adjusts its state according to the current position, the empirical position, and the neighbor’s empirical position until the optimal combination is found. By substituting the optimal parameters obtained from PSO into the LSSVM, the corresponding time series can be analyzed and predicted. PSOLSSVM not only simplifies the algorithm, but also resolves most of the global optimal problems. Employing the optimized method to predict wind speed can solve the high-dimensional problem while simplifying the process of LSSVM parameters selection. The specific optimization process is shown in Figure 1.

3. Framework of the Combined Model

VMD is capable of defining the relevant bands adaptively and balancing the errors between the modes. The solid mathematical foundation that this non-recursive decomposition owns means it could display the local features of the signal effectively. Phase space reconstruction uses delay time to reconstruct the raw time series for maintaining the geometry and dynamic characteristics like the original system. ARIMA is a simple and convenient model that only requires endogenous variables could predict wind speed, but it could not capture nonlinear relationships very well. BP has strong distribution and storage ability to approximate complex nonlinear relationship substantially. However, plenty of parameters need to be fixed to ensure the accuracy of BP, so that the initial values will affect the credibility and acceptability of the results greatly. SVM could avoid the local minimum point and the structure selection of neural network; besides, two vital parameters can be optimized by PSO. Nonetheless, PSOLSSVM also has problems such as unclear directionality and low target during particle searching. According to the merits and demerits summed above, combining all models can give full play to the advantages of each model, and the place where a single model is defective will be compensated by other models. The main steps of the proposed combination model are listed below, and the flowchart is shown in Figure 2. The green part indicates the data processing process, blue indicates linear–nonlinear single prediction models, and orange represents the combination prediction model of PSOLSSVM.
According to all the analysis above, the combination model VMD-P-(ARIMA, BP)-PSOLSSVM is proposed. Research in this paper is based on three hypotheses: (a) Hypothesis 1—VMD and phase space reconstruction can achieve excellent effects, more so than any other data processing methods. (b) Hypothesis 2—regarding the prediction results of the linear–nonlinear single models as the input of the nonlinear combination prediction can effectively improve the accuracy and reliability of the prediction. (c) Hypothesis 3—the PSOLSSVM method for secondary prediction can make up for the shortcomings of the individual prediction models, and this nonlinear prediction is much more accurate than the linear weighted combination.
Firstly, VMD is applied to decompose the original wind speed and obtain more stable components. The number of modes k is mainly determined by the difference between the center frequencies of IMF (k) and IMF (k − 1). When the difference tends to stabilize, the value of k can be determined to obtain k patterns and a residual term, and the next step is to reconstruct the phase space for each IMF. The application of C-C method could arrange delay time τ and embedding dimension m simultaneously and thereby define the input–output matrices of the prediction models. Thirdly, predict the k + 1 IMFs separately by paralleling ARIMA and BP methods. The prediction of ARIMA only needs original IMFs so reconstruction is optional. The detailed ARIMA construction is utilizing unit root test to define d, exploiting ACF and PACF to determine q and p partly, and then finishing the model construction and making a static prediction. The most significant parameter of BP neural network is the number of hidden layers. In order to ensure the accuracy of a single model, we conducted multiple BP network training and determined the best quantity according to accuracy of the test set. Adding up the prediction results of every IMF can obtain the prediction results of the individual models. The fourth step is to perform combined prediction with PSOLSSVM, which optimizes the parameters through the PSO and then uses the trained network for data prediction. Different with separate models, the input values of combined prediction are the prediction results of ARIMA and BP.

4. Short-Term Wind Speed Forecast

4.1. Data Collection

The applicability of the model presented in this paper should be confirmed by processing the actual data. To achieve the goal, the wind speed data are collected from the wind farm of Cheng De, of which the measured height is 70 m and the time interval is 5 min. Because the most representative windy season of Cheng De is winter, the article selects 1000 data from 1 January 2017 as samples; among which, the first 800 data are training sets, and the remaining 200 are used as prediction values. The error analyses of last 100 data are treated to prove the superiority of the combined model. Relevant statistics of 1000 data are described in Table 1 and Figure 3. The decomposition program and most of the prediction models in the study are implemented in MATLAB 2018a. However, the ARIMA model uses EVIEWS 7 software, and the operating environment is Windows10 Professional.

4.2. Data Processing

It is crucial to set the number of modal components k and the penalty factor α , where k directly determines whether the decomposition is correct [54]. According to the study of [55], the conclusion could be made that it is an effective method to select the optimal mode number by using the difference Δ f between the center frequencies of the components. The criterion for stopping decomposes is when the Δ f between IMF (k) and IMF (k − 1) decreases gradually and tends to be stable. Table 2 shows the process of determining k in this case.
It can be seen from Table 2 that this case should be decomposed into five modes on account of the Δ f between k = 4 and k = 5 becoming smaller suddenly. If they continue to decompose, the value of Δ f may go up instead of down, meaning the center frequency of the adjacent modes is too close and the decomposition will begin aliasing. Based on the above analysis, the optimal number of decompositions is 5, with an additional error term, so the study of this data is based on these six IMFs. The waveform of the obtained six IMFs is shown in Figure 4.
The study also uses the most popular decomposition method, EMD, to process this case for comparing with VMD. EMD can decompose the appropriate mode adaptively, and because of its completeness, the sum of the components is always the same as the source data without residual term. Eight components are obtained by EMD and the specific results are shown in Figure 5.
The IMFs obtained by VMD should be reconstructed in the phase space to receive the input–output matrix of each component. The first thing is calculating the reconstruction parameters one by one. With the help of C-C, the delay time τ and embedding dimension m of per IMF decomposed by VMD is shown in Table 3.
Taking the IMF1 as an example, input–output matrix of the prediction models are Equations (18) and (19). The rest of the IMFs are similar to IMF1.
[ X 1 X 2 X 987 ] = [ x 1 x 7 x 13 x 2 x 8 x 14 x 987 x 993 x 999 ]
[ x 14 x 15 x 1000 ]
The matrix needs to be divided into a training set and prediction set for data simulation. Specific settings of each IMF are shown in Table 4.
Reconstruct the components acquired by EMD according to the same step could get the parameters and data settings as shown in Table 5.

4.3. Wind Speed Forecast by Separate Models

4.3.1. ARIMA Forecast

ARIMA is a statistics model for linear analysis and prediction; it analyzes the IMFs directly rather than the reconstructed sequences, but this model requires a certain stability of the data to ensure its prediction accuracy. In this paper, ADF (augmented Dickey–Fuller) is employed to test the stability of components so as to decide the difference number d. Supposing the significance level is 1%, this means that if the absolute value of t is greater than that of the critical value, it could estimate that data are stationary. If the absolute value of t is smaller, this indicates that the component is unstable, so it needs to perform the first-order difference and repeat the above steps until the requirement of rejecting the null hypothesis is satisfied. Because the components decomposed by VMD and EMD are more stable and have different frequencies and different periods, some of them can pass the stability test without differential processing, which denotes d = 0. For smooth data or differential data, q and p are determined according to the tailing or truncation of the ACF and PACF. The specific identification method is shown in Table 6.
The ARIMA model structure of each component should be defined before forecasting, therefore, the ADF verification and parameter analysis of each component has been processed in EVIEWS7. Final structures are shown in Table 7.
For comparison, the study also establishes the ARIMA model of original data and EMD components, and the results are expressed in Table 8.
The paper utilizes the ARIMA model of every IMF to predict the last 200 data separately. There are two prediction methods when using EVIEWS to establish ARIMA, namely static prediction and dynamic prediction. According to [56], it can be concluded that the effect of dynamic prediction is not as good as static prediction, so this paper chooses static to predict these components. Adding the predicted values of all the IMFs could reconstruct the predicted results of short-term wind speed.

4.3.2. BP Forecast

BP is used to establish nonlinear prediction models for the phase space reconstructed IMFs. Before sending the matrices into the models, the numbers of nodes of three layers need to be confirmed. The numbers of nodes in the input layer should be determined according to the dimension of phase space reconstruction and the output layer with one node. As for the hidden layer, the numbers of nodes are determined due to the input layer separately. The cut-and-try method is mainly used. The reference equation is Equation (20).
m = n + 1 + a
where n denotes the number of input layer nodes, m represents the number of hidden layer nodes, 1 is the number of output layer node, and a is a constant of 0–10. After several processing, the paper chose six as the number of hidden layer nodes, because the output of the six hidden layers has the smallest error and the highest precision. The other parameters are set as follows: The number of iterations is 100, the learning rate is 0.01, and the error target is 0.00004. After determining model structure and parameters, BP training is carried out for each IMF. The trained model can be used to predict the last 200 data by function sim in order to obtain the short-term prediction results.

4.4. Combined Forecast

A total of 200 data predicted by the two methods served as input of the combined prediction, and the output is still the actual wind speed. In the secondary prediction, the training set is the first 100 data, and the other 100 are the final prediction set. The final prediction of this study is based on the PSOLSSVM, which exploits PSO to optimize the combination of σ and γ . In the case of the parameters of PSO, the optimization interval of γ is set to [0.1, 300], and the optimization interval of σ is [0.1, 100], the number of iterations is adopted as 300, speed of particle optimization is 25, population is 20, initial weight is 0.9, and the final weight is set as 0.4. In addition, in order to evaluate the performance of the proposed model proposed in this paper, two linear weighted combinations including AW (average weighted) and EW (error weighted) are used as the comparisons. Using three preprocessing methods of the original data into the same prediction model could obtain the optimal processing method. The PSOLSSVM optimal parameters are listed in Table 9.

5. Results and Discussions

5.1. Model Performance Evaluation

It is valuable to employ a few error indicators when judging the prediction ability of the proposed model. Six indicators have been selected to evaluate the prediction results of the last 100 data. Statistical error measures such as MAE (mean absolute error), MAPE (mean absolute percent error), and RMSE (root mean squared error) are applied to assess the model according to the error between the predicted and actual values. Calculation equation is shown in (21)–(23).
M A E = 1 N i = 1 N | y i y ^ i |
M A P E = 1 N i = 1 N | y i y ^ i y i | 100 %
R M S E = 1 N i = 1 N ( y i y ^ i ) 2
where y ^ i denotes the predicted value of the wind speed, y i represents the actual wind speed, and the value of N is 100 in this paper, which denotes the number of the error analysis.
To further describe the meliority of the combination model in this study and the indispensability of each step, improved percentages indicators including P M A E , P M A P E , and P R M S E are introduced to measure the amendment degree. The improvement indicators are designed as below:
P M A E = M A E 1 M A E 2 M A E 1 100 %
P M A P E = M A P E 1 M A P E 2 M A P E 1 100 %
P R M S E = R M S E 1 R M S E 2 R M S E 1 100 %

5.2. Error Comparison Analysis

Intending to test the excellence of the proposed model named VMD-P-(ARIMA, BP)-PSOLSSVM, multiple models are opted for error comparison analysis, including two separate models called VMD-ARIMA, VMD-P-BP, two combined model using different combination methods like VMD-P-(ARIMA, BP)-AW, VMD-P-(ARIMA, BP)-EW, and two different preprocessing methods named EMD-P-(ARIMA, BP)-PSOLSSVM and O-P-(ARIMA, BP)-PSOLSSVM. Statistical indicators of all seven methods are listed in Table 10 and the best prediction results are marked in bold.
For observing the prediction accuracy intuitively, the study turns the content in Table 11 into three bar charts. In Figure 6, Figure 7 and Figure 8, the green bars represent separate prediction models, blue represents other combined models, and red denotes the proposed combined model with different preprocessing. It can be found that three indicators of M5 is the minimum among all methods, which means the proposed model is the best in terms of precision and stability. In the next analysis, the prediction results of all methods are grouped and evaluated to prove that each part of the proposed model is reasonable.
From observing Figure 9 and the comparison of the proposed and the separate models including M1 and M2, it can be detected that the MAE, MAPE, and RMSE of the M5 are virtually all less than those of the relevant separate models for the three horizons. As for the separate models, the performance of ARIMA is more accurate and stable than the BP. Compared with the ARIMA, P M A E of the proposed model is 53.8% while P M A P E and P R M S E is 42.8% and 52.2%, respectively. Simultaneously, matched with the result of BP, the value of P M A E , P M A P E , and P R M S E of the M5 is 74.3%, 70.2%, and 72.3% separately. Among this analysis, P M A E of three improved indicators is the maximum indicator that the proposed has a prominent contribution to increase the prediction accuracy. In the way of improving stableness, the proposed also has outstanding behavior, which may make some efforts to decrease the effect of wind power when entering the grid. Comparing the M1 with M2, 44.4%, 47.9%, and 42.1% correspond to P M A E , P M A P E , and P R M S E of the M1. The reason of this situation is because the signal decomposition technique treats the previously volatile wind speed into more stable series, so the linear model ARIMA could extract the signal preferably. Thereby, decomposition improves the accuracy and stability of the model to some extent. The analysis in this paragraph mainly expresses that the combined model in this paper is much better than the separate models from the accuracy and stability. In particular, the comparison not only shows that the outstanding contribution of PSOLSSVM during the secondary prediction, but also indicates the high volatility of wind speed after VMD processed can be dismissed partly. Individual prediction models have their own inherent characteristics, which causes them to have different merits and demerits in prediction. Different methods will collect different information from the data, so the separate models may ignore some information and only extract what it considers important. Thereby, using ARIMA and BP results as the input of the secondary prediction can optimize the individual models, while some defects and the inaccuracies of them can be complemented by the combination model; thus, the accuracy and stability of the prediction will be improved.
Figure 10 plots the predictions and the errors of the M3, M4, and M5 with the corresponding improvement indicators of them. The contrast of three combination models emphasizes the supremacy of the PSOLSSVM as the secondary prediction method. Linear weighting just averaged the results of two separate models to some extent, and the same for the errors, so it is difficult to play up strengths and avoid weaknesses. Moreover, the results of the individual models still have obvious nonlinear characteristics, thus, the prediction effect of the linear is theoretically inferior to the nonlinear combination. Using PSOLSSVM as the combination method is better than the linear weighted according to the study, which the P M A E , P M A P E and P R M S E of the proposed model are all more than 50% compared to the AW and EW. The relevant value of proposed are 64.3%, 57.5%, and 62.8% for AW and 60.8%, 52.9%, and 59.5% for EW. Result of the EW is better than the AW because EW decreases the weight of the method with large error to a certain extent and increases that of the high precision. The P M A E , P M A P E , and P R M S E of M4 compared with M3 is 8.9%, 9.7%, and 8.1%. From the above analysis, it can be summarized that the secondary prediction method proposed in this paper is much more excellent than the linear weighting of the separate models and the PSOLSSVM improves much in precision and stability based on the P M A E , P M A P E , and P R M S E analysis.
M5, M6, and M7 have diverse pretreatments with the one prediction procedure M6 is decomposed by EMD and M7 utilizes original data directly, the relevant error comparison and improvement indicators are shown in Figure 11, The key point of the proposed model is the secondary prediction using the first results of the separate models, so comparing the different inputs of the first prediction will find the best decomposition method to upgrade the accuracy of the whole model. Sort results can be achieved by comparing the worst effect of the combination prediction using the original data, followed by the EMD, and the best is the proposed model in this study. The P M A E of the proposed compared with M7 is 25.9%, P M A P E is 36.9%, and P R M S E is 39.1%, and the same analysis with M6 has the relevant value of, respectively, 13.3%, 13.2%, and 11.9%. Furthermore, EMD battles with the original data to get the P M A E , P M A P E , and P R M S E at 14.5%, 27.2%, and 30.9%. Improvement degree in this group is smaller than the last comparison group, which represents that the preprocessing have weaker improvement ability than the secondary prediction. This diagnosis proved the validity and necessity of data processing for VMD and phase space reconstruction. For a wind speed sequence with large fluctuations, it is effective to decompose original data into stable components by some methods, and then prediction. On account of the excellent impact and strong mathematical principle of VMD, this paper combines it with phase space reconstruction to process wind speed data.
In summary, VMD-ARIMA is the better model in separate predictions because of the available decomposition and the useful linear prediction; secondary prediction of the proposed model can greatly optimize the combination of the separate models, while the optimized degree is superior to the linear weighting; PSOLSSVM suffices to compensate the shortcomings of individuals and capture the nonlinear information to enhance the prediction accuracy and stability; VMD is a novel and eligible technology to improve this combination model from the source; the optimization effect of the secondary prediction is higher than the VMD or any other combinations.

6. Additional Forecasting Case

The universality and applicability must be proofed when a novel method proposed, so the spring data from the same district is applied to complete the study. In consideration of the most fluctuating wind speed, 1000 data start from 30 March of 2017 are picked as a supplementary case. After decomposition, six components and one residual term are obtained by VMD and nine components by EMD, and the specific phase space reconstruction and prediction steps are omitted for the sake of avoiding the duplication. The statistical information and the final prediction results are exhibited in Table 11 and Table 12, respectively.
Different resources receive different prediction results is a natural phenomenon, while the error analysis results of the supplementary case are consistent with the main case to some extent. Original data of the supplementary case is more volatile, which makes the prediction precision and reliability of the proposed model lower than the previous case. But the model developed in this paper is still the best in the supplementary case according to the results that the value of MAE, MAPE, and RMSE is 0.0591 m/s, 1.8937%, and 0.0729 m/s, respectively. ARIMA is still the better one in the separate models, and the improved indicators of it compared with BP are 37.4%, 37.2%, and 36.8%. The secondary prediction in this case manifests much better than the linear weighted, which the performance is ranked as M5 > M4 > M3, where > represents better. For instance, the P M A E of the proposed compared with M3 is 62.4%, P M A P E is 61.8%, and P R M S E is 62.7%. When analyzing the M5, M6, and M7, it can be found that the data processed by VMD and phase space reconstruction is more excellent than unprocessed or processed by EMD. Synthetically speaking, the data have more fluctuation when the proposed model has worse results, but is still optimal compared to other methods. Figure 12 and Figure 13 show the specific comparison results and improvement degree of the supplementary case.
On the one hand, the supplementary case proves that the proposed model has universal applicability to short-term wind speed prediction from the aspects of the data processing method, secondary predictive idea, and the final prediction method. By comparing it with other methods, the best results of the proposed method confirm that the requirement of high prediction accuracy and stability has been satisfied. On the other hand, for different data, the performance of the proposed model is different, as well as the degree of improvement. However, though the data with sharp waves will predict poorly, it demonstrates the proposed method is not a completely theoretical application but a practicality one.

7. Conclusions

Precise and credible short-term wind speed prediction is conducive to ensure the stability of the power grid. It is convenient for wind farms to arrange the unit maintenance and maintenance reasonably. Moreover, it will help to promote the development of wind power and improve its competitiveness. This paper developed a novel combination optimization model for short-term wind speed prediction, which the main idea is using the processed data and separate models to predict the wind speed first, and then regarding the results of the separate models as the input of the other method to make a second forecast. VMD and phase space reconstruction were applied as the preprocessing method, of which the former decomposes the wind speed data and the latter determines the input–output matrix of the prediction model. Separate models contain ARIMA and BP, meanwhile the PSOLSSVM with diverse principle is employed to do the secondary prediction. After simulation of two sets of data, this study verifies that the secondary prediction could compensate the shortcomings of the separate models, and the proposed model VMD-P-(ARIMA, BP)-PSOLSSVM is more effective than any other methods in prediction field of short-term wind speed.
Several conclusions can be drawn from this paper: (a) Decomposing the original wind speed by VMD can reduce the instability effectively, and the connection to phase space reconstruction enhances the mathematical basis of the whole model. Chaos method applied with VMD makes the matrix of components decidedly more scientific. The applicability of the process is the confirmation of Hypothesis 1. (b) The biggest innovation of this paper is using the PSOLSSVM and the results of the separate models for secondary prediction, of which the accuracy and reliability surpasses any other models. It also proves that combining linear with nonlinear methods, whose principles are different, can avoid the defects of the individual model and improve the prediction preformance, which prove the correctness of Hypothesis 2. (c) Case studies from two seasons with high fluctuations indicate that the novel model developed in the study has scalable application prospects and can meet the requirements of wind farms. This is the relevant content of Hypothesis 3 in the modeling process, and the error analysis results confirm the correctness of Hypothesis 3. (d) The error results of the two empirical cases in this paper prove that it is a very practical method to predict the short-term wind speed according to the proposed research process and modeling steps. It also demonstrates that the model has universal applicability and wide applicability.

Author Contributions

W.S. designed this paper and provided data resources; Q.G. wrote the original draft.

Funding

This research received no external funding.

Acknowledgments

In the process of the writing, sincerely appreciate my friend Wang Yuwei for giving advices on content and texture.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Zhang, Z.S.; Sun, Y.Z.; Cheng, L. Potential of trading wind power as regulation services in the California short-term electricity market. Energy Policy 2013, 59, 885–897. [Google Scholar] [CrossRef]
  2. Lars, L.; Gregor, G.; Henrik, A.N.; Torben, N.; Henrik, M. Stort-term prediction—An overview. Wind Energy 2003, 6, 273–280. [Google Scholar]
  3. Federico, C.; Massimiliano, B. Wind speed and wind energy forecast through Kalman filtering of Numerical Weather Prediction model output. Appl. Energy 2012, 99, 154–166. [Google Scholar]
  4. Ma, L.; Luan, S.Y.; Jiang, C.W.; Liu, H.L.; Zhang, Y. A review on the forecasting of wind speed and generated power. Renew. Sustain. Energy Rev. 2009, 13, 915–920. [Google Scholar]
  5. Zhou, J.G. Study of Short-term Wind Speed Prediction Method. Master’s Thesis, Tianjin University, Tianjin, China, 2012. [Google Scholar]
  6. Wang, J.Z.; Wang, Y.; Jiang, P. The study and application of a novel hybrid forecasting model—A case study of wind speed forecasting in China. Appl. Energy 2015, 143, 472–488. [Google Scholar] [CrossRef]
  7. Ye, L.; Zhao, Y.N. A Review on Wind Power Prediction Based on Spatial Correlation Approach. Autom. Electr. Power Syst. 2014, 38, 126–135. [Google Scholar]
  8. Aggarwal, S.K. Wind power forecasting: A review of statistical models. Int. J. Energy Sci. 2013, 3, 1–10. [Google Scholar]
  9. Brown, B.G.; Katz, R.W.; Murphy, A.H. Time Series Models to Simulate and Forecast Wind Speed and Wind Power. J. Climatol. Appl. Meteorol. 1984, 23, 1184–1195. [Google Scholar] [CrossRef]
  10. Lalarukh, K.; Yasmin, Z.J. Time series models to simulate and forecast hourly averaged wind speed in Quetta, Pakistan. Sol. Energy 1997, 61, 23–32. [Google Scholar]
  11. Masseran, N. Modeling the fluctuations of wind speed data by considering their mean and volatility effects. Renew. Sustain. Energy Rev. 2016, 54, 777–784. [Google Scholar] [CrossRef]
  12. Wang, Y.; Wang, J.; Zhao, G.; Dong, Y. Application of residual modification approach in seasonal ARIMA for electricity demand forecasting: A case study of China. Energy Policy 2012, 48, 284–294. [Google Scholar] [CrossRef]
  13. Box, G.; Jenkins, G.; Reinsel, G. Time Series Analysis, Forecasting and Control, 3rd ed.; Prentice-Hall: Englewood Cliffs, NJ, USA, 1994. [Google Scholar]
  14. Liu, Y. Container Throughput Forecasting Based on a Hybrid Model of VMD-ARIMA-HGWO-SVR. Master’s Thesis, Lanzhou University, Lanzhou, China, 2018. [Google Scholar]
  15. Zhao, Z.; Wang, X.S.; Qiao, J.T. Ultra-short-term Wind Speed Prediction Based on VMD and Improved ARIMA Model. J. North China Electr. Power Univ. 2019, 46, 54–59. [Google Scholar]
  16. Torres, J.; Garcıa, A.; De, B.M.; De, F.A. Forecast of hourly average wind speed with ARMA models in Navarre. Sol. Energy 2005, 79, 65–77. [Google Scholar] [CrossRef]
  17. Liu, H.; Tian, H.Q.; Li, Y.F. Comparison of two new ARIMA-ANN and ARIMA-Kalman hybrid methods for wind speed prediction. Appl. Energy 2012, 98, 415–424. [Google Scholar] [CrossRef]
  18. Ergin, E.; Jing, S. ARMA based approaches for forecasting the tuple of wind speed and direction. Appl. Energy 2011, 88, 1405–1414. [Google Scholar]
  19. Yuan, Q.Y.; Li, C.; Yang, Y.; Ye, K.H. Nonlinear Characteristics Analysis of Wind Speed Time Series. J. Eng. Therm. Energy Power 2018, 33, 135–143. [Google Scholar]
  20. Sun, W.; Wang, Y.W. Short-term wind speed forecasting based on fast ensemble empirical mode decomposition, phase space reconstruction, sample entropy and improved back-propagation neural network. Energy Convers. Manag. 2018, 157, 1–12. [Google Scholar] [CrossRef]
  21. Ren, C.; An, N.; Wang, J.Z.; Li, L.; Hu, B.; Shang, D. Optimal parameters selection for BP neural network based on particle swarm optimization: A case study of wind speed forecasting. Knowl. Based Syst. 2014, 56, 226–239. [Google Scholar] [CrossRef]
  22. Wang, J.J.; Zhang, W.Y.; Li, Y.N.; Wang, J.Z.; Dang, Z.L. Forecasting wind speed using empirical mode decomposition and Elman neural network. Appl. Soft. Comput. 2014, 23, 452–459. [Google Scholar] [CrossRef]
  23. Sideratos, G.; Hatziargyriou, N.D. Probabilistic wind power forecasting using radial basis function neural networks. IEEE Trans. Power Syst. 2012, 27, 1788–1796. [Google Scholar] [CrossRef]
  24. Cao, Q.; Ewing, B.T.; Thompson, M.A. Forecasting wind speed with recurrent neural networks. Eur. J. Oper. Res. 2012, 221, 148–154. [Google Scholar] [CrossRef]
  25. Qu, Z.X.; Mao, W.Q.; Zhang, K.Q.; Zhang, W.Y.; Li, Z.P. Multi-step wind speed forecasting based on a hybrid decomposition technique and an improved back-propagation neural network. Renew. Energy 2018, 133, 919–929. [Google Scholar] [CrossRef]
  26. Yang, Z.S.; Wang, J. A hybrid forecasting approach applied in wind speed forecasting based on a data processing strategy and an optimized artificial intelligence algorithm. Energy 2018, 160, 87–100. [Google Scholar] [CrossRef]
  27. Li, C.B.; Lin, S.S.; Xu, F.Q.; Liu, D.; Liu, J.C. Short-term wind power prediction based on data mining technology and improved support vector machine method: A case study in Northwest China. J. Clean. Prod. 2018, 205, 909–922. [Google Scholar] [CrossRef]
  28. Fu, C.; Li, G.Q.; Lin, K.P.; Zhang, H.J. Short-Term Wind Power Prediction Based on Improved Chicken Algorithm Optimization Support Vector Machine. Sustainability 2019, 11, 512. [Google Scholar] [CrossRef]
  29. Zhang, G.M.; Yuan, Y.H.; Gong, S.J. A Predictive Model of Short-Term Wind Speed Based on Improved Least Squares Support Vector Machine Algorithm. J. Shang Hai Jiao Tong Univ. 2011, 45, 1125–1129. [Google Scholar]
  30. Shao, Z.; Gao, F.; Yang, S.L.; Yu, B.G. A new semiparametric and EEMD based framework for mid-term electricity demand forecasting in China: Hidden characteristic extraction and probability density prediction. Renew. Sustain. Energy Rev. 2015, 52, 876–889. [Google Scholar] [CrossRef]
  31. Liu, H.; Tian, H.Q.; Pan, D.F.; Li, Y.F. Forecasting models for wind speed using wavelet, wavelet packet, time series and Artificial Neural Networks. Appl. Energy 2013, 107, 191–208. [Google Scholar] [CrossRef]
  32. Hu, J.; Wang, J.; Ma, K. A hybrid technique for short-term wind speed prediction. Energy 2015, 81, 563–574. [Google Scholar] [CrossRef]
  33. Liu, H.; Tian, H.Q.; Li, Y.F. Comparison of new hybrid FEEMD-MLP, FEEMD-ANFIS, Wavelet Packet-MLP and Wavelet Packet-ANFIS for wind speed predictions. Energy Convers. Manag. 2015, 89, 1–11. [Google Scholar] [CrossRef]
  34. Zhou, J.Z.; Sun, N.; Jia, B.J.; Peng, T. A Novel Decomposition-Optimization Model for Short-Term Wind Speed Forecasting. Energies 2018, 11, 1752. [Google Scholar] [CrossRef]
  35. Dragomiretskiy, K.; Zosso, D. Variational Mode Decomposition. IEEE Trans. Signal Process. 2014, 62, 531–544. [Google Scholar] [CrossRef]
  36. Abdoos, A.A. A new intelligent method based on combination of VMD and ELM for short term wind power forecasting. Neurocomputing 2016, 203, 111–120. [Google Scholar] [CrossRef]
  37. Ali, M.; Khan, A.; Rehman, N.U. Hybrid multiscale wind speed forecasting based on variational mode decomposition. Int. Trans. Electr. Energ. Syst. 2018, 28, e2466. [Google Scholar] [CrossRef]
  38. Bates, J.; Granger, C. The combination of forecasts. J. Oper. Res. Soc. 1969, 20, 451–468. [Google Scholar] [CrossRef]
  39. Dai, L.; Huang, S.D.; Huang, K.Y.; Ye, S. Combination Forecasting Model Based on Neural Networks for Wind Speed in Wind Farm. Proc. CSU-EPSA 2011, 23, 27–31. [Google Scholar]
  40. Guo, Z.H.; Zhao, J.; Zhang, W.Y.; Wang, J.Z. A corrected hybrid approach for wind speed prediction in Hexi Coeeidor of China. Energy 2011, 36, 1668–1679. [Google Scholar] [CrossRef]
  41. Zhang, K.Q.; Qu, Z.X.; Dong, Y.X.; Lu, H.Y.; Leng, W.N.; Wang, J.Z.; Zhang, W.Y. Research on a combined model based on linear and nonlinear features—A case study of wind speed forecasting. Renew. Energy 2019, 130, 814–830. [Google Scholar] [CrossRef]
  42. Li, G.; Shi, J.; Zhou, J.Y. Bayesian adaptive combination of short-term wind speed forecasts from neural network models. Renew. Energy 2011, 36, 352–359. [Google Scholar] [CrossRef]
  43. Liu, H.; Mi, X.W.; Li, Y.F. An experimental investigation of three new hybrid wind speed forecasting models using multi-decomposing strategy and ELM algorithm. Renew. Energy 2018, 123, 694–705. [Google Scholar] [CrossRef]
  44. Jiang, P.; Li, C. Research and application of an innovative combined model based on a modified optimization algorithm for wind speed forecasting. Measurement 2018, 124, 395–412. [Google Scholar] [CrossRef]
  45. Zhao, Y.M. Photovolltaic Power Generation Forecasting Based on VMD-SE-LSSVM and Iterative Error Correction. Master’s Thesis, Xi’an University of Technology, Xi’an, China, 2018. [Google Scholar]
  46. Wu, Q.; Lin, H. Short-Term Wind Speed Forecasting Based on Hybrid Variational Mode Decomposition and Least Squares Support Vector Machine Optimized by Bat Algorithm Model. Sustainability 2019, 11, 652. [Google Scholar] [CrossRef]
  47. Sun, D.; Meng, J.; Guan, Y.F.; He, Y.K. Inverter faults diagnosis in PMSM DTC drive using reconstructive phase space and fuzzy clustering. Proc. CSEE 2007, 27, 49–53. [Google Scholar]
  48. Sun, Y.M.; Zhang, Z.S. A new model of STLF based on the fusion of PSRT and chaotic neural networks. Proc. CSEE 2004, 24, 44–48. [Google Scholar]
  49. Kim, H.S.; Eykholt, R.; Salas, J. Nonlinear dynamics, delay times, and embedding windows. Nonlinear Phenom. 1999, 127, 48–60. [Google Scholar] [CrossRef]
  50. Zhou, Z.S. Prediction on Rainfall Based on BP Neural Networks. Master’s Thesis, Hunan Agricultural University, Changsha, China, 2015. [Google Scholar]
  51. Sun, W.; Xu, Y.F. Using a back propagation neural network based on improved particleswarm optimization to study the influential factors of carbon dioxide emissions in Hebei Province, China. J. Clean. Prod. 2016, 112, 1282–1291. [Google Scholar] [CrossRef]
  52. Suykens, J.A.K.; Vandewalle, J. Least Squares Support Vector Machine Classifiers. Neural Process. Lett. 1999, 9, 293–300. [Google Scholar] [CrossRef]
  53. Kennedy, J.; Eberhart, R. Particle swarm optimization. Int. Conf. Neural Netw. 1995, 6, 1942–1948. [Google Scholar]
  54. Wu, W.X.; Wang, Z.J.; Zhang, J.P.; Ma, W.J.; Wang, J.Y. Research of the Method of Determining k Value in VMD based on Kurtosis. J. Mech. Transm. 2018, 42, 153–157. [Google Scholar]
  55. Sun, G.Q.; Chen, T.; Wei, Z.N.; Sun, Y.H.; Zang, H.X.; Chen, S. A carbon price forecasting model based on variational mode decomposition and spiking neural networks. Energies 2016, 9, 54. [Google Scholar] [CrossRef]
  56. Wu, W.Y. EMD-ARIMA Model and Its Application in the Prediction of Commodity Price Index. Master’s Thesis, Jiangxi University of Finance and Economics, Nanchang, China, 2017. [Google Scholar]
Figure 1. Flowchart of particle swarm optimization least squares support vector machine.
Figure 1. Flowchart of particle swarm optimization least squares support vector machine.
Energies 12 02322 g001
Figure 2. Flowchart of the model proposed in this paper.
Figure 2. Flowchart of the model proposed in this paper.
Energies 12 02322 g002
Figure 3. Original wind speed time series.
Figure 3. Original wind speed time series.
Energies 12 02322 g003
Figure 4. The waveforms of components and residual terms decomposed by variational mode decomposition (VMD).
Figure 4. The waveforms of components and residual terms decomposed by variational mode decomposition (VMD).
Energies 12 02322 g004
Figure 5. The waveforms of components and residual terms decomposed by empirical mode decomposition (EMD).
Figure 5. The waveforms of components and residual terms decomposed by empirical mode decomposition (EMD).
Energies 12 02322 g005
Figure 6. The comparison chart of mean absolute error (MAE).
Figure 6. The comparison chart of mean absolute error (MAE).
Energies 12 02322 g006
Figure 7. The comparison chart of mean absolute percent error (MAPE).
Figure 7. The comparison chart of mean absolute percent error (MAPE).
Energies 12 02322 g007
Figure 8. The comparison chart of root mean squared error (RMSE).
Figure 8. The comparison chart of root mean squared error (RMSE).
Energies 12 02322 g008
Figure 9. Comparison between separate prediction models and proposed prediction model.
Figure 9. Comparison between separate prediction models and proposed prediction model.
Energies 12 02322 g009
Figure 10. Comparison of different combinations.
Figure 10. Comparison of different combinations.
Energies 12 02322 g010
Figure 11. Comparison of different data processing methods.
Figure 11. Comparison of different data processing methods.
Energies 12 02322 g011
Figure 12. Supplemental case error analysis histogram: (a) MAE; (b) MAPE; (c) RMSE.
Figure 12. Supplemental case error analysis histogram: (a) MAE; (b) MAPE; (c) RMSE.
Energies 12 02322 g012aEnergies 12 02322 g012b
Figure 13. Grouping error analysis and related improvement of supplementary data: (a) Comparison between separate prediction models and proposed prediction model; (b) comparison of different combinations; (c) comparison of different data processing methods.
Figure 13. Grouping error analysis and related improvement of supplementary data: (a) Comparison between separate prediction models and proposed prediction model; (b) comparison of different combinations; (c) comparison of different data processing methods.
Energies 12 02322 g013aEnergies 12 02322 g013b
Table 1. Statistics information of data.
Table 1. Statistics information of data.
Mean (m/s)Max. (m/s)Min (m/s)Var.Skew.Kurt.
6.409712.090.875.3280.1027−0.8186
Table 2. Center frequency corresponding to different mode number, k.
Table 2. Center frequency corresponding to different mode number, k.
KIMF1IMF2IMF3IMF4IMF5IMF6IMF7 Δ f
10.0002-------
20.00010.2597-----0.2596
30.00010.01970.2759----0.2562
40.00010.01250.03570.2769---0.2412
50.00010.01250.03570.27440.3860--0.1116
60.00010.01000.02470.06220.27560.3870-0.1115
70.00010.01000.02440.05910.13830.27900.40800.1290
Table 3. Phase space reconstruction parameters for each component.
Table 3. Phase space reconstruction parameters for each component.
IMF1IMF2IMF3IMF4IMF5IMFR0
m335345
τ 653652
τ w 1291212157
Table 4. Training set and prediction set settings for each intrinsic mode function (IMF).
Table 4. Training set and prediction set settings for each intrinsic mode function (IMF).
DatasetsIMF1IMF2IMF3IMF4IMF5IMFR0
Training set X 1 ~ X 787 X 1 ~ X 789 X 1 ~ X 787 X 1 ~ X 787 X 1 ~ X 784 X 1 ~ X 791
Prediction set X 788 ~ X 987 X 790 ~ X 989 X 788 ~ X 987 X 788 ~ X 987 X 785 ~ X 984 X 792 ~ X 991
Table 5. Reconstruction parameters and datasets of raw data and IMFs decomposed by EMD.
Table 5. Reconstruction parameters and datasets of raw data and IMFs decomposed by EMD.
IMFsm τ τ w Training SetPrediction Set
O367 X 1 ~ X 787 X 788 ~ X 987
IMF1235 X 1 ~ X 796 X 797 ~ X 996
IMF24620 X 1 ~ X 781 X 782 ~ X 981
IMF3279 X 1 ~ X 792 X 793 ~ X 992
IMF45418 X 1 ~ X 783 X 784 ~ X 983
IMF54517 X 1 ~ X 784 X 785 ~ X 984
IMF631022 X 1 ~ X 779 X 780 ~ X 979
IMF72911 X 1 ~ X 790 X 791 ~ X 990
IMF831022 X 1 ~ X 779 X 780 ~ X 979
Table 6. The identification of autoregressive moving average (ARMA) method.
Table 6. The identification of autoregressive moving average (ARMA) method.
ACFPACFModel Identification
Trailingp-order truncationAR(p) model
q-order truncationTrailingMA(q) model
TrailingTrailingARMA(p,q) model
Table 7. Autoregressive integrated moving average model (ARIMA) model structures of VMD components.
Table 7. Autoregressive integrated moving average model (ARIMA) model structures of VMD components.
IMF1IMF2IMF3IMF4IMF5IMFR0
(p, d, q)(2,2,1)(4,0,2)(4,0,2)(6,0,2)(2,0,4)(3,0,5)
Table 8. ARIMA model structures of original data and EMD components.
Table 8. ARIMA model structures of original data and EMD components.
OIMF1IMF2IMF3IMF4IMF5IMF6IMF7IMF8
(p, d, q)(6,2,1)(5,0,3)(5,0,2)(2,0,4)(6,2,1)(2,0,0)(1,2,0)(3,4,2)(6,3,2)
Table 9. Optimal parameters obtained by particle swarm optimization.
Table 9. Optimal parameters obtained by particle swarm optimization.
VMD-P-(ARIMA, BP)-PSOLSSVMEMD-P-(ARIMA, BP)-PSOLSSVMO-P-(ARIMA, BP)-PSOLSSVM
γ 239.25207.40248.40
σ26.2767.8957.60
Table 10. Error indicators of all models.
Table 10. Error indicators of all models.
NO.ModelMAE (m/s)MAPE (%)RMSE (m/s)
M1VMD-ARIMA0.11343.50350.14955
M2VMD-P-BP0.20396.72250.25828
M3VMD-P-(ARIMA,BP)-AW0.14664.72030.1921
M4VMD-P-(ARIMA,BP)-EW0.13364.26180.1767
M5VMD-P-(ARIMA,BP)-PSOLSSVM0.05242.00550.0715
M6EMD-P-(ARIMA,BP)-PSOLSSVM0.06052.31060.0812
M7O-P-(ARIMA,BP)-PSOLSSVM0.07073.17730.1175
Table 11. The statistics information of supplementary case.
Table 11. The statistics information of supplementary case.
Mean (m/s)Max. (m/s)Min (m/s)Var.Skew.Kurt.
5.312316.630.3711.4170.9119−0.0162
Table 12. Supplementary case prediction results analysis.
Table 12. Supplementary case prediction results analysis.
NO.ModelMAE (m/s)MAPE (%)RMSE(m/s)
M1VMD -ARIMA0.12704.02260.1571
M2VMD-P-BP0.20286.40860.2487
M3VMD-P-(ARIMA,BP)-AW0.15724.96280.1956
M4VMD-P-(ARIMA,BP)-EW0.14834.68380.1851
M5VMD-P-(ARIMA,BP)-PSOLSSVM0.05911.89370.0729
M6EMD-P-(ARIMA,BP)-PSOLSSVM0.06822.17120.0887
M7O-P-(ARIMA,BP)-PSOLSSVM0.11243.63400.1389

Share and Cite

MDPI and ACS Style

Sun, W.; Gao, Q. Short-Term Wind Speed Prediction Based on Variational Mode Decomposition and Linear–Nonlinear Combination Optimization Model. Energies 2019, 12, 2322. https://doi.org/10.3390/en12122322

AMA Style

Sun W, Gao Q. Short-Term Wind Speed Prediction Based on Variational Mode Decomposition and Linear–Nonlinear Combination Optimization Model. Energies. 2019; 12(12):2322. https://doi.org/10.3390/en12122322

Chicago/Turabian Style

Sun, Wei, and Qi Gao. 2019. "Short-Term Wind Speed Prediction Based on Variational Mode Decomposition and Linear–Nonlinear Combination Optimization Model" Energies 12, no. 12: 2322. https://doi.org/10.3390/en12122322

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop