Next Article in Journal
Two-Stage Battery Energy Storage System (BESS) in AC Microgrids with Balanced State-of-Charge and Guaranteed Small-Signal Stability
Previous Article in Journal
An Investigation of Parallel Post-Laminar Flow through Coarse Granular Porous Media with the Wilkins Equation
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Novel Hybrid Strategy Using Three-Phase Feature Extraction and a Weighted Regularized Extreme Learning Machine for Multi-Step Ahead Wind Speed Prediction

1
Climate and Weather Disasters Collaborative Innovation Center, School of Management Science and Engineering, Nanjing University of Information Science and Technology, Nanjing 210044, China
2
Gansu Weather Modification Office, Lanzhou 730020, China
3
College of Mathematics and Statistics, Nanjing University of Information Science and Technology, Nanjing 210044, China
*
Authors to whom correspondence should be addressed.
Energies 2018, 11(2), 321; https://doi.org/10.3390/en11020321
Submission received: 5 January 2018 / Revised: 20 January 2018 / Accepted: 29 January 2018 / Published: 2 February 2018
(This article belongs to the Section A: Sustainable Energy)

Abstract

:
With the growing penetration of wind power into electric grids, improving wind speed prediction accuracy has become particularly valuable for the exploitation of wind power. In this paper, a novel hybrid strategy based on a three-phase signal decomposition (TPSD) technique, feature extraction (FE) and weighted regularized extreme learning machine (WRELM) is developed for multi-step ahead wind speed prediction. The TPSD including seasonal separation algorithm (SSA), fast ensemble empirical mode decomposition (FEEMD) and variational mode decomposition (VMD) is proposed for the first time to handle the complex and irregular natures of wind speed comprehensively. The FE process is used to capture the useful features of wind speed fluctuations and determine the optimal inputs for a prediction model. The WRELM is employed as a basic predictor for building the prediction model by these selected features. Four real wind speed prediction cases are utilized to evaluate the proposed model, and experimental results verify the effectiveness of the proposed model compared with the benchmark models.

1. Introduction

In the past few decades, to reduce dependence on fossil fuels with their negative effects on the environment, attention has turned to clean renewable energy sources throughout the world [1]. As one kind of the rapidly growing renewable energy sources, wind energy has been recognized as an attractive alternative to conventional fossil fuels due to several advantages, including renewability and pollution-free environment [2]. However, wind power is recognized as a stochastic process [3] because of the intermittent and multi-scale characteristics of wind speed fluctuation [4,5]. With the increasing penetration of wind power in electric grids, this presents a number of challenges to power system operation, both technically and economically [6]. An accurate wind speed forecast is considered as one of the most efficient ways to mitigate these challenges. Improving the prediction accuracy of wind speed is beneficial for increasing the security of wind energy utilization and reducing the risk of power outages [7].
In recent years, many prediction methods have been proposed in the literature. Weron [8] presented a review of the state-of-the-art with a look into the future for forecasting methods. These models are generally classified into two groups: physical models and statistical methods [9]. Considering the physical description (such as topography, roughness, and obstacles) of wind farms, physical models mainly including numeric weather prediction (NWP), utilize physical laws and boundary conditions to simulate the physics of the atmosphere and predict the local wind speed [10]. These methods which usually require large amount of computing time and rich physical background knowledge, are frequently adopted for long-term wind speed prediction [11]. Contrary to these physical models, statistical methods which usually utilize lots of historical data to build the prediction models, are suitable for short-term wind speed prediction [12]. Traditional statistical methods, mainly including autoregressive moving average model (ARMA) [13], stochastic model [14], and Markov chain [15], are most widely used in the literatures. Erdem and Shi [13] developed four ARMA models for short-term prediction of wind speed and direction, and found that these proposed models performed better than the selected benchmark models. Bivona et al. [14] proposed several stochastic models to predict the short-term wind speed and concluded that the proposed model could significantly improve the forecast accuracy. Shamshad et al. [15] employed the first and second order Markov chain models to predict the uncertain characteristic of wind speed. More research about wind speed prediction with these conventional statistical methods has been done in [16,17,18,19].
Although these statistical methods can achieve more accurate short-term wind speed forecasting than physical models, their prediction performances are still not satisfactory because these models may be insufficient to capture the hidden nonlinear features in wind speed [20,21]. To capture the nonlinear variation of wind speed and improve the prediction accuracy, machine learning models have been proposed for short-term wind speed prediction. As two typical representatives of machine learning models, artificial neural networks (ANNs) and support vector machines (SVMs) have been widely used for wind speed prediction [19,22,23,24,25,26,27]. For instance, Velo et al. [22] employed a back propagation (BP) neural network with three layers to forecast the short-term wind speed and found that the proposed model could obtain reliable estimations. Shamshirband et al. [23] adopted a radial basis function (RBF) neural network to predict the wind speed and proved the effectiveness of the proposed model by test cases. Li and Shi [24] comprehensively compared the performances of three kinds of ANNs including adaptive linear element, BP and RBF for short-term wind speed prediction, and concluded that the prediction performance of different ANNs models depended on the different conditions. Guo et al. [19] employed a SVM model to predict the monthly wind speed, and the results indicated that this model had better performance in three different error criterion compared with selected benchmark models. Zhou et al. [25] developed three SVM models with three kernels to predict the short-term wind speed and concluded that the proposed models could improve the prediction accuracy. Cincotti et al. [26] compared the performances of three different methods including discrete-time univariate econometric model, ANN and SVM for electricity spot-prices forecasting and the results indicated that the SVM had the better prediction performance than other selected benchmark models.
Even though these machine learning models can improve the forecasting precision of wind speed to some extent, their prediction performances are still not satisfactory due to the spatial and temporal complexity of wind velocity variation. In recent years, there has been an increasing trend of combining different individual models, forming a hybrid model for short-term wind speed forecasting. For instance, Shi et al. [24] proposed two hybrid models namely ARMA-ANN and ARMA-SVM for short-term wind speed predictions. ANN and SVM were used to overcome the linear limitations of ARMA. The results showed that the proposed hybrid models were better than other individual forecasting models. Wang et al. [28] developed a hybrid model which combined extreme learning machine (ELM), Ljung-Box Q-test, and ARMA for wind speed prediction, and concluded that the developed hybrid model could improve the prediction accuracy of wind speed. Khashei et al. [29] proposed a hybrid model based on ARMA, fuzzy logic and ANN forwind speed prediction. Fuzzy logic and ANN were employed to capture the nonlinear information of wind velocity variation, and ARMA was employed to capture the linear information of it. The result showed that the developed model had the better prediction performance than other selected benchmark models. Kani and Ardehali [30] presented a hybrid model based on ANN and Markov chain for wind speed prediction, concluded that the developed model was better than the single methods.
Through the previous review, it can be found that most of these models are usually constructed by using the original wind speed signal directly. However, because of the inherent complexity of wind speed fluctuations, it is a difficult task to predict wind speed by these above-mentioned methods. To improve the predictive ability of these models, it is very necessary to consider and analyze the complicated characteristics of wind speed fluctuations. In recent years, a large amount of hybrid methods named decomposition prediction aggregation (DPA) models, which combine signal decomposition techniques and existing prediction models, have been proposed for short-term wind speed forecasting. The common modeling process of these DPA models can be summarized as follows: (1) decomposing raw wind speed signal into several sub-signals using some signal decomposition algorithms mainly including wavelet transform (WT) and empirical mode decomposition (EMD); (2) building forecasting models for each sub-signal; (3) obtaining the final forecasting results by sum of the forecasting result for each sub-signal. For example, De Giorgi et al. [31] built a combined model based on WT and SVM for wind speed prediction. In this method, WT was used to conduct the decomposition with the complicated multi-patterns signal, and SVM was constructed for forecasting all the sub-signals. The result showed that the WT could enhance the prediction performance of the standard SVM model. Ren et al. [32] presented a combined method based on EMD and ARMA for wind speed prediction. In this method, EMD was utilized to implement the decomposition of the original wind speed signal, ARMA was used for sub-signals forecasting, and the final forecasting result was calculated by the sum of the forecasting result of each sub-signal. This study proved that EMD could enhance the forecasting ability significantly. Liu et al. [33] presented a combined EMD-ANN model for wind speed forecasting, and concluded that EMD could enhance the forecasting performance of the ANN model.
Although the DPA models based on signal decomposition algorithms can improve the prediction ability to some extent, there still exist several deficiencies for these models. For example, adopting a single signal decomposition algorithm is inadequate to deal with non-stationary and inherent complexity of wind speed, constructing prediction models for each sub-series needs substantial computational resources and wastes training time, and ignoring the seasonal variation of wind speed will reduce the prediction precision of models. Thus, there still exist some probabilities for enhancing the prediction ability of these models. In this paper, a novel hybrid strategy based on three-phase signal decomposition (TPSD) technique, feature extraction (FE) and weighted regularized extreme learning machine (WRELM) is developed for multi-step ahead wind speed prediction. Firstly, a TPSD framework including seasonal separation algorithm (SSA), fast ensemble empirical mode decomposition (FEEMD), and variational mode decomposition (VMD) is for the first time developed to handle the complex and irregular natures of wind speed comprehensively. In the first phase, the original wind speed signal can be separated into season and trend components by SSA. In the second phase, the trend component can be decomposed into a number of intrinsic mode functions (IMFs) and a residual with different frequencies. For reducing the non-stationarity of the high frequency signal, the high frequencies IMFs (especially IMF1) can be further decomposed into several stationary modes in the third phase. Secondly, a feature extraction (FE) process including partial autocorrelation function (PACF) and regression analysis is proposed to capture the useful features of wind speed fluctuations and determine the optimal input features for a prediction model. Then, an improved extreme learning machine (ELM) named weighted regularized extreme learning machine (WRELM) is established using these selected features, and the prediction results of wind speed can be calculated by WRELM. Finally, the proposed approach is tested using four real wind speed datasets collected from a real-world wind farm of China. The main novelties and contributions of this study can be summarized as follows:
(1)
Compared with the single-step ahead wind speed prediction, multi-step ahead wind speed prediction can provide more time for wind power scheduling and wind turbines maintenance. However, due to the cumulative error influence on the prediction accuracy, it is still a challenge task for multi-step ahead prediction. This study develops a novel hybrid strategy using three-phase feature extraction technique and weighted regularized extreme learning machine for multi-step ahead wind speed prediction.
(2)
Different from the traditional DPA models which build prediction models for each subseries obtained by signal decomposition algorithms, in order to decrease the computation time and increase the prediction accuracy, this study proposes a novel prediction framework which only establishes a prediction model using these selected features from all different subseries.
(3)
In order to capture the useful features of wind speed signal and obtain the optimal input-output sample pairs, this study proposes a novel feature extraction framework including three signal decomposition processes of SSA, FEEMD and VMD. First, the SSA is employed to separate the season and trend components of wind speed signal, and capture the seasonal features of wind speed fluctuations. Second, the FEEMD is applied to decompose the trend component into lots of intrinsic mode functions (IMFs) and a residual with different frequencies. Considering the negative effect of high frequencies IMFs (especially IMF1) on the prediction accuracy, the VMD is utilized to further decompose the high frequency IMF1 into several stationary modes for reducing the non-stationarity of the high frequency signal. Finally, a feature selection process is used to capture the useful features of wind speed fluctuations and determine the optimal inputs of the prediction models.
(4)
In order to avoid the over-fitting limitation and reduce the influence of outliers, an improved ELM named WRELM is employed as a basic predictor for building the prediction model by using these selected features.
The rest of this paper is organized as follows: Section 2 gives a brief description of SSA, FEEMD, VMD, PACF and WRELM. Section 3 presents the frame work of the proposed model and the different error criteria. Section 4 shows the numerical results obtained from four real datasets. Finally, the conclusions and future researches are summarized in Section 5.

2. Related Methodology

This study develops a novel hybrid strategy based on three-phase feature extraction technique and weighted regularized extreme learning machine for multi-step ahead wind speed forecasting. Before presenting the hybrid approach, the key components of the proposed model are introduced as follows.

2.1. Seasonal Separation Algorithm (SSA)

The Seasonal separation algorithm (SSA) can implement the separation of both season and trend components from seasonal time series [34]. As a climate-driven renewable resource, the seasonal variations and trend variations of wind speed are two most commonly encountered phenomena. As the first step of the TPSD technique, this study firstly employs the SSA to implement the decomposition of raw wind speed signal for both season and trend components and capture the seasonal features of wind speed fluctuations. The concrete process of the algorithm can be described as follows [35].
Assuming that xt denotes the wind speed at time t, t ∈ {1, 2, …, T}, and Sj and Trt represent the seasonal and trend components, respectively. Then:
x t = T r t × S j
Then, the seasonal index Sj can be obtained by
S j = x t / T r t
Because the trend component Trt is unknown, it is need to be approximate by the average of xi in each cycle.
Assuming that T = l × m, and m and l denote the number of cycles and the number of data items in each cycle, respectively. Then, the dataset {x1, x2, , xT} can be expressed as x11, …, x1j, …, x1l, x2l, …, x2j, …, x2l, …, xk1, …, xkl, …, xm1, …, xmj, …, xml (k = 1, 2, …, m; j = 1, 2, …, l), where xkj represents the j-th datum of the k-th cycle. Then, the average of the k-th cycle can be derived as follows:
x _ k = ( x k 1 + x k 2 + x k l ) / l ( k = 1 , 2 , , m )
If Skj denotes the normalization data for items xkj, then:
S k j = x k j x _ k ( k = 1 , 2 , , m ;   j = 1 , 2 , , l ) .
Then, Sj can be defined as follows:
S j = S 1 j + S 2 j + S m j m ( j = 1 , 2 , , l ) .
This definition of Sj conforms to the normalization process and is demonstrated as follows:
j = 1 l S j = 1 m k = 1 m j = 1 l S k j = 1 m k = 1 m ( j = 1 l x k j / x _ k ) = 1 m k = 1 m l = l
Then, the trend component can be obtained as follows:
T r k j = x k s S j ( k = 1 , 2 , , m ;   j = 1 , 2 , , l )
Considering the cycle influence of wind speed data, in this paper, l = 24 is as a cycle and m = [T/l].

2.2. Fast Ensemble Empirical Mode Decomposition (FEEMD)

As a novel signal processing technology, EMD has been frequently adopted for analyzing nonlinear and stochastic signals [32,33]. Compared with the traditional signal processing techniques such as wavelet transform and Fourier transform, the EMD has better performance in multi-resolution and extensive practicability. However, this method presents a serious drawback of mode mixing. An ensemble EMD named EEMD was developed by Wu and Huang in 2008 for tackling the mode mixing problem [36]. Although the EEMD can effectively alleviate the mode mixing problem, it is time consuming to obtain the ensemble means. A new improved version of EMD called fast ensemble empirical mode decomposition (FEEMD) is proposed for overcoming two main disadvantages including mode mixing and time consuming. The superiority of FEEMD has been demonstrated in many fields [37,38]. The main steps of this algorithm can be summarized as follows:
Step 1: Initializing the ensemble number en and the replication times M.
Step 2: Obtaining the noise-added signal xtn(t) by adding the Gaussian white noise ntn(t) to the original signal x(t):
x t n ( t ) = x ( t ) + n t n ( t )
where tn (tn = 1, 2, L, …, M) denotes the number of trial times, and t is the time script.
Step 3: Using EMD to decompose the noise-added signal xtn(t) into a set of intrinsic mode functions (IMFs) and a residue:
x t n ( t ) = i = 1 e n c i , t n ( t ) + r t n ( t )
where ci,tn(t) and rtn(t) represent the i-th IMF and the residue of the tn-th trial at time t, respectively.
Step 4: Adding different white noises to the original signal and repeat step (2) to step (3) until tn = M.
Step 5: Calculating the final decomposition results by the following equations:
c i ( t ) = t n = 1 M c i , t n ( t ) / M r ( t ) = t n = 1 M r t n ( t ) / M
where ci(t) represents the ensemble mean of the i-th IMF, and r(t) denotes the ensemble mean of the residue components.
Considering the real empirical data, three important parameters of FEEMD which includethe ensemble number en and the replication times M, are respectively set as 8 and 200 in this paper.

2.3. Variational Mode Decomposition (VMD)

As a new signal processing technique, variational mode decomposition (VMD) can decompose a complicated signal into a discrete number of modes with specific sparsity properties [39]. Let x(t) be the original signal at time t, yi denotes the i-th component of signal x(t) by VMD, and cpi represents the corresponding center pulsation of yi. Along with the decomposition process of VMD, a center pulsation cpi can be obtained and each mode yi can be compressed around it. To estimate the bandwidth of each mode yi, three main steps can be considered: (i) using Hilbert transform to obtain unilateral frequency spectrum by calculating each mode yi; (ii) shifting the frequency spectrum of each mode to baseband by mixing an exponential tuned to the respective estimated center frequency; (iii) estimating the bandwidth of each mode yi by making use of the H1 Gaussian smoothness of the demodulated signal. Therefore, the decomposition process of VMD can be converted into the following optimization problem [40]:
min { y i } , { c p i } { i t [ ( δ ( t ) + j π t ) y i ( t ) ] e j c p i t 2 2 } s . t . i y i = x ( t )
where yi(t) denotes the i-th component of signal at time t, δ(t) and represent the Dirac distribution and convolution operator, respectively.
Considering the penalty terms and Lagrange multiplier, the above constrained problem can be converted to the unconstrained one which is easier to be calculated. The process can be described as follows:
L ( { y i } , { c p i } , λ ) = α i t [ ( δ ( t ) + j π t ) y i ( t ) ] e j c p i t 2 2 + x ( t ) i y i ( t ) 2 2 + λ ( t ) , x ( t ) i y i ( t )
where α and λ denote the balancing parameter of the data-fidelity constraint and Lagrange multiplier, respectively.
The alternate direction method of multipliers (ADMM) can be used to update yi and cpi in two directions, and complete the analysis process of VMD. Therefore, the solutions of yi and cpi can be calculated as follows:
y ^ i i n + 1 = x ^ ( c p ) z i y ^ z ( c p ) + λ ^ ( c p ) 2 1 + 2 α ( c p c p i ) 2 c p i i n + 1 = 0 c p | y ^ i i n + 1 ( c p ) | 2 d c p 0 | y ^ i i n + 1 ( c p ) | 2 d c p
where in denotes the number of iterations, x ^ ( c p ) ,   y ^ z ( c p ) , λ ^ ( c p ) and y ^ i i n + 1 ( c p ) represent the Fourier transforms of x(t), yz(t), λ(t) and y i i n + 1 ( t ) , respectively.

2.4. Partial Autocorrelation Function (PACF)

In time series analysis issues, PACF is widely applied to determine the correlation between the current values and the past values of a time variable. Inspired by this, in this paper, PACF is employed to find the correlation between the current values and the past values of wind speed variable, and determine the input number of these prediction models. The brief introduction of the PACF is described as follows [41,42].
If x(t) (t = 1, 2, K, T) is the wind speed at time t and γ(h) denotes the covariance at lag h, then we can get the estimation value γ ^ ( h ) of γ(h) as follows:
γ ^ ( h ) = 1 T t = 1 T h ( x ( t ) x ¯ ) ( x ( t + h ) x ¯ ) ,   h = 0 , 1 , , L
where x ¯ is the average value of time series x(t), T is the data size, and L is the maximum lag. The choice of L depends on the length of the data. In general, L = T/4.
If ρ(h) is denoted as autocorrelation function (ACF) at lag h, then we can get the estimation value ρ ^ ( h ) of ρ(h) as follows:
ρ ^ ( h ) = γ ^ ( h ) γ ^ ( 0 )
If β(h, h) denotes the PACF at lag h, then the estimation value β ^ ( h , h ) of the β(h, h) can be derived as follows:
β ^ ( 1 , 1 ) = ρ ^ ( 1 ) β ^ ( h + 1 , j ) = β ^ ( h , j ) β ^ ( h + 1 , h + 1 ) β ^ ( h + 1 , h j + 1 )   ( j = 1 , 2 , , h ) β ^ ( h + 1 , h + 1 ) = ρ ^ ( h + 1 ) j = 1 h ρ ^ ( h + 1 j ) β ^ ( h , j ) 1 j = 1 h ρ ^ ( j ) β ^ ( h , j )
where h = 1, 2, L, L.
To assess the significance of autocorrelation between lags, the confidence intervals have been widely adopted. In this study, the 95% confidence interval is employed to determine the optimal lags of wind speed for all models. The definition can be described as follows:
r 0.95 + = + 2 T r 0.95 = 2 T
where T is the data size, r 0.95 + and r 0.95 denote the upper and lower critical values, respectively. If β ^ ( h , h ) ( r 0.95 , r 0.95 + ) , then x ( t h ) is one of the input variables. Otherwise, it is not.

2.5. Weighted Regularized Extreme Learning Machine (WRELM)

2.5.1. Extreme Learning Machine (ELM)

As a special kind of ANN, the ELM has the advantages of fast learning speed, high forecasting accuracy and better generalization ability relative to traditional ANNs [43]. Huang et al. have demonstrated that ELM can improve the prediction performance than the other ANN and SVM [44]. It has been successfully applied for time series prediction [45,46]. A standard structure of ELM is demonstrated in Figure 1.
For given a dataset with N samples { ( X i , Y i ) } i = 1 N , where Xi is the input vector and Xi Rn, Yi is the target output vector and Yi Rm, set g(X) as the activation function of hidden layer with Q nodes, and the working principle of the standard ELM can be described as follows [43]:
q = 1 Q V q g ( W q X i + b q ) = Y i ,   i = 1 , 2 , , N
where bq is randomly selected as the bias of the q-th hidden node, Wq is randomly selected as the input weight vector between the q-th hidden node and the input nodes, and Vq is the output weight vector between the q-th hidden node and the output nodes.
Equations (18) can be simplified as a linear system:
H V = Y
where H is the output results of hidden layers and:
H ( W 1 , W 2 , , W Q , X 1 , X 2 , , X N , b 1 , b 2 , , b Q ) = [ g ( W 1 X 1 + b 1 ) g ( W Q X 1 + b Q ) g ( W 1 X N + b 1 ) g ( W Q X N + b Q ) ] N × Q ,
V is the output weights matrix between hidden layer and output layer and V = [ V 1 T V 2 T V Q T ] Q × m , and Y is the target output results of output layer and Y = [ Y 1 T Y 2 T Y N T ] N × m .
The optimal least squares solution V can be obtained by minimizing the empirical risk:
V ^ = ( H T H ) 1 H T Y
where V ^ is the optimal least squares estimates of the output weights matrix V.
Therefore, the prediction results of ELM can be expressed as:
Y ^ = H V ^

2.5.2. Weighted Regularized Extreme Learning Machine (WRELM)

As mentioned above, because the ELM considers only the empirical risk minimization, it still suffers from over-fitting in the modeling process. On the other hand, the prediction performance of ELM is also affected by the outliers in train samples. In order to overcome these limitations of ELM, an improved ELM named WRELM based on the principles of both empirical risk minimization and structural risk minimization simultaneously, is employed to build the wind speed predictor in this study. The mathematical expression of WRELM model is shown as follows [47]:
min V   C W e 2 2 + V 2 2 ,   subject   to   Y H V = e
where ei is the error variable Wi is the weighing factor, W = d i a g { W 1 , W 2 , , W N } is the extended form of e 2 2 ( e = [ e 1 , e 2 , , e N ] T ) . C is a regularization parameter.
This following formula can get the optimal solution V for WRELM:
V ^ = ( H T W 2 H + I C ) 1 H T W 2 Y
where I is a unit matrix.
The prediction results of WRELM can be obtained similar to ELM. The related research has demonstrated that the WRELM can improve the prediction performance than other versions of ELM. The detailed process of model derivation and parameter setting of the WRELM can be found in [47].

3. Proposed Approach and Error Criteria

3.1. The Framework of the Proposed Model

From the upper review, it can be found that these signal decomposition algorithms are often employed to enhance the prediction ability of the proposed models. However, due to the insufficiency of single signal decomposition algorithms for dealing with complex wind speed signal and the low computational efficiency caused by modeling for each subseries obtained from signal decomposition process, there still exist some probabilities for improving the prediction accuracy of these models. In this paper, a novel hybrid strategy based on three-phase signal decomposition (TPSD) technique, feature extraction (FE) and weighted regularized extreme learning machine (WRELM) is developed for improving the multi-step ahead wind speed prediction. In this proposed model, Firstly, a TPSD framework including seasonal separation algorithm (SSA), fast ensemble empirical mode decomposition (FEEMD), and variational mode decomposition (VMD) is utilized to handle the complex and irregular natures of wind speed comprehensively. Then, a feature extraction (FE) process including partial autocorrelation function (PACF) and regression analysis is proposed to capture the useful features of wind speed fluctuations and determine the optimal input features for a prediction model. Finally, an improved extreme learning machine (ELM) named weighted regularized extreme learning machine (WRELM) is established using these selected features to improve the forecasting accuracy and computational efficiency.
Figure 2 shows the framework of the developed hybrid model, and the modeling process of the proposed approach can be briefly summarized as follows:
(1)
Develop a TPSD framework to handle the complex and irregular natures of wind speed signal comprehensively. In the first phase, the SSA is employed to separate the season and trend components of wind speed signal, and capture the seasonal features of wind speed fluctuations. In the second phase, the FEEMD is applied to decompose the trend component into lots of intrinsic mode functions (IMFs) and a residual with different frequencies. Considering the negative effect of high frequencies IMFs (especially IMF1) on the prediction accuracy, the VMD is utilized to further decompose the high frequency IMF1 into several stationary modes for reducing the non-stationarity of the high frequency signal in the third phase. The full dimensions features of wind speed signal can be obtained by TPSD.
(2)
Propose a feature extraction process to capture the useful features of wind speed fluctuations and determine the optimal features for a prediction model. The PACF is first applied to find the correlation between the current values and the past values of wind speed variable, and determine the initial features for the prediction model. In order to avoid over-fitting, a linear regression is further applied to select the optimal features for the prediction models. In the modeling process of linear regression, the top 80% of training data is called as the learning set which is applied to calculate the parameters of the model, and the remaining 20% of training data is called validation set which is applied to estimate the performance of the model. If one kind of feature combinations can generate the smallest validation error, then the corresponding feature combination is selected as the optimal input features subset for the prediction model.
(3)
Use these optimal features to build a WRELM prediction model. Different from the traditional signal decomposition-based prediction models which build a prediction model for each sub-series decomposed from original signal by signal decomposition algorithm, this study only constructs a prediction model using these selected optimal features for saving computation time and improving the prediction accuracy.

3.2. Evaluation Criteria

In this study, three error criteria which measure the deviation between the real and forecasting values are utilized to quantitatively evaluate prediction performance of all involved forecasting models. Three error criteria have the three measures including the mean absolute error (MAE), root mean square error (RMSE) and mean absolute percentage error (MAPE). In general, the smaller values of these measures indicate that the corresponding model has better prediction performance. These error measures are given as follows:
M A E = 1 f n t = 1 f n | x ( t ) x ^ ( t ) |
R M S E = 1 f n t = 1 f n ( x ( t ) x ^ ( t ) ) 2
M A P E = 1 f n t = 1 f n | x ( t ) x ^ ( t ) x ( t ) |
where fn represents the number of forecasting samples, x(t) and x ^ ( t ) denote the real value and prediction value of wind speed signal at time t, respectively.

4. Experimental Simulation

4.1. Data Collection

Gansu Province in China has abundant wind energy resources due to its particular favorable terrain and the influence of atmospheric circulation. In this study, the mean hourly wind speed data with 24 observation values every day collected from a real wind farm located in Gansu Province was utilized to evaluate the prediction performance of the proposed model. In order to further verify the seasonal adaptability of the proposed model, four prediction cases were randomly selected: from 1 May 2010 to 31 May 2010, corresponding to the spring, from 1 August 2010 to 31 August corresponding to the summer, 2010, from 1 October 2010 to 31 October 2010 corresponding to the fall, and from 1 December 2010 to 31 December 2010 corresponding to the winter season, respectively. Figure 3 shows the raw wind speed signals in the four cases. As shown in Figure 3, the wind speed has obvious random fluctuations and multi-pattern characteristics. Table 1 describes the statistical analysis results of these wind speed signals. From Table 1, it can be shown that the four datasets have different statistical measures. The basic idea is used to test if the proposed model can be applied for different seasonal prediction cases. Moreover, each case recorded 744 observation values that can be partitioned into both the training set (80%) and the validation set (20%) in the modeling process. The training set is used for building the prediction model, and the validation set is used to test the forecasting performance of the proposed model.

4.2. Three-Phase Signal Decomposition of Wind Speed Signal

Due to the influence of the complex climate system on wind speed, wind speed fluctuations have complicated multi-pattern characteristics. It is essential to consider and analyze the complicated multi-pattern characteristics of wind speed fluctuations to improve the prediction ability of the models, but most of the existing studies either ignore the complex multi-pattern characteristics or adopt a single signal decomposition algorithm for capturing the complicated wind speed fluctuations. It is a difficult task to further improve the wind speed prediction accuracy using these mentioned methods. Many studies have shown that a best decomposition algorithm for all situations does not exist. In this paper, we make full use of the latest theoretical achievements of signal decomposition algorithms, and develop a novel combination framework including SSA, FEEMD and VMD for dealing comprehensively with the complicated characteristics of wind speed fluctuations. This algorithm first uses SSA to separate the season and trend components of wind speed signal, and capture the seasonal features of wind speed fluctuations. Then, the FEEMD is applied to decompose the trend component into lots of IMFs and a residual with different frequencies. Finally, considering the negative effect of high frequencies IMFs (especially IMF1) on the prediction accuracy, the VMD is utilized to further decompose the high frequency IMF1 into several stationary modes for reducing the non-stationarity of the high frequency signal.
Figure 4 shows the SSA results of four original wind speed signals. From Figure 4, it can be shown that each wind speed dataset is separated into the seasonal variations and trend variations. The seasonal features of each case are shown in Table 2, where the seasonal features of the four cases have the different characteristics because of the influence of the climate system on wind speed.
Figure 5 shows the decomposed results of trend components using FEEMD in the four cases. From Figure 5, it can be shown that the different trend components in four cases are decomposed into a number of IMFs and a residual with different frequencies. The frequencies of IMFs reflected different natural oscillatory modes are ranged from high to low. The residual is the lowest frequency and represents the basic trend of signal. In this paper, each trend component is decomposed into totally 9 components which are respectively named as IMF1, IMF2, IMF3, IMF4, IMF5, IMF6, IMF7, IMF8 and residual. In addition, to further improve the forecasting performance of the model, the VMD is further employed to decompose the high frequency IMF1 into several stationary modes for reducing the non-stationarity of the high frequency signal. Figure 6 shows the VMD results of the high frequency IMF1 in four cases. From Figure 6, it can be shown that each IMF1 of four cases is decomposed in total into three components which are respectively named as Mode1, Mode2, and Mode3. The complicated multi-patterns features of wind speed change have been decomposed thoroughly by the above three-phase signal decomposition technique. In next section, a feature selection process is employed to capture the useful features of wind speed fluctuations and determine the optimal features for a prediction model.

4.3. Feature Selection Process of Trend Components Signal

4.3.1. The Initial Feature Selection Process of Training Samples Using PACF

The input nodes number of the model has to be determined from data signal before training the prediction model. In this study, the PACF is first utilized to find the correlation between the current values and the past values of wind speed variable, and determine the input nodes number of the model. Figure 7 shows the plot of PACF against the lag length in the four trend components, respectively. As shown in Figure 7, the PACF graph shows different cutoff phenomena in the four cases. In spring and winter, the PACF shows a cutoff phenomenon after lag 2. In summer and fall, the PACF shows a cutoff phenomenon after lag 3. Table 3 shows the input nodes number of the predictor. According to the PACF results of four cases, the training samples of different cases can be constructed from all the subseries and the corresponding trend component. For instance, the trend component in Spring is decomposed into totally 11 components by FEEMD and VMD which are respectively named as IMF2, IMF3, IMF4, IMF5, IMF6, IMF7, IMF8, residual, Mode1, Mode2, and Mode3, and the input nodes number is identified as 2 by PACF, then there are the 22 initial features of the training samples and can be shown in Table 4. Similarly, the initial features of the training samples in other cases can also be shown in Table 4.

4.3.2. The Optimal Feature Selection Process of Training Samples Using Regression Analysis

In order to select the optimal feature combination and avoid over-fitting, a linear regression is further applied to select the optimal features of training samples in four cases. In the modeling process of linear regression, the top 80% of training data is called as the learning set which is applied to calculate the parameters of the model, and the remaining 20% of training data is called validation set which is applied to estimate the performance of the model. A simple feature selection process which adds the more recent feature to the less recent feature one by one is adopted in this study. If one kind of feature combinations can generate the smallest validation error, then the corresponding feature combination is selected as the optimal features subset of training samples.
Here, RMSE is selected as the validation error, and Figure 8 shows the validation error against the feature number in the four cases. As is shown in Figure 8, the best feature numbers are 14, 19, 17, and 16 in the four cases, respectively. The optimal feature combinations of training samples in the four cases are summarized in Table 5.

4.4. The Prediction Results of Original Wind Speed Signal

As a novel machine learning algorithm, ELM has the advantages of fast learning speed, high forecasting accuracy and better generalization ability relative to traditional single-hidden layer feed-forward neural networks, and has been successfully applied in the field of time series prediction. However, because the ELM considers only the empirical risk minimization, it still suffers from over-fitting in the modeling process. On the other hand, the prediction performance of ELM is also affected by the outliers in train samples. In order to overcome these limitations of ELM, an improved ELM named WRELM based on the principles of both empirical risk minimization and structural risk minimization simultaneously, is employed to build the wind speed predictor in this study. Different from the traditional signal decomposition-based prediction models which build a prediction model for each sub-series decomposed from original signal by signal decomposition algorithm, this study only constructs a prediction model using these selected optimal features for improving the prediction accuracy.
Figure 9 shows the multi-step ahead prediction results of WRELM model for trend components in four cases. From Figure 9, it can be seen that the WRELM model can capture the complicated features of trend component fluctuations from one-step ahead forecasting to three-step ahead forecasting. Finally, the prediction results of original wind speed can be calculated by aggregating the seasonal features to the prediction values of trend component. Figure 10 shows the multi-step ahead prediction results of original wind speed in four cases. Similarly, from Figure 10, it can be also shown that the prediction values of each original wind speed in four cases can capture the main trend of each corresponding original wind speed fluctuations.

4.5. Model Comparisons

In order to comprehensively evaluate the effectiveness of the proposed feature extraction method (FEM)-based prediction approach called FEM-SFVW model, a detailed comparative study is conducted for multi-step ahead wind speed forecasting in this section. Three kinds of models including the single models (BP, ELM and WRELM), DPA-based models (DPA-SFVB, DPA-SFVE and DPA-SFVW) and other FEM-based models (FEM-SB, FEM-FB, FEM-VB, FEM-SFB, FEM-SVB, FEM-FVB, FEM-SFVB, FEM-SE, FEM-FE, FEM-VE, FEM-SFE, FEM-SVE, FEM-FVE, FEM-SFVE, FEM-SW, FEM-FW, FEM-VW, FEM-SFW, FEM-SVW, FEM-FVW and FEM-SFVW) are selected as the benchmark models to assess the effectiveness of the proposed model. Three error criteria including MAE, RMSE and MAPE are utilized to assess the performance of all considered prediction models. Table 6 shows the comparison of multi-step ahead prediction performances of different models in spring. The smallest value of each column is marked as boldface in Table 6. As shown in Table 6, compared with these all benchmark models, the proposed model has the smallest error criteria in horizons of one-step, two-step and three-step ahead prediction. Table 7, Table 8 and Table 9 show the comparisons of multi-step ahead prediction performances of different models in other cases. A similar conclusion is deduced in Table 7, Table 8 and Table 9. To present the comparison more intuitively, Figure 11, Figure 12, Figure 13 and Figure 14 show the histograms of four cases based on the values of MAE, RMSE and MAPE of different models.
From Figure 11, Figure 12, Figure 13 and Figure 14, it can be shown that the proposed model has the smallest error criteria compared with other benchmark models. In a word, it is concluded that the proposed model can improve the prediction performance of multi-step ahead wind speed and is superior to all the benchmark models.
To further assess the influence of TPSD technique, FE process and WRELM on the proposed hybrid model, five experiments are designed as follows. Experiment I is designed for proving the advantages of WRELM, and three comparisons are conducted including ELM vs. BP, WRELM vs. BP, and WRELM vs. ELM. The comparison results of the experiment I in four cases are shown in Table 10.
From Table 10, it can be shown that the WRELM model has the smallest multi-step ahead prediction errors compared with BP and ELM. Therefore, we adopt WRELM as the basic predictor for wind speed forecasting in this study. Experiment II is designed to assess the influence of the FE process on the proposed hybrid model, and three comparisons are conducted including FEM-SFVB vs. DPA-SFVB, FEM-SFVE vs. DPA-SFVE, and FEM-SFVW vs. DPA-SFVW. The comparison results of the experiment II in four cases are also shown in Table 10, where it can be seen that the FE process can improve the prediction performance of multi-step ahead wind speed forecasting.
In order to assess the influence of the different signal decomposition algorithms on the proposed hybrid model, three experiments including experiment III, experiment IV and experiment V are designed. Experiment III is designed to evaluate that if the three-phase signal decomposition technique is better than two-phase signal decomposition technique, and nine comparisons are conducted including FEM-SFVB vs. FEM-SFB, FEM-SFVB vs. FEM-SVB, FEM-SFVB vs. FEM-FVB, FEM-SFVE vs. FEM-SFE, FEM-SFVE vs. FEM-SVE, FEM-SFVE vs. FEM-FVE, FEM-SFVW vs. FEM-SFW, FEM-SFVW vs. FEM-SVW, and FEM-SFVW vs. FEM-FVW.
Experiment IV is designed to evaluate that if the two-phase signal decomposition technique is better than single signal decomposition technique, and eighteen comparisons are conducted including FEM-SFB vs. FEM-SB, FEM-SFB vs. FEM-FB, FEM-SVB vs. FEM-SB, FEM-SVB vs. FEM-VB, FEM-FVB vs. FEM-FB, FEM-FVB vs. FEM-VB, FEM-SFE vs. FEM-SE, FEM-SFE vs. FEM-FE, FEM-SVE vs. FEM-SE, FEM-SVE vs. FEM-VE, FEM-FVE vs. FEM-FE, FEM-FVE vs. FEM-VE, FEM-SFW vs. FEM-SW, FEM-SFW vs. FEM-FW, FEM-SVW vs. FEM-SW, FEM-SVW vs. FEM-VW, FEM-FVW vs. FEM-FW, and FEM-FVW vs. FEM-VW. Experiment V is designed to evaluate that if the single signal decomposition technique is better than the no decomposition process, and nine comparisons are conducted including FEM-SB vs. BP, FEM-FB vs. BP, FEM-VB vs. BP, FEM-SE vs. ELM, FEM-FE vs. ELM, FEM-VE vs. ELM, FEM-SW vs. WRELM, FEM-FW vs. WRELM, and FEM-VW vs. WRELM. Table 11 shows the comparison results of the three experiments in spring over different horizons including one-step, two-step and three-step ahead wind speed prediction. From Table 11, it can be shown that the three-phase signal decomposition technique is better than two-phase signal decomposition technique, the two-phase signal decomposition technique is better than single signal decomposition technique, and the single signal decomposition technique is better than the no decomposition process. In a word, the multi-phase signal decomposition algorithms can effectively decrease the three prediction errors including MAE, RMSE and MAPE compared with the single models (BP, ELM and WRELM) in different prediction horizons. Similarly, Table 12, Table 13 and Table 14 show the comparison results of the three experiments in other three cases over different horizons including one-step, two-step and three-step ahead wind speed prediction. A similar conclusion is deduced in Table 12, Table 13 and Table 14.

5. Conclusions

Accurate wind speed prediction is beneficial for the exploitation and utilization of wind power. This study develops a novel hybrid strategy based on three-phase signal decomposition (TPSD) technique, feature extraction (FE) and weighted regularized extreme learning machine (WRELM) for multi-step ahead wind speed prediction. Firstly, a TPSD framework including seasonal separation algorithm (SSA), fast ensemble empirical mode decomposition (FEEMD), and variational mode decomposition (VMD) is developed for the first time to comprehensively handle the complex and irregular nature of wind speed. In the first phase, the original wind speed signal can be separated into season and trend components by SSA. In the second phase, the trend component can be decomposed into a number of intrinsic mode functions (IMFs) and a residual with different frequencies. For reducing the non-stationarity of the high frequency signal, the highest frequency IMF1 can be further decomposed into several stationary modes in the third phase. Secondly, a feature extraction (FE) process including partial autocorrelation function (PACF) and regression analysis is proposed to capture the useful features of wind speed fluctuations and determine the optimal input features for a prediction model. Then, an improved extreme learning machine (ELM) named weighted regularized extreme learning machine (WRELM) is established using these selected features, and the prediction results of wind speed can be calculated by WRELM. Finally, four real wind speed prediction cases are used to evaluate the proposed model, experimental results show that: (1) both the TPSD technique and feature extraction can improve the prediction performance for wind speed; (2) the novel prediction framework which only establishes a prediction model using these selected features from all different subseries can increase the prediction accuracy; (3) the proposed model has the best prediction performance compared with the benchmark models.

Acknowledgments

This research was supported by the National Natural Science Foundation of China (Grant No. 71501101), the Natural Science Foundation of Jiangsu Province (Grant No. BK20150928 and BK20160974), the Project of Philosophy and Social Science Research in Colleges and Universities in Jiangsu Province (Grant No. 2015SJB063), the Qing Lan Project, the National Natural Science Foundation of China (Grant Nos. 11626132, 91546117, and 61502242), the National Social Science foundation of China (Grant Nos. 16ZDA047 and 15CJL017), the Startup Foundation for Introducing Talent of NUIST (S8113097001), the Project Funded by the Flagship Major Development of Jiangsu Higher Education Institutions, the Project Funded by the Priority Academic Program Development of Jiangsu Higher Education Institutions, and the Top-notch Academic Programs Project of Jiangsu Higher Education Institutions.

Author Contributions

Jujie Wang and Yanfeng Wang conceived and designed the experiments; Yaning Li performed the experiments; Jujie Wang analyzed the data; Yaning Li contributed reagents/materials/analysis tools; Yanfeng Wang wrote the paper.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

SSASeasonal Separation Algorithm
FEEMDFast Ensemble Empirical Mode Decomposition
VMDVariational Mode Decomposition
DPADecomposition Prediction Aggregation
TPSDThree-Phase Signal Decomposition
FEMFeature Extraction Method
PACFPartial Autocorrelation Function
BPBack Propagation Neural Network
ELMExtreme Learning Machine
WRELMWeighted Regularized Extreme Learning Machine
DPA-SFVBThe Common Decomposition Prediction Aggregation-based Hybrid Model of Seasonal Separation Algorithm, Fast Ensemble Empirical Mode Decomposition, Variational Mode Decomposition and Back Propagation Neural Network
DPA-SFVEThe Common Decomposition Prediction Aggregation-based Hybrid Model of Seasonal Separation Algorithm, Fast Ensemble Empirical Mode Decomposition, Variational Mode Decomposition and Extreme Learning Machine
DPA-SFVWThe Common Decomposition Prediction Aggregation-based Hybrid Model of Seasonal Separation Algorithm, Fast Ensemble Empirical Mode Decomposition, Variational Mode Decomposition and Weighted Regularized Extreme Learning Machine
FEM-SBThe Feature Extraction Method-based Hybrid Model of Seasonal Separation Algorithm and Back Propagation Neural Network
FEM-FBThe Feature Extraction Method-based Hybrid Model of Fast Ensemble Empirical Mode Decomposition and Back Propagation Neural Network
FEM-VBThe Feature Extraction Method-based Hybrid Model of Variational Mode Decomposition and Back Propagation Neural Network
FEM-SFBThe Feature Extraction Method-based Hybrid Model of Seasonal Separation Algorithm, Fast Ensemble Empirical Mode Decomposition and Back Propagation Neural Network
FEM-SVBThe Feature Extraction Method-based Hybrid Model of Seasonal Separation Algorithm, Variational Mode Decomposition and Back Propagation Neural Network
FEM-FVBThe Feature Extraction Method-based Hybrid Model of Fast Ensemble Empirical Mode Decomposition, Variational Mode Decomposition and Back Propagation Neural Network
FEM-SFVBThe Feature Extraction Method-based Hybrid Model of Seasonal Separation Algorithm, Fast Ensemble Empirical Mode Decomposition, Variational Mode Decomposition and Back Propagation Neural Network
FEM-SEThe Feature Extraction Method-based Hybrid Model of Seasonal Separation Algorithm and Extreme Learning Machine
FEM-FEThe Feature Extraction Method-based Hybrid Model of Fast Ensemble Empirical Mode Decomposition and Extreme Learning Machine
FEM-VEThe Feature Extraction Method-based Hybrid Model of Variational Mode Decomposition and Extreme Learning Machine
FEM-SFEThe Feature Extraction Method-based Hybrid Model of Seasonal Separation Algorithm, Fast Ensemble Empirical Mode Decomposition and Extreme Learning Machine
FEM-SVEThe Feature Extraction Method-based Hybrid Model of Seasonal Separation Algorithm, Variational Mode Decomposition and Extreme Learning Machine
FEM-FVEThe Feature Extraction Method-based Hybrid Model of Fast Ensemble Empirical Mode Decomposition, Variational Mode Decomposition and Extreme Learning Machine
FEM-SFVEThe Feature Extraction Method-based Hybrid Model of Seasonal Separation Algorithm, Fast Ensemble Empirical Mode Decomposition, Variational Mode Decomposition and Extreme Learning Machine
FEM-SWThe Feature Extraction Method-based Hybrid Model of Seasonal Separation Algorithm and Weighted Regularized Extreme Learning Machine
FEM-FWThe Feature Extraction Method-based Hybrid Model of Fast Ensemble Empirical Mode Decomposition and Weighted Regularized Extreme Learning Machine
FEM-VWThe Feature Extraction Method-based Hybrid Model of Variational Mode Decomposition and Weighted Regularized Extreme Learning Machine
FEM-SFWThe Feature Extraction Method-based Hybrid Model of Seasonal Separation Algorithm, Fast Ensemble Empirical Mode Decomposition and Weighted Regularized Extreme Learning Machine
FEM-SVWThe Feature Extraction Method-based Hybrid Model of Seasonal Separation Algorithm, Variational Mode Decomposition and Weighted Regularized Extreme Learning Machine
FEM-FVWThe Feature Extraction Method-based Hybrid Model of Fast Ensemble Empirical Mode Decomposition, Variational Mode Decomposition and Weighted Regularized Extreme Learning Machine
FEM-SFVWThe Feature Extraction Method-based Hybrid Model of Seasonal Separation Algorithm, Fast Ensemble Empirical Mode Decomposition, Variational Mode Decomposition and Weighted Regularized Extreme Learning Machine
MAEMean Absolute Error
RMSERoot Mean Square Error
MAPEMean Absolute Percentage Error

References

  1. Ma, X.J.; Jin, Y.; Dong, Q.L. A generalized dynamic fuzzy neural network based on singular spectrum analysis optimized by brain storm optimization for short-term wind speed forecasting. Appl. Soft Comput. 2017, 54, 296–312. [Google Scholar] [CrossRef]
  2. Chang, G.W.; Lu, H.J.; Chang, Y.R.; Lee, Y.D. An improved neural network-based approach for short-term wind speed and power forecast. Renew. Energy 2017, 105, 301–311. [Google Scholar] [CrossRef]
  3. Calif, R.; Schmitt, F.G.; Huang, Y. The multifractal description of wind power fluctuations using arbitrary order Hilbert spectral analysis. Physica A 2013, 392, 4106–4120. [Google Scholar] [CrossRef]
  4. Calif, R.; Schmitt, F.G. Modeling of atmospheric wind speed sequence using a lognormal stochastic equation. J. Wind Eng. Ind. Aerodyn. 2012, 109, 1–8. [Google Scholar] [CrossRef]
  5. Calif, R.; Schmitt, F.G. Multiscaling and joint multiscaling description of the atmospheric wind speed and the aggregate power output from a wind farm. Nonlinear Processes Geophys. 2014, 21, 379–392. [Google Scholar] [CrossRef] [Green Version]
  6. Liu, J.Q.; Wang, X.R.; Lu, Y. A novel hybrid methodology for short-term wind power forecasting based on adaptive neuro-fuzzy inference system. Renew. Energy 2017, 103, 620–629. [Google Scholar] [CrossRef]
  7. Wang, C.; Zhang, H.L.; Fan, W.H.; Fan, X.C. A new wind power prediction method based on chaotic theory and Bernstein Neural Network. Energy 2016, 117, 259–271. [Google Scholar] [CrossRef]
  8. Weron, R. Electricity price forecasting: A review of the state-of-the-art with a look into the future. Int. J. Forecast. 2014, 30, 1030–1081. [Google Scholar] [CrossRef]
  9. Jung, J.; Broadwater, R.P. Current status and future advances for wind speed and power forecasting. Renew. Sustain. Energy Rev. 2014, 31, 762–777. [Google Scholar] [CrossRef]
  10. Cassola, F.; Burlando, M. Wind speed and wind energy forecast through Kalman filtering of numerical weather prediction model output. Appl. Energy 2012, 99, 154–166. [Google Scholar] [CrossRef]
  11. Wu, Q.L.; Peng, C.Y. A Least Squares Support Vector Machine Optimized by Cloud-Based Evolutionary Algorithm for Wind Power Generation Prediction. Energies 2016, 9, 585. [Google Scholar] [CrossRef]
  12. Hu, Q.; Su, P.; Yu, D.; Liu, J. Pattern-based wind speed prediction based on generalized principal component analysis. IEEE Trans. Sustain. Energy 2014, 5, 866–874. [Google Scholar] [CrossRef]
  13. Erdem, E.; Shi, J. ARMA based approaches for forecasting the tuple of wind speed and direction. Appl. Energy 2011, 88, 1405–1414. [Google Scholar] [CrossRef]
  14. Bivona, S.; Bonanno, G.; Burlon, R.; Gurrera, D.; Leone, C. Stochastic models for wind speed forecasting. Energy Convers. Manag. 2011, 52, 1157–1165. [Google Scholar] [CrossRef]
  15. Shamshad, A.; Bawadi, M.A.; Hussin, W.M.A.W.; Majid, T.A.; Sanusi, S.A.M. First and second order Markov chain models for synthetic generation of wind speed time series. Energy 2005, 30, 693–708. [Google Scholar] [CrossRef]
  16. Torres, J.L.; Garcia, A.; De Blas, M.; De Francisco, A. Forecast of hourly average wind speed with Arma models in Navarre (Spain). Sol. Energy 2005, 79, 65–77. [Google Scholar] [CrossRef]
  17. Louka, P.; Galanis, G.; Siebert, N.; Kariniotakis, G.; Katsafados, P.; Pytharoulis, I.; Kallos, G. Improvements in wind speed forecasts for wind power prediction purposes using Kalman filtering. J. Wind Eng. Ind. Aerodyn. 2008, 96, 2348–2362. [Google Scholar] [CrossRef] [Green Version]
  18. Yu, J.; Chen, K.; Mori, J.; Rashid, M.M. A Gaussian mixture copula model based localized Gaussian process regression approach for long-term wind speed prediction. Energy 2013, 61, 673–686. [Google Scholar] [CrossRef]
  19. Guo, Z.H.; Zhao, J.; Zhang, W.Y.; Wang, J.Z. A corrected hybrid approach for wind speed prediction in Hexi Corridor of China. Energy 2011, 36, 1668–1679. [Google Scholar] [CrossRef]
  20. Liu, H.; Shi, J.; Erdem, E. Prediction of wind speed time series using modified Taylor Kriging method. Energy 2010, 35, 4870–4879. [Google Scholar] [CrossRef]
  21. Wang, J.Z.; Qin, S.S.; Zhou, Q.P.; Jiang, H.Y. Medium-term wind speeds forecasting utilizing hybrid models for three different sites in Xinjiang, China. Renew. Energy 2015, 76, 91–101. [Google Scholar] [CrossRef]
  22. Velo, R.; López, P.; Maseda, F. Wind speed estimation using multilayer perceptron. Energy Convers. Manag. 2014, 81, 1–9. [Google Scholar] [CrossRef]
  23. Shamshirband, S.; Petkovic, D.; Amini, A.; Anuar, N.B.; Nikolic, V.; Cojbasic, Z.; Kiah, L.M.; Gani, A. Support vector regression methodology for wind turbine reaction torque prediction with power-split hydrostatic continuous variable transmission. Energy 2014, 67, 623–630. [Google Scholar] [CrossRef]
  24. Li, G.; Shi, J. On comparing three artificial neural networks for wind speed forecasting. Appl. Energy 2010, 87, 2313–2320. [Google Scholar] [CrossRef]
  25. Zhou, J.; Shi, J.; Li, G. Fine tuning support vector machines for short-term wind speed forecasting. Energy Convers. Manag. 2011, 52, 1990–1998. [Google Scholar] [CrossRef]
  26. Cincotti, S.; Gallo, G.; Ponta, L.; Raberto, M. Modelling and forecasting of electricity spot-prices: Computational intelligence vs classical econometrics. AI Commun. 2014, 27, 301–314. [Google Scholar]
  27. Shi, J.; Guo, J.M.; Zheng, S.Y. Evaluation of hybrid forecasting approaches for wind speed and power generation time series. Renew. Sustain. Energy Rev. 2012, 16, 3471–3480. [Google Scholar] [CrossRef]
  28. Wang, J.Z.; Hu, J.M.; Ma, K.L.; Zhang, Y.X. A self-adaptive hybrid approach for wind speed forecasting. Renew. Energy 2015, 78, 374–385. [Google Scholar] [CrossRef]
  29. Khashei, M.; Bijari, M.; Ardali, G.A.R. Improvement of auto-regressive integrated moving average models using fuzzy logic and artificial neural networks (ANNs). Neurocomputing 2009, 72, 956–967. [Google Scholar] [CrossRef]
  30. Kani, S.P.; Ardehali, M. Very short-term wind speed prediction: A new artificial neural network-Markov chain model. Energy Convers. Manag. 2011, 52, 738–745. [Google Scholar] [CrossRef]
  31. De Giorgi, M.G.; Congedo, P.M.; Malvoni, M.; Laforgia, D. Error analysis of hybrid photovoltaic power forecasting models: A case study of Mediterranean climate. Energy Convers. Manag. 2015, 100, 117–130. [Google Scholar] [CrossRef]
  32. Ren, Y.; Suganthan, P.; Srikanth, N. A comparative study of empirical mode decomposition-based short-term wind speed forecasting methods. IEEE Trans. Sustain. Energy 2015, 6, 236–244. [Google Scholar] [CrossRef]
  33. Liu, H.; Chen, C.; Tian, H.Q.; Li, Y.F. A hybrid model for wind speed prediction using empirical mode decomposition and artificial neural networks. Renew. Energy 2012, 48, 545–556. [Google Scholar] [CrossRef]
  34. Zhang, G.P.; Qi, M. Neural network forecasting for seasonal and trend time series. Eur. J. Oper. Res. 2005, 160, 501–514. [Google Scholar] [CrossRef]
  35. Guo, Z.H.; Wu, J.; Lu, H.Y.; Wang, J.Z. A case study on a hybrid wind speed forecasting method using BP neural network. Knowl. Based Syst. 2011, 24, 1048–1056. [Google Scholar] [CrossRef]
  36. Wu, Z.; Huang, N.E. Ensemble empirical mode decomposition: A noise assisted data analysis method. Adv. Adapt. Data Anal. 2008, 1, 1–41. [Google Scholar] [CrossRef]
  37. Wang, Y.H.; Yeh, C.H.; Young, H.W.V.; Hu, K.; Lo, M.T. On the computational complexity of the empirical mode decomposition algorithm. Phys. A Stat. Mech. Appl. 2014, 400, 159–167. [Google Scholar] [CrossRef]
  38. Liu, H.; Tian, H.Q.; Li, Y.F. Comparison of new hybrid FEEMD-MLP, FEEMD-ANFIS, wavelet packet-MLP and wavelet packet-ANFIS for wind speed predictions. Energy Convers. Manag. 2005, 89, 1–11. [Google Scholar] [CrossRef]
  39. Dragomiretskiy, K.; Zosso, D. Variational mode decomposition. IEEE Trans. Signal Process. 2014, 62, 531–544. [Google Scholar] [CrossRef]
  40. Abdoos, A.A. A new intelligent method based on combination of VMD and ELM for short term wind power forecasting. Neurocomputing 2016, 203, 111–120. [Google Scholar] [CrossRef]
  41. Wang, H.; Zhao, W. ARIMA model estimated by Particle Swarm optimization algorithm for Consumer price index forecasting, Lecture notes in computer Science. Artif. Intell. Comput. Intell. 2009, 5855, 48–58. [Google Scholar]
  42. Guo, Z.H.; Zhao, W.G.; Lu, H.Y.; Wang, J.Z. Multi-step forecasting for wind speed using a modified EMD-based artificial neural network model. Renew. Energy 2012, 37, 241–249. [Google Scholar] [CrossRef]
  43. Huang, G.B.; Zhu, Q.Y.; Siew, C.K. Extreme learning machine: Theory and applications. Neurocomputing 2006, 70, 489–501. [Google Scholar] [CrossRef]
  44. Huang, G.B.; Zhou, H.; Ding, X.; Zhang, R. Extreme learning machine for regression and multiclass classification. IEEE Trans. Syst. Man Cybern. Part B 2012, 42, 513–529. [Google Scholar] [CrossRef] [PubMed]
  45. Liu, H.; Tian, H.Q.; Li, Y.F. Four wind speed multi-step forecasting models using extreme learning machines and signal decomposing algorithms. Energy Convers. Manag. 2015, 100, 16–22. [Google Scholar] [CrossRef]
  46. Martínez-Martínez, J.M.; Escandell-Montero, P.; Soria-Olivas, E.; Martín-Guerrero, J.D.; Magdalena-Benedito, R.; Gómez-Sanchis, J. Regularized extreme learning machine for regression problems. Neurocomputing 2011, 74, 3716–3721. [Google Scholar] [CrossRef]
  47. Zhang, K.; Luo, M. Outlier-robust extreme learning machine for regression problems. Neurocomputing 2015, 151, 1519–1527. [Google Scholar] [CrossRef]
Figure 1. A standard structure of ELM.
Figure 1. A standard structure of ELM.
Energies 11 00321 g001
Figure 2. The framework of the proposed approach.
Figure 2. The framework of the proposed approach.
Energies 11 00321 g002
Figure 3. Four original wind speed cases.
Figure 3. Four original wind speed cases.
Energies 11 00321 g003
Figure 4. De-seasonalization process of original wind speed data using SSA in four cases.
Figure 4. De-seasonalization process of original wind speed data using SSA in four cases.
Energies 11 00321 g004
Figure 5. The decomposed results of trend components using FEEMD in four cases.
Figure 5. The decomposed results of trend components using FEEMD in four cases.
Energies 11 00321 g005
Figure 6. The decomposed results of IMF1 using VMD in four cases.
Figure 6. The decomposed results of IMF1 using VMD in four cases.
Energies 11 00321 g006
Figure 7. Plots of PACF against the lag length in four trend components.
Figure 7. Plots of PACF against the lag length in four trend components.
Energies 11 00321 g007
Figure 8. Validation errors of feature selection in the four cases.
Figure 8. Validation errors of feature selection in the four cases.
Energies 11 00321 g008
Figure 9. Multi-step ahead prediction results of trend component in four cases.
Figure 9. Multi-step ahead prediction results of trend component in four cases.
Energies 11 00321 g009
Figure 10. Multi-step ahead prediction results of original wind speed in four cases.
Figure 10. Multi-step ahead prediction results of original wind speed in four cases.
Energies 11 00321 g010
Figure 11. Performance comparison of different models in terms of MAE, RMSE and MAPE in spring.
Figure 11. Performance comparison of different models in terms of MAE, RMSE and MAPE in spring.
Energies 11 00321 g011
Figure 12. Performance comparison of different models in terms of MAE, RMSE and MAPE in summer.
Figure 12. Performance comparison of different models in terms of MAE, RMSE and MAPE in summer.
Energies 11 00321 g012
Figure 13. Performance comparison of different models in terms of MAE, RMSE and MAPE in fall.
Figure 13. Performance comparison of different models in terms of MAE, RMSE and MAPE in fall.
Energies 11 00321 g013
Figure 14. Performance comparison of different models in terms of MAE, RMSE and MAPE in winter.
Figure 14. Performance comparison of different models in terms of MAE, RMSE and MAPE in winter.
Energies 11 00321 g014
Table 1. Statistical measures of four cases.
Table 1. Statistical measures of four cases.
CasesMean (m/s)Std.dev (m/s)Maximum (m/s)Median (m/s)Minimum (m/s)
Spring4.242.3913.403.750.50
Summer2.201.5510.801.800.10
Fall2.231.478.601.800.10
Winter3.131.839.702.900.10
Table 2. Seasonal indices of the original wind speed data in the four cases.
Table 2. Seasonal indices of the original wind speed data in the four cases.
TimesDatasetsTimesDatasets
SpringSummerFallWinterSpringSummerFallWinter
11.020.860.840.93130.900.880.810.74
20.961.030.900.84140.970.970.980.80
30.900.920.880.89151.141.121.171.19
40.850.880.830.95161.131.281.371.29
50.820.840.810.86171.171.411.461.34
60.850.710.770.85181.221.451.561.37
70.800.750.740.88191.221.411.601.46
80.870.760.720.80201.241.381.471.42
90.860.720.820.76211.221.181.381.41
100.830.730.690.68221.201.171.241.23
110.850.690.710.73231.091.110.840.95
120.900.620.780.69240.981.130.640.94
Table 3. The input nodes number of the trend component for the prediction models in four cases.
Table 3. The input nodes number of the trend component for the prediction models in four cases.
CasesInitial Features
SpringTC(t), TC(t − 1)
SummerTC(t), TC(t − 1), TC(t − 2)
FallTC(t), TC(t − 1), TC(t − 2)
WinterTC(t), TC(t − 1)
Table 4. The initial features of training samples in four cases.
Table 4. The initial features of training samples in four cases.
CasesInitial Features
SpringIMF2(t), IMF3(t), IMF4(t), IMF5(t), IMF6(t), IMF7(t), IMF8(t), Residue(t), Mode1(t), Mode2(t), Mode3(t), IMF2(t − 1), IMF3(t − 1), IMF4(t − 1), IMF5(t − 1), IMF6(t − 1), IMF7(t − 1), IMF8(t − 1), Residue(t − 1), Mode1(t − 1), Mode2(t − 1), Mode3(t − 1)
SummerIMF2(t), IMF3(t), IMF4(t), IMF5(t), IMF6(t), IMF7(t), IMF8(t), Residue(t), Mode1(t), Mode2(t), Mode3(t), IMF2(t − 1), IMF3(t − 1), IMF4(t − 1), IMF5(t − 1), IMF6(t − 1), IMF7(t − 1), IMF8(t − 1), Residue(t − 1), Mode1(t − 1), Mode2(t − 1), Mode3(t − 1), IMF2(t − 2), IMF3(t − 2), IMF4(t − 2), IMF5(t − 2), IMF6(t − 2), IMF7(t − 2), IMF8(t − 2), Residue(t − 2), Mode1(t − 2), Mode2(t − 2), Mode3(t − 2)
FallIMF2(t), IMF3(t), IMF4(t), IMF5(t), IMF6(t), IMF7(t), IMF8(t), Residue(t), Mode1(t), Mode2(t), Mode3(t), IMF2(t − 1), IMF3(t − 1), IMF4(t − 1), IMF5(t − 1), IMF6(t − 1), IMF7(t − 1), IMF8(t − 1), Residue(t − 1), Mode1(t − 1), Mode2(t − 1), Mode3(t − 1), IMF2(t − 2), IMF3(t − 2), IMF4(t − 2), IMF5(t − 2), IMF6(t − 2), IMF7(t − 2), IMF8(t − 2), Residue(t − 2), Mode1(t − 2), Mode2(t − 2), Mode3(t − 2)
WinterIMF2(t), IMF3(t), IMF4(t), IMF5(t), IMF6(t), IMF7(t), IMF8(t), Residue(t), Mode1(t), Mode2(t), Mode3(t), IMF2(t − 1), IMF3(t − 1), IMF4(t − 1), IMF5(t − 1), IMF6(t − 1), IMF7(t − 1), IMF8(t − 1), Residue(t − 1), Mode1(t − 1), Mode2(t − 1), Mode3(t − 1)
Table 5. The optimal feature combinations of training samples in four cases.
Table 5. The optimal feature combinations of training samples in four cases.
CasesOptimal Features
SpringIMF2(t), IMF3(t), IMF4(t), IMF5(t), IMF6(t), IMF7(t), IMF8(t), Residue(t), Mode1(t), Mode2(t), Mode3(t), IMF2(t − 1) , IMF3(t − 1), IMF4(t − 1)
SummerIMF2(t), IMF3(t), IMF4(t), IMF5(t), IMF6(t), IMF7(t), IMF8(t), Residue(t), Mode1(t), Mode2(t), Mode3(t), IMF2(t − 1), IMF3(t − 1), IMF4(t − 1), IMF5(t − 1), IMF6(t − 1), IMF7(t − 1), IMF8(t − 1), Residue(t − 1)
FallIMF2(t), IMF3(t), IMF4(t), IMF5(t), IMF6(t), IMF7(t), IMF8(t), Residue(t), Mode1(t), Mode2(t), Mode3(t), IMF2(t − 1), IMF3(t − 1), IMF4(t − 1), IMF5(t − 1), IMF6(t − 1), IMF7(t − 1)
WinterIMF2(t), IMF3(t), IMF4(t), IMF5(t), IMF6(t), IMF7(t), IMF8(t), Residue(t), Mode1(t), Mode2(t), Mode3(t), IMF2(t − 1), IMF3(t − 1), IMF4(t − 1), IMF5(t − 1), IMF6(t − 1)
Table 6. Comparison of the prediction performances of different models in spring.
Table 6. Comparison of the prediction performances of different models in spring.
CategoriesModelsSpring
One-Step AheadTwo-Step AheadThree-Step Ahead
MAERMSEMAPEMAERMSEMAPEMAERMSEMAPE
SingleBP1.042.230.411.262.780.541.732.930.68
ELM1.021.990.391.222.610.521.632.820.65
WRELM1.011.910.371.142.480.491.582.530.63
DPADPA-SFVB0.770.820.310.890.930.380.940.990.52
DPA-SFVE0.720.690.290.780.810.320.860.910.42
DPA-SFVW0.630.480.200.710.580.250.770.780.29
FEMFEM-SB0.951.820.351.062.140.481.472.610.61
FEM-FB0.891.740.380.981.970.501.252.030.62
FEM-VB0.931.690.360.991.850.481.321.960.60
FEM-SFB0.791.090.290.851.240.410.991.350.54
FEM-SVB0.760.990.300.811.070.420.891.180.53
FEM-FVB0.710.830.270.730.870.390.790.920.51
FEM-SFVB0.590.520.250.680.760.310.710.850.41
FEM-SE0.911.570.331.011.980.481.392.070.60
FEM-FE0.871.450.370.961.790.471.211.880.59
FEM-VE0.891.510.350.971.820.451.141.910.57
FEM-SFE0.751.030.280.791.190.400.941.230.53
FEM-SVE0.720.950.290.751.030.410.841.090.52
FEM-FVE0.670.780.250.700.810.360.720.880.49
FEM-SFVE0.540.490.220.610.580.270.650.710.36
FEM-SW0.821.230.290.941.820.461.231.960.58
FEM-FW0.801.160.330.911.680.441.181.770.57
FEM-VW0.811.210.310.881.540.451.021.630.56
FEM-SFW0.710.970.270.771.080.390.891.170.52
FEM-SVW0.680.890.280.730.960.390.791.010.51
FEM-FVW0.550.580.210.630.690.330.680.730.49
FEM-SFVW0.320.200.100.430.330.130.500.580.14
Table 7. Comparison of prediction performances of different models in summer.
Table 7. Comparison of prediction performances of different models in summer.
CategoriesModelsSummer
One-Step AheadTwo-Step AheadThree-Step Ahead
MAERMSEMAPEMAERMSEMAPEMAERMSEMAPE
SingleBP0.941.120.731.241.790.861.792.751.03
ELM0.891.080.691.181.640.781.522.180.91
WRELM0.850.990.581.051.370.711.351.870.86
DPADPA-SFVB0.820.950.450.850.990.530.981.120.65
DPA-SFVE0.790.910.430.820.950.490.860.970.62
DPA-SFVW0.640.580.290.790.890.470.830.940.56
FEMFEM-SB0.860.950.611.151.290.751.551.730.89
FEM-FB0.840.970.571.091.340.641.431.810.78
FEM-VB0.850.940.550.971.310.661.271.710.69
FEM-SFB0.740.890.490.820.950.511.031.130.59
FEM-SVB0.780.890.500.850.960.531.091.040.55
FEM-FVB0.760.910.450.810.950.480.990.960.56
FEM-SFVB0.700.780.400.780.900.460.920.950.53
FEM-SE0.830.890.571.071.160.681.411.580.77
FEM-FE0.800.940.510.991.270.611.361.480.69
FEM-VE0.790.890.530.941.290.621.161.370.65
FEM-SFE0.710.790.450.800.870.470.991.020.55
FEM-SVE0.760.810.470.820.840.490.930.980.56
FEM-FVE0.710.820.390.780.850.450.810.890.53
FEM-SFVE0.660.740.330.720.820.440.750.850.51
FEM-SW0.810.850.550.981.020.631.271.490.71
FEM-FW0.780.910.490.951.180.581.261.320.65
FEM-VW0.750.880.510.891.080.561.091.210.63
FEM-SFW0.680.770.430.780.820.460.940.960.51
FEM-SVW0.720.700.450.770.790.470.870.940.52
FEM-FVW0.680.750.360.710.800.440.760.840.50
FEM-SFVW0.320.170.190.640.690.420.680.820.49
Table 8. Comparison of prediction performances of different models in fall.
Table 8. Comparison of prediction performances of different models in fall.
CategoriesModelsFall
One-Step AheadTwo-Step AheadThree-Step Ahead
MAERMSEMAPEMAERMSEMAPEMAERMSEMAPE
SingleBP1.020.990.621.281.060.741.951.410.98
ELM0.970.950.591.161.020.691.741.180.92
WRELM0.940.890.561.020.920.661.571.050.88
DPADPA-SFVB0.720.690.450.850.890.470.870.930.55
DPA-SFVE0.650.470.360.720.760.440.780.850.51
DPA-SFVW0.530.480.230.620.670.420.670.730.48
FEMFEM-SB0.950.920.551.080.960.671.581.210.83
FEM-FB0.920.890.530.970.920.641.291.130.76
FEM-VB0.880.930.520.920.980.610.971.050.73
FEM-SFB0.780.740.450.820.790.530.840.910.61
FEM-SVB0.800.750.420.840.810.500.860.870.58
FEM-FVB0.780.690.400.800.760.450.810.830.55
FEM-SFVB0.570.520.320.710.680.410.760.790.50
FEM-SE0.910.880.530.990.900.651.371.020.79
FEM-FE0.890.840.500.940.860.611.161.050.71
FEM-VE0.850.870.490.880.950.570.920.970.66
FEM-SFE0.750.700.430.780.760.500.810.850.58
FEM-SVE0.780.730.410.810.780.470.810.830.53
FEM-FVE0.720.680.360.780.730.420.790.780.51
FEM-SFVE0.420.350.290.590.620.390.610.720.45
FEM-SW0.890.850.490.960.890.631.260.950.75
FEM-FW0.860.790.470.910.820.581.010.970.67
FEM-VW0.830.840.480.850.910.550.890.930.63
FEM-SFW0.720.690.410.740.710.470.770.810.57
FEM-SVW0.710.680.370.750.720.420.790.790.51
FEM-FVW0.660.630.320.710.680.370.740.720.45
FEM-SFVW0.170.050.180.360.220.330.360.240.35
Table 9. Comparison of prediction performances of different models in winter.
Table 9. Comparison of prediction performances of different models in winter.
CategoriesModelsWinter
One-Step AheadTwo-Step AheadThree-Step Ahead
MAERMSEMAPEMAERMSEMAPEMAERMSEMAPE
SingleBP0.950.970.551.051.020.692.162.050.92
ELM0.910.930.521.010.990.671.751.860.82
WRELM0.890.870.490.980.940.611.371.640.76
DPADPA-SFVB0.680.730.380.840.880.450.920.970.51
DPA-SFVE0.570.640.350.740.790.380.830.870.41
DPA-SFVW0.420.560.270.650.620.330.740.810.38
FEMFEM-SB0.820.810.500.960.940.631.211.390.71
FEM-FB0.850.780.480.980.900.591.171.260.66
FEM-VB0.830.790.470.930.860.581.041.100.67
FEM-SFB0.750.700.410.850.800.490.920.940.56
FEM-SVB0.770.680.380.820.770.450.860.960.53
FEM-FVB0.700.650.350.780.720.410.820.840.47
FEM-SFVB0.540.610.320.720.660.390.780.820.42
FEM-SE0.780.790.480.920.890.591.081.180.67
FEM-FE0.820.750.460.950.860.541.051.140.63
FEM-VE0.800.770.450.900.840.560.971.020.63
FEM-SFE0.730.680.390.810.780.460.890.910.54
FEM-SVE0.740.640.350.750.730.420.800.870.48
FEM-FVE0.660.590.320.710.670.380.770.790.44
FEM-SFVE0.370.310.280.670.610.340.710.690.40
FEM-SW0.750.770.460.870.840.560.981.070.62
FEM-FW0.790.720.450.920.830.520.971.080.61
FEM-VW0.760.750.430.880.820.510.940.970.59
FEM-SFW0.710.650.350.760.720.430.830.800.49
FEM-SVW0.700.590.310.720.680.360.770.780.41
FEM-FVW0.630.550.290.650.630.340.710.690.42
FEM-SFVW0.280.120.140.560.540.290.600.650.29
Table 10. Comparison results of experiment I and experiment II in four cases.
Table 10. Comparison results of experiment I and experiment II in four cases.
CasesPrediction HorizonErrorsThe Proportion of Reduction
FEM-SFVB vs. DPA-SFVBFEM-SFVE vs. DPA-SFVEFEM-SFVW vs. DPA-SFVWWRELM vs. BPWRELM vs. ELMELM vs. BP
SpringOne-step aheadMAE (%)23.3825.0049.212.880.981.92
RMSE (%)36.5928.9958.3314.354.0210.76
MAPE (%)19.3524.1450.009.765.134.88
Two-step aheadMAE (%)23.6021.7939.449.526.563.17
RMSE (%)18.2828.4043.1010.794.986.12
MAPE (%)18.4215.6348.009.265.773.70
Three-step aheadMAE (%)24.4724.4235.068.673.075.78
RMSE (%)14.1421.9825.6413.6510.283.75
MAPE (%)21.1514.2951.727.353.084.41
SummerOne-step aheadMAE (%)14.6316.4650.009.574.495.32
RMSE (%)17.8918.6870.6911.618.333.57
MAPE (%)11.1123.2634.4820.5515.945.48
Two-step aheadMAE (%)8.2412.2018.9915.3211.024.84
RMSE (%)9.0913.6822.4723.4616.468.38
MAPE (%)13.2110.2010.6417.448.979.30
Three-step aheadMAE (%)6.1212.7918.0724.5811.1815.08
RMSE (%)15.1812.3712.7732.0014.2220.73
MAPE (%)18.4617.7412.5016.505.4911.65
FallOne-step aheadMAE (%)20.8335.3867.927.843.094.90
RMSE (%)24.6425.5389.5810.106.324.04
MAPE (%)28.8919.4421.749.685.084.84
Two-step aheadMAE (%)16.4718.0641.9420.3112.079.38
RMSE (%)23.6018.4267.1613.219.803.77
MAPE (%)12.7711.3621.4310.814.356.76
Three-step aheadMAE (%)12.6421.7946.2719.499.7710.77
RMSE (%)15.0515.2967.1225.5311.0216.31
MAPE (%)9.0911.7627.0810.204.356.12
WinterOne-step aheadMAE (%)20.5935.0933.336.322.204.21
RMSE (%)16.4451.5678.5710.316.454.12
MAPE (%)15.7920.0048.1510.915.775.45
Two-step aheadMAE (%)14.299.4613.856.672.973.81
RMSE (%)25.0022.7812.907.845.052.94
MAPE (%)13.3310.5312.1211.598.962.90
Three-step aheadMAE (%)15.2214.4618.9236.5721.7118.98
RMSE (%)15.4620.6919.7520.0011.839.27
MAPE (%)17.652.4423.6817.397.3210.87
Table 11. Comparison results of experiments III, IV and V in spring.
Table 11. Comparison results of experiments III, IV and V in spring.
Comparison of ModelsSpring
One-Step AheadTwo-Step AheadThree-Step Ahead
MAE (%)RMSE (%)MAPE (%)MAE (%)RMSE (%)MAPE (%)MAE (%)RMSE (%)MAPE (%)
FEM-SFVB vs. FEM-SFB25.3252.2913.7920.0038.7124.3928.2837.0424.07
FEM-SFVB vs. FEM-SVB22.3747.4716.6716.0528.9726.1920.2227.9722.64
FEM-SFVB vs. FEM-FVB16.9037.357.416.8512.6420.5110.137.6119.61
FEM-SFVE vs. FEM-SFE28.0052.4321.4322.7851.2632.5030.8542.2832.08
FEM-SFVE vs. FEM-SVE25.0048.4224.1418.6743.6934.1522.6234.8630.77
FEM-SFVE vs. FEM-FVE19.4037.1812.0012.8628.4025.009.7219.3226.53
FEM-SFVW vs. FEM-SFW54.9379.3862.9644.1669.4466.6743.8250.4373.08
FEM-SFVW vs. FEM-SVW52.9477.5364.2941.1065.6366.6736.7142.5772.55
FEM-SFVW vs. FEM-FVW41.8265.5252.3831.7552.1760.6126.4720.5571.43
FEM-SFB vs. FEM-SB16.8440.1117.1419.8142.0614.5832.6548.2811.48
FEM-SFB vs. FEM-FB11.2437.3623.6813.2737.0618.0020.8033.5012.90
FEM-SVB vs. FEM-SB20.0045.6014.2923.5850.0012.5039.4654.7913.11
FEM-SVB vs. FEM-VB18.2841.4216.6718.1842.1612.5032.5839.8011.67
FEM-FVB vs. FEM-FB20.2252.3028.9525.5155.8422.0036.8054.6817.74
FEM-FVB vs. FEM-VB23.6650.8925.0026.2652.9718.7540.1553.0615.00
FEM-SFE vs. FEM-SE17.5834.3915.1521.7839.9016.6732.3740.5811.67
FEM-SFE vs. FEM-FE13.7928.9724.3217.7133.5214.8922.3134.5710.17
FEM-SVE vs. FEM-SE20.8839.4912.1225.7447.9814.5839.5747.3413.33
FEM-SVE vs. FEM-VE19.1037.0917.1422.6843.418.8926.3242.938.77
FEM-FVE vs. FEM-FE22.9946.2132.4327.0854.7523.4040.5053.1916.95
FEM-FVE vs. FEM-VE24.7248.3428.5727.8455.4920.0036.8453.9314.04
FEM-SFW vs. FEM-SW13.4121.146.9018.0940.6615.2227.6440.3110.34
FEM-SFW vs. FEM-FW11.2516.3818.1815.3835.7111.3624.5833.908.77
FEM-SVW vs. FEM-SW17.0727.643.4522.3447.2515.2235.7748.4712.07
FEM-SVW vs. FEM-VW16.0526.459.6817.0537.6613.3322.5538.048.93
FEM-FVW vs. FEM-FW31.2550.0036.3630.7758.9325.0042.3758.7614.04
FEM-FVW vs. FEM-VW32.1052.0732.2628.4155.1926.6733.3355.2112.50
FEM-SB vs. BP8.6518.3914.6315.8723.0211.1115.0310.9210.29
FEM-FB vs. BP14.4221.977.3222.2229.147.4127.7530.728.82
FEM-VB vs. BP10.5824.2212.2021.4333.4511.1123.7033.1111.76
FEM-SE vs. ELM10.7821.1115.3817.2124.147.6914.7226.607.69
FEM-FE vs. ELM14.7127.145.1321.3131.429.6225.7733.339.23
FEM-VE vs. ELM12.7524.1210.2620.4930.2713.4630.0632.2712.31
FEM-SW vs. WRELM18.8135.6021.6217.5426.616.1222.1522.537.94
FEM-FW vs. WRELM20.7939.2710.8120.1832.2610.2025.3230.049.52
FEM-VW vs. WRELM19.8036.6516.2222.8137.908.1635.4435.5711.11
Table 12. Comparison results of experiments III, IV and V in summer.
Table 12. Comparison results of experiments III, IV and V in summer.
Comparison of ModelsSummer
One-Step AheadTwo-Step AheadThree-Step Ahead
MAE (%)RMSE (%)MAPE (%)MAE (%)RMSE (%)MAPE (%)MAE (%)RMSE (%)MAPE (%)
FEM-SFVB vs. FEM-SFB5.4112.3618.374.885.269.8010.6815.9310.17
FEM-SFVB vs. FEM-SVB10.2612.3620.008.246.2513.2115.608.653.64
FEM-SFVB vs. FEM-FVB7.8914.2911.113.705.264.177.071.045.36
FEM-SFVE vs. FEM-SFE7.046.3326.6710.005.756.3824.2416.677.27
FEM-SFVE vs. FEM-SVE13.168.6429.7912.202.3810.2019.3513.278.93
FEM-SFVE vs. FEM-FVE7.049.7615.387.693.532.227.414.493.77
FEM-SFVW vs. FEM-SFW52.9477.9255.8117.9515.858.7027.6614.583.92
FEM-SFVW vs. FEM-SVW55.5675.7157.7816.8812.6610.6421.8412.775.77
FEM-SFVW vs. FEM-FVW52.9477.3347.229.8613.754.5510.532.382.00
FEM-SFB vs. FEM-SB13.956.3219.6728.7026.3632.0033.5534.6833.71
FEM-SFB vs. FEM-FB11.908.2514.0424.7729.1020.3127.9737.5724.36
FEM-SVB vs. FEM-SB9.306.3218.0326.0925.5829.3329.6839.8838.20
FEM-SVB vs. FEM-VB8.245.329.0912.3726.7219.7014.1739.1820.29
FEM-FVB vs. FEM-FB9.526.1921.0525.6929.1025.0030.7746.9628.21
FEM-FVB vs. FEM-VB10.593.1918.1816.4927.4827.2722.0543.8618.84
FEM-SFE vs. FEM-SE14.4611.2421.0525.2325.0030.8829.7935.4428.57
FEM-SFE vs. FEM-FE11.2515.9611.7619.1931.5022.9527.2131.0820.29
FEM-SVE vs. FEM-SE8.438.9917.5423.3627.5927.9434.0437.9727.27
FEM-SVE vs. FEM-VE3.808.9911.3212.7734.8820.9719.8328.4713.85
FEM-FVE vs. FEM-FE11.2512.7723.5321.2133.0726.2340.4439.8623.19
FEM-FVE vs. FEM-VE10.137.8726.4217.0234.1127.4230.1735.0418.46
FEM-SFW vs. FEM-SW16.059.4121.8220.4119.6126.9825.9835.5728.17
FEM-SFW vs. FEM-FW12.8215.3812.2417.8930.5120.6925.4027.2721.54
FEM-SVW vs. FEM-SW11.1117.6518.1821.4322.5525.4031.5036.9126.76
FEM-SVW vs. FEM-VW4.0020.4511.7613.4826.8516.0720.1822.3117.46
FEM-FVW vs. FEM-FW12.8217.5826.5325.2632.2024.1439.6836.3623.08
FEM-FVW vs. FEM-VW9.3314.7729.4120.2225.9321.4330.2830.5820.63
FEM-SB vs. BP8.5115.1816.447.2627.9312.7913.4137.0913.59
FEM-FB vs. BP10.6413.3921.9212.1025.1425.5820.1134.1824.27
FEM-VB vs. BP9.5716.0724.6621.7726.8223.2629.0537.8233.01
FEM-SE vs. ELM6.7417.5917.399.3229.2712.827.2427.5215.38
FEM-FE vs. ELM10.1112.9626.0916.1022.5621.7910.5332.1124.18
FEM-VE vs. ELM11.2417.5923.1920.3421.3420.5123.6837.1628.57
FEM-SW vs. WRELM4.7114.145.176.6725.5511.275.9320.3217.44
FEM-FW vs. WRELM8.248.0815.529.5213.8718.316.6729.4124.42
FEM-VW vs. WRELM11.7611.1112.0715.2421.1721.1319.2635.2926.74
Table 13. Comparison results of experiments III, IV and V in fall.
Table 13. Comparison results of experiments III, IV and V in fall.
Comparison of ModelsFall
One-Step AheadTwo-Step AheadThree-Step Ahead
MAE (%)RMSE (%)MAPE (%)MAE (%)RMSE (%)MAPE (%)MAE (%)RMSE (%)MAPE (%)
FEM-SFVB vs. FEM-SFB26.9229.7328.8913.4113.9222.649.5213.1918.03
FEM-SFVB vs. FEM-SVB28.7530.6723.8115.4816.0518.0011.639.2013.79
FEM-SFVB vs. FEM-FVB26.9224.6420.0011.2510.538.896.174.829.09
FEM-SFVE vs. FEM-SFE44.0050.0032.5624.3618.4222.0024.6915.2922.41
FEM-SFVE vs. FEM-SVE46.1552.0529.2727.1620.5117.0224.6913.2515.09
FEM-SFVE vs. FEM-FVE41.6748.5319.4424.3615.077.1422.787.6911.76
FEM-SFVW vs. FEM-SFW76.3992.7556.1051.3569.0129.7953.2570.3738.60
FEM-SFVW vs. FEM-SVW76.0692.6551.3552.0069.4421.4354.4369.6231.37
FEM-SFVW vs. FEM-FVW74.2492.0643.7549.3067.6510.8151.3566.6722.22
FEM-SFB vs. FEM-SB17.8919.5718.1824.0717.7120.9046.8424.7926.51
FEM-SFB vs. FEM-FB15.2216.8515.0915.4614.1317.1934.8819.4719.74
FEM-SVB vs. FEM-SB15.7918.4823.6422.2215.6325.3745.5728.1030.12
FEM-SVB vs. FEM-VB9.0919.3519.238.7017.3518.0311.3417.1420.55
FEM-FVB vs. FEM-FB15.2222.4724.5317.5317.3929.6937.2126.5527.63
FEM-FVB vs. FEM-VB11.3625.8123.0813.0422.4526.2316.4920.9524.66
FEM-SFE vs. FEM-SE17.5820.4518.8721.2115.5623.0840.8816.6726.58
FEM-SFE vs. FEM-FE15.7316.6714.0017.0211.6318.0330.1719.0518.31
FEM-SVE vs. FEM-SE14.2917.0522.6418.1813.3327.6940.8818.6332.91
FEM-SVE vs. FEM-VE8.2416.0916.337.9517.8917.5411.9614.4319.70
FEM-FVE vs. FEM-FE19.1019.0528.0017.0215.1231.1531.9025.7128.17
FEM-FVE vs. FEM-VE15.2921.8426.5311.3623.1626.3214.1319.5922.73
FEM-SFW vs. FEM-SW19.1018.8216.3322.9220.2225.4038.8914.7424.00
FEM-SFW vs. FEM-FW16.2812.6612.7718.6813.4118.9723.7616.4914.93
FEM-SVW vs. FEM-SW20.2220.0024.4921.8819.1033.3337.3016.8432.00
FEM-SVW vs. FEM-VW14.4619.0522.9211.7620.8823.6411.2415.0519.05
FEM-FVW vs. FEM-FW23.2620.2531.9121.9817.0736.2126.7325.7732.84
FEM-FVW vs. FEM-VW20.4825.0033.3316.4725.2732.7316.8522.5828.57
FEM-SB vs. BP6.867.0711.2915.639.439.4618.9714.1815.31
FEM-FB vs. BP9.8010.1014.5224.2213.2113.5133.8519.8622.45
FEM-VB vs. BP13.736.0616.1328.137.5517.5750.2625.5325.51
FEM-SE vs. ELM6.197.3710.1714.6611.765.8021.2613.5614.13
FEM-FE vs. ELM8.2511.5815.2518.9715.6911.5933.3311.0222.83
FEM-VE vs. ELM12.378.4216.9524.146.8617.3947.1317.8028.26
FEM-SW vs. WRELM5.324.4912.505.883.264.5519.759.5214.77
FEM-FW vs. WRELM8.5111.2416.0710.7810.8712.1235.677.6223.86
FEM-VW vs. WRELM11.705.6214.2916.671.0916.6743.3111.4328.41
Table 14. Comparison results of experiments III, IV and V in winter.
Table 14. Comparison results of experiments III, IV and V in winter.
Comparison of ModelsWinter
One-Step AheadTwo-Step AheadThree-Step Ahead
MAE (%)RMSE (%)MAPE (%)MAE (%)RMSE (%)MAPE (%)MAE (%)RMSE (%)MAPE (%)
FEM-SFVB vs. FEM-SFB28.0012.8621.9515.2917.5020.4115.2212.7725.00
FEM-SFVB vs. FEM-SVB29.8710.2915.7912.2014.2913.339.3014.5820.75
FEM-SFVB vs. FEM-FVB22.866.158.577.698.334.884.882.3810.64
FEM-SFVE vs. FEM-SFE49.3254.4128.2117.2821.7926.0920.2224.1825.93
FEM-SFVE vs. FEM-SVE50.0051.5620.0010.6716.4419.0511.2520.6916.67
FEM-SFVE vs. FEM-FVE43.9447.4612.505.638.9610.537.7912.669.09
FEM-SFVW vs. FEM-SFW60.5681.5460.0026.3225.0032.5627.7118.7540.82
FEM-SFVW vs. FEM-SVW60.0079.6654.8422.2220.5919.4422.0816.6729.27
FEM-SFVW vs. FEM-FVW55.5678.1851.7213.8514.2914.7115.495.8030.95
FEM-SFB vs. FEM-SB8.5413.5818.0011.4614.8922.2223.9732.3721.13
FEM-SFB vs. FEM-FB11.7610.2614.5813.2711.1116.9521.3725.4015.15
FEM-SVB vs. FEM-SB6.1016.0524.0014.5818.0928.5728.9330.9425.35
FEM-SVB vs. FEM-VB7.2313.9219.1511.8310.4722.4117.3112.7320.90
FEM-FVB vs. FEM-FB17.6516.6727.0820.4120.0030.5129.9133.3328.79
FEM-FVB vs. FEM-VB15.6617.7225.5316.1316.2829.3121.1523.6429.85
FEM-SFE vs. FEM-SE6.4113.9218.7511.9612.3622.0317.5922.8819.40
FEM-SFE vs. FEM-FE10.989.3315.2214.749.3014.8115.2420.1814.29
FEM-SVE vs. FEM-SE5.1318.9927.0818.4817.9828.8125.9326.2728.36
FEM-SVE vs. FEM-VE7.5016.8822.2216.6713.1025.0017.5314.7123.81
FEM-FVE vs. FEM-FE19.5121.3330.4325.2622.0929.6326.6730.7030.16
FEM-FVE vs. FEM-VE17.5023.3828.8921.1120.2432.1420.6222.5530.16
FEM-SFW vs. FEM-SW5.3315.5823.9112.6414.2923.2115.3125.2320.97
FEM-SFW vs. FEM-FW10.139.7222.2217.3913.2517.3114.4325.9319.67
FEM-SVW vs. FEM-SW6.6723.3832.6117.2419.0535.7121.4327.1033.87
FEM-SVW vs. FEM-VW7.8921.3327.9118.1817.0729.4118.0919.5930.51
FEM-FVW vs. FEM-FW20.2523.6135.5629.3524.1034.6226.8036.1131.15
FEM-FVW vs. FEM-VW17.1126.6732.5626.1423.1733.3324.4728.8728.81
FEM-SB vs. BP13.6816.499.098.577.848.7043.9832.2022.83
FEM-FB vs. BP10.5319.5912.736.6711.7614.4945.8338.5428.26
FEM-VB vs. BP12.6318.5614.5511.4315.6915.9451.8546.3427.17
FEM-SE vs. ELM14.2915.057.698.9110.1011.9438.2936.5618.29
FEM-FE vs. ELM9.8919.3511.545.9413.1319.4040.0038.7123.17
FEM-VE vs. ELM12.0917.2013.4610.8915.1516.4244.5745.1623.17
FEM-SW vs. WRELM15.7311.496.1211.2210.648.2028.4734.7618.42
FEM-FW vs. WRELM11.2417.248.166.1211.7014.7529.2034.1519.74
FEM-VW vs. WRELM14.6113.7912.2410.2012.7716.3931.3940.8522.37

Share and Cite

MDPI and ACS Style

Wang, J.; Wang, Y.; Li, Y. A Novel Hybrid Strategy Using Three-Phase Feature Extraction and a Weighted Regularized Extreme Learning Machine for Multi-Step Ahead Wind Speed Prediction. Energies 2018, 11, 321. https://doi.org/10.3390/en11020321

AMA Style

Wang J, Wang Y, Li Y. A Novel Hybrid Strategy Using Three-Phase Feature Extraction and a Weighted Regularized Extreme Learning Machine for Multi-Step Ahead Wind Speed Prediction. Energies. 2018; 11(2):321. https://doi.org/10.3390/en11020321

Chicago/Turabian Style

Wang, Jujie, Yanfeng Wang, and Yaning Li. 2018. "A Novel Hybrid Strategy Using Three-Phase Feature Extraction and a Weighted Regularized Extreme Learning Machine for Multi-Step Ahead Wind Speed Prediction" Energies 11, no. 2: 321. https://doi.org/10.3390/en11020321

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop