Next Article in Journal
Technological Innovation in Biomass Energy for the Sustainable Growth of Textile Industry
Next Article in Special Issue
Short-Term Wind Speed Forecasting Based on Hybrid Variational Mode Decomposition and Least Squares Support Vector Machine Optimized by Bat Algorithm Model
Previous Article in Journal
The Role of a Manager’s Intangible Capabilities in Resource Acquisition and Sustainable Competitive Performance
Previous Article in Special Issue
Hybrid Forecasting Model for Short-Term Electricity Market Prices with Renewable Integration
Article Menu
Issue 2 (January-2) cover image

Export Article

Sustainability 2019, 11(2), 526; https://doi.org/10.3390/su11020526

Article
A Novel System for Wind Speed Forecasting Based on Multi-Objective Optimization and Echo State Network
School of Statistics, Dongbei University of Finance and Economics, Dalian 116025, China
*
Author to whom correspondence should be addressed.
Received: 14 December 2018 / Accepted: 17 January 2019 / Published: 19 January 2019

Abstract

:
Given the rapid development and wide application of wind energy, reliable and stable wind speed forecasting is of great significance in keeping the stability and security of wind power systems. However, accurate wind speed forecasting remains a great challenge due to its inherent randomness and intermittency. Most previous researches merely devote to improving the forecasting accuracy or stability while ignoring the equal significance of improving the two aspects in application. Therefore, this paper proposes a novel hybrid forecasting system containing the modules of a modified data preprocessing, multi-objective optimization, forecasting, and evaluation to achieve the wind speed forecasting with high precision and stability. The modified data preprocessing method can obtain a smoother input by decomposing and reconstructing the original wind speed series in the module of data preprocessing. Further, echo state network optimized by a multi-objective optimization algorithm is developed as a predictor in the forecasting module. Finally, eight datasets with different features are used to validate the performance of the proposed system using the evaluation module. The mean absolute percentage errors of the proposed system are 3.1490%, 3.0051%, 3.0618%, and 2.6180% in spring, summer, autumn, and winter, respectively. Moreover, the interval prediction is complemented to quantitatively characterize the uncertainty as developing intervals, and the mean average width is below 0.2 at the 95% confidence level. The results demonstrate the proposed forecasting system outperforms other comparative models considered from the forecasting accuracy and stability, which has great potential in the application of wind power systems.
Keywords:
wind speed forecasting; echo state network; forecasting accuracy; stability and practicality; hybrid forecasting system; interval prediction

1. Introduction

Advances in the development and utilization of renewable energies have greatly decreased environmental pollution and brought about extensive socio-economic benefits. Among various renewable energies, wind energy, as a kind of emission-free, cheap, inexhaustible, and accessible energy, is of great significance in the world energy structure. From the Renewables 2018 Global Status Report (GSR) [1], until the end of 2017, the global wind turbines’ installed capacity achieved about a 539 GW increase by nearly 11%, with more than 52 GW newly added in 2017, and the installed capacity got its third largest growth year ever. For many countries, wind power has become the backbone of strategies to phase out fossil and nuclear energy. In 2017, 43% of Denmark’s power came from wind, setting a new world record. A growing number of countries have reached a double-digit share of wind power, including Germany, Spain, Sweden, Portugal, Ireland, and Uruguay. Until the end of 2017, China was still the largest wind power market with a capacity of 190 GW installed and will continue its undisputed global leader position of wind power. Figure 1 shows the distribution of global leading countries in wind power installation capacities in 2017. Wind power has become one of the fastest increasing renewable energies around the world and greatly impacts the sustained economic development [2,3].
However, the power integration faces a considerable challenge because of the inherent highly stochastic and intermittent nature of wind power, which unavoidably impairs not only the dispatch and management of the electric system but also the stability of the power grid [4]. Therefore, wind speed evaluation as well as wind speed forecasting (WSF) is an effective way to address the above problems and to accomplish secure and reliable electricity dispatch and management. Accurate and stable WSF helps the power system satisfy the electricity demands of economic and social development on the basis of being resource-conserving and environment-friendly [5,6]. Considering the significance, researchers have carried on a large amount of research about both the theory and practice of WSF. Furthermore, to achieve better predictions, more and more approaches are developed for WSF that could be generally grouped to four classes [7]: physical models, statistical models, artificial intelligence models, as well as hybrid models.
Physical models, based on numerical weather prediction (NWP), generally employ meteorological data and geographic feature information to forecast future wind speeds [8,9,10]. With the development of numerical simulation, reanalysis data [11,12] and satellite data [13,14] have been used in wind speed evaluation gradually. They usually require much more for the model parameters so that the application of physical methods is inevitably restricted by the uncertain weather conditions and the performance of NWP. In the situation of climate change, researches use climate models [15,16] to predict the future wind speed. Giménez, P.O. [17] demonstrated that reanalysis data and satellite data facilitate a reliable wind speed evaluation; they also considered the impacts of climate change on wind speed. Considering the various data types and parameters, the physical methods can achieve high forecasting accuracy. However, they bring on considerable computation time and computation complexity. Furthermore, they are unsatisfactory for short-term wind speed forecasting (STWSF).
Statistical models are much more appropriate for STWSF, which make the utmost of the historical data to model their inner relationship and then to build statistical models to predict the future wind speeds [18]. These methods have better forecasting performance and faster processing speeds. However, these models are based on the linear assumption so that they cannot describe exactly the wind speed time series which is essentially non-linear.
Recently, with the rapid development and extension of artificial intelligence techniques, researches have been aware of the artificial intelligence’s excellent ability to deal with the nonlinear feature of wind speed data [19]. Artificial intelligence, for instance, the artificial neural network (ANN), the support vector machine (SVM), as well as the extreme learning machine (ELM), has been resoundingly employed for wind speed forecasting. An artificial intelligence technique is equipped to handle complex relationships and to make decisions under uncertainty based on its excellent self-learning and self-adaptation ability [20]. However, the common ANN like back propagation neural network (BPNN) that demands intricate training processing [21] may be easily trapped into local optimum [19] and needs a long training time. Other artificial intelligence techniques like SVM are of a compute burden associated with the sample size [22,23,24,25,26,27]. Therefore, it is hard to achieve wonderful wind speed forecasting performances using these methods. Echo state network (ESN), which has shown successful applications to time series forecasting like load forecasting, stock forecasting, energy consumption forecasting, and so on, can deal with the difficulties mentioned above but is still rarely applied in wind speed time series forecasting [28,29,30,31,32]. According to the literature [33,34,35,36,37], ESN replaces the hidden layer with a reservoir composed of many interconnected neurons so that it can (a) Reduce computation complexity and improving training efficiency; (b) achieve a higher forecasting accuracy; (c) capture complex dynamics in nonlinear time series; and (d) help avoid over-fitting problem. Therefore, ESN is competent for wind speed forecasting and can show an outstanding ability in practical applications.
Obviously, the application of ESN will make great progress in wind power forecasting, but the inherent stochastic and intermittent nature of wind power works against getting satisfactory forecasting results. Thus, to overcome the existing problems and to achieve a high accuracy of wind speed forecasting, researchers try to combine multifarious algorithms based on their individual advantages called hybrid methods. Commonly, a hybrid model exerts a certain mechanism to preprocess the original signals and then predicts through an optimized predictor. Zhang et al. [38] proposed a hybrid system which compounds hybrid backtracking search algorithm (HBSA), optimized variational mode decomposition (OVMD), as well as ELM. Results obtained from the research indicate the more satisfying performance in wind speed forecasting of hybrid models. Likewise, Du et al. [39] applied complementary ensemble empirical mode decomposition (CEEMD) and Elman neural network constituting a new hybrid model, which achieved more accurate results in wind speed forecasting. Researches demonstrate that hybrid models are capable of improving the precision effectively in wind speed forecasting.
Based on the literature research, the defect of the aforementioned methods can be summarized as (1) physical models, including reanalysis data, satellite data, and climate models, are unsatisfactory for STWSF and the computation time and computation complexity are considerable as well; (2) statistical models cannot describe exactly the essentially non-linear and fluctuation features of wind speed, but they are effective in predicting under small change of climate and other influencing factors, though the prediction performance is not ideal in the case of a large variety of random factors or poor-quality data; (3) artificial intelligence methods can capture the essentially nonlinearity and improve the accuracy of STWSF, but they also have some disadvantages, such as easy to be trapped into local optimum, over-fitting, and so on; and (4) hybrid models combine data preprocessing, optimization, and artificial intelligence methods to overcome the drawbacks and achieve better forecasting performance. Researches indicates that hybrid models can capture the feature of wind speed and combine the advantage of different methods, having great significance in improving the accuracy of STWSF [39].
Researchers have made a lot of improvement in wind speed forecasting models, but most researches focus on point forecasting and ignore the uncertainty in the forecasting process, which will pose risks to the operation and management of the power system. To analyze the uncertainty, Li et al. [6] conducted an interval prediction using a hybrid model to gain both high coverage and small width. Naik et al. [40] proposed a hybrid model based on the low rank Multi-kernel ridge regression and obtained a good performance in the wind speed interval prediction. Shrivastava et al. [41] employed a hybrid framework based on SVM to capture the forecasting uncertainty and results show it can generate high quality prediction intervals. The inherent uncertainty can disturb the decision making and bring risk to wind farm operating, so it is essential to quantify the uncertainty via wind power interval forecasting. Furthermore, point forecasting generates only one forecasting value at each which can simply and directly reflect the future wind power situation [3], while interval forecasting produces the upper and lower bounds of the forecasted wind speed at a certain confidence level. To mitigate risks and to improve the management level of the wind power system, point forecasting combining with interval forecasting can make a great contribution.
Considering the superiority of hybrid models, we developed a novel hybrid forecasting system composed of the modules of data preprocessing, forecasting, optimization, and evaluation. Due to inherent volatility and irregularity of the raw wind speed, the data preprocessing module plays a vital part in the system. Furthermore, most previous data preprocessing methods were too primitive to fully mine the characteristics of the wind speed data. Wherefore in this paper, an improved data preprocessing algorithm—Complete Ensemble Empirical Mode Decomposition with Adaptive Noise (CEEMDAN)—is adopted, which can improve the preprocessing effect by adding adaptive white noise among every decomposition. For further improvement, most previous researches employ optimization algorithms to improve the forecasting accuracy. Genetic algorithm (GA) is an effective heuristic algorithm which has shown advantages in wind speed forecasting through the self-improvement mechanism. Wang et al. [27] applied the ensemble empirical mode decomposition (EEMD) and ANN optimized by GA constituting a new hybrid model, which can predict wind speed more accurate than before. However, there is no universal parameter for GA; and it needs to be continually seeking. Furthermore, sometimes a small change of parameters can make a huge difference to the algorithm results and performance. Therefore, GA can be unstable and be susceptible to changes. A. Khosravi [42] compared adaptive neuro-fuzzy inference system (ANFIS) optimized by particle swarm optimization algorithm (PSO) and GA, and the results showed the ANFIS-PSO outperformed the ANFIS-GA, which means the performance of GA is not excellent enough. Additionally, the previous single-objective optimization algorithms, which only focus on improving forecasting accuracy, is not sufficient. So this paper introduces a Multi-Objective Grey Wolf Optimization (MOGWO) algorithm into the optimization module, which focuses on improving the forecasting accuracy as well as enhancing the forecasting stability. Obviously, with the perfection of the model, the model complexity and computing time are increased; therefore, to overcome the aforementioned drawbacks on the basis of guaranteeing the forecasting effect, the forecasting module applies ESN which is simple and fast but of great forecasting capabilities. Finally, the evaluation module evaluates the proposed system based on the experiments of four datasets with different seasons and four datasets with different sites and time intervals. The newly developed hybrid system CEEMDAN-MOGWO-ESN is supposed to balance the superiorities and drawbacks existing in different algorithms and to achieve excellent forecasting results both at wind speed point forecasting and interval forecasting.
The innovation points and contributions of the conducted research are summarized below:
  • Develop a novel hybrid forecasting system for wind speed forecasting. The empirical results indicate the system can integrate advantages of the data preprocessing, optimization, as well as forecasting methods and achieve better forecasting performance in wind speed forecasting.
  • The developed novel forecasting system has strong applicability. This paper employs three experiments to demonstrate that the proposed system can be used for wind speed forecasting with different seasons, different sites, and different time intervals.
  • The proposed hybrid system not only performs well for point forecasting but also implements for interval forecasting. The novel system can quantify the uncertainty as forecasting intervals, and the results indicate the developed system performs well in wind speed interval forecasting.
  • The proposed hybrid system can improve the wind speed forecasting accuracy and stability simultaneously while most previous research can only focus on one side. The experiment results demonstrate that the multi-objective optimization algorithm can not only improve the forecasting accuracy and stability simultaneously but also outperform other optimization algorithms.
  • This paper conducts a comprehensive evaluation of the proposed forecasting system. Ten evaluation metrics, forecasting effectiveness, grey relational analysis, as well as hypothesis testing are combined to demonstrate the advancement of the proposed hybrid forecasting system.
The structure of the paper is organized as follows: Section 2 presents the relevant theories employed in the proposed model in detail, including the theory of CEEMDAN, MOGWO, and ESN and the evaluation methods. The proposed hybrid system is set forth in Section 3. Section 4 introduces the experiment set and the forecasting results analysis. Several discussions are conducted in Section 5. Finally, Section 6 concludes the whole paper.

2. Methodology

The components of the proposed hybrid system containing the fundamental theories of the decomposition technique CEEMDAN, the forecasting method ESN, the multi-objective optimization algorithm MOGWO, as well as the evaluation methods are presented in this section.

2.1. Complete Ensemble Empirical Mode Decomposition with Adaptive Noise

To decrease high computational cost and to eliminate the residual noise of EEMD while alleviating the mode mixing problem of EMD, Torres et al. [43] proposed CEEMDAN by adding the finite time of the adaptive white noise in each decomposition. The distinct advantages of CEEMDAN are as follows: (1) Introduce the noise coefficient vector to control the added noise level for each decomposition; (2) the reconstruction as well as the decomposition is complete and without a noise component; and (3) it is more efficient in the EMD family.
The CEEMDAN computation can be achieved as follows:
Step 1. Adding one white Gaussian noise signal with standard normal distribution, the obtained series can be shown as
s i ( n ) = s ( n ) + ε 0 v i ( n ) i = 1 ,     I
where i indicates the trial number, s(n) represents the original series, and vi(n) indicates the added white noise series.
Step 2. Getting the first intrinsic mode function (IMF) by the EMD method:
I M F 1 ( n ) = ( i = 1 I I M F 1 i ( n ) ) / I
Step 3. The first residue can be calculated as (k = 1):
r 1 ( n ) = s ( n ) I M F 1 ( n )
Step 4. The k-th residue can be calculated as
r k ( n ) = s ( n ) I M F k ( n ) k = 2 ,   K
Step 5. Decompose the residue with added noise to get the (k + 1)-th IMF:
I M F k + 1 ( n ) = ( i = 1 I E 1 ( r k ( n ) ) + ε k E k ( v i ( n ) ) ) / I
Step 6. Repeat Steps 4 and 5, until you find out all the IMFs.
In the end, the final residue is
R ( n ) = s ( n ) k = 1 K I M F k
Thus, the original signal is decomposed into
s ( n ) = k = 1 K I M F k + R ( n )

2.2. Echo State Network

ESN proposed by Jaeger [44] is a new type of recurrent neural network, which is consisted of an input layer, a DR (dynamical reservoir) designed by an interconnected recurrent grid of recurrent neurons, and an output layer. The schematic of ESN is shown in Figure 2D. Different from traditional neural networks, the link weights of the input layer to DR and inside the DR are firstly selected then stay fixed, so merely the DR to output layer link weights need be trained. The ESN output can be expressed as
X ( n + 1 ) = F ( W i n U ( n + 1 ) + W X ( n ) + W b a c k Y ( N ) )
where U(n + 1) and X(n + 1) represent the input vector and hidden layer state at (n + 1); F indicates the hidden layer’s activation function; Win, W, and Wback are respectively the input-DR, DR-DR, and output-DR weighting matrix; and the output Y at time (n + 1) can be obtained by
Y ( n + 1 ) = G ( W o u t [ U T ( n + 1 ) , X T ( n + 1 ) ] T )
where Wout is the output weight matrix, Wout = (X−1Y)T, and G represents the output layer activation function.
The output weight Wout is the only parameter that needs to be obtained from the training; the Wout can be calculated through the linear regression algorithm:
W o u t = ( X 1 Y ) T
Compared with other methods, ESN shows the following features: (1) The training process of ESN is much faster and simple and (2) ESN shows more advantages in the processing of one-dimension time series.

2.3. Multi-Objective Grey Wolf Optimization

The MOGWO proposed by Mirjalili et al. [45] is an advanced optimization algorithm based on the grey wolf optimization (GWO). The GWO simulates the social hunting behavior of grey wolves: the optimal solutions are generated by alpha (α) wolf, the second solutions are generated by beta (β) wolf, and the third solutions are generated by delta (δ) wolf. Furthermore, α, β, and δ wolves dominate the exploration for the global optimum, and omega (ω) wolves, which generate the remainder solutions, just follow them.
The wolves encircle the prey and update its location at the beginning. Equations (11) and (12) simulate the encircling process of the grey wolves [46]:
G = | B X p ( t ) X ( t ) |
X ( t + 1 ) = X p ( t ) K G
where t represents the current iteration, X p and X denote the location of the prey and grey wolves respectively, and B and K denote the coefficient vectors and can be calculated as
K = 2 k h 1 k
B = 2 h 2
where h 1 and h 2 are random vectors within [0,1] and k decreases from 2 to 0 as the iterations.
To improve the solution quality, the grey wolves update their positions based on the leading of the first three wolves (α, β, and δ). The mechanism of hunting and updating the positions can be simulated as follows:
G α = | B 1 X α X |
G β = | B 2 X β X |
G δ = | B 3 X δ X |
X 1 = X α K 1 G α
X 2 = X β K 2 G β
X 3 = X δ K 3 G δ
X ( t + 1 ) = X 1 + X 2 + X 3 3
The MOGWO is developed from the GWO by integrating the two important components: the archive and leader selection strategy [47]. The archive is applied to store the non-dominated solutions generated in each cycle of GWO. The archive management mechanism exploited in MOGWO controls the entering and exiting of the solutions and helps keep the balance of the solutions in the archive. The leader selection strategy plays a vital part in choosing the α, β, and δ wolves from the archive by the roulette-wheel method. Additionally, more detailed information about MOGWO can be found in Reference [45].
To improve the forecasting accuracy and to enhance the forecasting stability simultaneously, two objective functions are designed based on the MOGWO. The objective functions are shown in Algorithm 1. For improving the forecasting accuracy, the objective function fitness1 is designed according to the mean absolute error. Meanwhile, to improve the stability, fitness2 is designed via the forecasting error’s variance. Because accuracy and stability are both important in wind speed forecasting, the weights of the two objectives are set to be the same.

2.4. The Forecasting Performance Evaluation

To evaluate the forecasting performance of the proposed hybrid system in wind speed point forecasting completely, this research designed a complete and scientific evaluation module containing nine appropriate evaluation metrics as well as another two evaluation methods. Moreover, to evaluate the interval forecasting performance of the proposed system, five assessment indices are introduced.

2.4.1. The Typical Evaluation Metrics

Various evaluation indicators have been employed to assess the forecasting error by the researchers without a universally accepted standard in comparing different models’ forecasting results. Therefore, ten typical evaluation metrics are applied to estimate the forecasting performance, as shown in Table 1. More specifically, the average error of n forecast result (AE) and root mean-square error (RMSE) reflect the forecasting error in a different way. The mean absolute percentage error (MAPE) can reflect the difference between the forecasting and the actual values. The median absolute percentage error (MdAPE) is a measure of statistical dispersion. The fractional bias of n forecast result (FB) shows the number of “under” or ”over” forecasting. The index agreement of the forecast result (IA) can compare the performance of different methods since it is dimensionless. The Theil U statistical 1 of forecast result (U1) measures the forecast accuracy, and the Theil U statistical 2 of forecast result (U2) measures the forecast quality. Pearson’s correlation coefficient, r, is used to measure the correlation relationship between the forecasting and actual values. Except r and IA, smaller values of the other error criteria reflect better forecasting performances.
Here, ai and fi respectively signifies the actual value and the forecasting value at time i, a ¯ and f ¯ indicate the mean value of the actual value and the forecasting value, respectively, and n represents the size of the sample in this research.

2.4.2. The Other Two Evaluation Methods

For further verifying the meliority of the proposed hybrid system in wind speed forecasting, this paper employs the grey relational analysis (GRA) and forecasting effectiveness (FE) [48] to extend the evaluation module. The main thought of GRA is to determine whether the degree of similarity between the forecasting sequence’s curve and the original series’ curve is high. A higher level of the curve’s similarity corresponds to the higher correlation between the corresponding sequences, and vice versa. Wang [49] describes the details of GRA. Moreover, the basic idea of FE is to assess the models’ performance by the square sum of the forecasting errors and the mean squared deviation of the forecasting accuracy. A greater FE value indicates the corresponding model performs better and the detailed description is shown by Xiao [50].

2.4.3. The Assessment Indices for Interval Forecasting

For short-term wind speed interval forecasting, it is imperative to construct appropriate assessment indices to assess the quality of the prediction intervals. This paper introduces the following five assessment indices based on the literatures. Coverage probability (CP) can indicates the prediction intervals’ accuracy, and when CP is confirmed, a smaller average width (AW) corresponds to better performance, accumulated width deviation (AWD) shows the similar effect as AW from another aspect, coverage width criterion (CWC) is used to evaluate the whole quality of the interval forecasting, and score is also an overall evaluation index, where the smaller score indicates better prediction intervals. The detailed expression and calculation are shown in References [51,52,53].

3. The Proposed Hybrid Forecasting System

Hybrid models generally combine two or more algorithms, which is possible to improve the forecasting performance by gathering the excellence of each method [54]. In the proposed forecasting system, it contains the original series’ decomposition and recombination, optimization and forecasting, and forecasting result’s evaluation. Figure 2 displays the proposed hybrid system’s framework, and from Figure 2 the proposed system can be summarized as follows:
Step 1: As shown in Figure 2A, the CEEMDAN decomposes the Raw series into several IMFs, removes the high frequency noise, and recombines the remainders as the Final series.
Step 2: As shown in Figure 2B, the Final series is divided into the training set and testing set, the input-output structure is set as inputting five data and outputting one data.
Step 3: As shown in Figure 2C,D, the MOGWO optimizes the parameters of ESN, employs the training set to train ESN, and updates the parameters of ESN.
Step 4: Employ the testing set to forecast, and the forecasting performance are evaluated by the evaluation metrics shown in Figure 2E.
According to the four steps, the CEEMDAN-MOGWO-ESN hybrid system is constructed; the details are shown in Algorithm 1. Wind speed forecasting can be segmented according to time horizon [55]: short term forecasting is focused on a few seconds to six hours ahead, medium term is from six hours to a day ahead, and long term is exceeding a one day prediction. In this research, wind speed data of 10 min and 30 min time intervals are selected to conduct short term forecasting. The forecasting horizon of 10 min and 30 min time intervals are 10 min ahead and 30 min ahead for one step forecasting. Based on these, this paper conducts short term wind speed forecasting of 10 min and 30 min time intervals; four experiments using eight datasets are conducted as the illustrative examples to test the performance of the developed system.
The pseudo-code of the CEEMDAN-MOGWO-ESN algorithm:
Algorithm 1. CEEMDAN-MOGWO-ESN
Objective functions:
min { f i t n e s s 1 = MSE = 1 n i = 1 n ( a i f i ) f i t n e s s 2 = std ( a i f i ) i = 1 , 2 , , n
Input: x t r a i n ( 0 ) = ( x ( 0 ) ( 1 ) , x ( 0 ) ( 2 ) , , x ( 0 ) ( l ) ) —the training data
x t e s t ( 0 ) = ( x ( 0 ) ( l + 1 ) , x ( 0 ) ( l + 2 ) , , x ( 0 ) ( l + j ) ) —the testing data
Output: y ^ t e s t ( 0 ) = ( y ^ ( 0 ) ( l + 1 ) , y ^ ( 0 ) ( l + 2 ) , , y ^ ( 0 ) ( l + j ) ) —the forecasting values
Parameters:
  • α (Xα)—alpha wolf, represents the optimal solution
  • β (Xβ)—beta wolf, represents the second solution
  • δ (Xδ)—delta wolf, represents the third solution
  • K/B—The coefficient vectors
  • t—the current iteration
  • Max_it—the maximum iterations
  • archive—the optimal solutions’ reservoir
  • [Li, Ui]—the boundaries of interval
1/* Use CEEMDAN method to reduce noise in the original data. */
2/* Initialize the parameters of MOGWO. */
3/* Initialize the grey wolf population Xi (i = 1, 2… n). */
4/* Find the nondominant solutions and initialize the archive with them. */
5/* Select Xα from archive. */
6/* Exclude Xα from the archive temporarily to avoid selecting the same leader. */
7/* Select Xβ from archive. */
8/* Exclude Xβ from the archive temporarily to avoid selecting the same leader. */
9/* Select Xδ from archive. */
10/* Add back α and β to the archive. */
11T = 1
12WHILEt < Max_it
13FOR each search agent
14/* Update the position of the current search agent. */
15 G α = | B 1 X α X | , G β = | B 2 X β X | , G δ = | B 3 X δ X |
16 X 1 = X α K 1 G α , X 2 = X β K 2 G β , X 3 = X δ K 3 G δ
17 X ( t + 1 ) = X 1 + X 2 + X 3 3
18END FOR
19/* Update α, K and B. */
20/* Calculate the objective values of all search agents. */
21/* Find the non-dominated solutions. */
22/* Update the archive with respect to the obtained non-dominated solutions */
23IF the archive is full
24/* Run the grid mechanism to omit one of the current archive members */
25/* Add the new solution to the archive */
26END IF
27IF any of the new added solutions to the archive is located outside the hypercubes
28/* Update the grids to cover the new solutions. */
29END IF
30/* Select Xα from archive. */
31/* Exclude Xα from the archive temporarily to avoid selecting the same leader. */
32/* Select Xβ from archive. */
33/* Exclude Xβ from the archive temporarily to avoid selecting the same leader. */
34/* Select Xδ from archive. */
35/* Add back α and β to the archive. */
36t = t + 1
37END WHILE
38RETURN archive
38/* Select the optimal solution X* from archive via Roulette-wheel strategy. */
39/* Set parameters of ESN based on X*. */
40/* Employ x t r a i n ( 0 ) to train ESN and update the parameters of ESN. */
41/* Input x t e s t ( 0 ) to ESN. */
42/* Output the forecasting value y ^ t e s t ( 0 ) . */

4. Simulation and Analysis

For corroborating the proposed hybrid system’s superiority of wind speed forecasting, three experiments are conducts as an empirical research employing wind speed data gathered from Penglai wind farms. Specifically, Experiment I applies four datasets in different seasons with 10 min intervals to check the serviceability of the proposed system in different seasons; Experiment II employs four datasets with 10 min intervals and 30 min intervals at different sites to confirm the availability of the developed system in the different intervals; and Experiment III adopts GRA and FE to evaluate the hybrid system’ further performance. The details of the information are shown as follows.

4.1. Data Description

Eight data sets from Penglai in China which has plenty wind energy are considered as cases to inspect the proposed hybrid system’s validity in practical applications. Specifically, the datasets A, B, C, and D with 10 min intervals are all gathered at the same data site (Penglai site 1) but from spring, summer, autumn, and winter, respectively. The datasets E with 10 min intervals as well as datasets F with 30 min intervals are from Penglai site 2, and the datasets G with 10 min intervals and datasets H with 30 min intervals are from Penglai site 3. More specifically, there are altogether 2880 data points in each experiment, in which the training set is composed of the first 2304 observations covered over 16 days and the rest of the 576 data points covered 4 days make up the testing set. For the experiments, Experiment I employs 10 min wind speed data respectively gathered at Penglai site 1 in spring, summer, autumn and winter, i.e., data sets A, B, C, and D. In Experiment II, 10 min and 30 min wind speed data (i.e., datasets E and datasets F) as well as 10 min and 30 min data (i.e., data sets G and datasets H) are separately gathered at Penglai site 2 and Penglai site 3. Experiments III and IV are based on Experiment I and Experiment II. The detailed information of the datasets is listed in Table 2.
According to the descriptive statistical characteristic of the experimental data including the average, maximum, median, minimum, and standard deviation, it is clear that the eight wind speed datasets have different features and the experimental data are representative. Indeed, this paper is conducted to test the developed improved forecasting system via numerical simulation and experiments. Thus, this paper employs historical wind speed data to conduct off-line predictions.

4.2. Experiment I: Comparison of Different Seasons

In this experiment, the four seasons’ wind speed data with 10 min from Penglai site 1 are employed to verify the developed system’s effectiveness in wind speed forecasting. By conducting the experiment with different seasons’ data, it can be proved that the seasonal change cannot affect the forecasting ability of the developed system. Moreover, this experiment utilizes four comparative studies to demonstrate the validity of the hybrid system’s each component and the progressiveness of the newly proposed hybrid system. Specifically, the first comparison proves the superiority of the employed ESN method in the proposed system by selecting and comparing ESN, GRNN, and WNN; at the second comparison, the advancement of the data preprocessing module is confirmed by comparing the proposed system with EMD-MOGWO-ESN and VMD-MOGWO-ESN; the third comparison is aimed at comparing the proposed system with CEEMDAN-MOPSO-ESN and CEEMDAN-MOWCA-ESN to attest the availability of the optimization method MOGWO; and the last comparison compares the developed hybrid models with the above comparative models as well as Autoregressive Integrated Moving Average (ARIMA) and the persistence model to attest the effectiveness of the developed wind speed forecasting model. The experiment results of the Penglai site 1’s wind speed data at four seasons are listed at Table 3, and the bolded values are the best value of each evaluation metric. The experiment performance can also be more distinctly exhibited by Figure 3; it shows the performance of the proposed forecasting system more intuitively and clearer. Considering Table 3 and Figure 3, the developed CEEMDAN-MOGWO-ESN system gains almost every evaluation metric’s best value, which means the proposed novel forecasting system outperforms the other benchmark methods in wind speed forecasting. The detailed results and analysis are summarized as follows:
(1) Comparing ESN with other artificial intelligence methods (GRNN and WNN), it can be found that ESN has a better forecasting ability than GRNN and WNN. Moreover, the runtime of ESN reduces significantly compared with GRNN and WNN. Therefore, the used ESN can not only improve the forecasting accuracy but also reduce the developed system’s runtime, which means the forecast method used in the developed forecasting system is preeminent.
(2) From comparing the developed forecasting system with other hybrid methods (EMD-MOGWO-ESN and VMD-MOGWO-ESN), it is obvious that the proposed CEEMDAN-MOGWO-ESN can improve forecasting accuracy significantly. In this comparison, only the data preprocessing methods are different, so the effort of the developed system’s data preprocessing method is proved. It means that the data preprocessing method CEEMDAN used in the proposed system can conduct effective data preprocessing and contribute to improving the forecasting accuracy.
(3) By comparing the developed system with contract models (CEEMDAN-MOPSO-ESN and CEEMDAN-MOWCA-ESN), the advancement of the multi-object optimization algorithm used in the proposed system is confirmed. Only the optimization algorithm is different in the contract models; therefore the discrepancy in the forecasting ability of these models results from the optimization algorithm changes. The developed system outperforms the contract models in forecasting, so the MOGWO outperforms the contract optimization algorithm (MOPSO and MOWCA). It reveals that the multi-object optimization algorithm MOGWO can enhance the forecasting effectiveness.
(4) The comparisons between the developed system and other comparative methods have clearly confirmed the advancement of the proposed hybrid system in wind speed forecasting. Each component has a certain enhancement for the forecasting ability respectively and can be added up to promote the forecasting performance as a hybrid system. Furthermore, by comparing with ARIMA, the persistence model, and other models, the developed forecasting system’s superiority is revealed absolutely.
(5) When comparing the developed system with other methods, the developed system prevails over the comparative methods in each case, which means that the proposed hybrid system performs better in wind speed forecasting no matter which season. For the developed system, its MAPE values are 3.1490%, 3.0051%, 3.0618%, and 2.6180% at spring, summer, autumn, and winter, respectively. Therefore, the developed hybrid system is a reliable forecasting method, and its forecasting ability is not affected by seasonal factors.
Remark: For all seasons’ datasets in Penglai site 1, the developed hybrid system obtains nearly all the best values of all the evaluation indexes comparing with the other comparative models. Therefore, the developed system has a reliable forecasting ability owing to the excellent hybrid strategy; moreover, it can forecast wind speed effectively and be not affected by seasonal factors.

4.3. Experiment II: Comparison of a Different Time Interval

For further validating the outstanding forecasting ability of the proposed system in this paper and demonstrating the validity of the proposed forecasting system when forecasting wind speeds of different time intervals or diverse data features, it employs 10 min and 30 min data form Penglai site 2 and Penglai site 3 for the experiment. In Experiment II, there are two comparative studies organized. The first comparative study employs two sets of 10 min and 30 min wind speed series’ comparisons to affirm the developed system’s validity in forecasting the wind speed of different time intervals. While the other comparative study conducts two sets of comparison between the wind speed data with the same intervals, it collected from different sites to prove the developed system can perform well no matter which site the data is gathered from. Each comparison is expressed by testing the developed system and benchmark models such as ARIMA, GRNN, EMD-MOGWO-ESN, CEEMDAN-MOPSO-ESN, and others. The performance of this experiment is distinctly shown in Figure 4, and the results of Experiment II are presented in Table 4 and Table 5. According to Table 4, Table 5, and Figure 4, the excellent forecasting performance of the developed system can be demonstrated. The detailed results and analysis are summarized as follows:
(1) In the first comparative study, comparing the wind speed forecasting performance of the proposed system with other comparative methods at 10 min and 30 min reveals the developed system’s wonderful forecasting performance in different time interval. Such as, the 10 min data’s MAPE of the proposed system at Penglai site 3 is 2.6276%, the ESN is 5.1874%, the GRNN is 6.6787%, the ARIMA is 5.8801%, the VMD-MOGWO-ESN is 4.1352% and the CEEMDAN-GWO-ESN is 2.6891% which performances the best in the comparative models. The comparative study’s consequences indicate that the proposed system can forecast well at different time intervals.
(2) The second comparative study conducted with wind speed of the same time interval but different characteristics reveals the developed system’s excellent forecasting performance. For a 10 min wind speed forecasting, the developed system performs the best at dataset E and dataset G and the other compared models also obtain good forecasting results. But for a wind speed with a 30 min interval, the excellent forecasting ability of the developed system has emerged. The MAPE of the developed forecasting system is 4.9663% and 5.9178% at dataset F and dataset H, the developed system not only gains the best MAPE value but also achieves the least discrepancy of the forecasting performances. As to the compared models, for example, the MAPE values of EMD-MOGWO-ESN, CEEMDAN-MOWCA-ESN, GRNN, and ARIMA are 6.1778%, 5.8910%, 11.8085%, and 12.4851% and are 8.2231%, 6.2213%, 16.8312%, and 14.837% at dataset F and dataset H, respectively.
(3) When comparing the forecasting performance of the proposed system and other methods at different sites and time intervals, it can be found that the developed system can forecast well beyond the limitations of time and space. For example, the developed system’s MAPE values are 2.6227% of dataset E, 4.9663% of dataset F, 2.6276% of dataset G, and 5.9178% of dataset H, and the hybrid strategy increases the forecasting accuracy by 2.7875%, 5.7176%, 2.5596%, and 7.8702%, respectively. This indicates that the developed hybrid system can improve wind speed forecasting effects effectively and obtain high forecasting ability.
Remark: The comparison results of the cases from different time intervals and different wind sites certify the contribution of the proposed hybrid strategy and advancement of the proposed forecasting system. Furthermore, based on the various evaluation metrics, it is proved that the developed system can perform well without the influence of the time intervals and sites.

4.4. Experiment III: Further Evaluating the Proposed System

Though the evaluation metrics listed in Table 1 has been applied to attest the developed system’s forecasting performance, the evaluation still needs to be further conducted. Thus, FE and GRA are added to demonstrate the super-excellence of the developed hybrid system in wind speed forecasting to a greater degree. FE indicates the forecasting accuracy while GRA represents the forecasting performance by reflecting the correlation between the forecasting values and the actual values. Here all datasets are applied to realize the FE and GRA test, further verifying the results of Experiment I and Experiment II. The experiment results are listed at Table 6, where the bigger value of the result indicates the better forecasting performance and the best results appear in bold. From Table 6, both FE values and GRA values of the proposed system are the greatest among all the models in the experiment, which means the developed forecasting system prevails over the comparative methods in all cases.
Remark: The FE and GRA further validate that the proposed system is a reliable and valid tool to forecast wind speed compared with other methods. Moreover, the forecasting accuracy and the relevance between forecasting values and actual values of the developed system are also demonstrated. In summary, the developed system can perform well in wind speed forecasting.

4.5. Experiment IV: Wind Speed Interval Forecasting

In this experiment, we use dataset D and E as examples to verify the interval forecasting performance of the developed system. To confirm the distribution of the construct prediction intervals, this paper employs four methods fitting the error distribution. As the results shown in Table 7 and Figure 5a, the Logistic distribution is the best fitted one and the Gaussian distribution is close to the Logistic distribution. Thus, we construct the prediction intervals via the Logistic distribution and evaluate the intervals by the assessment indices such as CP, AW, AWD, CWC, and score at 95%, 90%, 85%, 80%, and 70% confidence levels, respectively. On the account of the similar fitting results between the Logistic distribution and Gaussian distribution, we contract the two distributions at the same situation. The results are shown in Table 8 and Figure 5b; from the results, we can find that the developed system performs better in wind speed interval forecasting when fitting the distribution by Logistic rather than the Gaussian distribution. Figure 5 intuitively shows that the developed system possesses an excellent wind speed interval forecasting ability.

5. Discussion

5.1. Discussion I: Statistical Hypothesis Testing

Though the evaluation metrics such as MAPE, AE, and RMSE can be the standard to compare the forecasting accuracy of models, statistical significance testing also need to be used to judge the models’ forecasting ability [2]. Diebold-Mariano (DM) testing proposed by Diebold and Mariano in 1995 is widely used to test the significance of the forecasting ability between different methods. Based on the experiment results, this part employs DM testing to test the significance of the proposed system compared with the comparative methods to prove the superiority of the developed system in wind speed forecasting. Table 9 shows the hypothesis testing results at certain significance levels, and the results values of the experiment models are all bigger than the critical value at the 1% level or 10% level. When the results are bigger than X0.01/2 = 2.58, it indicates the null hypothesis should be rejected at the 1% significant level, and when the results are bigger than X0.1/2 = 1.64, it indicates the null hypothesis should be rejected at the 10% significant level. The results are all bigger than 1.64 and mostly bigger than 2.58 which means the proposed system outperforms all the comparative models at the 10% significant level, and except for CEEMDAN-MOWCA-ESN, the proposed system outperforms the comparative models at the 1% significant level. Therefore, combining the evaluation results of the experiments, we can conclude that the developed hybrid system has a better forecasting ability than the former models and can perform well in wind speed forecasting.

5.2. Discussion II: Forecasting Stability

An effective model can not only forecast accurately but also improve the forecasting precision stably. The forecasting accuracy has been confirmed, so this discussion is applied to demonstrate the stability of the proposed hybrid system. In general, researchers use performance variance to judge the model’s stability [56]; this paper employs the forecasting error’s variance to measure the stability of the developed system, and the results are placed at Table 10. As the smaller variance indicates a stronger stability, and the proposed system has the smallest variance values in all cases, we can draw a conclusion that the developed system owns the strongest stability compared with other methods in this research.

5.3. Discussion III: Sensitivity Analysis of Optimization Algorithm

There are three important parameters of the optimization algorithm MOGWO: the grey wolf number, the iteration number, and the archive size, which can significantly influence the effectiveness of the proposed hybrid system. An appropriate parameter will promote forecasting accuracy as well as forecasting efficiency, and vice versa. To explore the influence of the parameter changing to wind speed forecasting performance, we conduct this discussion by changing one of the three parameters separately and keeping the other parameters unchanged. The parameters’ settings and experiment results of the discussion are shown in Table 11. From Table 11, we can find the following:
(1) The grey wolf number obviously affects the forecasting accuracy; for example, the MAPE value shows regular change with the increasing of the grey wolf number. First, the MAPE value decreases, and when the grey wolf number is set to 200 the MAPE attains a minimum; after that, the MAPE value becomes bigger again. Furthermore, with the increasing of the grey wolf number, the run time increases. Therefore, the change of the grey wolf number affects the forecasting results of the proposed system.
(2) With the changing of iteration number, the forecasting accuracy has a slight variation but the run time changes a lot. The MAPE value also decreases first and then increases, and the least MAPE is corresponding to the iteration at 50, which is the best iteration number. Therefore, the forecasting system will slightly change with the changing of the iteration number.
(3) The forecasting accuracy of the proposed system changes better first, with the increasing of the archive size, and then grows down. It clearly revealed the archive size’s effect on the performance of the proposed system.
Remark: The forecasting performance can be visibly influenced by the changing of the MOGWO’s parameters. The appropriate parameters will lead to excellent forecasting performance while poor parameters cannot help to find the best initial parameters of ESN so it decreases the forecasting ability. Furthermore, the parameter settings change with the practical case conditions; the discussion proves that the grey wolf number is set as 200, the iterations are set as 50, and the archive size sets as 100 in this research.

5.4. Discussion IV: Further Application for Multistep Forecasting Performance

The proposed system’s superiority has been completely attested in the one-step wind speed forecasting. However, the developed system only performing well in the one-step forecasting is not enough to monitor and ensure the wind power system’s safety. To satisfy this requirement, multistep forecasting is conducted on the basis of dataset A and dataset C. In this experiment, we conduct a comparison between the proposed system and several traditional single methods such as the persistence model, ARIMA, neural networks, as well as several hybrid models such as EMD-MOGWO-ESN and CEEMDAN-MOWCA-ESN; the results are shown at Table 12. According to the experiment results, the developed system performs best not only in the first step but also in the second and third step, and its superiority is confirmed. Obviously, the MAPE value of the developed system is far less than the single methods and also smaller than the comparative hybrid models at each step. That means the developed system outperforms other models at multistep wind speed forecasting so it can be applied in wind energy systems.

6. Conclusions

Recently, significant attention and persistent exploitation have been developed for wind energies as it is clean and renewable. However, the randomness and fluctuation of wind speeds make it hard to maintain the security and stability of wind power systems. Accurate and stable wind speed forecasting is of vital significance. Thus, this paper develops a novel hybrid forecasting system which can obtain high forecasting accuracy and stability as well as enhancing the development of wind energy. Firstly, we reduce the noise of the original wind speed via the data preprocessing method; the processed data are inputted into the ESN for forecasting, specifically, the parameters of ESN are optimized by a multi-objective algorithm to enhance the forecasting performance of the developed hybrid system. Then, four datasets of different seasons and four datasets with different features and time intervals gathered from a wind farm in Penglai China are applied to prove the effectiveness of the developed hybrid system. The developed forecasting system achieves the highest forecasting accuracy and stability in all cases. Moreover, compared with traditional statistical methods, single neural networks, as well as other hybrid methods, the proposed system can obtain the best forecasting performance. Finally, an interval forecasting is conducted to address the uncertainty problems existing in wind speed forecasting. Furthermore, several discussions from different aspects are supplemented to verify the advancement of the proposed hybrid system, showing the proposed system’s excellent performance and further application. Synthesizing the experiments and discussion results, the proposed hybrid system is an effective and helpful novel method in wind speed forecasting. The system is designed based on the off-line prediction via historical wind speed data, that is the limitation of the research. Accordingly, employing the developed forecasting system conduct online prediction using real-time data should be made in future research.

Author Contributions

C.W. proposed the concept of this research and wrote the whole manuscript; J.W. provided overall guidance; C.W. carried on the data analysis; T.N. polished the manuscript and supported a part of the data processing.

Funding

This research was funded by the National Natural Science Foundation of China (Grant No. 71671029).

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

WSFWind speed forecasting
AWAverage width
CPCoverage probability
ANNArtificial neural network
ESNEcho state network
SVMSupport vector machine
ARIMAAutoregressive integrated moving average
CEEMDANComplete ensemble empirical mode decomposition with adaptive noise
IMFIntrinsic mode function
HBSAHybrid backtracking search algorithm
CEEMDComplementary ensemble empirical mode decomposition
GAGenetic algorithm
GRAGrey relation analysis
DM testDiebold–Mariano test
ANFISAdaptive neuro-fuzzy inference system
NWPNumerical weather prediction
AWDAccumulated width deviation
CWCCoverage width criterion
BPNNBack propagation neural network
GRNNGeneral regression neural network
WNNWavelet neural network
EEMDEnsemble empirical mode decomposition
OVMDOptimized variational mode decomposition
VMDParticle swarm optimization
MOGWOMulti-objective grey wolf optimization
MOPSOMulti-objective Particle swarm optimization
STWSFShort-term wind speed forecasting
FEForecasting effectiveness
MOWCAMulti-objective water cycle algorithm
PSOParticle swarm optimization

References

  1. REN21. Renewables 2018 Global Status Report; REN21 Secretariatv: Paris, France, 2018; ISBN 9783981891133. Available online: http://www.ren21.net (accessed on 31 December 2018).
  2. Wang, J.; Du, P.; Niu, T.; Yang, W. A novel hybrid system based on a new proposed algorithm—Multi-Objective Whale Optimization Algorithm for wind speed forecasting. Appl. Energy 2017, 208, 344–360. [Google Scholar] [CrossRef]
  3. Yan, J.; Liu, Y.; Han, S.; Wang, Y.; Feng, S. Reviews on uncertainty analysis of wind power forecasting. Renew. Sustain. Energy Rev. 2015, 52, 1322–1330. [Google Scholar] [CrossRef]
  4. Jiang, P.; Yang, H.; Heng, J. A hybrid forecasting system based on fuzzy time series and multi-objective optimization for wind speed forecasting. Appl. Energy 2019, 235, 786–801. [Google Scholar] [CrossRef]
  5. Niu, T.; Wang, J.; Lu, H.; Du, P. Uncertainty modeling for chaotic time series based on optimal multi-input multi-output architecture: Application to offshore wind speed. Energy Convers. Manag. 2018, 156, 597–617. [Google Scholar] [CrossRef]
  6. Li, R.; Jin, Y. A wind speed interval prediction system based on multi-objective optimization for machine learning method. Appl. Energy 2018, 228, 2207–2220. [Google Scholar] [CrossRef]
  7. Ma, X.; Jin, Y.; Dong, Q. A generalized dynamic fuzzy neural network based on singular spectrum analysis optimized by brain storm optimization for short-term wind speed forecasting. Appl. Soft Comput. J. 2017, 54, 296–312. [Google Scholar] [CrossRef]
  8. Wang, J.; Yang, W.; Du, P.; Niu, T. A novel hybrid forecasting system of wind speed based on a newly developed multi-objective sine cosine algorithm. Energy Convers. Manag. 2018, 163, 134–150. [Google Scholar] [CrossRef]
  9. Zhang, W.; Qu, Z.; Zhang, K.; Mao, W.; Ma, Y.; Fan, X. A combined model based on CEEMDAN and modified flower pollination algorithm for wind speed forecasting. Energy Convers. Manag. 2017, 136, 439–451. [Google Scholar] [CrossRef]
  10. Tian, C.; Hao, Y. A Novel Nonlinear Combined Forecasting System for Short-Term Load Forecasting. Energies 2018, 11, 712. [Google Scholar] [CrossRef]
  11. Becker, R.; Thrän, D. Optimal siting of wind farms in wind energy dominated power systems. Energies 2018, 11, 978. [Google Scholar] [CrossRef]
  12. Ganea, D.; Amortila, V.; Mereuta, E.; Rusu, E. A joint evaluation of the wind and wave energy resources close to the Greek Islands. Sustainability 2017, 9, 1025. [Google Scholar] [CrossRef]
  13. Onea, F.; Rusu, L. Evaluation of some state-of-the-art wind technologies in the nearshore of the black sea. Energies 2018, 11, 2452. [Google Scholar] [CrossRef]
  14. Kollet, S.; Gasper, F.; Brdar, S.; Goergen, K.; Hendricks-Franssen, H.-J.; Keune, J.; Kurtz, W.; Küll, V.; Pappenberger, F.; Poll, S.; et al. Introduction of an Experimental Terrestrial Forecasting/Monitoring System at Regional to Continental Scales Based on the Terrestrial Systems Modeling Platform (v1.1.0). Water 2018, 10, 1697. [Google Scholar] [CrossRef]
  15. Salvador, S.; Costoya, X.; Sanz-Larruga, F.J.; Gimeno, L. Development of offshore wind power: Contrasting optimal wind sites with legal restrictions in Galicia, Spain. Energies 2018, 11, 731. [Google Scholar] [CrossRef]
  16. Giménez, P.O.; García-Galiano, S.G. Assessing Regional Climate Models (RCMs) Ensemble-driven reference evapotranspiration over Spain. Water 2018, 10, 1181. [Google Scholar]
  17. Ganea, D.; Mereuta, E.; Rusu, L. Estimation of the Near Future Wind Power Potential in the Black Sea. Energies 2018, 11, 3198. [Google Scholar] [CrossRef]
  18. Pearre, N.S.; Swan, L.G. Statistical approach for improved wind speed forecasting for wind power production. Sustain. Energy Technol. Assess. 2018, 27, 180–191. [Google Scholar] [CrossRef]
  19. Hao, Y.; Tian, C. The study and application of a novel hybrid system for air quality early-warning. Appl. Soft Comput. J. 2019, 74, 729–746. [Google Scholar] [CrossRef]
  20. Taghi Sattari, M.; Yurekli, K.; Pal, M. Performance evaluation of artificial neural network approaches in forecasting reservoir inflow. Appl. Math. Model. 2012, 36, 2649–2657. [Google Scholar] [CrossRef]
  21. Liu, D.; Wang, J.; Wang, H. Short-term wind speed forecasting based on spectral clustering and optimised echo state networks. Renew. Energy 2015, 78, 599–608. [Google Scholar] [CrossRef]
  22. Yao, X.; Wang, Z.; Zhang, H. Neurocomputing A novel photovoltaic power forecasting model based on echo state network. Neurocomputing 2019, 325, 182–189. [Google Scholar] [CrossRef]
  23. Wang, J.; Yang, W.; Du, P.; Li, Y. Research and application of a hybrid forecasting framework based on multi-objective optimization for electrical power system. Energy 2018, 148, 59–78. [Google Scholar] [CrossRef]
  24. Li, Y.; Wu, H.; Liu, H. Multi-step wind speed forecasting using EWT decomposition, LSTM principal computing, RELM subordinate computing and IEWT reconstruction. Energy Convers. Manag. 2018, 167, 203–219. [Google Scholar] [CrossRef]
  25. Ahmed, A.; Khalid, M. An intelligent framework for short-term multi-step wind speed forecasting based on Functional Networks. Appl. Energy 2018, 225, 902–911. [Google Scholar] [CrossRef]
  26. Wang, J.; Du, P.; Lu, H.; Yang, W.; Niu, T. An improved grey model optimized by multi-objective ant lion optimization algorithm for annual electricity consumption forecasting. Appl. Soft Comput. J. 2018, 72, 321–337. [Google Scholar] [CrossRef]
  27. Zhao, X.; Wang, C.; Su, J.; Wang, J. Research and Application Based on the Swarm Intelligence Algorithm and Artificial Intelligence for Wind Farm Decision System. Renew. Energy 2019, 134, 681–697. [Google Scholar] [CrossRef]
  28. Jaeger, H.; Haas, H. Harnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless Communication. Science 2004, 304, 78–81. [Google Scholar] [CrossRef]
  29. Deihimi, A.; Orang, O.; Showkati, H. Short-term electric load and temperature forecasting using wavelet echo state networks with neural reconstruction. Energy 2013, 57, 382–401. [Google Scholar] [CrossRef]
  30. Güntürkün, U. Sequential reconstruction of driving-forces from nonlinear nonstationary dynamics. Phys. D Nonlinear Phenom. 2010, 239, 1095–1107. [Google Scholar] [CrossRef]
  31. Fu, T.; Wang, C. A hybrid wind speed forecasting method and wind energy resource analysis based on a swarm intelligence optimization algorithm and an artificial intelligence model. Sustainability 2018, 10, 3913. [Google Scholar] [CrossRef]
  32. Wang, Z.; Wang, C.; Wu, J. Wind energy potential assessment and forecasting research based on the data pre-processing technique and swarm intelligent optimization algorithms. Sustainability 2016, 8, 1191. [Google Scholar] [CrossRef]
  33. Shi, G.; Liu, D.; Wei, Q. Neurocomputing Energy consumption prediction of of fi ce buildings based on echo state networks. Neurocomputing 2016, 216, 478–488. [Google Scholar] [CrossRef]
  34. Rigamonti, M.; Baraldi, P.; Zio, E.; Roychoudhury, I.; Goebel, K.; Poll, S. Neurocomputing Ensemble of optimized echo state networks for remaining useful life prediction. Neurocomputing 2018, 281, 121–138. [Google Scholar] [CrossRef]
  35. Deihimi, A.; Showkati, H. Application of echo state networks in short-term electric load forecasting. Energy 2012, 39, 327–340. [Google Scholar] [CrossRef]
  36. Chouikhi, N.; Ammar, B.; Rokbani, N.; Alimi, A.M. PSO-based analysis of Echo State Network parameters for time series forecasting. Appl. Soft Comput. J. 2017, 55, 211–225. [Google Scholar] [CrossRef]
  37. Wang, L.; Lv, S.; Zeng, Y. Effective sparse adaboost method with ESN and FOA for industrial electricity consumption forecasting in China. Energy 2018, 155, 1013–1031. [Google Scholar] [CrossRef]
  38. Zhang, C.; Zhou, J.; Li, C.; Fu, W.; Peng, T. A compound structure of ELM based on feature selection and parameter optimization using hybrid backtracking search algorithm for wind speed forecasting. Energy Convers. Manag. 2017, 143, 360–376. [Google Scholar] [CrossRef]
  39. Du, P.; Wang, J.; Guo, Z.; Yang, W. Research and application of a novel hybrid forecasting system based on multi-objective optimization for wind speed forecasting. Energy Convers. Manag. 2017, 150, 90–107. [Google Scholar] [CrossRef]
  40. Naik, J.; Bisoi, R.; Dash, P.K. Prediction interval forecasting of wind speed and wind power using modes decomposition based low rank multi-kernel ridge regression. Renew. Energy 2018, 129, 357–383. [Google Scholar] [CrossRef]
  41. Shrivastava, N.A.; Lohia, K.; Panigrahi, B.K. A multiobjective framework for wind speed prediction interval forecasts. Renew. Energy 2016, 87, 903–910. [Google Scholar] [CrossRef]
  42. Khosravi, A.; Machado, L.; Nunes, R.O. Time-series prediction of wind speed using machine learning algorithms: A case study Osorio wind farm, Brazil. Appl. Energy 2018, 224, 550–566. [Google Scholar] [CrossRef]
  43. Torres, M.E.; Colominas, M.A.; Schlotthauer, G.; Flandrin, P. A complete ensemble empirical mode decomposition with adaptive noise. In Proceedings of the 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Prague, Czech Republic, 22–27 May 2011; pp. 4144–4147. [Google Scholar]
  44. Jaeger, H. The “echo state” approach to analysing and training recurrent neural networks—With an Erratum note 1. GMD Rep. 2010, 148, 1–47. [Google Scholar]
  45. Mirjalili, S.; Saremi, S.; Mirjalili, S.M.; Coelho, L.D.S. Multi-objective grey wolf optimizer: A novel algorithm for multi-criterion optimization. Expert Syst. Appl. 2016, 47, 106–119. [Google Scholar] [CrossRef]
  46. Mirjalili, S.; Mirjalili, S.M.; Lewis, A. Grey Wolf Optimizer. Adv. Eng. Softw. 2014, 69, 46–61. [Google Scholar] [CrossRef]
  47. Yang, W.; Wang, J.; Niu, T.; Du, P. A hybrid forecasting system based on a dual decomposition strategy and multi-objective optimization for electricity price forecasting. Appl. Energy 2019, 235, 1205–1225. [Google Scholar] [CrossRef]
  48. Jiang, P.; Ma, X. A hybrid forecasting approach applied in the electrical power system based on data preprocessing, optimization and artificial intelligence algorithms. Appl. Math. Model. 2016, 40, 10631–10649. [Google Scholar] [CrossRef]
  49. Wang, J.; Wang, Y.; Jiang, P. The study and application of a novel hybrid forecasting model—A case study of wind speed forecasting in China. Appl. Energy 2015, 143, 472–488. [Google Scholar] [CrossRef]
  50. Xiao, L.; Shao, W.; Wang, C.; Zhang, K.; Lu, H. Research and application of a hybrid model based on multi-objective optimization for electrical load forecasting. Appl. Energy 2016, 180, 213–233. [Google Scholar] [CrossRef]
  51. Zhang, C.; Wei, H.; Xie, L.; Shen, Y.; Zhang, K. Direct interval forecasting of wind speed using radial basis function neural networks in a multi-objective optimization framework. Neurocomputing 2016, 205, 53–63. [Google Scholar] [CrossRef]
  52. Wang, J.; Niu, T.; Lu, H.; Guo, Z.; Yang, W.; Du, P. An analysis-forecast system for uncertainty modeling of wind speed: A case study of large-scale wind farms. Appl. Energy 2018, 211, 492–512. [Google Scholar] [CrossRef]
  53. Qin, S.; Liu, F.; Wang, J.; Song, Y. Interval forecasts of a novelty hybrid model for wind speeds. Energy Rep. 2015, 1, 8–16. [Google Scholar] [CrossRef][Green Version]
  54. Inman, R.H.; Pedro, H.T.C.; Coimbra, C.F.M. Solar forecasting methods for renewable energy integration. Prog. Energy Combust. Sci. 2013, 39, 535–576. [Google Scholar] [CrossRef]
  55. Wang, J.; Song, Y.; Liu, F.; Hou, R. Analysis and application of forecasting models in wind power integration: A review of multi-step-ahead wind speed forecasting models. Renew. Sustain. Energy Rev. 2016, 60, 960–981. [Google Scholar] [CrossRef]
  56. Tian, C.; Hao, Y.; Hu, J. A novel wind speed forecasting system based on hybrid data preprocessing and multi-objective optimization. Appl. Energy 2018, 231, 301–319. [Google Scholar] [CrossRef]
Figure 1. The distribution of the global wind power capacity in 2017.
Figure 1. The distribution of the global wind power capacity in 2017.
Sustainability 11 00526 g001
Figure 2. The flowchart of the proposed system: (A) the data preprocessing module; (B) the input-output structure of the developed system; (C) the optimization flowchart of MOGWO; (D) the structure of forecasting method: Echo state network; (E) the forecasting results.
Figure 2. The flowchart of the proposed system: (A) the data preprocessing module; (B) the input-output structure of the developed system; (C) the optimization flowchart of MOGWO; (D) the structure of forecasting method: Echo state network; (E) the forecasting results.
Sustainability 11 00526 g002
Figure 3. Forecasting results of the proposed system in four seasons.
Figure 3. Forecasting results of the proposed system in four seasons.
Sustainability 11 00526 g003
Figure 4. Forecasting performance of the proposed system at different time intervals.
Figure 4. Forecasting performance of the proposed system at different time intervals.
Sustainability 11 00526 g004
Figure 5. The distribution and interval predictions: (a) the distribution of fitting error; (b) the interval prediction results.
Figure 5. The distribution and interval predictions: (a) the distribution of fitting error; (b) the interval prediction results.
Sustainability 11 00526 g005
Table 1. Evaluation Metrics.
Table 1. Evaluation Metrics.
MetricDefinitionEquation
MAPEMean absolute percentage error M A P E = 1 n × i = 1 n | ( a i f i ) / a i | × 100 %
AEAverage error of n forecast result A E = 1 n × i = 1 n ( a i f i )
RMSERoot mean-square error R M S E = 1 n × i = 1 n ( a i f i ) 2
MdAPEMedian absolute percentage error M d A P E = m e d i a n ( | f i a i / a i | × 100 % )
FBFractional bias of n forecast result F B = 2 ( a ¯ f ¯ ) / ( a ¯ + f ¯ )
IAIndex agreement of the forecast result I A = 1 i = 1 n ( f i a i ) 2 / i = 1 n ( | f i a ¯ | + | a i + a ¯ | ) 2
U1Theil U statistical 1 of forecast result U 1 = 1 n × i = 1 n ( a i f i ) 2 / 1 n × i = 1 n f 2 + 1 n × i = 1 n a i 2
U2Theil U statistical 2 of forecast result U 2 = 1 n × i = 1 n ( ( f i + 1 a i + 1 ) / f i ) 2 / 1 n × i = 1 n ( ( f i + 1 a i ) / f i ) 2
rPearson’s correlation coefficient r = ( a i f i a i f i / n ) / ( f i 2 ( f i ) 2 / n ) ( a i 2 ( a i ) 2 / n )
Table 2. The statistic values of all datasets. (Source: Penglai Wind Farm).
Table 2. The statistic values of all datasets. (Source: Penglai Wind Farm).
DatasetSeason and IntervalStatistic Values (m/s)
Ave.Max.MedianMin.Std.
Dataset A
All SamplesSpring7.630219.40007.50000.80003.2133
Training Set6.887814.70007.00000.80002.6857
Testing Set10.599819.400010.50003.20003.4300
Dataset B
All SamplesSummer4.708220.50004.00000.50003.0102
Training Set4.400920.50003.40000.50003.2498
Testing Set5.93759.70005.90003.20001.0849
Dataset C
All SamplesAutumn5.682313.20005.50000.90002.2510
Training Set5.711513.20005.50000.90002.3488
Testing Set5.565311.70005.40002.30001.8044
Dataset D
All SamplesWinter9.424118.10009.20002.30002.8516
Training Set9.759218.10009.70002.30002.9562
Testing Set8.083712.80008.15002.50001.8609
Dataset E
All Samples10 min9.589118.70009.30002.00003.2041
Training Set9.934418.70009.90002.00003.3645
Testing Set8.207813.30008.30002.70001.9176
Dataset F
All Samples30 min8.268219.50008.00001.30003.3120
Training Set8.410618.20008.10001.30003.2873
Testing Set7.698319.50007.20001.50003.3518
Dataset G
All Samples10 min7.395118.20006.60001.00003.2506
Training Set7.747018.20007.10001.00003.3104
Testing Set5.987712.40005.30001.20002.5563
Dataset H
All Samples30 min7.506818.30007.20000.90003.1448
Training Set7.714018.30007.50000.90003.2272
Testing Set6.678314.70006.50000.90002.6350
Table 3. Results of Experiment I.
Table 3. Results of Experiment I.
DatasetModelAEMAPERMSEMdAPEFBrIAU1U2TIME (s)
Spring
Dataset APersistence Model−0.00697.06510.90940.05310.00070.96500.98220.04100.70960.0105
ARIMA−0.02956.95940.89400.05470.00280.96570.98240.04030.7072211.2213
GRNN−0.52899.43391.46250.07490.05140.92870.94200.06800.81231.2176
WNN−0.64249.52461.77330.07350.06270.88870.90990.08310.82112.7442
ESN−0.10297.11560.92580.05480.00980.96360.98100.04190.71580.9458
EMD-MOGWO-ESN−0.01934.05200.51220.03310.00180.98890.99440.02310.5817189.2712
VMD-MOGWO-ESN−0.01085.59780.69210.04130.00100.98010.98920.03120.8985238.5490
CEEMDAN-MOGWO-ESN−0.02943.14900.41820.02420.00280.99270.99620.01890.4680449.3265
CEEMDAN-MOPSO-ESN−0.11646.25680.80000.04670.01110.97330.98570.03630.6756480.3966
CEEMDAN-MOWCA-ESN0.00493.25300.43560.0247−0.00050.99200.99600.01960.4799308.7396
Summer
Dataset BPersistence Model−0.00046.30720.48740.04970.00010.89870.94730.04030.71530.0130
ARIMA−0.00117.69670.59390.06050.00020.85040.92090.04910.7759253.2662
GRNN−0.16777.41530.56480.06260.02860.86860.92270.04740.79411.2075
WNN−0.12026.55690.51250.05120.02040.88840.93660.04280.75002.7869
ESN−0.09796.40670.49530.05230.01660.89570.94300.04130.73580.9696
EMD-MOGWO-ESN−0.02673.80150.28270.03300.00450.96580.98240.02340.6034193.5132
VMD-MOGWO-ESN−0.01694.87810.35760.03950.00280.94710.96820.02960.8462196.6962
CEEMDAN-MOGWO-ESN−0.01853.00510.23210.02380.00310.97700.98790.01920.4789312.1663
CEEMDAN-MOPSO-ESN−0.03326.02920.44650.05110.00560.91440.95540.03700.6961456.7801
CEEMDAN-MOWCA-ESN−0.02873.17380.24250.02620.00480.97500.98700.02010.5069337.8480
Autumn
Dataset CPersistence Model0.00216.56230.43710.0515−0.00040.97070.98510.03720.78780.0168
ARIMA0.02937.50860.49370.0592−0.00520.96220.98060.04200.8218217.7421
GRNN−0.01636.87880.46020.05280.00290.96700.98290.03930.80271.2009
WNN0.16517.96100.48400.0556−0.02910.97000.98000.04080.80172.8116
ESN0.00046.58270.43440.0509−0.00010.97070.98500.03700.78261.0093
EMD-MOGWO-ESN0.00583.85540.24640.0303−0.00100.99070.99530.02100.6131180.8671
VMD-MOGWO-ESN−0.00335.54120.36050.04060.00060.98090.98930.03080.8689188.5874
CEEMDAN-MOGWO-ESN0.00313.06180.20260.0230−0.00050.99370.99680.01720.4978435.9351
CEEMDAN-MOPSO-ESN0.00555.84610.38480.0451−0.00100.97710.98820.03280.6989542.4545
CEEMDAN-MOWCA-ESN0.00724.30070.28550.0305−0.00130.98740.99360.02430.6066305.6523
Winter
Dataset DPersistence Model0.01295.36050.61080.0419−0.00160.94370.97110.03680.75830.0113
ARIMA0.02387.21110.80770.0559−0.00290.90250.94920.04860.8668219.5740
GRNN0.03915.86290.62830.0438−0.00480.93870.96730.03790.81941.8741
WNN0.19306.21140.63110.0460−0.02360.94390.96770.03770.80973.0436
ESN0.04035.39310.59370.0396−0.00500.94560.97140.03580.77680.9342
EMD-MOGWO-ESN0.01993.49070.37150.0288−0.00250.97900.98930.02240.6482192.9672
VMD-MOGWO-ESN0.01244.35560.46580.0327−0.00150.96780.98200.02810.8091199.8609
CEEMDAN-MOGWO-ESN0.00982.61800.30530.0206−0.00120.98580.99280.01840.5426434.4075
CEEMDAN-MOPSO-ESN0.03744.78310.52220.0363−0.00460.95840.97860.03140.7165558.1496
CEEMDAN-MOWCA-ESN0.00342.73430.31700.0206−0.00040.98470.99220.01910.5528318.4237
Note: The bolded values are the best values.
Table 4. Forecasting performance at Penglai site 2.
Table 4. Forecasting performance at Penglai site 2.
DatasetModelAEMAPERMSEMdAPEFBrIAU1U2TIME (s)
10 min
Dataset EPersistence Model0.01255.37930.64340.0427−0.00150.94110.96970.03820.75180.0096
ARIMA0.03757.27810.84970.0540−0.00460.89790.94650.05030.8580224.4170
GRNN0.03605.97030.66480.0439−0.00440.93520.96540.03940.81011.1879
WNN0.30957.30640.71580.0541−0.03700.93970.95890.04180.83682.8472
ESN0.02895.41020.62420.0405−0.00350.94320.97040.03700.76650.8773
EMD-MOGWO-ESN0.01703.37750.39370.0270−0.00210.97770.98860.02340.6803175.0164
VMD-MOGWO-ESN0.00583.88820.45790.0274−0.00070.97030.98390.02720.8890180.0621
CEEMDAN-MOGWO-ESN0.00352.62270.31130.0190−0.00040.98610.99290.01850.5264433.6128
CEEMDAN-MOPSO-ESN0.05124.84470.55000.0360−0.00620.95650.97750.03260.7108446.8051
CEEMDAN-MOWCA-ESN0.00942.80240.32730.0216−0.00110.98470.99220.01940.5518505.6086
30 min
Dataset FPersistence Model0.000410.33140.95440.07360.00000.95990.97960.05690.76780.0216
ARIMA−0.016612.48511.13190.08920.00220.94270.97050.06770.8307217.0166
GRNN0.016311.80851.00370.0834−0.00210.95510.97560.06010.79501.9596
WNN0.212312.93291.02530.0846−0.02730.95840.97330.06100.80602.8900
ESN0.038910.68390.93730.0728−0.00510.96080.97920.05600.75060.8695
EMD-MOGWO-ESN−0.00936.17780.57110.04780.00120.98560.99260.03410.6243173.2602
VMD-MOGWO-ESN0.00229.61310.79050.0621−0.00030.97300.98510.04740.8869175.1273
CEEMDAN-MOGWO-ESN0.01214.96630.45500.0347−0.00160.99100.99530.02720.5196403.4519
CEEMDAN-MOPSO-ESN0.03969.07740.79300.0638−0.00510.97210.98540.04730.6756569.2328
CEEMDAN-MOWCA-ESN0.01875.89100.52930.0427−0.00240.98770.99360.03160.5498572.0835
Note: The bolded values are the best values.
Table 5. Forecasting performance at Penglai site 3.
Table 5. Forecasting performance at Penglai site 3.
DatasetModelAEMAPERMSEMdAPEFBrIAU1U2TIME (s)
10 min
Dataset GPersistence Model0.00194.93690.41110.0417−0.00030.98680.99330.03130.69850.0129
ARIMA0.01135.88010.47900.0470−0.00 190.98190.99080.03650.7496224.4170
GRNN0.01506.67870.49730.0521−0.00250.98070.98980.03800.78471.1958
WNN−0.03696.08380.45010.04180.00610.98540.99150.03460.80832.7610
ESN0.02505.18740.41400.0414−0.00410.98660.99310.03150.70790.9250
EMD-MOGWO-ESN0.00762.92810.23780.0245−0.00130.99560.99780.01810.5539184.8949
VMD-MOGWO-ESN−0.00194.13520.32150.03410.00030.99200.99580.02450.8627203.6287
CEEMDAN-MOGWO-ESN0.00672.62760.20010.0203−0.00110.99690.99840.01530.5064437.2306
CEEMDAN-MOPSO-ESN0.00845.05730.38700.0396−0.00140.98820.99400.02950.6870695.8269
CEEMDAN-MOWCA-ESN0.01153.68280.28980.0296−0.00190.99340.99670.02210.5832482.3285
30 min
Dataset HPersistence Model−0.005312.96211.03340.09400.00080.92390.96080.07190.70000.0125
ARIMA0.025014.83701.14310.1005−0.00370.90480.95050.07960.7215217.0166
GRNN0.046616.83121.11710.1067−0.00690.90680.94950.07800.84122.1636
WNN−0.077517.81251.10960.10630.01170.90840.95020.07810.94462.8652
ESN0.036813.78801.02900.0937−0.00550.92190.95900.07170.69931.1308
EMD-MOGWO-ESN0.02688.22310.61640.0645−0.00400.97270.98610.04290.5817174.0264
VMD-MOGWO-ESN−0.003710.70470.74560.07490.00050.96140.97770.05220.8418170.0751
CEEMDAN-MOGWO-ESN0.00895.91780.46120.0457−0.00130.98470.99220.03210.4449451.9599
CEEMDAN-MOPSO-ESN0.093811.90540.85860.0837−0.01390.94690.97240.05950.6612512.7695
CEEMDAN-MOWCA-ESN0.01516.22130.48120.0462−0.00230.98340.99150.03350.4770480.7268
Note: The bolded values are the best values.
Table 6. Forecasting results evaluated by the forecasting effectiveness (FE) and grey relational degree (GRD).
Table 6. Forecasting results evaluated by the forecasting effectiveness (FE) and grey relational degree (GRD).
ModelsDataset ADataset BDataset CDataset D
FE-1FE-2GRDFE-1FE-2GRDFE-1FE-2GRDFE-1FE-2GRD
Persistence Model0.92950.86910.88710.93680.88590.77510.93450.87740.79190.94650.90210.8653
ARIMA0.93060.87020.88750.92270.86020.74560.92510.86160.76890.92800.86880.8336
GRNN0.90570.83040.84950.92580.87210.74700.93140.87120.78230.94140.89100.8589
WNN0.90490.82300.84040.92580.87210.74700.92020.84780.78560.93780.88300.8644
ESN0.92950.86880.88570.93600.88710.77120.93450.87810.78970.94570.89910.8670
EMD-MOGWO-ESN0.95960.92740.92900.96200.93490.84130.96140.92880.85790.96510.93950.9034
VMD-MOGWO-ESN0.94420.89040.91010.95140.91530.81550.94470.89430.82030.95650.91720.8882
CEEMDAN-MOGWO-ESN0.96860.94090.94340.96990.94510.86970.96940.94230.88380.97380.95080.9252
CEEMDAN-MOPSO-ESN0.93760.88350.89970.93970.89470.77800.94160.88900.80560.95220.91480.8771
CEEMDAN-MOWCA-ESN0.96760.93850.94190.96820.94350.86390.95700.91880.84680.97270.94840.9230
Dataset EDataset FDataset GDataset H
FE-1FE-2GRDFE-1FE-2GRDFE-1FE-2GRDFE-1FE-2GRD
Persistence Model0.94610.89820.85530.89690.80650.79340.95070.91100.82550.87270.76320.8560
ARIMA0.92720.86500.81970.87540.76600.76470.94120.89460.80160.85500.73400.8420
GRNN0.94030.88630.84750.88230.76790.78050.93240.87580.79170.84410.69300.8403
WNN0.92680.86350.85620.87160.74160.78890.93780.87270.81150.84780.69560.8398
ESN0.94600.89790.85730.89350.79210.79230.94790.90500.82170.86490.74000.8547
EMD-MOGWO-ESN0.96620.93830.89940.93820.88760.85330.97030.94830.88180.91800.84320.8999
VMD-MOGWO-ESN0.96110.92470.88800.90490.80490.81330.95870.92530.85060.89340.78100.8832
CEEMDAN-MOGWO-ESN0.97380.95010.91950.95040.90330.88350.97370.95280.89450.94100.88480.9231
CEEMDAN-MOPSO-ESN0.95150.90920.86760.90990.82840.81400.94900.90870.82360.88240.77220.8712
CEEMDAN-MOWCA-ESN0.97190.94750.91440.94120.88720.86780.96300.93520.86000.93800.87990.9209
Note: The bolded values are the best values.
Table 7. The parameters of the fitted distribution.
Table 7. The parameters of the fitted distribution.
Dataset DGaussianGeneralized Extreme ValueExtreme ValueLogistic
Log likelihood−930.9960−942.6690−1170.9600−934.9160
mean0.00120.0035−0.0329−0.0016
variance0.13180.13680.23320.1380
μ0.0012−0.13620.1845−0.0016
standard error of μ0.00760.00810.00830.0074
σ0.36300.35840.37650.2048
standard error of σ0.00540.00550.00550.0036
k-−0.2272--
standard error of k-0.0091--
Dataset EGaussianGeneralized Extreme ValueExtreme ValueLogistic
Log likelihood−349.9050−410.3980−683.6500−298.6460
mean0.00310.0101−0.03660.0010
variance0.07940.09120.16380.0774
μ0.0031−0.10780.14550.0010
standard error of μ0.00590.00630.00700.0055
σ0.28190.28640.31550.1533
standard error of σ0.00420.00410.00430.0027
k-−0.1963--
standard error of k-0.0052--
Note: mu is the location parameter, sigma is the scale parameter, and k is the shape parameter.
Table 8. The interval prediction results.
Table 8. The interval prediction results.
Dataset DDataset E
LogsitcAWCPAWDCWCSCOREAWCPAWDCWCSCORE
95%0.24760.99300.00050.24760.25990.10420.98770.00160.10420.1176
90%0.20760.98940.00140.20760.43910.08750.97890.00350.08750.1984
85%0.17710.98590.00260.17710.56650.07660.95250.00640.07660.2641
80%0.15490.97360.00440.15490.66600.07660.92250.01130.06820.3217
70%0.12230.94190.01090.12230.81070.05510.87150.02620.05510.4118
GaussianAWCPAWDCWCSCOREAWCPAWDCWCSCORE
95%0.13820.96130.00700.13820.18190.18681.00000.00000.18680.1980
90%0.11600.93490.01320.11600.30200.15661.00000.00000.15660.3320
85%0.10150.92430.02000.10150.39720.13360.99470.00020.13360.4261
80%0.10150.90490.02760.09030.47500.11690.99120.00080.11690.4995
70%0.07310.85390.04790.07310.59560.09220.98420.00280.09220.5977
Table 9. Diebold-Mariano (DM) testing results.
Table 9. Diebold-Mariano (DM) testing results.
ABCD
Persistence Model13.3187 *12.9513 *12.6671 *8.1898 *
ARIMA13.0006 *13.4601 *12.5768 *9.2973 *
GRNN10.5674 *13.7422 *10.5380 *10.0814 *
WNN7.4073 *13.7422 *14.2305 *10.6963 *
ESN13.3169 *13.2641 *11.9711 *9.1079 *
EMD-MOGWO-ESN7.2237 *6.3326 *7.1805 *7.9541 *
VMD-MOGWO-ESN10.0639 *10.2589 *9.9589 *7.3974 *
CEEMDAN-MOPSO-ESN11.3384 *13.2077 *11.3404 *9.9578 *
CEEMDAN-MOWCA-ESN1.6639 **2.2310 **9.2580 *2.2757 *
CEEMDAN-MOGWO-ESN----
EFGH
Persistence Model8.5112 *13.0287 *10.3597 *8.2681 *
ARIMA9.1672 *13.2538 *10.6310 *8.4434 *
GRNN9.5440 *13.5054 *10.5109 *9.2060 *
WNN11.6328 *12.7312 *9.8560 *9.5584 *
ESN8.8501 *13.2789 *10.4335 *8.1068 *
EMD-MOGWO-ESN6.9389 *7.2450 *3.9875 *9.3627 *
VMD-MOGWO-ESN6.7317 *9.9688 *7.6672 *10.3465 *
CEEMDAN-MOPSO-ESN9.1159 *12.1795 *10.3353 *8.5915 *
CEEMDAN-MOWCA-ESN3.1295 *6.5649 *8.4737 *2.6876 *
CEEMDAN-MOGWO-ESN----
* is at the 1% significance level; ** is at the 10% significance level.
Table 10. Forecasting stability results.
Table 10. Forecasting stability results.
ABCDEFGH
Persistence Model0.82600.23810.19080.37230.41350.90990.16871.0664
ARIMA0.79740.35500.24240.65070.71971.27980.22891.3046
GRNN1.85670.29180.21120.39270.44011.00540.24751.2462
WNN2.72760.29180.20690.36050.41631.00530.20341.2252
ESN0.83590.23410.18690.35260.38750.87430.17081.0588
EMD-MOGWO-ESN0.26190.07920.06070.13740.15450.32650.05660.3787
VMD-MOGWO-ESN0.47810.12740.12980.21650.20940.62380.10320.5551
CEEMDAN-MOGWO-ESN0.17370.05360.04100.09310.09680.20700.03990.2124
CEEMDAN-MOPSO-ESN0.62540.19830.14790.27100.29970.62470.14980.7273
CEEMDAN-MOWCA-ESN0.18950.05820.08140.10030.10700.27970.08380.2310
Note: The bolded values are the best values.
Table 11. The sensitivity analysis results.
Table 11. The sensitivity analysis results.
NumberAEMAPERMSEMDAPEFBRIAU1U2TIME
Grey Wolves Number500.01072.67340.20270.0204−0.00180.99680.99840.01540.5179183.2840
1000.00562.67590.21460.0232−0.00090.99640.99820.01640.5016252.7143
1500.01502.65290.21180.0209−0.00250.99650.99820.01610.4930376.3458
2000.00672.62760.20010.0203−0.00110.99690.99840.01530.5064437.2306
2500.00962.69430.20870.0231−0.00160.99660.99830.01590.5010535.9080
Iterations300.00882.70230.20690.0216−0.00150.99670.99830.01580.5159325.0705
400.00682.69980.20610.0217−0.00110.99670.99830.01570.5228371.3325
500.00672.62760.20010.0203−0.00110.99690.99840.01530.5064437.2306
600.00932.63270.20300.0215−0.00150.99680.99840.01550.4996531.0117
700.00742.63460.20550.0208−0.00120.99670.99830.01570.4997596.1518
Archive size500.01202.67760.21300.0224−0.00200.99650.99820.01620.5099455.5368
700.01382.65580.20310.0214−0.00230.99680.99840.01550.5036420.2421
1000.00672.62760.20010.0203−0.00110.99690.99840.01530.5064437.2306
1500.00812.65620.20380.0200−0.00130.99680.99840.01550.5209418.6188
1800.00832.79980.21200.0226−0.00140.99650.99820.01620.5426422.0142
Note: The bolded values are the results of the best parameters.
Table 12. Multistep foresting results of the developed system.
Table 12. Multistep foresting results of the developed system.
Dataset A1-Step2-Step3-Step
AEMAPERMSEAEMAPERMSEAEMAPERMSE
Persistence Model−0.00697.06510.9094−0.01759.81311.2315−0.026311.72691.4890
ARIMA−0.02956.95940.8940−0.03357.07460.9095−0.02927.07060.9130
GRNN−0.52899.43391.4625−0.620812.09561.7010−0.724214.01281.9332
WNN−0.64249.52461.7733−0.824913.00472.1967−0.905815.10442.4616
ESN−0.10297.11560.9258−0.21309.98131.2675−0.302411.90221.5398
EMD-MOGWO-ESN−0.01934.05200.5122−0.05226.39620.8779−0.09229.75651.3107
CEEMDAN-MOGWO-ESN−0.02943.14900.4182−0.10276.04690.7778−0.19189.56521.2177
CEEMDAN-MOPSO-ESN−0.11646.25680.8000−0.22999.05151.1618−0.364411.68571.4987
CEEMDAN-MOWCA-ESN0.00493.25300.43560.00616.33850.83770.006510.17701.3556
Dataset C1-Step2-Step3-Step
AEMAPERMSEAEMAPERMSEAEMAPERMSE
Persistence Model0.00216.56230.43710.00398.31480.57210.005810.21730.6808
ARIMA0.02937.50860.49370.02687.18510.47220.02507.24640.4741
GRNN−0.01636.87880.4602−0.03498.71380.5976−0.049810.13680.6879
WNN0.16517.96100.48400.309911.96120.71140.468616.27160.9189
ESN0.00046.58270.43440.00098.30050.57000.002310.20970.6833
EMD-MOGWO-ESN0.00583.85540.24640.01515.99080.39890.02828.64730.5727
CEEMDAN-MOGWO-ESN0.00313.06180.20260.00585.87200.38600.00978.83440.5804
CEEMDAN-MOPSO-ESN0.00555.84610.38480.01598.47500.56060.026310.80270.7095
CEEMDAN-MOWCA-ESN0.00724.30070.28550.01607.36560.48150.028210.67720.6897
Note: The bolded values are the best values.

© 2019 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
Sustainability EISSN 2071-1050 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert
Back to Top