Next Article in Journal
Experimental and Numerical Analyses of a Flat Plate Photovoltaic/Thermal Solar Collector
Next Article in Special Issue
A Hierarchical Optimization Model for a Network of Electric Vehicle Charging Stations
Previous Article in Journal
Impact of Copper Loading on NH3-Selective Catalytic Reduction, Oxidation Reactions and N2O Formation over Cu/SAPO-34
Previous Article in Special Issue
A Review of Smart Cities Based on the Internet of Things Concept
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Research and Application of Hybrid Forecasting Model Based on an Optimal Feature Selection System—A Case Study on Electrical Load Forecasting

1
School of Mathematics and Statics, Lanzhou University, Lanzhou 730000, China
2
School of Statistics, Dongbei University of Finance & Economics, Dalian 116000, China
3
State Key Laboratory of Numerical Modeling for Atmospheric Sciences and Geophysical Fluid Dynamics, Institute of Atmospheric Physics, Chinese Academy of Sciences, Beijing 10029, China
*
Author to whom correspondence should be addressed.
Energies 2017, 10(4), 490; https://doi.org/10.3390/en10040490
Submission received: 30 January 2017 / Revised: 10 March 2017 / Accepted: 27 March 2017 / Published: 5 April 2017
(This article belongs to the Special Issue Innovative Methods for Smart Grids Planning and Management)

Abstract

:
The process of modernizing smart grid prominently increases the complexity and uncertainty in scheduling and operation of power systems, and, in order to develop a more reliable, flexible, efficient and resilient grid, electrical load forecasting is not only an important key but is still a difficult and challenging task as well. In this paper, a short-term electrical load forecasting model, with a unit for feature learning named Pyramid System and recurrent neural networks, has been developed and it can effectively promote the stability and security of the power grid. Nine types of methods for feature learning are compared in this work to select the best one for learning target, and two criteria have been employed to evaluate the accuracy of the prediction intervals. Furthermore, an electrical load forecasting method based on recurrent neural networks has been formed to achieve the relational diagram of historical data, and, to be specific, the proposed techniques are applied to electrical load forecasting using the data collected from New South Wales, Australia. The simulation results show that the proposed hybrid models can not only satisfactorily approximate the actual value but they are also able to be effective tools in the planning of smart grids.

Graphical Abstract

1. Introduction

Electrical Load (EL) forecasting is a fundamental and vital task for economically efficient operation and controlling of power systems [1,2,3,4,5]. It has often been employed for energy management, unit commitment and load dispatch [6,7,8,9,10,11,12,13,14]. The high accuracy of load forecasting guarantees the safe and stable operation of power systems [15,16,17]. Therefore, it is necessary to improve the reliability and the forecasting accuracy of smart grids [18,19,20]. Reliable EL forecasting is able to decrease energy consumption and reduce environmental pollution [21,22,23,24].
However, EL forecasting is difficult because the time series of EL are complex and non-linear with daily, weekly and annual cycles. It includes random components owing to fluctuation in the electricity usage of individual users, large industrial with irregular hours of operations, holidays and even sudden weather condition [25,26,27,28,29,30,31,32,33,34,35,36,37]. Furthermore, EL forecasting incorporating Very Short Term Load Forecasting (VSTLF), Short-Term Load Forecasting (STLF) and Long-Term Load Forecasting (LTLF) is very important to power system security and economy, especially in the electricity market [38,39]. VSTLF and STLF are both employed to set up necessary basis for dispatching the power grid. The VSTLF mainly focuses on the load forecasting within 1 h, and one of the most important purposes for VSTLF is to optimize the daily power generation plan; in addition, the VSTLF could be employed for cold stand-by and spinning reserve. In the meantime, both VSTLF and STLF could be used to adjust the plan for overhaul on power grid. Some papers have obtained good results for VSTLF [40,41,42,43,44], but it is still a difficult task to dispatch and manage the power gird. Furthermore, compared to VSTLF, the application of STLF is more extensive with even greater difficulty [45]. Therefore, improving the accuracy of STLF is one of the most important means to improve the management of power systems for forecasting the EL accurately can save valuable time to manage smart grid in advance before a significant variation [30,37].
It is obvious from the literature reviews that studies at EL forecasting still play a vital part in the electrical power system, which will have a great effect on its planning and operation. Therefore, it is very desirable to develop an EL forecasting model of higher accuracy. In order to achieve accurate and stable STLF, a large number of approaches have been employed, among which Statistical Methods (SM), Machine Learning Approaches (MLA) and Hybrid Approaches (HA) are the mainstream [42,43,44,45,46,47,48,49,50,51,52,53,54,55,56,57,58,59,60,61].
The Statistical Methods (SM), such as Autoregressive Integrated Moving Average (ARIMA) and Auto Regressive Moving Average (ARMA), have good real-time performance when compared with other models [62,63,64]. In ARIMA, there is an additional parameter called differencing degree, which means the number of non-seasonal differences to fine tune the models to be more accurate on the basis of ARMA [65,66]. Feinberg and Eugene A [10] have employed fractional-ARIMA model to forecast the load at multiple time points over a time span between 1 and 24 h. Through comparing the proposed models with other methods, the experimental results showed that the hybrid model could improve the forecasting accuracy to a large degree. Steinherz and Pappas [67] evaluated the development of electricity markets through combining ARMA with GARCH (Generalized AutoRegressive Conditional Heteroskedasticity). These models were preferred for estimating load on electricity markets. Pappas et al. [68] presented a new method for electricity demand load forecasting with the multi-model partitioning theory and compared its effectiveness with three other well established time series analysis techniques, including Schwarz’s Bayesian Information Criterion (BIC), Akaike’s Information Criterion (AIC) and Corrected Akaike Information Criterion (AICC). The experimental results indicated that the proposed model had been effective in load forecasting. However, such methods cannot properly represent the complex nonlinear relationship between the load and a variety of stochastic factors such as hourly, daily, weekly and monthly time periodicity and social events that could cause unpredictable variations in power demand.
In view of the outstanding ability for nonlinear systems, ANNs have been extensively applied to STLF [69,70,71,72,73,74,75,76,77], and the different Artificial Neural Network (ANN) models, with and without load profiling, have been verified in previous studies. The neural network model had a multilayer perception architecture 5-5-1 with hyperbolic tangent function in the hidden layer and linear function in the output layer. The experiments showed that the coefficient of determination was above 0.9, which indicated the high effect of the model. Chaturvedi et al. [73] utilized a Generalized Neural Network (GNN) for the EL forecasting to overcome the drawbacks of ANN. GNN combined with fuzzy system and adaptive genetic algorithm was presented to be the most effective forecasting model. Lou and Dong [74] modeled fuzzy and random uncertainties of electric load forecasting based on the random fuzzy variables. Then a novel technique—Random Fuzzy Neural Network (RFNN) was obtained and the model was promising in micro grids and small power systems.
To improve the forecasting accuracy and stability, ANNs are often combined with other techniques, such as wavelet transforms, to build a hybrid model according to the characteristics of the functional system, as described in several articles [78,79,80,81,82,83]. Ghelardoni et al. [71] used Secondary Decomposition Algorithm (SDA) and the Support Vector Machine (SVM) to predict the load. In addition, the Fast Ensemble Empirical Mode Decomposition (FEEMD) and Wavelet Packet Decomposition (WPD) are applied to de-noise the original time series data, and then the final results demonstrated that the proposed methods are effective in load forecasting. Hong [84] presented an electric load forecasting model that combined the seasonal recurrent support vector regression model with chaotic artificial bee colony algorithm in order to reduce the forecasting errors. The final experimental results demonstrated that the model was a promising alternative for the forecasting of EL. Nie et al. [85] combined Support Vector Machine (SVM) and ARIMA to forecast the short-term EL. After testing the effectiveness of the model by a large sample, the results showed that the hybrid model was valid in the time series forecasting. Bahrami et al. [86] developed a new hybrid model based on the combination of Wavelet Transform (WT) and Grey Model (GM) to realize the short-term forecasting and the Particle Swarm Optimization (PSO) had been applied to optimize the model. The simulation results confirmed that the hybrid model had favorable performance for short-term EL forecasting compared with other models.
From the review above, it could be found that the hybrid forecasting models are more popular in time series forecasting, because they are more effective compared with the single models and can save the computational time. Besides, the feature learning of original data is useful in reducing the forecasting errors.
The primary purpose of this paper is to propose a hybrid neural network model (P-ENN-ARSR) to predict the EL based on pyramid system. Initially, the Pyramid Data Recognize System (PDRS) is designed as a Delay Calculation Operator (DCO) in P-ENN, which network is able to store the characteristics of a period of data. Then, the P-ENN with an Auto-Recurrence Spline Rolling model (ARSR) is utilized to short-term load forecasting (STLF). The results of the power consumption forecasting model have been tested by using the data of New South Wales, Australia. Furthermore, for evaluating the forecasting accuracy of load forecasting, we have developed a Forecasting Validity Degree (FVD) which could appraise the electrical load forecasting with effectiveness and reliability. In addition, in order to prove the effectiveness of the proposed hybrid model, three experiments are performed to examine the validity of EL prediction. The major contributions of this paper are as follows:
(1)
A new feature learning method called Pyramid Data Classification System, designed to recognize and store the features of original data, is built for recurrent neural networks to improve the forecasting accuracy.
(2)
A novel hybrid model incorporating ENN and ARSR, which is both an effective and simple tool, has been proposed to deal with the data with different features for performing the EL forecasting.
(3)
A new evaluation method has been formed, which is called improved forecasting validity degree (IFVD). It is developed according to its basic form of forecasting validity degree. This evaluation metrics is more sensitive to the trend change of the data and can identify the performance of the model more accurately.
The rest of this paper is organized as follows: Section 2 explains the methodology that is used in the research, and evaluation metrics of the model is presented in Section 3. Section 4 shows the three experimental results to prove the effectiveness of the hybrid model presented in this paper. Finally, Section 5 contains the conclusion.

2. Methodology

The hybrid model developed in this paper is based on the preprocessing of the original time series, Elman neural network model (ENN) and Auto-Recurrence Spline Rolling model (ARSR); therefore, this section introduces the two methods, respectively.

2.1. The Pyramid Data Classification System

The Pyramid data classification system used to preprocess the original data is developed based on an index of Electric-chi-square. When the original data have been input into the Pyramid system, both the short-term data and the long-term data could be considered as variations with time. The selection of a group of the data is placed in the bottom of a Pyramid. The top data are calculated by the underlying data, and the top floor of the data after conversion is called the Electric-chi-square index. Each term of the data will obtain its own index. According to the different indexes, the data series are divided into different categories. Table 1 illustrates the structure of Pyramid data classification system and the pseudo code is listed below.
Remark 1.
The pyramid system is a developed type of feature learning method based on the data. Considering the features of the power consumption data, if the interval of the data sample is reduced to 10 min, then the effect of classification could be more obvious.
Algorithm: Pyramid System.
Input: x ( 0 ) = ( x ( 0 ) ( 1 ) , x ( 0 ) ( 2 ) , , x ( 0 ) ( l ) ) —a sequence of the sample data.
Output: x ˜ ( 0 ) = ( x ˜ ( 0 ) ( l + 1 ) , x ˜ ( 0 ) ( l + 2 ) , , x ˜ ( 0 ) ( l + n ) ) —a sequence of the forecasting data.
Parameters:
l—The number of sample data to build the Pyramid system in each rolling loop.
m—The number of forecasting data in each loop, namely n data to be forecasted in total.
n —An integer number which is called rolling number and k = m .
1: R s = ( x ( 0 ) ( 1 ) , x ( 0 ) ( 2 ) , , x ( 0 ) ( l ) ) /* it was able to set up before the program began*/
2: Build Pyramid/*a Pyramid system with the data set for feature learning */
3: While ( k < m ) Do/* only on the first occasion has it ever been announced */
4: Calculate R ˜ m /* A developed index of feature learning method based on the data */
R ˜ m = ( x ( 0 ) ( 1 + ( k 1 ) m + 1 ) , x ( 0 ) ( 1 + ( k 1 ) m + 2 ) , , x ( 0 ) ( 1 + k m ) )
x ˜ ( 0 ) ( l ) = ( x ( 0 ) ( l ) x ( 0 ) ( l 1 ) ) ( x ( 0 ) ( l ) x ( 0 ) ( l 1 ) )
5: Fetch R s = ( x ˜ 1 ( 0 ) + x ˜ 2 ( 0 ) 2 , x ˜ 1 ( 0 ) + x ˜ 2 ( 0 ) + x ˜ 3 ( 0 ) 3 , , i = 1 i 1 x ˜ i ( 0 ) i 1 ) ;
6: Rebuild k = k + 1 /* reset the Pyramid system using the data set R s */
7: End Return x ˜ ( 0 ) = ( x ˜ ( 0 ) ( l + 1 ) , x ˜ ( 0 ) ( l + 2 ) , , x ˜ ( 0 ) ( l + n ) ) ;

2.2. Elman Neural Network Model (ENN)

The ENNM is a type of network that is similar to a three-layer feed-forward neural network, and the network has a context layer that feeds back the hidden layer outputs in the previous steps and thereby the networks have somewhat memories. Furthermore, the neurons contained in each layer are used to propagate information from one layer to another.

2.2.1. Network Training Algorithm

This paper employs back propagation (BP) to train the network and the weight is a key parameter for BP to adjust the difference between actual output and expected output of the network.
Definition 1.
When the output of the network has an unacceptable difference from the expected output, the weights of the hidden layer and the output layer should be updated by the appropriate updating method as shown in Equation (1) [55].
w ( n ) = η ( 1 α ) E w + α w ( n 1 )
where w ( n ) denotes the weight of loop n , and η denotes the learning rate of the network. The momentum factor is α , and e / w denotes the gradient direction of the weights.

2.2.2. Number of Network Neurons

To select proper number of hidden layer is a much complicated problem that there is no unified or ideal method. Its number is directly related to the final forecasting accuracy of the hybrid more. If the number is too small, it is difficult for the network to learn by using enough information; however, on the contrary, with too large number, the fault tolerance becomes lower and both the learning and training time will increase accordingly. Therefore, it is of great significance to apply suitable number of hidden layer to the forecasting.
The number of hidden layer is estimated in the range from five to twenty according to some empirical methods [87,88,89,90,91,92,93,94,95,96,97,98,99]. To select the best one in this range, an experiment is done based on the 1st–360th series of the original wind speed series. The dynamic change in hidden status neuron activation in the context layer is adjusted as Equation (2).
S i ( t ) = g ( k = 1 k V i k S k ( t 1 ) + j = 1 J W i j I j ( t 1 ) )
where S k ( t 1 ) and I j ( t 1 ) denote the output of the context state and input neurons, respectively. V i k and W i j denote their corresponding weights, and g ( x ) is a sigmoid transfer function.
Remark 2.
Table 2 shows the performance results with different numbers of hidden layer, and it is clearly seen that the number is 6, the result is the best with the lowest MAPE of 6.61%, MAE of 591.30 and MSE of 6.1117. Therefore, the parameters of ENNM in this paper are set below:
 
Number of input neurons: 4.
 
Best number of hidden layer neurons: 6.
 
Number of output neurons: 1.
 
Value of the learning rate: 0.01.
 
Number of iterations: 1000.

2.3. Auto-Recurrence Spline Rolling Model

This paper presents ARSR model to perform the forecasting through extracting information and establishing trend extrapolation model. This method can get over the drawbacks of grey model (GM) and obtain better forecasting accuracy [56]. The detailed meaning of single variable linear differential model and spline interpolation in this paper is explained below.
Definition 2.
The form of the single variable linear differential model is as follows:
d m y d x m + a 1 d m 1 y d x m 1 + a m 1 d 1 y d x 1 + a m y + a m + 1 = 0 ( i = 1 , 2 , ... , m + 1 )
The spline interpolation problem formulation could be described as follows (only given an odd spline function):
{ s ( x i ) = y i ( i = 1 , 2 , ... , N 1 ) s ( a ) ( x i ) = y i ( a ) ( i = 0 , N ; a = 0 , 1 , ... , n 1 ) }
where { x i | i = 0 , 1 , , N } are the nodes of interpolation, { y i | i = 0 , 1 , , N } are the values of the nodes and { y i ( a ) | i = 0 , 1 , , n 1 } are the interpolations of the nodes that the index is determined as (a).
Definition 3.
In Equation (8), s(x) is the k-order spline formula with the following form:
s ( x ) = j = 0 N + k 1 C j m + 1 φ j m + 1 , k
where φ j m + 1 , k ( x ) = N k , j k ( x ) ( j = 0 , 1 , ... , N + k 1 ) .
Definition 4.
The B spline function has the following form
{ N k , j ( x ) , j = k , k + 1 , ... , N 1 }
where N k , j ( x ) = ( x j + k + 1 x j ) G k ( x j x , , x j + k + 1 x ) and G k ( x ) = { x k ( x 0 ) 0 ( x < 0 ) .
When the nodes spread equidistantly, suppose that x j = x 0 + j h ; in this case,
N k , j ( x ) = Ω k ( x x 0 h j k + 1 2 )
Definition 5.
Ω k ( x ) is defined as follows:
Ω k ( k ) = j = 0 k + 1 ( 1 ) j ( k + 1 j ) ( x + k + 1 2 j ) k k !   ( k = 0 , 1 , 2 , 3 , )
If the original discrete data are sufficiently smooth with a continuous process, the spline interpolation function defined by Equations (7) and (8) could describe the real process of the past well. However, as s(x) could not forecast the future, the s(x) should be put with the massive past information into the differential forecasting model. Then, s(x) could be put into Equation (6), and the differential equation could be obtained as follows:
d m s ( x ) d x m + a 1 d m 1 s ( x ) d x m 1 + + a m 1 S ( x ) + a m + 1 = 0
The detailed process of identifying the parameters a 1 , a 2 , , a m + 1 is specified in Ref. [56].
Remark 3.
There are two types of data sets in the spline model: the actual data and the forecasted data that are calculated according to the actual data of the initial calculation process. In ARSR model, the new measured value of the actual is used to replace the independent variable used in the spline model, which means that the procedure above would be updated by the actual data as a recurrence.
This method with small calculated amount and fast speed effectively avoids the influence of former error on the latter error; therefore, it can improve the forecasting accuracy.

2.4. The Hybrid Model

The flowchart of this paper is described in Figure 1. As the Figure 1 illustrates, this paper uses the absolute percentage error as the judgment index for presenting the forecasting performance of different power consumption forecasting models. To examine the forecasting accuracy of distribution of skewness and kurtosis, this article introduces the validity index to further compare the forecasting performance of different power consumption forecasting models. Validity is based on the Invalid degree element with K order forecasting relative error, and this paper will present the general discrete form of forecasting validity equivalence. Moreover, the detailed processes are given as follows:
  • Step 1: Set the initial selected individual model set:
    M i n d e x = { m 1 i n d e x , m 2 i n d e x , m 3 i n d e x }
    Set the initial selected data set:
    S i i n d e x = { s 1 i n d e x , s 2 i n d e x , s 3 i n d e x , , s n i n d e x }
    Establish different forecasting models and the details have been shown in above sections.
    S t = ϕ 1 S t 1 + + ϕ p S t p + ε t σ 1 ε t 1 σ q ε t q , t Z
    m 2 i n d e x ( S j i n d e x ) = A R S R M ( S j i n d e x , S j + 1 i n d e x , S M ( S j i n d e x , S j + 1 i n d e x ) )
    m 2 i n d e x ( S j ) = F ( j = 1 n W i j I j ( t 1 ) ) * I F ( g ( k = 1 n ˜ V i k S k i n d e x ( t 1 ) + k = 1 n ˜ W i j I j ( t 1 ) ) )
    where IF is a two-value function with 0–1, which means that if and only if the value of IF is 1 could model 2 obtain the correct value.
  • Step 2: Apply the pyramid data classification system to analyze the predictability of the original time series, which forms the prerequisite conditions for accurate forecasting. The Pyramid system can also extract the optimal information from the original data that is used as the input variables of the optimized forecasting models.
    S = a b ( i + 1 ) ( a t S j S j + 1 d j b t i ( i 1 ) d i ) d i
    S j i n d e x = i = 1 n 1 ( i = 1 n 1 ( S j S j + 1 ) * ( S j S j + 1 ) ) ( i + 1 ) i = 1 n 1 i ( i 1 )
  • Step 3: Transfer the data that has been classified into ENN, ARSR and ENN-ARSR to conduct the forecast.
    Y j k = { y 1 , y 2 , y 3 , , y n }
    y j = A R S R M ( m 1 i ( S j i ) , m 2 i ( S j i ) )
    where k means the serial number of test data, and i means the value of the Electric-chi-square index.
  • Step 4: Update the forecasts with the actual data.
  • Step 5: Evaluate the forecasting models using FVD and GCD analysis.
    H ( m i 1 , m i 2 ) = S i g m o i d ( n * m i 1 ( 1 m i 1 ( m i 1 ) 2 ) F i x ( n * m i 1 ( 1 m i 1 ( m i 1 ) 2 ) ) )
    ζ ( L ) = M a x ( M a x ( 1 N t = 1 N min ( min ( a b s ( e i t ) ) ) + ρ max ( max ( a b s ( e i t ) ) ) i = 1 m a b s ( e i t ) + ρ max ( max ( a b s ( e i t ) ) ) ) )
  • Step 6: Finally, based on the Electric-chi-square index of the Pyramid data classification system, the forecasting results propose the corresponding rules of the Electric-chi-square index and different forecasting methods.
  • Step 7: Establish the forecasting system for application with the conclusion proposed in Section 6.

3. Model Evaluation

In this experiment, three generally adopted indexes are adopted to evaluate the experimental results, including MAPE, MAE and MSE, and their equations are listed as Table 3:
In addition to the three evaluation metrics referred above, including MAPE, MAE and MSE, another metric is also used to assess the performance of the model, i.e., forecasting validity degree (FVD). The FVD has been developed to have a full evaluation of the model performance. It defines the normal forecasting validity, which is based on the Invalid degree element of the k-order forecasting fractional error [57]. Due to the dispersion of the time series, this section shows the equally general discrete form of validity, and the related definitions are listed below.
Definition 6.
When H ( x i ) = x i is a one-element continuous function, H ( m i 1 ) = m i 1 is the 1-order forecasting validity of the ith forecasting method; while H ( x i ) = x i ( 1 y x i 2 ) is a two-element continuous function, H ( m i 1 , m i 2 ) = m i 1 ( 1 m i 2 ( m i 1 ) 2 ) is the FVD-2-order forecasting validity of the ith forecasting method.
Remark 4.
The 1-order forecasting validity index is the mathematical expectation of the forecasting accuracy series. When the difference between 1 and the standard deviation of the forecasting accuracy series multiplies its mathematical expectation, the FVD-2-order forecasting validity index is obtained. The smaller the 2-order forecasting validity index appears, the more effective the forecasting method is.
The FVD-2-order forecasting validity index could evaluate the effectiveness of some models that cannot be achieved only by MAPE. Based on that, this paper develops a novel concept of the forecasting validity index defined in Definition 7.
Definition 7.
H ( m i 1 , m i 2 ) = m i 1 ( 1 m i 2 ( m i 1 ) 2 ) is the FVD-2-order forecasting validity of the ith forecasting method. The FVD-3-order forecasting validity of the ith forecasting method is shown by Formula (20):
H ( m i 1 , m i 2 ) = 1 1 exp ( ( m i 1 ) 3 + 2 ( m i 2 ) 1 2 2 m i 2 )
Remark 5.
One type of forecasting validity index is a more obvious index than the other if its index value is larger than the other and its monotonicity is more obvious than the other.

4. Experiment

This section includes three experiments that are aimed at comparing the hybrid model proposed with other single models and proving its effectiveness. The data sets and results of data preprocessing are also included in this section.

4.1. Data Sets

The hybrid model, P-ENN-ARSR, is tested by using the EL data provided by the National Electricity Market Management Company (NEMMCO) of New South Wales (NSW), Australia. The EL data were collected on a half hourly basis (48 data points per day) for the year of 2011. This paper selects the season S = 4 and period T = 48 and Figure 2 shows the general trend of data.
To evaluate the forecasting results of different models, the observation values of the EL in the first four days were used to assess the Elman Neural Network model parameters, and the remaining data were used for the validation of the model. The actual data are used in ARSR model. The data selection scheme is demonstrated in Figure 3.

4.2. Data Preprocessing

A suitable data preprocessing method could improve the forecasting results even when compared with the same model. It not only can significantly reduce the error caused by extreme data of experimental results but also can be suitable for the characteristics of the experimental model. At the same time, the data preprocessing method would not have an influence on the nature of the data themselves.
In the process of data classification, each term of data would obtain an exclusive Electric-chi-square index, and a period of EL data with two data points would obtain an Electric-chi-square index. From Table 4, it can be determined that when the Electric-chi-square index of a data set is less than 0.6, ARSR performs better than ENN. When the Electric-chi-square index is greater than 0.6, the results forecasted by ENN will be better than those of ARSR. The details of the Pyramid data classification system are shown in Figure 4.
Remark 6.
There are some data of different classes based on the Electric-chi-square index with totally different errors in forecasting, though they are difficult to distinguish based upon the statistical dispersion. The data set is mainly divided into different classes by the pyramid system according to the Electric-chi-square index. In the cases above, it is obvious that the different types of data defined by the pyramid system have close mean and STDEV values. Data series can be divided into different categories more positively and accurately if the Pyramid system has been applied to classified data.

4.3. Experimental Setup

In order to testify the effectiveness of the proposed hybrid model, named as P-ENN-ARSR, this paper carries out two experiments, including Experiment I, Experiment II and Experiment III.
Experiment I initially compares the hybrid model with the single model of ENN and ARSR, respectively. The comparison between P-ENN-ARSR and ENN-ARSR can prove the classified effects of Pyramid data classification system. The data applied in Experiment I are the short-term EL data with 30-min intervals. The data sets are divided into four: spring, summer, autumn and winter. Experiment II is designed to prove the better performance of P-ENN-ARSR through comparing with other famous forecasting models, including auto regressive moving average (ARMA), autoregressive integrated moving average (ARIMA), back propagation neural network (BPNN), support vector machine (SVM) and adaptive network-based fuzzy inference system (ANFIS). The number of data applied in the experiment is large enough to support the construction of all the models referred above. Experiment III is aimed at testify the validity of FVD-3-order FVD proposed in this paper through comparing it with the FVD-2-order FVD. Three models, including ENN, ARSR and P-ENN-ARSR, are applied to make the comparison.

4.4. Experiment I

Experiment I is aimed at prove the effectiveness of each part in the hybrid model. Table 5 and Table 6 show the comparison and construct of ARSR, ENN, ENN-ARSR and P-ENN-ARSR in different seasons. From the two tables, it could be seen that;
(1)
For spring and summer, the hybrid model P-ENN-ARSR has the best forecasting results at 9 and 10 points, respectively and ENN-ARSR achieves the highest forecasting accuracy at 3 and 2 points, respectively. Although P-ENN-ARSR does not have the best MAE or MSE, the hybrid model outperform other models in the aspect of MAPE, FVD and IFVD.
(2)
For autumn, in addition to the time of 6:00 am and 8:00 am, P-ENN-ARSR has the best forecasting performance when compared with other models. Similarly, for the time series in winter seven points are forecasted accurately using the hybrid model P-ENN-ARSR. In comparison of MAE, MSE, MAPE, FVD and IFVD, P-ENN-ARSR has the lowest forecasting errors.
Remark 7.
The reason for the results above is that in the hybrid model P-ENN-ARSR, the pyramid data classification plays an effective part in promoting the forecasting capacity of the ARSR and ENN models. The pyramid data classification system decreases the jumping character of the original EL data, and the system selects the initial weights and thresholds for building ARSR-ENN; therefore, the optimized ARSR-ENN can achieve forecasting with higher precision.

4.5. Experiment II

Experiment II is designed to compare the proposed hybrid model in this paper with other well-known forecasting models, including ARIMA, SVM, BPNN and ANFIS, to testify to its effectiveness. From Table 7 and Table 8 and Figure 5, the results can be summarized as:
(1)
The electric-Chi-Square ranges from 0.1 to 1, and it is clear that P-ENN-ARSR achieves the best MAPE at 5 points when compared with other models. Then, if evaluated by IFVD, the hybrid model proposed achieves the best values at 4 points separately. However, only when the electric-Chi-square is 0.2, P-ENN-ARSR has the highest FVD with the value of 0.9988.
(2)
ARIMA belongs to statistical models that are based on a large amount of historical information. SVM is the machine-based forecasting method that is suitable in the STLF. BPNN and ANFIS are both ANNs with strong ability of self-learning and self-adaption. These single models can outperform other ones at certain points; however, the overall forecasting performance of P-ENN-ARSR is the most excellent.
(3)
When electric-Chi-square is 0.4, 0.7, 0.8 and 0.9, FVD and IFVD have the similar evaluations results at the model of SVM and ANFIS. In comparison, IFVD has better ability to identify the right trend of the model.
Remark 8.
The hybrid mode combines ANN with statistical models, which takes the advantage of both the single ENN and ARSR. By conducting the experiment, we can conclude that the model is applicable in conducting the forecasting for EL time series. Moreover, the data applied in Experiment II are EL data with 5-h intervals and the forecasting accuracy is still low and in an acceptable scale; therefore, it is proved that the hybrid model P-ENN-ARSR is effective for STLF.

4.6. Experiment III

Experiment III compares the results of FVD-2-order and FVD-3-order forecasting validity index and from Table 9 it can be concluded that:
(1)
For FVD-2-order forecasting validity index, ARSR has better forecasting performance than ENN when the index belongs to (0, 0.6). The single ENN performs better than the single ARSR within the index range of (0.7, 1). Among all the proposed models, the hybrid P-ENN-ARSR model has the best performance in the FVD-2-order forecasting validity.
(2)
For FVD-3-order forecasting validity index, when comparing the single ARSR and the single ENN, the former model has better forecasting performance than the latter while the indexes belong to (0, 0.5). ARSR achieves better performance than ENN when the index belongs to (0.6, 1). Among all the proposed models, the hybrid P-ENN-ARSR model has the best performance in the FVD-3-order forecasting validity.
(3)
When comparing the FVD-3-order forecasting validity indexes with the FVD-2-order forecasting validity indexes, it could be known that the former has much larger differences than the latter. For example, the FVD-2-order forecasting validity index with 0.4 of ENN, ARSR and P-ENN-ARSR is 0.7885, 0.8328 and 0.8662, respectively. The FVD-3-order forecasting validity index with 0.4 of ENN, ARSR and P-ENN-ARSR is 2.0, 1.67 and 1.66, respectively.
Remark 9.
While the Electric-chi-index belongs to 0.1–0.5, ARSR has more effective forecasting results than ENN. ENN performs better than ARSR when the Electric-chi-index is in the range of 0.6–1. While the Electric-chi-index belongs to 0.1–1, P-ENN-ARSR has more effective forecasting results than both ENN and ARSR. As we mentioned in Section 3, the FVD-3-order has better performance in evaluating forecasts than FVD-2-order.

5. Discussion

In this section, the factors of the forecasting models and PDRS have been discussed for promoting the forecasting performance. Meanwhile, the performance and the effect of train-test ratio not only have been tested but have been generated as well. Furthermore, two of the most important evaluation metrics, convergence speed and degree of certainty, have been presented and discussed in this section.

5.1. Forecasting Models

A great many of techniques for power system load forecasting have been proposed in the last decades [71,72,73,74,75,76,77,78,79,80,81]. Traditional forecasting approaches, such as ARMA and ARIMA, cannot give sufficiently accurate results. Conversely, complex algorithmic methods with heavy computational burden are able to converge slowly and may diverge in certain cases. As the literature reviews mentioned, a number of algorithms have been suggested for the load forecasting problem. Previous approaches can be generally classified into two types of categories in accordance with methods they employ. The first type of models have treated the load pattern as a time series signal and predicts the future load by using various time series analysis techniques. The second type of models have recognized that the load pattern is heavily dependent on features of electrical system, and finds a functional relation between the employed features and electrical load. The future load is then predicted by inserting the predicted information of electrical system into the predetermined functional relationship. In this paper a hybrid model which combines both time series and regression approaches has been presented, and the model not only has the advantage of fast computing speed, but is easy to implement as well.

5.1.1. Arguments of ARIMA

Based on the results of our experiments, ARIMA, which is better than two linear models, AR and ARMA. The reason for the unfavorable result produced by ARMA is that the ARMA could not fit the non-linear data series and it has a definite rhythmic pattern of fluctuations; however, all time series in data sets are not very regular so the irregular information has been removed entirely by the moving-average method. However, there is an additional parameter called differencing degree in ARIMA, which indicates the number of non-seasonal differences to fine tune the models to be more accurate on the basis of ARMA. Though the parameters could be facilitated by evaluating the partial autocorrelation functions for an estimate of p, it is still a difficult task to draw appropriate values of the arguments p and q in the AR, ARIMA and ARIMA. These models can be developed by least squares regression to generate the values of the parameters, which the parameters with the minor error have been chosen.
In our experiment, for Electrical Load, ARIMA (2, 4, 1) has obtained the best performances. In addition, we also tried other groups of p, q and d. The fitting performance improved gradually until d = 4, but when d is set to 4, the forecasting performance of the sample data of EL is not sufficient for fitting more parameters required in ARIMA. On the other hand, the forecasting performance is getting worse when q is larger than 1. Furthermore, the forecasting performances of ARIMA models are not only very dependent on their orders, but supported on the number of input sample data as well. We also observed that the models have good prediction accuracy at the first two points, but often poorly perform at the rest. It indicates that the proposed models are usually more suitable for STLF.

5.1.2. Analysis on Structures of Elman Networks

Our algorithm uses features of electrical load for modeling, and the ENN is able to perform non-linear modeling and adaptation. The proposed ENN are used for nonlinear forecasting have gained enormous popularity and success in EL forecasting because there is now a growing evidence that EL time series contain nonlinearities. As we expected, Elman outperforms most of other models shown in Table 6. However, there are many parameters required to be elaborately configured. However, there were no established rules for choosing the appropriate values of these parameters on EL forecasting. We had to resort to trial to obtain their appropriate values that lead to the best forecasting performance. Although there were many studies on how to tune the parameters of ENN, clearly, selection over the whole space of the parameters is beyond the scope of this article.
The different configurations of the three key parameters have been examined, including of train-test ratio, feedback delays, and hidden layers for EL. In addition, the ENN is a kind of neural networks with sharing the recurrent information in sample space. Thus, it is difficult to find a rule for updating parameters of ENN, and it is also challenging to find an appropriate strategy for updating parameters to bring the model to the best performance in the practical EL forecasting where the test data are unknown. During our experiment on ENN, we have tested the networks 100 times for each configuration with the same parameter setting and the forecasting values with the best performance by NN (the best is shown in Table 6) have been selected to compare with other models in Experiment II. Besides, general problems with the networks include the inaccuracy of prediction and numerical instability. One of the reasons this method often gives volatile results is that there is mechanism of randomness and probability inside the NN training methods. Another common criticism of ENNs is that they require an enormous amount of data for training in real-world operation. The training data of ENN are different with BP for the additional time-step in recurrent neural networks. The dimension of input data of ENNs is at least three, if the data have much more information, the dimensions of input will increase.

5.2. Trade-Off Based on PDRS

Note that it is an accepted fact that any of the modern Machine Learning algorithms will outperform traditional EL forecasts. A great many feed forward neural networks are used to forecast EL time series, but the feedforward neural network relies on the data features. It used local recognize to connect the different vectors into a lager vector and the last vector must be fix length. If we want to get better forecasting performance, the networks need to use a better feature learning methods. The natural method is used the larger vector as input data, but, when the dimension of input data increase, the weight matrix of ENN would be increasing rapidly. For example, if the dimension of input data and neurons both are 39, the dimension of weight matrix of the first layer will be 1521. Among which many weights are redundant, but they have to be computed in every iteration.
In this paper, we have employed the Pyramid Data Recognize System (PDRS) to reduce the amount of calculation in weight matrix in ENN and we discuss the factors related to the PDRS that would influence the trade-off of fitting and forecasting. We also test the performance of the effect of cross-validity sets in the training process and the different types of P-ENN are shown as Table 10.

5.2.1. Analysis of Fitting Performance

Thus far, in this paper, we have mainly focused on feature learning of PDRS. PDRS is not only relatively simple to recognize, but also has advantages over other approaches in terms of memory. However, PDRS has significant limitations in terms of fitting performance. This is because the linearity assumption is almost always a poor approximation. Table 10 presents three types of P-ENN which of different nodes in context layer, and the fitting accuracy are presented in Table 11. The cross-validity method is employed in this experiment.
The results represented by Table 11 show that the PDRS-ENNs have the better performance in fitting than other models and the PDRS-ENN-I has the best performance in fitting in all of models. The results also indicate that the memory unit of PDRS has good performance in feature learning. In PDRS, after the data had been got in the unit, the PDRS would generate the features of fitter data, and then the features would be connected by networks, the signals would be transform by the neurons. If the same features are transformed into the PDRS again, the neurons will be activated by the connections. Thus, the internal neurons of PDRS represent the features of data, or we can see that the internal neurons store the features of the data.

5.2.2. Analysis of Forecasting Performance

However, from Table 12, we can see that the forecasting performance of PDRS-ENN-I is much better than others, the result further illustrates that the PDRS-ENN-I not only has excellent fitting capability but has good forecasting results as well. In addition, the cross-validity method is employed in this experiment.
This section presents the results of testing by using the PDRS-based forecasting algorithm. Table 12 describes the forecasting performance of PDRS-ENN-1, PDRS-ENN-II, PDRS-ENN-1II, ANFIS, SVM and BPNN in numerical experiments. The PDRS is constructed using the rules that are described in Section 2, which stimulates the prior influence of the EL in the numerical method. We have totally conducted nine experiments, which are based on cross-validity method. From Table 12, it can be known that PDRS-ENN-1 and PDRS-ENN-II can converge with a reliable value of 1.80. In comparison, the FVD value of the PDRS-ENN-III is 1.90. In addition, the forecasting performances of ANFIS, SVM and BPNN are worse than that of PDRS-ENN-I, PDRS-ENN-II and PDRS-ENN-III. Based on Table 11 and Table 12, it can be known:
(1)
The forecasting performances of the proposed models are worse than the fitting performance of the same models. The PDRS-ENN-1, PDRS-ENN-II and PDRS-ENN-1II are better than ANFIS, SVM and BPNN, and the FVD values of PDRS models have changed by 0.17, 0.21 and 0.29, respectively. The FVD values of BPNN have changed by 0.30, which shows the worst stability among the proposed models.
(2)
Though the FVD value of ANFIS have changed by 0.16, showing the best stability among the proposed models, its 3-order-FVD value is only 2.04, which illustrates that the good stability does not generate good forecasting performance in WP, and the PDRS-ENN-I shows the best performance of trade-off between fitting and forecasting among the proposed models in WP.
(3)
All of the proposed forecasting models are data-driven methods, which makes full use of the historical data through feature learning. All of these forecasting models assume that history will repeat itself. The models of ANFIS, SVM and BPNN forecast future values supposing that the independent variables could explain the variations in dependent variables; in addition, these models assume that the relationship between dependent and independent variables will remain valid in the future; however, compared with ANFIS, SVM and BPNN, ENN has a more “context layer” part. Besides, PDRS helps ENN extract the features of WP data, and help ENN avoid the local optimum in training and testing. Therefore, the PDRS models have better performance both in fitting and forecasting.
From Section 5.2.2, we can see that, for WP, the PDRS-ENN is not only suitable for WP fitting but get good results in forecasting as well. In addition, the cross-validation methods are employed in experiments for the reliability and practicability. On the other hand, as a separate and operable method, the first stage of the model, i.e., the PDRS stage, can serve as a candidate correction module after evaluation for other time series forecasting models.

6. Conclusions

A practical machine learning prediction method not only forecasts one single point accurately but is able to accurately forecast the trend that contains several consecutive data points as well. Many algorithms have been developed for STLF and LTLF but these prediction methods are seldom used to deal with complex features of time series. Motivated by recent progress in feature learning-based prediction, we have proposed PDRS-ENN model, which is able to do reasonable prediction in the EL time series. We evaluated and compared PDRS-ENN with both other commonly used forecasting models and traditional models optimized by PDRS, with the load data in NWS, Australia; each sample of them moves steadily upward in secular trend, but is full of noise and hard to simulate. Experimental results showed that the PDRS-ENN generally outperforms traditional models.
We evaluated other variant PDRS-ENNs and found that the PDRS-ENN-I outperforms others in terms of evaluation metrics and degree of certainty. An extension of this work includes keeping the balance of the conflict among different evaluation metrics by handing the forecasting problems with multi-objectives in fitness function. Furthermore, our future research will focus on studying the principles of balancing exploitation and trade-off between fitting and forecasting.

Acknowledgments

This research was supported by the National Natural Science Foundation of China (Grant No. 71671029) and the National Natural Science Foundation of China (Grant No. 41475013).

Author Contributions

Yunxuan Dong and Jianzhou Wang conceived and designed the experiments; Zhenhai Guo performed the experiments; Chen Wang and Zhenhai Guo analyzed the data; Yunxuan Dong contributed analysis tools; and Jianzhou Wang and Yunxuan Dong wrote the paper.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

The following abbreviations are used in this manuscript:
ELElectrical Load
MLMachine Learning
ANNArtificial Neural Network
GRACHGeneralized AutoRegressive Conditional Heteroskedasticity
TETransmission Error
LTLFLong-Term Load Forecasting
SMStatistical Methods
HAHybrid Approaches
ARIMAAutoregressive Integrated Moving Average
BICBayesian Information Criterion
AICCCorrected Akaike Information Criterion
ANNArtificial Neural Networks
RFNNRandom Fuzzy Neural Network
FEEMDFast Ensemble Empirical Mode Decomposition
WTWavelet Transform
PSOParticle Swarm Optimization
ARSRAuto-Recurrence Spline Rolling
DLdeep learning
SVMsupport vector machine
WSwind speeds
WPWind Power
EWDAIElectric Wind Direction Anemometer Indicator
STLFShort-Term Load Forecasting
PAPhysical Approaches
MLAMachine Learning Approaches
NWPNumerical Weather Prediction
ARMAAuto Regressive Moving Average
AICAkaike’s Information Criterion
GNNGeneralized Neural Network
CGconjugate gradient
SDASecondary Decomposition Algorithm
WPDWavelet Packet Decomposition
GMGrey Model
PDRSPyramid Data Recognize System
FVDForecasting Validity Degree
BPback propagation
ALRadaptive learning rate
VSTLFVery Short Term Load Forecasting

References

  1. Danny, H.W.; Li, Y.; Liu, C.; Joseph, C.L. Zero energy buildings and sustainable development implications—A review. Energy 2013, 54, 1–10. [Google Scholar]
  2. Yong, K.; Kim, J.; Lee, J.; Ryu, M.; Lee, J. An assessment of wind energy potential at the demonstration offshore wind farm in Korea. Energy 2012, 46, 555–563. [Google Scholar]
  3. Shiu, A.; LamK, P.L. Electricity consumption and economic growth in China. Energy Policy 2004, 32, 47–54. [Google Scholar] [CrossRef]
  4. Chen, J. Development of offshore wind power in China. Renew. Sustain. Energy Rev. 2011, 15, 5013–5020. [Google Scholar] [CrossRef]
  5. Ferraro, P.; Crisostomi, E.; Tucci, M.; Raugi, M. Comparison and clustering analysis of the daily electrical load in eight European countries Original Research Article. Electr. Power Syst. Res. 2016, 141, 114–123. [Google Scholar] [CrossRef]
  6. Harmsen, J.; Patel, M.K. The impact of copper scarcity on the efficiency of 2050 global renewable energy scenarios. Energy 2013, 50, 62–73. [Google Scholar] [CrossRef]
  7. Koprinska, I.; Rana, M.; Agelidis, V. Correlation and instance based feature selection for electricity load forecasting. Knowl.-Based Syst. 2015, 82, 29–40. [Google Scholar] [CrossRef]
  8. Liu, H.; Tian, H.Q.; Liang, X.F.; Li, Y.F. Wind speed forecasting approach using secondary decomposition algorithm and Elman neural networks. Appl. Energy 2015, 157, 183–194. [Google Scholar] [CrossRef]
  9. Liu, L.; Wang, Q.R.; Wang, J.Z.; Liu, M. A rolling grey model optimized by particle swarm optimization in economic prediction. Comput. Intell. 2014, 32, 391–419. [Google Scholar] [CrossRef]
  10. Feinberg, E.A.; Genethliou, D. Load Forecasting. Power Electron. Power Syst. 2005, 269–285. [Google Scholar] [CrossRef]
  11. Bowden, N.; Payne, J. Short term forecasting of electricity prices for MISO hubs: Evidence from ARIMA-EGARCH models. Energy Econom. 2008, 30, 3186–3197. [Google Scholar] [CrossRef]
  12. Wong, W.K.; Guo, Z.X. Chapter 9—Intelligent Sales Forecasting for Fashion Retailing Using Harmony Search Algorithms and Extreme Learning Machines Optimizing Decision Making in the Apparel Supply Chain Using Artificial Intelligence (AI); Elsevier: Amsterdam, The Netherlands, 2013; pp. 170–195. [Google Scholar]
  13. Pilling, C.; Dodds, V.; Cranston, M.; Price, D.; Harrison, T.; How, A. Chapter 9—Flood Forecasting—A National Overview for Great Britain. Flood Forecast. 2016. [Google Scholar] [CrossRef]
  14. Zhang, J.; Draxl, C.; Hopson, T.; Monache, L.D.; Vanvyve, E.; Hodege, B.M. Comparison of numerical weather prediction based deterministic and probabilistic wind resource assessment methods. Appl. Energy 2015, 156, 528–541. [Google Scholar] [CrossRef]
  15. Sile, T.; Bekere, L.; Frisfelde, D.C.; Sennikovs, J.; Bethers, U. Verification of numerical weather prediction model results for energy applications in Latvia. Energy Procedia 2014, 59, 213–220. [Google Scholar] [CrossRef]
  16. Wilson, H.W. Community cleverness required. Nature 2008, 455, 1. [Google Scholar]
  17. Graff, M.; Pena, R.; Medina, A.; Escalante, H.J. Wind speed forecasting using a portfolio of forecasters. Renew. Energy 2014, 68, 550–559. [Google Scholar] [CrossRef]
  18. Zhang, J.; Li, H.; Gao, Q.; Wang, H.; Luo, Y. Detecting anomalies from big network traffic data using an adaptive detection approach. Inf. Sci. 2015, 318, 91–110. [Google Scholar] [CrossRef]
  19. Zárate-Miñano, R.; Anghel, M.; Milano, F. Continuous wind speed models based on stochastic differential equations Original Research Article. Appl. Energy 2013, 104, 42–49. [Google Scholar] [CrossRef]
  20. Iversen, E.B.; Morales, J.M.; Møller, J.; Madsen, H. Short-term probabilistic forecasting of wind speed using stochastic differential equations Original Research Article. Int. J. Forecast. 2016, 32, 981–990. [Google Scholar] [CrossRef]
  21. Juan, A.A.; Faulin, J.; Grasman, S.E.; Rabe, M.; Figueira, G. A review of simheuristics: Extending metaheuristics to deal with stochastic combinatorial optimization problems Original Research Article. Oper. Res. Perspect. 2015, 2, 62–72. [Google Scholar] [CrossRef]
  22. Wu, Z.; Tian, J.; Ugon, J.; Zhang, L. Global optimality conditions and optimization methods for constrained polynomial programming problems Original Research Article. Appl. Math. Comput. 2015, 262, 312–325. [Google Scholar]
  23. Luong, L.H.S.; Spedding, T.A. Neural-network system for predicting maching behavior. J. Mater. Process. Technol. 1995, 52, 585–591. [Google Scholar] [CrossRef]
  24. Liu, H.; Tian, H.Q.; Liang, X.F.; Li, Y.F. New wind speed forecasting approaches using fast ensemble empirical model decomposition, genetic algorithm, mind evolutionary algorithm and artificial neural networks. Renew. Energy 2015, 83, 1066–1075. [Google Scholar] [CrossRef]
  25. Hu, J.M.; Wang, J.Z.; Zeng, G.W. A hybrid forecasting approach applied to wind speed time series. Renew. Energy 2013, 60, 185–194. [Google Scholar] [CrossRef]
  26. Hastenrath, S. Climate and Climate Change | Climate Prediction: Empirical and Numerical; Encyclopedia of Atmosperic Science: Amsterdam, The Netherlands, 2015. [Google Scholar]
  27. Pfeffer, R.L. Reference Module in Earth Systems and Environmental Sciences, from Encyclopedia of Atmospheric Sciences, 2nd ed.; Elsevier: Amsterdam, The Netherlands, 2015; pp. 26–32. [Google Scholar]
  28. Yadav, A.K.; Chandel, S.S. Solar radiation prediction using Artificial Neural Network techniques: A review. Renew. Sustain. Energy Rev. 2014, 33, 772–781. [Google Scholar] [CrossRef]
  29. Sîrb, L. The Implications of Fuzzy Logic in Qualitative Mathematical Modeling of Some Key Aspects Related to the Sustainability Issues around “Roşia Montană Project”. Procedia Econ. Financ. 2013, 6, 372–384. [Google Scholar] [CrossRef]
  30. Falomir, Z.; Olteţeanu, A. Logics based on qualitative descriptors for scene understanding. Neurocomputing 2015, 161, 3–16. [Google Scholar] [CrossRef]
  31. Karatop, B.; Kubat, C.; Uygun, Ö. Talent management in manufacturing system using fuzzy logic approach. Comput. Ind. Eng. 2015, 86, 127–136. [Google Scholar] [CrossRef]
  32. Pani, A.K.; Mohanta, H.K. Soft sensing of particle size in a grinding process: Application of support vector regression, fuzzy inference and adaptive neuro fuzzy inference techniques for online monitoring of cement fineness. Powder Technol. 2014, 264, 484–497. [Google Scholar] [CrossRef]
  33. Chou, J.; Hsu, Y.; Lin, L. Smart meter monitoring and data mining techniques for predicting refrigeration system performance. Expert Syst. Appl. 2014, 41, 2144–2156. [Google Scholar] [CrossRef]
  34. Liu, H.; Tian, H.; Li, Y. Comparison of new hybrid FEEMD-MLP, FEEMD-ANFIS, Wavelet Packet-MLP and Wavelet Packet-ANFIS for wind speed predictions. Energy Convers. Manag. 2015, 89, 1–11. [Google Scholar] [CrossRef]
  35. Sarkheyli, A.; Zain, A.M.; Sharif, S. Robust optimization of ANFIS based on a new modified GA. Neurocomputing 2015, 166, 357–366. [Google Scholar] [CrossRef]
  36. Zhao, M.; Ji, J.C. Nonlinear torsional vibrations of a wind turbine gearbox. Appl. Math. Model. 2015, 39, 4928–4950. [Google Scholar] [CrossRef]
  37. Zimroz, R.; Bartelmus, W.; Barszcz, T.; Urbanek, J. Diagnostics of bearings in presence of strong operating conditions non-stationarity—A procedure of load-dependent features processing with application to wind turbine bearings. Mech. Syst. Signal Process. 2014, 46, 16–27. [Google Scholar] [CrossRef]
  38. Misra, S.; Bera, S.; Ojha, T.; Mouftah, T.H.; Anpalagan, M.A. ENTRUST: Energy trading under uncertainty in smart grid systems. Comput. Netw. 2016, 110, 232–242. [Google Scholar] [CrossRef]
  39. Wang, J.; Wang, H.; Guo, L. Analysis of effect of random perturbation on dynamic response of gear transmission system. Chaos Solitons Fractals 2014, 68, 78–88. [Google Scholar] [CrossRef]
  40. Sepasi, S.; Reihani, E.; Howlader, A.M.; Roose, L.R.; Matsuura, M.M. Very short term load forecasting of a distribution system with high pv penetration. Renew. Energy 2017, 106, 142–148. [Google Scholar] [CrossRef]
  41. Qiu, X.; Ren, Y.; Suganthan, P.N.; Amaratunga, G.A.J. Empirical mode decomposition based ensemble deep learning for load demand time series forecasting. Appl. Soft Comput. 2017, 54, 246–255. [Google Scholar] [CrossRef]
  42. Chen, T.; Peng, Z. Load-frequency control with short-term load prediction. Power Syst. Power Plant Control 1987, 1, 205–208. [Google Scholar]
  43. Punantapong, B.; Punantapong, P.; Punantapong, I. Improving a grid-based energy efficiency by using service sharing strategies. Energy Procedia 2015, 79, 910–916. [Google Scholar] [CrossRef]
  44. Sandels, C.; Widén, J.; Nordström, L.; Andersson, E. Day-ahead predictions of electricity consumption in a swedish office building from weather, occupancy, and temporal data. Energy Build. 2015, 108, 279–290. [Google Scholar] [CrossRef]
  45. Kow, K.W.; Wong, Y.W.; Rajkumar, R.K.; Rajkumar, R.K. A review on performance of artificial intelligence and conventional method in mitigating PV grid-tied related power quality events. Renew. Sustain. Energy Rev. 2016, 56, 334–346. [Google Scholar] [CrossRef]
  46. Linke, H.; Börner, J.; Heß, R. Table of Appendices. Cylind. Gears 2016, 1, 709–727, 729–767, 769–775, 777–787, 789, 791–833 and 835. [Google Scholar]
  47. Yang, C.; Chen, J. A Multi-objective Evolutionary Algorithm of Marriage in Honey Bees Optimization Based on the Local Particle Swarm Optimization. Ifac. Proc. 2008, 41, 12330–12335. [Google Scholar] [CrossRef]
  48. Ali, D.; Omid, O.; Hemen, S. Short-term electric load and temperature forecasting using wavelet echo state networks with neural reconstruction. Energy 2013, 57, 382–401. [Google Scholar]
  49. Yao, S.J.; Song, Y.H.; Zang, L.Z.; Cheng, X.Y. Wavelet transform and neural networksfor short-term electrical load forecasting. Energy Convers. Manag. 2000, 41, 1975–1988. [Google Scholar] [CrossRef]
  50. Rocha, R.A.J.; Alves, S.A. Feature extraction viamultiresolution analysis for short-term load forecasting. IEEE Trans. Power Syst. 2005, 20, 189–198. [Google Scholar]
  51. Key, E.M.; Lebo, M.J. Pooled Cross-Sectional and Time Series Analyses. In Political Science International Encyclopedia of the Social & Behavioral Sciences, 2nd ed.; Elsevier: Amsterdam, The Netherlands, 2015; pp. 515–521. [Google Scholar]
  52. Sousounis, P.J. Synoptic Meteorology | Lake-Effect Storms Reference Module in Earth Systems and Environmental Sciences, from Encyclopedia of Atmospheric Sciences, 2nd ed.; Elsevier: Amsterdam, The Netherlands, 2015; pp. 370–378. [Google Scholar]
  53. Bolund, E.; Hayward, A.; Lummaa, V. Life-History Evolution, Human. Reference Module in Life Sciences. In Encyclopedia of Evolutionary Biology; Elsevier: Amsterdam, The Netherlands, 2016; pp. 328–334. [Google Scholar]
  54. Chandra, R.; Zhang, M.J. Cooperative coevolution of Elman recurrent neural networks for chaotic time series prediction. Neurocomputing 2012, 86, 116–123. [Google Scholar] [CrossRef]
  55. Elman, J. Finding structure in time. Cognitive 1990, 15, 179–211. [Google Scholar] [CrossRef]
  56. Wang, R.Y.; Fang, B.R. Spline interpolation differential model prediction method for one variable system. J. HoHai Univ. 1992, 20, 47–53. [Google Scholar]
  57. Wang, M.T. The exploration of the normal form of the index of forecasting validity. Forecasting 1998, 17, 39–40. [Google Scholar]
  58. Mohandes, M.; Rehman, S.; Rahman, S.M. Estimation of wind speed profile using adaptive neuro-fuzzy inference system (ANFIS). Appl. Energy 2011, 88, 4024–4032. [Google Scholar] [CrossRef]
  59. Bouzgou, H.; Benoudjit, N. Multiple architecture system for wind speed prediction. Appl. Energy 2011, 88, 2463–2471. [Google Scholar] [CrossRef]
  60. Grau, J.B.; Antón, J.M.; Andina, D.; Tarquis, A.M.; Martín, J.J. Mathematical Models to Elaborate Plans for Adaptation of Rural Communities to Climate Change Reference Module in Food Science. In Encyclopedia of Agriculture and Food Systems; Elsevier: Amsterdam, The Netherlands, 2014; pp. 193–222. [Google Scholar]
  61. Thomassey, B.S. Chapter 8—Intelligent demand forecasting systems for fast fashion. In Information Systems for the Fashion and Apparel Industry; Elsevier: Amsterdam, The Netherlands, 2016; pp. 145–161. [Google Scholar]
  62. Lasek, A.; Cercone, N.; Saunders, J. Chapter 17—Smart restaurants: Survey on customer demand and sales forecasting. In Smart Cities and Homes; Elsevier: Amsterdam, The Netherlands, 2016; pp. 361–386. [Google Scholar]
  63. Kwon, H.; Lyu, B.; Tak, K.; Lee, J.; Moon, I. Optimization of Petrochemical Process Planning using Naphtha Price Forecasting and Process Modeling. Comput. Aided Chem. Eng. 2015, 37, 2039–2044. [Google Scholar]
  64. Stock, J.H. Time Series: Economic Forecasting. In International Encyclopedia of the Social & Behavioral Sciences, 2nd ed.; Elsevier: Amsterdam, The Netherlands, 2015; pp. 337–340. [Google Scholar]
  65. Jiang, Y.; Palash, W.; Akanda, A.S.; Small, D.L.; Islam, S. Chapter 14—A Simple Streamflow Forecasting Scheme for the Ganges Basin. In Flood Forecasting; Elsevier: Amsterdam, The Netherlands, 2016; pp. 399–420. [Google Scholar]
  66. Wilks, D.S. Chapter 7—Statistical Forecasting. Int. Geophys. 2011, 100, 215–300. [Google Scholar]
  67. Steinherz, H.H.; Pedreira, C.E.; Souza, R.C. Neural Networks for Short-Term Load Forecasting: A Review and Evaluation. IEEE Trans. Power Syst. 2001, 16, 44–55. [Google Scholar]
  68. Pappas, S.S.; Karampelas, E.P.; Karamousantas, D.C.; Katsikas, S.K.; Chatzarakis, G.E.; Skafidas, P.D. Electricity demand load forecasting of the Hellenic power system using an ARMA model. Electr. Power Syst. Res. 2010, 80, 256–264. [Google Scholar] [CrossRef]
  69. Calanca, P. Weather Forecasting Applications in Agriculture Reference Module in Food Science. In Encyclopedia of Agriculture and Food Systems; Elsevier: Amsterdam, The Netherlands, 2014; pp. 437–449. [Google Scholar]
  70. Li, J.P.; Ding, R.Q. WEATHER FORECASTING | Seasonal and Interannual Weather Prediction Reference Module in Earth Systems and Environmental Sciences. In Encyclopedia of Atmospheric Sciences, 2nd ed.; Elsevier: Amsterdam, The Netherlands, 2015; pp. 303–312, Current as of 2 September 2015. [Google Scholar]
  71. Luca, G.; Ghio, A.; Anguita, D. Energy Load Forecasting Using Empirical Mode Decomposition and Support Vector Regression. IEEE Trans. Smart Grid 2013, 4, 549–556. [Google Scholar]
  72. Juen, C.B.; Chang, M.W.; Lin, C.J. Load forecasting using support vector machines: A study on EUNITE Competition 2001. IEEE Trans. Power Syst. 2004, 19, 1821–1830. [Google Scholar]
  73. Chaturvedi, D.K.; Sinha, A.P.; Malik, O.P. Short term load forecast using fuzzy logic and wavelet transform integrated generalized neural network. Electr. Power Energy Syst. 2015, 67, 230–237. [Google Scholar] [CrossRef]
  74. Lou, C.W.; Dong, M.C. A novel random fuzzy neural networks for tackling uncertainties of electric load forecasting. Electr. Power Energy Syst. 2015, 73, 34–44. [Google Scholar] [CrossRef]
  75. Koopman, S.J.; Commandeur, J.J.F. Time Series: State Space Methods. In International Encyclopedia of the Social & Behavioral Sciences, 2nd ed.; Elsevier: Amsterdam, The Netherlands, 2015; pp. 354–361. [Google Scholar]
  76. Nfaoui, H. Wind Energy Potential. Reference Module in Earth Systems and Environmental Sciences. In Comprehensive Renewable Energy; Elsevier: Amsterdam, The Netherlands, 2012; Volume 2, pp. 73–92, Current as of 30 July 2012. [Google Scholar]
  77. Jiménez, F.; Kafarov, V.; Nuñez, M. Computer-aided forecast of catalytic activity in an hydrotreating industrial process using artificial neural network, fuzzy logic and statistics tools. Comput. Aided Chem. Eng. 2006, 21, 545–550. [Google Scholar]
  78. Ferraty, F.; Sarda, P.; Vieu, P. Statistical Analysis of Functional Data. In International Encyclopedia of Education, 3rd ed.; Elsevier: Amsterdam, The Netherlands, 2010; pp. 417–425. [Google Scholar]
  79. Lehnertz, K. SEIZURES | Seizure Prediction. In Encyclopedia of Basic Epilepsy Research; Elsevier: Amsterdam, The Netherlands, 2009; pp. 1314–1320. [Google Scholar]
  80. Soliman, S.A.; Al-Kandari, A.M. 1—Mathematical Background and State of the Art. Electrical Load Forecasting; Elsevier: Amsterdam, The Netherlands, 2010; pp. 1–44. [Google Scholar]
  81. Louka, P. Improvements in wind speed forecasts for wind power prediction. Purposes using Kalman filtering. J. Wind Eng. Ind. Aerodyn. 2008, 96, 2348–2362. [Google Scholar] [CrossRef]
  82. Tao, D.; Xiuli, W.; Xifan, W. A combined model of wavelet and neural network for short-term load forecasting. In Proceedings of the IEEE International Conference on Power System Technology, Kunming, China, 13–17 October 2002; pp. 2331–2335. [Google Scholar]
  83. Wang, R.H.; Guo, Q.J.; Zhu, C.G.; Li, C.J. Multivariate spline approximation of the signed distance function. Comput. Appl. Math. 2014, 265, 276–289. [Google Scholar] [CrossRef]
  84. Hong, W.C. Electric load forecasting by seasonal recurrent SVR (support vector regression) with chaotic artificial bee colony algorithm. Energy 2011, 36, 5568–5578. [Google Scholar] [CrossRef]
  85. Nie, H.Z.; Liu, G.H.; Liu, X.M.; Wang, Y. Hybrid of ARIMA and SVMs for short-term load forecasting. Energy Procedia 2012, 86, 1455–1460. [Google Scholar] [CrossRef]
  86. Bahrami, S.; Hooshmand, R.A.; Parastegari, M. Short term electric load forecasting by wavelet transform and grey model improved by PSO (particle swarm optimization) algorithm. Energy 2014, 72, 434–442. [Google Scholar] [CrossRef]
  87. Hodge, B.M.; Milligan, M. Wind power forecasting error distributions over multiple timescales. In Proceedings of the IEEE Power and Energy Society General Meeting, Detroit, MI, USA, 24–29 July 2011; pp. 1–8. [Google Scholar]
  88. Sideratos, G.; Hatziargyriou, N.D. An Advanced Statistical Method for Wind Power Forecasting. IEEE Trans. Power Syst. 2007, 22, 258–265. [Google Scholar] [CrossRef]
  89. Foley, A.M.; Leahy, P.G.; Mckeogh, E.J. Wind power forecasting & prediction methods. In Proceedings of the International Conference on Environment and Electrical Engineering, Prague, Czech Republic, 16–19 May 2010; pp. 61–64. [Google Scholar]
  90. Shamshirband, S.; Petkovic, D.; Anuar, N.B.; Kiah, M.L.; Akib, S.; Gani, A.; Cojbasic, Z.; Nikolic, V. Sensorless estimation of wind speed by adaptive neuro-fuzzy methodology. Electr. Power Energy Syst. 2014, 62, 490–495. [Google Scholar] [CrossRef]
  91. BP p.l.c. BP Statistical Review of World Energy; BP p.l.c.: London, UK, 2015. [Google Scholar]
  92. BP p.l.c. BP Technology Outlook; BP p.l.c.: London, UK, 2015. [Google Scholar]
  93. Kariniotakis, G.N.; Stavrakakis, G.S.; Nogaret, E.F. Wind power forecasting using advanced neural network models. IEEE Trans. Energy Convers. 1997, 11, 762–767. [Google Scholar] [CrossRef]
  94. Pedersen, R.; Santos, I.F.; Hede, I.A. Advantages and drawbacks of applying periodic time-variant modal analysis to spur gear dynamics. Mech. Syst. Signal Process. 2010, 24, 1495–1508. [Google Scholar] [CrossRef]
  95. Li, Y.; Castro, A.M.; Martin, J.E.; Sinokrot, T.; Prescott, W.; Carrica, P.M. Coupled computational fluid dynamics/multibody dynamics method for wind turbine aero-servo-elastic simulation including drivetrain dynamics. Renew. Energy 2017, 101, 1037–1051. [Google Scholar] [CrossRef]
  96. Mo, S.; Zhang, Y.; Wu, Q.; Matsumura, S.; Houjoh, H. Load sharing behavior analysis method of wind turbine gearbox in consideration of multiple-errors. Renew. Energy 2016, 97, 481–491. [Google Scholar] [CrossRef]
  97. Mabrouk, I.B.; El Hami, A.; Walha, L.; Zghal, B.; Haddar, M. Dynamic vibrations in wind energy systems: Application to vertical axis wind turbine. Mech. Syst. Signal Process. 2017, 85, 396–414. [Google Scholar] [CrossRef]
  98. Park, Y.; Lee, G.; Song, J.; Nam, Y.; Nam, J. Optimal Design of Wind Turbine Gearbox using Helix Modification. Eng. Agric. Environ. Food 2013, 6, 147–151. [Google Scholar] [CrossRef]
  99. Hameed, Z.; Hong, Y.S.; Cho, Y.M.; Ahn, S.H.; Song, C.K. Condition monitoring and fault detection of wind turbines and related algorithms: A review. Renew. Sustain. Energy Rev. 2009, 13, 1–39. [Google Scholar] [CrossRef]
Figure 1. The flowchart of the hybrid model.
Figure 1. The flowchart of the hybrid model.
Energies 10 00490 g001
Figure 2. The general trend of data.
Figure 2. The general trend of data.
Energies 10 00490 g002
Figure 3. The data selection scheme.
Figure 3. The data selection scheme.
Energies 10 00490 g003
Figure 4. Pyramid system of data classification.
Figure 4. Pyramid system of data classification.
Energies 10 00490 g004
Figure 5. The employed data in Experiment II.
Figure 5. The employed data in Experiment II.
Energies 10 00490 g005
Table 1. The structure of Pyramid data classification system.
Table 1. The structure of Pyramid data classification system.
Data
The value of the data is in each pyramid. The value is a double figure. A double value containing the total of the real load data on the previous record. A seasonal data series is put into the bottom of the pyramid.
Operations
Constructor
Initial values:The value of the data to be measured.
Process:Initialize the data value. Specify the figure of the data in each foundation bed of the pyramid.
Foundation bed
Input:None
Preconditions:None
Process:Import the data and compute the variance of the adjacent data.
Output:None
Postconditions:None
Ladder
Input:None
Preconditions:None
Process:Compute the figure sum of the variance in the foundation bed.
Specify the average of the sum.
Do multiply operation on the sum and the average.
Output:Return the final result of each pyramid.
Postconditions:None
Hierarchy
Input:None
Preconditions:None
Process:Quote the list of the top values of the pyramid to compute the Electric-Chi-Square index.
FVD the data based on the Electric-Chi-Square index.
Output:None
Postconditions:None
Table 2. Parameters and performance results of the developed neural networks for all the simulations.
Table 2. Parameters and performance results of the developed neural networks for all the simulations.
Number of Hidden LayerResults of One-Step Ahead ForecastingNumber of Hidden LayerResults of One-Step Ahead Forecasting
MAPE (%)MAE (m/s)MSE (104 m/s2)MAPE (%)MAE (m/s)MSE (104 m/s2)
46.95619.347.1127107.01629.357.0283
56.92615.897.1183116.77606.526.2559
66.61591.306.1117126.80609.646.4435
76.96621.776.9602136.70600.176.1422
86.93621.156.5277146.63592.316.0193
96.75604.036.2331156.74605.146.3197
Table 3. The Definition of Metrics.
Table 3. The Definition of Metrics.
MetricDefinitionEquation
MAEThe average absolute forecast error of n times forecast results MAE = 1 N n = 1 N | y n y n | (21)
MSEThe average of the prediction error squares MSE = 1 N n = 1 N ( y n y n ) 2 (22)
MAPEThe average of absolute error MAPE = 1 N n = 1 N | y n y n y n | × 100 % (23)
Table 4. Forecasting error results (MAPE).
Table 4. Forecasting error results (MAPE).
ClassElectric-Chi-SquareForecasting Model
ENNARSR
Normal0.12.75%1.99%
0.23.56%2.60%
0.33.02%2.44%
0.43.02%2.44%
0.53.53%3.08%
Special0.63.00%3.41%
0.73.28%3.56%
0.83.21%4.44%
0.94.43%4.75%
1.03.62%4.54%
Table 5. The forecasting results of hybrid model in spring and summer.
Table 5. The forecasting results of hybrid model in spring and summer.
Actual TimeElectric-Chi-SquareMethodsActual TimeElectric-Chi-SquareMethods
ARSRENNENN-ARSRP-ENN-ARSRARSRENNENN-ARSRP-ENN-ARSR
SpringSummer
2:00:000.473.46%2.29%1.02%2.29%2:00:000.162.77%5.88%3.84%2.77%
4:00:000.640.63%0.55%2.27%0.55%4:00:000.241.19%6.17%4.56%1.19%
6:00:000.43.98%4.98%4.05%3.98%6:00:000.345.48%4.56%3.64%4.56%
8:00:000.66.71%9.60%1.28%6.71%8:00:001.146.22%3.44%2.84%3.44%
10:00:000.692.64%3.23%4.92%2.64%10:00:000.892.64%7.65%4.30%2.64%
12:00:000.580.26%6.57%1.62%0.26%12:00:000.740.31%6.41%4.32%0.31%
14:00:000.51.04%10.95%6.12%1.04%14:00:000.630.56%6.72%4.53%0.56%
16:00:000.432.95%8.60%1.79%2.95%16:00:000.541.05%6.67%4.24%1.05%
18:00:000.645.17%5.04%5.10%5.04%18:00:000.744.63%5.64%6.30%4.63%
20:00:000.581.15%2.10%1.26%1.15%20:00:000.670.35%4.42%1.39%0.35%
22:00:000.542.35%0.17%1.92%0.17%22:00:000.664.18%7.10%4.73%4.18%
00:00:000.513.80%1.05%0.61%1.05%00:00:000.631.52%7.83%1.57%1.52%
MAE4953.5034739.7781911.1453204.385MAE2971.0621138.2622970.035885.6493
MSE899.50681117.0571362.9256786.523MSE549.74158507.1275605.5959296.089
MAPE2.85%4.59%2.66%2.32%MAPE2.58%6.04%3.85%2.27%
FVD0.82970.86250.89350.9722FVD0.79910.75450.86170.9635
IFVD0.85690.73850.88200.9711IFVD0.83480.74400.86040.8168
Table 6. The forecasting results of hybrid model in autumn and winter.
Table 6. The forecasting results of hybrid model in autumn and winter.
Actual TimeElectric-Chi-SquareMethodsActual TimeElectric-Chi-SquareMethods
ARSRENNENN-ARSRP-ENN-ARSRARSRENNENN-ARSRP-ENN-ARSR
AutumnWinter
2:00:000.232.53%3.26%0.80%2.53%2:00:000.22.89%13.44%4.09%2.89%
4:00:000.540.17%3.41%4.05%0.17%4:00:000.50.40%14.76%3.88%0.40%
6:00:000.557.67%2.10%3.00%2.10%6:00:000.547.43%31.37%3.60%7.43%
8:00:001.854.93%5.40%3.06%4.93%8:00:001.74.04%3.69%5.80%4.04%
10:00:001.482.89%0.45%4.41%0.45%10:00:001.353.76%3.09%1.77%1.76%
12:00:001.261.30%4.10%5.14%1.30%12:00:001.140.92%2.73%2.12%0.92%
14:00:001.080.24%6.77%2.33%0.24%14:00:000.970.04%4.92%0.79%0.04%
16:00:000.943.84%3.79%4.41%3.79%16:00:000.842.39%2.12%6.27%2.39%
18:00:001.186.74%2.59%2.77%2.59%18:00:001.177.02%3.16%4.30%7.02%
20:00:001.071.10%0.29%5.61%0.29%20:00:001.061.51%2.77%3.20%1.51%
22:00:001.055.37%2.26%5.55%2.26%22:00:001.056.07%5.04%4.26%6.07%
00:00:001.021.47%3.78%1.71%1.47%00:00:001.022.76%3.77%3.63%2.76%
MAE4180.0033496.7464892.3835274.083MAE5939.7013166.082877.144808.086
MSE9889.1165223.7548654.3866125.665MSE2278.4294980.9439008.5255746.612
MAPE3.19%3.18%3.57%1.84%MAPE3.27%7.57%3.64%3.10%
FVD0.79910.75450.86170.9635FVD0.88360.80620.81470.9129
IFVD0.83480.74400.86040.8168IFVD0.81900.89610.88360.8883
Table 7. Results of P-ENN-ARSR for EL forecasting at 5-h intervals.
Table 7. Results of P-ENN-ARSR for EL forecasting at 5-h intervals.
Electric-Chi-SquareP-ENN-ARSR
MAEMSEMAPEFVDIFVD
0.11.58 × 1044.39 × 1060.020.750.76
0.23.51 × 1042.20 × 1070.051.000.95
0.32.37 × 1041.04 × 1070.030.800.93
0.43.53 × 1042.32 × 1070.040.780.96
0.52.73 × 1041.33 × 1070.030.770.96
0.62.03 × 1047.20 × 1060.020.980.77
0.72.64 × 1041.30 × 1070.030.890.85
0.84.16 × 1043.16 × 1070.050.930.86
0.91.73 × 1045.94 × 1060.020.790.96
13.07 × 1041.66 × 1070.040.890.78
Table 8. Results of different models for EL forecasting at 5-h intervals.
Table 8. Results of different models for EL forecasting at 5-h intervals.
Electric-Chi-SquareARIMASVM
MAEMSEMAPEFVDIFVDMAEMSEMAPEFVDIFVD
0.18.26 × 1031.06 × 1070.040.930.867.12 × 1036.95 × 1060.030.990.90
0.27.80 × 1031.05 × 1070.020.790.867.02 × 1038.44 × 1060.020.760.94
0.37.52 × 1038.03 × 1060.010.990.911.23 × 1042.46 × 1070.080.750.89
0.41.36 × 1043.53 × 1070.130.760.871.17 × 1042.31 × 1070.080.870.97
0.58.51 × 1031.30 × 1070.020.810.841.14 × 1042.07 × 1070.080.870.97
0.61.30 × 1043.68 × 1070.120.870.821.23 × 1042.70 × 1070.110.910.75
0.71.47 × 1043.74 × 1070.110.850.909.29 × 1031.45 × 1070.050.760.75
0.81.37 × 1042.91 × 1070.100.940.909.48 × 1031.44 × 1070.030.900.85
0.91.40 × 1043.59 × 1070.050.880.741.11 × 1041.96 × 1070.050.970.98
11.09 × 1042.04 × 1070.050.750.991.03 × 1041.67 × 1070.040.790.94
Electric-Chi-SquareBPNNANFIS
MAEMSEMAPEFVDIFVDMAEMSEMAPEFVDIFVD
11.09 × 1042.04 × 1070.050.750.991.03 × 1041.67 × 1070.040.790.94
0.17.86 × 1031.05 × 1070.030.920.801.04 × 1041.72 × 1070.080.920.76
0.29.52 × 1031.28 × 1070.050.800.879.72 × 1031.65 × 1070.060.880.89
0.38.72 × 1031.18 × 1070.030.950.898.69 × 1031.17 × 1070.040.940.95
0.41.15 × 1041.71 × 1070.070.820.881.16 × 1042.02 × 1070.070.780.76
0.59.70 × 1031.43 × 1070.040.950.925.77 × 1035.44 × 1060.010.950.74
0.61.08 × 1041.72 × 1070.050.900.871.27 × 1042.68 × 1070.100.940.88
0.71.09 × 1042.19 × 1070.030.840.871.04 × 1041.68 × 1070.040.960.97
0.81.44 × 1043.42 × 1070.060.790.787.84 × 1039.68 × 1060.010.940.93
0.91.17 × 1042.25 × 1070.070.980.799.91 × 1031.44 × 1070.040.890.89
11.43 × 1043.29 × 1070.100.760.831.02 × 1041.76 × 1070.040.920.84
Table 9. FVD-2-order and FVD-3-order index analysis.
Table 9. FVD-2-order and FVD-3-order index analysis.
Electric-Chi-SquareFVD-2-Order IndexElectric-Chi-SquareFVD-3-Order Index
ENNARSRP-ENN-ARSRENNARSRP-ENN-ARSR
0.10.90510.88370.91750.11.631.611.58
0.20.84410.84060.85870.21.691.661.62
0.30.83600.83530.84820.31.681.651.62
0.40.78850.83280.86620.42.001.671.66
0.50.82310.82770.83450.51.701.681.65
0.60.75030.81580.80960.62.131.701.72
0.70.81620.81310.82220.71.701.701.67
0.80.82310.81210.82700.81.661.711.64
0.90.76010.81460.81230.91.702.091.71
10.73920.79320.810711.752.131.71
Table 10. The different types of P-ENN.
Table 10. The different types of P-ENN.
Experiment No.Inference TypeIterations in P-ENNNodes in Context Layer
1P-ENN-I56
2P-ENN-I512
3P-ENN-I518
4P-ENN-II106
5P-ENN-II1012
6P-ENN-II1018
7P-ENN-III156
8P-ENN-III1512
9P-ENN-III1518
Table 11. The fitting performance evaluated by FVD of 3-order.
Table 11. The fitting performance evaluated by FVD of 3-order.
No.PDRS-ENN-IPDRS-ENN-IIPDRS-ENN-IIIANFISSVMBPNN
11.601.601.611.911.881.73
21.611.591.611.921.901.75
31.601.581.591.901.901.72
41.621.591.631.901.861.72
51.611.601.601.931.881.73
61.621.591.621.921.871.73
71.581.581.611.921.901.71
81.601.601.591.901.861.74
91.611.611.611.891.871.75
Mean1.611.601.611.911.881.73
Table 12. The forecasting performance evaluated by FVD of 3-order.
Table 12. The forecasting performance evaluated by FVD of 3-order.
No.PDRS-ENN-IPDRS-ENN-IIPDRS-ENN-IIIANFISSVMBPNN
11.771.811.902.032.042.03
21.791.831.882.052.052.01
31.761.811.922.052.022.05
41.791.811.922.012.042.05
51.781.831.912.012.062.05
61.781.821.912.022.052.01
71.781.791.892.012.022.05
81.781.801.922.012.042.02
91.781.821.892.042.052.01
Mean1.781.811.902.032.042.03

Share and Cite

MDPI and ACS Style

Dong, Y.; Wang, J.; Wang, C.; Guo, Z. Research and Application of Hybrid Forecasting Model Based on an Optimal Feature Selection System—A Case Study on Electrical Load Forecasting. Energies 2017, 10, 490. https://doi.org/10.3390/en10040490

AMA Style

Dong Y, Wang J, Wang C, Guo Z. Research and Application of Hybrid Forecasting Model Based on an Optimal Feature Selection System—A Case Study on Electrical Load Forecasting. Energies. 2017; 10(4):490. https://doi.org/10.3390/en10040490

Chicago/Turabian Style

Dong, Yunxuan, Jianzhou Wang, Chen Wang, and Zhenhai Guo. 2017. "Research and Application of Hybrid Forecasting Model Based on an Optimal Feature Selection System—A Case Study on Electrical Load Forecasting" Energies 10, no. 4: 490. https://doi.org/10.3390/en10040490

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop