Next Article in Journal
Multi-Dimensional Resource Allocation for Throughput Maximization in CRIoT with SWIPT
Previous Article in Journal
Ion Exchange Resin and Entrapped Candida rugosa Lipase for Biodiesel Synthesis in the Recirculating Packed-Bed Reactor: A Performance Comparison of Heterogeneous Catalysts
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Novel Method of Forecasting Chaotic and Random Wind Speed Regimes Based on Machine Learning with the Evolution and Prediction of Volterra Kernels

Electrical Engineering Department, College of Engineering and Technology, University of Science and Technology of Fujairah, Fujairah P.O. Box 2202, United Arab Emirates
Energies 2023, 16(12), 4766; https://doi.org/10.3390/en16124766
Submission received: 5 May 2023 / Revised: 4 June 2023 / Accepted: 13 June 2023 / Published: 16 June 2023
(This article belongs to the Section A3: Wind, Wave and Tidal Energy)

Abstract

:
This study aims to focus on using the Volterra series and machine learning for forecasting random and chaotic wind speed regimes, since calm weather is mostly noticed at the local site, making dataset selection difficult. A novel method is proposed to predict Volterra kernels up to the third order, using a forward–back propagation neural network with 12-month measurements at Fujairah site (United Arab Emirates). Both daily and monthly wind speed datasets are investigated for forecasting. The three dominant hourly and daily kernels are extracted for each day and each month. Predicted future Volterra kernels are estimated from past values using both statistical analysis and individual neuro networks for each of the Volterra kernel coefficients. Using the evolved Volterra kernels, the hourly and daily wind speeds are forecasted with similar patterns of the measured values. Due to the random nature of wind speed at the local site, a two-layer with four neurons per layer neuro network is used to locate the most variable and intense speed during 8 h in the day. Forecasted wind speed is determined with errors arising from different sources, such as the utilization of only third-order Volterra kernels and the difficulty of machine training of the employed shallow network. Nevertheless, this work depicts a useful algorithm to forecast chaotic and random wind speed regimes. Computational time is a trade of the complexity of Volterra mathematical analysis.

1. Introduction

Wind energy is one of the main sources of the recent increase in renewable energy systems worldwide. Its potential output depends greatly on wind characteristics such as speed, which requires accurate forecasting to manage and control grid networks and standalone electrical power operation [1]. Wind speed prediction is normally analyzed by physical models or statistical models. Physics-dependent models are based on metrological physical laws, such as wind speed and direction [2], whereas statistical analysis relies on data algorithms such as moving average, autoregressive, machine learning, support vector machine [3,4], and hybrid methods combining different machine learning algorithms [4,5]. Statistical modeling is useful for short-time forecasting, which ranges from hours to even seconds, whereas physics-driven models are more suitable for long-time prediction of wind speed.
The chaotic and random nature of wind speed is one of the shortcoming effects of wind forecasting due to the indeterminate nature of the wind speed. This problem is exploited even more with a low-scale wind speed regime. Prediction using the nonlinear learning ensemble method [5] is attempted to investigate deep learning time series, whereas a frequency domain analysis based on frequency decomposition [6] is conducted. Recently, a probabilistic wind speed prediction model was attempted using real-time decomposition [3]. However, dealing with chaotic and random forecasting [7] requires other approaches, such as fractal analysis [8,9], which calculates the persistence of past features of monotonous nature. It has been introduced to characterize and quantify the complexity of geometries with a fractal factor ranging from 1 to 2. Another approach is wavelet transformation analysis, which converts a series of data from the time domain to several frequency filtrations. Earlier, the largest Lyapunov exponent method [10] was used for continuous and discrete nonlinear systems to measure variations in the Lyapunov exponent trajectories. A similar method in this context is the Kolmogorov entropy method [11].
The chaotic and random characteristics of wind speed can better be described using the Volterra series due to the nonlinearities relating to inputs and outputs. The applications of the Volterra series are numerous. One attempt to study prediction of chaotic traffic flow, is analyzed using fast learning algorithms of VNNTF based on chaotic mechanism [12]. An identification algorithm [13] is adopted to randomly evaluate the first third-order Volterra kernels, but the method suffers from a large consuming time. Another application of Volterra kernels was proposed for nonlinear unsteady aerodynamic loading identification [14]. The application of the Volterra series is extended to the fields of electronic and electrical engineering; for example, an algorithm is proposed by [15] to compute the Volterra frequency response function of nonlinear systems, whereas the work of [16] was to identify Volterra kernels for nonlinear systems excited by multitone signals. The calculation of Volterra series and kernels suffers from poor accuracy and large complexity; hence, conventional and time-delay series neural networks [17,18,19] are used both in time and frequency domains to overcome this shortcoming by truncating and recurrent estimation approaches [20,21]. Yet, the selection of neural network (NN) layers, activation functions, and input and hidden layers nodes impose difficulties for the optimal analysis of estimating the Volterra kernels, which describe the input–output of the nonlinear system. With a smaller number of neurons, lower accuracy is achieved, whereas, with a larger neuron number, overfitting occurs. In the case of a time-delay artificial neural network (TDANN), the length of the memory affects accuracy too because, with shallow memory length, a lower correlation between neurons has resulted and, with deep memory length, overfitting is obtained [22]. Wavelet decomposition was used to analyze and predict wind speed of chaotic nature [23]. The work of [24] is used to simplify NN training by truncating the Volterra kernels. Normally, up to the first third-order time-domain kernels are needed for reasonable accuracy, but the tradeoff is the size of the input range of values.
In this work, a novel method is proposed and implemented to forecast random, chaotic wind speed using different hourly and daily datasets for training an artificial neural network (ANN) to evaluate the first third-order Volterra kernels over a period of several months. The adoption of datasets depends on the randomness and variability of the measured data. Then, the behavior of the kernels is predicted by finding their trend values from their previous evaluations. Due to the complexities of estimating many kernels, only the first-order and second-order kernel coefficients are calculated. Hence, with two layers, a four-input neutron, and four hidden neutrons, the network is implemented. The method has been compared with two other methods of evaluating the forecasts [25,26] using the same datasets.

2. Materials and Methods

2.1. Wind Speed Dataset

Wind speed has been measured over a period of 12 months by a logger located 10 m above ground at Fujairah site in the UAE, with site data as shown in Table 1. It is assumed that the nature of the random wind regime is not largely affected by the height of the logger, since we intend to study wind persistence and its monotonous character. The dataset is logged as one-minute average values. The wind regime is normally chaotic and random with large indeterminate periods. Figure 1 depicts the nature of the wind regime at the site [24]. It can be deduced that wind speed is generally calm, with the maximum values scarcely reaching 10 mph. This can further impose difficulties in predicting future wind speeds. Selections that make a careful selection of the dataset are crucial to eliminating random errors.
The characteristics of Fujairah site are listed in Table 1. The wind regime at the site is largely random in nature, with large variations from season to season. It must be mentioned here that during the 2020–2021 measurements, the wind speed was mainly calm, with an average speed of 5 mph. The logger setup is basic, which is meant for academic research purposes. The metrological data, including wind speed, are recorded in two ways, wirelessly and wired to a LabVIEW© programed platform.
Due to the nature of large wind randomness, it is important to select periods of random wind speed persistence. Consequently, it is intended to use the dataset for both hourly and daily prediction with different selections for short-time and long-time forecasting cases. For the hourly forecasting, only 100 appropriate days are selected for the analysis of this study due to being exposed to noticeable seasonal variations. The exposed days are divided equally into 10 periods of 10 days each. The wind speed is selected 4 times a day, covering an average of 6 h each in which normal potential variations can exist, making it suitable for the goal of this study. For the daily forecasting, wind regime exploitation of the entire 12-month period is used with daily average values for each month. Another difficulty of accurate forecasting is the size and amount of calculating for each Volterra kernel for the selected period. For instance, an N perception neuron network requires m ( N 2 + N + 1 ) calculations for up to the m-order kernels, and for each period that is considered for this study. The prediction of these kernels requires neural networks for each kernel to be determined. In this work, 2-layer NN with only 4 neutrons is chosen, which makes network training inaccurate and difficult.

2.2. NN Model

It is known that dynamic neural networks, which may have topologies of recurrent and time-delayed patterns, can identify and solve nonlinear dynamic systems. In the first stage of the analysis, a conventional artificial neuro network (ANN) is implemented for the extractions of the Volterra kernels, with one hidden layer to accommodate a smaller number of Volterra kernels. The inputs are the time-delayed data measured with an M-depth of history according to the dataset selected and explained in the previous section. The number of neurons used in the input layer constitutes the memory depth of the data used. It is also appropriate to use an equal number of neurons in the hidden layer as well for the convenience of Volterra kernel calculations. A general M-memory depth CNN is depicted in Figure 2, with p neurons in the hidden layer and one neuron output. In this study, only 4 specific periods of interest are chosen as inputs that reflect the persistence of the wind speed randomness, incorporated with 4 neurons in a single hidden layer.
The next stage of analysis is to estimate the evolution of the Volterra kernels throughout the different selected periods of the dataset. This has been attempted using either statistical analysis or machine learning. In the latter, a similar topographic pattern of Korhonen’s self-organizing feature map (SOFM) network is proposed for the 4 × 4 and 1 × 4 neurons.
The Volterra kernels are functions of layer-to-layer weights and neuron biases [17]. Hence, it is needed first to train the neural network with the datasets explained above to evaluate all weights and biases. Then, Volterra kernels up to the third order are calculated for each period studied. Afterward, the evolution of the main Volterra kernel values is predicted and used to forecast future wind speeds.

2.3. Procedural Algorithm

Figure 3 depicts the procedural algorithm adopted in this study, which relies on the Volterra kernel evolution from one period to the next. In each period, up to the third-order kernels are evaluated using static artificial neural networks with time-delayed wind speeds that have been recorded in the datasets. In the process of the kernel evaluation, the weight coefficients of the input-hidden layer, optimal weights of the output layer, as well as biases of both the hidden layer and output layer are extracted from the trained networks. Then, the mathematical Volterra analysis is applied according to the formulation displayed in the next section.

2.4. Volterra Kernel Extractions

With Volterra modeling, a single output is determined from a series of inputs using mathematical formulation without necessarily the need of knowing the real structure of the nonlinear system, i.e.:
y k = F u k  
That is, given a set of m-memorized inputs U k = u k ,   u k 1 ,   . . ,   u k m + 1 , the output y k = u k + 1 can be evaluated in discrete form as follows:
y k = b 0 + j = 1 p w j φ b j + j = 1 p w j   φ 1 ( b j )   u k + w 2 , j   u k 1 + + w M + 1 , j   u k M + j = 1 p w j   φ 2 b j 2 !   u k + w 2 , j   u k 1 + + w M + 1 , j   u k M 2 + j = 1 p w j   φ 3 b j 3 !   u k + w 2 , j   u k 1 + + w M + 1 , j   u k M 3  
This can be simplified using Volterra kernels as:
y k = h 0 + m 1 = 0 M h 1   ( m 1 )   u k m 1 + m 1 M m 2 p h 2 ( m 1 , m 2 )   u k m 1 u k m 2  
where h p ( m 0 , m 1 ,   . . m p ) is the p-order Volterra kernels, which constitutes weighting coefficients on past values of m-memorized inputs. In this context, only kernels of p value up to 2 are determined. The first up to the second-order kernels are defined as:
h 0 = b 0 + j = 1 p w j   φ b j
h 1 m = j = 1 p w j   w m + 1 ,   j   φ 1 b j ,   m = 0 , 1 , , M  
h 2 m 1 , m 2 = j = 1 p w j   w m 1 + 1 , j   w m 2 + 1 , j   φ 2 b j ,   m 1 = 1 , 2 , M ,   m 2 = 1 , 2 , , M  
In this work, the Volterra kernels are first evaluated using the weight coefficients of the implemented neural network from (4), (5), (6) for the period in concern; hence, the forecasted wind speed is evaluated from (3). It is accepted to truncate these kernels up to the 3rd order to reduce computational efforts of this work without raising extra errors.

2.5. Kernels Estimation

2.5.1. Prediction Method

Predicted Volterra kernels are estimated using previous kernel extractions in the last 10-month period. In this work, only a single value of h0, a vector of 4 values for h1, and a two-dimensional area of 4 × 4 values of h2 are used for their prediction using statistical analysis as well as machine learning.

2.5.2. ML

Once Volterra kernels are extracted from previous periods, different sizes of neural networks are further used to predict evaluated values of the h0, h1, and h2 kernels for future estimation. Figure 4, Figure 5 and Figure 6 display the neuro networks which are implemented to extract h0, {1 × 4} h1, and {4 × 4} h2, respectively.
It is noted that Korhonen neural network is important for the evaluation of the zero- and first-order Volterra kernels. Due to large computations, the Korhonen neural arrangement has not been applied for evaluating the second-order kernels. This truncation of Volterra kernels can cause enormous errors, whereas the use of a smaller number of neurons per NN layer will reduce the accuracy of this analysis.

3. Results

3.1. Long-Term Prediction

Table 2 lists the zero- and first-order evaluated Volterra kernels in the 12-month period. The forecasting of wind speed is performed based on only these two kernels as an accepted approximation to reduce exhausted computations, but this would impose further errors on the proposed forecast.
It is deduced from above table that, based on previous months’ data, the forecasted wind speed can be expressed truncated as shown in (3) to be 2.271605 — 0.60568 ∗ S1 — 1.31348 ∗ S2 + 1.223976 ∗ S3, where S1, S2, and S3 are the measured wind speed on three previous days. It is intended here to check the amount of daily wind speed randomness, which is expected to be large, and, consequently, the estimation is based merely on statistical analysis.

3.2. Short-Term Prediction

As a first attempt, a period span of 100 days is considered for the short-term kernel prediction. The dataset is divided into two periods of 50 days each to monitor the variety and extent of speed randomness. Four selected daily measurements, which reflect potential wind speed randomness, are chosen in the analysis. The resultant zero- and first-order Volterra kernels are:
h o = 2.5968 h 1 = { 2.0140   0.1821   0.0510   0.3577 }
Using only these values of kernel coefficients, Figure 7 shows both the measured and forecasted wind speed for the 100-day period, divided into two 50-day periods.
The proposed algorithm of extracting the kernels and estimating their evaluated values has been applied on this period. In Table 3 the two-order Volterra kernels are listed for 10 consequence periods of 10 days each, based on the occurrence of potential persistence of wind speed randomness. The Volterra kernels up to the second-order coefficients are calculated for specific hours of the days, normally during 1 a.m.–8 a.m., in each day of logged data. These specific hours constitute the large persistence of wind speed randomness. Other time occurrences can also be considered.
Hence, the forecasted wind speed is determined by:
S p e e d = 3.4194 + 4.5363   S 1 0.48691   S 2 2.9585 S 3 + 1.306 S 4 ,
when neural networks are implemented and as:
S p e e d = 0.1352 0.0932 S 1 0.0166   S 2 0.3929 S 3 + 0.48 S 4
when statistical analysis is applied, where S1, S2, S3, and S4 are the measured wind speed on four previous days.

3.3. Wind Speed Forecasting

Wind speed forecasting is performed in two different phases; in the first, wind speed is calculated with the extracted Volterra kernels up to the third order and compared with the measured values. Figure 8 displays the two patterns of measured and calculated wind speed for each of the 10 periods of 10 days each. It can be noticed that, although the two concurrent patterns are similar, the errors are enormous. This is due to four main reasons, namely, the overall analysis is based on the evaluation of up to the third-order Volterra kernels. Secondly, only two-layer neural networks of four neutrons per layer are incorporated, which implies that machine training was not perfect. Thirdly, the forecasted wind speed in each period has been compared with the measured one in a handicapped manner, since evaluated Volterra kernels are for the entire period but not for each day, as has been performed. Fourthly, the historical depth of memory recurrence of selected inputs was limited to four only. The reason for this is to compensate for the large number of needed computations.

4. Discussion

4.1. Method Validation

The selection of a proper dataset is crucial for validating the proposed algorithm in this study. It was intended to compare measured wind speed with the forecasted value based on statistical trends. It was unable to validate the implemented method, since there were large discrepancies between the measured and forecasted values, as depicted in Table 4. For the first dataset, Volterra kernels were calculated in a 12-month period, and the result is extracted from the evolution of the previous 12 months. Three main readings per day of the 12th month, which reflect potential variations in wind speed, were used in this analysis. The error of this error is 1.9383 mph in seven successive days.
In Table 5, the dataset period of 100 days divided into 10 groups that reflects major variation in the wind speed is selected, in which four major readings per day are used for evaluating the resultant Volterra kernels. With this arrangement, a better estimation of the wind speed forecast is obtained. Two ways of forecasting the wind speed are applied, one from statistical trends and the other from machine learning, in which a neural network is used for each kernel coefficient. In this context, only zero-order and first-order kernels of four coefficients are considered.

4.2. Hyperparameter Errors

Apart from the model neural network parameters, which are the trained weights, other hyperparameters describing the network architecture need to be defined accurately. This cannot be estimated directly from data but, instead. must be specified through intuition, trial and error, and the use of heuristic tuning. For example, recurrent neural networks are adequate to process sequential and time-series datasets, whereas convolutional neural networks suit image processing, but, in this work, recurrent data are used for convolutional neural networks. Other hyperparameter errors arise from other sources, such as whether fully or partially connected networks, the implementation of mapping functions from inputs to outputs, the size and region focus of datasets, etc.

4.3. Method Comparison

It can be seen from Table 4 that the average error is 1.9383 mph and from Table 5 the average error is 2.3241 mph for the investigated 100 days, which can be tolerated considering the hyperparameter errors associated with the implemented algorithm. Table 6 depicts a comparison between the implemented algorithm in this study with two other methods for the same datasets: the temporal metrological method [25] and the error extraction method [26].
Based on the above comparison, the future work will require focusing on the type and location of dataset measurement nonlinearities. The Volterra kernels can be truncated according to reference [24]. A larger NN with more input abstractions will be useful for better training the network.

5. Conclusions

A novel method is used to evaluate the Volterra coefficients up to the third-order kernels for forecasting wind speeds of chaotic nature with variable and inconsistent randomness. The Volterra kernels are extracted for a sequence of periods to estimate predicted evolution and, hence, forecasted wind speed. Computational efforts are traded for the complexity of Volterra mathematical analysis. In this study, a comparison of the patterns of measured and calculated long-term and short-term forecasting of wind speed is accomplished. It is found that errors arise due to the following reasons:
  • The overall analysis is based on the evaluation of up to the third-order Volterra kernels.
  • Only two-layer neural networks of four neutrons per layer are incorporated, which implies that machine training was not perfect.
  • The forecasted wind speed in each period has been compared with the measured one in a handicapped manner, since evaluated Volterra kernels are for the entire period but not for each day, as has been performed.
  • The historical depth of memory recurrence of selected inputs was limited to four only. The reason for this is to compensate for the large number of needed computations.
Nevertheless, as the aim of this work is to address forecasting nonlinearities with Volterra kernels, this is an incentive attempt for other collaborators to opt for more accurate results by eliminating the above-mentioned errors. A quantitative analysis is required for future work to address the effectiveness of the implemented method in analyzing chaotic wind regimes of different scales of randomness and the relationship between them.

Funding

This research received no external funding.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Raw data were generated at USTF. Derived data supporting the findings of this study are available from the corresponding author [email protected] on request.

Acknowledgments

This is to thank Momen Odeh ([email protected]) for setting up the logger and LabVIEW programming. I would also like to thank Geith Majid ([email protected]) for text proofing.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Drisya, G.; Asokan, K.; Kumar, K.S. Diverse dynamical characteristics across the frequency spectrum of wind speed fluctuations. Renew. Energy 2018, 119, 540–550. [Google Scholar]
  2. Ouyang, T.; Cha, X.; Qin, L. Medium-or long-term wind power prediction with combined models of meteorological multivariable. Power Syst. Technol. 2016, 40, 847–852. [Google Scholar]
  3. Sun, H.; Qiu, C.; Lu, L.; Gao, X.; Chen, J.; Yang, H. Wind turbine power modeling and optimization using artificial neural network with wind field experimental data. Appl. Energy 2020, 280, 115880. [Google Scholar] [CrossRef]
  4. Yan, C.; Pan, Y.; Archer, C.L. A general method to estimate wind farm power using artificial neural networks. Wind Energy 2019, 22, 1421–1432. [Google Scholar] [CrossRef]
  5. Zhang, W.Y.; Qu, Z.X.; Zhang, K.Q.; Mao, W.Q.; Ma, Y.N.; Fan, X. A combined model based on CEEMDAN and modified flower pollination algorithm for wind speed forecasting. Energy Convers. Manag. 2017, 136, 439–451. [Google Scholar] [CrossRef]
  6. Song, J.J.; Wang, J.Z.; Lu, H.Y. A novel combined model based on advanced optimization algorithm for short-term wind speed forecasting. Appl. Energy 2018, 215, 643–658. [Google Scholar] [CrossRef]
  7. Jiang, Y.; Huang, G.; Yang, Q.; Yan, Z.; Zhang, C. A novel probabilistic wind speed prediction approach using real time refined variational model decomposition and conditional kernel density estimation. Energy Convers. Manag. 2019, 185, 758–773. [Google Scholar] [CrossRef]
  8. Chen, J.; Zeng, G.-Q.; Zhou, W.; Du, W.; Lu, K.-D. Wind speed forecasting using nonlinear-learning ensemble of deep learning time series prediction and extremal optimization. Energy Convers. Manag. 2018, 165, 681–695. [Google Scholar] [CrossRef]
  9. Tutueva, A.V.; Karimov, T.I. Detection of hidden oscillations in system without equilibrium. Int. J. Bifurc. Chaos 2021, 31, 20150043. [Google Scholar] [CrossRef]
  10. Harrouni, S. Long term persistence in daily wind speed series using fractal dimension. Int. J. Multiphys. 2016, 7, 87–94. [Google Scholar] [CrossRef] [Green Version]
  11. An, X.; Jiang, D.; Liu, C.; Zhao, M. Wind farm power prediction based on wavelet decomposition and chaotic time series. Expert Syst. Appl. 2011, 38, 11280–11285. [Google Scholar] [CrossRef]
  12. Yin, L.; He, Y.; Dong, X.; Lu, Z. Multi-step prediction of Volterra neural network for traffic flow based on chaos algorithm. In Information Computing and Applications: Third International Conference, ICICA 2012, Chengde, China, 14–16 September 2012; Communications in Computer and Information Science Book Series (CCIS); Springer: Berlin/Heidelberg, Germany, 2012; Volume 307. [Google Scholar]
  13. Chen, L.R.; Zhang, Z.R.; Cao, J.F. A novel method of combining generalized frequency response function and convolutional neural network for complex system fault diagnosis. PloS ONE 2020, 15, e0228324. [Google Scholar] [CrossRef]
  14. De Paula, N.C.G.; Marques, F.D.; Silva, W.A. Volterra kernels assessment via time-delay neural networks for non-linear unsteady aerodynamic loading identification. AIAA J. 2018, 57, 1725–1735. [Google Scholar] [CrossRef]
  15. Jones, J.C.P.; Yaser, K.S.A. A new harmonic probing algorithm for computing the MIMO Volterra frequency response function of non-linear systems. Nonlinear Dyn. 2018, 94, 1029–1046. [Google Scholar] [CrossRef]
  16. Han, H.T.; Ma, H.G.; Tan, L.N.; Cao, J.F.; Zhang, J.L. Non-parametric identification method of Volterra kernels for nonlinear systems excited by multitone signals. Asian J. Control. 2014, 16, 519–529. [Google Scholar] [CrossRef]
  17. Kantz, H.; Schreiber, T. Nonlinear Time Series Analysis; Cambridge University Press: Cambridge, UK, 2004; Volume 7. [Google Scholar]
  18. Grassberger, P. Estimation of the Kolmogorov entropy from a chaotic signal. Phys. Rev. A 1983, 28, 2591–2593. [Google Scholar] [CrossRef] [Green Version]
  19. Wray, J.; Green, G.G.R. Calculation of the Volterra kernels of non-linear dynamic systems using an artificial neural network. Biol. Cybern. 1994, 71, 187–195. [Google Scholar] [CrossRef]
  20. Stegmayer, G.; Pirola, M.; Orengo, G.; Chiotti, O. Towards a Volterra series representation from a Neural Network model. WSEAS Trans. Syst. 2004, 3, 432–437. [Google Scholar]
  21. Zhang, B.; Billings, S.A. Volterra series truncation and kernel estimation of nonlinear systems in the frequency domain. Mech. Syst. Signal Process. 2017, 84, 39–57. [Google Scholar] [CrossRef]
  22. Zhong, K.; Chen, L. An Intelligent calculation method of Volterra time-domain kernel based on time-delay artificial neural network. Math. Probl. Eng. 2020, 8546963. [Google Scholar] [CrossRef]
  23. Lin, L.; Xia, D.; Dai, L.; Zheng, Q.; Qin, Z. Chaotic analysis and prediction of wind speed based on wavelet decomposition. Processes 2021, 9, 1793. [Google Scholar] [CrossRef]
  24. Giannini, F.; Colantonio, P.; Orengo, G.; Serino, A.; Stegmayer, G.; Pirola, M.; Ghione, G. Neural networks and Volterra series for time-domain power amplifier behavioral models. Int. J. RF Microw. Comput.-Aided Eng. 2007, 17, 160–168. [Google Scholar] [CrossRef]
  25. Abdul Majid, A. Accurate and efficient forecasted wind energy using selected temporal metrological variables and wind direction. Energy Convers. Manag. X 2022, 16, 100286. Available online: www.sciencedirect.com/journal/energy-conversion-and-management-x (accessed on 12 June 2023). [CrossRef]
  26. Abdul Majid, A. Forecasting Monthly Wind Energy Using an Alternative Machine Training Method with Curve Fitting and Temporal Error Extraction Algorithm. Energies 2022, 15, 8596. [Google Scholar] [CrossRef]
Figure 1. Wind speed histogram and cumulative histogram. Most of the variations occur in the 1–5 mph range [26].
Figure 1. Wind speed histogram and cumulative histogram. Most of the variations occur in the 1–5 mph range [26].
Energies 16 04766 g001
Figure 2. Neuro network model with M-depth of memory.
Figure 2. Neuro network model with M-depth of memory.
Energies 16 04766 g002
Figure 3. Algorithm procedures of the implemented model.
Figure 3. Algorithm procedures of the implemented model.
Energies 16 04766 g003
Figure 4. NN for the evaluation of h0.
Figure 4. NN for the evaluation of h0.
Energies 16 04766 g004
Figure 5. NN for the evaluation of h1{1,2,3,4} coefficients.
Figure 5. NN for the evaluation of h1{1,2,3,4} coefficients.
Energies 16 04766 g005
Figure 6. NN for the evaluation of {4 × 4} coefficients of h2.
Figure 6. NN for the evaluation of {4 × 4} coefficients of h2.
Energies 16 04766 g006
Figure 7. Measured and forecasted wind speed during 100-day period.
Figure 7. Measured and forecasted wind speed during 100-day period.
Energies 16 04766 g007
Figure 8. Patterns of measured and calculated wind speeds for 10 periods.
Figure 8. Patterns of measured and calculated wind speeds for 10 periods.
Energies 16 04766 g008aEnergies 16 04766 g008b
Table 1. Physical parameters of Fujairah site [21].
Table 1. Physical parameters of Fujairah site [21].
ParameterValue
Latitude25,007′ N
Longitude56,018′ E
Mean wind speed at 10 m4.072664 mph
Mean wind direction182.46510
Average temperature28 °C
Mean pressure900–1100 m bar
Relative humidity50–100%
Air density1.188 kg/m3
Terrainflat land
ObstaclesHills
Surface roughness class0.5 Sa
Note: The site is surrounded by low–high hills that might impose wind speed obstructions and restrictions. The wind regime is generally calm at site, with occasional abrupt and chaotic increases in wind speed due to seasonal temperature changes.
Table 2. Depicts these values for long-term daily forecasting.
Table 2. Depicts these values for long-term daily forecasting.
h0h1(1)h1(2)h1(3)
Month 11.06550.7209−0.78523.5145
Month 2−0.60841.3254−1.0820.9684
Month 38.58840.2627−0.64310.3529
Month 43.959−0.38310.9421−1.0135
Month 5−0.9335−0.7779−1.4873−1.1422
Month 6−4.12810.0515−1.7653−0.3483
Month 74.26970.5041−0.265−0.5244
Month 82.6796−9.0945−16.73546.7691
Month 9−1.0694−4.2658−5.5122−0.3046
Month 10−7.81115.0786−3.3169−0.8385
Month 117.83897.18032.681−0.6133
Month 12−0.2562−0.069−0.02570.0059
Forecasted
month
2.271605−0.60568−1.313481.223976
Table 3. Extracted Volterra kernels in 100 days.
Table 3. Extracted Volterra kernels in 100 days.
h0h1(1)h1(2)h1(3)h1(4)
Day1–Day100.45721.00970.42921.9899−0.0469
Day11–Day201.1548−0.2147−0.1143−0.663−0.462
Day21–Day300.2880.87190.34343.6623−3.0886
Day31–Day400.13911.6331−0.5056−2.86152.5864
Day41–Day500.56020.09331.2503−0.1631−0.6328
Day51–Day60−0.7095−0.1883−0.3355−0.65351.5966
Day61–Day70−0.09450.025−0.02490.025−0.0249
Day71–Day800.2426−0.2129−0.69040.08−0.1705
Day81–Day900.0728−0.01080.0102−0.04110.022
Day91–Day1000.96760.53110.55970.61540.189
Forecasted Day
(statistics)
0.135233−0.09326−0.01668−0.392950.480067
Forecasted Day
(NN)
3.41944.5363−0.48691−2.95851.3046
Table 4. Daily wind speed forecasting in mph.
Table 4. Daily wind speed forecasting in mph.
Month: DayForecasted
Wind Speed (Trended)
Average
Measured
Wind Speed
Error
12:011.271.8255790.555579
12:021.751.5769680.173032
12:03(0)2.591202.591200
12:041.052.2093751.159375
12:05(0)4.0789354.078935
12:06(0)2.3439812.343981
12:07(0)2.6666672.666667
Table 5. Hourly (average) wind speed forecasting.
Table 5. Hourly (average) wind speed forecasting.
Forecasted DayTrended
(Statistics) Wind Speed mph
NN Forecasted Wind Speed mphAverage Forecasted Wind Speed mphAverage
Measured
Wind Speed mph
Error
mph
Day 1010.58.014.253.777080.47292
Day 1020.58.014.254.079740.17026
Day 1030.2819.49.84.786225.01378
Day 1040.2517.28.74.519214.18079
Day 1050.2517.28.78.058560.64144
Day 1060.2112.66.45.114581.28542
Day 1070.1910.35.253.803701.44630
Day 1080.2112.66.42.807063.59294
Day 1090.2112.66.44.044442.35556
Day 1100.0914.87.43.317934.08207
Table 6. Method comparison with two other methods.
Table 6. Method comparison with two other methods.
Implemented MethodTemporal Metrological Method [25]Error Extraction Method [26]
Qualitative comparisonSuitable for chaotic and random wind speed regimesNon-chaotic wind speedsNon-chaotic wind speeds
Flexible with the use of different order Volterra kernels (1st-, 2nd-, 3rd-, etc.) for accuracyFixedFixed
Requires only wind speed measurementsRequires many sensors for different variables measurements.Requires only wind speed measurements
Requires several NNs for each Volterra kernel coefficientComplex NNSimple NN
Requires many complex calculationsRequires minimum calculationsRequires simple calculations for error extraction
Dataset focus on period and type of random nonlinearitiesNo focus is requiredSome attention is needed for extracting dataset errors
Short-time forecastingShort- and long-time forecastingShort- and long-time forecasting
Quantitative comparisonLarge errors of 2.12–51.15%Small errors of 2.7%Error of 2.8–4.8%
Error is between 1.9383 mph and 2.324148 mphError is 0.38839 mphError is between 0.2143 mph and 0.3610 mph
Utilizing only 10 distinctive days with nonlinearitiesDataset of 30 measurements is usedDataset of 30 measurements is used
NN cannot be trained 100% for predicting all Volterra kernels100% fully trained NN100% fully trained NN
TDANN-ANN is usedDistributed NN is usedANN is used
4 input abstractions are used for the NN12 input abstractions are used5 input abstractions are used
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Abdul Majid, A. A Novel Method of Forecasting Chaotic and Random Wind Speed Regimes Based on Machine Learning with the Evolution and Prediction of Volterra Kernels. Energies 2023, 16, 4766. https://doi.org/10.3390/en16124766

AMA Style

Abdul Majid A. A Novel Method of Forecasting Chaotic and Random Wind Speed Regimes Based on Machine Learning with the Evolution and Prediction of Volterra Kernels. Energies. 2023; 16(12):4766. https://doi.org/10.3390/en16124766

Chicago/Turabian Style

Abdul Majid, Amir. 2023. "A Novel Method of Forecasting Chaotic and Random Wind Speed Regimes Based on Machine Learning with the Evolution and Prediction of Volterra Kernels" Energies 16, no. 12: 4766. https://doi.org/10.3390/en16124766

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop