Next Article in Journal
Effective Digital Technology Enabling Automatic Recognition of Special-Type Marking of Expiry Dates
Previous Article in Journal
Experiences of Underground Mine Backfilling Using Mine Tailings Developed in the Andean Region of Peru: A Green Mining Solution to Reduce Socio-Environmental Impacts
Previous Article in Special Issue
Techno-Economic Analysis and Optimization of Hybrid Renewable Energy System with Energy Storage under Two Operational Modes
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

A Comprehensive Review on Machine Learning Techniques for Forecasting Wind Flow Pattern

by
K. R. Sri Preethaa
1,2,
Akila Muthuramalingam
1,
Yuvaraj Natarajan
1,2,
Gitanjali Wadhwa
1 and
Ahmed Abdi Yusuf Ali
3,*
1
Department of Computer Science and Engineering, KPR Institute of Engineering and Technology, Coimbatore 641407, India
2
Department of Robot and Smart System Engineering, Kyungpook National University, 80, Daehak-ro, Buk-gu, Daegu 41566, Republic of Korea
3
Department of Electrical Engineering, University of Johannesburg, Johannesburg 2092, South Africa
*
Author to whom correspondence should be addressed.
Sustainability 2023, 15(17), 12914; https://doi.org/10.3390/su151712914
Submission received: 12 April 2023 / Revised: 11 June 2023 / Accepted: 28 June 2023 / Published: 26 August 2023

Abstract

:
The wind is a crucial factor in various domains such as weather forecasting, the wind power industry, agriculture, structural health monitoring, and so on. The variability and unpredictable nature of the wind is a challenge faced by most wind-energy-based sectors. Several atmospheric and geographical factors influence wind characteristics. Many wind forecasting methods and tools have been introduced since early times. Wind forecasting can be carried out short-, medium-, and long-term. The uncertainty factors of the wind challenge the accuracy of techniques. This article brings the general background of physical, statistical, and intelligent approaches and their methods used to predict wind characteristics and their challenges—this work’s objective is to improve effective data-driven models for forecasting wind-power production. The investigation and listing of the effectiveness of improved machine learning models to estimate univariate wind-energy time-based data is crucially the prominent focus of this work. The performance of various ML predicting models was examined using ensemble learning (ES) models, such as boosted trees and bagged trees, Support Vector Regression (SVR) with distinctive kernels etc. Numerous neural networks have recently been constructed for forecasting wind speed and power due to artificial intelligence (AI) advancement. Based on the model summary, further directions for research and application developments can be planned.

1. Introduction

The wind is the fundamental variable of the atmosphere. The wind is a fundamental source of renewable energy, variations in wind patterns are responsible for global weather, and it is an indicator of life comfort and safety. The study of wind flow patterns and their characteristics has crucial applications in varied domains such as weather forecasting, pollution control, climatic changes, power production, structural health monitoring, and many more. In recent years, as the importance of wind flow prediction has increased, several research methodologies have been introduced for accurate prediction. Urbanization and the rise in population has led to the establishment of highly-structured residential and commercial spaces. The wind flow variation between densely located high-rise buildings creates discomfort and unhealthy conditions for the occupants and pedestrians. The aerodynamic characteristics and structural health of high-rise buildings also depend on the wind speed and flow pattern exerted by the wind on buildings. The structural design, such as the height, shape, and nature of nearby building clusters, impacts wind flow around these buildings. The evaluation of the wind scale becomes essential for maintaining the durability of structures as well as for engineering the design of new safe establishments. The non-linear and dynamic nature of wind flow renders accurate forecasting complex. Many engineering approaches for wind forecasting have been widely employed for observing wind characteristics. These methods can be broadly classified as physical, numerical, and computational [1]. Regarding wind speed and wind, a variety of techniques, categorized by time scales or approach, are accessible. Different published definitions classify wind power forecasting methods according to various periods. Therefore, when combined with other types of literature and categorized by time scales, wind power forecasting techniques fall into one of four classifications: ultra-short-term forecasting covers from a few minutes to an hour; short-term forecasting is up to a few hours in advance; medium-term forecasting is up to a week in advance, from a few hours out; long-term forecasting predicts events up to a year in the future. This article reviews different wind flow prediction techniques and their challenges across various domains.
The research makes several significant contributions in the field of wind flow prediction. Firstly, it emphasizes the importance of studying wind flow patterns and their characteristics in various domains such as weather forecasting, pollution control, power production, and structural health monitoring. The research highlights the crucial role of wind in global weather patterns, renewable energy, and life comfort and safety. The study specifically focuses on the challenges posed by urbanization and the rise in population, particularly regarding wind flow variations between densely located high-rise buildings. It recognizes the impact of wind speed and flow patterns on the aerodynamic characteristics, structural health, and comfort of occupants and pedestrians in urban environments. Accurate wind forecasting is essential for maintaining the durability of structures and designing safe establishments. The research underlines the significance of this and acknowledges the non-linear and dynamic nature of wind flow, which adds complexity to accurate forecasting of wind patterns. To facilitate a better understanding of wind power forecasting techniques, the research categorizes them into four classifications based on time scales: ultra-short-term, short-term, medium-term, and long-term. This classification framework provides a valuable reference for comprehending different forecasting methods and their application in different time periods. In exploring wind prediction approaches, the research delves into both conventional experimental methods and intelligent computing techniques such as machine learning and deep learning. It highlights the challenges associated with conventional methods and explores the potential of intelligent computing approaches in overcoming these challenges for more accurate predictions. The article’s structure is well-organized, providing a clear roadmap for readers. In outline, conventional experimental methods are discussed in Section 2, intelligent computing techniques are explored in Section 3, and Section 4 focuses on addressing the research gap and providing recommendations for future enhancements. Overall, this research significantly contributes to the understanding of wind flow prediction, particularly in urban environments and high-rise buildings. It sheds light on the challenges faced in wind forecasting and highlights the potential of intelligent computing approaches for improving accuracy. The structured approach of the article ensures a comprehensive exploration of the topic, benefiting researchers and practitioners in the field.

2. Literature Study

The application of wind characteristics is enormous in varied fields. Accurate predicting of the wind flow and its effects earns considerable attention due to its benefits, and its research field is still expanding. This section summarizes wind prediction methodologies used in the literature and their shortcomings in varied application domains.

2.1. Conventional Methods

2.1.1. Physical Methods

Wind power is a significant source of renewable energy, but its variability poses challenges for efficient power production. Accurately predicting wind flow patterns is crucial for effective planning of wind power generation, maintenance, and conservation. By understanding and forecasting wind flow, stakeholders can optimize their operations, ensure a stable power supply, and maximize the utilization of this valuable renewable resource. On the nonlinear nature of wind, physical methods were initially employed for wind pattern forecasting. These methods were implemented in different terrains, altitudes, pressure, and temperatures to estimate the wind’s nature in future. Initial measurements were conducted onsite due to the studies related to pedestrian-level wind (PLW) assessments. Wind tunnel experiments were introduced to simulate the surrounding urban environment, and the wind characteristics were investigated. The experiments were conducted using hot wire at limited measurement regions. The observed values at tunnel surfaces were scaled to pedestrian levels. Recently sensors were implanted around the buildings to measure the wind speed, and the effects were investigated [2]. Many other wind measuring techniques, such as particle image velocimetry, laser doppler, thermography and thermistor anemometry, were used to simulate the wind flow around the buildings. A lack of professionals for constant observation, the complexity in modelling based on first principles, crucial data maintenance, and high computational costs in earlier years detracted from improvement of these physical methods. This caused the progression of data-driven numerical weather prediction (NWP) models that use statistical methods. The NWP model was not accurate on short-term predictions and thus digital evolution models were introduced for reducing error and improving accuracy [3,4]. Models based on physical process derivation inferred wind flow using a variety of meteorological parameters with computational fluid dynamics (CFD) and thermodynamic methods. Physical methods have been employed for a few decades due to their excellent interpretability and solid theoretical foundations. CFD-based Gerri’s method, Sketchup and CREO3.0 models have been applied for large-scale, long-term predictions. Nevertheless, these methods were unsuitable for short-term predictions due to inadequate computational facilities and low accuracy. Therefore, prediction using physical methods has numerous restrictions [5].
The physical models were found to introduce non-quantifiable environmental uncertainties. A numerical simulation model using a computational fluid dynamics approach was conducted to explore the effect of wind at the pedestrian level in an urban area. A study employed a CFD approach with a modified Launder–Kato-type (LK) model to compare the wind measurements between CFD and wind tunnel tests. The results proved that the CFD-based model reasonably fits the wind tunnel experimental results [6].

2.1.2. Statistical Numerical Methods

The conventional statistical models used time series data for pattern identification and some characteristic estimation based on historical data. The autoregressive model (AR), moving average model (MA), and integration of these two models (ARIMA) were proposed to calculate the wind speed at a given time. These models used higher order differential functions. The Kalman filters model was introduced for online wind speed forecasting. An integration of autoregression and an information criterion function was applied to test the effectiveness of the prediction models by comparing the one-month average speed and one-hour average wind speed. Other time-series non-Gaussian models were developed, but the autoregression mean average model outperformed the persistence models with less error [7]. The Wind Atlas Analysis and Application Program (WAsP) is most extensively utilized in the wind industry to forecast long-term wind energy. WAsP is a data-driven model that predicts wind speed in a target region based on the connection between short-term wind data in the target region and neighboring reference regions. WAsP methods were implemented on assumptions that the target and reference region have the same weather, are neutrally stable, have smooth terrain and the collected data are reliable. These assumptions were unreal and thus the model suffered from significant errors [8]. Measure-correlate-prediction (MCP) methods were also used in long-term wind energy estimation by determining the relationship between target and reference areas. Numerous MCP methods were devised based on the linear, nonlinear, and probabilistic relationships of the data. MCP methods were found to be more accurate than physical methods and WAsP but had underlying constraints on data collection methods such as choosing measuring sites, installation of anemometers, height of wind measurement, influence of nearby buildings, vegetation and so on [9].
Spatial correlation models that considered the relationship between different terrestrial locations and the wind speed were used to determine the wind speed of the neighboring areas. The model was more challenging than time-series models as it relied on the measurement of spatially correlated areas. In a combination of spatial correlation with fuzzy methods, genetic-based algorithms were utilized to increase the accuracy of the prediction. The error in these methods was studied, revealing that accuracy mainly depends on the size of the region of interest and the number of points considered for estimation [10]. Spatial temporal, moving average, and fractional autoregressive models were found to capture patterns more accurately on very short-term time series. The accuracy of the autoregressive approaches relied on the wind speed and reliability of the distribution of investigation areas. The performance of auto-regressive integrated models out-performed that of second-order Markov chain, Weibull and recurrent neural network-based models when applied to seasonal wind trends [11]. In order to make short-term projections, ARIMA models were used in conjunction with hybrid or combinational methods. The findings demonstrated that the ARMAX models, including wind direction as an exogenous input (for example, wind speed at various heights, wind direction, temperature, and sun radiation), outperformed the other models [12]. The boundary layer scaling model (BLSM) was applied to NWP data and a wind map of a power hub in Great Britain to predict the wind speed and power density at a height of 10 m. BLSM produced accurate wind speed prediction with less error than the microgeneration certification scheme model [13], which predicts average wind speed by scaling wind speed data. BLSM performed well on high-resolution data and more detailed datasets [14]. A VMD-TCN-ST model was built to forecast the wind speed to support the safety and stability of wind power industries. The model integrated variational mode decomposition of time-series wind data for feature extraction, a temporal convolutional network for prediction and a sequence triplet loss function for enhanced performance. The results were improved compared with ARIMA, LSTM and other decomposition methods [15].
A seasonal ARIMA model was implemented to predict the time-series short-term wind speed in the offshore area of Scotland and observed that it produced more accurate results than deep learning algorithms [16]. The nonlinearity of wind energy contradicts the application of linear statistical methods, thus the combination of several methods produced better results [17]. Reliable wind speed predictive results were achieved by assembling data decomposition, sub-model selection and different predictor selection techniques on the Mayfly algorithm [18]. These methods could be applied only on the single time-series scale of input and outputs. In addition, when the timescale was more extensive averaging methods were applied, which may result in the loss of useful knowledge.
The statistical and probability-based models were chosen over physical methods for real-time wind predictions, as they are efficient and use historical data. A Markov chain (MC) was the popular statistical tool used for predictions. An MC transition matrix was utilized as an optimization model with multi-object evolutionary strategy algorithms on large-scale high-dimensional real-time predictions [19]. A probability-based mass function was applied to measure wind flow direction and speed on varied time scales for forecasting. The method could accurately predict shorter time intervals, but the results were unrealistic for long-range time intervals [20]. Gaussian Processes (GP) were proposed over probabilistic predictions on regional wind flow. The covariance functions are the critical element of GP. A comparative study was conducted on different covariance functions with direct, indirect, static, dynamic, and combined structures with prediction intervals. The results showed that the indirect dynamic GP had more accuracy on broader prediction intervals [21]. However, the forecast out-performance of statistical models was also significantly constrained because of their poor nonlinear fitting ability. A comparative study on conventional statistical models namely autoregressive mean average and autoregressive integrated moving average with that of support vector machine learning methods was conducted. The results proved that the machine learning methods produce better forecasting results than those of conventional methods [22]. Table 1 shows the summary of physical, statistical, and numerical methods used for wind prediction.

2.2. Intelligent Based Approaches

Logical decisions can be made in advance based on the prediction findings. The precise forecast of wind speed is an efficient technique to increase the dependability and safekeeping of the wind power system [23]. As a result, in-depth studies focusing on wind speed forecasting have lately emerged. Wind speed forecasting can be categorized into four main models: physical, statistical, intelligent, and hybrid approaches [24]. Physical models simulate the dynamic process of wind by utilizing geographic and meteorological data. They are known for their high accuracy and physical interpretability. However, due to their limited computational effectiveness, they are not suitable for short-term wind speed predictions [25]. On the other hand, statistical models rely on probability theory and quantitative statistics, using historical data to generate straightforward forecasting predictions. They offer practicality and real-time applicability, even predicting wind direction. However, their predictive capacity may be constrained by their poor ability to capture nonlinear relationships in the data [26,27]. In contrast, intelligent approaches, such as machine learning and artificial neural networks, transcend traditional statistical methods. They excel at capturing complex nonlinear patterns, as they employ algorithms capable of learning from data and adapting to changing patterns. These intelligent models have the potential to outperform statistical models, particularly when dealing with nonlinear and dynamic wind patterns. By harnessing advanced techniques, intelligent approaches enhance the forecasting capabilities and provide valuable insights for optimizing wind power systems.

2.2.1. Machine Learning Approaches

In recent years, there has been a growing interest in using machine learning algorithms for wind pattern forecasting. These algorithms are particularly well-suited for this task due to their ability to analyze large amounts of data and make predictions based on patterns and trends. One popular machine learning technique used for wind pattern forecasting is artificial neural networks (ANNs). ANNs are a type of algorithm that are inspired by the structure and function of the human brain and can be used to model complex relationships between inputs and outputs. In wind pattern forecasting, ANNs can be trained to predict wind patterns based on historical data and a variety of meteorological variables. Another machine learning technique that has been used for wind pattern forecasting is support vector regression (SVR). SVR is a type of algorithm that can be used to model complex, nonlinear relationships between inputs and outputs. In wind pattern forecasting, SVR can be used to predict wind patterns based on historical data and a variety of meteorological variables.
Random Forest is another machine learning algorithm that has been used for wind pattern forecasting. Random Forest is an ensemble method that creates multiple decision trees and combines them to create a more robust model. The multiple decision trees in the ensemble are created by randomly selecting a subset of the training data and a subset of the features. This randomness helps to reduce overfitting and improve the generalization of the model. Gradient Boosting Machine (GBM) is also a machine learning algorithm that has been used in wind pattern forecasting. GBM is an ensemble method that creates multiple decision trees and combines them to create a more robust model. Unlike Random Forest, GBM creates the decision trees in a sequential manner where each tree tries to correct the errors of the previous tree. This sequential nature of the model helps to capture complex relationships in the data. Long Short-Term Memory (LSTM) is a more advanced algorithm in the field of machine learning which has been used in wind pattern forecasting. LSTM is a type of Recurrent Neural Network (RNN) that is particularly well-suited for sequential data, such as time series. LSTM has a memory cell that can retain information for a long period, which helps in predicting the future values of the time series.
To generate very short-term parametric probabilistic wind power estimates at numerous locations, a sparse vector autoregression approach is proposed [28] using a machine learning technique. To operate well, smart grids with 10s or even 100s of wind generators need expert, extremely short-term forecasts, and geographical information is greatly desired. For multistep-ahead estimating of wind power production, a mathematical morphology-based local predictor (MMLP) and mean trend detector (MTD) are employed. To be more precise, the wind power is predicted using historical daily wind speed data using support vector regression (SVR), random forest regression (RF), least absolute shrinkage and selection operator (LASSO) regression and k-nearest neighbors (kNN) [29]. The results emphasize that machine learning models may be applied in areas other than those where the models were trained. These models, however, are immobile and disregard information from earlier data [30]. Figure 1 shows the architectural stage of machine learning approaches. The architectural stage in machine learning refers to the process of designing and organizing the various components and flow of a machine learning model. It involves several important steps that are crucial for constructing a strong and efficient predictive model. At the outset of the architectural stage, data gathering plays a vital role. This entails collecting the appropriate datasets that will be used for training, validating, and testing the model. These datasets can be obtained from a variety of sources, including public repositories or private databases. Once the data have been collected, the subsequent step involves data cleaning. This process involves preprocessing the data to address any missing values, outliers, or inconsistencies that could potentially impact the model’s performance. Techniques such as imputation, outlier detection, and data normalization or standardization are employed to ensure the data’s quality and reliability. Another important aspect of the architectural stage is exploratory data analysis. This step entails examining and visualizing the data to gain insights into their inherent patterns, distributions, and relationships. By doing so, we can better understand the characteristics of the data and identify relevant features or variables that will be valuable for the model. Following data preprocessing and exploratory analysis, the subsequent phase is feature engineering and selection. This involves transforming and selecting the most informative features from the dataset. Feature engineering techniques may include scaling, dimensionality reduction, or creating new derived features that capture essential information. Feature selection techniques help identify the subset of features that have the most significant impact on the model’s performance. Next in the architectural stage comes model selection and assessment. This step entails choosing the appropriate machine learning algorithm or ensemble of algorithms that best align with the specific problem at hand. Factors such as the data’s nature, the complexity of the problem, and the desired model interpretability or accuracy are taken into account when selecting the most suitable model. Model assessment involves evaluating the model’s performance using appropriate metrics and validation techniques to ensure its generalization and reliability. Model training is a critical step within the architectural stage. It involves feeding the selected algorithm with the prepared data to learn the underlying patterns and relationships. The model is trained using optimization techniques that aim to minimize errors or maximize the model’s performance on the training data. Once the model is trained, it undergoes evaluation and optimization. Model evaluation assesses its performance on unseen test data, allowing for an unbiased assessment of its ability to generalize. If necessary, further optimization techniques such as hyperparameter tuning or regularization methods are applied to fine-tune the model and enhance its performance. Lastly, ongoing maintenance and monitoring are essential for ensuring the model’s sustained effectiveness. Regular monitoring of the model’s performance and periodic retraining or updating help address any issues that may arise, such as concept drift or changes in the underlying data distribution.
The machine learning life cycle’s main activity is model creation, which has three subpoints: model selection and assessment, model training, and model evaluation. Finally, optimizing the model and executing ongoing maintenance checks is critical. Researchers must monitor the model using predictive analytics software and look for problems like model drift or bias to ensure that it continues to produce correct predictions over time. Contrarily, intelligent techniques, such as the extreme learning machine (ELM) [31], Elman neural network (Elman), echo state networks (ESN) [32], and long short-term memory network (LSTM) [33], are frequently utilized for wind speed forecasting due to their excellent nonlinear appropriate and self-learning capabilities. However, the predicting performance of these intelligent models could be more stable because of their heavy reliance on built-in factors. As a result, ensemble models were developed. Ensemble approaches may be more efficient since they can concurrently ensure the generalization and accuracy of the forecasting approach [18]. The weight integration concept and optimization technique are used in the ensemble learning method, which combines several predictors and eliminates the phenomena of model overfitting while enhancing the predictor’s capacity to modify to data with various temporal properties [34].
Among other techniques, particle swarm optimization (PSO) integrates other neural networks. The ensemble network model can significantly better optimize performance than the conventional network. By combining four separate networks with various structural differences using the Grey Wolf optimizer (GWO), a unique ensemble model can outperform individual networks [35]. It is stimulating for a single neural network to adapt to many scenarios due to the variety of the data. To improve the model’s overall capacity for time-series regression analysis, the ensemble learning approach blends neural networks with other structures. Therefore, there are potential research opportunities for ensemble learning in wind power forecasting. Many academics have used unsupervised machine learning to remove autocorrelation characters from high-resolution time series to improve prediction performance [36,37].
Machine learning is used by current error correction methods to anticipate residual errors. It is problematic to train the forecast model through high generalization, nevertheless, because of the error data’s significant unpredictability and discreteness [24]. Some better methods, such the multi-cycle error correction approach and the error correction model based on decomposition [38], nevertheless require assistance with unfavorable engineering applications, poor operating efficiency, and over-correction. Therefore, an integration study is required to enhance the wind speed forecasting performance of the high-performance error correction approach. In conclusion, machine learning algorithms like Artificial Neural Networks, Support Vector Regression, Random Forest, Gradient Boosting Machine, and Long Short-Term Memory, etc., have been used in wind pattern forecasting to improve the accuracy of predictions. These algorithms can analyze large amounts of data and make predictions based on patterns and trends, which is particularly useful in wind pattern forecasting where complex relationships between inputs and outputs are involved. Table 2 shows the summary of machine learning approaches used for wind prediction.

2.2.2. Deep Learning Approaches

Numerous wind power prediction models have surfaced in recent years, encompassing statistical, physical, and artificial intelligence approaches. Artificial intelligence methods, leveraging the in-depth information contained in erratic wind power statistics, have shown promise in creating accurate and nonlinear models. Consequently, researchers have proposed various artificial intelligence algorithms to develop precise wind power forecasting models. Neural networks-based approaches have gained popularity in wind power prediction due to their ability to handle complex relationships in the data. These approaches use artificial neural networks to learn and model wind speed patterns. In neural networks-based approaches, interconnected nodes called neurons form layers. Each neuron takes inputs, applies weights, and generates an output using an activation function. By combining multiple neurons in layers, neural networks capture intricate relationships and make predictions based on learned patterns.
To capture the intricate details of wind flow patterns surrounding buildings and depict street-level wind atmospheres, the application of particle image velocimetry (PIV) is common near model construction areas. However, the measurement of immediate wind speeds in protected places around building models remains challenging due to laser-light shielding. Deep learning algorithms, such as the generative adversarial imputation Network (GAIN), can be employed to thoroughly analyze wind flow patterns by imputing the unmeasured wind velocities [2]. This utilization of deep learning techniques has also proven effective in time-series forecasting models, surpassing conventional algorithms [39].
The effectiveness of BI-LSTM in forecasting wind power has been extensively demonstrated by numerous groups of comparison tests [40]. This research introduces Linear Neural Networks with Tapped Delay (LNNTD) in a blend with Wavelet Transform (WT) aimed at probabilistic wind power forecasting in a time-based environment [41] with the aim of increasing wind power prediction accuracy and reliability. A new wind speed forecasting model was created using the long-short-term memory network (LSTM) as the predictor. Although the computing overhead might be lessened, LSTM could standardize the lengthy time series information in wind power data [42]. High-precision prediction modelling was developed based on LSTM and, to be more effective, was realized using the gated recursive unit (GRU) [43]. A temporal convolutional neural network was also incorporated into the forecasting model (TCN). The DL technique has gained actual research usefulness in wind power forecasting based on the relevant works stated above [44].
The Convolutional Neural Network (CNN) extracts profound features from the wind speed data to conduct wind speed forecasting. Figure 2 demonstrates the working of deep learning approach CNN architecture.
Convolutional Neural Networks (CNNs) are vital in wind speed forecasting due to their ability to extract valuable features from raw wind speed data. The CNN architecture comprises key components that enhance its effectiveness in capturing spatial patterns and correlations. The core of the CNN architecture consists of convolutional layers that use filters to perform convolutions on the input wind speed data. These filters are designed to detect specific patterns at different scales, such as edges or corners. By applying these filters across the data, the CNN identifies essential spatial information relevant to wind speed prediction. Pooling layers are often added after the convolutional layers to downsample the feature maps generated by the convolutions. For example, max pooling selects the maximum value within each region, reducing data dimensions while retaining important features. This downsampling reduces model complexity and provides translation invariance, allowing the CNN to focus on crucial features regardless of their location. The output of the convolutional and pooling layers is then flattened and fed into fully connected layers. Similar to traditional neural networks, these layers learn complex relationships between the extracted features and the target variable, in this case, wind speed. Fully connected layers enable the CNN to capture higher-level representations and make predictions based on learned patterns. During training, the CNN adjusts its internal parameters, weights, and biases, to minimize the difference between predicted and actual wind speed values in the training data. This optimization is achieved through the backpropagation algorithm, which updates the model parameters based on gradients computed from the loss function. The CNN architecture is a powerful tool for extracting spatial features from wind speed data. By utilizing convolutional layers for local patterns, pooling layers for downsampling, and fully connected layers for higher-level relationships, CNNs effectively learn and predict wind speed patterns. Understanding the CNN architecture allows readers to grasp its importance in wind power prediction and its potential for improving forecast accuracy.
This substantially enhances the modelling implementation and the inclusive prediction outcome of LSTM. The example demonstrates how well CNN can remove the one-dimensional variation data from the original wind speed data while outperforming more conventional approaches. Using extracted features from CNN, the model may examine and improve the quality of the actual data [45]. When combined with other techniques to delve into time-series data thoroughly, simple models like GRU and LSTM, which have incomplete capability to mine the core properties of sequences, may significantly increase the correctness of wind speed prediction. The CNN is employed to investigate the correlation and nonlinear characteristics of time series. For example, a model utilizing the 2D-CNN as the auto-encoder is used to forecast 2D regional wind speeds [46]. 2D-CNN is employed as the feature withdrawal and is attached to the radial basis function network to estimate wind power (RBF). Table 3 shows the summary of neural network approaches used for wind prediction.

2.2.3. Hybrid Approaches

Hybrid models have emerged as promising approaches for wind power prediction by combining different techniques and models to enhance forecast accuracy and reliability. One example of a hybrid model is the combination of artificial neural networks with wavelet transforms. Wavelet transforms capture both time and frequency information in wind speed data, allowing hybrid models to extract relevant features for prediction and handle different scales and patterns. By combining the benefits of several models, numerous deep learning and machine learning procedures have been created in the literature to increase prediction accuracy further. Another approach combines linear neural networks with methods like tapped delay, considering lagged effects and temporal dependencies. This combination captures both linear and nonlinear relationships, resulting in more accurate predictions for complex wind speed behavior. Hybrid models can also incorporate statistical techniques like time-series analysis and regression models. These complement the predictive power of neural networks by providing a solid foundation for understanding underlying patterns and trends. Data mining, discrete wavelet transforms, and a multilayer perceptron neural network are used to create a hybrid wind power forecaster. Research emphasized that cluster selection speeds up the forecasting process by limiting the data to train the forecaster to the relevant subset rather than the entire dataset. During training, hybrid models integrate different components and optimize their parameters to minimize prediction errors. Careful calibration and parameter tuning ensure that the models work harmoniously and leverage each other’s strengths. By utilizing hybrid models, researchers and practitioners can benefit from the complementary capabilities of different techniques, leading to more accurate and reliable wind power predictions. These models contribute to the advancement of wind power forecasting, facilitating better decision-making in renewable energy systems. A proposed SVM-enhanced Markov approach for forecasting short-term wind power is also included. To predict the nominal evolution of wind generation, finite-state Markov techniques based on data analytics are first used [47]. The SVM forecast is then adequately combined with the finite-state Markov models. A new hybrid model to anticipate wind power with high accuracy would significantly reduce the uncertainty of the system’s operation. The hybrid model approach is built using multiple linear regressions and least square methods (MLR&LS) [48]. This paves the path to employ a novel principle for the prediction methodologies. The suggested hybrid model predicts wind power in two phases. Data transformation is the initial step, in which historical wind power data are transformed into ratios and used as values for the prediction. Inverse transformation, the second phase, represents the total wind power by converting the projected ratios into actual numbers. Figure 3 shows how two architectures extract features and then concatenate the features for better prediction.
The hybrid approach is the common forecasting technique used by sophisticated wind speed prediction systems. However, the multiple reservoirs hybrid model’s application research and error correction still need improvement. In order to do this, a dual dynamic SP-ESN (serial-parallel dynamic echo state network) is employed. Its serial structure may dynamically choose the training set’s length and capture the sequence’s short-term memory information. However, the parallel system cannot automatically correct the prediction inaccuracy of the serial structure. An improved complete ensemble empirical mode decomposition with adaptive noise (ICEEMDAN) approach, the chaotic coyote optimization algorithm (CCOA) and the SP-ESN, are then included in a dynamic forecast model created on stage space reconstruction [49]. This is a helpful model that considers the impact of several climatological variables to advance the accuracy of short-term wind speed forecasts. (a) The filter-wrapper non-dominated sorting differential evolution algorithm containing K-medoid clustering (FWNSDEC) was developed to identify critical meteorological elements and produce various feature subsets. The fusion DL model is constructed for each feature subset. A Convolutional long short-term memory (ConvLSTM) network is then used to process the sample set of three-dimensional sequences. The concluding forecasting outcomes is the regular prediction of all the constructed ConvLSTMs. Singular spectrum analysis (SSA) decomposes the meteorological factors and creates the three-dimensional input structure [50]. Forecasting wind speeds is essential for wind power plants’ reliability and operational safety. However, high-performance wind speed forecasting needs to be improved because the natural wind has strong non-stationary and nonlinear properties. In order to provide precise and trustworthy wind speed forecasting, a unique multi-scale feature adaptive extraction (MSFAE) ensemble model is created in this study. The model builds six GWO-CNN-BiLSTM (GCNBiL) networks with various convolution operator lengths. At different time scales, it extracts and learns the deep autocorrelation feature hidden in high-resolution data. The forecasting outcomes of six GCNBiL benchmark models are then combined using the multi-objective cuckoo-search-moth-flame hybrid optimization (MOCSMFHO) algorithm [17]. Table 4 shows the summary of hybrid approaches used for wind prediction.
Figure 4 illustrates the growth rate of research in the field of wind flow prediction. Initially, researchers predominantly relied on physical models to predict wind flow patterns near tall buildings. However, recent trends indicate a shift towards the adoption of hybrid approaches. These hybrid models combine the strengths of multiple methods, resulting in increased accuracy in wind flow prediction. This figure provides a visual representation of the transition from physical methods to hybrid models in the research domain. At the same time, the latest trends show that the research areas are gradually increasing towards hybrid approach features where the benefits of two or more models are combined with increasing the predicting accuracy rate.
Different types of predictive models, including machine learning, deep learning, and hybrid models, possess their own strengths and weaknesses. Machine learning models exhibit versatility, allowing them to be applied across diverse domains, while certain algorithms offer interpretability and scalability. However, they require manual feature engineering and may struggle with capturing complex patterns or be sensitive to noise. In contrast, deep learning models automatically learn complex features, possess powerful representation capabilities, and can handle large-scale datasets. Nonetheless, they come with computational complexity, lack interpretability, and demand substantial labeled data. Hybrid models combine different models to achieve enhanced accuracy, improved robustness, and flexibility. However, they entail increased complexity, computational overhead, and present interpretability challenges due to the integration of various model types. It is important to acknowledge that these observations are general and can vary based on specific algorithms, datasets, and application domains. Therefore, researchers and practitioners should carefully evaluate these factors when selecting the most suitable model for their prediction tasks.
Limitations and research gap for the methods used for predicting wind patterns will be discussed in the next section.

3. Research Gaps and Limitations

The persistence methods are employed ignoring the weather changes and considering them as deterministic events. Physical methods are suited for short-term forecasting, but their accuracy eventually decreases with an increase in time. As the physical methods do not depend on historical data, they are well suited for new wind farms. The electrical utilities use some of the physical methods for instant measurement of wind speed. The numerical methods are suitable for long-term predictions. The WAsP model is widely used across the wind industry despite its topographical limitations considering that the sites are located in smooth terrain. The MCP methods are valuable in estimating the long-term wind characteristics at farm sites. There are several uncertainties abounding in wind forecasting, and there are no robust methods devised to quantify uncertainties, which are found to underestimate and produce erroneous results. Thus, MCP methods are most applied and prove effective on linear regression models. Some statistical methods use variability in the relationship between the current data and long-term variability between the reference and target regions to assess the uncertainty.
The MCP methods make predictions only based on the current data available in the reference and target regions, thus there is little information on uncertainty. Autoregression and moving-average-based statistical methods are best suited for short-term predictions. The predictive ARIMA models showed reliable results that were more accurate than backpropagation neural networks for short time intervals of calculation. The ARIMA models can be made more effective when integrated into hybrid models. The BLS technique used wind-map image data instead of raw NWP data, which also includes the climatology, vegetation, and surface morphology. BLS and MCS produced quick and cost-effective estimations for long-term predictions. The methods used wind maps, and the maps are only available up to 45 m from the proposed site whereas NWP raw data are available at various heights. The BLS with vertical scaling technique proved to produce better accuracy than previously. The accuracy of estimations depends on the correctness of meteorological parameters and if any error is made then it greatly affects the accuracy of the prediction. The statistical methods rely on the previous wind data and fail to consider the other atmospheric parameters that prevail in the present.
Table 5 presents a comprehensive overview of the methodology and research gap in intelligence-based approaches for wind flow prediction. It provides insights into the techniques and methods employed in these approaches, such as machine learning and deep learning. Additionally, the table highlights the existing research gap in this area, indicating areas where further investigation and improvement are required. The information in Table 5 helps readers understand the landscape of intelligence-based approaches and the potential areas for future research and advancements.
Table 1, Table 2, Table 3 and Table 4 provide a basic list of several current techniques that can optimize the forecasting performance of wind power forecasting models. Although it has been demonstrated that the methodologies listed in the tables above have produced some research findings on wind power forecasting, there are still several research gaps worthy of further exploration in Table 5.

4. State of Art and Future Directions

Currently, one of the top trends in wind and weather forecasting methods used by NASA and other geographic research institutes is the use of advanced numerical models. These models use mathematical equations to simulate the behavior of the atmosphere and make predictions about future weather patterns. NASA, for example, uses a model called the Global Forecast System (GFS) to make global weather predictions. Another trend in wind and weather forecasting is the use of satellite data. Satellites can provide a wealth of information about the atmosphere, including temperature, humidity, and wind patterns. NASA and other research institutes use these data to improve the accuracy of weather predictions. A third trend in wind and weather forecasting is the use of machine learning algorithms. As mentioned before, these algorithms can analyze large amounts of data and make predictions based on patterns and trends. NASA and other research institutes are exploring the use of these algorithms to improve the accuracy of weather predictions.
One way to improve these forecasting methods is to increase the amount of data used in the models. With more data, the models can better capture the complexity of the atmosphere and make more accurate predictions. However, it is important to ensure that the data used are of high quality and relevant to the forecast being made. Another way to improve these forecasting methods is to increase the resolution of the models. Higher resolution models can capture smaller-scale weather phenomena, such as thunderstorms and tornadoes, which are often missed by lower resolution models. However, high-resolution models also require more computational power and resources, which can be a limitation. A third way to improve these forecasting methods is to increase collaboration between research institutes. By sharing data and models, research institutes can improve the accuracy of weather predictions by combining the strengths of different models and data sets. Additionally, collaboration can also help to identify gaps in knowledge and research areas that need further exploration.
In addition to these points, it is important to note that weather forecasting is a challenging task, and even with the most advanced methods, it is not possible to predict the weather with 100% accuracy. Therefore, it is crucial to have a clear understanding of the limitations of the forecasting methods used, and to communicate this information to the public in a transparent and accurate way. Ultimately, advanced numerical models, satellite data, and machine learning algorithms are some of the top trends in wind and weather forecasting methods used by NASA and other research institutes. To improve these methods, it is important to increase the amount of data used in the models, increase the resolution of the models, and increase collaboration between research institutes. However, it is also important to acknowledge the limitations of forecasting methods and communicate them accurately to the public.

5. Conclusions

This paper presents an overview of wind characteristic forecasting schemes available in various domains. Many forecasting models have been introduced, and researchers are still focusing on robustness. Every model has its own features and limitations. Some models performed well at short-term forecasting while some are best suited for the long term. Some physical or persistence methods like WAsP are simple and widely used despite their limitations around topography of the sites. The physical methods do not require any historical data for wind forecasting at new sites whereas the numerical or statistical methods require comprehensive information about the sites. The MCP methods were used for linear long-term wind energy predictions. The data-driven machine learning models achieved greater accuracy with minimized errors in wind forecasting. For long-term predictions, neural networks have gained more visibility in forecasting models due to their greater accuracy with a high volume of data. On the evaluation of various strategies, most of the models rely on underlying data and thus become overfit to available data and cannot be generalized to other data. Besides employing individual methods, hybridization of methods and ensembling of models are proved to achieve greater accuracy with minimal errors. For any forecasting approach the atmospheric conditions play a crucial role in determining the accuracy and fitness of the model. In addition, for the weather forecasting models the accuracy relies on the land topology, altitude of wind measurement, temperature, pressure and so on.

Author Contributions

Conceptualization, Y.N. and A.A.Y.A.; validation, Y.N., A.M. and A.A.Y.A.; formal analysis, G.W. and K.R.S.P.; investigation, G.W. and K.R.S.P.; resources, G.W. and K.R.S.P.; writing—original draft preparation, G.W. and K.R.S.P.; writing—review and editing, A.A.Y.A. and Y.N.; visualization, G.W. and K.R.S.P.; supervision, Y.N. and A.M.; project administration, Y.N. and A.A.Y.A. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

No new data were created or analyzed in this study. Data sharing is not applicable to this article.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Chang, W.-Y. A Literature Review of Wind Forecasting Methods. J. Power Energy Eng. 2014, 2, 161–168. [Google Scholar] [CrossRef]
  2. Kim, B.; Lee, D.-E.; Preethaa, K.S.; Hu, G.; Natarajan, Y.; Kwok, K. Predicting wind flow around buildings using deep learning. J. Wind. Eng. Ind. Aerodyn. 2021, 219, 104820. [Google Scholar] [CrossRef]
  3. Monteiro, M.J.; Couto, F.T.; Bernardino, M.; Cardoso, R.M.; Carvalho, D.; Martins, J.P.A.; Santos, J.A.; Argain, J.L.; Salgado, R. A Review on the Current Status of Numerical Weather Prediction in Portugal 2021: Surface–Atmosphere Interactions. Atmosphere 2022, 13, 1356. [Google Scholar] [CrossRef]
  4. Lei, M.; Shiyan, L.; Chuanwen, J.; Hongling, L.; Yan, Z. A review on the forecasting of wind speed and generated power. Renew. Sustain. Energy Rev. 2009, 13, 915–920. [Google Scholar] [CrossRef]
  5. Sharma, P.K.; Warudkar, V.; Ahmed, S. Application of a new method to develop a CFD model to analyze wind characteristics for a complex terrain. Sustain. Energy Technol. Assess. 2020, 37, 100582. [Google Scholar] [CrossRef]
  6. Mittal, H.; Sharma, A.; Gairola, A. Numerical simulation of pedestrian level wind flow around buildings: Effect of corner modification and orientation. J. Build. Eng. 2019, 22, 314–326. [Google Scholar] [CrossRef]
  7. Bowen, A.J.; Mortensen, N.G. Exploring the limits of WAsP the wind atlas analysis and application program. In European Union Wind Energy Conference Proceedings; Zervos, A., Ehmann, H., Helm, P., Eds.; H.S. Stephens & Associates: Bedford, UK, 1996; pp. 584–587. [Google Scholar]
  8. Carta, J.A.; Velázquez-Medina, S.; Cabrera, P. A review of measure-correlate-predict (MCP) methods used to estimate long-term wind characteristics at a target site. Renew. Sustain. Energy Rev. 2013, 27, 362–400. [Google Scholar] [CrossRef]
  9. Hill, D.C.; McMillan, D.; Bell, K.R.W.; Infield, D. Application of Auto-Regressive Models to U.K. Wind Speed Data for Power System Impact Studies. IEEE Trans. Sustain. Energy 2012, 3, 134–141. [Google Scholar] [CrossRef]
  10. Ulrich, F.; Lange, M.; Mönnich, K.; Waldl, H.-P.; Beyer, H.G.; Luig, A. A statistical analysis of the reduction of the wind power prediction error by spatial smoothing effects. J. Wind. Eng. Ind. Aerodyn. 2002, 90, 231–246. [Google Scholar]
  11. Dhiman, H.S.; Deb, D. A Review of Wind Speed & Wind Power Forecasting Techniques. arXiv 2020. [Google Scholar] [CrossRef]
  12. Ayodele, T.R.; Olarewaju, R.; Munda, J.L. Comparison of different wind speed prediction models for wind power application. In Proceedings of the 2019 Southern African Universities Power Engineering Conference/Robotics and Mechatronics/Pattern Recognition Association of South Africa (SAUPEC/RobMech/PRASA), Bloemfontein, South Africa, 28–30 January 2019; pp. 223–228. [Google Scholar] [CrossRef]
  13. Scheme, M.C. Microgeneration Installation Standard: MIS 3002, 2013. Available online: https://mcscertified.com/wp-content/uploads/2021/10/MIS-3003.pdf (accessed on 30 April 2023).
  14. Allen, D.J.; Tomlin, A.S.; Bale, C.S.E.; Skea, A.; Vosper, S.; Gallani, M.L. A boundary layer scaling technique for estimating near-surface wind energy using numerical weather prediction and wind map data. Appl. Energy 2017, 208, 1246–1257. [Google Scholar] [CrossRef]
  15. Li, H.; Jiang, Z.; Shi, Z.; Han, Y.; Yu, C.; Mi, X. Wind-speed prediction model based on variational mode decomposition, temporal convolutional network, and sequential triplet loss. Sustain. Energy Technol. Assess. 2022, 52, 101980. [Google Scholar] [CrossRef]
  16. Liu, X.; Lin, Z.; Feng, Z. Short-term offshore wind speed forecast by seasonal ARIMA—A comparison against GRU and LSTM. Energy 2021, 227, 120492. [Google Scholar] [CrossRef]
  17. Chen, J.; Liu, H.; Chen, C.; Duan, Z. Wind speed forecasting using multi-scale feature adaptive extraction ensemble model with error regression correction. Expert Syst. Appl. 2022, 207, 117358. [Google Scholar] [CrossRef]
  18. Liu, Z.; Jiang, P.; Wang, J.; Zhang, L. Ensemble forecasting system for short-term wind speed forecasting based on optimal sub-model selection and multi-objective version of mayfly optimization algorithm. Expert Syst. Appl. 2021, 177, 114974. [Google Scholar] [CrossRef]
  19. Song, Z.; Geng, X.; Kusiak, A.; Xu, C. Mining Markov chain transition matrix from wind speed time series data. Expert Syst. Appl. 2011, 38, 10229–10239. [Google Scholar] [CrossRef]
  20. Pujari, K.N.; Miriyala, S.S.; Mittal, P.; Mitra, K. Better wind forecasting using Evolutionary Neural Architecture search driven Green Deep Learning. Expert Syst. Appl. 2023, 214, 119063. [Google Scholar] [CrossRef]
  21. Xue, H.; Jia, Y.; Wen, P.; Farkoush, S.G. Using of improved models of Gaussian Processes in order to Regional wind power forecasting. J. Clean. Prod. 2020, 262, 121391. [Google Scholar] [CrossRef]
  22. Shawon, S.M.R.H.; Saaklayen, M.A.; Liang, X. Wind Speed Forecasting by Conventional Statistical Methods and Machine Learning Techniques. In Proceedings of the 2021 IEEE Electrical Power and Energy Conference (EPEC), Toronto, ON, Canada, 22–31 October 2021; pp. 304–309. [Google Scholar] [CrossRef]
  23. Liu, H.; Yang, R.; Wang, T.; Zhang, L. A hybrid neural network model for short-term wind speed forecasting based on decomposition, multi-learner ensemble, and adaptive multiple error corrections. Renew. Energy 2021, 165, 573–594. [Google Scholar] [CrossRef]
  24. Wang, K.; Fu, W.; Chen, T.; Zhang, B.; Xiong, D.; Fang, P. A compound framework for wind speed forecasting based on comprehensive feature selection, quantile regression incorporated into convolutional simplified long short-term memory network and residual error correction. Energy Convers. Manag. 2020, 222, 113234. [Google Scholar] [CrossRef]
  25. Chen, C.; Liu, H. Medium-term wind power forecasting based on multi-resolution multi-learner ensemble and adaptive model selection. Energy Convers. Manag. 2020, 206, 112492. [Google Scholar] [CrossRef]
  26. Liu, H.; Chen, C.; Lv, X.; Wu, X.; Liu, M. Deterministic wind energy forecasting: A review of intelligent predictors and auxiliary methods. Energy Convers. Manag. 2019, 195, 328–345. [Google Scholar] [CrossRef]
  27. Zhu, S.; Yuan, X.; Xu, Z.; Luo, X.; Zhang, H. Gaussian mixture model coupled recurrent neural networks for wind speed interval forecast. Energy Convers. Manag. 2019, 198, 111772. [Google Scholar] [CrossRef]
  28. Dowell, J.; Pinson, P. Very-short-term probabilistic wind power forecasts by sparse vector autoregression. IEEE Trans. Smart Grid 2015, 7, 763–770. [Google Scholar] [CrossRef]
  29. Demolli, H.; Dokuz, A.S.; Ecemis, A.; Gokcek, M. Wind power forecasting based on daily wind speed data using machine learning algorithms. Energy Convers. Manag. 2019, 198, 111823. [Google Scholar] [CrossRef]
  30. Xiao, L.; Shao, W.; Jin, F.; Wu, Z. A self-adaptive kernel extreme learning machine for short-term wind speed forecasting. Appl. Soft Comput. 2021, 99, 106917. [Google Scholar] [CrossRef]
  31. Li, Y.; Wu, H.; Liu, H. Multi-step wind speed forecasting using EWT decomposition, LSTM principal computing, RELM subordinate computing and IEWT reconstruction. Energy Convers. Manag. 2018, 167, 203–219. [Google Scholar] [CrossRef]
  32. Chitsazan, M.A.; Fadali, M.S.; Trzynadlowski, A.M. Wind speed and wind direction forecasting using echo state network with nonlinear functions. Renew. Energy 2019, 131, 879–889. [Google Scholar] [CrossRef]
  33. Altan, A.; Karasu, S.; Zio, E. A new hybrid model for wind speed forecasting combining long short-term memory neural network, decomposition methods and grey wolf optimizer. Appl. Soft Comput. 2021, 100, 106996. [Google Scholar] [CrossRef]
  34. Niu, M.; Hu, Y.; Sun, S.; Liu, Y. A novel hybrid decomposition-ensemble model based on VMD and HGWO for container throughput forecasting. Appl. Math. Model. 2018, 57, 163–178. [Google Scholar] [CrossRef]
  35. Yan, G.; Yu, C.; Bai, Y. A new hybrid ensemble deep learning model for train axle temperature short term forecasting. Machines 2021, 9, 312. [Google Scholar] [CrossRef]
  36. Liu, H.; Chen, C. Multi-objective data-ensemble wind speed forecasting model with stacked sparse autoencoder and adaptive decomposition-based error correction. Appl. Energy 2019, 254, 113686. [Google Scholar] [CrossRef]
  37. Sun, S.; Qiao, H.; Wei, Y.; Wang, S. A new dynamic integrated approach for wind speed forecasting. Appl. Energy 2017, 197, 151–162. [Google Scholar] [CrossRef]
  38. Deng, Y.; Wang, B.; Lu, Z. A hybrid model based on data preprocessing strategy and error correction system for wind speed forecasting. Energy Convers. Manag. 2020, 212, 112779. [Google Scholar] [CrossRef]
  39. Chouikhi, N.; Ammar, B.; Rokbani, N.; Alimi, A.M. PSO-based analysis of Echo State Network parameters for time series forecasting. Appl. Soft Comput. 2017, 55, 211–225. [Google Scholar] [CrossRef]
  40. Subbiah; Sankari, S.; Paramasivan, S.K.; Arockiasamy, K.; Senthive, S.; Thangavel, M. Deep Learning for Wind Speed Forecasting Using Bi-LSTM with Selected Features. Intell. Autom. Soft Comput. 2023, 35, 3829–3844. [Google Scholar] [CrossRef]
  41. Sumit, S.; Aggarwal, S.K. Wind power forecasting using wavelet transforms and neural networks with tapped delay. CSEE J. Power Energy Syst. 2018, 4, 197–209. [Google Scholar] [CrossRef]
  42. Han, S.; Qiao, Y.H.; Yan, J.; Liu, Y.Q.; Li, L.; Wang, Z. Mid-to-long term wind and photovoltaic power generation prediction based on copula function and long-short term memory network. Appl. Energy 2019, 239, 181–191. [Google Scholar] [CrossRef]
  43. Wang, J.; Yan, J.; Li, C.; Gao, R.X.; Zhao, R. Deep heterogeneous GRU model for predictive analytics in smart manufacturing: Application to tool wear prediction. Comput. Ind. 2019, 111, 1–14. [Google Scholar] [CrossRef]
  44. Chen, Y.; Kang, Y.; Chen, Y.; Wang, Z. Probabilistic forecasting with temporal convolutional neural network. Neurocomputing 2020, 399, 491–501. [Google Scholar] [CrossRef]
  45. Liu, H.; Mi, X.; Li, Y. Smart deep learning-based wind speed prediction model using wavelet packet decomposition, convolutional neural network and convolutional long short term memory network. Energy Convers. Manag. 2022, 166, 120–131. [Google Scholar] [CrossRef]
  46. Chen, Y.; Wang, Y.; Dong, Z.; Su, J.; Han, Z.; Zhou, D.; Zhao, Y.; Bao, Y. 2-D regional short-term wind speed forecast based on CNN-LSTM deep learning model. Energy Convers. Manag. 2021, 244, 114451. [Google Scholar] [CrossRef]
  47. Yang, L.; He, M.; Zhang, J.; Vittal, V. Support-vector-machine-enhanced markov model for short-term wind power forecast. IEEE Trans. Sustain. Energy 2015, 6, 791–799. [Google Scholar] [CrossRef]
  48. Eissa, M.; Yu, J.; Wang, S.; Liu, P. Assessment of wind power prediction using hybrid method and comparison with different models. J. Electr. Eng. Technol. 2018, 13, 1089–1098. [Google Scholar] [CrossRef]
  49. Ding, L.; Bai, Y.-L.; Fan, M.-H.; Yu, Q.-H.; Zhu, Y.-J.; Chen, X.-Y. Serial-parallel dynamic echo state network: A hybrid dynamic model based on a chaotic coyote optimization algorithm for wind speed prediction. Expert Syst. Appl. 2023, 212, 118789. [Google Scholar] [CrossRef]
  50. Lv, S.-X.; Wang, L. Multivariate wind speed forecasting based on multi-objective feature selection approach and hybrid deep learning model. Energy 2023, 263, 126100. [Google Scholar] [CrossRef]
  51. Shen, Z.; Fan, X.; Zhang, L.; Yu, H. Wind speed prediction of unmanned sailboat based on CNN and LSTM hybrid neural network. Ocean. Eng. 2022, 254, 111352. [Google Scholar] [CrossRef]
  52. Buturache, A.-N.; Stancu, S. Wind energy prediction using machine learning. Low Carbon Econ. 2021, 12, 1–21. [Google Scholar] [CrossRef]
  53. Li, Y.; Wang, R.; Li, Y.; Zhang, M.; Long, C. Wind power forecasting considering data privacy protection: A federated deep reinforcement learning approach. Appl. Energy 2023, 329, 120291. [Google Scholar] [CrossRef]
Figure 1. Architectural stage of machine learning approaches.
Figure 1. Architectural stage of machine learning approaches.
Sustainability 15 12914 g001
Figure 2. Working of CNN architecture.
Figure 2. Working of CNN architecture.
Sustainability 15 12914 g002
Figure 3. Hybrid approach framework.
Figure 3. Hybrid approach framework.
Sustainability 15 12914 g003
Figure 4. Growth rate of research from physical method to hybrid models.
Figure 4. Growth rate of research from physical method to hybrid models.
Sustainability 15 12914 g004
Table 1. Summary of conventional wind energy prediction approaches.
Table 1. Summary of conventional wind energy prediction approaches.
Author and YearAlgorithm(s)ContributionAdvantage
Maria Jose Monteiro et al. 2022, [3]Numerical Weather PredictionsA workshop on numerical weather prediction methods was conducted by Portuguese Institute for the Sea and Atmosphere to discuss the ongoing research and development in weather prediction The workshop report quoted that numerical process driven models has gained more performance rather standalone numerical methods.
Hemant Mittal et al. 2018, [6]CFDAnalysis of pedestrian-level wind environment by corner-modified building structures The (Shear Stress Transport-K-epsilon) model with the LK (Launder and Kato) amendment and modified closure coefficients outperforms the RKE (Re-Normalization Group K-epsilon) model in simulating wave movement behind buildings. SKE, with LK amendment, improves accuracy in predicting turbulent flows in the wave region, while RKE is enhanced for high wind conditions in corner areas.
Pramod Kumar Sharma et al. 2019, [5]CFD and CREOThe system was developed to predict wind information on complex terrainThe model proved to be a cost-effective
approach when coupled with CFD rather than WAsP for complex terrain.
Hill D.C et al. 2012, [7]Univariate and multivariate autoregressionThe work analyzed the wind power impact for future power systems, considering geographically-dispersed wind speed. This model order depends on time resolution and demands more parameters for persistent results
Focken, Ulrich et al. 2001, [10]Spatial CorrelationInvestigation into statistical wind power prediction across distributed wind farms.Spatial correlation between the regions showed that the magnitude of error depends on size of region of interest and not on number of sites
Ayodele T. R. et al. 2021, [11]Markov chain, ARMA, Weibull The study applied the different models to short-term, medium-term and long-term wind forecastingThe results proved ARMA-based predictions were best suited for short- and long-term predictions. MC order methods performed well on short- and medium-term prediction whereas the physical models produced least accuracy at all time intervals.
D.J. Allen. et al. 2017, [14]Boundary layer scalingThe NWP model used wind-map data derived for forecasting long-term wind speed and densities at 124 sites The model produced improved 1.5 % results over numerical object boundary layer analysis but was unable to produce accuracy over raw NWP data.
Huang Li et al. 2019, [15]VMD-TCN-STImplemented the accurate prediction of wind speed to guarantee safe and stable functioning of power systemsThe proposed model performed with improved accuracy but was limited to stable wind series data.
Xiaolei Liu et al. 2021, [16]Seasonal ARIMAA comparative study of seasonal ARIMA and deep learning models LSTM and GTU for short-term offshore wind speed prediction was conductedSARIMA produced maximum performance owing to a univariate dataset and required few parameters, whereas the deep learning models did not seem to be real for short-term time sequences due to the involvement of a greater number of hyperparameters
Zhenkun Liu, et al. 2020, [18]Hybrid modelA hybridized model of data decomposition, sub-model selection and optimization of the Mayfly algorithm was proposed to forecast short-term wind characteristics The results showed that the ensembled model produced more promising results than individual predictors, but in the case of hybrid models their performance depended on the data patterns.
Zhe Song et al. 2011, [19]Markov chain and evolutionary algorithmThe method was developed to extract the important statistical aspects of wind series data at different time intervals.The approach proved that a first order transition matrix is the best base estimator when used with an evolution algorithm for optimized results.
Keerthi Nagasree Pujari et al.
2022, [20]
PMF Performed comparative analysis of time-series wind data using a decomposition statistical model, LSTM, auto regressive models, and neural networksThe results proved that the proposed neural network architecture model produced more accurate results over robust statistical models.
Hao Xue et al. 2022, [21]Gaussian ProcessThe novel method using Gaussian processes was applied to measure the unsteady wind characteristics at a regional areaThe results showed that indirect dynamic GP produced better performance with lesser error both in deterministic and probability wind power prediction modes
S.M.R.H. Shawon et al. 2021, [22]ARIMA Investigation into accuracy of wind prediction by ARIMA and ML algorithmsThe results showed ML models outperformed conventional methods for short-term wind energy prediction
Table 2. Summary of Machine learning approaches.
Table 2. Summary of Machine learning approaches.
Author and YearAlgorithm(s)ContributionAdvantage
Dowell Jethro et al. 2015, [28]Sparse Vector Autoregression
(sVAR)
The goal was to generate precise very-short-term forecasts at various wind farms.The model’s location parameter lowered the total number of coefficients. The deterministic and probabilistic skill ratings of the sVAR were increased.
Demolli. Halil et al. 2019, [29]LASSO, kNN, XGBoost, Random Forest, and SVRUsing machine learning methods, wind power forecasting was carried out using daily wind speed data.The daily total wind power values of sites other than the model-trained location could be accurately predicted by the algorithms. To be used before constructing wind turbines in an uncharted region.
Xiao Liye et al. 2021, [30]Kernel extreme learning machineKELM is appropriate for wind speed forecasting, which requires fast updating of the most recent data to ensure forecasting accuracy and efficacy.KELM learns from the new data without having to start from scratch, removes the results from the old data, and directly keeps the training results from the overlapped data.
Li. Yanfei et al. 2018, [31]Regularized Extreme Learning Machine (RELM), Inverse Empirical Wavelet Transform (IEWT)The raw wind speed series was broken down into several sub-layers using the Empirical Wavelet Transform (EWT); each sub-forecasting layer’s error series was modelled using a RELM as predictor.The forecasting structure performed much better when used with a RELM network-based error modelling approach. The RELM framework and the IEWT-based outlier correction method effectively enhanced wind speed forecasting accuracy.
Chitsazan M. A. et al. 2019, [32]Echo state networks.Proposed two techniques based on the nonlinear interactions between the internal states of echo state networks for wind speed and 12-direction forecasting.The design is straightforward, has a high capacity for learning and prediction accuracy, and does not need extensive training, or complicated optimization.
Altan, A. et al. 2020, [33]Grey wolf optimizer (GWO), Long short-term memory (LSTM),A particular model, a decomposition technique, and a sophisticated optimization procedure were all combined in the forecasting model.Data composed from five wind stations were used in the proposed LSTM-GWO combined WSF model. In the preprocessing stage, WMA performed the filling of missing data and flattening of WSTs data.
Liu, Z. et al. 2021, [18]Ensemble modelA newly developed multi-objective point forecasting (PF), version of MA, and interval forecasting (IF), a wind speed ensemble forecasting system (WSEFS) is proposed. The benefits of data decomposition, numerous predictors, sub-model selection, and a recently suggested multi-objective version of MA are the main features of the proposed WSEFS, which may produce high-quality wind speed PF and IF outcomes.
Niu, M. et al. 2018, [34]Ensemble modelA decomposition and ensemble model were developed for container throughput forecasting based on the “decomposition and ensemble” and “divide and conquer” ideas.Automatic parameter calculation and optimization in ARIMA and SVR can reduce the obstacles that prevent non-experts from utilizing the suggested model to address real-world prediction issues.
Yan, G. et al. 2021, [35]Particle swarm optimization and gravitational search algorithm (PSOGSA)A three-step data-driven hybrid approach was utilized to predict locomotive axle environmental parameters, including temperature, wind, and humidity.The data was combined using the Complementary empirical mode decomposition method. The goal function weights could be optimized, ensembled, and combined using the PSOGSA to provide the final forecasts.
Liu, H. et al. 2019, [36]Unsupervised machine learningThe hidden representation of the original 3 s high-resolution wind speed data is proposed to be extracted using a two-layer stacked sparse autoencoder (SSAE).A multi-step wind speed forecasting model with deep bidirectional learning, multi-objective data ensemble, and error correction has been suggested. On datasets acquired from three separate places, four experiments were run.
Wang, K. et al. 2020, [24]Residual error correctionWind speed was predicted using a novel compound framework coupling decomposition approach, synchronous optimization, and residual error correction (REC).The developed principal forecasting model, REC further improved performance. The suggested compound framework can be used as a strong tool because of its greater ability to capture possibly unclear information.
Deng, Y. et al. 2020, [38]Empirical wavelets transform, ElmanA wind speed forecasting model with an innovative error correction mechanism, data decomposition, and forecasting module.EWT separated the sub-signals in the raw wind data. Models of Elman neural networks were created to predict the sub-signals. A novel error correction system was designed to improve the decomposition-based models’ capacity for prediction.
Table 3. Summary of neural network approaches.
Table 3. Summary of neural network approaches.
Author and YearAlgorithm(s)ContributionAdvantage
Bubryur, K. et al. 2021, [2]Generative adversarial imputation networkInvestigating the wind flow pattern with these unmeasured wind speeds is quite labor-intensive. The deep learning model was used to impute unmeasured speeds near building models.The unmeasured wind velocity values were correctly predicted by the GAIN model. The validated GAIN model could be incorporated into the PIV study in order to impute the unmeasured wind velocities and acquire an entire wind flow pattern.
Subbia, S. et al. 2023, [40]Bi-directional LSTMThe primary goal was to handle concerns with uncertainty, the curse of dimensionality, overfitting, and nonlinearity to improve wind speed forecasting performance.Using Boruta wrapper feature selection, the model extracted essential meteorological information for wind speed forecasts (BFS). By considering the wind speed from the previous and next time steps, Bi-LSTM then predicted the wind speed.
Saroha, S.et al. 2018, [41]Linear Neural Networks with Tapped Delay (LNNTD)A model using LNNTD has been applied to wind power estimation for the Ontario Electricity Market (OEM)The developed method is presented for a stochastic time series of wind energy forecasting. The advantage of this method is that it considers all sources of uncertainty supplied by the input data indecision throughout the parametric hypothesis.
Han, S. et al. 2021, [42]LSTMThe main meteorological elements significantly impacting power generation because of nonlinear effects were successfully extracted using a long-term memory network.The mid-to-long-term forecast accuracy of wind and solar power generation based on the long short-term memory network was significantly increased associated to the persistence and support vector machine models.
Wang, J. et al. 2019, [43]Deep heterogeneous GRUBi-Directional GRU and Unidirectional GRU were stacked to create a new deep learning model for two-step prediction that added an intermediary layer to the model.The temporal pattern concealed in the sequential mechanical data might be discovered using the suggested deep heterogeneous GRU model and local feature extraction.
Chen, Y. et al. 2020, [44]Temporal convolutional neural network (TCN)The framework supports both parametric and non-parametric settings for estimating probability density. To capture the temporal dependencies of the series, stacked residual blocks were utilized, which were based on dilated causal convolutional nets.The methodology has excellent scalability and flexibility due to its capacity to learn latent correlation between series and handle challenging real-world forecasting scenarios including data sparsity and cold beginnings.
Liu, H. et al. 2022, [45]CNNAn innovative wind speed forecast model based on the WPD (Wavelet Packet Decomposition) and CNN.The resultant high-frequency sublayers were forecasted using CNN with a 1D convolution operator. To finish forecasting the low-frequency sub-layer, CNN-LSTM was used.
Chen, Y. et al. 2021, [46]2D-CNNA CNN auto-encoder and long short-term memory were used to create a novel deep learning model for a 2-D regional wind speed forecast (LSTM).The array of wind speed mechanisms was skilled as a structured 2D matrix using a CNN model. Utilizing deep knowledge from the preceding phases, such a deep feature was repeatedly expected sideways across the timeline using the LSTM unit.
Table 4. Summary of hybrid approaches.
Table 4. Summary of hybrid approaches.
Author and YearAlgorithm(s)ContributionAdvantage
Yang, L. et al. 2015, [47]Support vector machine (SVM)-enhanced Markov modelWind slope dynamics, a support vector machine (SVM)-improved Markov model, was created for short-term wind power forecasting.The SVM-enhanced Markov model for forecasting short-term wind energy was created. The model considered wind ramps and the seasonality and diurnal nonstationary of wind farm power.
Eissa, M. et al. 2018, [48]Multiple linear regressions, least square methodsIn order to create the hybrid model for a very short-term WPP (VSTWPP), analytical data, multiple linear regressions, and least squares techniques were used (MLR&LS).Data transformation was the initial step, in which historical wind power data was transformed into ratios and used as values for the prediction. The predicted ratios were changed into the actual values, after which the total wind power was forecasted using inverse transformation.
Shen, Z. et al. 2022, [51]CNN-LSTM hybrid neural networkFor multi-step wind speed prediction, a novel hybrid neural network method based on convolutional neural network (CNN) and long short-term memory (LSTM) is proposed.Two components make up the proposed multi-step wind speed prediction scheme: a data processing module and a model module. The grid search technique is enhanced by choosing the input length and learning rate hyperparameters.
Buturache. et al. 2021, [52]ANN, SVR, Random ForestA comparative and thorough analysis presents the advantages and disadvantages of applying artificial neural networks, support vector regression, random trees, and random forests.The entire cognitive process, including feature engineering, metrics selection, model selection, or hyperparameter tweaking, is revealed using a step-by-step methodology built on the CRISP-DM data mining methodology.
Li, Yang. et al. 2023, [53]Deep reinforcement learning, federatedlearningFederated deep reinforcement learning is a forecasting method for ultra-short-term wind power forecasting that combines federated learning and deep reinforcement learning (DRL) (FedDRL)The FedDRL scheme uses the DDPG algorithm as its fundamental prediction model to increase forecasting accuracy. As part of the proposed forecasting scheme, the federated learning framework enables users to upload pertinent parameters and save private data locally for training.
Ding, L. et al. 2023, [49]ICEEMDAN, SP-ESN, CCOA (chaotic coyote optimization algorithm)In sophisticated wind speed prediction systems, the hybrid approach is acknowledged as the standard forecasting technique.A dynamic prediction model based on phase space reconstruction that combines the SP-ESN, the CCOA, and the ICEEMDAN approach is created.
Lv, S. et al. 2023, [50]FWNSDEC, SSA, ConvLSTM, This study suggests a useful methodology for improving the accuracy of short-term wind speed forecasts by considering the impact of several meteorological phenomena.The FWNSDEC make use of meteorological variables and produce various feature subsets. The average prediction of all constructed ConvLSTMs represents the final forecasting outcome.
Chen, J. et al. 2022, [17]GWO-CNN-BiLSTMA hybrid-new multi-scale feature adaptive extraction (MSFAE) ensemble model has been created to produce precise and trustworthy wind speed forecasts.The model is built with six GWO-CNN-BiLSTM (GCNBiL) networks with various convolution operator lengths, and at various time scales. A multi-objective hybrid optimization algorithm is then used by the proposed model to combine the forecasting outputs of the six GCNBiL benchmark models.
Table 5. Methodology and research gap in intelligent based approaches.
Table 5. Methodology and research gap in intelligent based approaches.
MethodResearch Gap
Sparse Vector Autoregression (sVAR)The Sparse vector regression approach’s disadvantage is that it only considers a small dimension. Work should extend to spatial dimensions.
LASSO and SVRWhen there are two or more highly correlated variables, or when the number of predictors exceeds the number of observations, Lasso regression and SVR will not work well. For predicting wind patterns, the attributes are highly correlated to each other.
Ensemble LearningDue to the added complexity, using ensemble methods decreases the model’s interpretability. Additionally, applications requiring quick responses will not be suitable for computation- and design-intensive systems.
Kernel extreme learning machine (KELM)The PSO algorithm is needed along with KELM to modify the neural network kernel function parameters to get the best values. Both generalization performance and stability are lacking in the KELM algorithm.
Echo state networks
(ESN)
ESNs’ dependency on the hyperparameters is one of its main drawbacks. It is difficult to train these networks because the stable working region of ESNs in the hyperparameter space is extremely constrained.
Grey wolf optimizerThe Grey Wolf Optimization (GWO) algorithm has a few drawbacks, including poor local search performance, low solving accuracy, and a sluggish convergence rate.
Particle Swarm OptimizationIn a high-dimensional dataset, the particle swarm optimization (PSO) technique has a low convergence rate during the iterative process. PSO does not perform well because of its computational complexity when solving the high-dimensional dataset.
Empirical wavelets transformUnderstanding the variables important to a project or model is the largest issue with the empirical wavelets transform (EWT). Shift sensitivity, inadequate directionality, and a lack of phase information are three significant drawbacks.
Generative adversarial imputation networkThe generator and discriminator networks in a GAIN are continually contending with one another, which can lead to unstable and slow training. Every generator iteration overoptimizes for a specific discriminator, and the discriminator never learns how to escape the trap.
LSTMThe difficulty of LSTMs to manage temporal dependencies longer than a few steps is one of its main drawbacks. The small size of the context window is yet another drawback of LSTMs.
Linear Neural NetworksOnly linear relationships between input and output vectors can be learned by linear networks. Problems with a temporal component cannot be solved by linear neural networks.
GRUThe sluggish convergence rate and low learning efficiency of GRU models continue to be an issue, leading to excessively long training times and even under-fitting when used alone.
CNNThe drawbacks of CNNs include the requirement for a large amount of training data and the inability to encode the position and orientation of objects. The position and orientation of objects are not encoded which will lead more complexity in the proposed model.
Deep reinforcement learningDuring the learning process, federated learning necessitates frequent communication between nodes. Therefore, it requires more than just adequate local processing and memory. Only discrete action spaces are suitable for deep reinforcement techniques.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Sri Preethaa, K.R.; Muthuramalingam, A.; Natarajan, Y.; Wadhwa, G.; Ali, A.A.Y. A Comprehensive Review on Machine Learning Techniques for Forecasting Wind Flow Pattern. Sustainability 2023, 15, 12914. https://doi.org/10.3390/su151712914

AMA Style

Sri Preethaa KR, Muthuramalingam A, Natarajan Y, Wadhwa G, Ali AAY. A Comprehensive Review on Machine Learning Techniques for Forecasting Wind Flow Pattern. Sustainability. 2023; 15(17):12914. https://doi.org/10.3390/su151712914

Chicago/Turabian Style

Sri Preethaa, K. R., Akila Muthuramalingam, Yuvaraj Natarajan, Gitanjali Wadhwa, and Ahmed Abdi Yusuf Ali. 2023. "A Comprehensive Review on Machine Learning Techniques for Forecasting Wind Flow Pattern" Sustainability 15, no. 17: 12914. https://doi.org/10.3390/su151712914

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop