Next Article in Journal
Analysis of Energy Generation Efficiency and Reliability of a Cogeneration Unit Powered by Biogas
Next Article in Special Issue
Quantum Computing and Machine Learning for Cybersecurity: Distributed Denial of Service (DDoS) Attack Detection on Smart Micro-Grid
Previous Article in Journal
Advances in High-Temperature Molten Salt-Based Carbon Nanofluid Research
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Machine Learning and Game-Theoretic Model for Advanced Wind Energy Management Protocol (AWEMP)

1
Thermal and Energy Systems Study Laboratory (LESTE), National Engineering School of Monastir, University of Monastir, Monastir 5000, Tunisia
2
Electrical Engineering and Computer Sciences, University of Sherbrooke, Sherbrooke, QC J1K 2R1, Canada
3
Department of Electrical and Computer Engineering, Universite du Quebec en Outaouais, Gatineau, QC J8X 3X7, Canada
4
Department of Electrical Engineering and Computer Science, University of Toronto, Toronto, ON M5S 3G8, Canada
5
ENSI CAEN, GREYC Laboratory, 14000 Caen, France
*
Author to whom correspondence should be addressed.
Energies 2023, 16(5), 2179; https://doi.org/10.3390/en16052179
Submission received: 7 February 2023 / Revised: 21 February 2023 / Accepted: 22 February 2023 / Published: 24 February 2023

Abstract

:
To meet the target of carbon neutrality by the year 2050 and decrease the dependence on fossil fuels, renewable energy sources (RESs), specifically wind power, and Electric Vehicles (EVs) have to be massively deployed. Nevertheless, the integration of a large amount of wind power, with an intermittent nature, into the grid and the variability of the load on the demand side require an efficient and reliable energy management system (EMS) for operation, scheduling, maintenance and energy trading in the modern power system. This article proposes a new Energy Management Protocol (EMP) based on the combination of Machine Learning (ML) and Game-Theoretic (GT) algorithms to manage the operation of the charging/discharging of EVs from an energy storage system (ESS) via EV supply equipment (EVSE) when the main source of energy is wind power. The ESS can be linked to the grid to overcome downtimes of wind power production. Case study results of wind power forecasting using an ML algorithm and 10 min wind measurements, combined with a GT optimization model, showed good performance in the forecasting and management of power dispatching between EVs to ensure the efficient and accurate operation of the power system.

1. Introduction

The way we use and consume energy is dynamically changing from day to day. This is to be aligned with the global objectives of COP 27, such as the energy transition revolution, GHG emission reduction, climate change commitments and the maximization of communities’ satisfaction regarding the energy service [1]. From energy generation to storage, distribution and delivery, different management techniques based on the capabilities of Information, Communication and Technologies (ICTs) are used to tackle energy efficiency, especially in the context of smart grid infrastructure with a huge penetration of Electric Vehicles (EVs) and multiple renewable energy sources (RESs).
Wind power is one of the RESs that have undergone significant growth in installed capacity over the past two decades. It is becoming increasingly cost-effective, as it has the lowest carbon emission rate [2]. According to the Global Wind Report, nearly 94 GW of wind capacity was installed in 2021. Similar to other RESs, from a commercial point of view, wind power systems are in an early stage. This is because the current wind power system lacks reliability and attraction in the market and needs further development to deal with its dependence on weather conditions [3,4], as well as the stochastic behavior of the load on the demand for power specifically caused by consumer behavior changes and the widespread adoption of EVs as an attractive mobility system [5]. Thus, more uncertainties and constraints will put pressure on the power system [6,7]. Both wind power and EVs require the use of efficient and robust energy management procedures to deal with issues related to power generation, distribution and delivery.
For this reason, the energy management approaches designed for RESs in general, and for wind power specifically, are very challenging not only at the technical level of development and implementation but also in terms of environmental commitments and the energy transition paradigm, especially in the context of Net-Zero business development and COP27 requirements [8,9,10,11,12,13,14]. Therefore, the integration of huge capacities of wind energy into the power system can result in several technical matters, such as the dispatch and regulation of power. To cope with these issues, wind power forecasting can help to perform optimal energy management depending on the predicted power that will be generated for a certain time horizon. However, wind energy forecasting is a difficult task, which raises concerns regarding the management and regulation procedures and integration methods in the electricity market. Furthermore, the uncertainties associated with connected EVs on the demand side and time-varying loads have led to new challenges for Distribution System Operators (DSOs) in reaching an equilibrium between demand and supply for the steady operation of the power system. Consequently, there is an increasing interest in developing an Energy Management Protocol (EMP) based on the more precise modeling and forecasting of wind power production for a variable load demand, where data forecasts and analysis are crucial elements for efficient energy operation and management commitments.
Depending on the method used, several investigations can be found in the literature on the development and use of an energy management system (EMS) [8,9,10,11,12,13,14]. In [8], the authors reviewed different aspects of the EMS with a complete analysis of the different stakeholders and partakers that can be involved in it. They presented a critical examination of the distributed energy resource performance and different plans in the EMS, along with a full analysis of the optimization techniques used to accomplish EMS goals under multiple constraints. They concluded their work by giving recommendations for an optimized EMS that can be used for different applications, such as EVs, industries, buildings and the total community. Another review paper on EMS approaches in microgrids can be found in [9], where the authors provide a classification of the methods used for EMSs on the basis of the technique, configuration and control employed to preserve the balance between energy resources and accessible loads while adding benefits to their usefulness. In [10], an Intelligent Smart Energy Management System (ISEMS) was proposed to administrate the load demand in a smart grid environment with the deep penetration of renewables.
An EMS was also used for smart grid and microgrid energy management in [11,12,13], where different techniques were employed. For instance, the author in [11] introduced smart microgrid (SMG) concept-based prediction techniques and highlighted the role of power generation and revenue forecasting methods to drive SMG deployment with the liberal power market idea, while the authors in [12] proposed a new versatile EMS depending on the frequency, through which distributed generators have controllers with time-varying droop and a gain-adaptive strategy. The random planning of hybrid AC/DC microgrids considering plugin Hybrid Electric Vehicle (HEV) charging loads distributed all over the grid was investigated in [13].
Wind energy management was studied in [14,15]. The authors in [14] investigated the control and management of an unconnected wind energy system against variations in wind speed and demand load. In [15], via a Model Predictive Control (MPC) controller and using an EMS, the authors solved the problem of optimization by taking into account production forecast data and handling several operation rules of a hybrid power plant (HPP) composed of a wind farm connected to the grid and a Li-ion battery storage system on the electrical grid of Guadeloupe Island.
Energy management systems were also used to optimize the powertrain design for fuel-cell batteries for EV applications by implementing a deep deterministic policy gradient [16] and to analyze the effect of control factors and design factors on the dual source of power for the selection of the power battery capacity range considering the synergistic decline in the dual power source’s lifetime in the operating lifecycle of a fuel-cell vehicle [17].
The above literature review shows how important the use of the EMS is in managing the growing energy needs of the modern power system and in coping with the problems introduced by RESs and EVs in the framework of the carbon-free emission target and climate neutrality by the year 2050. Nevertheless, the interactions between different participants, specifically EVs, in the presence of intermittent RESs, such as wind power, taking into account the free and competitive exchange between participants, need to be further investigated. For this reason, more attention should be paid to such situations where the management, trading and exchange of energy are carried out in a liberal and decentralized way between participants.
In this work, we present the development of an Advanced Wind Energy Management Protocol (AWEMP) for power distribution between a wind power source, the main grid, an ESS and an EV charging supply point based on the combination of ML and GT algorithms. The forecasting of wind power is performed using the ML model, namely, support vector regression (SVR); the ML model (SVR) choice will be validated in the next subsection. The GT model is used to increase the accuracy and efficiency of the power management process between participants. Technically, GT is used to solve problems arising from the complex interaction between participants (energy sellers and buyers) by adopting the cooperation and conflict GT schemes.
Our contributions in the present study are summarized as follows:
  • We are the first to consider combining ML and GT algorithms in the development of an AWEMP for power distribution between the wind power source, the main grid, an ESS and an EV charging supply point, where power transfer is two-way between all parts, except for wind power.
  • We formulated and developed the proposed AWEMP. The mathematical model reflects the concept of free and competitive exchange between the different participants in the system.
  • We prove that the AWEMP, which is based on ML and GT models, can successfully operate the EV charging and discharging demand process within the determined constraints and enhance grid stability when considering realistic EV charging/discharging characteristics.
  • The proposed AWEMP is effective and can be scaled for more complicated situations with different RESs and different parts on the demand side, taking into account a decentralized model of energy trading between participants.
The rest of this article is organized as follows. In Section 2, we present several meticulously selected bibliographic works. Section 3 presents the methodology and the approach adopted in this work. In Section 4, we present the formulation of the problem and the system model. The main results and a discussion are presented in Section 5. Finally, in Section 6, we provide conclusions and future works.

2. Related Works

Added to the publications mentioned in Section 1, there are several other interesting works where the energy management of RESs, specifically wind power, is well discussed. The most important encountered issues are related to the accurate assessment of wind energy potential and power forecasts to achieve the stable and reliable operation of the power system and to the way that this energy will be optimally distributed to feed in a random load on the demand side.
For this reason, the related works will be divided into two parts. First, some relevant techniques of forecasting wind power will be reviewed and discussed, and then we will review the optimization algorithm that was used to implement the AWEMP in the present investigation and its applications in energy management and EV-charging strategies.

2.1. Forecasting in Wind Energy Sector

Accurate wind power forecasts are imperatively required to deal with the uncertainties and intermittence of wind power and subsequently to be able to efficiently incorporate wind energy into the power system. Thus, various methods have been developed and used to perform the precise forecasting of wind power and wind speed [18,19,20,21,22,23,24,25].
For example, Markov chain models and multivariate reduction techniques were used in [18] to combine forecasts. The authors showed that the proposed combination approaches based on techniques for dimension reduction deliver good forecasting results in terms of the Mean Square Error. Some studies have developed variants of SVR, among which is [19], where the authors presented a new vector-field-based support vector regression technique to forecast building energy consumption to increase accuracy and reduce the effects of nonlinearity in the data on the results of conventional methods, such as SVR, artificial neural networks (ANNs), gradient boosting regression, etc. In a review paper [20], it is shown that the support vector machine is fast in terms of the calculation time, is simple to use and consistent and provides accurate results. Hybrid methods using different techniques, such as SVR and ANN, and other techniques have shown that SVR with a radial basis function (RBF) model outperforms other techniques [21,22].
In a recent review paper [24], the authors systematically reviewed long-, short- and ultra-short-term wind power forecasting techniques. Each category of prediction technique was further subdivided into four subclasses, and a comparative analysis was presented. The authors also provided a discussion of recent advancement trends, performance analysis and recommendations for the future, while [25] showed that hybrid models are the most frequently used and the most popular forecasting models in the energy literature. They used combined approaches in the wind energy forecasting field and categorized them into four main categories: (1) data-preprocessing-based approaches, (2) parameter-optimization-based approaches, (3) postprocessing-based approaches and (4) component-combination-based approaches. The results indicated that the component-combination-based category was the most diverse and extensive hybrid approach in the literature.
Although hybrid methods have been popular for performing precise wind power forecasting, according to the previous literature review, the SVR model continues to be the most appropriate intelligent model used for the accurate forecasting of wind energy, especially in cases of time series measurements. This strongly validates our choice of the SVR model for the forecasting of wind power in this study because of its versatility and ease of implementation. Furthermore, the SVR model can provide precise forecasting even with a small quantity of measured data, and it showed outstanding calculation performance in [19,20,21,22,23].

2.2. Game-Theoretic Schemes

Game theory (GT) is defined as a subpart of multiobjective models. It is used to deal with conflict-of-interest situations between participants. According to the objective condition accepted by all participants in the beginning, GT is able to make satisfactory decisions. There are two categories of GT, namely, cooperative and non-cooperative ones. The conflict situation is called a non-cooperative game, where participants are unable to make alliances or where arrangements need to be self-enforcing. The cooperation situation is called a cooperative game, where the participants can form externally enforced mandatory commitments. It has been deployed to find the best situation in energy management. Some selected papers are reviewed here [11,26,27,28,29,30,31].
The authors in [26] provided a complete overview of the usage of game theory in the integrated energy system, where they summarized the main game theory models used to solve issues emerging from multiagent trading in the integrated energy system and proposed future perspectives and challenges for the application of game theory in integrated energy systems.
The cooperative model was used in [27,28]. For instance, the authors in [27] proposed a new scheduling strategy based on evolutionary game theory (EGT), taking into account voltage management for a multiagent system (MAS), to determine the EV charging price, the charging/discharging of an energy storage system integrated into a PV energy system (PV-ESS) and demand response (DR) incentive values considering voltage management, consequently achieving the optimal energy operation for the distribution network. The results show that the scheduling strategy proposed in [27] manages the voltage profile and provides the most economical decision among agents.
The non-cooperative category was used in [29,30]. The authors in [29] presented a generalized Stackelberg game (GSG) for managing EV charging behaviors in a smart grid based on the non-cooperative game theory. The results showed that the charging strategies for EVs, as well as the energy price, were obtained, providing a reference for EV charging management. The real-time management of energy in large-scale residential households and EVs not connected to charging stations using a non-cooperative game based on a consensus protocol was investigated in [30]. They proposed a time-of-use pricing tariff with a lower cost for devoted users such that the convergence time remains unchanged. Then, they evaluated the efficiency of the iterative algorithm they proposed using a set of simulations.
It is believed that the use of game theory will improve the performance of the EMS proposed in the present work, not only in terms of energy management but also in terms of profitability and the satisfaction of each participant.

3. Methodology

The approach adopted in the present work is a combination of ML and GT algorithms for the energy management of different parts: (1) the wind power source, (2) ESS, (3) electric vehicle supply equipment (EVSE) and (4) the main grid. Figure 1 shows a graphic representation of the different intervening parts in the system.
Wind power represents the main source of energy. The energy harvested will be first stored in an ESS consisting of Li-ion batteries. The energy stored in the ESS is then used to charge CEVs through charging/discharging supply equipment. The ESS will also be connected to the main grid, so in the case of a lack of wind power, it can be supplied by the grid. At the same time, the ESS can supply energy to the grid when the generated wind energy exceeds the demand from EV supply equipment, and thus it can help reduce the peak load.
Power transfer will be bidirectional between the ESS and the main grid, as well as between the ESS and EV supply equipment, as shown in Figure 1. This situation will allow all parts of the power system to exchange and trade energy with one another, which represents an ideal atmosphere to perform energy management in a context that will reduce dependence on fossil-fuel-based sources of energy, thus decreasing carbon emissions, and achieving the global carbon-free target for the year 2050, since it will minimize the demand from the grid.
The AWEMP will optimally dispatch power between participants according to the availability of the generated/stored energy and the variability of the load on the DS (charging/discharging EVs), allowing the maximum profit and satisfaction of participants.

4. System Model and Problem Formulation

The proposed AWEMP flowchart is presented in Figure 2, which illustrates the workflow of the AWEMP: First, the measured wind data will be processed and introduced into the AWEMP. Second, ML for forecasting will make a prediction of the available wind power based on historical data, which will in turn be fed into the GT optimization model to optimize of the process of EV charging/discharging.
Thus, energy management is performed depending on the generated wind power and the available stored energy in the ESS, which is backed by the grid, to optimize the bidirectional energy exchange (charging/discharging) between EVs.
The proposed AWEMP is a combination of ML and GT algorithms to predict and optimize wind power generation and the charging/discharging process of EVs. The mathematical formulations of these two models are given in the following paragraphs.

4.1. ML Forecasting of the Wind Power Modeling Approach

The SVR model used to perform the forecasting of wind power uses a supervised ML algorithm, support vector machine (SVM), for approximation and regression. The mathematical formulation of the SVR optimization problem can be summarized as follows.
The training dataset of input–output pairs is defined as  { ( x 1 , y 1 ) , , ( x n , y n ) } d × , where  d is the space of the input features,  x i , with dimension d, the target variables are  y i ∈  , and n is the training data size. The ML model can be formulated as shown in Equation (1):
f (x) = wT · θ (x) + b,
where f is the approximation function, w is the weight vector, b is the bias term, θ (x) is a nonlinear mapping function and (·) denotes the dot product in  d .
The optimization problem for SVR can be reduced to finding w by minimizing Equation (2):
m i n { 1 2 w 2 + C i = 1 n ( ξ i + ξ i * ) } ,
with the constraints in Equations (3)–(5):
y i w T · θ b ε + ξ i ,
y i + w T · θ + b ε + ξ i * ,
ξ i , ξ i * 0 ,
where  ξ i and  ξ i * are slack variables, C is the penalization parameter of the error that is applied to control the trade-off between the regularization term and empirical risk, and  ε is equivalent to the function approximation accuracy placed on the training data samples [20].
Figure 3 shows the SVR graphical representation in the case of one-dimensional linear regression, where the parameter  ε approximates the accuracy of the regression and the slack variables  ξ i and  ξ i * refer to outliers, which will be considered errors in the regression.
Lagrange multipliers,  α i and  α i * , are then introduced to solve the SVR minimization problem. Subject to the previous constraints, this leads to the following form:
f ( x ) = i = 1 n ( α i α i * ) K ( x , x i ) + b ,
where K denotes the kernel function, which allows the mapping of input data to a space with a higher dimension. Then, linear regression in the space with a higher dimension corresponds to nonlinear regression in the original space. The kernel function could be a linear function, polynomial (Poly), radial basis function (RBF), exponential radial basis function (ERBF), or customized kernel function.
The validation of the results is achieved using the R-squared error (RSE), which is computed according to the following formula:
R 2 = 1 i = 1 n ( y i _ y i ^ ) 2 i = 1 n ( y i _ y ¯ i ) 2 ,
where  y i ^ = f ( x i ) is a predicted value, and  y ¯ i is the average value of  y i values.
Once the forecasting of wind speed is performed and validated, the wind turbine power output is then computed according to Equation (8) [32]:
P W T ( t ) = { 0 ,     f o r           v ( t ) < v i n v ( t ) 3 v i n 3 v R 3 v i n 3 P R ,   f o r     v i n v ( t ) v R   P R ,   f o r     v R v ( t ) v o u t 0 ,     f o r         v ( t ) > v o u t ,
where  v ( t ) is the wind speed,  v i n is the cut-in wind speed,  v o u t is the cut-off wind speed,  v R is the rated wind speed,  P R is the rated power of the wind turbine and  P W T ( t ) is the actual output power of the wind turbine.
Figure 4 illustrates the relationship between the parameters in Equation (8), and it depicts the dependence of the wind power output on the wind speed. First, the wind turbine starts generating energy at a wind speed equal to  v i n , and then the power output will increase exponentially until it reaches the value of  P R at the wind speed  v R . The power output will remain constant at  P R until the wind speed reaches the value  v o u t , where the power generation of the wind turbine has to be cut off for security reasons since the wind speed has reached high values that could lead to high-speed rotations, which will severely affect the operation of the wind turbine.
Table 1 summarizes the values of these parameters, which will be used to compute the power output of the wind turbine.
Wind power output forecasting is performed by solving Equations (1)–(8) according to Algorithm 1.
Algorithm 1. ML for forecasting
Input: Training dataset
Output: Power output forecasting
1. 
Input data processing: finding anomalies within the input data, correcting them and replacing unusual measured values,
2. 
Data transformation: data scaling using mini-max scaler,
3. 
Training–test split for a certain input ratio,
4. 
SVR modeling: Fitting the SVR model with RBF kernel function to the training set and validating with the test set,
5. 
Feature building: Creating a feature set using data with a lag,
6. 
Forecasting of the wind speed using multistep feature forecasting based on the lagged data and the SVR model,
7. 
Validation of the results of performing the R2-error accuracy test,
8. 
Computation of  P o u t p u t ( t ) from the forecasted wind speed.
The flowchart describing the details of the ML algorithm used for forecasting wind power is presented in Figure 5. The ML model goes through different test criteria before it can be used to forecast wind power. This will provide enough confidence in the results of forecasting.

4.2. Optimization Problem with GT Model

The interaction between all parts of the whole system presented in Figure 1 depends on battery storage management in the ESS and CEV system and their charging/discharging process. For the ESS, the instantaneous state-of-charge variation is linked to the grid, wind power and the charging/discharging procedure of CEVs in the corresponding supply charging. Thus, the ESS model can be presented by Equation (9):
j = 1 M S o C E S S j ( t ) = j = 1 M S o C E S S j ( t 1 ) j = 1 M i = 1 N c h S o C C h j i ( t ) + j = 1 M k = 1 N D c h S o C D c h j k ( t ) + j = 1 M S o C w i n d j ( t ) + j = 1 M S o C g r i d j ( t )
where SoCESS is the ESS state of charge, SoCCh and SoCDch are the states of charge of EVs scheduled for charging and discharging, respectively, t is the time variation, NCh is the number of the CEVs scheduled for the charging process, NDch is the number of the CEVs scheduled for the discharging process and M is the number of EVSE items in a region such as Ottawa.
For each CEV, the SoC variation is provided by Equations (10) and (11):
S o C C h j ( t ) = S o C C h j ( t 1 ) + Δ t × r a t e D c h ,
S o C D c h j ( t ) = S o C D c h j ( t 1 ) Δ t × r a t e D c h ,
where  S o C m i n j S o C C h , D c h j S o C m a x j .
As the quality of service in the EVSE system is based on the satisfaction of the CEVs, the objective function of the whole system can be written as
M a x   ( j = 1 M i = 1 N c h S o C C h j i ,   j = 1 M k = 1 N D c h S o C D c h j k ) ,
subject to
M i n   ( j = 1 M C T · P g ) ,
where CT is the total cost of the wind power system, and  P g is the power needed from the grid.
The charging/discharging problem is considered in the objective function given by Equation (12). The optimal solution maximizes CEV satisfaction, whatever the service needed (charging or discharging), while minimizing the cost of the wind power system and the support of the grid. This model is based on a competitive approach, such as Nash equilibrium with the Stackelberg game scheme [31].
The validation of the results is performed by computing the Root Square Mean Error (RSME) according to the following Formula (14):
R M S E = 1 M i = 1 M ( y i y i ^ ) 2 ,
We propose the Algorithm 2 to resolve Equations (9)–(14).
Algorithm 2. GT optimization
Input:NCh, NDch, M, CEV profiles, charging/discharging rate; wind power, ESS capacity
Output: CEV satisfaction
1. 
CEV declares the electricity quantity that it needs or is ready to sell, as well as the timing range and its expected electricity price,
2. 
According to the electricity price variation, the EMP schedules each CEV (for the charging or discharging process) and updates all data received, /* */
3. 
Resolve Equations (9)–(14),
4. 
Update the number of CEVs satisfied.

5. Results

Wind measurements were gathered in the framework of a wind power assessment project. A mast was installed in a site located in Utique in the governorate of Bizerte in the north of Tunisia, which is an uninhabited mountainous agricultural region with an altitude of about 343 m. The mast acquires 10 min measurements of the wind speed, temperature, pressure, humidity and wind direction at different heights for the assessment and control of wind power.
The measurements taken over one year were preprocessed and then used to train the ML algorithm, namely, the SVR model. The SVR model hyperparameters and the training–test proportions were optimized through the cross-validation method according to the flow chart in Figure 4. The RBF was selected as a kernel for the SVR model, as it has shown an exceptional ability to model the nonlinear behavior of wind measurements [20,21,22].
The SVR model showed an excellent capability of wind speed forecasting for days ahead. The forecasted wind speed was then used to calculate the wind turbine power output, whose characteristics are summarized in Table 1.
Figure 6 shows the measured velocity (in blue) with the forecasted wind speed (in red). The ML algorithm demonstrated good performance in terms of wind speed forecasting, especially for days ahead. The calculation of the RSE, based on measured and forecasted wind speed, gives us a result of about 0.94, which indicates that the prediction fits the measurements well.
Similar results can be found in [21,22], where, in both papers, the authors found accurate results using SVR based on RSEs of about 0.9999 for a 10-min horizon and 0.9883 for a time of 3 h, respectively. In our case, the calculation of RSE gave a value of 0.94, which is a little lower than the results in [21,22] since our time horizon was extended to up to 7 days ahead, while in their studies, the time horizon was limited to a few hours.
Once the wind speed is well forecasted, the wind power can be computed from the wind speed using Equation (8). The results of the computed wind power from measured and forecasted wind speeds are presented in Figure 7. The forecast appears impeccable, as it has captured the shape of the power output profile very well.
The RSE computed from the measured power output and forecasted output gives a value of about 0.88. Although this value is lower than the one found in the case of wind speed forecasting (0.94), it remains high enough to be confident in the results of the forecasted wind power outputs.
The decrease in the value of the RSE computed from the wind power output compared to the one computed from the wind speed is due to the fact that wind power is related to the wind speed to the power of 3 (Equation (8)); consequently, a small error in the wind speed could lead to larger one when computing the power output of the wind turbine.
The objective of the forecast should be very carefully established from the beginning. It can be considered a technical as well as a strategic question. The deviation between the measured values and forecasted ones should be treated carefully, as it can lead to more discrepancies in tasks such as energy trading or decision making by DSOs.
Consequently, properly estimating the accuracy of the forecasts defined in Figure 5 can significantly increase the value of energy. That said, energy trading can be well conducted in certain markets when appropriate trading strategies are used (such as peer-to-peer energy trading between participants based on a blockchain and smart contacts [31]) while at the same time helping DSOs to balance the power system.
Considering the system presented in Figure 1 and having the power output from wind, we conducted 1000 runs of simulations, and then the Monte Carlo technique was used to extract the average values for each setting. The simulations were performed using MATLAB. To prove the performance of our proposed scheme, we simulated the satisfaction level of CEVs regarding the charging and discharging service. We define the satisfaction level as the number of CEVs completing the charging or the discharging process divided by the total number of CEVs in each EVSE. Table 2 shows our simulation parameters.
The GT model is considered to make the best decision possible given how energy participants interact using the EMP, especially where goods (electricity) are divided between competing goals.
Figure 8 compares the CEV satisfaction level with (represented by the blue color) and without our GT optimization algorithm (shown by the red color). It is obvious that our GT optimization algorithm improves the average CEV satisfaction.
From Table 3, we can conclude that these results demonstrate that our GT optimization algorithm increases CEV satisfaction by more than 44%.
Several papers have reported using GT models to improve the charging/discharging process of EVs in different situations [34,35,36]. It was shown that using GT approaches can improve the planning of en-route charging station locations and maximize subsidies toward the purchase of charging units by up to 14.3% in [34], while in [35], the proposed GT-based strategy outperformed the benchmark strategies in terms of overall profits.
The authors in [35] proposed a decentralized GT (D-GT) model aiming to optimize the EVs’ interaction with the D-EVSE considering both EVs’ satisfaction as well as the D-EVSE’s stability. Their results showed that the proposed model can manage and control the interaction between EVs and D-EVSE efficiently and effectively.
A comparison of the present work results and those in the literature [34,35,36] shows that ours are in agreement with previous publications, as GT has improved, in terms of the satisfaction, profitability and reliability of the EV charging/discharging process. In fact, the use of the GT model helped improve the management of the charging/discharging process of EVs, showing an increase in the rate of EV satisfaction of up to 44% (Table 3).

6. Conclusions and Discussion

In this paper, a new AWEMP is presented and tested for RES management. Additionally, the role of forecasting models of power based on ML and GT is highlighted to deal with the natural variability of wind power generation to maintain energy system availability, sustainability and effectiveness.
The use of the GT optimization model improved the rate of satisfaction of CEVs in terms of the charging/discharging process. The combination of the ML algorithm and the GT model shows its performance in making the AWEMP more efficient and reliable. Simulations were conducted for forecasting and the optimization process to highlight how participants interact with the AWEMP, particularly where goods (electricity) are divided between competing goals.
The ML model showed a good capability of wind speed and wind power forecasting, as it effectively captured the profile of the power generated. Nevertheless, forecasting models for wind energy systems need much more attention to make the energy transition align with the best use of public and private RESs, deliver improvements to citizens’ quality of life and reduce energy costs [11]. A small deviation between the measured values and forecasted ones could lead to more discrepancies in tasks such as energy trading or decision making by DSOs.
To perform perfect energy management, it is necessary to have information not only on the consumption profile on the demand side but also on the power generated for different time horizons (ultra-short, short, medium and long terms), particularly for intermittent and random sources of energy such as wind power, where variation in weather conditions could significantly alter power production.
The ML algorithm used in the present study is an effective and accurate model only in short- and medium-term forecast time horizons [20]. For this reason, more investigations in the wind power forecasting domain are needed to achieve multiobjective forecasting, i.e., for different time horizons, and to cope with the uncertainties and intermittence in the generated power, as well as with fluctuations and randomness on the demand side. Future works are planned in which hybrid AI algorithms will be used for the multiobjective forecasting of wind power, as the use of hybrid AI algorithms has shown better performance in wind power forecasting compared to a single AI algorithm [25].
The present AWEMP has shown great performance in managing interactions between participants when the energy transfer is bidirectional. This prompts a call to proceed to the next steps of investigation to perform decentralized energy trading based on the concept of the present AWEMP in future work.

Author Contributions

Methodology, I.K. and D.S.; Software, I.K. and D.S.; Validation, I.K., D.S., A.O., I.M. and L.K.; Formal analysis, I.K. and D.S.; Investigation, I.K., D.S., A.O., I.M. and L.K.; Resources, I.K. and D.S.; Writing—original draft, I.K. and D.S.; Writing—review & editing, I.K., D.S., A.O., I.M. and L.K.; Project administration, D.S. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Data Availability Statement

Data is unavailable due to privacy.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Said, D. A Survey on Information Communication Technologies in Modern Demand Side Management for Smart Grids: Challenges, Solutions, and Opportunities. IEEE Eng. Manag. Rev. 2022. Early Access. [Google Scholar] [CrossRef]
  2. Costoya, X.; deCastro, M.; Carvalho, D.; Feng, Z.; Gómez-Gesteira, M. Climate change impacts on the future offshore wind energy resource in China. Renew. Energy 2021, 175, 731–747. [Google Scholar] [CrossRef]
  3. Shair, J.; Li, H.; Hu, J.; Xie, X. Power system stability issues, classifications and research prospects in the context of high-penetration of renewables and power electronics. Renew. Sustain. Energy Rev. 2021, 145, 111111. [Google Scholar] [CrossRef]
  4. Zakaria, A.; Ismail, F.B.; Lipu, M.S.H.; Hannan, M.A. Uncertainty models for stochastic optimization in renewable energy applications. Renew. Energy 2020, 145, 1543–1571. [Google Scholar] [CrossRef]
  5. Said, D.; Cherkaoui, S.; Khoukhi, L. Queuing model for EVs charging at public supply stations. In Proceedings of the 9th International Wireless Communications and Mobile Computing Conference (IWCMC), Sardinia, Italy, 1–5 July 2013; pp. 65–70. [Google Scholar]
  6. Yan, L.; Chen, X.; Chen, Y.; Wen, J. A Cooperative Charging Control Strategy for Electric Vehicles Based on Multiagent Deep Reinforcement Learning. IEEE Trans. Ind. Inform. 2022, 18, 8765–8775. [Google Scholar] [CrossRef]
  7. Liu, P.; Liu, Z.; Zhang, N.; Lin, F. Cooperative Game-based Charging-Discharging Efficiency Optimization of Electric Vehicles in 6G-enabled V2G. IEEE Trans. Green Commun. Netw. 2022. Early Access. [Google Scholar] [CrossRef]
  8. Rathor, S.K.; Saxena, D. Energy management system for smart grid: An overview and key issues. Int. J. Energy Res. 2020, 44, 4067–4109. [Google Scholar] [CrossRef]
  9. Battula, A.R.; Sandeep, V.; Surender, R.S. Review of Energy Management System Approaches in Microgrids. Energies 2021, 14, 5459. [Google Scholar] [CrossRef]
  10. Prakash, P.; Mudige, T.K.; Panduranga, V.K. An IoT based Intelligent Smart Energy Management System with Accurate Forecasting and Load Strategy for Renewable Generation. Measurement 2020, 152, 107187. [Google Scholar]
  11. Said, D. Intelligent Photovoltaic Power Forecasting Methods for a Sustainable Electricity Market of Smart Micro-Grid. IEEE Commun. Mag. 2021, 59, 122–128. [Google Scholar] [CrossRef]
  12. Navid, R.; Mohammadreza, M.; Mehrdad, G.; Maryam, M. A new stochastic gain adaptive energy management system for smart microgrids considering frequency responsive loads. Energy Rep. 2020, 6, 914–932. [Google Scholar]
  13. Wang, P.; Wang, D.; Zhu, C.; Yang, Y.; Abdullah, H.M.; Mohamed, M.A. Stochastic management of hybrid AC/DC microgrids considering electric vehicles charging demands. Energy Rep. 2020, 6, 1338–1352. [Google Scholar] [CrossRef]
  14. Albalawi, H.; Zaid, S.A.; Buswig, Y.M.; El-Rab, H.W.; Lakhouit, A.; Arshad, M.A. Wind energy management of a standalone system operating at maximum power point. Int. J. Power Electron. Drive Syst. (IJPEDS) 2022, 13, 1884–1895. [Google Scholar] [CrossRef]
  15. López-Rodríguez, R.H.; González, A.A.; Vechiu, I.; Bacha, S. Day-Ahead MPC Energy Management System for an Island Wind/Storage Hybrid Power Plant. Energies 2021, 14, 1066. [Google Scholar] [CrossRef]
  16. Zhou, J.; Feng, C.; Su, Q.; Jiang, S.; Fan, Z.; Ruan, J.; Sun, S.; Hu, L. The Multi-Objective Optimization of Powertrain Design and Energy Management Strategy for Fuel Cell–Battery Electric Vehicle. Sustainability 2022, 14, 6320. [Google Scholar] [CrossRef]
  17. Lu, D.; Hu, D.; Yi, F.; Li, J.; Yang, Q. Optimal selection range of FCV power battery capacity considering the synergistic decay of dual power source lifespan. Int. J. Hydrogen Energy 2023, 48. in press. [Google Scholar] [CrossRef]
  18. Poncela-Blanco, M.; Poncela, P. Improving Wind Power Forecasts: Combination through Multivariate Dimension Reduction Techniques. Energies 2021, 14, 1446. [Google Scholar] [CrossRef]
  19. Zhonga, H.; Wang, J.; Jiac, H.; Muc, Y.; Lv, S. Vector field-based support vector regression for building energy consumption prediction. Appl. Energy 2019, 242, 403–414. [Google Scholar] [CrossRef]
  20. Zendehboudi, A.; Baseer, M.A.; Saidur, R. Application of support vector machine models for forecasting solar and wind energy resources: A review. J. Clean. Prod. 2018, 199, 272–285. [Google Scholar] [CrossRef]
  21. Khosravi, K.; Koury, R.N.N.; Machado, L.; Pabon, J.J.G. Prediction of wind speed and wind direction using artificial neural network, support vector regression and adaptive neuro-fuzzy inference system. Sustain. Energy Technol. Assess. 2018, 25, 146–160. [Google Scholar] [CrossRef]
  22. Zafirakisa, D.; Tzanesa, G.; Kaldellis, J.K. Forecasting of Wind Power Generation with the Use of Artificial Neural Networks and Support Vector Regression Models. Energy Procedia 2019, 159, 509–514. [Google Scholar] [CrossRef]
  23. Hossain Lipu, M.S.; Sazal Miah, M.D.; Hannan, M.A.; Hussain, A.; Sarker, M.R.; Ayob, A.; Saad, M.H.M.; Sultan, M.M.D. Artificial Intelligence Based Hybrid Forecasting Approaches for Wind Power Generation: Progress, Challenges and Prospects. IEEE Access 2021, 9, 102460–102489. [Google Scholar] [CrossRef]
  24. Sawant, M.; Patil, R.; Shikhare, T.; Nagle, S.; Chavan, S.; Negi, S.; Bokde, N.D. A Selective Review on Recent Advancements in Long, Short and Ultra-Short-Term Wind Power Prediction. Energies 2022, 15, 8107. [Google Scholar] [CrossRef]
  25. Ahmadi, M.; Khashei, M. Current status of hybrid structures in wind forecasting. Eng. Appl. Artif. Intell. 2021, 99, 104133. [Google Scholar] [CrossRef]
  26. He, J.; Li, Y.; Li, H.; Tong, H.; Yuan, Z.; Yang, X.; Huang, W. Application of Game Theory in Integrated Energy System Systems: A Review. IEEE Access 2020, 8, 93380–93397. [Google Scholar] [CrossRef]
  27. Lee, J.W.; Kim, M.K. An Evolutionary Game Theory-Based Optimal Scheduling Strategy for Multiagent Distribution Network Operation Considering Voltage Management. IEEE Access 2022, 10, 50227–50241. [Google Scholar] [CrossRef]
  28. Hupez, M.; Toubeau, J.F.; De Grève, Z.; Vallée, F. A New Cooperative Framework for a Fair and Cost-Optimal Allocation of Resources Within a Low Voltage Electricity Community. IEEE Trans. Smart Grid 2021, 12, 2201–2211. [Google Scholar] [CrossRef]
  29. Chen, Y.; Wang, X.; Qian, T.; Wu, X. Game Theoretic Energy Management for Electric Vehicles in Smart Grid. In Proceedings of the 6th Asia Conference on Power and Electrical Engineering (ACPEE), Chongqing, China, 8–11 April 2021. [Google Scholar]
  30. Ghazvini, H.R.B.; Ghavami, M.; Haeri, M. Distributed Energy Management of Large-Scale Microgrids Using Predictive Control. In Proceedings of the 30th International Conference on Electrical Engineering (ICEE), Seoul, Republic of Korea, 17–19 May 2022. [Google Scholar]
  31. Said, D. A Decentralized Electricity Trading Framework (DETF) for Connected EVs: A Blockchain and Machine Learning for Profit Margin Optimization. IEEE Trans. Ind. Inform. 2021, 17, 6594–6602. [Google Scholar] [CrossRef]
  32. Sohoni, V.; Gupta, S.C.; Nema, R.K. A Critical Review on Wind Turbine Power Curve Modelling Techniques and Their Applications in Wind Based Energy Systems. J. Energy 2016, 2016, 8519785. [Google Scholar] [CrossRef] [Green Version]
  33. Said, D.; Mouftah, H.T. A Novel Electric Vehicles Charging/Discharging Management Protocol Based on Queuing Model. IEEE Trans. Intell. Veh. 2020, 5, 100–111. [Google Scholar] [CrossRef]
  34. Zavvos, E.; Gerding, E.H.; Brede, M. A Comprehensive Game-Theoretic Model for Electric Vehicle Charging Station Competition. IEEE Trans. Intell. Transp. Syst. 2022, 23, 12239–12250. [Google Scholar] [CrossRef]
  35. Yan, H.; Sun, C.; Liao, H.; Tang, X. Battery Charging Strategies Design for Battery Swapping Stations: A Game Theoretic Approach. In Proceedings of the IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids (SmartGridComm), Singapore, 25–28 October 2022. [Google Scholar]
  36. Alghamdi, T.G.; Said, D.; Mouftah, H.T. Decentralized Game-Theoretic Approach for D-EVSE based on Renewable Energy in Smart Cities. In Proceedings of the IEEE International Conference on Communications (ICC), Dublin, Ireland, 7–11 June 2020. [Google Scholar]
Figure 1. Schematic of the Energy Management Protocol and the participants.
Figure 1. Schematic of the Energy Management Protocol and the participants.
Energies 16 02179 g001
Figure 2. Flowchart of the AWEMP.
Figure 2. Flowchart of the AWEMP.
Energies 16 02179 g002
Figure 3. Graphic representation of SVR (one-dimensional linear regression).
Figure 3. Graphic representation of SVR (one-dimensional linear regression).
Energies 16 02179 g003
Figure 4. Characteristic of wind turbine power output.
Figure 4. Characteristic of wind turbine power output.
Energies 16 02179 g004
Figure 5. Flowchart of the ML forecasting model.
Figure 5. Flowchart of the ML forecasting model.
Energies 16 02179 g005
Figure 6. Time traces showing measurement (blue), and forecast of wind speed (red).
Figure 6. Time traces showing measurement (blue), and forecast of wind speed (red).
Energies 16 02179 g006
Figure 7. Time traces showing wind turbine power output (blue) and forecasting of wind power (red).
Figure 7. Time traces showing wind turbine power output (blue) and forecasting of wind power (red).
Energies 16 02179 g007
Figure 8. Average CEV satisfaction.
Figure 8. Average CEV satisfaction.
Energies 16 02179 g008
Table 1. Wind turbine parameters.
Table 1. Wind turbine parameters.
Parameter Value
  v i n 4.0 m/s
  v o u t 25.0 m/s
  v R 9.8 m/s
  P R 3.37 MW
Table 2. Simulation parameters.
Table 2. Simulation parameters.
ParameterValue
Electricity price
(based on requested electricity level)
15 c/kWh [10]
Minimum electricity selling price
(game theory)
8 c/kWh (ToU)
Maximum electricity
Selling price (game theory)
18 c/kWh [10]
Number of CEV buyers10, 30, 60
Number CEV sellers10, 30, 60
Dch, DDisch60 kW DC [10]
Max charging time20 min
SoCUniform distribution between 20 and 100%
EV battery capacity24 kWh [33]
SoCBDT20%
Table 3. Satisfaction rate.
Table 3. Satisfaction rate.
GT OptimizationWithout GT OptimizationIncreasing Rate
Average CEV satisfaction955344.2%
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Khabbouchi, I.; Said, D.; Oukaira, A.; Mellal, I.; Khoukhi, L. Machine Learning and Game-Theoretic Model for Advanced Wind Energy Management Protocol (AWEMP). Energies 2023, 16, 2179. https://doi.org/10.3390/en16052179

AMA Style

Khabbouchi I, Said D, Oukaira A, Mellal I, Khoukhi L. Machine Learning and Game-Theoretic Model for Advanced Wind Energy Management Protocol (AWEMP). Energies. 2023; 16(5):2179. https://doi.org/10.3390/en16052179

Chicago/Turabian Style

Khabbouchi, Imed, Dhaou Said, Aziz Oukaira, Idir Mellal, and Lyes Khoukhi. 2023. "Machine Learning and Game-Theoretic Model for Advanced Wind Energy Management Protocol (AWEMP)" Energies 16, no. 5: 2179. https://doi.org/10.3390/en16052179

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop