Next Article in Journal
Enhanced Second-Order RC Equivalent Circuit Model with Hybrid Offline–Online Parameter Identification for Accurate SoC Estimation in Electric Vehicles under Varying Temperature Conditions
Next Article in Special Issue
Comprehensive Overview of the Effective Thermal Conductivity for Hydride Materials: Experimental and Modeling Approaches
Previous Article in Journal
The Impacts on Regional Development and “Resource Curse” by Energy Substitution Policy: Verification from China
Previous Article in Special Issue
A Multi-Agent Approach for the Optimized Operation of Modular Electrolysis Plants
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Combination of Site-Wide and Real-Time Optimization for the Control of Systems of Electrolyzers

1
Institute of Automation Technology, Helmut-Schmidt-University, 22043 Hamburg, Germany
2
Chair of Automation, Ruhr University, 44801 Bochum, Germany
*
Author to whom correspondence should be addressed.
Energies 2024, 17(17), 4396; https://doi.org/10.3390/en17174396
Submission received: 22 July 2024 / Revised: 28 August 2024 / Accepted: 29 August 2024 / Published: 2 September 2024
(This article belongs to the Special Issue Research on Integration and Storage Technology of Hydrogen Energy)

Abstract

:
The integration of renewable energy sources into an energy grid introduces volatility, challenging grid stability and reliability. To address these challenges, this work proposes a two-stage optimization approach for the operation of electrolyzers used in green hydrogen production. This method combines site-wide and real-time optimization to manage a fluctuating energy supply effectively. By leveraging the dual use of an existing optimization model, it is applied for both site-wide and real-time optimization, enhancing the consistency and efficiency of the control strategy. Site-wide optimization generates long-term operational plans based on long-term forecasts, while real-time optimization adjusts these plans in response to immediate fluctuations in energy availability. This approach is validated through a case study showing that real-time optimization can accommodate renewable energy forecast deviations of up to 15%, resulting in hydrogen production 6.5% higher than initially planned during periods of increased energy availability. This framework not only optimizes electrolyzer operations but can also be applied to other flexible energy resources, supporting sustainable and economically viable energy management.

1. Introduction

The rapid expansion of renewable energy (renewable energy (RE)) sources significantly increases volatility and unpredictability in the energy supply chain [1], necessitating advanced control strategies to ensure grid stability and reliability [2]. This emphasizes the crucial role of energy flexibility [3], which is the ability of a resource to modulate its power generation or consumption [4].
Green hydrogen, which can be produced through electrolysis, offers a viable solution for storing volatile RE [5]. Hydrogen serves as a high-density energy carrier for production facilities and provides solutions for energy transportation and storage [6]. Recent advancements in hydrogen storage materials, such as the development of advanced metal alloys [7] and silica-confined nanostructures [8], have shown promise in enhancing the efficiency and capacity of hydrogen storage systems. In parallel, ongoing research is also focused on improving the efficiency of hydrogen production [9,10,11,12]. However, leveraging the full potential of green hydrogen production presents challenges due to the inherent fluctuations of renewable energy sources [13]. These fluctuations introduce uncertainties in the availability and predictability of an RE supply, complicating the integration and consistent utilization of green hydrogen [13].
To fully capitalize on the benefits of green hydrogen and integrate it effectively into an energy system, advanced optimization strategies are crucial [14]. The unpredictable nature of RE sources necessitates robust control mechanisms to handle these uncertainties [15]. However, existing optimization approaches for control often disregard these uncertainties [16,17] and instead focus on economic optimization where coarse resolutions are sufficient [18]. Yet, this static optimization is inherently vulnerable to uncertainties [19], underscoring the need for finer resolutions to address both renewable integration and uncertainty management [20]. Achieving such fine resolutions computationally, however, presents significant challenges regarding the timely generation of schedules [18].
Therefore, a multi-layered optimization approach known for its scalability and adaptability, illustrated in Figure 1, can be employed. Each layer within this hierarchical structure manages specific decision variables and monitors distinct parameters and variables from other layers. This hierarchical organization facilitates complexity abstraction and enables the provision of services to higher layers. For operational optimization purposes, these layers can be leveraged to achieve various optimization objectives [21].
A key feature of the hierarchical optimization structure is the distinct temporal resolution of each layer, enabling effective responses to both dynamic changes and long-term trends. The scheduling layer, which operates with the longest temporal resolution (from weeks to days) [21], generates a schedule. Meanwhile, the site-wide optimization (site-wide optimization (SWO)) layer, which encompasses a system of flexible energy resources (e.g., multiple electrolyzers), defines a plan. Long-term factors, such as market prices, can be integrated by these layers. A plan is typically generated for a timespan from hours to days.
The real-time optimization (real-time optimization (RTO)) layer operates at an intermediate resolution, typically ranging from hours to minutes, (Please note that the timescale of RTO differs from the shorter timescales seen in other real-time contexts, such as in the communication of controllers.) aligning operational execution with strategic directives [21]. It defines a structured set of setpoints (set of setpoints (SoS)), whereby the current setpoint is transferred to the resource via the control layer. The RTO layer replans resource operation within one SWO time step, taking into account new data such as short-term forecasts. Additionally, RTO, based on the concept of rolling planning or a receding horizon, offers a promising approach to mitigating uncertainties. While traditional strategic optimization methods may disregard this technique, RTO enhances adaptability and resilience under uncertainty, making it a powerful tool for economic optimization and improved operational planning [22].
Forecasts, such as those for RE generation, are incorporated into these optimization processes. The uncertainty and therefore the accuracy of these forecasts correlates with the forecast horizon [23]. Consequently, the schedule has the most uncertainty, which decreases down to the RTO layer.
The bottom control layers have the shortest temporal resolution, responding to immediate changes within minutes or seconds [21]. In these layers, the overall system is separated into resources, as each resource has its own controller. This layered approach to temporal resolution allows each layer to efficiently address specific tasks while ensuring a coordinated strategy which blends long-term planning with short-term reactions to changed contexts [21].
The prevailing focus on static optimization [20] often results in the isolated consideration of the depicted layers. Consequently, many publications disregard the interactions between RTO and SWO (gray layers in Figure 1). Despite its potential for significant economic and energy-systemic benefits, the adoption of RTO in real-world applications has fallen short of expectations, leaving its potential largely untapped [19,22]. One possible reason for this is the high costs associated with the development and implementation of RTO solutions [24].
To exploit the untapped potential and ensure more efficient and economical resource operation, this work investigates the transformation of an existing static optimization model (e.g., SWO) into a dynamic RTO model. As a result, a two-step optimization approach emerges which utilizes the same optimization model for both long-term and short-term optimization, thus addressing the isolated consideration of the individual layers (see Figure 1). The adaptation of the automation pyramid by Skogestad [21] (as shown in Figure 1) is applied in this work. Consequently, this approach is capable of responding to uncertainties and short-term deviations, tackling the issue that different optimization models across layers may lead to inconsistencies [22]. The objectives on the SWO and RTO layers are somehow similar, as both layers focus on maximizing benefit, such as by minimizing cost [22]. Therefore, the main difference between the two layers is their temporal resolution [22]. Recently, Reinpold et al. [17] demonstrated that static optimization models can accurately represent the real behavior of a resource, making the models suitable for dual usage in both long-term planning and short-term optimization.
This work is based on previous work by the authors, which includes a reusable modular optimization model structure [25] and a methodology for its parameterization [26].
In summary, the contributions of this work are the following:
  • A method for adapting existing static optimization models for their dual use in SWO and RTO is developed;
  • An algorithm is formed for continually solving the two-stage optimization problem incorporating updated forecast information;
  • An evaluation and validation of the proposed method and algorithms through a case study are given;
  • An assessment of the dynamic RTO model’s effects on power system performance and efficiency, highlighting improvements over static optimization in terms of cost, stability, flexibility, and energy usage, is given.
This work is structured as follows. Section 2 provides an analysis of related works and describes the research gap. Section 3 describes the method for continually solving the two-stage optimization problem, including the approach for adapting existing static optimization models. Section 4 evaluates the method via a case study. The method and its evaluation are discussed in Section 5. Section 6 concludes this work.

2. Related Work

This section reviews related works in optimizing flexible energy resources, focusing on their control and with emphasis on handling uncertainties.
Sun and Leto [27] introduced a model for bidding in energy markets for the integration of renewable energy sources and the operation of flexible energy resources. This approach aims to maximize profits and mitigate risks associated with the uncertainties of renewable energy production. A work by Sun and Leto [27] primarily addressed the upper layers of the control hierarchy shown in Figure 1scheduling and SWO—by proposing a joint bidding strategy for various distributed energy resources based on a predictive model which considers the uncertainties of renewable energy production. However, the model does not address RTO, which is crucial for immediate response to short-term fluctuations.
Pazouki et al. [28] described an optimization model for the operation of a system with energy generation from wind as well as the operation of flexible energy resources under uncertainty. Pazouki et al. [28] focused on the economic, emission, reliability, and efficiency aspects of system operation in both certain and uncertain environments of wind, electricity demand, and real-time pricing markets. The authors utilized a stochastic optimization approach, incorporating Monte Carlo simulations to generate scenario trees based on predicted real-time pricing, wind, and electricity demand. This method allows for the modeling of uncertainties and the identification of optimal operational strategies. Although the generated scenarios address uncertainties, the responsiveness in terms of RTO is lacking. This optimization is performed on a sub-hourly resolution and cannot be considered RTO but rather SWO.
Vedullapalli et al. [15] proposed a model and an algorithm for the operational planning of battery and heating, ventilation, and air conditioning resources in buildings using RTO to minimize the costs of electric energy. Vedullapalli et al. [15] also presented a two-part forecasting model for short-term variations. This method only focuses on short-term management for the control of resources without higher planning functions like SWO. This approach underscores the necessity of real-time control but lacks the integration with long-term strategic planning to market system flexibility.
Tsay et al. [29] proposed a framework for the energy-flexible operation of industrial air separation units using RTO. Their work highlights the need to account for process dynamics in production optimization due to the variable nature of electricity prices and addresses this with a dynamic optimization framework specifically designed for air separation units. Despite the mention of real-time electricity prices in their study, they were considered at an hourly resolution. Consequently, there was no reaction to short-term deviations, as the optimization primarily focused on the strategic, longer-term SWO of air separation units.
Flamm et al. [14] presented a specialized optimization model for an electrolyzer. Through experimental analysis of an electrolyzer, detailed linearized models were created to capture the electrolyzer’s conversion efficiency and thermal dynamics [14]. This model informs an RTO controller which aims to minimize hydrogen production costs by adapting to fluctuating electricity prices and photovoltaic inflow. However, a study by Flamm et al. [14] used deterministic forecasts, which raises questions about the appropriateness of the method in dealing with forecast uncertainties. Furthermore, Flamm et al. [14] described their approach as “model predictive control”, while Skogestad [21] highlighted the limitations of single-layer optimization in dealing with uncertainty, as uncertainty must be quantified a priori.
Alabi et al. [30] introduced an optimization approach for a multi-energy system. Initially, the approach focuses on data management via clustering and scenario reduction to mitigate uncertainties. Subsequently, it employs multi-objective optimization to balance investment and operating costs. Integration of the Markowitz portfolio risk theory allows for managing operational uncertainties. As the approach primarily emphasizes long-term planning and cost optimization, it lacks consideration for real-time resource control to effectively respond to fluctuations, a crucial aspect addressed by RTO. Moreover, the hourly resolution used for renewable energy sources has been proven inadequate in capturing their fluctuations, thus rendering a system not capable of reacting to short-term variations.
Similar to Alabi et al. [30], Alirezazadeh et al. [31] presented a method for the optimization of flexible generation within a smart grid. The method employs linear and nonlinear optimization models for solving unit commitment and smart grid scheduling problems, respectively. However, the method of Alirezazadeh et al. [31] does not consider RTO, which would be required for adaptability to short-term variations, and is limited to static SWO.
Yang et al. [32] focused on operational optimization for alkaline water electrolysis systems using a mixed-integer nonlinear programming approach. This optimization considers factors such as solar energy availability, electricity prices, and the resources’ operational characteristics for scheduling the electrolysis system. While the optimization effectively plans the operation of the electrolyzers based on the availability of solar energy and electricity prices to increase profitability, it is limited to long-term planning in terms of static SWO. This disregards the aspect of considering short-term fluctuations. As a result, this method cannot fully capture the dynamic nature of renewable energy sources, missing opportunities for further optimization and efficiency improvements in a real-time operational context.
Ireshika and Kepplinger [33] investigated the management of electric vehicle charging under uncertainty using a two-stage optimization approach, thereby focusing on uncertainties such as non-elastic demand and electric vehicle usage behavior.
Dumas et al. [34] introduced a hierarchical optimization approach for microgrids, focusing on the coordination between operational planning and RTO. At the operational planning level, decisions are made based on day-ahead forecasts to optimize energy costs over one or several days. The RTO level adjusts operations based on actual conditions and forecast errors within the current market period.
Whereas Ireshika and Kepplinger [33] and Dumas et al. [34] each emphasized the benefits of a two-stage optimization approach to managing flexible energy resources under uncertainty, instead of reusing existing approaches, both works specialized in applying dedicated optimization models for specific problems within their domains, using different models for the different levels of optimization. However, this can lead to conflicts between the planning and RTO layers, potentially resulting in inconsistencies [22].
Analysis of related works revealed a gap in the integration of SWO and RTO into a unified framework, indicating a need for generalized methods to advance the field. This work contributes to this research area by proposing a novel two-stage optimization framework which seamlessly combines SWO and RTO, thereby addressing the limitations observed in previous studies. Unlike existing approaches, which often focus exclusively on either long-term planning or real-time control, the presented approach provides a cohesive solution which ensures consistent and efficient operation across both time scales. Existing approaches focus on either SWO or RTO, with strategies to address short-term deviations rarely discussed [20]. This underlines the need to strive beyond the use of specific models for individual use cases and develop methods which provide a comprehensive and reusable solution for the dynamic adaptation of optimization strategies. By providing a comprehensive and adaptable method, this research advances the field by bridging the gap between long-term strategic planning and real-time adaptability, which is elemental for managing the inherent uncertainties of RE sources.

3. Method for Solving Two-Stage Optimization

This section introduces a method for continually solving SWO and RTO models for the subsequent control of systems of flexible energy resources. The concept for a two-stage optimization approach using existing optimization models is outlined in Section 3.1. Necessary adjustments for transforming an existing optimization model into a model compatible with both SWO and RTO are explained in Section 3.2. The approach for continually solving the two-stage optimization problem is elaborated upon in Section 3.3.

3.1. Concept for Two-Stage Optimization

The concept, illustrated in Figure 2, utilizes SWO to devise a plan for the entire optimization horizon T (e.g., a full day), segmented into intervals Δ τ . Individual time steps are denoted by τ . To accomplish this, long-term forecast data are incorporated, ensuring that the plan reflects anticipated future conditions or demands. The results from this planning phase set starting points for RTO, such as defining starting conditions like the resource system states for each time step t τ . This approach is executed cyclically, with new, updated forecasts being taken into account for each optimization.
Following this initial phase, RTO refines the optimization at a higher resolution Δ t , such as on a per-minute basis, denoted by time steps t τ , k over an optimization horizon T. The length of the RTO horizon | T | is equivalent to one time step of SWO Δ τ . This finer granularity allows for the accommodation of immediate fluctuations and guarantees that operations can quickly adjust to evolving scenarios. Any changes detected during the RTO phase, such as the failure of resources, are then fed back into the SWO, ensuring that the behavior of the real system is reflected in the subsequent planning periods t τ of the SWO. This cyclical process creates a dynamic and responsive optimization framework which seamlessly integrates long-term strategic planning with immediate operational adjustments, significantly improving both efficiency and adaptability.

3.2. Dual Use of Optimization Models

To facilitate the transformation of static optimization models into dynamic RTO models, some preliminary steps must be performed. The basic prerequisite, however, is that a static, feasible optimization model of a system of flexible energy resources is available. The static optimization model requires modification to enable differentiation between its application in SWO and RTO. Specifically for RTO use, it is necessary to fix the historical values of variables, including the states of resources or initial setpoints for the RTO time steps. This is achieved by equating the respective decision variable to the respective value. These values are derived from the outcomes of the SWO or results of previous RTO time steps. Furthermore, the energy amount procured for any time step τ must be set as a target for the corresponding RTO horizon starting at t τ , 0 . This is ensured by means of the constraint shown in Equation (1), wherein the energy in one SWO time step τ must be equal to the sum of the energy sourced from the grid in all corresponding RTO time steps t:
t τ , k T P el , grid , t τ , k · Δ t = P el , grid , τ · Δ τ τ
This mechanism is particularly critical within the context of ancillary services, where the costs associated with these services are allocated to the entities responsible for any deviations from the planned energy use. Ensuring that the energy procurement targets are met precisely across each interval helps minimize financial penalties and operational disruptions, maintaining the stability and efficiency of the energy system.
Furthermore, the objective function could be modified to ensure the full integration of RE, such as maximizing the output of the system.

3.3. Solving the Two-Stage Optimization Model

The process for solving the two-stage optimization model is depicted in Figure 3. First, the initial parameter settings are defined, such as the system state at the start of SWO (Step 1).
Subsequently, long-term forecast information, such as electricity data from spot markets or RE generation, is imported (Step 2) and utilized to solve the static optimization model for the time steps τ 0 , τ | T | (Step 3). The results obtained from this operational planning for the time step τ are stored (Step 4) and subsequently adopted as initial values for the RTO model ( τ j = t τ j , 0 , Step 5).
To enable appropriate responses, short-term forecasts with a high resolution, such as those from RE sources, are incorporated (Step 6). Subsequently, the RTO model is solved based on the specified RTO horizon T, allowing for suitable adjustments to short-term fluctuations (Step 7). Subsequently, the system verifies whether the end of the RTO horizon t k = t | T | has been reached. If it has not, then the optimized setpoints are conveyed to the process (Step 8), and relevant measurement values are received (Step 9). These measured values can then be considered during RTO (Step 10). The current setpoints then act as the new starting values for the next RTO iteration (Step 10).
Upon reaching the end of the RTO horizon with t k = t | T | , the system checks if the end of the planning interval T has been reached as well. If it has, then the process terminates. However, this process is typically executed in a continual manner, meaning that in most cases, the end is never reached. Instead, new starting values for the subsequent planning time step τ are obtained from the static optimization, and the RTO process recommences (Step 5). Both stages are always solved for the entire length of the respective optimization horizon T /T, incorporating newly available information, such as forecasts for future time steps, and historic values. Hence, each model is solved x times, with x corresponding to T Δ τ or T Δ t for SWO and RTO, respectively.
Applying the method outlined in this section generates plans for the control of a system of electrolyzers. Upon the availability of new data, such as forecasts, an updated SoS or plan for the remaining time steps of the respective optimization horizon is generated.

4. Evaluation of the Method

This case study assesses the effectiveness of the proposed method by applying it to a system of electrolyzers, which draw power from both the grid and a wind farm. For this purpose, this section describes the set-up of the validation (Section 4.1) as well as the results (Section 4.2 and Section 4.3).

4.1. Set-Up of the Evaluation

The optimization model used to validate the method was built using the validated optimization model structure developed by Wagner et al. [25] (see Box 1). A set of constraints for representing flexibility of the features was developed in [25]. These included constraints for operational boundaries (minimum and maximum values for flows), input/output relationships, and system states and related constraints [25]. The objective of the function was to minimize the cost of electrical energy purchased from the European intra-day market (Equation (2)). As concluded by Wagner et al. [20], this is a common objective in the field of optimization of flexible energy resources:
min Cos t = t T P grid , t · Δ t · c el , t
Box 1. Electrolyzer model used for the case study. Based on model structure developed by Wagner et al. [25]
min Total cost of energy procured from European intra-day market (Equation (2))
subject to
  • Power balance to include grid and renewable power and connect electrolyzers
  • Operational boundaries of the system (Equation (A1))
  • Operational boundaries of each resource (Equation (A1))
  • Input/output relationships (Equations (A2)–(A5))
  • Target for energy input (Equation (A6))
  • System states (Equations (A7)–(A9))
  • Follower states (Equation (A10))
  • Holding durations (Equations (A11) and (A12))
  • Ramp limits (Equations (A13) and (A14))
The parameters for each electrolyzer were determined by employing the methodology for parameterizing optimization models developed by Wagner and Fay [26]. This creates a data model for parameterization of the optimization model based on operational data [26]. The mathematical modeling and parameter set are described in Appendix A in detail.
Box 2 shows how the existing, feasible Box 1 is extended for use in RTO, as described in Section 3.2. Feasibility is ensured through (1) a validated model structure [25] and (2) a systematic derivation of suitable parameters [26].
Box 2. Model used for RTO
max hydrogen output subject to
  • Constraints of Box 1
  • Target to avoid penalty costs (Equation (1))
  • Fixed values for past periods (see Figure 3)
For forecasts of future RE generation, this work utilizes data from a real wind farm published by Anvari et al. [23], available at a resolution of 1 Hz. From this dataset, both | T | long-term (see Figure 4a) and | T | corresponding short-term forecasts for each time step τ T (see Figure 4b) were generated.
These forecasts were generated in an iterative manner at each time step, retaining data points for past time steps. To address the issue of prediction uncertainties, greater uncertainty for time steps further in the future was introduced. This can be clearly seen in the deviations of values at time step τ 1 of the forecasts generated at τ 0 and τ 1 in Figure 4a (gray circle). The reason for this difference lies in the inherent uncertainty associated with forecasting. As the forecast generated at time step τ 0 (blue) was based on data available up to τ 0 , it could not fully account for variations which became apparent by the time τ 1 was reached. Consequently, this led to an overestimation of the renewable generation at τ 1 , requiring a correction in the forecast generated at τ 1 (red). A similar interpretation could be applied to the short-term forecasts shown in Figure 4b.
The method was implemented in Java using a mixed-integer linear programming (MILP) model based on IBM ILOG CPLEX (implementation details can be found at https://github.com/lukas-wagner/TwoStageOpt; accessed on 27 August 2024) to solve the two-stage optimization model. The MILP optimization approach was selected due to its widespread use in related works [20]. Additionally, a comparison of mixed-integer linear and nonlinear optimization models showed that mixed-integer linear models are preferred for optimizing systems of energy resources because of their relatively short computational times [35] while still ensuring globally optimal solutions [36].

4.2. Results of the Evaluation

The method outlined in Section 3 was applied by utilizing the optimization models in Box 1 and Box 2, with all models solved as depicted in Figure 3. Prices sourced from the European intra-day market were employed [37], as illustrated in Figure 5.
The calculations were performed on Windows 10 with an Intel Core i7-11700 processor and 16 GB of RAM with an optimality gap of 10−3. The method for the two-stage optimization approach was applied for | T | = 10 SWO time steps and | T | = 10 time steps of RTO each. The calculation time for each time step τ , including its corresponding RTO time steps t, was approximately 10 s in total, using temporal resolutions of 0.25 h for SWO and 0.025 h for RTO.
Moreover, the optimized SoS generated by RTO was transmitted to a simulation model of electrolyzers as described in [38] by utilizing OPC-UA (Steps 9 and 10 in Figure 3). For this purpose, the method devised by Reinpold et al. [17] was employed. This process was carried out successfully, and the recorded values are analyzed below.

4.2.1. Results of Site-Wide Optimization

Figure 6 shows the plan generated by SWO, taking into account the forecasts shown in Figure 4a. For clarity, only the first time step τ 0 and the final, realized SoS generated at τ 9 , taking into account all past decisions, are shown.
Figure 6a illustrates that the plan generated at τ 0 aligned with the realized plan ( τ 9 ) up to and including time step τ 4 . This initial plan was generated while assuming perfect foresight, and it benefited from the greatest flexibility potential.
Starting from τ 5 , a significant share of time steps was already executed, thereby constraining the ability to respond to updated forecast data during the remaining time steps of SWO due to the constraints imposed. Consequently, this resulted in deviations between the optimized plan at τ 0 and the realized plan from this juncture onward as the flexibility potential decreased. This limitation was reflected in a decrease of 0.5% in hydrogen produced between the initial stage at τ 0 and the final step τ 9 . The main driver was the uncertainty of the forecasts, with 1.5% less realized RE than was initially forecasted. This also resulted in a lower overall efficiency of 62.3%, compared with the initial plan of 62.6% at τ 0 . The comparison of efficiencies at τ 0 and τ 9 is depicted in Figure 6b, illustrating the impact of the aforementioned uncertainties on the overall efficiency of the electrolyzer system.

4.2.2. Results of Real-Time Optimization

Figure 7 shows the results of RTO for one exemplary time step τ 4 . In Figure 7a, the prediction for the RE output under SWO for time step τ 4 , as well as the deviating forecast at t τ 4 , 9 , are depicted. Notably, the output of RE sources consistently surpassed the long-term prediction of SWO. Consequently, this led to an increase in hydrogen production. The realized SoS at t τ 4 , 9 yielded 0.66 kWh of hydrogen energy instead of the planned amount of 0.62 kWh at τ 4 , capitalizing on the increased availability of RE (+6.5% hydrogen energy; see Figure 7b).
Furthermore, as shown in Figure 7b, a significant drop in power could be observed at t 7 . This was attributed to an increase in the forecast for RE from t 8 to t 9 compared with previous forecasts (see t τ 4 , 7 ). Consequently, hydrogen production was shifted to later time steps t 8 and t 9 , resulting in a decrease in power input at t 7 .

4.3. Validation of the Method for Two-Stage Optimization

Figure 8 shows the realized hydrogen output in each time step for SWO as well as the sum of all hydrogen outputs in the last RTO time step of each SWO time step t τ j , 9 . Here, it can be seen that robust results were already achieved through SWO, with an average deviation of +2% between the optimized plan and the realized SoS across all time steps τ , encompassing a range from −3.5% to +15%. Although SWO generally yielded favorable results, deviations exceeding +15% in periods of high RE uncertainty underscore the importance of RTO.
However, these inherent uncertainties in RE, which resist further quantification and are dependent on the quality of the forecast, can be effectively addressed by RTO, providing a valuable tool for appropriate responses.
The approach outlined in Section 3 for implementing a two-stage optimization strategy is especially advantageous for hybrid energy resources which integrate both RE sources and the electricity grid. Initially, SWO determines the required energy procurement from the energy market with manageable computational effort and a long-term planning horizon. The second optimization stage, RTO, then utilizes the predetermined energy procurement from the energy market and the existing resource states established by SWO to respond to short-term fluctuations or deviations within optimized, defined framework conditions.
Utilizing one optimization model would not have accounted for continually updated forecasts, as as this would have necessitated continuous solving of the model for the entire horizon equal to τ at the availability of new forecasts. The computational times of one model at a high temporal resolution (e.g., 1.5 min) would have been too large to be useful (timely availability of the plan) [18]. Such an approach is also unsuitable considering the high level of uncertainty in forecasts for the distant future, rendering a resolution of 1.5 min. unjustified, which emphasizes the application of the two-stage optimization approach presented.
In summary, the findings demonstrate the efficacy of the method presented in Section 3 and affirm that the two-stage optimization approach can be successfully applied based on an existing static optimization model. This approach optimizes the procurement of energy from a spot market in parallel while facilitating the simultaneous integration of variable RE sources. This is especially important given the increasing expansion of RE and the imperative of decarbonization.
Moreover, it has become evident that existing optimization models of SWO can be adapted for this two-stage optimization approach without requiring significant adjustments (see Section 3.2). This facilitates the transition from pure planning to real-time operation, accommodating short-term fluctuations.

5. Discussion

The method as well as the results of the evaluation are discussed in this section.
The presented research demonstrated the potential of transforming static optimization models into dynamic RTO models for managing flexible energy resources such as electrolyzers. Specifically, this work employed a two-stage optimization strategy which integrates both site-wide and real-time optimization techniques to improve operational flexibility. The method involves a hierarchical approach where long-term forecasts are used for SWO, and short-term adjustments are made through RTO. This allows the system to dynamically adapt to fluctuations in RE generation and accurately reflect the actual behavior of the resource as well as the actual availability of RE. The results from a case study of an electrolyzer system validate the effectiveness of this approach.
One of the main advantages of the proposed method is its ability to ensure a stable power grid by matching energy consumption with RE generation. This dynamic capability is crucial for handling the variability and unpredictability associated with RE sources, making the method highly adaptable to real-world conditions. The method demonstrates the practical benefits of integrating real-time adjustments into long-term planning, thus improving the overall operational flexibility.
The implications of this study are relevant to the future of energy management and the integration of RE sources. The two-stage optimization method developed in this work provides a robust framework for RTO of flexible energy resources, such as electrolyzers. By combining SWO and RTO, this method enhances the alignment of energy consumption with RE generation, which is fundamental for the effective utilization and significant expansion of RE sources. This alignment is important for sustainable energy practices, as it allows for more efficient use of RE resources and minimizes waste and mismatching. This method makes it possible to not assume perfect foresight during the determination of an SoS for subsequent control and rather continually use reliable values in RTO in a short time gap to realization. This, however, leads to some drawbacks, including potential deviations from the plan initially generated by SWO.
Such deviations are not initially problematic and are expected given the forecast uncertainties. In fact, one of the drawbacks is that if RTO did not account for these deviations and instead strictly adhered to the SWO plan generated under the assumption of perfect foresight, unplanned adjustments would eventually become necessary. This is because either not all available RE would be integrated or the grid supply would have to be adjusted in an unplanned and ad hoc manner. Therefore, the ability of RTO to adapt to real-time data ensures more efficient and reliable integration of RE, preventing the need for reactive measures and supporting overall grid stability.
Despite the promising outcomes, this work recognizes some limitations. One notable limitation is the dependency on the accuracy of RE generation forecasts. While the optimization models perform well with accurate forecasts, deviations from predicted values can influence the optimality of the SoS. Additionally, the initial set-up and computational requirements, although manageable, might present some challenges for large-scale implementation. The necessity for high-resolution data and computational resources could potentially impact the scalability of this approach. Future work should focus on the transfer of the method to decentralized optimization approaches employing multi-agent systems, as they are inherently suited for the representation of resources under uncertainty and the handling thereof. Additionally, research should aim to enhance forecast accuracy, streamline computational processes, and explore decentralized optimization approaches to further improve the method’s practicality and scalability.
Even though the case study showed the applicability of the method to a system of electrolyzers, SWO and RTO of other types of flexible energy resources are also possible, as the underlying optimization model structure is generically applicable [17,25].

6. Conclusions

In this work, a novel two-stage optimization method was developed which bridges the gap between SWO and RTO, allowing for dynamic adjustments in response to the unpredictable nature of RE sources. By leveraging existing static optimization models and transforming them for use in RTO, a seamless integration of RE into a system of electrolyzers was achieved, enhancing both grid reliability and operational efficiency. This method stands out for its adaptability, ensuring optimal resource utilization in near real time and reducing the energy procurement costs from the intra-day market.
The case study on a system of electrolyzers, utilizing a hybrid energy supply from both the grid and a wind farm, validated the effectiveness of the method. The results demonstrated not only more sustainable operation through the optimized use of renewable resources but also highlighted the potential for economic benefits, as updated forecasts can be included in the operational planning.
However, the proposed method has certain dependencies. The effectiveness of the method relies on the accuracy of RE generation forecasts. While the method was designed to handle forecast deviations, significant inaccuracies could impact the optimal schedule, potentially affecting the full realization of the benefits. Additionally, the approach involves a certain level of computational complexity and requires high-resolution data, which could pose challenges for extremely large-scale implementations.
In conclusion, the developed two-stage optimization strategy offers a robust and flexible framework for energy management, paving the way for more sustainable and economically viable energy control of flexible energy resources in the face of growing RE integration.

Author Contributions

Conceptualization, data curation, investigation, methodology, validation, visualization, writing—original draft, and writing—review and editing, V.H. and L.P.W.; supervision and writing—review and editing, F.G.; funding acquisition, supervision, and writing—review and editing, A.F. All authors have read and agreed to the published version of the manuscript.

Funding

This research in the project eModule (support code: 03HY116) was funded by the German Federal Ministry of Education and Research and the Projektträger Jülich GmbH, based on a resolution of the German Bundestag. This research was also funded by the Digitalization and Technology Research Center of the Bundeswehr (dtec.bw) from the project OptiFlex, and dtec.bw is funded by the European Union’s NextGenerationEU.

Data Availability Statement

The implementation is available at: https://github.com/lukas-wagner/TwoStageOpt, accessed on 27 August 2024.

Conflicts of Interest

The authors declare no conflicts of interest.

Abbreviations

The following abbreviations are used in this work:
MILPmixed-integer linear programming
RErenewable energy
RTOreal-time optimization
SoSset of setpoints
SWOsite-wide optimization

Appendix A. Optimization Model

This appendix describes the mathematical modeling of Box 1. For a detailed explanation, please refer to Wagner et al. [25]. Additionally, the parameter set is presented.
The operational boundaries are modeled as shown in Equation (A1) [25]:
P min , t P t P max , t t
MILP optimization requires linearizing potentially nonlinear relationships. Utilizing piecewise linear approximation allows for retaining nonlinear aspects [39] but also benefiting from the advantage of MILP optimization (see Section 4.1). The piecewise linear approximation of the input/output relationship is realized by means of the binary variables x k for each segment k K and time step τ / t (Equations (A2)–(A4)). Only one segment can be active per time step (Equation (A5)). The total energy output D over the optimization horizon is set by Equation (A6) [25]:
P output , t = k K a k · P input k , t + b k · x k , t t
lb k · x k , t P input k , t t , k
P input k , t ub k · x k , t t , k
k K x k , t = 1 t
Δ t · t T P t = D
As concluded by Baumhof et al. [39], the representation of the system states within an optimization model increases its alignment with reality. System states  s S are characterized by the lower and upper flow limits (Equations (A8) and (A9)). State transitions are constrained by mandatory sequences, meaning certain states can only follow specific preceding states. This is enforced by Equation (A10), which ensures that transitions happen correctly from one state to another. The model also includes constraints on the minimum and maximum holding durations for each state, ensuring that a state remains active for a defined minimum or maximum number of time steps. These constraints are expressed in Equations (A11) and (A12), respectively. Finally, ramp limits are imposed on the rate of change of the power flows, which are controlled by the resource characteristics. These ramp limits are defined differently for each operating state using Equations (A13) and (A14), ensuring that the flow changes gradually according to the resource’s capabilities [25]:
s S x s , t = 1 t
P t s S P min , s · x s , t t > t 0
P t s S P max , s · x s , t t > t 0
x t 1 , s x t , s f S F , s x f , t s , t > t 0
t h , min , s · x t , s x t 1 , s τ T h x τ , s s , t > t 0
t h , max , s τ T h x τ , s s , t > t 0
Δ t · s S ramp min , s · x s , t P t P t 1 t > t 0
Δ t · s S ramp max , s · x s , t P t P t 1 t > t 0
The parameter set used for the case study was derived from measurement data [26]. Table A1 shows the parameters for the input/output relationship, whereas Table A2 shows the parameters for the system states and related constraints. These parameters were used for all electrolyzers.
Table A1. Parameters of the input/output relationship.
Table A1. Parameters of the input/output relationship.
Segment k1234
lb (kW)00.61.21.8
ub (kW)0.61.21.82.4
a k (kW/kW)0.520.830.560.56
b k (kW)−0.06−0.140.160.15
Table A2. System-state related parameters.
Table A2. System-state related parameters.
State s012
Nameoffstand-byoperation
t h , min , s 424
t h , max , s
S F , s {2}{0,2}{0,1}
P in . , min , s (kW)00.190.19
P in , max , s (kW)00.192.4
P out , max , s (kW)001.5
ramp min , s (kW/h)000
ramp max , s (kW/h)25,00034563456

References

  1. IRENA. European Comission. Renewable Energy Prospects for the European Union: Preview for Policy Makers. 2018. Available online: https://www.irena.org/publications/2018/Feb/Renewable-energy-prospects-for-the-EU (accessed on 18 July 2024).
  2. Smith, O.; Cattell, O.; Farcot, E.; O’Dea, R.D.; Hopcraft, K.I. The effect of renewable energy incorporation on power grid stability and resilience. Sci. Adv. 2022, 8, eabj6734. [Google Scholar] [CrossRef] [PubMed]
  3. European Comission. A Clean Planet for All: A European Strategic Long-Term Vision for a Prosperous, Modern, Competitive and Climate Neutral Economy. Available online: https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=CELEX%3A52018DC0773 (accessed on 18 July 2024).
  4. Ulbig, A.; Andersson, G. On operational flexibility in power systems. In Proceedings of the 2012 IEEE Power and Energy Society General Meeting, San Diego, CA, USA, 22–26 July 2012; pp. 1–8. [Google Scholar] [CrossRef]
  5. Lange, H.; Klose, A.; Lippmann, W.; Urbas, L. Technical evaluation of the flexibility of water electrolysis systems to increase energy flexibility: A review. Int. J. Hydrogen Energy 2023. [Google Scholar] [CrossRef]
  6. Vidas, L.; Castro, R. Recent Developments on Hydrogen Production Technologies: State-of-the-Art Review with a Focus on Green-Electrolysis. Appl. Sci. 2021, 11, 11363. [Google Scholar] [CrossRef]
  7. Liu, J.; Yong, H.; Zhao, Y.; Wang, S.; Chen, Y.; Liu, B.; Hu, J.; Zhang, Y. Phase evolution, hydrogen storage thermodynamics, and kinetics of ternary Mg98Ho1.5Fe0.5 alloy. J. Rare Earths 2024, 42, 1800–1808. [Google Scholar] [CrossRef]
  8. Wan, C.; Li, R.; Wang, J.; Cheng, D.G.; Chen, F.; Xu, L.; Gao, M.; Kang, Y.; Eguchi, M.; Yamauchi, Y. Silica Confinement for Stable and Magnetic Co-Cu Alloy Nanoparticles in Nitrogen-Doped Carbon for Enhanced Hydrogen Evolution. Angew. Chem. (Int. Ed. Engl.) 2024, 63, e202404505. [Google Scholar] [CrossRef]
  9. Zhao, P.; Wang, J.; Xia, H.; He, W. A novel industrial magnetically enhanced hydrogen production electrolyzer and effect of magnetic field configuration. Appl. Energy 2024, 367, 123402. [Google Scholar] [CrossRef]
  10. Chen, M.; Kitiphatpiboon, N.; Feng, C.; Abudula, A.; Ma, Y.; Guan, G. Recent progress in transition-metal-oxide-based electrocatalysts for the oxygen evolution reaction in natural seawater splitting: A critical review. eScience 2023, 3, 100111. [Google Scholar] [CrossRef]
  11. Wang, X.Q.; Ma, X.Y.; Wu, W.Z.; He, H.B.; Wang, N.N.; Zheng, R.J.; Ma, S.J.; Zhu, Y.Q.; Shen, P.K.; Zhu, J.L. MnS–MnO heterogeneous nanocube@N, S-doped carbon as a highly efficient bifunctional water splitting electrocatalyst. Rare Met. 2024, 43, 1977–1988. [Google Scholar] [CrossRef]
  12. Liu, L.; He, Y.; Li, Q.; Cao, C.; Huang, M.; Ma, D.D.; Wu, X.T.; Zhu, Q.L. Self-supported bimetallic array superstructures for high-performance coupling electrosynthesis of formate and adipate. Exploration 2024, 4, 20230043. [Google Scholar] [CrossRef]
  13. Odenweller, A.; Ueckerdt, F.; Nemet, G.F.; Jensterle, M.; Luderer, G. Probabilistic feasibility space of scaling up green hydrogen supply. Nat. Energy 2022, 7, 854–865. [Google Scholar] [CrossRef]
  14. Flamm, B.; Peter, C.; Büchi, F.N.; Lygeros, J. Electrolyzer modeling and real-time control for optimized production of hydrogen gas. Appl. Energy 2021, 281, 116031. [Google Scholar] [CrossRef]
  15. Vedullapalli, D.T.; Hadidi, R.; Schroeder, B. Optimal Demand Response in a building by Battery and HVAC scheduling using Model Predictive Control. In Proceedings of the 2019 IEEE/IAS 55th I&CPS, Calgary, AB, Canada, 5–8 May 2019. [Google Scholar] [CrossRef]
  16. Lindner, M.; Grosch, B.; Elserafi, G.; Dietrich, B.; Weigold, M. Holistic Approach for an Energy-Flexible Operation of a Machine Tool with Cooling Supply. Energies 2023, 16, 3943. [Google Scholar] [CrossRef]
  17. Reinpold, L.M.; Wagner, L.P.; Reiche, L.T.; Fay, A. Experimental Setup for the Evaluation of Optimization Strategies for Flexible Energy Resources. In Proceedings of the 2nd IEEE Industrial Electronics Society Annual Online Conference (ONCON), Virtual, 8–10 December 2023. [Google Scholar] [CrossRef]
  18. Wagner, L.P.; Kilthau, M.; Reinpold, L.M.; Fay, A. Required Level of Detail of Optimization Models for the Control of Flexible Energy Resources. In Proceedings of the 2023 IEEE International Conference on Communications Control, and Computing Technologies for Smart Grids, Glasgow, UK, 31 October–3 November 2023. [Google Scholar] [CrossRef]
  19. Engell, S.; Harjunkoski, I. Optimal operation: Scheduling, advanced control and their integration. Comput. Chem. Eng. 2012, 47, 121–133. [Google Scholar] [CrossRef]
  20. Wagner, L.P.; Reinpold, L.M.; Kilthau, M.; Fay, A. A Systematic Review of Modeling Approaches for Flexible Energy Resources. Renew. Sustain. Energy Rev. 2023, 184, 113541. [Google Scholar] [CrossRef]
  21. Skogestad, S. Advanced control using decomposition and simple elements. Annu. Rev. Control 2023, 56, 100903. [Google Scholar] [CrossRef]
  22. Krishnamoorthy, D.; Skogestad, S. Real-Time optimization as a feedback control problem—A review. Comput. Chem. Eng. 2022, 161, 107723. [Google Scholar] [CrossRef]
  23. Anvari, M.; Lohmann, G.; Wächter, M.; Milan, P.; Lorenz, E.; Heinemann, D.; Tabar, M.R.R.; Peinke, J. Short term fluctuations of wind and solar power systems. N. J. Phys. 2016. [Google Scholar] [CrossRef]
  24. Bauer, M.; Craig, I.K. Economic assessment of advanced process control—A survey and framework. J. Process Control 2008, 18, 2–18. [Google Scholar] [CrossRef]
  25. Wagner, L.P.; Reinpold, L.M.; Fay, A. Design Patterns for Optimization Models of Flexible Energy Resources. In Proceedings of the 2nd IEEE Industrial Electronics Society Annual Online Conference (ONCON), Online, 8–10 December 2023. [Google Scholar] [CrossRef]
  26. Wagner, L.P.; Fay, A. Methodology for Deriving Parameters for Optimization Models of Systems of Flexible Energy Resources. IEEE Open J. Ind. Electron. Soc. 2024, 5, 737–757. [Google Scholar] [CrossRef]
  27. Sun, C.; Leto, S. A novel joint bidding technique for fuel cell wind turbine photovoltaic storage unit and demand response considering prediction models analysis Effect’s. Int. J. Hydrogen Energy 2020, 45, 6823–6837. [Google Scholar] [CrossRef]
  28. Pazouki, S.; Haghifam, M.R.; Moser, A. Uncertainty modeling in optimal operation of energy hub in presence of wind, storage and demand response. Int. J. Electr. Power Energy Syst. 2014, 61, 335–345. [Google Scholar] [CrossRef]
  29. Tsay, C.; Kumar, A.; Flores-Cerrillo, J.; Baldea, M. Optimal demand response scheduling of an industrial air separation unit using data-driven dynamic models. Comput. Chem. Eng. 2019, 126, 22–34. [Google Scholar] [CrossRef]
  30. Alabi, T.M.; Lu, L.; Yang, Z. A novel multi-objective stochastic risk co-optimization model of a zero-carbon multi-energy system (ZCMES) incorporating energy storage aging model and integrated demand response. Energy 2021, 226, 120258. [Google Scholar] [CrossRef]
  31. Alirezazadeh, A.; Rashidinejad, M.; Abdollahi, A.; Afzali, P.; Bakhshai, A. A new flexible model for generation scheduling in a smart grid. Energy 2020, 191, 116438. [Google Scholar] [CrossRef]
  32. Yang, Y.; de La Torre, B.; Stewart, K.; Lair, L.; Phan, N.L.; Das, R.; Gonzalez, D.; Lo, R.C. The scheduling of alkaline water electrolysis for hydrogen production using hybrid energy sources. Energy Convers. Manag. 2022, 257, 115408. [Google Scholar] [CrossRef]
  33. Ireshika, M.A.S.T.; Kepplinger, P. Uncertainties in model predictive control for decentralized autonomous demand side management of electric vehicles. J. Energy Storage 2024, 83, 110194. [Google Scholar] [CrossRef]
  34. Dumas, J.; Dakir, S.; Liu, C.; Cornélusse, B. Coordination of operational planning and real-time optimization in microgrids. Electr. Power Syst. Res. 2021, 190, 106634. [Google Scholar] [CrossRef]
  35. Ommen, T.; Markussen, W.B.; Elmegaard, B. Comparison of linear, mixed integer and non-linear programming methods in energy system dispatch modelling. Energy 2014, 74, 109–118. [Google Scholar] [CrossRef]
  36. Richards, A.; How, J. Mixed-integer programming for control. In Proceedings of the 2005 IEEE American Control Conference, Portland, OR, USA, 8–10 June 2005; pp. 2676–2683. [Google Scholar] [CrossRef]
  37. EPEX SPOT SE. Continuous Intra-Day Prices for Germany. 2024. Available online: https://www.epexspot.com (accessed on 18 July 2024).
  38. Mock, M.; Viedt, I.; Lange, H.; Urbas, L. Heterogenous electrolysis plants as enabler of efficient and flexible Power-to-X value chains. In Computer Aided Chemical Engineering; Manenti, F., Reklaitis, G.V., Eds.; Elsevier: Amsterdam, The Netherlands, 2024; Volume 53, pp. 1885–1890. [Google Scholar] [CrossRef]
  39. Baumhof, M.T.; Raheli, E.; Johnsen, A.G.; Kazempour, J. Optimization of Hybrid Power Plants: When is a Detailed Electrolyzer Model Necessary? In Proceedings of the 2023 IEEE PowerTech, Belgrade, Serbia, 25–29 June 2023; pp. 1–10. [Google Scholar] [CrossRef]
Figure 1. Control hierarchy (adopted from [21]).
Figure 1. Control hierarchy (adopted from [21]).
Energies 17 04396 g001
Figure 2. Schematic representation of the concept.
Figure 2. Schematic representation of the concept.
Energies 17 04396 g002
Figure 3. Flowchart for the use of an existing optimization model in RTO.
Figure 3. Flowchart for the use of an existing optimization model in RTO.
Energies 17 04396 g003
Figure 4. Forecasts and their uncertainty (data by Anvari et al. [23]).
Figure 4. Forecasts and their uncertainty (data by Anvari et al. [23]).
Energies 17 04396 g004
Figure 5. Electricity price [37].
Figure 5. Electricity price [37].
Energies 17 04396 g005
Figure 6. Results of SWO.
Figure 6. Results of SWO.
Energies 17 04396 g006
Figure 7. RTO schedules at τ 4 .
Figure 7. RTO schedules at τ 4 .
Energies 17 04396 g007
Figure 8. Optimization results for entire horizon.
Figure 8. Optimization results for entire horizon.
Energies 17 04396 g008
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Henkel, V.; Wagner, L.P.; Gehlhoff, F.; Fay, A. Combination of Site-Wide and Real-Time Optimization for the Control of Systems of Electrolyzers. Energies 2024, 17, 4396. https://doi.org/10.3390/en17174396

AMA Style

Henkel V, Wagner LP, Gehlhoff F, Fay A. Combination of Site-Wide and Real-Time Optimization for the Control of Systems of Electrolyzers. Energies. 2024; 17(17):4396. https://doi.org/10.3390/en17174396

Chicago/Turabian Style

Henkel, Vincent, Lukas Peter Wagner, Felix Gehlhoff, and Alexander Fay. 2024. "Combination of Site-Wide and Real-Time Optimization for the Control of Systems of Electrolyzers" Energies 17, no. 17: 4396. https://doi.org/10.3390/en17174396

APA Style

Henkel, V., Wagner, L. P., Gehlhoff, F., & Fay, A. (2024). Combination of Site-Wide and Real-Time Optimization for the Control of Systems of Electrolyzers. Energies, 17(17), 4396. https://doi.org/10.3390/en17174396

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop