Next Article in Journal
Fractional-Order Sliding-Mode Observers for the Estimation of State-of-Charge and State-of-Health of Lithium Batteries
Next Article in Special Issue
An Overview of the Design and Optimized Operation of Vanadium Redox Flow Batteries for Durations in the Range of 4–24 Hours
Previous Article in Journal
Evaluation of Glyoxal-Based Electrolytes for Lithium-Sulfur Batteries
Previous Article in Special Issue
High Performance H2−Mn Regenerative Fuel Cells through an Improved Positive Electrode Morphology
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

Hybrid Energy Storage Systems Based on Redox-Flow Batteries: Recent Developments, Challenges, and Future Perspectives

by
Christina Schubert
1,*,
Wiem Fekih Hassen
2,*,
Barbara Poisl
1,*,
Stephanie Seitz
1,
Jonathan Schubert
1,
Estanis Oyarbide Usabiaga
3,4,
Pilar Molina Gaudo
3,4 and
Karl-Heinz Pettinger
1
1
Technology Centre Energy, University of Applied Sciences Landshut, Wiesenweg 1, 94099 Ruhstorf an der Rott, Germany
2
Chair of Distributed Information Systems, University of Passau, Innstraße 41, 94032 Passau, Germany
3
Grupo Gregorio Quejido, Epic Power Converters S.L., Calle F Oeste, Nave 93 Polígono Industrial Malpica, 50016 Zaragoza, Spain
4
Aragon Institute of Engineering Research, University of Zaragoza, C/Mariano Esquillor s/n, 50018 Zaragoza, Spain
*
Authors to whom correspondence should be addressed.
Batteries 2023, 9(4), 211; https://doi.org/10.3390/batteries9040211
Submission received: 31 January 2023 / Revised: 13 March 2023 / Accepted: 22 March 2023 / Published: 31 March 2023

Abstract

:
Recently, the appeal of Hybrid Energy Storage Systems (HESSs) has been growing in multiple application fields, such as charging stations, grid services, and microgrids. HESSs consist of an integration of two or more single Energy Storage Systems (ESSs) to combine the benefits of each ESS and improve the overall system performance, e.g., efficiency and lifespan. Most recent studies on HESS mainly focus on power management and coupling between the different ESSs without a particular interest in a specific type of ESS. Over the last decades, Redox-Flow Batteries (RFBs) have received significant attention due to their attractive features, especially for stationary storage applications, and hybridization can improve certain characteristics with respect to short-term duration and peak power availability. Presented in this paper is a comprehensive overview of the main concepts of HESSs based on RFBs. Starting with a brief description and a specification of the Key Performance Indicators (KPIs) of common electrochemical storage technologies suitable for hybridization with RFBs, HESS are classified based on battery-oriented and application-oriented KPIs. Furthermore, an optimal coupling architecture of HESS comprising the combination of an RFB and a Supercapacitor (SC) is proposed and evaluated via numerical simulation. Finally, an in-depth study of Energy Management Systems (EMS) is conducted. The general structure of an EMS as well as possible application scenarios are provided to identify commonly used control and optimization parameters. Therefore, the differentiation in system-oriented and application-oriented parameters is applied to literature data. Afterwards, state-of-the-art EMS optimization techniques are discussed. As an optimal EMS is characterized by the prediction of the system’s future behavior and the use of the suitable control technique, a detailed analysis of the previous implemented EMS prediction algorithms and control techniques is carried out. The study summarizes the key aspects and challenges of the electrical hybridization of RFBs and thus gives future perspectives on newly needed optimization and control algorithms for management systems.

1. Introduction

In recent years, there has been considerable interest in Energy Storage Systems (ESSs) in many application areas, e.g., electric vehicles and renewable energy (RE) systems. Commonly used ESSs for stationary applications are Lithium-Ion Batteries (LIBs), Lead–Acid Batteries (PbAs), and Pumped Storage hydropower [1]. However, in the last decade, there has been a rapid rise in the use of Redox-Flow Batteries (RFBs) due to the possibility to independently scale power and energy as well as attractive features, such as low self-discharge, high efficiency, and long life [2,3].
In many applications such as microgrids, a single ESS is insufficient for meeting the important system requirements. Hence, the use of multiple distinct ESSs, also known as Hybrid Energy Storage Systems (HESSs), is needed to benefit from the complementary characteristics of each single ESS. HESSs have received substantial interest over the previous ten years, and research on the major aspects of HESS have been extensively carried out [4,5,6,7]. However, only a few studies have focused on HESSs based on RFBs [8,9].
While technological features such as materials, components, or stacking of ESS are being constantly improved, stationary applications require advanced control and management techniques to enable highly adaptable flexibility options in future grids. Management Approaches for ESS should consider multiple decision criteria to optimize the operation and design. Often, these criteria are only based on technical aspects written in the data sheet, while application-oriented criteria are neglected. The technical approach focuses on the storage technology itself and its functionality under different circumstances. The application perspective describes how the storage system should perform and examines the utilization purpose.
As a HESS consists of at least two electrically connected single storage components, both the battery perspective of each component as well as the overall application perspective need to be taken into account to develop advanced control strategies. The combination of battery and application aspects leads to optimized dimensioning of the HESS itself. Figure 1 summarizes the methodology presented in this study. Starting from single storage components (A/B/C...), the evaluation of battery- and application-oriented criteria (step I/II) is performed for single components, and the combination within the HESS results in complementary characteristics and advantages. Moreover, the electrical layout meaning the optimized coupling architectures for single components and design approaches are based on the selected criteria and the storage technologies (step III). In the last step, the evaluation criteria determine the input parameters for the Energy Management structure and optimization in step four.
In this study, the proposed methodology (step one to four) is deeply studied based on literature analysis, and results from two research projects, HyFlow and Open Mobility Electric Infrastructure (OMEI), focusing on the hybridization of RFBs, are evaluated. The goal is to summarize the status quo of recent developments in design and energy management approaches for HESS based on RFB. The presented methodology allows for the classification of ESSs based on key performance indicators (KPIs) to identify the most suitable candidates for hybridization (Section 2). An optimization strategy to identify optimal electrical coupling architectures is performed using an exemplary HESS with an RFB and an SC from one of the research projects (Section 3). Application scenarios are studied and categorized to identify application-oriented criteria which need to be considered while developing the Energy Management System (EMS) (Section 4.1). The energy management structure, as core control component for all HESSs, will be studied deeply, and newly available optimization and prediction approaches are analyzed for future perspectives (Section 4.2).

2. Evaluation of Key Performance Indicators

KPIs help to characterize the behavior and enable comparison between different storage technologies. They can be classified in battery- and application-oriented KPIs. Materials or components used as well as design approaches, e.g., stacking of single cells influence the technical specifications of a battery, are summarized according to battery-oriented KPIs. For this study, the following KPIs are chosen: energy density in Wh/kg, power density in W/kg, efficiency in %, self-discharge in %/day, and reaction time in s. KPIs can also be formulated based on the application for which the ESS is used or are a result of the application requirements. For the classification approach within this section, the following application-oriented KPIs are used: energy- and power-related costs in EUR/kWh and EUR/kW, lifetime in cycles, shelf life in year, storage duration, design flexibility, ecological impact, and safety.

2.1. Classification of Single Storage Components

A comprehensive overview of existing energy storage technologies and their functionality divided into electrical, mechanical, electrochemical, thermochemical, chemical, and thermal technologies can be found in various publications [7,10,11,12]. So-called batteries are part of the category electrochemical energy storage technologies and can be further categorized into primary batteries, secondary batteries, fuel cells (FCs), and electrochemical capacitors (SC) [11]. Due to irreversible reactions, primary batteries are mostly not rechargeable and are typically used in small portable applications, e.g., watches or thermostats [11]. Secondary battery cells are based on a reversible electrochemical process and can thus be recharged several times depending on their technical characteristics [11]. The storage technologies investigated within this study are summarized as follows. RFB are used as the core storage component. Most suitable hybridization partners are LIBs, Sodium–Sulfur Batteries (NaSs), and PbAs. Moreover, SCs and Superconducting Magnetic Energy Storage (SMES) are added to the list of investigated technologies, due to their high power density.

2.1.1. Redox-Flow Batteries (RFBs)

In contrast to the other examples of electrochemical storage, RFBs offer independent scalability of energy and power and thus promising storage technology. The first developments were in 1949, and further improvements were patented during the 1970s, which led to the most commercialized Vanadium Redox-Flow Battery (VRFB) found today [2,13,14,15]. In general, RFBs consist of two half cells with carbon-based high surface electrodes separated by an ion selective membrane, as shown in Figure 2 [2,3]. Commonly, a water-based electrolyte is pumped through the half cells and stored in separated external tanks [2,3]. Typically, up to 40 cells are electrically connected in series using a bipolar stack design, while hydraulic circuits deliver electrolyte parallel to all cells [3,16,17]. In case of the VRFB, the electrolyte is based on a 1.6-molar solution of vanadium ions in sulfuric acid and water [2,18,19]. For the discharging process, a consumer is connected to the electrical circuit. Ideally, V5+ is reduced to V4+ on the cathode, while V2+ is oxidized to V3+ on the anode. In reverse, during the charging process a current source is connected to the electrical circuit, as highlighted in Figure 2, and the electrodes change the roles as cathode and anode [2,18,19].
Besides VRFBs, other types of RFBs are currently in different development or industrialization states [17,20,21,22]. Ref. [21] provides a comprehensive review of the RFB chemistries. In particular, the substitution of critical raw materials, such as vanadium, with abundant material, led to further developments in the field of Aqueous Organic Redox-Flow Batteries (AORFBs) presented in [20]. Expectations from research and industry are counting on organic molecules to enable a higher voltage range, solubility, and stability while having reduced losses due to crossover-mixing and fast reaction kinetics [20]. A highly ranked scientific review [17,20,21,22,23,24] has already been conducted in the field of RFBs. Thus, our review does not aim to provide a deep overview of RFBs as single storage components but, instead, will focus on aspects of hybridization and control strategies in application-oriented EMSs.

2.1.2. Lithium-Ion Batteries (LIBs)

A LIB is an example of electrochemical storage, based on the rocking chair effect of lithium ions with reversible chemical reactions [25]. It consists of two electrodes, a separator and the electrolyte. The fundamental materials research is due to researchers John B. Goodenough, M. Stanley Whittingham, and Akira Yoshino, who were awarded the Nobel Prize in Chemistry in 2019 for their work [26].
The most commonly used electrode active materials show good hosting characteristics: high storage capability for lithium ions as well as structure stability during intercalation and deintercalation processes [27]. On the cathode side, Lithium–Nickel–Cobalt–Manganese Oxide (NCM) is usually used. It is a complex oxide representing an attempt to combine the advantages of the composed elements. Cobalt shows good electrochemical behavior as well as a positive influence on structure stability, nickel increases the long-term reversibility, whereas manganese is beneficial for costs as well as structure stability [27]. In most cases, the anode consists of a graphite component as hosting material [28].

2.1.3. Sodium–Sulfur Batteries (NaSs)

In contrast to most battery types, NaS technology works at 320 °C instead of ambient conditions. The high temperature is necessary to melt the solid electrodes. The working principle is based on liquid electrodes: sodium on the cathode side and sulfur as the anode. In contrast, the electrolyte is solid and consists of beta-alumina [3]. This material is capable of conducting sodium ions for the battery reaction. Due to the sensitivity of metallic sodium against water, the cell is hermetically sealed as well as thermally insulated to maintain the high temperature [3].

2.1.4. Lead–Acid Batteries (PbAs)

The PbA works in ambient conditions and has a long history. The cathode consists of lead dioxide, whereas the anode is metallic lead. During discharging, lead sulfate is formed at both electrodes. It is nonconducting and insoluble [3]. Nevertheless, this reaction is reversible, and during the charging process the porous lead dioxide as well as the metallic spongy lead are receded. For the reaction, both electrodes react with the electrolyte composed of sulfuric acid [3].

2.1.5. Supercapacitors (SCs)

Super- or ultracapacitors belong to the category of the electrical or electrochemical double layer capacitors [29]. These systems are composed of two carbon electrodes, a separator (porous membrane), and an electrolyte for the ion conductivity [22]. Due to the high power density and the comparably small energy density, SCs find application where high C-Rates (charging and discharging current related to the capacity) and power systems are required. The disadvantages include a high self-discharge rate and relatively high specific storage costs [29].

2.1.6. Superconducting Magnetic Energy Storage (SMES)

Similar to the SCs, SMES systems are typically listed as a Power Component (PC), due to the high power density. The energy is stored in magnetic form with the help of a coil. The relative high costs, self-discharge rate and the environmental impact of the magnetic field can be identified as the disadvantages of the system [29]. As SMES systems represent an emerging new technology that has not been completely commercialized and, moreover, do not offer advantages over SCs, they are not considered as a hybrid component within this review.

2.1.7. Evaluation of Key Performance Indicators

In Table 1, the KPIs are applied to the selected storage technologies and subsequently evaluated for their utilization as a HESS component. The storage units are classified by Harvey balls according to their characteristics. Positive characteristics for each KPI are represented by filled balls, negative ones by empty balls, and medium by half-filled balls. For example, high power density is regarded as positive (filled ball), whereas high costs are seen as a negative characteristic (empty ball). For each battery technology, several publications are taken into account [7,10,11,12,22,29,30,31,32,33,34].
The collected data are listed, and the average literature values are calculated for each category. In some cases, minimal and maximal values for e.g., efficiency, power density, energy density, self-discharge, or reaction time are listed. For comparison, at the first stage, the average of literature values for minimal and maximal KPIs is calculated. Afterwards, the total average from minimal and maximal values is used for further investigations. The classification, as shown in the table, is then determined in relation to the overall average between all technologies for each category: positive compared to average equals filled balls, negative equals empty ball, and close to average equals half-filled ball. For example, the average power density for all selected batteries based on the named literature is 1001.25 W/kg. For SCs, the literature reveals 3508.33 W/kg, resulting in a filled ball in the table, whereas LIB show 982.92 W/kg, which is close to the overall average represented by a half-filled ball in the table. Average values below 200 W/kg are given by RFB, NaS, and PbA and, thus, represented as empty balls.
In general, high values for energy density, power density, efficiency, lifetime in cycles, shelf life, design flexibility, and safety are seen as positive, whereas low values for energy- and power-related costs, self-discharge, reaction time (low values = fast reaction time), and ecological impact are regarded as good. For storage duration, a wide time window is preferred, from milliseconds to months in the best case. The need for a suitable technology for each time slot leads to the exceptional visualization in the table without Harvey balls but the found storage duration time window.
With regard to the types of storage considered, LIBs stand out with high efficiencies of 90% and energy density of 150 Wh/kg [32]. Due to the relatively high power density of 980 W/kg, the batteries have a smaller size, which is suitable for various transportable devices, for stationary applications and for mitigation of power fluctuation applications [29]. The acquisition costs of 1750 EUR/kW, 1700 EUR/kWh, the raw material situation, as well as safety issues impair application [10,28,32].
In contrast to LIBs, RFBs have difficulties with energy and power density with average values of 25 Wh/kg, 143 W/kg for vanadium electrolyte as well as reaction time [32]. The latter depends on whether the pumps are already running or need to be started for a specific power requirement. Nevertheless, there are advantages regarding safety, ecological impact, lifetime of 11,625 cycles on average, and very low self-discharge. Above all, RFBs are characterized by independent scaling of power and energy, which enables an extremely flexible design for different applications. These characteristics make the RFB suitable for stationary storage applications [29].
NaS can be used for grid power quality regulation, voltage regulation, and peak load shifting [7,31]. They have high energy densities of 179 Wh/kg but challenges with self-discharge rates of 10% per day due to the high operating temperatures of up to 300 ° C [30]. This goes along with a reduced design flexibility as well as low lifetime of 3469 cycles on average.
These are characteristics that also challenge the PbA. Nevertheless, they are a popular storage choice for power quality and UPS, used in commercial and large-scale energy management applications due to their low cost of 429 EUR/kW and 246/kWh as well as high reliability [30]. However, when comparing the storage type with other batteries, the limited energy/power density of 37 Wh/kg and 193 W/kg as well as relatively low lifetime of 1146 cycles become apparent, especially at low temperatures [30,32]. In addition, the use of lead also results in high maintenance requirements and ecological as well as safety issues regarding toxicity [12,32].
In contrast to battery storage, SCs impress with high efficiency, high power density, and a fast response time of less than 10 milliseconds [10]. Additionally, a lifetime of 228,571 cycles and ecological as well as safety issues are positive aspects of SCs. The main drawbacks of SCs are high energy losses due to self-discharge of 20% per day as well as low energy density of 112 Wh/kg [30,32]. Due to these characteristics, SCs are not used for large-scale applications but for short-term storage and support [22]. Exemplary applications are lifts, distribution grids, microgrids, or automotive applications [7].
There are many storage systems available, and as shown for the selected types and KPIs, every technology shows advantages and drawbacks. On the one hand, depending on the individual use-case requirements, some KPIs can be more important than others, e.g., energy and power density for mobile applications. On the other hand, in some cases of combining different use cases, especially for stationary storage applications, there is a need to fulfill versatile KPIs in the best way possible. Thus, a combination of storage technologies and their KPIs can be a useful tool to enlarge the capability and advantages of the installed system.

2.2. Classification of HESSs

2.2.1. Definition of a HESS

Electrical hybridization of EESs refers to the combination of two or more single storage components into a system called a HESS. By carefully choosing the components, optimized overall characteristics of energy, power, lifetime, or costs can be achieved to meet the various requirements in complex use-cases. By combining two storage technologies, various single applications as well as multiple applications can be realized at once, and disadvantages of the individual storage types can balance each other out.
On the hardware side, the storage components are electrically connected via cables and power electronics, while on the software side, a so-called EMS is applied to control the power flow between the storage components and optimize the behavior within a system application, e.g., the grid. Depending on the electrical connections, the HESS itself can have the following grid connection options. In case the EESs are combined on a Direct Current (DC) level, the HESS has one grid connection point. If the EESs are connected on Alternating Current (AC) level, it is possible to have either separate connection points for every AC converter or one connection point for all converters. Both aspects, electrical hardware and software, need to be optimized for each HESS and application scenario to enable the best operation modes.
For HESS, two clusters of ESS can typically be distinguished based on ESS technical characteristics [34]:
1.
Primarily ESS cluster: has to satisfy the requirements of higher peak power demand and has to handle the fast transient fluctuations, e.g., load or Renewable Energy Sources (RES) production. This cluster is marked by fast response time, high power peaks, high efficiency, and high cycle lifetime.
2.
Secondary ESS cluster: has to comply with the requirement of high storage duration. This cluster is characterized by a low self-discharge rate and high efficiency.
Generally, all storage technologies—electrical, mechanical, electrochemical, thermochemical, chemical, and thermal—can be hybridized. Within this study, only the electrical hybridization of RFBs is investigated. Based on the results of two research projects (HyFlow, OMEI) and a comprehensive literature review [7,10,11,12,22,29,30,31,32,33,34], recent developments and challenges of HESS based on RFBs are presented. As there are only a few demonstration projects and publications of HESS with RFB, this consideration represents a recent and innovative effort. For the areas of applications and possibilities, literature reviews for different technologies are included.

2.2.2. Evaluation of Key Performance Indicators

The idea of a HESS is to combine different technologies in one system to meet the various requirements in complex use-cases. Therefore, storage technologies with complementary characteristics are hybridized to enable a broader operation and performance range. Complementary characteristics could be opposing as well as similar. For example, a combination of high with low power density is a beneficial opposing characteristic. Lifetime is seen as beneficial if combined technologies show similar characteristics, because the lifetime of the combined system depends on the limiting technology. The KPIs regarded as beneficial if the single batteries show opposing features are energy and power density, reaction time and storage duration. Similar high characteristics are preferred for efficiency, lifetime, shelf life, design flexibility, and safety, whereas similar low characteristics are favored for self-discharge, energy- and power-related costs as well as ecological impact.
The main criterion for hybridization is the beneficial combination of storage duration, power density, and reaction time resulting in five hybrid systems selected for the evaluation. In four hybridization cases, SCs were selected as a fast response and high power component with high lifetime. The respective secondary ESSs, operating as energy components, are LIBs, NaSs, PbAs, and RFBs. The fifth combination, LIB+RFB, is selected as LIBs can perform a similar role to SCs in some application scenarios. The combination is used within the research project OMEI to operate RES and electric charging infrastructure.
The evaluation summary is shown in Table 2. The Harvey balls for the hybrid system are formed out of the single system evaluation from Table 1. Besides those from the previous illustration of results with Harvey balls, the other colors are invented this time as a second evaluation characteristic. The Harvey balls are marked in green if the combination of two storage technologies has a positive influence on the respective KPI, in blue for medium to neutral influence, and red for negative influence. For example, the SC has a filled ball for power density whereas the RFB power density is shown as an empty ball. The result of the combination of both in one hybrid system is a half-filled ball. As described, power density is seen as beneficial if two opposing systems with high and low characteristics are combined in a HESS. This is illustrated with the color green. Another example is the KPI safety for the hybrid system LIB+RFB. This is a combination of a safe system (filled ball) with a system with safety issues (empty ball), also resulting in a half-filled ball for the hybrid evaluation. Nevertheless, the combination leads to potential safety issues in the hybrid system. Thus, the combination has a negative influence for the hybrid system and is marked in red.
Table 2 shows that a combination with an SC or LIB as a power component has a positive influence in the combination with NaS, PbA, and RFB as they both show high power densities with 3508 and 983 W/kg, respectively. Thus, the combination of SC+LIB has only a neutral influence on the power density as a standalone solution, which is superior compared with other technologies. While comparing self-discharge between different hybrid configurations, it becomes clear that combinations with RFB and PbA benefit from their low self-discharge rates of 0.13% and 0.23% per day. The combination of SC+RFB has the highest lifetime benefit, as both technologies on their own show high average values of 228,571 cycles for SC and 11,625 cycles for RFB. According to this evaluation methodology based on the given literature data, the best HESS is revealed to be a combination of SC with RFB. This system shows the most filled balls, positive features, as well as green colors, indicating beneficial characteristics due to the hybridization. The combination results in a storage system that shows high lifetime by the widest window of storage duration from minutes to weeks and a medium energy density with complementary power and reaction time elements for a medium cost level. In addition, the positive aspects of design flexibility, safety, and ecological impact are also preserved in the hybrid system. Thus, the following section dealing with coupling architectures of HESSs focuses the combination of SC with RFB.

3. Coupling Architecture Optimization Strategy

3.1. Coupling Architectures of Hybrid Storage Systems

The different ESSs of a HESS must be coupled in such a way that energy exchanges between them are possible. Given a set of ESSs and a required power exchange capability, there are several possible ways of interconnecting the involved ESSs and related power converters. Each one of these coupling architectures offers different features in terms of cost, efficiency, or performance. One of the main decisions is whether to use AC or DC links on the interconnection between devices. DC grids offer several advantages over AC grids: most common energy storage systems are already DC by nature, energy management is much simpler in DC than in AC, DC grids do not present the stability problems that are typical in AC grids, and the power density of a DC grid is higher than of an AC grid. Therefore, DC grids are the best option when interconnecting different energy storage devices. The involved DC/DC converters must face several requirements: (1) they must be bidirectional, (2) they must interconnect ports with a broad range of input or output voltage values, (3) the voltage gain can be low or very large, and (4) sometimes galvanic isolation is required.
The efficiency and cost of a DC/DC converter depends mainly on the required input to output voltage gain. When dealing with common non-isolated DC/DC converters (e.g., buck, boost, buck–boost), the ratio between the power switched by semiconductors and the converted power is equal to the input-to-output voltage gain. Therefore, the higher the input-to-output voltage ratio, the higher the converter cost and the lower its efficiency. On the other hand, isolated DC/DC converters perform input-to-output impedance matching. This way, the converted power is close to the switched power, and high efficiency levels are possible at a reasonable cost. An input-to-output voltage ratio around 4 can be considered the frontier at which the non-isolated DC/DC converter is less competitive than the isolated one.
In this section, a HESS application example is used in order to explain a possible coupling architecture optimization strategy. In this particular case, the HESS must exchange energy with a low-voltage (400 V A C ) three-phase industrial grid and contains two ESSs: a 5 kW RFB with a voltage between 40–68 V and a 25 kW SC bank that must be able to store up to 25 kJ of energy. The voltage of the SC bank is not defined and is one of the degrees of freedom of the optimization.
Figure 3 shows the possible three interconnection strategies for the HESS. Option (a) is the most evident and straightforward to propose: each ESS has its own converter. Anyway, considering that the voltage gain is a paramount parameter when selecting a converter and therefore has an important impact on the cost, it could be interesting to explore other options such as (b) and (c) architectures, where the DC/DC converters are in cascade and therefore individual input-to-output voltage ratio can be reduced.
In all possible configurations, the HESS is connected to the grid through a standard Active Front End (AFE) that is linked with a 700 V DC side. SCM is the supercapacitor module, SCC and BC are the supercapacitor and battery converters, and V S C is the voltage at the supercapacitor module.
In order to compare these three architecture proposals, several design parameters have been considered, as seen in Table 3.
In topology (a), the voltage ratio of SCC is to be defined and has no impact on any other parameter. In topology (b), the SCC voltage ratio conditions the BC voltage ratio. The maximum power with low voltage ratio is the power that can be converted by a non-isolated converter cheaper than the isolated full converter option. The minimum power processed with a high voltage ratio denotes the conversion of power with a high conversion cost. It is important to recall that conversion with low voltage ratio is cheaper than the conversion with a high voltage ratio. The first conclusion can be stated. Considering the total amount of power to be converted, topology (c) is not well suited, as it is required to convert 55 kW compared with only 30 kW of the topology (a). Moreover, the minimum power processed with high voltage ratio in topology (c) is six times bigger than that of (a). Therefore, we can remove topology (c) from the analysis.
Topology (b) offers the degree of freedom of the voltage at the SCM. If a low voltage is chosen, a high voltage ratio is needed at SCC and a low voltage ratio will be enough for the BC. On the other hand, a low SCC voltage ratio leads to a high BC voltage ratio. As there is more power to convert at the SCC, it is interesting to choose a high SC voltage, i.e., the second column of topology (b). Anyway, (b) always requires an overall conversion power that is 5kW higher than the topology (a), and does not offer any advantage in terms of voltage ratios that could lead to any cost improvement. Additionally, topology (a) is more flexible than (b), as it can handle any modification on the power or voltage values of any of the storage devices without any implications in the conversion chain of the other storage device. Thus, topology (a) is selected as the optimum architecture.

3.2. HESS Optimization Strategy

The BC does not require optimization, as there is no degree of freedom but the type of converter. Input–output voltages as well as the power to be converted are already defined. The input-to-output voltage ratio is high, so an isolated DC/DC converter is directly selected. In the case of the SCM and SCC, there are two degrees of freedom to be optimized (see Figure 3a). The nominal (or maximum) voltage of the SCM, V S C m a x , is the maximum voltage value at which the SC will be charged. Depending on this value, more or less SCs in series are required, and each SC must be larger or smaller. Therefore, this parameter has an impact on the cost of the SCM. It can also have an impact on the cost of the SCC. On the other hand, for a given amount of discharged energy Δ W, the minimum operating voltage V S C m i n depends on the capacitance C of the SCM. The lower the capacitance C, the lower the voltage at which the energy is discharged and therefore, the larger the current. As the cost of the SCC is directly related to the supercapacitor current (I S C ), the capacitance of C has a direct impact on the cost of the DC/DC converter. Obviously, the capacitance value also impacts on the cost of the SCM.
Figure 4 depicts the procedure of the optimization of the SCM and SCC. The procedure is based on the analysis of the performance of a large number of different capacitance and voltage values at the SCM.
The input data is a broad range of possible C, V S C m a x pairs. Considering the maximum current at the converter and the cost function of the converter, it is possible to compute the cost of the SCC. In the same way, thanks to the knowledge of the capacitance C and the maximum voltage at the SCM, it is possible to compute the number of SC cells in series and the capacitance of each one of them. These last data, combined with the cost per joule and per capacitance of the SC, lead to the cost of the SCM. Finally, both the cost of the SCM and the SCC are added and the optimum one with the minimum cost is identified. Figure 5a shows the cost per joule of the SC depending of the cell size.
Both SCC and BC share the same high-voltage DC-CCP at 700 V. Figure 5b illustrates the estimated cost per 5 kW of full power isolated (Isol) and not isolated (Non Isol) converter as a function of the low-side current side current. As it can be observed the estimated cost is constant in the case of the isolated technology whereas the non isolated one increases its cost as the low-side current side current increases. One of the advantages of the DC/DC converters is that they can easily be connected in parallel, so it is straightforward to scale power keeping almost the same cost per kilowatt figure. Figure 6 shows the estimated overall cost of the SCM plus SCC pack, considering both not isolated (Figure 6a) and isolated (Figure 6b) converters. As can be observed, the minimum cost of the non isolated case is lower than the isolated converter that is selected. The minimum cost is around EUR 4000 and is achieved with a maximum SC voltage of 650 V. At the minimum cost point the maximum SC and converter current is 58.2 A. The capacitance of the overall module that optimizes the cost is 0.21 F, built with 542 cells of 114 F each.

4. Energy Management System (EMS) for HESS

Besides optimal electrical hardware as presented above, HESS need to be optimized in terms of software and management approaches (EMS). Figure 7 illustrates the schematic of a HESS including all power, information, and sensor connections between storage components and the grid. The classification system to choose the best fitting storage technologies for hybridization has been discussed in Section 2. Within this study, RFBs as an energy component (EC) are studied in an hybrid approach using a complementary PC. The optimal electrical connections of two single storage application in one hybrid system has been discussed in Section 3. The EMS acts now as central control unit for the HESS communicating with all storage components, loads, generation, and forecasting units as highlighted in Figure 7. The Battery Management System (BMS) is mostly developed by the battery manufacturers and, thus, is not part of this review. In the following section, the EMS will be deeply studied. Beginning with an outline of the EMS structure and a definition of typical application scenarios, the EMS control techniques are presented based on their control and optimization parameters. The optimization of EMS strategies is then presented with a focus on prediction and currently used control techniques.

4.1. Energy Management Structure for HESS

The structure of a general energy management system can be realized in different ways. The norm ISO 50001, for example, serves a basic structure and can be used as a support for implementation. The standard provides a process to identify necessary framework conditions from collecting all the necessary data, setting strategic and operational energy targets to plan and structure the documentation [35].
The controlling structure for an EMS for HESS is similar to EES systems. The specific parameters and limit values have to be defined for the different application scenarios. Figure 8 shows a method to structure an EMS for HESS. The first step is to define the EMS goals in the specific application scenario. These can be subdivided into system goals and application goals. The applications scenarios are described in Section 4.1.1. The legal framework conditions and operating limits must be taken into account in advance [36]. Adapted to the EMS goals, the requirements, coupling architecture, and dimension can be set on the system components specific to the EC and PC. This results in safety boundaries for the system, for example system limitation values for power, current, and temperatures [37]. In particular, for efficient operation of RFBs, it is important to limit these values. Exceeding these ranges can lead to decreased battery performance, reduced efficiency, and even safety risks such as electrolyte leakage [15]. The control parameters for the application and system specific optimization have to be defined within a permissible operation range. These are explained in Section 4.1.2. Depending on the complexity and number of optimization parameter, the EMS control technique should be defined. In the first instance, classical and intelligent techniques are differentiated. Section 4.2.2 describes the optimization methods and refers to examples.

4.1.1. Application Scenarios

The specific application scenarios serve as input for the EMS design and implementation and especially influence the optimization or control parameters. Applications for EES are widely presented in the literature. To obtain a high amount of data, the investigations of the application fields includes not only RFB but also other stationary storage technologies. This study aims to show which electrical storage applications RFB can cover and how these can be technically and economically optimized specifically through hybridization.
By reviewing 22 publications within this study [1,10,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,55,56,57], over 80 different types of stationary application have are first identified. Mobile applications are excluded from this study. As different descriptions where referring to similar applications, a classification system developed in [58] has been applied. Duplications are reduced, and the applications are evaluated to sort them into universal application scenarios. Eleven application scenarios with different purpose, placement, duration, as well as control parameters applicable for a HESS based on RFBs are summarized in Table 4.
Applications with different descriptions but the same technical specifications or goals, e.g., frequency stability and frequency control, have been summarized. Moreover, some for which the control parameters are not clearly described, e.g., capacity support, capacity firming, or electric supply capacity, are formulated with more specific terms relying on already defined system services in the interconnected grid [45]. Some applications, such as grid flexibility, are too general, and universal control parameters cannot be found, or some are more related to the grid operators business and not yet clearly defined as EES scenarios, e.g.,investment deferral in grids or operational grid management. These applications are omitted from the final summary. Newly developed applications, such as Grid Booster, are also not listed in Table 4 but could be added once demonstration projects have been completed. The remaining 13, now referred to as application scenarios, are classified by their purpose, placement, and control level, as suggested by [58]. Newly added items also classify the duration, control parameters, and required controller rate for the EMS.
The application purpose of using a EES is summed up in three categories:
1.
System (S) describes storage usage for the general stability and maintenance of interconnected grids and the used stability products, e.g., defined in [45,58].
2.
Grid (G) describes the local grid operation mode maintaining power quality in distribution grids [58].
3.
Manage (M) sums up all end-user applications aiming at balancing power flows within their system boundary, which must be smaller than a network section [58].
The physical placement influences, on the one hand, the used infrastructure and involved stakeholders. On the other hand, the placement includes not only the physical placement but also the spatial distribution of control variables for the management system, e.g., frequency, voltage, and power [58]. Both physical and control placement are often combined, e.g., in home storage. For some applications, the placement is not specifically determined e.g., black start or island grids. Therefore, physical placement is categorized as follows [58]:
1.
Transmission grid (T);
2.
Distribution grid (D);
3.
Behind the meter at end-user locations (E-U).
The control level is the summarized decision parameter for a management system to decide which operation mode of the ESS is used at which time and how long it is used. Power (P) summarizes all objective functions of EES that are controlled by a power-specific parameter, while Energy (E) describes all those controlled by a energy-specific parameter [58]. All scenarios in Table 4 can be applied to single storage systems or HESSs. By using a HESS, it is even possible to combine different application scenarios complementary to the HESS characteristics. For example, the combination of an energy-based (E) and a power-based (P) application scenario is a commonly used approach in hybrid systems.
The duration describes the average operation time and can also be described as the time during which the energy storage system has the same control command. The duration of energy storage has been categorized based on the definition of system services in the grid starting with momentary reserve in milliseconds as immediate grid services, followed by primary, secondary, and tertiary reserve in minutes until exchange within one balancing group starts. The latter describes the smallest unit of the energy market model and refers to a virtual energy account to balance any number of energy inputs and outputs [59]. The duration is only fixed for system services, e.g., frequency control [45]. Other application scenarios, e.g., peak shaving or energy time shifting, show only suggestions of applicable time scales and can be seen as a start of the art from the studies literature data base. Similarly to combining different control levels, e.g., power or energy, HESS can enlarge the usable storage duration by adding a short term storage e.g., SC to a mid- to long-term storage e.g., RFB. Thereby, application scenarios as, e.g., momentary reserve and energy time shifting can be combined. Both state-of-the-art research projects, HyFlow and OMEI, built up demonstrators by combining different application scenarios and durations. HyFlow focuses on four different applications scenarios, whereby a combination of high-power and high-energy component is always foreseen [60]. Thus, momentary reserve, peak shaving, and energy time shifting are foreseen for industry grids, weak distribution grids, and UPS [60]. Within OMEI, the HESS is used to balanced fast-charging infrastructure and perform peak shaving as well as energy time shifting of renewable generations and load.
The control parameter describes the exact values that are used for the management system. These parameters need to be optimized with the momentary load and generation to satisfy the purpose of the storage usage and are thus application-oriented control parameters. Additionally, the used storage systems also have system-oriented control parameters for each battery used in a HESS, as described in the section above. Both need to be taken into account and prioritized for EMS and optimization techniques. The controller rate or sample rate shows the reaction rate of the EMS and thereby defines the communication and electrical requirements of a HESS. Moreover, this is also the time frame in which the optimal operation mode needs to be calculated and raw data from the application case, e.g., load or generation need to be measured. If the duration of the application is typically low, the controller rate needs to be high, e.g., 20 ms for momentary reserve.
Based on the application scenarios, the following sections describe which optimization routines are applied to identify an optimal power flow within a HESS.
Table 4. Classification of storage application scenarios by their application purpose (S: System; G: Grid; M: Manage), placement (T: Transmission; D: Distribution), control level (P: Power; E: Energy), duration, control parameters, and controller rate. Literature review from [1,10,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,55,56,57,58].
Table 4. Classification of storage application scenarios by their application purpose (S: System; G: Grid; M: Manage), placement (T: Transmission; D: Distribution), control level (P: Power; E: Energy), duration, control parameters, and controller rate. Literature review from [1,10,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,55,56,57,58].
SourceApplicationPurposePlacementControlDurationControl
Parameter
Controller
Rate
[38,46,47,48,49,50]Momentary
Reserve
STPt < msecf_AC 1<20 ms
[1,38,43,46,47,49,50,53,54]Primary ControlS/GTPt < msecP_AC
f_AC 1
<30 s
[10,38,42]Secondary ControlS/GTPs < t > 15 minP_AC
f_AC 1
<5 min
[10,38,42]Tertiary ControlS/GTPmin < t > 60 minP_AC
f_AC 1
<15 min
[10,38,42]Black StartS-Ps <t > min Δ P 3
f_AC 1
U_AC
1–10 s
[1,10,38,42,44,55]Island Grid 4S-Es < t > days Δ P 31 s–1 min
[1,38,42]Transmission
Support
and Stability
STEt > h Δ P 31 s–1 min
[10,38,42,49,56,57]Voltage SupportG /ST/DP15 min < t >h Δ U 21–15 min
[1,10,38,42,43,46,49,50,52]Distribution
Power Quality
G /SDPs < t > min Δ P 31 s–1 min
[10,38,43,44,52]Peak Shaving
(all time scales)
M /GE-UPs < t > 15 min Δ P 330 s–1 min
[38]Uninterruptible
Power Supply
ME-UP/Es < t > hP
f_AC
U
<20 ms
[38,46,47,49,50,52,56,57]Energy Time
Shifting
ME-UE15 min < t > days Δ P 3
t
1–15 min
[1,38,43]Energy Trading,
Arbitrage
M-E15 min < t > h Δ P 3
EUR/kW
EUR/kWh
1–15 min
1 Allowed frequency range within the German grid 50 Hz +− 0.02 Hz according to DIN EN 50160 [61,62]. 2 Allowed voltage range within the German grid 230 V+−10% according to DIN EN 50160 [61,62]. 3 Residual power DP refers to the difference of power demand and supply. 4 Including mini, micro, military, emergency grids or similar.

4.1.2. Control and Optimization Parameters

The application categories in the literature show the potential for HESS. Due to the combination of storage systems, not only technical and economical advantages but also application extensions and combinations can be achieved. Table 5 shows the advantages and objectives for HESS of the application categories and combinations in the considered literature. The table indicates system and application goals. First and foremost, the storage systems are designed to achieve the application objectives. On the technical side, for example, the parameters of storage capacity demand, power limits, power electronics, and time requirements are used for this purpose.
The use of HESSs has the advantage of combining the application goals with the option to optimize the system and the operation process by using a hybrid operation strategy. Optimization targets for the PC and EC are dimensioning, efficiency, lifetime and economic efficiency. These parameters are intended to optimize the HESS systems for the specific application goals. Therefore, control parameters such as capacities, power demand and supply, grid quality values (frequency, voltage), response times, and energy prices play a major role.
Based on this map, the potentials of RFB as EC in the considered applications can also be classified. The analysis of the applications and the KPI from Table 1 show optimization potentials in the operational efficiency, increased lifespan, and economic viability of RFB through hybridization. In particular, the combination with a PC such as a SC and the specific optimization of operation result in technical and economic advantages in implementation. Furthermore, an expanded spectrum of application areas can be defined where a single RFB system is not optimally applied.
Additionally, through the optimization and operation of the HESS, the targets for multiple applications can be achieved. A prerequisite is that the intended purpose takes place at the same placement as shown in Table 4.

4.2. Energy Management Optimization for HESS

The main goal of EMS for HESS is to execute the operation strategy in real time and in an optimal manner. This target is reached by increasing the input variables to the HESS by predicting data that fit the technical HESS requirements and is achieved by selecting a suitable EMS control technique. Figure 9 depicts the real-time architecture of an EMS. This architecture is composed of three steps: (1) prediction, (2) optimization, and (3) HESS component. The prediction model uses historical data such as RE production and weather to forecast important data, e.g., load demand and supply. The optimization model takes as inputs the predicted data, the system parameters and regulations as well as other information tightly linked to the system aims. Once the optimization is carried out, the HESS implements the calculated operation strategy. Finally, an evaluation and improvement process is executed to assess whether the desired changes or objectives have being achieved, or whether there has been progress toward meeting the system goals.

4.2.1. Prediction

An optimal EMS not only depends on the current external factors and in the present HESS status but also on prediction of the future system behavior at a particular time based on historical data (see Figure 9). The predicted data, that differ from one application to another, should be identified according to the system specific requirements and goals and should be as faithful as possible, since they will be used to forecast the application status and conditions. RE production, ESS capacity, and weather information are the most widely evaluated types of data in the last few years [75,76,77,78,79].
Many prediction techniques for ESSs are defined in the literature, as highlighted in Table 6. Mixed Integer Linear Programming (MILP) and Neural Network (NN) and its variants Artificial Neural Network (ANN), Recurrent Neural Networks (RNN), and Convolution Neural Networks (CNN) are among the most commonly adopted techniques [77,79,80]. NN is able to achieve accurate results at high speed and is used in many domains, e.g., prediction and optimization. Recently, there is considerable interest in using Reinforcement Learning (RL) in multiple fields, especially in automatic control system, due to its accurate results and high control performance [78,79].
Once built, the performance of any prediction technique should be evaluated. Several evaluation metrics have been standardized in order to give a clear and comprehensive picture of the prediction technique behavior. A set of evaluation metrics are defined in the literature and the well-known metrics are Mean Absolute Percentage Error (MAPE) and Root-Mean-Square Error (RMSE) [75,76,77,78,79]. As the optimization of an EMS is closely related to the quality of the predicted data, minimization of the prediction error is required. This goal can be reached using several methods, including the selection of the best prediction horizon length and the combination of multiple prediction techniques.
Only a small number of studies have addressed the issue of predicting data to optimize an EMS, and nearly all of these studies adopted a single ESS. Further studies should investigate multiple challenges, in particular, regarding prediction data specifically for HESS based on RFB, the identification of the appropriate data to predict and the selection of the best prediction technique.

4.2.2. EMS Control Techniques

The selection of the optimal EMS control technique depends on the pre-defined optimization function (or goal) of the application. Based on the EMS architectural level, optimization functions can be classified into low-level optimization functions and high-level optimization functions [6,7]:
1.
Low-level optimization functions control the AC/DC bus voltage and the electric current flow.
2.
High-level optimization functions control many energy management strategies, among which are power performance, SoC monitoring, ESS charge/discharge cycles, and energy cost reduction.
The majority of studies, presented in Table 7, focus on high-level optimization functions, especially for power allocation strategy. Furthermore, for HESS based on RFB, power is not the only important variable that needs to be studied, but other parameters such as energy and SoC also have to be considered.
Different control techniques have been proposed in the literature to attain the main objectives of HESS, including system performance optimization, system stability improvement, and computation cost reduction [6,7]. Figure 10 represents in depth classification of EMS control techniques for HESS. These techniques are classified into two groups: classical techniques and intelligent techniques.
1.
Classical control techniques mainly include filtration-based control, dead beat control, droop control, and sliding mode control. These techniques are the most used in the literature, as demonstrated in Table 7, and are mainly applied for offline implementation independently of the filtration-based control technique.
2.
Intelligent control techniques are classified into rule-based techniques and optimization-based techniques. Rule-based techniques are among the most widely adopted in previous work due to their simplicity in implementation (see Table 7). However, these techniques are still far from perfect, as they require deep knowledge of the domain and the definition of rules for a complex system is a challenging task. Recently, there has been considerable interest in real-time optimization techniques, with a rapid rise in the use of Deep Learning (DL) and Machine Learning (ML) algorithms, e.g., Neural Network (NN) and Reinforcement Learning (RL). ML techniques deliver accurate results in real time, but on the other hand, they require a lot of training data and suffer from high computational complexity.
More details on these techniques can be found in [7].
As the majority of the current HESS-based applications are implemented online, Table 8 summarizes the advantages and limits of real-time control techniques. Based on Table 8, it is recommended that real-time optimization techniques be adopted for complex systems when accurate results are required.
Previous research on the HESS based on RFB can only be considered a first step toward a more profound understanding of the best optimization parameters to be adopted and the optimal EMS control techniques to be used. For complex HESS based on RFB, the power distribution between the different batteries that make up the HESS, as well as the reaction time, represent the most important optimization parameters. On the other hand, the recent HESSs based on RFB are intended for real-time applications, and the appropriate control techniques to achieve this goal are DL algorithms, e.g., NN and RL.

5. Related Work

A large number of existing surveys in the broader literature have examined HESS technology. This section outlines the recent reviews on this topic.
In [34], an overview of the different HESS aspects is given. After a brief definition, the author presents the significant advantages and application prospects of HESS. This study shows that HESS is gaining increasing attention in several domains, including smart grid, electric vehicles, and RE park power management. Additionally, it is demonstrated that LIBs play a big part in most of the current HESS applications and they are adopted either as “high energy” or “high power” storage. Then, the different coupling architectures in HESS are investigated, and it turns out that “the two DC/DC converters connected in parallel” is the most commonly used configuration due to its better use of storage capacity. This paper also examines the EMS control techniques and classifies them into rule-based and optimization-based techniques according to power as main control variable. This study briefly points out the main aspects of HESS.
In [7], two fundamental aspects of HESS, namely (1) coupling topologies and (2) EMS control techniques, are investigated. The first part of this work focuses on the architecture, advantages, and limitations of the following coupling topologies: “passive”, “semi-active”, and “active”. The widely used topology in HESS and especially in power systems is “active”. The remainder of this study is devoted to an analysis of existing EMS control techniques. The authors identified many techniques and classified them into two groups: classical and intelligent. For each technique, the principle, the features as well as the application domains are specified. Examples of classic techniques are filtration-based control and sliding mode control, and for instances of intelligent techniques, we have robust control, Model Predictive Control (MPC), and hierarchical control. Although this paper mainly presents intelligent control techniques for EMS, research on the technical characteristics of HESS remains limited.
In [6], a survey of SC-based HESSs for standalone DC microgrids is carried out. The paper begins by outlining the different HESS coupling topologies, e.g., passive, semi-active and full active. Furthermore, EMSs are investigated. After identifying the goals and the structure of EMSs, intelligent control techniques are discussed. They are classified into rule-based control techniques and optimization-based techniques. This study explores one type of coupling topology and describes just a few examples of EMS control techniques.
Previous surveys on HESS have mainly investigated the coupling topologies between distinct ESSs and the selection of the suitable EMS control techniques without particularly focusing on a specific type of ESS. Furthermore, RFB have gained increasing interest in the last decade in multiple application domains. Thus, the purpose of this paper is to study the different aspects of HESS based on RFB.

6. Conclusions

HESSs offer high potential to optimize stationary storage applications. The analysis of the KPIs shows the advantages and disadvantages of the different EESs. In many cases, the requirements in the application do not fit perfectly to one storage characteristic of a system. Frequently, the energy and power density limits the operation scenarios. In individual applications, this can usually be compensated by over-dimensioning of the storage system. However, this has negative effects due to the sustainable or economic requirements of the system. Therefore, specific combination of the different storage systems offers a feasible solution. RFB technology profits from combination of SC or LIB in many KPIs (described in Table 2), resulting in high lifetime by the widest window of storage duration, a medium energy density with complementary high power, and fast reaction time for a medium cost level. In this HESS, the RFB acts as an energy component (secondary cluster), while SC or LIB take the role of the power component (primary cluster).
Depending on hybrid components and application scenarios, the coupling architecture of the system has to be optimized. A DC coupled system offers several advantages regarding efficiency and system prices and is selected as an optimized solution for an RFB–SC combination. A coupling architecture optimization strategy is proposed for the selection of the SC module as well as the converter to optimize efficiency, voltage, and costs.
According to the technical system design, the control strategies for the specific applications offer further optimization potential for HESS. The structure of an EMS is similar to that of an EES, but the possibilities and also the complexity increase. In the first place, the application specific goals have to be defined. Application examples and the control parameters to realize these are summarized in Table 4. In addition, hybridization enables the possibility to add system specific operation goals such as optimizing the dimensioning, efficiency, or the economic rentability. As a supplement, Table 5 shows a map where HESS systems are used for a combined application scenario described in the literature.
Due to the complexity and capabilities of HESS applications, intelligent control techniques such as artificial intelligence are used. As a supplement to real-time operation, prediction data are used to optimize operational efficiency and achievement of the remaining EMS goals.
The use and advantages of HESSs in different combinations and applications are reported in numerous publications. In Table 7, considered publications are listed and itemized according to application specifications. A number of gaps and shortcomings regarding EMS for HESS remain to be addressed:
  • The advance of real-time optimization of EMS came at a very high computational cost. One solution to address this issue is the use of the Digital Twin (DT) concept. DT uses real-world data to create a simulation that predicts system future performance [100]. DT has been recently adopted in many application fields due to several advantages, in particular energy management and operation optimization improvement.
  • In the majority of research carried out on HESS, two distinct ESSs are mainly adopted, as illustrated in Table 7, and only three studies have included an RFB [8,9,88]. Further work needs to be conducted on HESS that contain more than two distinct ESSs and at least one RFB.

Author Contributions

Conceptualization, C.S., W.F.H., B.P., and K.-H.P.; methodology, C.S., W.F.H., B.P., S.S., J.S., E.O.U., and P.M.G.; software, C.S., W.F.H., B.P., S.S., J.S., E.O.U., and P.M.G.; validation, C.S., W.F.H., B.P., S.S., J.S., E.O.U., and P.M.G.; formal analysis, C.S., W.F.H., B.P., S.S., J.S., E.O.U., and P.M.G. investigation, C.S., W.F.H., B.P., S.S., J.S., E.O.U., and P.M.G.; resources, C.S., W.F.H., B.P., S.S., J.S., E.O.U., P.M.G., and K.-H.P.; data curation, C.S., W.F.H., B.P., S.S., J.S., E.O.U., and P.M.G.; writing—original draft preparation, C.S., W.F.H., B.P., S.S., J.S., and E.O.U.; writing—review and editing, C.S., W.F.H., B.P., S.S., J.S., E.O.U., P.M.G., and K.-H.P.; visualization, C.S., W.F.H., B.P., S.S., J.S., E.O.U., and P.M.G.; supervision, C.S., W.F.H., B.P., E.O.U., P.M.G., and K.-H.P.; project administration, C.S., W.F.H., B.P., and K.-H.P.; funding acquisition, C.S., W.F.H., B.P., and K.-H.P. All authors have read and agreed to the published version of the manuscript.

Funding

This research is funded by the Horizon2020 research and innovation program of the European Union under grant agreement No 963550, HyFlow. This document reflects only the author’s view and the Agency is not responsible for any use that may be made of the information it contains. (HyFlow Grant Agreement, Art. 29.5 Disclaimer excluding Agency responsibility) More information: https://hyflow-h2020.eu/ (accessed on 1 February 2023) and This research is also funded by the German Federal Ministry for Digital and Transport with the Project OMEI (Open Mobility Elektro-Infrastruktur FK: 45KI10A011).

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

The following abbreviations are used in this manuscript:
ACAlternating Current
AFEActive Front End
ANNArtificial Neural Network
AORFBAqueous Organic Redox-Flow Battery
ARIMAAuto Regressive Integrated Moving Average
BCBattery Converter
BMSBattery Management System
CNNConvolution Neural Networks
DDistribution Grid
DCDirect Current
DTDigital Twin
EEnergy
ECEnergy Component
EESElectrical Energy Storage
EMSEnergy Management System
ESSEnergy Storage System
E-UBehind the Meter at End-User Locations
FCFuel Cell
GAGradient Descent
GANGenerative Adversarial Network
HESSHybrid Energy Storage System
ISCSupercapacitor Current
IsolIsolated
GGrid
KPIKey Performance Indicator
LIBLithium-Ion Battery
LSTMLong Short Term Memory
MManage
MAEMean Absolute Error
MAPEMean Absolute Percentage Error
MDPIMultidisciplinary Digital Publishing Institute
MILPMixed Integer Linear Programming
MINLPMixed Integer Nonlinear Programming
MLPMixed Linear Programming
MPCModel Predictive Control
NaSSodium–Sulfur Battery
NCMLithium–Nickel–Cobalt–Manganese Oxide
NNNeural Network
Non IsolNot Isolated
NRMSENormalized Root-Mean-Square Error
N/SNot Specified
OMEIOpen Mobility Electric Infrastructure
PPower
PbALead–Acid Battery
PCPower Component
PSOParticle Swarm Optimization
RERenewable Energy
RESRenewable Energy Sources
RFBRedox-Flow Battery
RLReinforcement Learning
RMSERoot-Mean-Square Error
RNNRecurrent Neural Networks
SSystem
SCSupercapacitor
SCCSupercapacitor Converter
SCMSupercapacitor Module
SoCState of Charge
SMESSuperconducting Magnetic Energy Storage
TTransmission Grid
UPSUninterruptible Power Supply
VRFBVanadium Redox-Flow Battery
VSCVoltage at Supercapacitor Module

References

  1. U.S. Department of Energy. Energy Storage Grand Challenge Energy Storage Market Report; National Renewable Energy Lab. (NREL): Golden, CO, USA, 2020.
  2. Maria, S.K.; Miron, R.; Robert, R. All-Vanadium Redox Battery. U.S. Patent US4786567A, 2 November 1986. [Google Scholar]
  3. Kurzweil, P.; Dietlmeier, O. Elektrochemische Speicher: Superkondensatoren, Batterien, Elektrolyse-Wasserstoff, Rechtliche Grundlagen, Wiesbaden; Springer: Berlin/Heidelberg, Germany, 2015. [Google Scholar] [CrossRef]
  4. Deepika, D.; Singh, N. Exponential state observer based finite time control of fully active hybrid energy storage system. Sādhanā 2022, 47, 21. [Google Scholar] [CrossRef]
  5. Hu, W.; Shang, Q.; Bian, X.; Zhu, R. Energy management strategy of hybrid energy storage system based on fuzzy control for ships. Int. J. Low-Carbon Technol. 2022, 17, 169–175. [Google Scholar] [CrossRef]
  6. Jing, W.; Hung Lai, C.; Wong, S.H.W.; Wong, M.L.D. Battery-supercapacitor hybrid energy storage system in standalone DC microgrids: Areview. IET Renew. Power Gener. 2017, 11, 461–469. [Google Scholar] [CrossRef]
  7. Babu, T.S.; Vasudevan, K.R.; Ramachandaramurthy, V.K.; Sani, S.B.; Chemud, S.; Lajim, R.M. A Comprehensive Review of Hybrid Energy Storage Systems: Converter Topologies, Control Strategies and Future Prospects. IEEE Access 2020, 8, 148702–148721. [Google Scholar] [CrossRef]
  8. Ali, M.H.; Slaifstein, D.; Ibanez, F.M.; Zugschwert, C.; Pugach, M. Power Management Strategies for Vanadium Redox Flow Battery and Supercapacitors in Hybrid Energy Storage Systems. In Proceedings of the 2022 IEEE PES Innovative Smart Grid Technologies Conference Europe (ISGT-Europe), Novi Sad, Serbia, 10–12 October 2022; IEEE: Piscataway, NJ, USA, 2022; pp. 1–5. [Google Scholar]
  9. Behera, M.K.; Saikia, L.C. A Novel Resilient Control of Grid-Integrated Solar PV-Hybrid Energy Storage Microgrid for Power Smoothing and Pulse Power Load Accommodation. IEEE Trans. Power Electron. 2022, 38, 3965–3980. [Google Scholar] [CrossRef]
  10. Das, C.K.; Bass, O.; Kothapalli, G.; Mahmoud, T.S.; Habibi, D. Overview of energy storage systems in distribution networks: Placement, sizing, operation, and power quality. Renew. Sustain. Energy Rev. 2018, 91, 1205–1230. [Google Scholar] [CrossRef]
  11. Dehghani-Sanij, A.R.; Tharumalingam, E.; Dusseault, M.B.; Fraser, R. Study of energy storage systems and environmental challenges of batteries. Renew. Sustain. Energy Rev. 2019, 104, 192–208. [Google Scholar] [CrossRef]
  12. Ferreira, H.L.; Garde, R.; Fulli, G.; Kling, W.; Lopes, J.P. Characterisation of electrical energy storage technologies. Energy 2013, 53, 288–298. [Google Scholar] [CrossRef]
  13. Kangro, W. Verfahren zur Speicherung von Elektrischer Energie. German Patent DE914264C, 28 June 1949. [Google Scholar]
  14. Kangro, W. Verfahren zur Speicherung von elektrischer Energie in Fluessigkeiten. German Patent DE1006479B, 14 July 1954. [Google Scholar]
  15. Thaller, L.H. Electrically rechargeable REDOX Flow Cell. U.S. Patent US3996064A, 22 August 1975. [Google Scholar]
  16. Sterner, M.; Stadler, I. Energiespeicher: Bedarf, Technologien, Integration; Springer: Berlin/Heidelberg, Germany, 2014. [Google Scholar] [CrossRef]
  17. Weber, A.Z.; Mench, M.M.; Meyers, J.P.; Ross, P.N.; Gostick, J.T.; Liu, Q. Redox flow batteries: A review. J. Appl. Electrochem. 2011, 41, 1137–1164. [Google Scholar] [CrossRef]
  18. Skyllas-Kazacos, M.; Chakrabarti, M.H.; Hajimolana, S.A.; Mjalli, F.S.; Saleem, M. Progress in Flow Battery Research and Development. J. Electrochem. Soc. 2011, 158, R55. [Google Scholar] [CrossRef]
  19. Choi, C.; Kim, S.; Kim, R.; Choi, Y.; Kim, S.; Jung, H.y.; Yang, J.H.; Kim, H.T. A review of vanadium electrolytes for vanadium redox flow batteries. Renew. Sustain. Energy Rev. 2017, 69, 263–274. [Google Scholar] [CrossRef]
  20. Sánchez-Díez, E.; Ventosa, E.; Guarnieri, M.; Trovò, A.; Flox, C.; Marcilla, R.; Soavi, F.; Mazur, P.; Aranzabe, E.; Ferret, R. Redox flow batteries: Status and perspective towards sustainable stationary energy storage. J. Power Sources 2021, 481, 228804. [Google Scholar] [CrossRef]
  21. Noack, J.; Roznyatovskaya, N.; Herr, T.; Fischer, P. The Chemistry of Redox-Flow Batteries. Angew. Chem. 2015, 54, 9776–9809. [Google Scholar] [CrossRef] [PubMed]
  22. Luo, X.; Wang, J.; Dooner, M.; Clarke, J. Overview of current development in electrical energy storage technologies and the application potential in power system operation. Appl. Energy 2015, 137, 511–536. [Google Scholar] [CrossRef]
  23. Soloveichik, G.L. Flow Batteries: Current Status and Trends. Chem. Rev. 2015, 115, 11533–11558. [Google Scholar] [CrossRef] [PubMed]
  24. Changkun, Z.; Leyuan, Z.; Yu, D.; Sangshan, P.; Xuelin, G.; Yu, Z.; Gaohong, H.; Guihua, Y. Progress and prospects of next-generation redox flow batteries. Energy Storage Mater. 2018, 15, 324–350. [Google Scholar] [CrossRef]
  25. Goodenough, J. How we made the Li-ion rechargeable battery. Nat. Electron. 2018. [Google Scholar] [CrossRef]
  26. Welter, K. Die Lithium-Ionen-Batterie: Eine Erfindung Voller Energie; Chemie in unserer Zeit; Wiley Online Library: Hoboken, NJ, USA, 2019. [Google Scholar] [CrossRef]
  27. Korthauer, R. (Ed.) Handbuch Lithium-Ionen-Batterien; Springer: Berlin/Heidelberg, Germany, 2013. [Google Scholar] [CrossRef]
  28. Jossen, A.; Weydanz, W. Moderne Akkumulatoren Richtig Einsetzen. 2006. Available online: https://cuvillier.de/uploads/preview/public_file/11447/9783736999459_Inhaltsverzeichnis.pdf (accessed on 10 March 2023).
  29. Kebede, A.A.; Kalogiannis, T.; van Mierlo, J.; Berecibar, M. A comprehensive review of stationary energy storage devices for large scale renewable energy sources grid integration. Renew. Sustain. Energy Rev. 2022, 159, 112213. [Google Scholar] [CrossRef]
  30. Chen, H.; Cong, T.N.; Yang, W.; Tan, C.; Li, Y.; Ding, Y. Progress in electrical energy storage system: A critical review. Prog. Nat. Sci. 2009, 19, 291–312. [Google Scholar] [CrossRef]
  31. Aneke, M.; Wang, M. Energy storage technologies and real life applications—A state of the art review. Appl. Energy 2016, 179, 350–377. [Google Scholar] [CrossRef]
  32. Koohi-Fayegh, S.; Rosen, M.A. A review of energy storage types, applications and recent developments. J. Energy Storage 2020, 27, 101047. [Google Scholar] [CrossRef]
  33. Electric Power Research Institute. Electric Energy Storage Technology Options: A White Paper Primer on Applications, Costs, and Benefits; Electric Power Research Institute: Palo Alto, CA, USA, 2010. [Google Scholar]
  34. Bocklisch, T. Hybrid energy storage systems for renewable energy applications. Energy Procedia 2015, 73, 103–111. [Google Scholar] [CrossRef]
  35. Fiedler, T.; Mircea, P.M. Energy management systems according to the ISO 50001 standard—Challenges and benefits. In Proceedings of the 2012 International Conference on Applied and Theoretical Electricity (ICATE), Craiova, Romania, 25–27 October 2012; pp. 1–4. [Google Scholar] [CrossRef]
  36. Barckhausen, A.; Becker, J.; Malodobry, P. 2019. Available online: https://www.adelphi.de/de/publikation/energiemanagementsysteme-der-praxis-0 (accessed on 1 February 2023).
  37. Li, X.; Wang, S. Energy management and operational control methods for grid battery energy storage systems. CSEE J. Power Energy Syst. 2021, 7, 1026–1040. [Google Scholar] [CrossRef]
  38. Thielmann, A.; Sauer, A.; Schnell, M.; Isenmann, R.; Wietschel, M. Technologie-Roadmap Stationäre Energiespeicher 2030; Fraunhofer: Munich, Germany, 2015. [Google Scholar]
  39. Buescher, J.; Hussy, C.; Kessels, K.; Koper, M.; Munzel, B. Support to R&D Strategy for Battery Based Energy Storage: 10 Year R&I Roadmap 2017–2026 (D10); European Network of Transmission System Operators for Electricity: Brussels, Belgium, 2016. [Google Scholar]
  40. Edström, K.; Dominko, R.; Fichtner, M.; Perraud, S. Battery 2030+ Roadmap; European Commission: Brussels, Belgium, 2020. [Google Scholar] [CrossRef]
  41. Mongrid, K.; Viswanathan, V.; Alam, J.; Vartanian, C.; Sprenkle, V.; Pacific Northwest National Lboratory; Baxter, R.; Mustang Prairie Energy. 2020 Grid Energy Storage Technology Cost and Performance Assessment; Technical Report; U.S. Department of Energy: Washington, DC, USA, 2020.
  42. Zander, W.; Lemkens, S.; Macharey, U.; Langrock, T.; Nailis, D.; Zdrallek, M.; Schaefer, K.F.; Steffens, P.; Kornrumpf, T.; Hummel, K.; et al. Optimierter Einsatz von Speichern für Netz-und Marktanwendungen in der Stromversorgung: Teil 1: Ergebniszusammenfassung der Projektsteuergruppe; dena-NETZFLEXSTUDIE: Berlin, Germany, 2017. [Google Scholar]
  43. Saboori, H.; Hemmati, R.; Ghiasi, S.M.S.; Dehghan, S. Energy storage planning in electric power distribution networks—A state-of-the-art review. Renew. Sustain. Energy Rev. 2017, 79, 1108–1121. [Google Scholar] [CrossRef]
  44. Kousksou, T.; Bruel, P.; Jamil, A.; El Rhafiki, T.; Zeraouli, Y. Energy storage: Applications and challenges. Sol. Energy Mater. Sol. Cells 2014, 120, 59–80. [Google Scholar] [CrossRef]
  45. Agricola, A.C.; Seidl, H.; Mischinger, S.; Rehtanz, C.; Greve, M.; Häger, U.; Hilbrich, D.; Kippelt, S.; Kubis, A.; Liebenau, V.; et al. dena-Studie Systemdienstleistungen 2030. In Voraussetzungen für eine sichere und zuverlässige Stromversorgung mit Hohem Anteil Erneuerbarer Energien; Endbericht; dena-NETZFLEXSTUDIE: Berlin, Germany, 2014. [Google Scholar]
  46. Krishan, O.; Suhag, S. An updated review of energy storage systems: Classification and applications in distributed generation power systems incorporating renewable energy resources. Int. J. Energy Res. 2019, 43, 6171–6210. [Google Scholar] [CrossRef]
  47. U.S. Energy Information Administration. Battery Storage in the United States: An Update on Market Trends; U.S. Energy Information Administration: Washington, DC, USA, 2020.
  48. Kennedy, R. Battery Storage Capacity More than Tripled in 2021. 2022. Available online: https://pv-magazine-usa.com/2022/07/07/battery-storage-capacity-more-than-tripled-in-2021/ (accessed on 1 February 2023).
  49. Ribeiro, P.F.; Johnson, B.K.; Crow, M.L.; Arsoy, A.; Liu, Y. Energy storage systems for advanced power applications. Proc. IEEE 2001, 89, 1744–1756. [Google Scholar] [CrossRef]
  50. Palizban, O.; Kauhaniemi, K. Energy storage systems in modern grids—Matrix of technologies and applications. J. Energy Storage 2016, 6, 248–259. [Google Scholar] [CrossRef]
  51. Qu, D.; Wang, G.; Kafle, J.; Harris, J.; Crain, L.; Jin, Z.; Zheng, D. Electrochemical Impedance and its Applications in Energy-Storage Systems. Small Methods 2018, 2, 1700342. [Google Scholar] [CrossRef]
  52. Leung, P.; Li, X.; Ponce de León, C.; Berlouis, L.; Low, C.T.J.; Walsh, F.C. Progress in redox flow batteries, remaining challenges and their applications in energy storage. Rsc Adv. 2012, 2, 10125. [Google Scholar] [CrossRef]
  53. Schulz, D. (Ed.) Nachhaltige Energieversorgung und Integration von Speichern: Tagungsband zur NEIS 2015; Springer: Wiesbaden, Germany, 2015. [Google Scholar]
  54. Institut für Elektrizitätswirtschaft und Energieinnovation (IEE), Technische Universität Granz (Ed.) Neue Energie für Unser Bewegtes Europa; Technischen Universität Graz: Graz, Austria, 2018; Available online: https://www.tugraz.at/institute/iee/home (accessed on 1 February 2023).
  55. Bucher, C. Analysis and Simulation of Distribution Grids with Photovoltaics. Ph.D. Thesis, ETH Zurich, Zurich, Switzerland, 2014. [Google Scholar] [CrossRef]
  56. Pimm, A.J.; Cockerill, T.T.; Taylor, P.G. The potential for peak shaving on low voltage distribution networks using electricity storage. J. Energy Storage 2018, 16, 231–242. [Google Scholar] [CrossRef]
  57. Luthander, R.; Widén, J.; Munkhammar, J.; Lingfors, D. Self-consumption enhancement and peak shaving of residential photovoltaics using storage and curtailment. Energy 2016, 112, 221–231. [Google Scholar] [CrossRef]
  58. Zugschwert, C. Evaluation von Synergieeffekten zentraler Speichersysteme in Niederspannungsnetzen durch integrative Modellbildung. Ph.D. Thesis, University of Luxembourg, Luxembourg, 13 April 2022. [Google Scholar]
  59. Stuckenholz, A. Grundlagen. In Basiswissen Energieinformatik; Stuckenholz, A., Ed.; Lehrbuch, Springer: Wiesbaden/Heidelberg, Germany, 2020; pp. 9–73. [Google Scholar] [CrossRef]
  60. Pettinger, K.H. Project HyFlow: Development of a Sustainable Hybrid Storage System Based on High Power Vanadium Redox Flow Battery and Supercapacitor—Technology; funded by the European Union’s Horizon 2020 research and innovation programm under grand agreement No 963550; European Commission: Brussels, Belgium, 2020. [Google Scholar]
  61. Deutsche Kommission Elektrotechnik Elektronik Informationstechnik in DIN und VDE. In Merkmale der Spannung in Öffentlichen Elektrizitätsversorgungsnetzen; Norm: DIN EN 50160:2020-11; 2020. [CrossRef]
  62. Verband der Elektrotechnik Elektronik Informationstechnik e. V. (VDE). Erzeugungsanlagen am Niederspannungsnetz (VDE-AR-N 4105): Technische Mindestanforderungen für Anschluss und Parallelbetrieb von Erzeugungsanlagen am Niederspannungsnetz; Norm, VDE-AR-N 4105; 2018. [Google Scholar]
  63. Khan, K.A.; Khalid, M. Improving the transient response of hybrid energy storage system for voltage stability in DC microgrids using an autonomous control strategy. IEEE Access 2021, 9, 10460–10472. [Google Scholar] [CrossRef]
  64. Xu, D.; Liu, Q.; Yan, W.; Yang, W. Adaptive terminal sliding mode control for hybrid energy storage systems of fuel cell, battery and supercapacitor. IEEE Access 2019, 7, 29295–29303. [Google Scholar] [CrossRef]
  65. Wang, H.B.; Yang, X.; Liu, J.; Chen, J. Control Strategy of the Hybrid Energy Storage System for Leveling Off Fluctuating Power Output of Stand-Alone Photovoltaic System. In Advanced Materials Research; Trans Tech Publication: Bach, Switzerland, 2014; Volume 860, pp. 608–612. [Google Scholar]
  66. Torreglosa, J.P.; Garcia, P.; Fernandez, L.M.; Jurado, F. Energy dispatching based on predictive controller of an off-grid wind turbine/photovoltaic/hydrogen/battery hybrid system. Renew. Energy 2015, 74, 326–336. [Google Scholar] [CrossRef]
  67. Wang, J.; Wang, M.; Li, H.; Qin, W.; Wang, L. Energy management strategy for microgrid including hybrid energy storage. In Proceedings of the 2018 Asian Conference on Energy, Power and Transportation Electrification (ACEPT), Singapore, 24–26 October 2018; IEEE: Piscataway, NJ, USA, 2018; pp. 1–6. [Google Scholar]
  68. Kim, S.; Kwon, M.; Choi, S. Operation and Control Strategy of a New Hybrid ESS-UPS System. IEEE Trans. Power Electron. 2017, 33, 4746–4755. [Google Scholar] [CrossRef]
  69. Wu, T.; Shi, X.; Liao, L.; Zhou, C.; Zhou, H.; Su, Y. A capacity configuration control strategy to alleviate power fluctuation of hybrid energy storage system based on improved particle swarm optimization. Energies 2019, 12, 642. [Google Scholar] [CrossRef]
  70. Kang, B.K.; Kim, S.T.; Bae, S.H.; Park, J.W. Effect of a SMES in Power Distribution Network With PV System and PBEVs. IEEE Trans. Power Electron. 2012, 23, 5700104. [Google Scholar] [CrossRef]
  71. Wang, S.; Tang, Y.; Shi, J.; Gong, K.; Liu, Y.; Ren, L.; Li, J. Design and advanced control strategies of a hybrid energy storage system for the grid integration of wind power generations. IET Renew. Power Gener. 2015, 9, 89–98. [Google Scholar] [CrossRef]
  72. Li, J.; Yang, Q.; Robinson, F.; Liang, F.; Zhang, M.; Yuan, W. Design and test of a new droop control algorithm for a SMES/battery hybrid energy storage system. Energy 2017, 118, 1110–1122. [Google Scholar] [CrossRef]
  73. Athari, M.H.; Ardehali, M.M. Operational performance of energy storage as function of electricity prices for on-grid hybrid renewable energy system by optimized fuzzy logic controller. Renew. Energy 2015, 85, 890–902. [Google Scholar] [CrossRef]
  74. Englberger, S.P. Optimized Energy Management for Battery Energy Storage via Multi-Use and Multi-Storage Operation. Ph.D. Thesis, Technische Universität München, München, Germnay, 2022. [Google Scholar]
  75. Zhang, R.; Feng, M.; Zhang, W.; Lu, S.; Wang, F. Forecast of solar energy production-A deep learning approach. In Proceedings of the 2018 IEEE International Conference on Big Knowledge (ICBK), Beijing, China, 10–11 November 2018; IEEE: Piscataway, NJ, USA, 2018; pp. 73–82. [Google Scholar]
  76. Choi, J.; Lee, J.I.; Lee, I.W.; Cha, S.W. Robust PV-BESS Scheduling for a Grid With Incentive for Forecast Accuracy. IEEE Trans. Sustain. Energy 2021, 13, 567–578. [Google Scholar] [CrossRef]
  77. Mahjoub, S.; Chrifi-Alaoui, L.; Marhic, B.; Delahoche, L. Predicting Energy Consumption Using LSTM, Multi-Layer GRU and Drop-GRU Neural Networks. Sensors 2022, 22, 4062. [Google Scholar] [CrossRef] [PubMed]
  78. Liu, G.; Xue, Y.; Chinthavali, M.S.; Tomsovic, K. Optimal sizing of PV and energy storage in an electric vehicle extreme fast charging station. In Proceedings of the 2020 IEEE Power & Energy Society Innovative Smart Grid Technologies Conference (ISGT), Hague, The Netherlands, 26–28 October 2020; IEEE: Piscataway, NJ, USA, 2020; pp. 1–5. [Google Scholar]
  79. Chen, S.X.; Gooi, H.B.; Wang, M. Sizing of energy storage for microgrids. IEEE Trans. Smart Grid 2011, 3, 142–151. [Google Scholar] [CrossRef]
  80. Zhu, J.; Yang, Z.; Chang, Y.; Guo, Y.; Zhu, K.; Zhang, J. A novel LSTM based deep learning approach for multi-time scale electric vehicles charging load prediction. In Proceedings of the 2019 IEEE Innovative Smart Grid Technologies-Asia (ISGT Asia), Chengdu, China, 21–24 May 2019; IEEE: Piscataway, NJ, USA, 2019; pp. 3531–3536. [Google Scholar]
  81. Zhang, X.; Chan, K.W.; Li, H.; Wang, H.; Qiu, J.; Wang, G. Deep-Learning-Based Probabilistic Forecasting of Electric Vehicle Charging Load With a Novel Queuing Model. IEEE Trans. Cybern. 2021, 51, 3157–3170. [Google Scholar] [CrossRef] [PubMed]
  82. Zhu, J.; Yang, Z.; Guo, Y.; Zhang, J.; Yang, H. Short-term load forecasting for electric vehicle charging stations based on deep learning approaches. Appl. Sci. 2019, 9, 1723. [Google Scholar] [CrossRef]
  83. Chen, H.; Hu, Z.; Zhang, H.; Luo, H. Coordinated charging and discharging strategies for plug-in electric bus fast charging station with energy storage system. IET Gener. Transm. Distrib. 2018, 12, 2019–2028. [Google Scholar] [CrossRef]
  84. Jin, C.; Tang, J.; Ghosh, P. Optimizing electric vehicle charging with energy storage in the electricity market. IEEE Trans. Smart Grid 2013, 4, 311–320. [Google Scholar] [CrossRef]
  85. Ko, Y.D. An efficient integration of the genetic algorithm and the reinforcement learning for optimal deployment of the wireless charging electric tram system. Comput. Ind. Eng. 2019, 128, 851–860. [Google Scholar] [CrossRef]
  86. Straka, M.; Falco, P.D.; Ferruzzi, G.; Proto, D.; Poel, G.V.D.; Khormali, S.; Buzna, L. Predicting Popularity of Electric Vehicle Charging Infrastructure in Urban Context. IEEE Access 2020, 8, 11315–11327. [Google Scholar] [CrossRef]
  87. Zhang, M.; Xu, Q.; Zhang, C.; Nordström, L.; Blaabjerg, F. Decentralized Coordination and Stabilization of Hybrid Energy Storage Systems in DC Microgrids. IEEE Trans. Smart Grid 2022, 13, 1751–1761. [Google Scholar] [CrossRef]
  88. Zugschwert, C.; Goschl, S.; Martin Ibanez, F.; Pettinger, K.H. Development of a multi-timescale method for classifying hybrid energy storage systems in grid applications. In Proceedings of the 2021 6th IEEE Workshop on the Electronic Grid (eGRID), New Orleans, LA, USA, 8–10 November 2021; IEEE: Piscataway, NJ, USA, 2021; pp. 1–7. [Google Scholar] [CrossRef]
  89. Ye, K.; Li, P.; Li, H. Optimization of hybrid energy storage system control strategy for pure electric vehicle based on typical driving cycle. Math. Probl. Eng. 2020, 2020, 1365195. [Google Scholar] [CrossRef]
  90. Chen, H.; Zhang, Z.; Guan, C.; Gao, H. Optimization of sizing and frequency control in battery/supercapacitor hybrid energy storage system for fuel cell ship. Energy 2020, 197, 117285. [Google Scholar] [CrossRef]
  91. Zhang, Q.; Li, G. Experimental study on a semi-active battery-supercapacitor hybrid energy storage system for electric vehicle application. IEEE Trans. Power Electron. 2019, 35, 1014–1021. [Google Scholar] [CrossRef]
  92. Yang, G.; Li, J.; Fu, Z.; Fang, L. Optimization of logic threshold control strategy for electric vehicles with hybrid energy storage system by pseudo-spectral method. Energy Procedia 2018, 152, 508–513. [Google Scholar] [CrossRef]
  93. Chong, L.W.; Wong, Y.W.; Rajkumar, R.K.; Isa, D. An adaptive learning control strategy for standalone PV system with battery-supercapacitor hybrid energy storage system. J. Power Sources 2018, 394, 35–49. [Google Scholar] [CrossRef]
  94. Porru, M.; Serpi, A.; Damiano, A. Smart energy management of HESS-based electric propulsion systems for urban mobility. In Proceedings of the IECON 2016-42nd Annual Conference of the IEEE Industrial Electronics Society, Florence, Italy, 24–27 October 2016; IEEE: Piscataway, NJ, USA, 2016; pp. 4453–4458. [Google Scholar]
  95. Yu, Y.B.; Liu, X.; Min, H.; Sun, H.; Xu, L. A novel fuzzy-logic based control strategy for a semi-active battery/super-capacitor hybrid energy storage system in vehicular applications. J. Intell. Fuzzy Syst. 2015, 29, 2575–2584. [Google Scholar] [CrossRef]
  96. Kim, Y.; Koh, J.; Xie, Q.; Wang, Y.; Chang, N.; Pedram, M. A scalable and flexible hybrid energy storage system design and implementation. J. Power Sources 2014, 255, 410–422. [Google Scholar] [CrossRef]
  97. Hredzak, B.; Agelidis, V.G.; Jang, M. A model predictive control system for a hybrid battery-ultracapacitor power source. IEEE Trans. Power Electron. 2013, 29, 1469–1479. [Google Scholar] [CrossRef]
  98. El Fadil, H.; Giri, F. Sliding mode control of fuel cell and supercapacitor hybrid energy storage system. IFAC Proc. Vol. 2012, 45, 669–674. [Google Scholar] [CrossRef]
  99. Vosen, S.; Keller, J. Hybrid energy storage systems for stand-alone electric power systems: Optimization of system performance and cost through control strategies. Int. J. Hydrog. Energy 1999, 24, 1139–1156. [Google Scholar] [CrossRef]
  100. Singh, S.; Weeber, M.; Birke, K.P. Implementation of Battery Digital Twin: Approach, Functionalities and Benefits. Batteries 2021, 7, 78. [Google Scholar] [CrossRef]
Figure 1. Flow chart of the decision criteria for energy management approaches for HESS.
Figure 1. Flow chart of the decision criteria for energy management approaches for HESS.
Batteries 09 00211 g001
Figure 2. Principle schematic of an RFB cell during charging.
Figure 2. Principle schematic of an RFB cell during charging.
Batteries 09 00211 g002
Figure 3. Three possible configurations for HESS coupling architecture.
Figure 3. Three possible configurations for HESS coupling architecture.
Batteries 09 00211 g003
Figure 4. Flow chart of the optimization procedure.
Figure 4. Flow chart of the optimization procedure.
Batteries 09 00211 g004
Figure 5. Cost of elements: (a) cost per joule for each cell size and (b) estimated cost of converters as a function of technology and low-voltage side current.
Figure 5. Cost of elements: (a) cost per joule for each cell size and (b) estimated cost of converters as a function of technology and low-voltage side current.
Batteries 09 00211 g005
Figure 6. Estimated overall cost considering the SCM and the SCC for (a) non-isolated converter and (b) isolated converter.
Figure 6. Estimated overall cost considering the SCM and the SCC for (a) non-isolated converter and (b) isolated converter.
Batteries 09 00211 g006
Figure 7. Principle schematic of a HESS including all power, information, and sensor connections between storage components and the grid.
Figure 7. Principle schematic of a HESS including all power, information, and sensor connections between storage components and the grid.
Batteries 09 00211 g007
Figure 8. Methods of an energy management structure for HESS.
Figure 8. Methods of an energy management structure for HESS.
Batteries 09 00211 g008
Figure 9. Real-time EMS architecture [74].
Figure 9. Real-time EMS architecture [74].
Batteries 09 00211 g009
Figure 10. EMS control techniques of HESS [7].
Figure 10. EMS control techniques of HESS [7].
Batteries 09 00211 g010
Table 1. Evaluation of battery- and application-oriented KPIs for different single storage technologies, based on data from [7,10,11,12,22,29,30,31,32,33,34].
Table 1. Evaluation of battery- and application-oriented KPIs for different single storage technologies, based on data from [7,10,11,12,22,29,30,31,32,33,34].
LIBSCNaSPbARFB
BatteryorientedEnergy density in Wh/kgBatteries 09 00211 i001Batteries 09 00211 i002Batteries 09 00211 i001Batteries 09 00211 i003Batteries 09 00211 i003
Power density in W/kgBatteries 09 00211 i003Batteries 09 00211 i001Batteries 09 00211 i002Batteries 09 00211 i002Batteries 09 00211 i002
Efficiency in %Batteries 09 00211 i001Batteries 09 00211 i001Batteries 09 00211 i003Batteries 09 00211 i002Batteries 09 00211 i002
Self-discharge in %/dayBatteries 09 00211 i003Batteries 09 00211 i002Batteries 09 00211 i002Batteries 09 00211 i001Batteries 09 00211 i001
Reaction Time in sBatteries 09 00211 i003Batteries 09 00211 i001Batteries 09 00211 i002Batteries 09 00211 i001Batteries 09 00211 i002
ApplicationorientedCost in EUR/kWBatteries 09 00211 i002Batteries 09 00211 i001Batteries 09 00211 i002Batteries 09 00211 i001Batteries 09 00211 i003
Cost in EUR/kWhBatteries 09 00211 i002Batteries 09 00211 i002Batteries 09 00211 i003Batteries 09 00211 i001Batteries 09 00211 i003
Lifetime in cyclesBatteries 09 00211 i003Batteries 09 00211 i001Batteries 09 00211 i002Batteries 09 00211 i002Batteries 09 00211 i001
Shelf life in yearsBatteries 09 00211 i003Batteries 09 00211 i001Batteries 09 00211 i003Batteries 09 00211 i002Batteries 09 00211 i003
Design FlexibilityBatteries 09 00211 i002Batteries 09 00211 i003Batteries 09 00211 i002Batteries 09 00211 i002Batteries 09 00211 i001
Ecologic impactBatteries 09 00211 i002Batteries 09 00211 i001Batteries 09 00211 i003Batteries 09 00211 i002Batteries 09 00211 i001
SafetyBatteries 09 00211 i002Batteries 09 00211 i001Batteries 09 00211 i003Batteries 09 00211 i003Batteries 09 00211 i001
Storage durationmin-daysms-hourmin-daysmin-daysweeks
Legend: Batteries 09 00211 i002 = negative characteristics; Batteries 09 00211 i003 = medium characteristics; Batteries 09 00211 i001 = positive characteristics.
Table 2. Evaluation of different hybrid storage combinations based on complementary battery- and application-oriented KPIs.
Table 2. Evaluation of different hybrid storage combinations based on complementary battery- and application-oriented KPIs.
SC+LIBSC+NaSSC+PbASC+RFBLIB+RFB
BatteryorientedEnergy density in Wh/kgBatteries 09 00211 i004Batteries 09 00211 i004Batteries 09 00211 i005Batteries 09 00211 i005Batteries 09 00211 i006
Power density in W/kgBatteries 09 00211 i006Batteries 09 00211 i004Batteries 09 00211 i004Batteries 09 00211 i004Batteries 09 00211 i004
Efficiency in %Batteries 09 00211 i006Batteries 09 00211 i006Batteries 09 00211 i007Batteries 09 00211 i007Batteries 09 00211 i007
Self-discharge in %/dayBatteries 09 00211 i007Batteries 09 00211 i008Batteries 09 00211 i004Batteries 09 00211 i004Batteries 09 00211 i009
Reaction time in sBatteries 09 00211 i006Batteries 09 00211 i004Batteries 09 00211 i006Batteries 09 00211 i004Batteries 09 00211 i005
ApplicationorientedCost in EUR/kWBatteries 09 00211 i007Batteries 09 00211 i007Batteries 09 00211 i009Batteries 09 00211 i005Batteries 09 00211 i007
Cost in EUR/kWhBatteries 09 00211 i008Batteries 09 00211 i005Batteries 09 00211 i005Batteries 09 00211 i005Batteries 09 00211 i007
Lifetime in cyclesBatteries 09 00211 i006Batteries 09 00211 i007Batteries 09 00211 i007Batteries 09 00211 i009Batteries 09 00211 i006
Shelf life in yearsBatteries 09 00211 i006Batteries 09 00211 i006Batteries 09 00211 i007Batteries 09 00211 i006Batteries 09 00211 i005
Design flexibilityBatteries 09 00211 i007Batteries 09 00211 i007Batteries 09 00211 i007Batteries 09 00211 i006Batteries 09 00211 i007
Ecologic impactBatteries 09 00211 i007Batteries 09 00211 i006Batteries 09 00211 i007Batteries 09 00211 i009Batteries 09 00211 i007
SafetyBatteries 09 00211 i007Batteries 09 00211 i006Batteries 09 00211 i006Batteries 09 00211 i009Batteries 09 00211 i007
Storage durationms-daysms-daysms-daysms-weeksmin-weeks
Hybrid influence:positive influenceno/medium influencenegative influence
Legend:Batteries 09 00211 i002 = negativeBatteries 09 00211 i003 = mediumBatteries 09 00211 i001 = positive
Batteries 09 00211 i002 + Batteries 09 00211 i002 = Batteries 09 00211 i002Batteries 09 00211 i002 + Batteries 09 00211 i003; Batteries 09 00211 i003 + Batteries 09 00211 i003 = Batteries 09 00211 i003Batteries 09 00211 i003 + Batteries 09 00211 i001; Batteries 09 00211 i001 + Batteries 09 00211 i001 = Batteries 09 00211 i001
Table 3. Comparison of different system architectures.
Table 3. Comparison of different system architectures.
Architecture Proposal
Design Parameterab c
Power converted by SCC (kW)2530 25
Power converted by BC (kW)55 30
Overall conversion power installed (kW)30c35 55
Voltage ratio SCCTBDHLL
Voltage ratio BCHLHH
Maximum power processed with low voltage ratio (kW)2553025
Minimum power processed with high voltage ratio (kW)530530
Table 5. Map of optimization parameters and EMS goals for the hybrid storage application categories (PC: Power Component; EC: Energy Component).
Table 5. Map of optimization parameters and EMS goals for the hybrid storage application categories (PC: Power Component; EC: Energy Component).
Application Voltage SupportDistribution Power QualityPeak ShavingEnergy Time Shifting
Hybrid ComponentPCPCPCPC/EC
Island gridsECImproving transient response, increase efficiency/performance and lifetime of the EC, grid (voltage) quality, supply security [63,64,65] Operational limits operation, self sufficiency, economic efficiency, efficiency, reduce energy costs [66,67]
Uninterruptible Power SupplyEC Utilization of UPS EC, economic efficiency, stability of power system [68]
Peak ShavingECMinimizing the power fluctuation, self-sufficiency, grid quality, optimizing the capacity ratio of EC, PC [69]Dimensioning, efficiency, economic efficiency, lifetime, smoothing the current of EC [70]
Energy time shiftingEC Dimensioning, efficiency, economic efficiency, lifetime, smoothing the fluctuation of RE [71]Self-sufficiency, reduce of max. power consumption/generation, utilization of RE, efficiency, dimensioning, lifetime [72]
Energy Trading/ArbitrageEC/PC Economic efficiency (operational costs), efficiency, reduce energy costs [73]
Table 6. Classification of predicted data.
Table 6. Classification of predicted data.
Predicted DataPrediction TechniquesEvaluation Metrics
Charging demand [80,81,82]CNN, LSTM, RNNMAPE, MAE, NRMSE
RE production [75,76,77,79]CNN, MILP, NN, RNN, ARIMA, GAN, MLP, LSTMMAPE, RMSE
ESS Capacity [78,79]MILP, MINLP, NNRMSE
Charging scheduling and pricing [83,84]MILP, RL, ANNN/S
Charging station placement [85,86]GA, RL, Linear Regression, Decision TreesN/S
N/S: Not specified.
Table 7. Classification of HESS studies.
Table 7. Classification of HESS studies.
PaperEnergy Storage SystemElectric TopologiesOptimizationGeneral Control TechniquesUsed Data
Optimization FunctionReal Time
[9](H 2 /Br 2 ) RFB, SCDC coupledPowerYesMathematical modelMicrogrids
[87]Battery, SCDC coupledPower allocation of different ESSYesClassical
Real-time optimization
Microgrids/Simulated
[4]Battery, SCDC coupledReduces measurement inaccuraciesN/SClassicalN/S
[8]VRFB, SCActive topologyCurrent, SoCNoClassical
Fuzzy logic
EV charging park/Real
[5]Li-Ion battery, SCDC coupledN/SN/SFuzzy logicShips
[88]VRFB, SCActive topologyPower thresholdsNoRule-basedIndustrial grid—Real/Synthetic
EV charging park
[63]Batteries, SCDC coupledConstant voltage to the DC busNoClassicalPV, AC- and DC Loads/Simulated
[89]Battery, SCDC coupledN/SN/SGlobal optimization
Real-time optimization
Electric vehicle
[90]Li-Ion battery, SCDC coupledMeet power demand
Reduce the cost of energy storage device
YesClassical
Real-time optimization
Ship load
[91]Battery, SCDC coupledPower allocationYesClassical
Rule-based
EV application
[64]Fuel cell, Battery, SCDC coupledProvide power for load in time
Good tracking performance of HESS current
Obtain a stable voltage of the dc bus
YesProjection operator adaptive lawN/S
[69]Battery, SCDC coupledMinimizing the power fluctuation
Optimizing the capacity ratio of each ESS
YesReal-time optimizationN/S
[92]Battery, SCN/SN/SYesRule-based
Global optimization
Real-time optimization
Electric vehicle
[93]battery, SCDC coupledPower
Charge/Discharge cycle
YesReal-time optimizationPV power generation
[67]Li-Ion battery, SCAC coupledOptimize the cycle life of the HESSYesMathematic modelMicrogrids
[72]Battery, SMESDC coupledControl charge/discharge
prioritization
NoClassicalOff-grid load profile/Simulated
Sea wave energy conversion/Simulated
[68]Battery, fuel cell,AC coupled, On gridPowerN/SN/SGrid data/Real
[94]Battery, SCThree-level NPC ConverterN/SN/SClassicalElectric vehicle
[71]Battery
Superconducting magnetic ESS
One DC/AC converter
Two DC/ DC converters
Smoothing the fluctuations of the wind power outputN/SDevice/system-level control strategiesWind power generation
[95]Battery, SCDC coupledN/SN/SRule-basedElectric vehicle
[73]Battery, fuel cell, electrolyzerDC coupled, On grid ACEnergy costs, powerN/SRule-basedPredicted daily data
[66]Fuel cell, battery, SCDC coupled, Off gridPowerYesReal-time optimizationGrid data/Real
[65]Battery, SCDC coupledN/SN/S Microgrid
[96]PbA and Li-Ion battery, SCThree different architecturesMaintain the grid power and voltageNoClassicalResidential load/Literature data
[97]battery, SCDC coupledCurrent, voltageYesReal-time optimizationN/S
[98]Fuel cell, SCDC convertersVoltageNoClassicalElectric vehicle/Simulated
[70]Battery, SMESDC coupled, On gridCurrentN/SN/SGrid data/Real
[99]Fuel cell, Battery, ElectrolyzerAC bus and DC bus consideredN/SYesReal-time optimizationResidential load
N/S: Not specified.
Table 8. A summary of the main real-time EMS control techniques.
Table 8. A summary of the main real-time EMS control techniques.
Real-Time
EMS Control Techniques
AdvantagesLimitations
Classical Filtration [91]
  • Widely adopted for real-time application
  • Highly computational efficiency
  • Straightforward
  • Complexity of designing filters
  • Requires an accurate mathematical model
  • Inefficient in reducing the peak power demand
IntelligentRule-basedFuzzy logic [88,91,92,95]
  • Simple implementation
  • Faster response
  • Efficient hybrid control strategy
  • High reliability
  • Low computational complexity
  • Rules are defined based on an expert of the domain
  • Real-time implementation is the control strategy
  • Sensitive to changes in system parameters and components
Real-time optimizationMPC [7,92,97]
  • Accurate real-time application
  • Prediction of application future behavior
  • Avoiding problems
  • High-scale application control
  • Easy incorporation of constraints
  • Require accurate mathematical model
  • Sensitive to model parameter variations
  • High computational complexity
NN [7,77]
  • Accurate real-time application
  • Low computational complexity
  • High speed to process results
  • Require lots of training data
  • The prediction accuracy depends on the data sample quality
RL [85]
  • Accurate real-time application
  • High control performance
  • It is data-hungry
  • It requires a lot of computation
PSO [69,89]
  • Accurate real-time application
  • Easy implementation
  • Limited number of parameters
  • High computational complexity
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Schubert, C.; Hassen, W.F.; Poisl, B.; Seitz, S.; Schubert, J.; Oyarbide Usabiaga, E.; Gaudo, P.M.; Pettinger, K.-H. Hybrid Energy Storage Systems Based on Redox-Flow Batteries: Recent Developments, Challenges, and Future Perspectives. Batteries 2023, 9, 211. https://doi.org/10.3390/batteries9040211

AMA Style

Schubert C, Hassen WF, Poisl B, Seitz S, Schubert J, Oyarbide Usabiaga E, Gaudo PM, Pettinger K-H. Hybrid Energy Storage Systems Based on Redox-Flow Batteries: Recent Developments, Challenges, and Future Perspectives. Batteries. 2023; 9(4):211. https://doi.org/10.3390/batteries9040211

Chicago/Turabian Style

Schubert, Christina, Wiem Fekih Hassen, Barbara Poisl, Stephanie Seitz, Jonathan Schubert, Estanis Oyarbide Usabiaga, Pilar Molina Gaudo, and Karl-Heinz Pettinger. 2023. "Hybrid Energy Storage Systems Based on Redox-Flow Batteries: Recent Developments, Challenges, and Future Perspectives" Batteries 9, no. 4: 211. https://doi.org/10.3390/batteries9040211

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop