1. Introduction
The global energy transition is driving an unprecedented transformation of electricity systems. The installation of using Renewable Energy Sources (RES) has dramatically increased due to the rapid reduction in both wind and solar technology prices along with established climate policy commitments, national energy security interests, and consistent technological innovation strategies. As a result, electricity grids are evolving from systems dominated by centrally dispatched synchronous generators toward architectures characterized by inverter-based generation, distributed energy resources, and increasingly complex operational and institutional requirements. This change results in different physical behaviors, control needs, and socio-technical context with respect to traditional power systems. While renewable energy technologies have matured rapidly at the component level, their large-scale integration poses challenges that extend well beyond generation adequacy. The variability of solar and wind electricity generation creates a challenge for the operation of a power system at many time scales due to erratic and uncertain generation patterns from both forecasting and normal operation. At very short time scales (i.e., on the order of seconds to minutes), inverter replacement of synchronous generators lowers the natural inertia and fault current of the power system, which changes how frequency and voltage are stabilized and creates a challenge for protection schemes designed for one-way power flow.
Additionally, unit commitment, economic dispatch and reserve provisioning are affected by forecasting error and variability over time spans of hours to seasons. At planning horizons spanning years to decades, the spatial distribution of renewable resources, together with the need for transmission reinforcement, energy storage deployment, and demand-side flexibility, gives rise to complex and interdependent infrastructure investment decisions. Addressing these challenges requires a shift from traditional integration paradigms toward coordinated portfolios of technologies, control strategies, and institutional arrangements. Power electronic converters are no longer passive interfaces but increasingly active participants in grid stability through grid-forming control, fast frequency response, and advanced voltage regulation. Energy storage systems, demand-side management, and flexible loads provide additional degrees of freedom for balancing supply and demand across multiple time scales. Concurrently, the development of high-voltage direct current (HVDC) transmission lines will assist with the efficient long-distance transfer of electricity generated from renewable resources, including offshore locations. New advanced digital technologies are also leading to real-time capabilities for monitoring, forecasting and optimizing an increasingly decentralized electrical system. Finally, there is an ever-increasing coupling of the electricity sector with the transport, heating and industrial sectors through electrification and the production of hydrogen, thereby changing the dynamics of our systems and significantly increasing the integration challenges. There has been increasing literature in the individual areas of integration of renewable energy such as forecasting schemes, control of inverters, storage technology, market dynamics, and regulation design. Nevertheless, most available research is limited to particular technologies, time scales or geographical areas and it is hard to obtain a comprehensive picture of how emerging electricity grids operate as complex socio-technical systems. The higher the renewable penetration, the more significant the interactions between technologies, control layers, and institutional structures are, and what is effective when implemented in isolation might not be effective once implemented at scale.
This makes a comprehensive synthesis bridging the technical, operational, and institutional dimensions of renewable energy integration necessary. Such a synthesis should clearly take into consideration the changing role of power electronics, the rise of converter-based power systems, integration of distributed and flexible resources, and the implications of grid codes, standards, and cybersecurity demands. It should also be able to rely on practical experience of implementation to supplement theoretical analysis and simulation-based research. This review will serve this purpose and offer a unified discussion of the renewable energy integration and control in emerging electricity grids. The article analyzes the enabling technologies and management approaches on the various levels, such as smart grid infrastructures, advanced forecasting and optimization, grid-forming inverter control, transmission expansion, pathways to sector coupling, and regulatory measures. Practical challenges and successful integration tactics are demonstrated with the help of real-world case studies, and the new research directions can be seen in converter-dominated system stability, mass-scale coordination of distributed resources, and long-term flexibility.
Several reviews have appeared in recent years on individual aspects of renewable energy integration—including power-electronic converter control, energy storage technologies, smart-grid digitalization, sector coupling, and AI applications. The contribution of the present work, with respect to this body of literature, lies in three converging directions. First, this review explicitly integrates the multiple timescales of integration challenges—sub-second dynamics, real-time control, and multi-year planning—into a unified analytical framework, with particular attention to cross-scale couplings that single-topic reviews tend to underemphasize. Second, it bridges technological analysis with the perspective of operational deployment by reporting concrete examples of AI- and digital-twin-based tools already in production at major transmission system operators. It further provides quantitative comparisons of emerging integration solutions—including grid-forming versus grid-following control across short-circuit-ratio regimes, alternative storage chemistries, and HVDC versus HVAC transmission corridors–based on recent field data and benchmarking studies, rather than relying solely on conceptual descriptions. Third, the review explicitly distinguishes between the brownfield context of advanced economies, characterized by retrofit constraints on legacy infrastructure, and the greenfield context of developing regions, where renewable-oriented architectures can be designed from the outset. The implications of this dichotomy for research and development priorities are systematically discussed in the concluding sections. The objective is to provide both a technically rigorous and pragmatically grounded reference for researchers, system operators, and policy designers engaged in the integration of high shares of renewable energy into electricity grids.
The remainder of the paper is organized as follows.
Section 2 outlines artificial intelligence, machine learning, and optimization methods that are applicable in the contemporary operation of the power system.
Section 3 and
Section 4 discuss the problems of renewable energy integration and smart grid technologies, respectively.
Section 5 addresses stability, power quality and protection in low-inertia and converter-dominated systems.
Section 6 examines management strategies, such as forecasting, demand-side flexibility, and vehicle-to-grid integration.
Section 7 examines the contribution of power electronics and power transmission technologies.
Section 8 and
Section 9 address standards, grid codes, and cybersecurity considerations.
Section 10 is a reflection on practical applications, and
Section 11 is on sector coupling and new technologies. Finally,
Section 12 summarizes key findings and outlines future research directions.
Figure 1 provides a visual roadmap of these thematic areas and their interconnections.
3. Renewable Energy Integration
As distributed energy resources and advanced control capabilities increasingly drive a fast transition from passive to active distribution systems, this change is often viewed as a paradigm shift in how the grid operates [
19]. Integrating renewable energy sources into the grid will thereby be seen as the ultimate goal of the energy transition while being the greatest challenge in doing so. In this section of the report, we will describe each of the principal renewable technologies (solar PV and wind) along with hybrid configurations (generation + storage) in terms of their technical characteristics, effects on the grid, and integration solutions. Finally, a review of the status of renewable deployment globally will be presented, highlighting regional variation, strategies that have helped lead to successful implementation of renewable projects, and lessons learned from the leading markets.
3.1. Solar Photovoltaic Integration
Solar photovoltaic systems have significantly dropped in price and expanded rapidly to become a form of energy production that is well-established. In many areas around the world, they are now cheaper than other new ways to produce electricity. However, there are a number of integration issues that exist that are unique to photovoltaics. These include variability caused by both weather and the sun’s position throughout the day, highly distributed deployment across millions of small-scale systems, as well as the use of power electronics such as inverters to connect them to the power grid, which introduce integration challenges fundamentally different from those associated with conventional synchronous generation. The increased use of solar photovoltaics has had an immediate impact on local distribution networks that were originally designed for one-way power flow from utility substations to end users. When the photovoltaic systems inject power into the local system, the flow of electricity will be in the opposite direction of what was initially intended, creating a potential for voltage rise on distribution feeders rather than voltage drops across distance from a substation. This is even more apparent in low-voltage networks characterized by high resistance-to-reactance ratios, where voltage magnitude is highly sensitive to real and reactive power injections. Simulations of actual residential distribution systems demonstrate that, as the percentage of photovoltaic generation connected to the network increases, there is an increased likelihood of exceeding voltage levels in violation of standards without an appropriate set of control techniques in place; hence causing operational and electrical service quality problems for consumers [
20]. Hosting capacity represents a systematic methodology for evaluating how much distributed generation can be integrated into an electric distribution system without exceeding operational constraints such as voltage thresholds, thermal ratings, and protection coordination. Hosting capacity studies have identified that allowable photovoltaic (PV) penetration on various distribution feeders differs significantly and is dependent primarily on feeder topology, electrical characteristics of the feeder, PV placement of the PV system, and the effects of diversity. Assessments have therefore demonstrated a need to utilize feeder-specific evaluations versus generic penetration limits for planning the integration of PV systems into the distribution system [
21]. Smart inverter technologies offer viable solutions for providing effective alternatives to upgrading costly infrastructure to manage voltage while also providing greater hosting capacities for PV systems in distribution networks. Newer inverters now have the capability to dynamically adjust real and reactive power output based upon local distribution system voltage measurements; therefore allowing for the use of control strategies in response to local voltage measurements that were not previously achievable with older grid-friendly inverter technology. The application of distributed Volt/VAr control in PV inverters has been demonstrated to effectively mitigate overvoltage conditions, as demonstrated by the ability to maintain voltage magnitudes within the acceptable range without any centralized coordination [
20]. Complementary strategies such as Volt/Watt control curtail real power output when voltage exceeds predefined thresholds, offering an additional mechanism to prevent violations when reactive power capability alone is insufficient. The optimization of inverter dispatch using network-wide approaches in addition to local control is shown to enhance performance further. Optimizing the real and reactive power injection of inverters across a feeder reduces distribution network losses while maintaining acceptable voltage profiles and, when compared to purely local control methods, results in better performing residential distribution systems [
22]. In distributed optimization architecture, inverters utilize local measurements and communicate only on a limited basis to provide results that closely resemble those provided by a centralized solution and therefore are more easily scalable and practical to deploy. Another key consideration of working with high levels of photovoltaic penetration is power quality outside of voltage magnitude in steady state conditions. Inverter-based resources are recognized as contributors to harmonic and supraharmonic distortion; while narrow prescriptions generally require that individual units meet applicable emissions standards, the collective operation of many units creates the potential for excessive levels of distortion, resonance interactions, and elevated levels of electromagnetic interference in distribution systems. The results of comprehensive reviews evaluating waveform distortion across the frequency spectrum from a few kHz to hundreds of kHz highlight the complexities associated with emission, propagation, and interaction mechanisms that occur with power electronic converters and establish the importance of proper modeling, measurement, and standardization methodologies to ensure that power quality remains acceptable with high levels of photovoltaic penetration [
23]. One of the main issues associated with protection coordination is the way that legacy protection systems are relying on high fault currents that are generated from synchronous machines to achieve rapid detection of faults. Conversely, inverter-based photovoltaic systems limit their contribution of fault current to values that are very close to their rated value (in order to protect the power electronics), which has the effect of decreasing the sensitivity of the relays that they are connected to and changing the direction of fault current in networks where power flow is bi-directional. Adaptive protection, that is designed to adjust settings as a function of network configuration and/or operating conditions is being explored as a possible solution; however, this will require improved communication systems and intelligent devices that are capable of providing protection. Another aspect of the protection challenge of photovoltaics that is specifically associated with distributed photovoltaic generation is the challenge of detecting islanding. When portions of a distribution network become electrically isolated from the main grid, inverter-based generators may continue energizing the islanded section, posing safety risks to personnel and equipment. As a result, grid codes require photovoltaic systems to detect an islanding condition and cease to supply energy to the islanded load within a specified time period. Passive detection techniques based on measuring the local voltage and frequency are very easy to implement, but can suffer from having detection zones that do not detect an island condition for specific conditions of balance between load and generation. Therefore, while active detection techniques perturb the output of the inverters, they serve to reduce the size of the non-detection zones. Active methods reduce these zones by intentionally perturbing inverter output, while hybrid approaches combine passive and active techniques to achieve reliable detection with minimal impact on power quality. The evolution of photovoltaic grid connection practice is reflected in international standards and grid codes. An example of this is the latest version of the IEEE 1547-2018, which provides requirements for both interconnection and interoperability of distributed energy sources, as well as advancing a number of inverter functionality features to enhance grid stability through ride-through voltage and frequency support, dynamic reactive power support, and frequency-watt control during a disturbance [
24]. Additionally, the IEC 61727 [
25] sets forth complementary international specifications regarding the limits for harmonics, anti-islanding system performance, and characteristics of interfaces associated with PV systems connected to low voltage and medium voltage networks. Harmonizing national regulations with these international standards will promote widespread deployment of technology with a consistent baseline for minimum performance and safety requirements.
3.2. Wind Energy Integration
Wind energy can present several different types of obstacles to integration when compared to solar photovoltaics. Both solar and wind have variability associated with weather impacting their production, and both rely on power electronic interfaces; however, the size of installations for wind energy generation is larger than that for solar energy generation. On average, wind generation occurs in individual installations that can be measured in megawatts (MW) on the order of magnitude range from 10 s of MW to 100 s of MW, at/through a single location. Hence, wind integration issues occur primarily at the transmission system level. As a result, wind integration challenges primarily manifest at the transmission system level, although wind farms connected to weak networks may also introduce local operational issues analogous to those observed in distribution systems with high photovoltaic penetration. Wind power forecasting has emerged as one of the most mature and operationally critical applications of data-driven methods for renewable integration. Due to the variability inherent to wind power generation, it will require accurate wind power forecasts at multiple time horizons (e.g., minutes for automatic generation control, and hours and days before unit commitment and reserve planning). LSTM-based recurrent neural network models applied to ultra-short-term wind forecasts have achieved significant improvements in accuracy compared to conventional statistical and traditional neural network methods. Notably, these improvements indicate that RNN architecture is well suited for identifying short-term temporal dependencies present in wind generation [
26]. Hybrid forecasting techniques that use both time-series decomposition techniques (like empirical mode decomposition) and machine-learning models together have provided greatly improved robustness when it comes to forecasting under non-stationary (variable) wind conditions. By decomposing the wind speed/time-power series into multiple components based on the temporal scale; each of these components is then modeled separately, which allows them to better identify the effects of different atmospheric phenomena, generally always from the very small-scale fluctuations caused by turbulence to the larger-scale fluctuations caused by synoptic weather systems. The results of case studies show that hybrid forecasting improves both forecasting performance and forecasting consistency compared to using a single direct forecasting model, particularly during transitions between regimes typically associated with wind energy generation [
27]. The benefits of more accurate wind forecasting extend beyond just more accurate forecasts; they extend to all system-level benefits. Having more reliable forecast information will allow system operators to operate generation resources/schedule generation resources more effectively. Additionally, it will reduce the reliance on conservatively maintained reserves to deal with variability and uncertainty arising from high levels of wind penetration. Also, it is anticipated that as the amount of wind integration increases, the level of operating and balancing cost will increase similarly. Thus indicating the importance of superior/advanced forecasting and control methods to help mitigate these issues [
28]. The interaction of wind generation and the dynamic behavior of power systems has implications for the frequency stability of power systems. With the replacement of traditional synchronous generating units with wind generation, system inertia as a whole has decreased resulting in higher rates of change of frequency after disturbances. Furthermore, modern wind turbine technology utilizes power electronics for advanced controls, which allows the rapid adjustment of active power output based on frequency deviations (synthetic inertia). Simulation modeling has demonstrated that wind turbine synthetic inertia can help to lower the initial rate of change of frequency and raise the frequency nadir, both of which can increase system security and provide additional time for primary frequency control actions to be accomplished [
29]. However, providing synthetic inertia through wind turbines requires using kinetic energy from the rotating blades, which creates tradeoffs regarding energy capture, mechanical loading, and availability of inertial response. Finally, at the wind farm level, there are additional optimization challenges and opportunities created through turbine-turbine aerodynamic interactions. For instance, turbine wake effects (when downstream turbines operate under disturbed airflow conditions as created by upstream turbines) can significantly decrease overall farm efficiency under certain wind conditions. The use of advanced wind farm control strategies that manage turbine-to-turbine interaction (such as active yaw scaling through intentional yaw misalignment) have demonstrated improved overall energy capture from the farm and reduced fatigue loading (on both upstream and downstream turbines). These approaches require accurate wake modeling and real-time adaptation to changing atmospheric conditions, reflecting the increasing sophistication of wind power plants as actively controlled, system-integrated resources rather than passive generators. Overall, the integration of wind energy into modern electricity grids increasingly relies on coordinated forecasting, control, and optimization strategies that operate across multiple temporal and spatial scales. Continued advances in data availability, modeling techniques, and control architectures are enabling wind power plants to contribute not only energy but also flexibility and ancillary services, supporting reliable operation of renewable-rich power systems.
3.3. Hybrid Systems and Energy Storage
The limitations and synergies between existing renewable energy technologies have increased the interest in hybrid systems of renewable generation coupled with energy storage. By colocating storage with renewable generation, hybrid systems can smooth out renewable power output, reduce curtailments of renewable energy, improve the utilization of grid connection assets, and provide additional grid services that are often difficult or impossible to deliver with only generating resources. Additionally, a major contributing factor for this transition toward hybrid systems is the dramatic fall in lithium-ion battery costs, approximately 85 to 90 percent between 2010 and 2023 [
30], which has made hybrid renewable energy generation plus storage commercially viable for an ever-growing number of applications. In the case of grid-connected prosumer and microgrid energy systems, the design of the storage system must account for a variety of operational limitations and objectives. Studies examining the integration of photovoltaic and battery systems have determined that optimal sizes and operations of these systems are heavily dependent on local load profiles and on local photovoltaic energy generation data, as well as on the limits associated with grid connections (e.g., injection limits) [
31]. In particular, stringent injection limits tend to shift optimal storage utilization toward maximizing on-site consumption rather than exporting energy to the grid, significantly influencing both battery sizing and operational strategies. Battery energy storage systems (BESS) have evolved from niche off-grid applications to mainstream grid-scale resources providing diverse services to consumers daily. Batteries have the ability to provide a wide range of services at the same time because of their fast response time, bidirectional power flow, modularity, and locational flexibility [
32]. Due to the large amount of investment in BESS, their most common use today for short-term and medium-term applications is by lithium ion batteries due to their efficiency and reliability for providing intra-day balancing of energy generation from solar (using the daily profile) (e.g., typically about two to four hours of use) [
33]. While performance metrics such as efficiency and cycle life depend on chemistry, depth of discharge, and operating conditions, continued technological improvements have significantly expanded the range of stationary storage use cases. Effective utilization of battery storage requires control and scheduling strategies capable of balancing multiple value streams while respecting operational constraints, including state-of-charge limits, power ratings, and degradation considerations. The framework above can be evaluated using a multi-objective optimization tool and proves that batteries may work effectively together in providing needed reliability to the electric grid, reducing the amount of peak load on electric grids and providing economic benefits to the grid operator. The major challenge for control systems is to develop control methods that manage trade-offs across conflicting objectives (in an uncertain environment) when using batteries and battery storage for applications that have varying renewable energy sources [
12]. In addition to using batteries, long-duration storage solutions are becoming a part of hybrid systems in order to allow for the variability of renewable energy sources over long periods of time, when electrochemical storage cannot provide a return on investment. Power-to-hydrogen pathways enable the conversion of surplus renewable electricity to hydrogen using electrolysis. This technology allows for the separation of power and energy storage capacities, essentially decoupling them from one another. Subsequently, hydrogen can provide for renewable electricity generation, be used as an energy source for industrial applications such as steel and ammonia production, or power heavy, long-haul transportation. However, the efficiency of electricity-to-hydrogen-to-electricity pathways is significantly lower than other technologies, typically around 30% round trip efficiency, primarily due to losses incurred during conversion and storage [
34]. Nevertheless, the lower cost of energy capacity makes hydrogen a potential energy storage solution for seasonal and long term needs within decarbonized electricity systems. Hybrid systems are also able to leverage innovative strategies for deploying energy storage. Mobile utility-scale battery energy storage systems, mounted on trailers or containerized platforms, offer flexibility by allowing storage assets to be temporarily deployed to locations experiencing network congestion, maintenance outages, or seasonal demand peaks [
35]. Although the operation of mobile energy storage systems is inherently more complex than that of stationary storage systems, mobile energy storage can provide deferred value to a grid operator if permanent upgrades to facilities are needed in the future, and help improve grid resiliency during emergency events. Vehicle-to-grid (V2G) technologies represent another emerging dimension of hybrid energy systems, enabling electric vehicles to act as distributed storage resources through bidirectional charging. V2G works by allowing EVs to serve the electricity grid as distributed storage resources, thus providing a two-way power flow via bi-directional EV charging. The magnitude of the aggregated storage potential of fleets of EVs can be quite significant, particularly in markets that have achieved high levels of EV adoption (i.e., 10–20% share or more), although realizing that potential will require overcoming many technical, economic, and behavioral barriers. For example, in order to achieve widespread V2G deployment, V2G stakeholder groups must work together to address the need for standardized communication protocols between EVs and electricity grids, manage the rate of battery degradation from vehicle use for the V2G application, and develop incentive mechanisms that fairly compensate vehicle owners while ensuring user convenience in their use of their EVs [
36]. Pilot deployments demonstrate technical feasibility, and the value proposition of vehicle-to-grid integration is expected to strengthen as electric vehicle penetration continues to grow. In general terms, hybrid renewable energy systems that are designed to integrate generation, storage, and advanced control strategies will play a key role in the design of modern electrical power systems. These systems combine complementary technologies that operate across a range of timeframes to provide increased flexibility, reliability, and economic efficiency, as well as facilitate the reliable operation of electrical grids when high amounts of variable renewable energy are being provided.
To summarize the main characteristics of renewable generation and hybrid systems,
Table 2 provides a comparative overview of technologies, their operational features, and integration challenges.
Beyond lithium-ion BESS and hydrogen, several alternative storage technologies are gaining attention as complements to or substitutes for the dominant lithium-ion chemistry, particularly for medium- and long-duration applications where the cost and cycle-life characteristics of Li-ion become less favorable [
38].
Vanadium redox flow batteries (VRFBs) decouple energy capacity from rated power: the rated power is determined by the active electrochemical cell area, while the energy capacity scales independently with the volume of the external electrolyte tanks. This architectural decoupling makes VRFBs particularly well suited to long-duration applications (typically 4–10 h and beyond), and supports cycle lives in excess of
charge–discharge cycles with limited capacity fade over a 15–20 year service horizon [
38]. Round-trip AC-to-AC efficiencies are typically reported in the range of 65–85%, with energy density (15–35 Wh/kg) substantially below that of Li-ion batteries—a fact that limits VRFB applicability where compactness is a primary requirement, but is largely irrelevant in stationary deployments. The principal commercial constraint remains the cost of vanadium and the capital cost of the membrane and stack, although recent VRFB market growth (estimated at compound annual growth rates above 15% to 2030) and ongoing research on alternative electrolyte chemistries are progressively addressing these issues.
Sodium–sulfur (NaS) batteries are high-temperature electrochemical devices in which molten sodium and molten sulfur electrodes operate at approximately 300–350 °C, separated by a beta-alumina solid electrolyte. NaS batteries achieve relatively high round-trip efficiencies (75–86%) and energy densities (typically 150–240 Wh/kg), with cycle lives in the range of 4500–7300 cycles and design lifetimes of 15–20 years [
38]. They have a substantial deployment record in stationary applications, with multi-MW installations operating worldwide for renewable firming, peak shaving, and ancillary services. The high operating temperature, however, requires continuous thermal management and imposes safety constraints that have historically conditioned the deployment of this technology, and the recent discontinuation of large-scale manufacturing by the principal supplier introduces additional uncertainty regarding its medium-term role in new projects.
Compressed air energy storage (CAES) is a mechanical storage technology in which off-peak electricity is used to compress air into an underground reservoir—typically a salt cavern—and the stored energy is recovered by expanding the compressed air through a turbine during discharge. Conventional diabatic CAES systems achieve round-trip efficiencies of 40–55% and require fossil-fuel combustion for reheating during expansion. Advanced adiabatic CAES (AA-CAES) and liquid air energy storage (LAES) variants under development aim to recover the heat of compression internally, eliminating fossil-fuel input and improving efficiency [
38]. CAES offers very long discharge durations (8–24 h and beyond), low self-discharge, and project lifetimes of up to several decades, but its deployment is constrained by the availability of suitable underground geology, which has so far limited large-scale commercial diffusion to the two long-standing plants in Huntorf (Germany) and McIntosh (USA).
Gravity energy storage (GES), in both its solid (S-GES) and pumped-piston (P-GES) variants, has recently re-emerged as a candidate for utility-scale applications. The principle exploits the conversion between electrical energy and gravitational potential energy by lifting and lowering a heavy mass—such as concrete blocks, mine cars, or weighted pistons—within a vertical structure. Reported round-trip efficiencies vary substantially across designs, with values in the 75–85% range claimed for the most mature systems, and field-pilot data from systems such as Gravitricity in the United Kingdom suggesting sub-second response times suitable for grid frequency support [
39]. The first commercial-scale solid gravity plant was commissioned in China in 2023 (Energy Vault, 25 MW/100 MWh), confirming the technical feasibility of the concept at relevant scale, although the long-term cost competitiveness against pumped hydroelectric storage and CAES still has to be demonstrated through extensive operational experience.
The four technologies discussed above complement the lithium-ion batteries and hydrogen pathways already introduced in this section. Each addresses a specific niche in terms of discharge duration, geographical adaptability, and capital cost trade-offs. Consequently, the optimal storage portfolio for a given high-renewable system is expected to combine multiple technologies rather than rely on a single dominant chemistry [
38].
Table 3 summarizes the principal characteristics of all storage technologies discussed in this section.
3.4. Global Status and Deployment
The installation of renewable energy has grown rapidly over the last 20 years, and this has been attributed to a combination of continuing government support, innovation in technology and decreasing costs for renewable energy solutions. It is important to understand where deployment is at as of this time period, along with the methods different markets have implemented for how they are going to integrate large-scale renewable energy, and the different approaches that are being taken by different regions around the world in order to understand what opportunities and challenges there are with respect to how the world is going to make room for integrating large amounts of renewable energy into their energy systems. China represents the world’s largest renewable energy market in absolute terms and illustrates the scale at which coordinated infrastructure and system planning can enable rapid transitions. Scenario-based analyses indicate that the combined optimization of photovoltaic and wind resource siting, ultra-high-voltage transmission expansion, energy storage deployment, and demand-side flexibility could increase annual renewable electricity generation from approximately 9 PWh to 15 PWh, while simultaneously reducing average carbon abatement costs from around 97 USD per tonne of CO
2 to single-digit values in highly optimized configurations [
41]. These results clearly demonstrate the economic and system-wide advantages of integrated system and infrastructure planning when it comes to the potential for creating very large amounts of renewable energy solutions, although it should be noted that these results are based solely on theoretical analyses and not on the actual physical performance of the respective systems. China’s latest growth pattern for installing new energy sources such as both wind and solar imply that it is possible to build out large amounts of renewable energy very quickly but also exposes integration challenges related to regional imbalances between resource-rich areas and major load centers, transmission congestion, and the need for continued market and regulatory reform. The German energy transition, or “Energiewende,” demonstrates how industrialized nations with rigorous standards of reliability and limited expansion of domestic transmission networks will integrate renewable energy sources into their electrical grid. Analyses of the transition to renewable resources in Germany find that inadequate expansion of transmission systems—especially to transport wind power generated in northern Germany to southern Germany where it is consumed—creates increasing levels of curtailment and underutilization of renewable resources [
42]. While storage and demand-side flexibility contribute to system balancing, the German experience demonstrates that transmission expansion remains a critical complement to generation growth, as temporal and spatial mismatches cannot be economically resolved through storage alone. This system design results in an effective mix of investment in transmission infrastructure, flexible demand-side response options, and standard storage to provide appropriate signals for operational and investment decisions for the delivery of renewable electricity. System-level analyses of the European power system similarly indicate that early and coordinated decarbonization strategies, integrating renewable deployment with transmission expansion and sector coupling, can significantly reduce long-term system costs compared to delayed or fragmented transitions [
43]. California offers a widely cited illustration of solar integration challenges in a large, complex power system. The state’s “duck curve” phenomenon—characterized by deep midday net-load minima followed by steep evening ramps on the order of tens of gigawatts over a few hours—has become emblematic of operational challenges at high solar penetration [
44].
More than a decade after its original characterization, the duck-curve phenomenon has not disappeared but has instead deepened. Continued solar capacity expansion has progressively shifted the CAISO spring net-load profile from the original “duck” shape towards an increasingly pronounced canyon-like configuration, with midday net load occasionally approaching values close to zero.
According to recent operational statistics, total CAISO curtailment of utility-scale wind and solar generation reached 3.4 million MWh in 2024, representing a 29% increase over 2023. Over the same period, battery storage capacity in the CAISO footprint expanded from 8.0 GW at the end of 2023 to 11.6 GW at the end of 2024 [
45].
The rapid build-up of battery capacity has begun to reshape the evening ramp by displacing gas-fired peaking generation and by storing midday solar surpluses for evening discharge. However, curtailment levels during periods of low spring demand have continued to increase in absolute terms. Comparable patterns are now emerging in other systems with high solar penetration, notably in ERCOT (Texas).
The duck curve therefore illustrates not a transient phenomenon that has been resolved, but rather a structural reconfiguration of net-load profiles that continues to evolve as renewable penetration increases and as flexibility resources progressively absorb the resulting variability.
This net-load shape reflects periods of substantial solar overgeneration during daylight hours and rapid increases in conventional generation requirements during the evening. In response to these challenges, California has taken a coordinated approach, which includes large-scale deployment of batteries, encouraging demand response through time-based pricing, and changes to the market rules to better value flexibility of the system, etc. These efforts demonstrate that managing renewable energy penetration at high levels will require a holistic approach to integrating generation, energy storage, demand response, transmission, and market design, rather than relying on one technology alone. Across these diverse regional experiences, several common lessons emerge.
Transmission infrastructure consistently appears as either a key enabler or a binding constraint for renewable integration, with inadequate capacity leading to curtailment and inefficient resource utilization.
Effective integration requires the coordination of multiple time frames (real-time balancing to long-term investment planning), and requires institutional frameworks that align incentives and provide for information sharing;
No single technology provides a universal solution; rather, the most effective strategy appears to be the development of portfolios of complementary strategies for integrating renewables, including: forecasting, flexible generation, storage, demand response, transmission, and market mechanisms.
A stable policy and/or long-term commitment is critical to attracting private investment in renewable development as well as in the complementary infrastructure and system capabilities that allow an electrical system to operate reliably with a high penetration of renewable resources.
Figure 2 illustrates the characteristic California duck curve in the net load profile. The curve shows a pronounced midday minimum of approximately 13–14.5 GW, driven by high solar photovoltaic generation during peak daylight hours. As solar output rapidly declines in the late afternoon while electricity demand increases, the system experiences a steep evening ramp of about 13 GW over roughly three hours. The characteristics of this duck curve demonstrate two principal concerns for power system operators:
Therefore, the duck curve highlights the importance of developing a more flexible system to provide the necessary resources to meet these challenges, including fast-ramping resources, energy storage, demand-side response, and improved system coordination.
The global picture outlined above masks a fundamental dichotomy that strongly conditions the deployment of renewable energy technologies and the design of integration strategies. On the one hand, advanced economies operate predominantly brownfield power systems—long-established meshed networks designed around centralized synchronous generation—in which the integration of renewables is largely a problem of retrofit, involving the accommodation of new technologies on legacy infrastructure and the progressive replacement or repurposing of existing assets.
On the other hand, several emerging economies—most notably across sub-Saharan Africa, where approximately 750 million people still lacked access to electricity in 2023 [
46]—face a substantially different challenge, in which large portions of the network are effectively greenfield, either to be built from scratch or to be re-architected as electrification progresses. The technical, economic, and institutional priorities, the typical timescales, and the relative balance between decentralized and centralized solutions differ significantly between these two settings, as discussed in detail in
Section 12.
9. Cybersecurity and Privacy
The increasing digitalization and interconnection of power systems expands the attack surface for cyber threats, with potential consequences including disruption of grid reliability, manipulation of market operations, and exposure of sensitive customer data. This section explores the evolving cyber threat landscape for power systems, defense mechanisms currently being deployed to protect against cyber attacks, privacy considerations for customer data, and the emerging threat of quantum computing to cryptographic security.
The cybersecurity considerations discussed in this section are not abstract; they apply directly to the communication infrastructures introduced earlier in this review—including the advanced metering infrastructure (AMI) discussed in
Section 4.1, the IEC 61850-based substation and field communications outlined in
Section 8, and the EMS, SCADA, and digital-twin platforms presented in
Section 4.5—each of which exposes a distinct attack surface that must be properly characterized and protected. The threats addressed below should therefore be understood as a cross-cutting layer that permeates the entire smart-grid stack, rather than as an isolated topic. Accordingly, effective mitigation strategies must span device-level, protocol-level, and system-architecture-level countermeasures.
Power systems face different cyber threats from nation-state actors who try to disrupt essential infrastructure and from financial criminals who aim to breach market operations and steal customer information. The 2015 cyber attack on Ukraine’s power grid which caused outages that affected 225,000 customers for several hours proved that attackers can disrupt grid control systems through planned simultaneous operations [
77]. Mo and colleagues [
77] documented that cyber–physical attacks which use the interaction between information systems and physical systems lead to cascading failures whose effects surpass those of infected computer systems. Modern power systems have a wide attack surface that includes all their essential components from generation control systems to customer-facing applications. Each security component requires specific protective measures to defend its unique security flaws. The rising connection between operational technology networks that manage physical operations and information technology networks that enable business operations creates security risks because attackers can use weaker protected IT systems to access vital OT systems. The comprehensive analysis of cyber-attacks against smart grids according to reference [
78] has identified three distinct threat types which include denial-of-service attacks that create communication channel and computing resource overloads and data integrity attacks that disrupt measurement and control signal operations and false data injection attacks which use state estimation to hide actual system conditions. The sophistication of attacks continues to increase, with advanced persistent threats employing multi-stage campaigns that establish footholds, escalate privileges, and achieve objectives over extended periods while evading detection. Cyber–physical power systems use defense measures that operate through multiple security layers to prevent attacks while their systems detect threats and take action against them. The network segmentation method protects essential control systems through its design which separates them from networks showing lower trust security levels, thereby reducing the ability of attackers who succeed in breaking perimeter security systems to conduct lateral attacks. The system uses intrusion detection systems to watch network traffic and track system performance, which helps identify security breaches through detection of abnormal patterns, but the system faces challenges because signature-based systems generate many false alarms and attackers create their techniques to imitate normal operations. Cyber–physical security research testbed facilities provide researchers with safe environments to study attack scenarios without endangering actual infrastructure according to reference [
79]. The testbeds established by Hahn et al. [
79] according to their analysis combine operational power system equipment with highly accurate simulators and network infrastructure elements to create a testing environment which enables testing of attack scenarios and security countermeasures. Testbed research generates insights which utilities use to develop new technologies and improve their operational procedures. The systems which handle authentication together with access control procedures establish boundaries which protect control systems and confidential information from access by unauthorized users and systems. Multi-factor authentication which combines passwords with tokens and biometrics delivers better security than using passwords by itself. The system employs role-based access control to restrict user access rights which enables users to perform their job duties while safeguarding the organization from insider threats and reducing the damage potential from stolen credentials. The upcoming development of quantum computers which will break current public key cryptography systems represents a long-term security threat to grid infrastructure. Mosca [
80] demonstrated through his analysis that Shor’s algorithm can factor large numbers and solve discrete logarithm problems at polynomial speed on quantum computers which possess sufficient processing power, thus rendering RSA and elliptic curve cryptography vulnerable to attack. While practical quantum computers with this capability may be a decade or more away, the long operational lifetime of power system equipment and the need for security to persist for years or decades creates urgency for post-quantum cryptography deployment. The recent developments in post-quantum cryptography have proven it can be implemented effectively into smart grids, however, it has also exposed many of the challenges associated with that implementation. Lattice-based, code-based, and hash-based cryptographic algorithms can all resist current known quantum attacks [
17]. Quantum-resistant hybrid encryption algorithms for IoT applications provide high levels of security but at the cost of additional processing overhead which, while manageable for the majority of applications, could create problems for resource-constrained devices like smart meters and distribution automation devices. The NIST post-quantum cryptography standardization process is identifying algorithms suitable for standardization and deployment. The selected algorithms provide security protection while maintaining operational efficiency and installation difficulty across all application areas. The transition from existing systems to post-quantum cryptography needs detailed planning to maintain secure operations throughout the entire migration period.
10. Case Studies and Real-World Implementations
The real-world implementation of technologies to integrate renewable energy sources reveals important insights into the performance of those technologies; they also give us a better understanding of how economically viable an approach to using these sources of energy may be and will show us what types of institutional challenges exist in achieving this type of energy integration. The experiences from using renewable energy have yielded case studies that show how integration challenges occur, how various options interact when deployed at scale, and which combinations of technologies and/or policies have been successful in real-world environments. Germany’s Energiewende is one of the most researched models for national transitions to renewable energy. In their model-based analysis of Germany’s transition, Zerrahn and Schill [
42] find that insufficient reinforcements to the transmission system result in increased curtailing of renewable energy and less use of wind power due to the inability to send power from resource-rich areas in the north of Germany to the demand centers in southern Germany. The German experience indicates that storage cannot solve the issue of integrating renewable energy in a cost-effective manner when dealing with both temporal and geographical mismatches between production and consumption of electricity. Instead, least-cost integration strategies consistently favor a portfolio approach combining transmission expansion, storage deployment, demand-side flexibility, and market-based coordination mechanisms. California provides a widely cited example of operational challenges associated with high solar photovoltaic penetration through the so-called “duck curve”. Denholm et al. [
44] conducted detailed production cost modeling which showed that increased solar deployment results in net load drops during midday hours. The study emphasizes that the duck curve is primarily an illustrative diagnostic rather than a direct measure of curtailment, and shows that curtailment outcomes depend strongly on operational assumptions, minimum generation constraints, transmission limits, and available flexibility resources. Importantly, the analysis demonstrates that coordinated deployment of multiple flexibility options—including storage, demand response, export capability, and enhanced operational practices—can substantially reduce overgeneration and enable higher solar penetration without compromising system reliability. China’s rapid renewable energy expansion illustrates both the potential scale of deployment and the integration challenges that arise when capacity additions outpace grid development. Scenario-based analysis by Wang et al. [
41] shows that coordinated optimization of wind and solar deployment with ultra-high-voltage transmission infrastructure could substantially increase renewable electricity production while reducing system-level decarbonization costs. The field experience from initial project implementation periods shows that regions with low transmission capacity and operational inflexibility will experience high rates of renewable energy curtailment. The solution to the problems required subsequent funding for transmission upgrades and better dispatch coordination and market changes. High-voltage direct current (HVDC) transmission projects connecting remote renewable resources to load centers demonstrate the technical maturity of long-distance power transfer solutions. The HVDC literature [
71] shows that operational HVDC corridors function as effective power systems which allow remote areas with concentrated renewable energy resources to operate at full capacity while maintaining power system stability and required reactive power for long-distance AC transmission. Power electronics-based transmission systems have been proven through both onshore ultra-high-voltage DC links and offshore HVDC wind power connections to function as essential components which enable the large-scale incorporation of renewable energy sources into electrical grids. Microgrid deployments in regions exposed to extreme weather events provide valuable evidence of resilience benefits from distributed renewable generation and storage. Real-world microgrid projects [
50] have many instances of where systems supplying critical loads have continued to operate during extended outages of the main grid for many hours to days depending on available generation resources and storage capacity, and load prioritization strategies. The experiences gained from these projects demonstrate the ability of microgrids to be not only platforms for integrating renewable resources but also tools for enhancing resiliency and preparedness for emergencies. Across these diverse case studies, several common lessons emerge. First of all, integration challenges are geographically specific—dependent upon things like the mix of resources, network topology, operational practices and the regulatory context. Secondly, there is no one technology that serves as a universal solution; rather successful integration encompasses coordinated groups of transmission, storage, flexible demand, advanced controls, and market mechanisms. Thirdly, early identification of constraints to integration and proactive planning for infrastructure will dramatically reduce long-term costs and risk of curtailment. Finally, real-world experience shows that having an appropriate institutional framework in place will support the translation of technological capabilities into reliable and economically efficient operations for systems.
The case studies discussed above offer valuable empirical insights; however, their direct transferability to other jurisdictions should not be assumed. Each example reflects a specific combination of resource endowment, market structure, regulatory tradition, public-acceptance baseline, and capital-cost environment which, taken together, determine the technical and economic feasibility of the adopted integration strategy.
Solutions that have proven cost-effective in advanced economies—characterized by mature wholesale markets, well-developed transmission networks, and access to low-cost capital—such as the German Energiewende’s reliance on extensive cross-border interconnection, or Australia’s deployment of large-scale BESS in a system with high penetration of distributed solar generation, may exhibit substantially different cost–benefit ratios when applied to systems with weaker grid infrastructure, smaller market size, or higher financing costs.
The reported levelized costs of integration measures, residual curtailment levels, and ancillary-service procurement strategies described in the literature for these reference systems should therefore be interpreted as boundary references rather than universally applicable benchmarks. Meaningful adaptation of these solutions to other jurisdictions requires explicit consideration of local resource profiles, the maturity of the regulatory framework, the effective cost of capital faced by project developers, and the institutional capacity to operate increasingly complex integrated systems—all of which can vary by an order of magnitude across the range of contexts addressed in this review.
11. Sector Coupling and Emerging Technologies
Decarbonizing our energy systems isn’t limited to generating electricity. It also includes transportation, heating, industry, and all other industries that have used fossil fuels for energy in the past. One way to achieve greater decarbonization is by coupling different sectors’ energy systems together; this includes electrifying or creating electric power in ways that integrate with other types of energy systems such as hydrogen production, thermal storage, and coordinating digitally. By coupling these different forms of energy systems together, we can create more opportunities for decarbonization, while adding more flexibility to our systems. In this section, we will discuss some of the technologies and infrastructures expected to drive the next wave of energy transition.
11.1. Hydrogen Production and Integration
Hydrogen systems offer multiple pathways for decarbonization, including long-duration energy storage, fuel substitution in hard-to-electrify sectors, and utilization of renewable electricity that would otherwise be curtailed. Comprehensive reviews of hydrogen energy systems [
37] document all technology options which include electrolysis and reforming for production and compressed hydrogen and liquefied hydrogen for storage and pipelines and transport for distribution and fuel cells and combustion and industrial feedstocks for end-use applications. Electricity-to-hydrogen-to-electricity pathways exhibit substantially lower round-trip efficiencies than electrochemical battery storage, typically on the order of 30–40% when accounting for losses in electrolysis, compression, storage, and re-electrification [
34,
37]. Hydrogen remains a preferred solution for long-duration and seasonal storage applications because it provides low energy capacity costs and functions to separate energy storage capacity from power capacity requirements. The process of renewable-powered electrolysis for green hydrogen production creates a flexible electrical load which enables the accumulation of surplus renewable generation to produce storable and transportable energy carriers. The system complexity of integrating photovoltaics and electrolyzers and compressors and hydrogen storage systems necessitates advanced monitoring and fault detection system development to ensure the secure and dependable operation of commercial-scale hydrogen installations [
81]. Hydrogen serves as an essential industrial feedstock which extends beyond energy storage because it fulfills traditional steelmaking and ammonia synthesis and chemical manufacturing needs which will probably surpass power-sector requirements in future demand. Value-chain optimization studies combining hydrogen production with carbon capture and utilization highlight strong interdependencies across sectors and underscore the importance of coordinated planning for cost-effective decarbonization [
34].
The technical and economic viability of green hydrogen at the scales required for deep decarbonization remains subject to significant uncertainty and should not be taken for granted at this stage. Current production costs for green hydrogen via water electrolysis fall in the range of approximately 3.8–11.9 USD/kg H
2, well above the 1.5–3.0 USD/kg of natural-gas-derived hydrogen with carbon capture and the 1–2 USD/kg of unabated grey hydrogen [
82].
The IEA Net Zero Emissions Scenario projects the cost of low-emissions hydrogen production from renewable electricity to decrease to approximately 2–9 USD/kg by 2030—roughly half of present values—but this projection is conditional on the realization of the required deployment trajectory, which in turn depends on substantial policy support and demand-side commitments that, as of 2024, lag behind the announced supply-side targets [
82].
Beyond the levelized cost of hydrogen production, the role of hydrogen as a long-duration storage medium in the power sector is further constrained by the relatively low round-trip electricity-to-electricity efficiency of approximately 30–45% achievable with current electrolysis–storage–fuel cell or electrolysis–storage–turbine chains. Additional infrastructure requirements—including high-pressure or geological storage, dedicated pipelines, and refueling networks—represent further barriers, as they lack direct analogues in incumbent fossil-fuel value chains.
Material constraints also represent a critical limitation. In particular, the availability of platinum-group metals such as iridium, required for proton-exchange-membrane (PEM) electrolysers, poses a significant supply-chain risk, as projected demand under 2030 deployment scenarios exceeds current production by orders of magnitude. These constraints have not yet been fully mitigated by ongoing research and development efforts.
For these reasons, hydrogen is best understood as a complementary pathway to direct electrification rather than a universal substitute. Its strongest near-term value proposition lies in hard-to-electrify industrial processes—such as steel production, ammonia synthesis, and refining—as well as in long-distance transport modes for which direct electrification is technically impractical. In the power sector, its role is likely to remain limited to seasonal balancing and to specific niche applications where its complementarity with other flexibility options can be demonstrated on a case-by-case basis [
46,
82].
11.2. Carbon Capture and Utilization
The deployment of renewable energy is enhanced with the use of carbon capture, utilization and storage (CCUS) technologies because they will allow emissions to be reduced from existing fossil fuel and industrial infrastructure. Reviews of CCS development and deployment [
83] trace the evolution of capture technologies from early industrial applications to large-scale demonstration projects. Technology readiness assessments and facility databases [
84] document operational experience across post-combustion, pre-combustion, and oxy-fuel capture approaches. The primary barrier to implementing CCUS is the energy penalty from carbon capture processes (ranging typically from 15% to 30% of the electric generation of a typical power plant, based on the carbon capture technology applied and on the conditions under which each technology operates) [
83,
84]. The energy penalty creates a trade-off between generation efficiency and reducing greenhouse gas emissions requiring the optimization of CCUS development, deployment, and operation from a systems perspective. The integration of CCS with hydrogen production or Bioenergy with CCS (BECCS) will create potential opportunities for achieving low or potentially net-negative carbon emissions. Achieving low or potentially net-negative emissions may be essential to satisfying increasingly stringent climate change objectives.
Carbon capture and storage (CCS) technologies face a comparable, and in several respects more severe, viability gap. As of 2024, global commercial CCS capacity stands at approximately 50 MtCO
2/year, compared to an IEA Net Zero Emissions target of approximately 1.2 GtCO
2/year by 2030—a deployment gap of roughly twenty-four-fold over the next half-decade [
46].
Capture costs in the power sector remain in the range of approximately 50–120 USD/tCO
2 for post-combustion retrofit configurations on coal- and gas-fired plants. Detailed engineering studies for natural-gas combined-cycle retrofits indicate costs of approximately 86–132 USD/tCO
2, depending on natural gas prices [
46]. These figures are substantially higher than the carbon prices currently observed in major emission trading systems and exceed the value of the most generous deployment-stage subsidies available in advanced economies. As a consequence, CCS retrofits to power-generation assets generally do not achieve economic viability in the absence of tailored policy support.
The most recent IEA scenarios reflect this difficulty by progressively reducing the projected contribution of CCUS to global decarbonization. In the World Energy Outlook 2024, CCUS accounts for less than 5% of total emission reductions by 2050 in the Net Zero Emissions Scenario [
46].
From the perspective of this review, CCS is therefore best understood as a candidate technology for residual decarbonization in industrial sectors with concentrated CO2 streams—such as cement, ammonia, steel, and ethanol production—and as a contributor to the abatement of legacy fossil-fired generation in jurisdictions where retirement is institutionally or socially constrained, rather than as a primary pathway for power-sector decarbonization in systems where renewable-based alternatives are cost-competitive.
The framing of hydrogen and CCS as components of long-term flexibility in this review should therefore be interpreted in a conditional sense: each can play a meaningful role within an integrated decarbonization portfolio, but neither resolves, in isolation, the technical and economic challenges of deep decarbonization at the timescales typically considered in policy roadmaps.
11.3. Resource Constraints and Sustainability
When implementing large-scale deployment of renewable energy technologies, questions arise about resource availability, land use, and long-term sustainability. Energy return on investment (EROI) analyses offer a methodology to assess the gross energy potential and the net energy that will be available to society after accounting for the inputs (energy) required to deploy and operate the technologies. Using a multi-constraint grid-cell methodology that explicitly accounts for land availability, conversion efficiency, and minimum EROI requirements, Dupont et al. estimate a global net solar energy potential spanning a wide range, from approximately 165 to 1089 EJ yr
−1, depending on the assumed minimum EROI threshold [
85]. These scenario-based results emphasize that while solar energy is abundant in principle, the fraction that can be sustainably harvested at acceptable net-energy returns is highly dependent on technological assumptions, spatial constraints, and societal energy requirements. Learning-curve analyses indicate that renewable technologies will continue to see cost reductions; however, uncertainties related to material availability, manufacturing scalability, and evolving policy environments may constrain the pace of deployment [
86].
11.4. Policy and Innovation Dynamics
The regulatory structure and improvement drive contribute importantly to the rate and direction of the energy transition. Empirical analyses of renewable energy policy design and innovation outcomes in emerging economies [
87] highlight the importance of stable policy signals, technology transfer mechanisms, and capacity-building programs for enabling sustained deployment and domestic industrial development. Digitization also provides ways of creating new market structures and ways for consumers to participate in these markets. The convergence of blockchain technology and artificial intelligence may enable increased prosumer participation and the development of decentralized energy markets [
13]. By offering a transparent and tamper-resistant means of recording peer-to-peer energy transactions, distributed ledger technology can be used to establish a database for managing energy transactions among peers. AI algorithms will provide tools for optimizing decision-making (both individual and collective) within these decentralized energy markets. Both of these technologies may provide a basis for developing new organizations and business models that complement traditional utility-focused models, assuming regulation evolves to create and maintain system reliability, protect consumers, and allocate costs equitably.
12. Conclusions and Future Directions
The transition toward electricity systems dominated by renewable energy sources represents one of the most profound technical, economic, and institutional transformations in the history of power systems. This review has consolidated existing research across the essential components of the energy transition, including smart enabling technologies, system stability and protection, operational management strategies, sector coupling pathways, regulatory frameworks, cybersecurity concerns, and practical implementation experiences. Taken together, these perspectives highlight both the substantial progress achieved to date and the increasing complexity associated with high penetrations of variable renewable energy sources. The technical integration of solar and wind power on a large scale has fundamentally changed how the power system behaves on many different time scales. The displacement of synchronous generators by inverter-based resources reduces natural inertia and accelerates frequency dynamics, with characteristic response times shifting from several seconds toward sub-second regimes in converter-dominated systems [
56,
57]. Simulation-based and analytical studies indicate that such reductions in inertia can lead to significantly higher rates of change of frequency and deeper frequency nadirs under severe contingencies, in some cases amounting to degradations on the order of several tens of percent in extreme low-inertia scenarios [
56,
57]. The ongoing developments concerning grid-forming inverter control, synthetic inertia related to wind plants, and fast frequency response from battery energy storage systems have shown the potential to partially mitigate these effects, by reducing RoCoF and improving frequency nadirs from realistic disturbances, though the degree of benefit realized still highly depends on both system configuration and assumptions regarding controls [
29,
58]. Renewable energy sources, such as wind and solar, face challenges from their natural variability and uncertainty in predicting when they will generate electricity over the course of the daily operational cycle. Thus, we will need to implement progressively more complex mechanisms for forecasting, optimizing, and coordinating these resources as time moves forward into the future. For instance, machine learning (ML) and deep learning techniques used in actual applications have demonstrated the ability to reduce short-term load and renewable forecasts by about 15 percent to 30 percent when compared to traditional statistical forecasting methods [
1,
6]. The dataset and system characteristics determine which improvements will occur but the results show how data-driven forecasting methods can decrease balancing needs while improving system efficiency for power grids that use more renewable energy sources. Demand-side management and load flexibility further contribute to operational resilience, with empirical studies indicating that demand response programs can unlock flexibility potentials corresponding to roughly 10–20% of peak load in mature systems, while observed peak demand reductions on the order of 5–15% have been achieved under time-of-use pricing and advanced metering deployments in representative settings [
52]. At planning time scales, experience across multiple regions confirms the central role of transmission infrastructure as both an enabler and a potential bottleneck for renewable integration. The direct transmission enhancement requirements from Germany’s Energiewende show that the country must increase its transmission capacity to stop renewable power generation from being curtailed beyond 5% of wind potential during certain years and regions because this problem creates financial losses and results in the waste of free energy resources [
42]. In California, production cost studies have documented the characteristic “duck curve” behavior associated with high solar penetration, including midday net-load minima on the order of 13–15 GW and steep evening ramping requirements of comparable magnitude over time windows of a few hours [
44]. The individual examples of the California production-cost studies and the German renewable curtailment highlight the need to employ coordinated sets of flexible resources, including storage, demand response, and improved transmission capacity, to address operational challenges presented by concentrated photovoltaic installations. The economic dimension of renewable integration extends well beyond the levelized cost of electricity generation. The rising integration costs, which stem from renewable energy sources, result from increased system needs to manage unpredictable energy production and network capacity limitations. The integration cost framework proposed in the literature decomposes these effects into profile, balancing, and grid-related components, with review studies indicating that profile-related effects often dominate at higher penetration levels, while balancing and grid-related costs typically remain in the single- to double-digit €/MWh range in many systems [
88]. Importantly, the magnitude and relative importance of these cost components remain highly system-specific and depend strongly on assumptions regarding system adaptation, flexibility options, and market design.
Figure 4 summarizes the essential elements of the relationship by showing how various parts of integration costs—profile effects and balancing needs and grid-related expenses—become more significant when renewable energy sources reach higher levels of usage. Rather than representing quantitative results for a specific power system, the figure highlights qualitative trends consistent with the integration cost framework discussed in the literature [
88], emphasizing the diminishing effectiveness of incremental renewable additions in the absence of complementary investments in flexibility, infrastructure, and coordinated system planning. Outside of the power sector, the review emphasizes how growing the role of sector coupling is an essential pathway to achieve deeper levels of decarbonization. Power-to-hydrogen systems, electrification of transport and electrification of industrial processes all offer new ways to utilize excess renewable generation while providing flexibility over longer periods of time. Although converting electricity to hydrogen then back into electricity typically exhibits relatively low round-trip efficiencies (around 30–40%), they can be attractive solutions for seasonal energy storage as well as decarbonizing different sectors because of their low cost for energy, high capacity, and many uses across all types of end-users/sectors [
34,
37]. The success of transition processes depends on institutional and regulatory frameworks which serve as essential success factors. The grid codes and technical standards have been updated to mandate inverter-based resources to deliver grid-supporting functions which were previously provided by synchronous generators through voltage regulation and frequency support and fault ride-through capability [
24,
25]. System operators need to change their market designs so they can properly assess the value of system flexibility and location-specific grid services and fast-responding resources needed in systems which depend heavily on variable generation. The cybersecurity requirements of this environment become more complex because the rise of digital technologies increases attack vulnerabilities which affect generation facilities and network systems and market distribution systems and operational cybersecurity breaches have shown that cyber–physical attacks create essential service outages when organizations fail to execute effective countermeasures [
77]. The future research initiatives need to address three different fields which are technical aspects, operational practices, and institutional structures. The main research priorities need to develop advanced forecasting techniques which include probabilistic and ensemble methods, next-generation energy storage technologies beyond lithium-ion batteries, robust grid-forming control strategies for fully converter-dominated systems, and improved modeling tools capable of capturing interactions across multiple time scales. At the same time, continued investigation of market design, regulatory alignment, and sector coupling mechanisms will be essential to translate technological capability into reliable, economically efficient, and socially acceptable power system operation. Key research gaps identified through this review include: (i) the lack of validated frameworks for stability assessment in fully converter-dominated systems operating without synchronous generation; (ii) insufficient understanding of the interactions between grid-forming and grid-following inverters at high penetration levels; (iii) the need for scalable coordination mechanisms for millions of distributed energy resources; (iv) immature market designs that fail to adequately value flexibility, location, and fast response; and (v) the absence of standardized approaches for managing cybersecurity risks across increasingly interconnected and digitalized grid architectures.
Among the longer-term avenues for AI-enabled grid operation, large language models (LLMs) have begun to receive attention from transmission system operators and research groups. Early applications include operator decision support, on-line analysis of technical documentation, news-monitoring assistants for situational awareness, and conversational interfaces to historical SCADA data. The integration of LLMs into the safety-critical context of grid operations, however, raises non-trivial issues related to auditability, traceability, hallucination control, and alignment with strict reliability-certification frameworks. These challenges are likely to delay the deployment of LLM-based agents in time-critical control loops, even as their use in advisory and back-office workflows continues to expand. Their incorporation into the future digital ecosystem of power systems therefore appears more plausible as a complement to established physics-based and statistical-learning tools, rather than as a replacement. In this sense, LLM-based approaches can be understood as a natural extension of the AI deployments already discussed in
Section 2.1.
Achieving the next phase of the energy transition will require closer coordination between researchers, industry, and policymakers—particularly in developing integrated planning frameworks, adaptive regulatory mechanisms, and cross-sectoral flexibility solutions that match the pace and complexity of the technological transformation. Overall, the synthesis presented in this review shows that renewable energy integration creates significant technical and economic obstacles which can be overcome through advanced smart technologies and infrastructure development and institutional reforms.
Table 9 provides a synthetic mapping between timescales, operational challenges, and corresponding technological solutions for renewable-based power systems.
To create a reliable sustainable electricity system which depends on renewable energy sources we need to shift our focus from optimizing individual components to understanding how all elements of generation, networks, storage, demand-side resources, and market mechanisms function together.
A further consideration that conditions the practical interpretation of these research priorities is the marked dichotomy between brownfield and greenfield contexts of renewable energy integration. In advanced economies—where transmission and distribution networks were built around large synchronous generators over the course of the twentieth century—the dominant challenge is to retrofit a mature, capital-intensive infrastructure to accommodate increasing shares of inverter-based generation, declining system inertia, and active prosumers. In this brownfield setting, the technical priorities discussed throughout this review (grid-forming inverter deployment, synthetic inertia and BESS frequency support, HVDC reinforcement of long corridors, EMS/SCADA modernization through digital twins) are inherently incremental, must be coordinated with regulatory frameworks developed for earlier system architectures, and proceed under significant constraints related to legacy asset stranded value, public acceptance of new infrastructure, and grid-code evolution.
The greenfield perspective is substantially different. Across sub-Saharan Africa, parts of South Asia, and several developing regions where electrification rates remain well below universal access, large portions of the future network are still to be designed and built. The most recent IEA assessments indicate that achieving universal access by 2030 in the Net Zero Emissions Scenario would require approximately 90% of new connections to rely on renewable resources, with mini-grids accounting for roughly 30% and stand-alone solar home systems for about 25% of additional access [
46]. In such contexts, the architectural choices that established economies are now struggling to retrofit—including distributed generation, multi-vector coupling, modular storage, and dispatch-aware demand management—can, in principle, be embedded into the network from the outset, enabling a form of technological leapfrogging analogous to the well-documented transition from fixed-line to mobile telecommunications.
The constraints, however, are of a different nature: they are dominated by financing gaps and the cost of capital (which the IEA estimates to be up to four times higher in low-income countries than in advanced economies for comparable transmission and distribution projects [
46]), by institutional capacity and regulatory maturity, and by the bankability of small and decentralized projects rather than by the technical maturity of the underlying technologies.
Recognizing this dichotomy reframes the research and deployment priorities discussed in this review. Several of the priorities articulated here, while structurally familiar from earlier literature on renewable integration, take on substantially different meanings in the two settings. Improved forecasting and grid-code evolution (
Section 6 and
Section 8) serve as tools to integrate increasing shares of variable generation into existing markets in brownfield contexts, but become instruments to design markets and grid codes from scratch—and to embed renewable-friendly assumptions into them—in greenfield contexts, where regulatory blank slates can be leveraged to avoid the path dependencies that characterize advanced economies. Sector coupling (
Section 11) appears in advanced economies as a long-term strategy for decarbonizing hard-to-electrify sectors, whereas in greenfield contexts it can be conceived from the outset as an organizing principle of new energy infrastructure.
Storage technology selection (
Section 3.3) also reflects different trade-offs: long-duration storage to hedge seasonal variability is increasingly relevant for brownfield systems with high renewable penetration, whereas short- to medium-duration battery storage constitutes the backbone of off-grid and mini-grid deployments in greenfield systems. The transferability of integration solutions, regulatory frameworks, and the case studies presented in
Section 10 should therefore be assessed with explicit recognition of which of these two settings the target context belongs to.
We consider the explicit articulation of this brownfield–greenfield dichotomy, and its implications for the prioritization and adaptation of integration strategies, to be one of the key contributions of this review relative to the existing literature, which often focuses on individual technologies or single regional contexts.