Next Article in Journal
Seismic Reflection Coefficient Inversion Using Basis Pursuit Denoising in the Joint Time-Frequency Domain
Previous Article in Journal
Assessing the Energy Performance of Prefabricated Buildings Considering Different Wall Configurations and the Use of PCMs in Greece
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Agent-Based Energy Sharing Mechanism Using Deep Deterministic Policy Gradient Algorithm

1
School of Electric Engineering, Xi’an Jiaotong University, Xi’an 710000, China
2
State Grid Shanghai Municipal Electric Power Company, Shanghai 200122, China
*
Author to whom correspondence should be addressed.
Energies 2020, 13(19), 5027; https://doi.org/10.3390/en13195027
Submission received: 4 September 2020 / Revised: 20 September 2020 / Accepted: 22 September 2020 / Published: 24 September 2020
(This article belongs to the Section L: Energy Sources)

Abstract

Balancing energy generation and consumption is essential for smoothing the power grids. The mismatch between energy supply and demand would not only increase the cost on both sides, but also has a great impact on the stability of the system. This paper proposes a novel energy sharing mechanism (ESM) to facilitate the consumption of local energy. With the help of the ESM, multiple prosumers have an opportunity to share surplus energy with neighboring prosumers. The problem is formulated as a leader–follower framework based on the Stackelberg game theory. To address the aforementioned problems, a deep deterministic policy gradient (DDPG) is applied to solve the Nash equilibrium (NE). The numerical results demonstrate that the proposed method is more stable than the conventional reinforcement learning (RL) algorithm. Moreover, the proposed method can converge to NE and find a relatively good energy sharing (ES) pricing strategy without knowing the specific system information. In short, it is notable that the proposed ESM can be seen as a win–win strategy for both prosumers and the power system.
Keywords: energy sharing; Nash equilibrium; deep reinforcement learning; deep deterministic policy gradient energy sharing; Nash equilibrium; deep reinforcement learning; deep deterministic policy gradient

Share and Cite

MDPI and ACS Style

Kuang, Y.; Wang, X.; Zhao, H.; Huang, Y.; Chen, X.; Wang, X. Agent-Based Energy Sharing Mechanism Using Deep Deterministic Policy Gradient Algorithm. Energies 2020, 13, 5027. https://doi.org/10.3390/en13195027

AMA Style

Kuang Y, Wang X, Zhao H, Huang Y, Chen X, Wang X. Agent-Based Energy Sharing Mechanism Using Deep Deterministic Policy Gradient Algorithm. Energies. 2020; 13(19):5027. https://doi.org/10.3390/en13195027

Chicago/Turabian Style

Kuang, Yi, Xiuli Wang, Hongyang Zhao, Yijun Huang, Xianlong Chen, and Xifan Wang. 2020. "Agent-Based Energy Sharing Mechanism Using Deep Deterministic Policy Gradient Algorithm" Energies 13, no. 19: 5027. https://doi.org/10.3390/en13195027

APA Style

Kuang, Y., Wang, X., Zhao, H., Huang, Y., Chen, X., & Wang, X. (2020). Agent-Based Energy Sharing Mechanism Using Deep Deterministic Policy Gradient Algorithm. Energies, 13(19), 5027. https://doi.org/10.3390/en13195027

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop