Open Access
This article is

- freely available
- re-usable

*Energies*
**2019**,
*12*(7),
1386;
https://doi.org/10.3390/en12071386

Article

A Decentralized Architecture Based on Cooperative Dynamic Agents for Online Voltage Regulation in Smart Grids

^{1}

Department of Information Technology and Electrical Engineering (DIETI), University of Naples Federico II, 80125 Naples, Italy

^{2}

Department of Engineering, University of Sannio, 82100 Benevento, Italy

^{*}

Author to whom correspondence should be addressed.

Received: 1 March 2019 / Accepted: 2 April 2019 / Published: 10 April 2019

## Abstract

**:**

The large-scale integration of renewable power generators in power grids may cause complex technical issues, which could hinder their hosting capacity. In this context, the mitigation of the grid voltage fluctuations represents one of the main issues to address. Although different control paradigms, based on both local and global computing, could be deployed for online voltage regulation in active power networks, the identification of the most effective approach, which is influenced by the available computing resources, and the required control performance, is still an open problem. To face this issue, in this paper, the mathematical backbone, the expected performance, and the architectural requirements of a novel decentralized control paradigm based on dynamic agents are analyzed. Detailed simulation results obtained in a realistic case study are presented and discussed to prove the effectiveness and the robustness of the proposed method.

Keywords:

voltage regulation; smart grid; decentralized control architecture; multi-agent systems## 1. Introduction

The intermittent power profiles generated by renewable power generators in power grids considerably perturb the bus voltage magnitude [1,2,3], which may go outside the allowable admissible range, especially during critical operating conditions (i.e., high generation and low load demand [3,4,5]). These events are not infrequent in existing power networks, which have been traditionally designed by assuming the passivity of all system buses, without considering the presence of distributed and dispersed generators [6]. Hence, increasing of renewable power generators in these networks, driven by the modern sustainable environmental policies, is causing severe and complex phenomena that need to be carefully addressed [7,8,9]. In this context, the research for new and more advanced online voltage control systems, aimed at regulating the reactive power injected/absorbed by distributed generators, represents one of the most promising research directions for smart power grids [10,11,12]. To address this issue, the use of centralized architectures, traditionally used for voltage control in power systems, could not be suitable in short-term scenarios [13], since it asks for a significant upgrade of the communication and computing resources, to effectively solve constrained optimal power flow problems [14]. Moreover, the deployment of reliable state estimation algorithms, which is a prerequisite of optimal power flow-based regulation techniques, is still an open problem due to the limited number of installed sensors [15]. This has stimulated the research for alternative control techniques for the coordination of the reactive power injected/absorbed by distributed generation units, which process only local data [16,17,18]. Recent experimental results have demonstrated that these local control techniques could be effectively used in existing distribution networks, but they may not provide sufficiently accurate results, especially in the presence of many renewable power generators [11]. To solve this problem, in [19,20,21] the voltage regulation problem is solved by a centralized computing framework, which collects and processes the sensor data streaming, and sends back the corresponding set-points to the voltage controllers. Although the results obtained by this hierarchical voltage control paradigm are highly accurate, a reliable and pervasive communication system is required to connect all the sensor/controllers to the central processing system, which makes the entire control architecture extremely vulnerable. Furthermore, this method asks for an accurate model of the power system and a reliable estimation of the load/generation patterns, which are highly unpredictable, due to rapidly changing operating conditions [22]. Moreover, as recently outlined in many research works, these kinds of centralized control architectures are characterized by low scalability levels, since an increased grid complexity could ask for unaffordable computing resources, further hardware redundancies, higher communication bandwidth, and larger data storage resources [23]. All these limitations could hinder the application of centralized control architectures in modern power systems, where the constant growth of grid complexity and the need for a massive pervasion of renewable power generators ask for more scalable, and more flexible control architectures. In this framework, the deployment of decentralized architectures based on cooperative controllers, which infer global information about the actual power system operation by exchanging and processing only local data, has been recognized as one the most promising enabling technology for solving the voltage control problem. The concept is to try keeping the bus voltage magnitudes very close to the nominal value by adjusting the reactive power generated by the distributed generators, without asking for sophisticated communication hardware and computational resources. In particular, in [24,25] a decentralized technique for voltage regulation based on mutually coupled oscillators has been proposed. The main idea is to couple each grid sensor to a first-order oscillator equipped with decentralized consensus protocols, which converge to the global variables characterizing the actual power system operation. Thanks to this paradigm, the distributed voltage controllers can infer the global variables without the need for a fusion center, which collects and processes all the sensor data. In [26], a two-stage control technique for decentralized voltage regulation in active networks has been proposed. During the first stage, all the local controllers adjust the voltage at the monitored bus, by only processing local data; in the second stage, a proper coordination strategy is activated to properly balance the reactive power absorbed/injected by each controller. A similar approach is proposed in [19], where two control techniques are conceived, to avoid excessive reactive power absorption/injection by each distributed controller. In particular, the first technique is based on the decentralized estimation of the average reactive power generated by all the controllers. The second approach is based on the estimation of the average current that controllers inject at the point of common coupling, which is then used to define the optimal set of each controller. More recently, new techniques based on multi-agent systems (MASs) have been proposed for decentralized voltage regulation. In particular, in [27] a MAS-based decentralized technique for voltage control in distribution networks, and an incentive mechanism aimed at stimulating renewable power generators to support the grid voltage are designed. The main idea is to allow the local control agents to compute the voltage sensitivities by cooperating only with their neighborhood, without the need for an arbitration agent, which collect all the agent’s measurements. Starting from these sensitivity coefficients, each agent identifies its local voltage control strategy by maximizing its own profit. An alternative decentralized approach to compute the voltage sensitivities, which is based on the data surface fitting technique, has been proposed in [28]. This technique requires the knowledge of the network characteristics, and it is robust to changes in network parameters. The decentralized optimization of the local voltage control strategy is obtained in [29] by employing a computing paradigm, which aims at minimizing a quadratic voltage mismatch error objective using gradient-projection updates. To solve this problem two dynamic scenarios have been considered, which include an asynchronous scheme for the decentralized parameters update, and a time-varying communication scheme for highly variable network operation states. A similar solution approach has been proposed in [30] for voltage control of radial distribution grids with photovoltaic generators operating in voltage support mode, and distributed storage systems. In this paper, the voltage optimization problem has been led to the design of a decentralized disturbance-feedback controller, which minimizes the expected value of a convex quadratic cost function, subject to robust convex quadratic constraints on the system state and input. This decentralized problem has been solved by deriving an inner approximation, which enables the efficient computation of an affine control policy via the solution of a finite-dimensional conic program. Although these techniques show their potential of decentralized architectures in solving the online voltage regulation, their performance, in terms of grid voltage magnitude deviations, may be not satisfactory [31]. This limitation mainly stems from the fact that the computed control action is not based on a real picture of the system operating condition. Hence, new and more effective decentralized voltage control architectures should be looked for. In trying to address these problems, this paper proposes a novel decentralized control architecture for the online voltage regulation in active power grids. The proposed solution leverages the mathematical framework of consensus/synchronization control theory in MASs. MASs consist of groups (i.e., ensemble) of dynamical systems exchanging their information and interacting with each other through wireless/wired communication networks, to agree, for example, upon a certain quantity of interest. Many real systems in nature and human society can be modeled as MAS and many researchers, inspired by natural occurrence of flocking and formation forming, have focused their work on synchronization, consensus and coordination of these latter [32], i.e., in controlling the whole network in order to produce a common behavior by applying distributed algorithms and to guarantee a smart group behavior. Examples in engineering deal with the coordinated motion of autonomous vehicles [33,34,35], the phase or frequency synchronization in large power grids [36], and the synchronization of wireless sensor networks [37].

By leveraging this paradigm, an electrical grid can be controlled by exploiting N cooperative smart agents that, exchanging their state information through communication networks, impose a common voltage magnitude value to the whole electrical grid. Specifically, each smart controller uses the information received by neighbors, via a communication interface, to locally control the voltage magnitude of the monitored bus, while aiming at achieving a synchronization behavior to desired voltage magnitude, as imposed by the network generator without the need for fusion data center. This allows the smart controller to locally decide how much reactive power it needs to inject, or absorb, to reach the desired voltage asset for the whole power grid.

The current literature exploits decentralized control strategies only for the control of the generators (see the survey [31] and the references herein). Our approach, differently, aims to guarantee that all the buses, both generation and load, synchronize to the common reference imposed by the generators, while reducing power losses. The proposed approach hence provides a self-organized power grid, which has the ability to cope effectively with the problems that might occur using only local interactions and providing “plug and play” capability. A case study developed on the IEEE 30-bus network confirm the effectiveness of the approach, and shows its robustness regarding electrical load variations.

Finally, it is worth mentioning that the large-scale deployment of the proposed control paradigm asks for the conceptualization of new tools aimed at facilitating operational data acquisition and handling in inter-operable formats. In this domain the current research activities are oriented in conceptualizing advanced computing paradigms aimed at handling complex systems by information semantics [38]. The main idea is to develop a power system ontology able to adapt to different use-cases, which could be used to define and specify complex events and actions that run on an event processing engine. To this aim the Authors are developing a distributed and cooperative information framework aimed at exploiting the semantic representation of power system measurements for transparently exchanging data and information between the local voltage controllers, and with the Energy Management Systems of the Distributed System Operator. The proposed framework is based on specific software components, which support decentralized semantic sensor data exchanging and a distributed middleware aimed at processing massive and heterogeneous sensor measurements. The details of this framework will be presented in a future works.

## 2. Problem Formulation

The online voltage control function identifies, for each power system state $\Gamma $, the set-point y of the grid controllers that minimizes an objective function J subject to several equality and inequality constraints $g(\Gamma ,y)$.

This problem can be formalized by the following constrained optimization problem:
where
is the control vector, whose components are the grid controller set-points, ${Q}_{dg,i}$ is the reactive power injected by the i-th ($i=1,\dots ,{N}_{g}$) distributed generator available for the regulation; ${Q}_{cap,j}$ is the vector of the reactive power injected by the j-th ($j=1,\dots ,{N}_{c}$) capacitor bank and m is the tap position of the HV/MV line tap changing transformer. Please note that the control vector y takes value in the solution space $\Omega $:

$$\{\begin{array}{c}\underset{y\in \Omega}{min}J(y,\Gamma )\\ g(\Gamma ,y)\le 0\end{array}$$

$$y=\left[{Q}_{dg,1},\cdots ,{Q}_{dg,{N}_{g}},{Q}_{cap,1},\cdots ,{Q}_{cap,{N}_{c}},m\right]$$

$$y\in \Omega \u27fa\left\{\begin{array}{c}ta{p}_{min}\le m\le ta{p}_{max},\hfill \\ {Q}_{dg,min,i}\le {Q}_{dg,1}\le {Q}_{dg,max,i}\phantom{\rule{0.277778em}{0ex}}\phantom{\rule{0.277778em}{0ex}}\phantom{\rule{0.277778em}{0ex}}\phantom{\rule{0.277778em}{0ex}}i=1,\cdots ,{N}_{g},\hfill \\ {Q}_{cap,min,j}\le {Q}_{cap,j}\le {Q}_{cap,max,j}\phantom{\rule{0.277778em}{0ex}}\phantom{\rule{0.277778em}{0ex}}\phantom{\rule{0.277778em}{0ex}}\phantom{\rule{0.277778em}{0ex}}j=1,\dots ,{N}_{c}.\hfill \end{array}\right.$$

The vector function $g(\Gamma ,y)$ describes the problem constraints in terms of allowable ranges for the bus voltage magnitudes (i.e., ${V}_{min,q}\le {V}_{q}\le {V}_{max,q},\phantom{\rule{0.277778em}{0ex}}q=1,\cdots ,N$), and maximum allowable currents for the ${n}_{l}$ power lines (i.e., ${I}_{l}\le {I}_{max},\phantom{\rule{0.277778em}{0ex}}l=1,\cdots ,{n}_{l}$).

The objective function could take into account both technical and economic aspects, and it is typically expressed as a weighted sum of O normalized design objectives:

$$J(y,\Gamma )={\alpha}_{{F}_{1}}\frac{{F}_{1}(y,\Gamma )}{{\overline{F}}_{1}}+{\alpha}_{{F}_{2}}\frac{{F}_{2}(y,\Gamma )}{{\overline{F}}_{2}}+\cdots +{\alpha}_{{F}_{O}}\frac{{F}_{O}(y,\Gamma )}{{\overline{F}}_{O}}$$

The typical design objectives that should be minimized are:

- the active power losses:$${F}_{1}={P}_{g}-{P}_{l}\ge 0$$
- the average voltage deviation:$${F}_{2}=\frac{{\sum}_{i=1}^{n}\parallel {V}_{q}-{V}_{q}^{\star}\parallel}{N}$$
- the maximum voltage deviation:$${F}_{3}=\underset{i}{max}\left(\parallel {V}_{q}-{V}_{q}^{\star}\parallel \right)={\parallel {V}_{q}-{V}_{q}^{\star}\parallel}_{\infty}$$

Since the design objectives are competing, the voltage control problem has no unique solution and a suitable trade-off between objectives must be identified.

## 3. A Decentralized Solution of the Optimal Voltage Regulation Problem

To address the voltage regulation problem, an innovative solution based on a decentralized architecture is discussed here. This architecture is based on a network of N cooperative smart controllers, each regulating the voltage magnitude of a specific bus (called node too).

In this operating scenario, each controller device is equipped with three basic components:

- a set of sensors measuring the available set of local electrical variables (i.e., voltage magnitude, active and reactive bus power);
- a dynamical system, whose state is initialized by sensor measurements and evolves interactively with the states of nearby controllers, according to a properly designed distributed control strategy;
- a communication interface, carrying the interaction among controllers by transmitting the state of the dynamical system and receiving the state transmitted by the other nodes.

The idea is to leverage the theoretical framework of multi-agent dynamical systems [39] to design and implement distributed cooperative control strategies allowing the optimal energy management of the whole power grid. To this aim, the N cooperative controller devices are modeled as a one-dimensional network of dynamical agents, in which each agent uses only its neighboring information to locally control the voltage magnitude of the bus, while aiming to achieve certain global coordination with all other agents. This mathematical framework is represented in Figure 1 as the composition of the following main interrelated components: (a) agent dynamics that describe the dynamics of each bus controller device; (b) communication topology, which indicates how and if a controller device obtains information about other agents, depending on the presence/absence of connecting lines; (c) distributed control action, which is implemented at the single-controller device level, and depends on both the state variables of the bus controller itself, and on information received from neighboring controller devices through the communication topology. Use of this paradigm allows the voltage controllers to assess, in a totally decentralized way, many important variables characterizing the actual operation of the grid. Thanks to this feature, each controller knows both the variables characterizing the monitored bus (sensed by in-built sensors) and the global variables describing the actual performance of the entire power grid (assessed by checking the state of the dynamical system). This allows each controller to (i) assess the evolution of the objective function describing the voltage regulation objectives and (ii) identify the proper control actions aimed at minimizing this function.

From this perspective, a power grid made of ${N}_{c}$ capacitor banks, ${N}_{g}$ generators and $N={N}_{g}+{N}_{c}$ buses can be managed by N cooperative smart controllers. Specifically, if the i-th smart controller is associated with the i-th generation bus ($i=1,\cdots ,{N}_{g}$) of the grid, then it aims at regulating the i-th bus voltage magnitude so to achieve the desired voltage ${V}_{i}^{*}$. Conversely, if the j-th smart controller is associated with the j-th capacitor bank bus ($j=1,\cdots ,{N}_{c}$), then it aims at controlling, via distributed cooperative algorithm, the j-th bus reactive power generation capability in order to: (i) guarantee that its voltage magnitude achieves the desired optimal voltage value (according to (6)), as imposed by the ${N}_{g}$ generators within the electric grid; ($ii$) reduce power losses (according to (5)).

#### 3.1. Agent Dynamics

Within our theoretical framework, each smart device j ($j=1,\cdots ,{N}_{c}$) for the j-th capacitor bank bus of the power grid is described by the following dynamical system:
where ${Q}_{j}\left(t\right)\phantom{\rule{0.277778em}{0ex}}[p.u.]$ represents the reactive power of the j-th capacitor bank bus; ${u}_{j}\left(t\right)$ is the cooperatively distributed control input that drives the reactive power, and hence the voltage magnitude, of the electrical node. It is evaluated by exploiting both local electrical measurements and electrical networks information.

$${\dot{Q}}_{j}\left(t\right)={u}_{j}\left(t\right),$$

Conversely, we assume that each smart device i ($i=1,\cdots ,{N}_{g}$) for the i-th generation bus within the electrical grid is described by the following dynamical system:
where ${V}_{i}\left(t\right)\phantom{\rule{0.277778em}{0ex}}[p.u.]$ represents the voltage magnitude of the i-th generator; ${u}_{i}\left(t\right)$ is the control input that drives the voltage magnitude of the electrical node so the achieve the desired voltage ${V}_{i}^{*}$. Please note that the i-th generator acts as a leader for the whole SG by imposing the reference voltage magnitude ${V}_{i}\left(t\right)$ for the capacitor bank buses.

$${\dot{V}}_{i}\left(t\right)={u}_{i}\left(t\right),$$

#### 3.2. Communication Topology

The communication topology indicates how and if a smart controller q ($q=1,\cdots ,N$, with $N={N}_{g}+{N}_{c}$) obtains information about the other smart devices p ($p=1,\cdots ,N$, with $q\ne p$).

The connections among the ${N}_{c}$ cooperative smart controller for the capacitor bank buses can be modeled as a directed graph (digraph) ${\mathcal{G}}_{{N}_{c}}=\left(\mathcal{V},\mathcal{E},\mathcal{A}\right)$ of order ${N}_{c}$ characterized by the set of nodes $\mathcal{V}=\{1,\dots ,{N}_{c}\}$ and the set of edges $\mathcal{E}\subseteq \mathcal{V}\times \mathcal{V}$. The topology of the graph is associated with an adjacency matrix with non-negative elements $\mathcal{A}={\left[{\alpha}_{j\rho}\right]}_{N\times N}$, being $\rho =1,\cdots ,{N}_{c}$. In what follows, we assume ${\alpha}_{j\rho}=1$ in the presence of a communication link from the smart device j to device $\rho $, otherwise ${\alpha}_{j\rho}=0$. Moreover, ${\alpha}_{jj}=0$ (i.e., self-edges $(j,j)$ are not allowed). The presence of edge $(j,\rho )\in \mathcal{E}$ means that device j can obtain information from the device $\rho $, but not necessarily viceversa.

The presence/absence of connections among the ${N}_{c}$ cooperative smart controller and the ${N}_{g}$ smart controller for the generation buses is instead described by the matrix ${\mathcal{A}}_{1}={\left[{\alpha}_{ji}\right]}_{{N}_{c}\times {N}_{g}}$, whose elements ${\alpha}_{ji}=1$ in the presence of a communication link among the smart device j and the device i, otherwise ${\alpha}_{ji}=0$.

Finally, we highlight that in our application we assume that the pairs $(j,\rho )$ and $(j,i)$ can communicate if there exist a power transmission line among them.

#### 3.3. Control Design

The voltage regulation control problem for the power grid can be solved by achieving two control objectives, namely:

- designing the control strategy ${u}_{i}\left(t\right)$ in (9), leveraging local electric information, to opportunely manage the voltage magnitude of the bus i so to reach and maintain the desired reference voltage value ${V}_{i}^{*}$, i.e.,$$\underset{t\to \infty}{lim}\parallel ({V}_{i}\left(t\right)-{V}_{i}^{*})\parallel =0\phantom{\rule{0.277778em}{0ex}}$$
- designing the distributed control input ${u}_{j}\left(t\right)$ in (8), leveraging both local and neighboring electrical information, to opportunely manage the reactive power of the bus j, hence updating its voltage magnitude ${V}_{j}\left(t\right)$ until it converges to the common reference behavior imposed by generators within the SG, i.e.,$$\begin{array}{c}\underset{t\to \infty}{lim}\parallel \sum _{\rho =1}^{{N}_{c}}{\alpha}_{j\rho}({V}_{j}\left(t\right)-{V}_{\rho}\left(t\right))\parallel \to 0\hfill \\ \underset{t\to \infty}{lim}\parallel \sum _{i=1}^{{N}_{g}}{\alpha}_{ji}({V}_{j}\left(t\right)-{V}_{i}\left(t\right))\parallel \to 0\hfill \end{array}$$

To attain the control goal in (10), we consider, according to the literature (see e.g., [40]), for each electric node i the following Proportional controller:
where ${k}_{i}$ is the proportional gain to be properly tuned according to the maximum admissible voltage variations for the i-th node.

$${u}_{i}\left(t\right)={k}_{i}({V}_{i}\left(t\right)-{V}_{i}^{*}))$$

Conversely, to attain the control objective in (11), we propose, for each electric node j the following consensus-based control protocol that updates its action based on the errors among the electrical state information:
where ${\alpha}_{j\rho}$ models the presence/absence of communication link among the bus j and the bus $\rho $; ${\alpha}_{ji}$ models the presence/absence of communication link among the bus j and the generator bus i; ${k}_{j}$ and ${b}_{j}$ are the control gains to be tuned so to guarantee that the reactive power of the bus j does not exceed a pre-fixed operating range $[{Q}_{j,min};{Q}_{j,max}]$.

$${u}_{j}\left(t\right)={k}_{j}\sum _{\rho =1}^{{N}_{c}}{\alpha}_{j\rho}({V}_{j}\left(t\right)-{V}_{\rho}\left(t\right))+{b}_{j}\sum _{i=1}^{{N}_{g}}{\alpha}_{ji}({V}_{j}\left(t\right)-{V}_{i}\left(t\right)),$$

Finally, we highlight that the exploitation of the distributed cooperative control input (13) guarantees that all the ${N}_{c}$ buses within the SG closely converge to the common behavior imposed by the ${N}_{g}$ generators, hence guaranteeing the optimal management of the electrical grid.

## 4. Case Study

To validate the effectiveness of the approach proposed in Section 3, we consider here the voltage regulation problem for the IEEE 30-bus test system depicted in Figure 2. The power grid is made of ${N}_{g}=6$ generators (i.e., node $1,2,5,8,11,13$), ${N}_{c}=24$ capacitor banks, $N=30$ buses, and ${n}_{l}=41$ lines. Load information, lines impedance, as well as reactive power limits, are reported in [41]. Numerical analysis has been carried out by exploiting the MATLAB© platform.

The initial condition for the N cooperative agents within the grid as well as the selected control gains for both the control protocol in (12) and the one in (13) are listed in Table 1. Finally, the desired voltage value ${V}_{i}^{*}$ for the generation buses ${N}_{g}$ are selected as follows: $[{V}_{1}^{*},\phantom{\rule{0.277778em}{0ex}}{V}_{2}^{*},\phantom{\rule{0.277778em}{0ex}}{V}_{5}^{*},\phantom{\rule{0.277778em}{0ex}}{V}_{8}^{*},\phantom{\rule{0.277778em}{0ex}}{V}_{11}^{*},\phantom{\rule{0.277778em}{0ex}}{V}_{13}^{*}]\phantom{\rule{3.33333pt}{0ex}}=\phantom{\rule{3.33333pt}{0ex}}[1.05,1.02,1.05,1.03,1.05,1.02]\phantom{\rule{0.277778em}{0ex}}[p.u.]$. Our aim is to show how the proposed solution can ensure in a totally distributed fashion the desired optimal voltage magnitude of the whole grid with reduced power losses.

Results in Figure 3, Figure 4 and Figure 5 show the effectiveness of the proposed control approach in ensuring the control goal in (10) and (11). Indeed, as depicted in Figure 3, thanks to the control action (12), the smart controllers for the generation buses ensure that the corresponding voltage magnitude converge to the desired values ${V}_{i}^{*}$ in $1\phantom{\rule{0.277778em}{0ex}}\left[s\right]$. Accordingly, the smart controller device j $(j\in {N}_{c})$ dynamically acts on the reactive power generation capability of the j-th electrical node (i.e., it produces or absorbs the bus reactive power; see Figure 5) and due to cooperative control action in (13) guarantees that its voltage magnitude converges in $1\phantom{\rule{0.277778em}{0ex}}\left[s\right]$ to the desired optimal value $[1.02;1.05]\phantom{\rule{0.277778em}{0ex}}[p.u.]$ as imposed by the ${N}_{g}$ generators of the electrical grid. Indeed, the mean grid voltage of the ${N}_{c}$ electrical nodes, i.e., ${V}_{mean}=1.03\phantom{\rule{0.277778em}{0ex}}[p.u.]$ is equal to the mean voltage imposed by the ${N}_{g}$ generators. This confirms the benefit of the proposed decentralized approach in ensuring the electrical grid synchronization to the reference behavior imposed by generators only leveraging local and neighboring information and without the need for knowing global information about the whole grid. The proposed approach hence provides a distributed control solution allowing the power grid to be self-organized. The benefits of the approach are the scalability of the solution, which makes the grid to be easily re-configurable, and the low computational burden required for the controlling purposes.

Finally, we remark that due to the scalability features of the proposed approach, the convergence settling time still remains equal to $1\phantom{\rule{0.277778em}{0ex}}\left[s\right]$ when increasing the number of devices, differently from the centralized solution where this increasing number may significantly affects the dynamic performance of the whole grid.

#### Robustness to Variable Load

Here we show the robustness of the proposed approach by considering percentage variations of all the loads compared to the nominal values reported in [41]. Specifically, as illustrative example, we take into account that load, indicated with $L\left(t\right)$, varies over time according to Figure 6 (i.e., maximum variations of $\pm 50\%$). Results in Figure 7 and Figure 8 disclose that despite the presence of load variations acting on the whole grid, the proposed approach promptly reacts to load changes by recovering the desired optimal voltage magnitude as imposed by the ${N}_{g}$ generators. Specifically, in the time interval $5\le t<10$ it is possible to appreciate that after increasing of the $30\%$ of all the loads within the grid (see Figure 6), the smart controllers dynamically regulate the voltage magnitude of the j-th bus via production or absorption of reactive power. The same behavior also occurs when there exist both a variation of $50\%$ in the time interval $10\le t<15$ and a variation of $-50\%$ in the time interval $15\le t<20$.

## 5. Conclusions

MAS-based architectures are considered as the most promising enabling methodology for decentralized voltage regulation in modern power distribution systems, where the massive pervasion of renewable power generators could hinder the deployment of hierarchical and centralized control paradigms. Although the conceptualization of MAS-based solutions has been widely explored in the literature, their deployment in realistic operation scenario is still at its infancy, and several open problems need to be addressed in order to identify the most effective computing paradigm, which reliably solves the voltage regulation problem, exhibiting high resilience to internal and external perturbations, high scalability to support an exponential growth of distributed energy resources, and low computational requirements.

In the light of these needs, this paper proposed a novel decentralized control architecture for the online voltage regulation in active power grids, which is based on a network of cooperative dynamic agents equipped with consensus protocols, and interacting with each other through wireless/wired communication networks. Thanks to the adoption of this cooperative paradigm, each agent regulates the voltage magnitude of a specific generation/load bus so to achieve a synchronization behavior to desired voltage magnitude without the need for fusion data center. This feature makes the proposed solution self-organized, decentralized, and scalable, hence resulting a promising alternative to solve the voltage regulation problem in modern smart grids.

Simulation results, carried out for the realistic case of study of the IEEE 30-bus test system, confirm the effectiveness and the robustness of the approach in ensuring that all the electrical buses reach and maintain the desired synchronization behavior.

## Author Contributions

Conceptualization, A.A., A.P., S.S., A.V. and D.V.; Methodology, A.A., A.P., S.S. and A.V.; Software, A.A., A.P., S.S. and A.V.; writing–original draft preparation, A.A., A.P., S.S. and A.V.; writing–review and editing, A.A., A.P., S.S., A.V. and D.V.

## Funding

This research received no external funding.

## Conflicts of Interest

The authors declare no conflict of interest.

## References

- Cossent, R.; Gómez, T.; Olmos, L. Large-scale integration of renewable and distributed generation of electricity in Spain: Current situation and future needs. Energy Policy
**2011**, 39, 8078–8087. [Google Scholar] [CrossRef] - Liu, Y.; Bebic, J.; Kroposki, B.; De Bedout, J.; Ren, W. Distribution system voltage performance analysis for high-penetration PV. In Proceedings of the 2008 IEEE Energy 2030 Conference, Atlanta, GA, USA, 17–18 November 2008; pp. 1–8. [Google Scholar]
- Rahman, M.M.; Arefi, A.; Shafiullah, G.; Hettiwatte, S. A new approach to voltage management in unbalanced low voltage networks using demand response and OLTC considering consumer preference. Int. J. Electr. Power Energy Syst.
**2018**, 99, 11–27. [Google Scholar] [CrossRef] - Walling, R.; Saint, R.; Dugan, R.C.; Burke, J.; Kojovic, L.A. Summary of distributed resources impact on power delivery systems. IEEE Trans. Power Deliv.
**2008**, 23, 1636–1644. [Google Scholar] [CrossRef] - Jamal, T.; Urmee, T.; Calais, M.; Shafiullah, G.; Carter, C. Technical challenges of PV deployment into remote Australian electricity networks: A review. Renew. Sustain. Energy Rev.
**2017**, 77, 1309–1325. [Google Scholar] [CrossRef] - Kenneth, A.P.; Folly, K. Voltage rise issue with high penetration of grid connected PV. IFAC Proc. Vol.
**2014**, 47, 4959–4966. [Google Scholar] [CrossRef] - Karimi, M.; Mokhlis, H.; Naidu, K.; Uddin, S.; Bakar, A. Photovoltaic penetration issues and impacts in distribution network—A review. Renew. Sustain. Energy Rev.
**2016**, 53, 594–605. [Google Scholar] [CrossRef] - Stetz, T.; Marten, F.; Braun, M. Improved low voltage grid-integration of photovoltaic systems in Germany. IEEE Trans. Sustain. Energy
**2013**, 4, 534–542. [Google Scholar] [CrossRef] - Varma, R.K.; Rangarajan, S.S.; Axente, I.; Sharma, V. Novel application of a PV solar plant as STATCOM during night and day in a distribution utility network. In Proceedings of the 2011 IEEE/PES Power Systems Conference and Exposition, Phoenix, AZ, USA, 20–23 March 2011; pp. 1–8. [Google Scholar]
- Caldon, R.; Coppo, M.; Turri, R. Distributed voltage control strategy for LV networks with inverter-interfaced generators. Electr. Power Syst. Res.
**2014**, 107, 85–92. [Google Scholar] [CrossRef] - Molina-García, Á.; Mastromauro, R.A.; García-Sánchez, T.; Pugliese, S.; Liserre, M.; Stasi, S. Reactive power flow control for PV inverters voltage support in LV distribution networks. IEEE Trans. Smart Grid
**2017**, 8, 447–456. [Google Scholar] [CrossRef] - Perera, B.K.; Ciufo, P.; Perera, S. Point of common coupling (PCC) voltage control of a grid-connected solar photovoltaic (PV) system. In Proceedings of the IECON 2013 39th Annual Conference of the IEEE Industrial Electronics Society, Vienna, Austria, 10–13 November 2013; pp. 7475–7480. [Google Scholar]
- Raju, L.; Milton, R.; Mahadevan, S. Multi agent systems based distributed control and automation of micro-grid using MACSimJX. In Proceedings of the 2016 10th International Conference on Intelligent Systems and Control (ISCO), Coimbatore, India, 7–8 January 2016; pp. 1–6. [Google Scholar]
- Fallahzadeh-Abarghouei, H.; Nayeripour, M.; Waffenschmidt, E.; Hasanvand, S. A new decentralized voltage control method of smart grid via distributed generations. In Proceedings of the 2016 International Energy and Sustainability Conference (IESC), Cologne, Germany, 30 June–1 July 2016; pp. 1–6. [Google Scholar]
- Higgins, N.; Vyatkin, V.; Nair, N.; Schwarz, K. Intelligent decentralised power distribution automation with IEC 61850, IEC 61499 and holonic control. IEEE Trans. Syst. Mach. Cybern. C
**2010**, 40, 1–12. [Google Scholar] - Demirok, E.; Gonzalez, P.C.; Frederiksen, K.H.; Sera, D.; Rodriguez, P.; Teodorescu, R. Local reactive power control methods for overvoltage prevention of distributed solar inverters in low-voltage grids. IEEE J. Photovolt.
**2011**, 1, 174–182. [Google Scholar] [CrossRef] - Turitsyn, K.; Sulc, P.; Backhaus, S.; Chertkov, M. Local control of reactive power by distributed photovoltaic generators. In Proceedings of the 2010 First IEEE International Conference on Smart Grid Communications, Gaithersburg, MD, USA, 4–6 October 2010; pp. 79–84. [Google Scholar]
- Demirok, E.; Sera, D.; Rodriguez, P.; Teodorescu, R. Enhanced local grid voltage support method for high penetration of distributed generators. In Proceedings of the IECON 2011 37th Annual Conference of the IEEE Industrial Electronics Society, Hungary, Budapest, 26–30 August 2011; pp. 2481–2485. [Google Scholar]
- Martí, P.; Velasco, M.; Fuertes, J.M.; Camacho, A.; Miret, J.; Castilla, M. Distributed reactive power control methods to avoid voltage rise in grid-connected photovoltaic power generation systems. In Proceedings of the 2013 IEEE International Symposium on Industrial Electronics, Taipei, Taiwan, 28–31 May 2013; pp. 1–6. [Google Scholar]
- Tanaka, K.; Oshiro, M.; Toma, S.; Yona, A.; Senjyu, T.; Funabashi, T.; Kim, C.H. Decentralised control of voltage in distribution systems by distributed generators. IET Gen. Transm. Distrib.
**2010**, 4, 1251–1260. [Google Scholar] [CrossRef] - Toma, S.; Senjyu, T.; Miyazato, Y.; Yona, A.; Funabashi, T.; Saber, A.Y.; Kim, C.H. Optimal coordinated voltage control in distribution system. In Proceedings of the 2008 IEEE Power and Energy Society General Meeting-Conversion and Delivery of Electrical Energy in the 21st Century, Pittsburgh, PA, USA, 20–24 July 2008; pp. 1–7. [Google Scholar]
- Shalwala, R.; Bleijs, J. Voltage control scheme using Fuzzy Logic for residential area networks with PV generators in Saudi Arabia. In Proceedings of the 2010 Joint International Conference on Power Electronics, Drives and Energy Systems & 2010 Power India, New Delhi, India, 20–23 December 2010; pp. 1–6. [Google Scholar]
- Gupta, N.; Garg, R.; Kumar, P. Asymmetrical Fuzzy logic control to PV Module Connected micro-grid. In Proceedings of the 2015 Annual IEEE India Conference (INDICON), New Delhi, India, 17–19 December 2015; pp. 1–6. [Google Scholar]
- Loia, V.; Vaccaro, A. A decentralized architecture for voltage regulation in smart grids. In Proceedings of the 2011 IEEE International Symposium on Industrial Electronics, Gdansk, Poland, 27–30 June 2011; pp. 1679–1684. [Google Scholar]
- Loia, V.; Vaccaro, A.; Vaisakh, K. A self-organizing architecture based on cooperative fuzzy agents for smart grid voltage control. IEEE Trans. Ind. Inf.
**2013**, 9, 1415–1422. [Google Scholar] [CrossRef] - Hojo, M.; Hatano, H.; Fuwa, Y. Voltage rise suppression by reactive power control with cooperating photovoltaic generation systems. In Electricity Distribution-Part; IET: Stevenage, UK, 2009; Volume 2. [Google Scholar]
- Wang, X.; Wang, C.; Xu, T.; Guo, L.; Fan, S.; Wei, Z. Decentralised voltage control with built-in incentives for participants in distribution networks. IET Gen. Transm. Distrib.
**2018**, 12, 790–797. [Google Scholar] [CrossRef] - Zhang, Z.; Ochoa, L.F.; Valverde, G. A novel voltage sensitivity approach for the decentralized control of DG plants. IEEE Trans. Power Syst.
**2018**, 33, 1566–1576. [Google Scholar] [CrossRef] - Liu, H.J.; Shi, W.; Zhu, H. Decentralized dynamic optimization for power network voltage control. IEEE Trans. Signal Inf. Proc. Netw.
**2017**, 3, 568–579. [Google Scholar] [CrossRef] - Lin, W.; Bitar, E. Decentralized stochastic control of distributed energy resources. IEEE Trans. Power Syst.
**2018**, 33, 888–900. [Google Scholar] [CrossRef] - Antoniadou-Plytaria, K.E.; Kouveliotis-Lysikatos, I.N.; Georgilakis, P.S.; Hatziargyriou, N.D. Distributed and decentralized voltage control of smart distribution networks: Models, methods, and future research. IEEE Trans. Smart Grid
**2017**, 8, 2999–3008. [Google Scholar] [CrossRef] - Petrillo, A.; Salvi, A.; Santini, S.; Valente, A.S. Adaptive synchronization of linear multi-agent systems with time-varying multiple delays. J. Frankl. Inst.
**2017**, 354, 8586–8605. [Google Scholar] [CrossRef] - Petrillo, A.; Pescapé, A.; Santini, S. A collaborative approach for improving the security of vehicular scenarios: The case of platooning. Comput. Commun.
**2018**, 122, 59–75. [Google Scholar] [CrossRef] - Petrillo, A.; Salvi, A.; Santini, S.; Valente, A.S. Adaptive multi-agents synchronization for collaborative driving of autonomous vehicles with multiple communication delays. Trans. Res. C Emerg. Technol.
**2018**, 86, 372–392. [Google Scholar] [CrossRef] - Di Vaio, M.; Fiengo, G.; Petrillo, A.; Salvi, A.; Santini, S.; Tufo, M. Cooperative shock waves mitigation in mixed traffic flow environment. IEEE Trans. Intell. Trans. Syst.
**2019**, 99, 1–15. [Google Scholar] [CrossRef] - Dorfler, F.; Bullo, F. Synchronization and transient stability in power networks and nonuniform Kuramoto oscillators. SIAM J. Control Optim.
**2012**, 50, 1616–1642. [Google Scholar] [CrossRef] - Zheng, J.; Jamalipour, A. Wireless Sensor Networks: A Networking Perspective; John Wiley & Sons: Hoboken, NJ, USA, 2009. [Google Scholar]
- Loia, V.; Furno, D.; Vaccaro, A. Decentralised smart grids monitoring by swarm-based semantic sensor data analysis. Int. J. Syst. Control Commun.
**2013**, 5, 1–14. [Google Scholar] [CrossRef] - Olfati-Saber, R.; Fax, J.A.; Murray, R.M. Consensus and cooperation in networked multi-agent systems. Proc. IEEE
**2007**, 95, 215–233. [Google Scholar] [CrossRef] - He, D.; Shi, D.; Sharma, R. Consensus-based distributed cooperative control for microgrid voltage regulation and reactive power sharing. In Proceedings of the IEEE PES Innovative Smart Grid Technologies, Istanbul, Turkey, 12–15 October 2014; pp. 1–6. [Google Scholar]
- Shahidehpour, M.; Wang, Y. Communication and Control in Electric Power Systems: Applications of Parallel and Distributed Processing; John Wiley & Sons: Hoboken, NJ, USA, 2004. [Google Scholar]

**Figure 3.**Time history of the voltage magnitude ${V}_{i}\left(t\right)\phantom{\rule{0.277778em}{0ex}}[p.u.]$ for $i\in {N}_{g}$.

**Figure 4.**Time history of the voltage magnitude ${V}_{j}\left(t\right)\phantom{\rule{0.277778em}{0ex}}[p.u.]$ for $j\in {N}_{c}$.

**Figure 5.**Time history of the reactive power ${Q}_{j}\left(t\right)\phantom{\rule{0.277778em}{0ex}}[p.u.]$ for $j\in {N}_{c}$.

**Figure 7.**Robustness with respect to variable load: time history of the voltage magnitude ${V}_{j}\left(t\right)\phantom{\rule{0.277778em}{0ex}}[p.u.]$ for $j\in {N}_{c}$.

**Figure 8.**Robustness with respect to variable load: time history of the reactive power ${Q}_{j}\left(t\right)\phantom{\rule{0.277778em}{0ex}}[p.u.]$ for $j\in {N}_{c}$.

Initial Conditions | |

Voltage magnitude | ${V}_{1}\left(0\right)=1.02;{V}_{2}\left(0\right)=1.01;{V}_{5}\left(0\right)=1.03;$ |

of generation bus i [$p.u.$] | ${V}_{8}\left(0\right)=1.04;{V}_{11}\left(0\right)=1.01;{V}_{13}\left(0\right)=1.03$ |

Reactive power | ${Q}_{3}\left(0\right)=-0.012;\phantom{\rule{0.277778em}{0ex}}{Q}_{4}\left(0\right)=-0.016;$ |

of capacitor bank bus | ${Q}_{6}\left(0\right)=-0.005;\phantom{\rule{0.277778em}{0ex}}{Q}_{7}\left(0\right)=-0.109$; |

j [$p.u.$] | ${Q}_{9}\left(0\right)=-0.005;\phantom{\rule{0.277778em}{0ex}}{Q}_{10}\left(0\right)=-0.02$ |

${Q}_{12}\left(0\right)=-0.075;\phantom{\rule{0.277778em}{0ex}}{Q}_{14}\left(0\right)=-0.016;$ | |

${Q}_{15}\left(0\right)=-0.025;\phantom{\rule{0.277778em}{0ex}}{Q}_{16}\left(0\right)=-0.018;$ | |

${Q}_{17}\left(0\right)=-0.058;\phantom{\rule{0.277778em}{0ex}}{Q}_{18}\left(0\right)=-0.009;$ | |

${Q}_{19}\left(0\right)=-0.034;\phantom{\rule{0.277778em}{0ex}}{Q}_{20}\left(0\right)=-0.007;$ | |

${Q}_{21}\left(0\right)=-0.112;\phantom{\rule{0.277778em}{0ex}}{Q}_{22}\left(0\right)=-0.005;$ | |

${Q}_{23}\left(0\right)=-0.016;\phantom{\rule{0.277778em}{0ex}}{Q}_{24}\left(0\right)=-0.067;$ | |

${Q}_{25}\left(0\right)=-0.005;\phantom{\rule{0.277778em}{0ex}}{Q}_{26}\left(0\right)=-0.023;$ | |

${Q}_{27}\left(0\right)=-0.005;\phantom{\rule{0.277778em}{0ex}}{Q}_{28}\left(0\right)=-0.005;$ | |

${Q}_{29}\left(0\right)=-0.009;\phantom{\rule{0.277778em}{0ex}}{Q}_{30}\left(0\right)=-0.019.$ | |

Control Gains | |

Control gains ${k}_{i}$ | ${k}_{i}=5$ i = 1, 2, 5, 8, 11, 13 |

Control gains ${k}_{j}$ | ${k}_{j}=10$ $\forall j\in {N}_{c}$ |

Control gains ${b}_{j}$ | ${b}_{j}=15$ $\forall j\in {N}_{c}$ |

© 2019 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).