Optimal PQ Control of Grid-Connected Inverters in a Microgrid Based on Adaptive Population Extremal Optimization

The optimal P-Q control issue of the active and reactive power for a microgrid in the grid-connected mode has attracted increasing interests recently. In this paper, an optimal active and reactive power control is developed for a three-phase grid-connected inverter in a microgrid by using an adaptive population-based extremal optimization algorithm (APEO). Firstly, the optimal P-Q control issue of grid-connected inverters in a microgrid is formulated as a constrained optimization problem, where six parameters of three decoupled PI controllers are real-coded as the decision variables, and the integral time absolute error (ITAE) between the output and referenced active power and the ITAE between the output and referenced reactive power are weighted as the objective function. Then, an effective and efficient APEO algorithm with an adaptive mutation operation is proposed for solving this constrained optimization problem. The simulation and experiments for a 3 kW three-phase grid-connected inverter under both nominal and variable reference active power values have shown that the proposed APEO-based P-Q control method outperforms the traditional Z-N empirical method, the adaptive genetic algorithm-based, and particle swarm optimization-based P-Q control methods.


Introduction
As an important distribution system, a microgrid integrates a variety of renewable and traditional distributed generations and different loads [1].How to design optimal controllers to guarantee that the microgrid operates well in both islanded and grid-connected modes is one of the critical issues in the microgrid research area [2][3][4][5][6].More specifically, it is important to control the voltage and frequency of each power converter connected to each distributed generation, called the VF control, in the islanded mode while it is necessary to regulate the output active and reactive powers of each distributed generation, called the P-Q control in the grid-connected mode.Some recent works have studied the optimal voltage control issue of the distribution systems in the presence of distributed energy resources [7,8].This paper focuses on the optimal P-Q control issue of a microgrid in the grid-connected mode.
In the past decade, some P-Q control methods have been proposed for distributed generations [9][10][11][12][13][14][15].Dai [9] developed an effective power flow control method for a distributed generation unit in the grid-connected mode by adopting a robust servomechanism voltage controller and a discrete-time sliding mode current controller on the basis of Newton-Raphson-based parameter estimation and feed forward control approaches.The research work [11] studied the control problem of active and reactive powers using a second-order generalized integrator in a single-phase grid-connected fuel cell system based on the boost inverter.In Reference [12], an individual-phase decoupled P-Q control method based on six control degrees was proposed for a three-phase voltage source converter.Adhikari and Li [13] proposed a P-Q control method with solar photovoltaic, maximum power point tracking (MPPT), and battery storage in the grid-connected mode.Adhikari et al. [14] proposed a two-selected control method using theP-Q control in the load-following mode while the P-V control was in the maximum power point tracking mode.Unfortunately, the design processes of multivariable parameters used in P-Q controllers in the above works rely on deeply empirical rules of the engineers, so the performance under dynamic loads variations often becomes poorer.In fact, the design issue of P-Q controllers is essentially optimally solving a constrained optimization problem, but there are only a few reported works concerning the design of P-Q controllers from the perspectives of constrained optimization.Al-Saedi et al. [16] presented a particle swarm optimization (PSO)-based P-Q control method in grid-connected operation under variable loads conditions.This seminal work has demonstrated the importance of PSO in the automatic tuning of P-Q control parameters for optimized operation during abrupt loads change, but two current control parameters in the designed control system lack the optimization process based on PSO, so it may be considered as an incomplete optimization process for designing P-Q controllers.On the other hand, some popular evolutionary and swarm algorithms have been applied successfully to the optimal control of power converters and power systems [17][18][19], which motivate us to design an effective and efficient optimization algorithm to the optimal P-Q control issue of three-phase grid-connected inverters in a microgrid.
As a novel optimization framework originally inspired by the far-from-equilibrium dynamics of self-organized criticality (SOC) [20], extremal optimization (EO) [21,22] is different from other evolutionary algorithms because it merely selects against the bad instead of favoring the good based on a uniform random or power-law probability distribution.According to the iterated mechanism, EO can be classified into two categories.The first one is the individual-based discrete EO such as the standard EO [21,22] and the self-organized optimization algorithm [23,24] for combinatorial optimization problems, where an individual often represents a discrete sequence, e.g., a cyclic permutation of cities for the traveling salesman problem, and individual-based iterated operations including selection and discrete mutations, e.g., the 2-Opt, 3-Opt, and Lin-Kernighan (LK) rules for TSP are adopted.In the binary-coded EO (BCEO) algorithm [25], a set of decision variables of a continuous optimization problem are coded as a binary string, and the power law-based selection and binary mutation operate on this binary string.The second is the population-based continuous EO by using population iterated operations, e.g., polynomial mutations and multi-non-uniform mutations.A variety of simulation and experimental results on different kinds of benchmark and real-world engineering optimization problems have shown that EO and its modified algorithms perform better than or at least the same as other popular evolutionary algorithms such as genetic algorithm (GA) and PSO [26].In the past decade, some modified EO algorithms have been applied to the optimal design issue of PID and fractional-order PID controllers for complex control systems [27][28][29][30][31][32][33].To the best of the authors' knowledge, the applications of EO to the optimal P-Q control of power converters have never been reported.
Encouraged by the aforementioned analysis, a novel intelligent P-Q control method is proposed for three-phase grid-connected inverters in a microgrid by using an adaptive population-based extremal optimization (APEO).The proposed method formulates the optimal P-Q control issue of three-phase grid-connected inverters in a microgrid as a typical constrained optimization problem firstly, where six parameters of decoupled PI controllers are real-coded as the decision variables and the integral time absolute error (ITAE) between the output and referenced active power and the ITAE between the output and referenced reactive power are weighted as the objective function.Then, an effective and efficient APEO algorithm with an adaptive mutation operation is proposed to solve this optimal issue.
The major contributions of this work are described as follows: (1) To the best of the authors' knowledge, the adaptive population-based extremal optimization is applied firstly to the optimal P-Q control issue of three-phase grid-connected inverters in a microgrid.(2) The superiority of the proposed method is demonstrated by both the simulation and experimental results for a three-phase grid-connected inverter in a microgrid.In fact, the previous reported PSO-based P-Q control method [16] was tested only using its simulation results.(3) In cases of both nominal and variable reference active power values, the proposed APEO-based P-Q control method can improve the performance of a three-phase grid-connected inverter in a microgrid compared to the traditional Z-N empirical method, the adaptive GA-based, and the PSO-based P-Q control methods.
The rest of this paper is structured as follows.Section 2 presents the preliminaries concerning grid-connected inverters and extremal optimization.In Section 3, an intelligent P-Q control method is designed for grid-connected inverters in a microgrid based on adaptive population EO.Section 4 gives the simulation results on a three-phase grid-connected inverter.Moreover, in order to further validate the superiority of the proposed APEO-based P-Q control method, the experimental results on a real 3 kW three-phase grid-connected inverter in a microgrid are presented in Section 5. Finally, the conclusion and open problems are given in Section 6.

Problem Formulation
Figure 1 shows the circuit diagram and the corresponding P-Q control scheme for a three-phase grid-connected inverter in a microgrid [16,34].Here, V dc is the DC voltage provided by a distribution generation unit, C d and C f are the capacitance of the DC side and the LC filter, respectively, L f represents the equivalent inductance of the LC filter, and R f is the equivalent resistance of the LC filter.The P-Q control scheme consists of the following key operations: the grid-side voltage, a current and phase detector, an inverter-side voltage and current detector, active and reactive power calculation, an active power PI controller, a reactive power PI controller, a current PI controller, abc/dq and dq/abc transformations, and space vector pulse width modulation (SVPWM).effective and efficient APEO algorithm with an adaptive mutation operation is proposed to solve this optimal issue.The major contributions of this work are described as follows: (1) To the best of the authors' knowledge, the adaptive population-based extremal optimization is applied firstly to the optimal P-Q control issue of three-phase grid-connected inverters in a microgrid.(2) The superiority of the proposed method is demonstrated by both the simulation and experimental results for a three-phase grid-connected inverter in a microgrid.In fact, the previous reported PSO-based P-Q control method [16] was tested only using its simulation results.
(3) In cases of both nominal and variable reference active power values, the proposed APEO-based P-Q control method can improve the performance of a three-phase grid-connected inverter in a microgrid compared to the traditional Z-N empirical method, the adaptive GA-based, and the PSO-based P-Q control methods.
The rest of this paper is structured as follows.Section 2 presents the preliminaries concerning grid-connected inverters and extremal optimization.In Section 3, an intelligent P-Q control method is designed for grid-connected inverters in a microgrid based on adaptive population EO.Section 4 gives the simulation results on a three-phase grid-connected inverter.Moreover, in order to further validate the superiority of the proposed APEO-based P-Q control method, the experimental results on a real 3 kW three-phase grid-connected inverter in a microgrid are presented in Section 5. Finally, the conclusion and open problems are given in Section 6.

Problem Formulation
Figure 1 shows the circuit diagram and the corresponding P-Q control scheme for a three-phase grid-connected inverter in a microgrid [16,34].Here, Vdc is the DC voltage provided by a distribution generation unit, Cd and Cf are the capacitance of the DC side and the LC filter, respectively, Lf represents the equivalent inductance of the LC filter, and Rf is the equivalent resistance of the LC filter.The P-Q control scheme consists of the following key operations: the grid-side voltage, a current and phase detector, an inverter-side voltage and current detector, active and reactive power calculation, an active power PI controller, a reactive power PI controller, a current PI controller, abc/dq and dq/abc transformations, and space vector pulse width modulation (SVPWM).The block diagram of decoupled P-Q controllers for a three-phase grid-connected inverter in a microgrid is presented in Figure 2. The active and reactive powers of the inverter denoted as P and Q, respectively, are computed as follows: where v od and v oq are the d-coordinate and q-coordinate of the grid-side voltage, respectively, and i od and i oq are the d-coordinate and q-coordinate of the grid-side current, respectively.
The block diagram of decoupled P-Q controllers for a three-phase grid-connected inverter in a microgrid is presented in Figure 2. The active and reactive powers of the inverter denoted as P and Q, respectively, are computed as follows: where vod and voq are the d-coordinate and q-coordinate of the grid-side voltage, respectively, and iod and ioq are the d-coordinate and q-coordinate of the grid-side current, respectively.The transfer functions of active and reactive power PI controllers denoted as GP(s) and GQ(s) are defined as follows: where Pref and Qref are the reference values of active and reactive powers, respectively; idr and iqr1 are the output values of the active and reactive PI controllers, respectively; Kp1 and Ki1 are the proportional and integral parameters of the active PI controller, respectively; Kp2 and Ki2 are the proportional and integral parameters of reactive PI controller, respectively.The reference voltage signals in the dq frame of SVPWM is defined as follows: where id and iq are the d-coordinate and q-coordinate of the inverter-side current, respectively; Kp3 and Ki3 are the proportional and integral parameters of the current PI controller, respectively; w is the The transfer functions of active and reactive power PI controllers denoted as G P (s) and G Q (s) are defined as follows: where P ref and Q ref are the reference values of active and reactive powers, respectively; i dr and i qr1 are the output values of the active and reactive PI controllers, respectively; K p1 and K i1 are the proportional and integral parameters of the active PI controller, respectively; K p2 and K i2 are the proportional and integral parameters of reactive PI controller, respectively.The reference voltage signals in the dq frame of SVPWM is defined as follows: x q = (i qr − i q )/s (7) where i d and i q are the d-coordinate and q-coordinate of the inverter-side current, respectively; K p3 and K i3 are the proportional and integral parameters of the current PI controller, respectively; w is the angular frequency; and i qr is the reference input of the q-coordinate of the current PI controller, i.e., i qr = w × C f × v od −i qr1 .Note that i dr is also the reference input of the d-coordinate of the current PI controller.
In order to manage the active and reactive power of each distributed generation in a microgrid under the grid-connected mode, the design issue of an optimal P-Q controller with six parameters, including K p1 , K i1 , K p2 , K i2 , K p3 , and K i3 , can be formulated as a typical constrained optimization problem.More specifically, six parameters of decoupled PI controllers are real-coded as decision variables and the integral time absolute error (ITAE) between the output and referenced active power and the ITAE between the output and referenced reactive power are weighted as a minimized function.The complete formulation of the optimal P-Q control issue for a three-phase grid-connected inverter is as follows: minF(x) = w 1 where P ref and Q ref are the referenced active and reactive powers, respectively; w 1 and w 2 are the weighted coefficients; T max is the maximum time of the time window; l 1 , l 2 , l 3 , l 4 , l 5 , and l 6 are the lower limits of K p1 , K i1 , K p2 , K i2 , K p3 , and K i3 , respectively; and u 1 , u 2 , u 3 , u 4 , u 5 , and u 6 are the upper limits of K p1 , K i1 , K p2 , K i2 , K p3 , and K i3 , respectively.

The Proposed Method
In this section, an intelligent P-Q control method is presented for three-phase grid-connected inverters in a microgrid by using an adaptive population-based extremal optimization algorithm (APEO).The key idea behind the proposed method is firstly formulating the optimal P-Q control of grid-connected inverters in a microgrid as a typical constrained optimization problem shown as Equation (8).Then, an effective and efficient APEO algorithm with an adaptive mutation operation is designed to solve this optimization problem.
The detailed steps of the proposed algorithm are described as follows: Input: The model of a three-phase grid-connected inverter with P-Q controllers, a sampling period T s , the lower limits constraints (l 1 , l 2 , l 3 , l 4 , l 5 , l 6 ) and upper limits constraints (u 1 , u 2 , u 3 , u 4 , u 5 , u 6 ) of the P-Q control parameters (K p1 , K i1 , K p2 , K i2 , K p3 , K i3 ), the weight coefficients w 1 and w 2 used for evaluating the objective function, a population size of N, the maximum number of iterations I max , and the shape parameter b of the adaptive mutation operation.
Output: The best solution S best (the best control parameters K po1 , K io1 , K po2 , K io2 , K po3 , K io3 ), the corresponding global fitness F best , the real-time curve of the active and reactive power, and the current waveform of the transformer.
Step1: Generate a random initial real-coded population P I = {S 1 , S 2 , . . ., S N }, where the population size N is generally set as an even number, each solution S i represents a real-coded sequence of six control parameters including K p1 , K i1 , K p2 , K i2 , K p3 , K i3 , and set P = P I .More specifically, the generated process of S i is S i = L + R i (U − L), i = 1, 2, . . ., N, where L = (l 1 , l 2 , l 3 , l 4 , l 5 , l 6 ) and U = (u 1 , u 2 , u 3 , u 4 , u 5 , u 6 ), and R i is a set of randomly generated values between 0 and 1.
Step 2: Evaluate the fitness {F i , i = 1, 2, . . ., N} of each solution S i in population P by means of Equation ( 8) firstly.Then rank all the solutions {S i , i = 1, 2, . . ., N} in ascending order of the fitness values {F i , i = 1, 2, . . ., N}, which means obtaining a permutation Π of the labels i such that.Set the best fitness of the current iteration as F best = F Π(1) and the corresponding best solution S best = S Π(1) .
Step4: Generate a new population P N = {S N1 , S N2 , . . ., S NN } from P M by adopting a multi-non-uniform mutation (MNUM).To be more specific, S Ni is computed by the following equations: where t is defined as the current number of iterations, r and r 1 are the randomly generated numbers between 0 and 1, and b represents the shape parameter, which adjusts the dynamics of the mutation operation.
Step 5: Set S NN = S best and accept P = P N unconditionally.
Step 6: Repeat step 2 to step 5 until some stopping criterion, e.g., the maximum number of iterations I max , is satisfied.
Step 7: Output the best control parameters solution ), the corresponding global fitness F best , the real-time curve of the active and reactive power, and the current waveform of loads.
Figure 3 presents the flowchart of APEO-based P-Q controllers design algorithm for three-phase grid-connected inverters.From the design perspective of the evolutionary algorithm, the proposed APEO-based P-Q controller design algorithm for three-phase grid-connected inverters has only the selection and mutation operations.Moreover, the proposed APEO method has fewer adjustable parameters than the adaptive genetic algorithm (AGA) [35] and the particle swarm optimization (PSO) [16].More specifically, except for the maximum number of iterations I max and the population size N, only one shape parameter b needs to be tuned in the proposed APEO algorithm.However, two additional adjustable parameters in AGA and five additional parameters in PSO need be tuned for a specific practical three-phase grid-connected inverter.In this sense, the proposed APEO-based P-Q controller design algorithm can be considered as being simpler than the AGA and PSO-based P-Q control methods.In addition, the superiority of the proposed APEO method to the AGA and PSO-based P-Q algorithms will be verified by the simulation and experimental results on a three-phase grid-connected inverter in a microgrid under both nominal and variable reference active power values in the next two sections.

Test for Benchmark Functions
Here, five benchmark functions shown in Table 1 are chosen from the literature [36] to illustrate the superiority of the proposed APEO algorithm to other popular optimization algorithms, such as the genetic algorithm (GA) [36], PSO [36], the original population-based extremal optimization version with lévy mutation termed as PEO [37], the hybrid PSO-EO algorithm [36], and the real-coded PEO with polynomial mutation termed as RPEO-PLM [38].For the fair comparison, the parameters settings of GA, PSO, PEO, PSO-EO, and RPEO-PLM algorithms are the same as those in Reference [36,38].The shape parameter b used in the APEO algorithm is set as b = 5.The number of maximum iterations is set the same as that in References [36,38], which is 20,000 for F1, F2, and F3; 10,000 for F4;and 100,000 for F5.Similarly, the popular size is set as follows: N = 10 for F1 and F3, and N = 30 for the other three functions.Each algorithm has been implemented by 20 independent runs for each function.
Table 2 compares the performance of APEO, GA, PSO, PEO, PSO-EO, and RPEO-PLM for the five test functions.Note that their performance is evaluated by the statistical results including the best values, average values, worst values, and the standard deviation of the 20 optimized fitness.The best performance is in bold.Clearly, APEO achieves the best performance for F1, F2, and F5, and the same performance as PSO, PSO-EO, and RPEO-PLM yet better than GA and PSO for F3 and F4.As a consequence, APEO performs better than or at least competitive with GA, PSO, PEO, PSO-EO, and RPEO-PLM for the five test functions.In other words, APEO can be considered as more suitable than the other popular optimization algorithms for the optimal P-Q control issue of three-phase gridconnected inverters in a microgrid.

Test for Benchmark Functions
Here, five benchmark functions shown in Table 1 are chosen from the literature [36] to illustrate the superiority of the proposed APEO algorithm to other popular optimization algorithms, such as the genetic algorithm (GA) [36], PSO [36], the original population-based extremal optimization version with lévy mutation termed as PEO [37], the hybrid PSO-EO algorithm [36], and the real-coded PEO with polynomial mutation termed as RPEO-PLM [38].For the fair comparison, the parameters settings of GA, PSO, PEO, PSO-EO, and RPEO-PLM algorithms are the same as those in Reference [36,38].The shape parameter b used in the APEO algorithm is set as b = 5.The number of maximum iterations is set the same as that in References [36,38], which is 20,000 for F 1 , F 2 , and F 3 ; 10,000 for F 4 ;and 100,000 for F 5 .Similarly, the popular size is set as follows: N = 10 for F 1 and F 3 , and N = 30 for the other three functions.Each algorithm has been implemented by 20 independent runs for each function.
Table 2 compares the performance of APEO, GA, PSO, PEO, PSO-EO, and RPEO-PLM for the five test functions.Note that their performance is evaluated by the statistical results including the best values, average values, worst values, and the standard deviation of the 20 optimized fitness.The best performance is in bold.Clearly, APEO achieves the best performance for F 1 , F 2 , and F 5 , and the same performance as PSO, PSO-EO, and RPEO-PLM yet better than GA and PSO for F 3 and F 4 .As a consequence, APEO performs better than or at least competitive with GA, PSO, PEO, PSO-EO, and RPEO-PLM for the five test functions.In other words, APEO can be considered as more suitable than the other popular optimization algorithms for the optimal P-Q control issue of three-phase grid-connected inverters in a microgrid.[38] 0 0 0 0 PSO-EO [36] 0 0 0 0 PSO [36] 0 0 0 0 GA [36] 0

Simulation Study for P-Q Control of Three-Phase Grid-Connected Inverter
In order to demonstrate the effectiveness of the proposed APEO-based P-Q controllers design method, this section presents the simulation results for a 3 kW three-phase grid-connected inverter in a microgrid.The six control parameters of P-Q controllers are tuned by traditional Z-N empirical method [39], AGA [35], PSO [16], and APEO.The system parameters for a three-phase grid-connected inverter are as follows: V dc = 320 V, C d = 1120 µF, R f = 0.15 Ω, L f = 2.5 mH, C f = 45 µF.The lower and upper limits of the six parameters used in three decoupled PI controllers are set as l 1 = 0.01, l 2 = 30, l 3 = 0.01, l 4 = 0.00001, l 5 = 0.00001, l 6 = 0.00001, u 1 = 0.03, u 2 = 50, u 3 = 0.03, u 4 = 10, u 5 = 25, u 6 = 500.The sampling time T s is set as 2 × 10 −6 s and the weights parameters w 1 and w 2 are set as 1 and 1, respectively.
The adjustable parameters of AGA, PSO, and APEO for the optimal design of P-Q controllers used in the following simulations are shown in Table 3.It should be noted that all the simulations have been run on the MATLAB2012b software on a 2.50 GHz PC with an i7-6500U processor running on 8 GB of RAM.
Table 3.The adjustable parameter settings of APEO, PSO, and AGA used for the optimal design of the P-Q controllers in a microgrid.
PSO [16] Population size = 30, I max = 30, inertia weight w = 0.6, the upper limit of velocity V max = 0.05, the lower limit of velocity

Case 1: Under Nominal Condition
In the first case, the reference values of the active and reactive powers for the above described three-phase grid-connected inverter are set as P ref = 2500 W and Q ref = 0 Var.Here, each evolutionary algorithm for the parameters optimization of the P-Q controllers has been implemented for 30 independent runs.Table 4 presents the statistical results of AGA, PSO, and APEO such as the minimum (f min ), median (f median ), maximum (f max ), mean (f mean ), and standard deviation (f sd ) values of the final global fitness obtained by the30 independent runs.It is clear that the APEO-based P-Q control method is better than the AGA and PSO-based P-Q controllers in terms of all the performance indices.In order to illustrate the convergence characteristics of the proposed method, Figure 4 presents the comparative convergence process of an independent run associated with the f min value shown in Table 4. Clearly, although the best fitness F bsest of APEO is worse than that of AGA and PSO at the beginning because APEO starts its optimization process from a completely random solution, APEO outperforms AGA and PSO after six iterations.The premature convergence of AGA and PSO for the P-Q controller design is very obvious because their best fitness values have not been improved since the third and fourth iteration in AGA and PSO, respectively.Furthermore, Figure 5 presents the evolutionary process of the six P-Q controller parameters in APEO.In conclusion, APEO is better able to explore the problem space of the P-Q controller for a three-phase grid-connected inverter than AGA and PSO.Table 5 presents the best P-Q controller parameters and the corresponding best performance values, including the fmin value, the settling time of the active and reactive powers denoted as tsP and tsQ, respectively, obtained by the traditional Z-N empirical method, AGA, PSO, and APEO.The active and reactive powers under different control parameters obtained by different methods when the DG unit is connected to the grid are compared in Figure 6.It is clear that the tsP and tsQ obtained by APEO are the least among the four methods.In other words, the response of active and reactive powers obtained by APEO is faster than those by the other methods.Table 5 presents the best P-Q controller parameters and the corresponding best performance values, including the fmin value, the settling time of the active and reactive powers denoted as tsP and tsQ, respectively, obtained by the traditional Z-N empirical method, AGA, PSO, and APEO.The active and reactive powers under different control parameters obtained by different methods when the DG unit is connected to the grid are compared in Figure 6.It is clear that the tsP and tsQ obtained by APEO are the least among the four methods.In other words, the response of active and reactive powers obtained by APEO is faster than those by the other methods.Table 5 presents the best P-Q controller parameters and the corresponding best performance values, including the f min value, the settling time of the active and reactive powers denoted as t sP and t sQ , respectively, obtained by the traditional Z-N empirical method, AGA, PSO, and APEO.The active and reactive powers under different control parameters obtained by different methods when the DG unit is connected to the grid are compared in Figure 6.It is clear that the t sP and t sQ obtained by APEO are the least among the four methods.In other words, the response of active and reactive powers obtained by APEO is faster than those by the other methods.

Case 2: Robustness Test
In order to test the robustness against the variable reference values Pref of different methods, this subsection presents the comparison of the dynamic response of the active and reactive powers under different control parameters obtained by the Z-N empirical method, AGA, PSO, and APEO under the variable reference values of the active power.Here, the variable conditions of the reference active power values are set as the Pref value increases suddenly from 500 W to 2500 W at 0.10 s while Pref decreases suddenly from 2500 W to 500 W at 0.20 s.The dynamic response of the active and reactive powers are compared in Figure 7.The overshoots and settling times of the active and reactive powers obtained by APEO are all the least among the four methods under Pref variance.

Case 2: Robustness Test
In order to test the robustness against the variable reference values P ref of different methods, this subsection presents the comparison of the dynamic response of the active and reactive powers under different control parameters obtained by the Z-N empirical method, AGA, PSO, and APEO under the variable reference values of the active power.Here, the variable conditions of the reference active power values are set as the P ref value increases suddenly from 500 W to 2500 W at 0.10 s while P ref decreases suddenly from 2500 W to 500 W at 0.20 s.The dynamic response of the active and reactive powers are compared in Figure 7.The overshoots and settling times of the active and reactive powers obtained by APEO are all the least among the four methods under P ref variance.

Case 2: Robustness Test
In order to test the robustness against the variable reference values Pref of different methods, this subsection presents the comparison of the dynamic response of the active and reactive powers under different control parameters obtained by the Z-N empirical method, AGA, PSO, and APEO under the variable reference values of the active power.Here, the variable conditions of the reference active power values are set as the Pref value increases suddenly from 500 W to 2500 W at 0.10 s while Pref decreases suddenly from 2500 W to 500 W at 0.20 s.The dynamic response of the active and reactive powers are compared in Figure 7.The overshoots and settling times of the active and reactive powers obtained by APEO are all the least among the four methods under Pref variance.

Experimental Results
IN order to further demonstrate the superiority of the proposed APEO-based P-Q control method compared to the traditional Z-N method, AGA, and PSO-based P-Q controllers design method, this section presents the experimental results on a real 3 kW three-phase grid-connected inverter.The system parameters of the three-phase grid-connected inverter are the same as those in the simulation studies.Figure 8 shows the experimental platform for the P-Q control of a three-phase grid-connected inverter in a microgrid.

Experimental Results
IN order to further demonstrate the superiority of the proposed APEO-based P-Q control method compared to the traditional Z-N method, AGA, and PSO-based P-Q controllers design method, this section presents the experimental results on a real 3 kW three-phase grid-connected inverter.The system parameters of the three-phase grid-connected inverter are the same as those in the simulation studies.Figure 8 shows the experimental platform for the P-Q control of a three-phase grid-connected inverter in a microgrid.

Experimental Results
IN order to further demonstrate the superiority of the proposed APEO-based P-Q control method compared to the traditional Z-N method, AGA, and PSO-based P-Q controllers design method, this section presents the experimental results on a real 3 kW three-phase grid-connected inverter.The system parameters of the three-phase grid-connected inverter are the same as those in the simulation studies.Figure 8 shows the experimental platform for the P-Q control of a three-phase grid-connected inverter in a microgrid.Two experiments have been designed to compare the performance obtained by the traditional Z-N method, AGA, and PSO-based P-Q controllers design methods when the reference value of the active power P ref increases suddenly from 500 W to 2500 W and decreases suddenly from 2500 W to 500 W. The P-Q controller parameters are the same as those shown in Table 3.The experimental dynamic response of the active and reactive powers obtained by the Z-N method, AGA, PSO, and APEO are shown in Figures 9-12, respectively.It is evident that the fluctuation of the experimental active and reactive power obtained by APEO is the least while the fluctuation obtained by Z-N method is the worst.In other words, the transient performance including the overshoots and settling time of the active and reactive powers obtained by APEO are all the best.On the other hand, the experimental results have also indicated that the P-Q control performance obtained by an evolutionary algorithm such as AGA, PSO, and APEO is obviously better than the traditional Z-N empirical method.method is the worst.In other words, the transient performance including theovershoots and settling time of theactive and reactive powers obtained by APEO are all the best.On the other hand, the experimental results have also indicated that the P-Q control performance obtained by anevolutionary algorithm such as AGA, PSO, and APEO is obviously better than the traditional Z-N empiricalmethod.
(a) The active power P obtained by theZ-N empirical method (P: 0.8kW/div, time: 100ms/div) (b) The reactive power Q obtained by theZ-N empirical method (Q: 0.3kVar/div, time: 100ms/div) Figure 9.The experimental dynamic response ofthe active and reactive powersobtained bythe Z-N empirical method when the reference value ofthe active power Prefincreases suddenly from 0.5kW to 2.5kW and decreases suddenly from 2.5kW to 0.5kW.The above experimental results of active and reactive power responses obtained by different methods are slightly worse than the corresponding results, but the superiority of theAPEO-based P-Q control method to other methods is still demonstrated by these experimental results.The difference between the simulation and experimental results is due to the ideal characteristics ofthe three-phase transformer used in thesimulations.In fact, the experimental P-Q control performance of a real threephase grid-connected inverter in a microgrid is further improved by adopting more effective evolutionary algorithms and other advanced control structure, e.g., model predictive control.The above experimental results of active and reactive power responses obtained by different methods are slightly worse than the corresponding results, but the superiority of the APEO-based P-Q control method to other methods is still demonstrated by these experimental results.The difference between the simulation and experimental results is due to the ideal characteristics of the three-phase transformer used in the simulations.In fact, the experimental P-Q control performance of a real three-phase grid-connected inverter in a microgrid is further improved by adopting more effective evolutionary algorithms and other advanced control structure, e.g., model predictive control.

Conclusions and Open Problems
This paper presents a novel APEO-based intelligent decoupled P-Q control method for the optimal P-Q control issue of three-phase grid-connected inverters in a microgrid.The key ideas behind this proposed APEO-based P-Q control method include encoding six parameters of three decoupled PI controllers in a P-Q controller as the real-coded decision variables, evaluating the control performance of a P-Q controller by considering the integral time absolute error (ITAE) between the output and referenced active power and the ITAE between the output and referenced reactive power, and updating the population by using selection and MNUM operations.The APEO-based P-Q control method is simpler than the existing popular evolutionary algorithms such as AGA-based [35] and PSO-based P-Q control algorithms [16] because of the fewer adjustable parameters and simpler operations in the population-based iterated optimization mechanism of the APEO-based P-Q control method.Furthermore, the simulation and experimental results for a 3 kW three-phase grid-connected inverter in a microgrid have demonstrated that the proposed APEO-based P-Q controller is superior to the traditional Z-N empirical method [39], AGA-based P-Q controllers [35], and PSO-based [16] P-Q controllers in terms of the control performances under nominal and variable control objective conditions.As a consequence, the proposed APEO-based P-Q controller design method can be considered as a promising intelligent P-Q control method for the optimal P-Q control issue of power converters in practical engineering systems.Of course, the P-Q controllers of three-phase grid-connected inverters can be optimized by other theoretical PID methods [40].However, the P-Q control performance of three-phase grid-connected inverters can be further improved by adopting multi-objective evolutionary algorithms.Additionally, in future, how to extend the basic idea of the APEO-based P-Q controller to more complex power converters and power systems will be studied.

Figure 1 .
Figure 1.The P-Q control scheme of a three-phase grid-connected inverter in a microgrid.

Figure 1 .
Figure 1.The P-Q control scheme of a three-phase grid-connected inverter in a microgrid.

Figure 2 .
Figure 2. The block diagram of decoupled P-Q controllers for a three-phase grid-connected inverter in a microgrid.

Figure 2 .
Figure 2. The block diagram of decoupled P-Q controllers for a three-phase grid-connected inverter in a microgrid.

Figure 3 .
Figure 3.The flowchart of APEO-based P-Q controllers' design algorithm for three-phase gridconnected inverters.

Figure 3 .
Figure 3.The flowchart of APEO-based P-Q controllers' design algorithm for three-phase grid-connected inverters.

Figure 4 .
Figure 4.The comparison of the convergence process of APEO, PSO, and AGA for P-Q controllers.

Figure 5 .
Figure 5.The evolutionary process of the P-Q controller parameters in APEO.

Figure 4 .
Figure 4.The comparison of the convergence process of APEO, PSO, and AGA for P-Q controllers.

Figure 4 .
Figure 4.The comparison of the convergence process of APEO, PSO, and AGA for P-Q controllers.

Figure 5 .
Figure 5.The evolutionary process of the P-Q controller parameters in APEO.

Figure 5 .
Figure 5.The evolutionary process of the P-Q controller parameters in APEO.

Figure 6 .
Figure 6.The comparison of active (a) and reactive (b) power obtained by different methods when the distributed generation (DG) unit is connected to the grid.

Figure 6 .
Figure 6.The comparison of active (a) and reactive (b) power obtained by different methods when the distributed generation (DG) unit is connected to the grid.

Figure 6 .
Figure 6.The comparison of active (a) and reactive (b) power obtained by different methods when the distributed generation (DG) unit is connected to the grid.

Figure 8 .Figure 7 .
Figure 8.The experimental platform of the P-Q control for three-phase grid-connected inverters in a microgrid.Two experiments have been designed to compare the performance obtained by the traditional Z-N method, AGA, and PSO-based P-Q controllers design methods when the reference value of the active power Pref increases suddenly from 500 W to 2500 W and decreases suddenly from 2500 W to 500 W. The P-Q controller parameters are the same as those shown in Table3.The experimental dynamic response of the active and reactive powers obtained by the Z-N method, AGA, PSO, and APEO are shown in Figures9-12, respectively.It is evident that the fluctuation of the experimental active and reactive power obtained by APEO is the least while the fluctuation obtained by Z-N

Figure 7 .
Figure 7.The dynamic response of the active (a) and reactive (b) powers under different control parameters obtained by different methods when the set value of the active power Pref increases suddenly from 0.5 kW to 2.5 kW at 0.10 s and decreases suddenly from 2.5 kW to 0.5 kW at 0.20 s.

Figure 8 .
Figure 8.The experimental platform of the P-Q control for three-phase grid-connected inverters in a microgrid.Two experiments have been designed to compare the performance obtained by the traditional Z-N method, AGA, and PSO-based P-Q controllers design methods when the reference value of the active power Pref increases suddenly from 500 W to 2500 W and decreases suddenly from 2500 W to 500 W. The P-Q controller parameters are the same as those shown in Table3.The experimental dynamic response of the active and reactive powers obtained by the Z-N method, AGA, PSO, and APEO are shown in Figures9-12, respectively.It is evident that the fluctuation of the experimental active and reactive power obtained by APEO is the least while the fluctuation obtained by Z-N

Figure 8 .
Figure 8.The experimental platform of the P-Q control for three-phase grid-connected inverters in a microgrid.

Figure 9 .
Figure 9.The experimental dynamic response of the active and reactive powers obtained by the Z-N empirical method when the reference value of the active power P ref increases suddenly from 0.5 kW to 2.5 kW and decreases suddenly from 2.5 kW to 0.5 kW.

Figure 10 .
Figure 10.The experimental dynamic response of theactive and reactive powersobtained by AGA when the reference value of theactive power Pref increases suddenly from 0.5kW to 2.5kW and decreases suddenly from 2.5kW to 0.5kW.

Figure 10 .
Figure 10.The experimental dynamic response of the active and reactive powers obtained by AGA when the reference value of the active power P ref increases suddenly from 0.5 kW to 2.5 kW and decreases suddenly from 2.5 kW to 0.5 kW.

Figure 11 .
Figure 11.The experimental dynamic response of theactive and reactive powersobtained by PSO when the reference value of theactive power Prefincreases suddenly from 0.5kW to 2.5kW and decreases suddenly from 2.5kW to 0.5kW.

Figure 11 .
Figure 11.The experimental dynamic response of the active and reactive powers obtained by PSO when the reference value of the active power P ref increases suddenly from 0.5 kW to 2.5 kW and decreases suddenly from 2.5 kW to 0.5 kW.

Figure 12 .
Figure 12.The experimental dynamic response of theactive and reactive powersobtained by APEO when the reference value ofthe active power Prefincreases suddenly from 0.5kW to 2.5kW and decreases suddenly from 2.5kW to 0.5kW.

Figure 12 .
Figure 12.The experimental dynamic response of the active and reactive powers obtained by APEO when the reference value of the active power P ref increases suddenly from 0.5 kW to 2.5 kW and decreases suddenly from 2.5 kW to 0.5 kW.

Table 1 .
The five benchmark functions.

Table 2 .
The comparative performance of APEO and the other popular optimization algorithms for test functions.

Table 4 .
The statistical performance of AGA, PSO, and APEO for designing P-Q controllers.

Table 5 .
The parameters of the best-decoupled PI controllers and the corresponding best performance obtained by different P-Q control methods.

Table 5 .
The parameters of the best-decoupled PI controllers and the corresponding best performance obtained by different P-Q control methods.

Table 5 .
The parameters of the best-decoupled PI controllers and the corresponding best performance obtained by different P-Q control methods.