1. Introduction
In modern power systems, maintaining terminal voltage stability is critical for efficient and reliable operation. These parameters significantly impair the performance of other operating equipment connected to power systems and have a substantial impact on the equipment’s life expectancy, which in turn affects system productivity and operation. As a result, control devices have been implemented and integrated into power systems’ grids to overcome any disturbance in the terminal voltage and sustain the operation limits or the reference settings. The generation unit is the primary source of power that supplies the load and enables system operation. If different power plants or generation units are connected, they should be synchronized to supply the load with constant voltage and frequency and avoid any failure or system instability. Power plants may be renewable energy, such as solar, wind, hydrothermal, biomass, and tidal power plants, or may be non-renewable, such as fossil fuel gas turbines, diesel generators, steam turbines, nuclear power plants, and gas–steam combined cycle [
1,
2].
An Automatic Voltage Regulator (AVR) is used to regulate the terminal voltage of synchronous generators through controlling the excitation voltage on the rotor. The terminal voltage is directly proportional to the reactive power or power factor of the synchronous generators. The main objective of an AVR is to maintain the voltage within the reference or nominal values. The AVR should be stable, efficient, and robust to disturbances, such as load variations, faults, and short circuits. A controller is installed in the AVR system to enhance its stability and dynamic response. Controllers, such as Proportional–Integral–Derivative (PID) [
3], Proportional–Integral (PI), Proportional–Integral–Derivative–Acceleration (PIDA) [
4], Fuzzy Logic [
5], and Fractional PID (FPID) [
6], maintain the terminal voltage in a closed-loop system. They sense the voltage across the terminals and compare it to the reference, producing an error signal that should be minimized. Therefore, the objective of an AVR system is to minimize the error signal through an objective function, ensuring system stability with fast time and frequency responses. These controllers’ parameters are tuned by optimization techniques and arithmetic algorithms according to the system’s dimensions.
In recent years, optimization techniques have been widely applied to Automatic Voltage Regulator (AVR) controller tuning to improve stability, robustness, and dynamic performance. Traditional tuning methods often face limitations when dealing with system nonlinearities, parameter uncertainties, and the trade-off between the transient response and steady-state accuracy. To address these challenges, researchers have adopted metaheuristic and hybrid optimization algorithms, which effectively balance exploration and exploitation to determine the optimal controller parameters. Nature-inspired and AI-driven algorithms have demonstrated superior performance by achieving faster convergence and avoiding local optima [
7,
8]. Incorporating these techniques into AVR systems enables significant improvements in overshoot reduction, settling time, and voltage regulation under dynamic operating conditions, establishing optimization-based controller design as a promising solution for modern power systems. Some of the intelligent algorithms are gradient-based optimization (GBO) [
9], artificial rabbit optimization (ARO) [
10], Sand Cat Swarm Optimization (SCSO) [
11], the whale optimization algorithm (WOA) [
12], particle swarm optimization (PSO) [
13], and teaching–learning-based optimization (TLBO) [
14].
Research studies have been conducted in this area to select the fastest and most robust optimization techniques to tune a controller’s parameters for the fastest transient response and enhanced AVR performance in a grid under different disturbance and loading conditions [
15]. A recent research paper surveyed AVR systems connected to a PID controller tuned using various optimization algorithms developed over the past two decades. A comparison was made between the grasshopper optimization algorithm (GOA) and vortex search algorithm (VSA), with both demonstrating better performance than the PSO algorithm [
16]. Another study comparing the WOA and moth–flame optimization (MFO) using PID controllers showed that the WOA achieved superior performance, but the maximum overshoot was only reduced [
17]. Researchers have continued to work on optimizing AVR systems due to their critical role in power generation units and substations. A hybrid optimization of the exponential distribution optimization algorithm (EDO) and transit search optimization algorithm (TSOA) was used to tune a PID controller, resulting in better time and frequency responses than GOA and TLBO. A hybrid fireworks algorithm (FWA) and WOA were also used to tune a PIDD2 controller for an AVR system to analyse the stability, track the trajectory, reject disturbances, and manage parameter uncertainty. Recent papers have also studied AVR systems tuned by different controllers to improve the stability performance, as shown in
Table 1. The table presents the types of optimizations, controllers, and comparisons with other optimization algorithms using the same controller [
15].
In this paper, Non-Monopolize Optimization (NO) is proposed to tune PID and PIDA controllers and enhance the performance of an Automatic Voltage Regulator (AVR) system. The proposed method is benchmarked against several state-of-the-art optimization techniques through comprehensive simulations, including a step response, frequency response (Bode plots), and root locus analysis. The robustness is further validated under load variations of ±50%, demonstrating stable dynamic performance under fluctuating operating conditions. While numerous metaheuristic optimization techniques have been applied to AVR systems, many suffer from premature convergence, high computational costs, or improvements limited to either the time-domain or frequency-domain performance, with insufficient robustness to load disturbances. To bridge this gap, the NO algorithm introduces a lightweight, metaphor-free, and adaptive search mechanism that achieves superior transient and frequency responses while maintaining high robustness, thereby providing a more reliable and efficient solution for modern power systems.
This paper is organized into six sections.
Section 1 introduces AVR systems and their impact on power systems.
Section 2 discusses the components of AVR systems.
Section 3 presents the controllers used in the MATLAB simulation and outlines the optimization techniques applied.
Section 4 examines various objective functions used in AVR systems to minimize errors and enhance stability.
Section 5 presents the simulation results, including a comparison with previously studied methods to evaluate the stability, response, and robustness of the AVR system. Finally,
Section 6 concludes the paper and summarizes the key findings.
4. Objective Function
The objective function aims to minimize the voltage error (ΔVe) between the reference voltage and the terminal voltage of the generator. The most common objective functions in AVR systems for error minimization are Integrated Absolute Error (IAE), Integrated Squared Error (ISE), Integrated Time-weighted Squared Error (ITSE), and Integral Time-weighted Absolute Error (ITAE). These are represented by Equations (6), (7), (8), and (9), respectively.
In control system optimization, the IAE weights all errors equally, but this typically results in a slower response and longer settling time. The ISE is more sensitive to initial errors and penalizes large deviations more heavily. The ITSE balances the need to suppress large errors and sustain penalized late errors. It is used more in research and mathematical modelling. The ITAE is the most widely used objective function in industries due to its ability to produce low overshoot and short settling times. It is characterized by a fast response and quick error reduction as it adds a weighting factor based on the time. As a result, the ITAE is the best objective function used in AVR systems, and it is used in process industries [
33]. The final transfer function of the system, after integrating the controller whose parameters are optimized using the selected objective function, is shown in
Figure 2.
5. Results
After performing the step response simulation in MATLAB Simulink, several key analyses were conducted for each controller type, including a 1 p.u. step response, Bode plots, and root locus diagrams. A comprehensive comparison of the PID and PIDA controllers was carried out to identify the most effective optimization technique for tuning the controller parameters. The goal was to achieve optimal power system stability, high time-domain performance, fast frequency response, and strong robustness under load variations.
The transient response was evaluated based on the terminal voltage of the synchronous generator. The best time response, or the benchmark, was indicated by a minimal overshoot () that was nearly equal to zero, the shortest rise time (), a reduced settling time at 5% or 2% (), and an improved steady-state error () that was nearly equal to 1. The time-domain performance was further assessed using a root locus analysis, from which the eigenvalues and damping ratios were extracted. The fastest time response had the highest damping ratio, nearly equal to one (close to the x-axis), and more negative real parts for the eigenvalues that indicate more system stability.
The frequency response was assessed using Bode diagrams, which provide the peak margin, gain margin, phase margin, and delay margin. The best frequency stability was characterized by the highest gain margin, the biggest phase margin (180 degrees), infinite delay margin, and zero peak margin. The controller parameters for each optimization technique were compared under the same conditions to determine the best AVR system performance. Furthermore, a robust analysis was performed on the best optimization technique to emphasize the power system’s stability and the speed of time response under various loading conditions. The stability should be within 5% of the nominal voltage or reference, and the time response should be within the normal condition ranges with minimal overshoot, rise time, settling time, and unity steady-state error.
5.1. AVR Connected to PID Controller
The PID controller was tuned using several optimization techniques, including the Non-Monopolize Optimization (NO), whale optimization algorithm (WOA), teaching-–earning-based optimization (TLBO), golf optimization algorithm (GOA), artificial bee colony (ABC), and artificial rabbits’ optimization (ARO). The controller gains (, and ) were constrained within the range [0, 1], and the optimization was conducted with a maximum of 100 iterations.
Figure 3 shows the step responses of the AVR system using the PID controller that was tuned by the different optimization techniques. The corresponding controller parameters and performance metrics are summarized in
Table 3. The results indicate that the NO provided the lowest overshoot among all the techniques. The settling times were generally similar across all methods. Final evaluation of each optimization technique’s effectiveness was based on both the time and frequency response metrics.
Figure 4 presents the Bode diagram for the NO-PID controller only. The other optimization techniques are illustrated in
Figure 5 for the frequency response analysis. The phase, gain, delay, and peak margins are calculated, analysed, and presented in
Table 4. The NO-PID controller demonstrated the best frequency-domain performance, with the highest gain, phase, and delay margins, and the lowest peak margin.
The root locus diagram is calculated in
Figure 6 for the NO-PID. The eigenvalues and damping ratios for all the techniques are presented in
Table 5. The NO-PID controller achieved the highest damping ratio and more negative poles, indicating the fastest time response compared to the other techniques.
5.2. AVR Connected to PIDA Controller
The PIDA controllers had different margins compared to the PID controllers. The margins of PIDA controllers were as follows:
For the PIDA controller, the transient response was also tested using various optimization methods: NO, WOA, TLBO, hybrid harmony search and dwarf mongoose optimization (HS/DMOA), current search (CS), BAT algorithm, and genetic algorithm (GA). This was conducted by a comparison with previous works in the literature [
12,
14,
29,
30,
31].
Figure 7 illustrates the step response of the PIDA controllers.
Table 6 contains the controller parameters and performance outcomes. Among these, the NO-PIDA achieved the lowest overshoot, while all techniques yielded similar rise times around 0.5 s. Both the NO and WOA showed the best settling times.
The frequency response analysis for the NO-PIDA controller is shown in
Figure 8 and compared to the others as indicated in
Figure 9. The analysis of the frequency response that was conducted on the optimization techniques used for the PIDA controller and the margins are indicated in
Table 6 and
Table 7. The NO-PIDA had the highest phase margin, gain margin, delay margin, and negligible peak margin. Although several methods had similar phase and delay margins, the NO-PIDA had a notably higher gain margin.
To assess the time response further, the root locus for the NO-PIDA is presented in
Figure 10. The eigenvalues and damping ratios are listed in
Table 8 for the different optimization techniques using the PIDA controller. The NO-PIDA controller demonstrated the best time response characteristics, featuring more negative poles and one of the highest damping ratios, approaching a value of 1—indicative of excellent time response and stability.
5.3. Robust Analysis of NO for PIDA Controller
The operating point and the power system parameters depend on the load variation. As a result, a study was performed on the AVR parameters to reflect a variation in loads, with variations from 50% to −50% of their nominal values (time constant). The NO-PIDA was studied as it had the best power system stability and fastest time and frequency responses. The variations in the load on the amplifier, generator, exciter, and sensor are presented in
Figure 11,
Figure 12,
Figure 13, and
Figure 14, respectively.
Table 9 shows the performance (maximum overshoot, settling time, and rise time) of the AVR system using the NO-PIDA, and
Table 10 shows the maximum deviation and its percentage for the variation in load. The results emphasis the robustness of AVR system, where the maximum deviation is acceptable and power system stability is achieved during transients.
6. Conclusions
This paper shows how to fully combine the Non-Monopolize Optimization (NO) method with the tuning of both PID and PIDA controllers for AVR systems to adjust the terminal voltage in the synchronous generator. The NO algorithm is different from other metaheuristics since it has a tuning process that does not use metaphors and is expeditious. It had the best transient stability and fastest time response and frequency response compared to other techniques that use the same controllers. With the PID controller, compared to the others, the NO showed the lowest overshoot of 1.0622 p.u., the highest gain margin of 41.24 dB and phase margin of 176.05 degrees, and the biggest damping ratio. The results show a significant output for the simple PID controller compared to other modern controllers. The NO-PIDA controller had the best transient stability of 1 p.u. overshoot, the fastest frequency stability with a 43.07 dB gain margin and a 180-degree phase margin, and the highest dynamic behaviour with more negative eigenvalues and damping ratios near to 1.
A robust analysis of the NO-PIDA controller was performed to study a loading variation of ±50% on the transient stability, and showed a stable, robust, and efficient AVR system model. These results show that the NO could be a good alternative to the complicated, multi-agent optimizers used in power systems. In the future, this technology may be expanded to work with several machines, different modern controllers, and its performance may be tested on experimental testbeds to see if it can be used in grid-connected generators and smart microgrids.
In future research, the proposed NO approach could be further enhanced by combining it with other optimization techniques to achieve even better AVR system performance. Beyond MATLAB/Simulink simulations, a transition to real-time implementation is planned to validate the findings experimentally and assess their industrial applicability. A hardware-based AVR system will be developed with embedded control platforms, sensors, and power electronic components to monitor the parameters and regulate the terminal voltage. Experimental testing will include step and frequency response evaluations, with particular attention to noise sensitivity, unmodelled system dynamics, and statistical error margins under different dynamic load conditions. These investigations will provide deeper insights into the reliability and robustness of the proposed method, ensuring its suitability for practical power system applications.