Abstract
This paper proposes a multi-strategy improved pied kingfisher optimizer (MSIPKO), a novel metaheuristic algorithm designed to address constrained optimization problems (COPs). COPs are widely encountered in engineering and industrial applications and are characterized by complex constraints that restrict the feasible solution space and often lead to multiple local optima. To enhance the performance of the original pied kingfisher optimizer (PKO), three strategies are incorporated: (i) a reverse differential crossover mechanism to improve global exploration and maintain population diversity; (ii) an enhanced diving-fishing operator to strengthen local exploitation; and (iii) an improved commensalism phase to enrich search directions and increase robustness. The performance of MSIPKO is evaluated on 12 benchmark functions from the IEEE Congress on Evolutionary Computation 2006 (CEC 2006) test suite and six classical engineering optimization problems. Experimental results demonstrate that MSIPKO outperforms several state-of-the-art algorithms in terms of optimization accuracy, convergence speed, and stability, particularly for high-dimensional, nonlinear, and multi-constrained problems. Moreover, MSIPKO achieves superior or comparable solutions with fewer function evaluations, indicating its high efficiency and adaptability. These results confirm that MSIPKO is a promising tool for solving complex real-world constrained optimization problems. Future work will focus on extending the proposed algorithm to multi-objective and large-scale optimization scenarios.
1. Introduction
Constrained optimization problems are a common challenge in the field of optimization. In real-world engineering scenarios, such as production planning and scheduling, most problems are subject to various constraints due to the scarcity of resources in the production process or technological limitations. Therefore, effectively solving such problems is of critical importance.
Compared to unconstrained optimization problems, constrained optimization problems are more complex due to the presence of constraints. When there are numerous constraints, the feasible solution space may become very limited. Additionally, if the feasible regions are disjoint, the problem may have multiple local optimal solutions. As a result, constrained optimization problems are significantly more difficult to solve than unconstrained ones. Research on the solution of these problems holds great theoretical significance and practical value.
1.1. Description of Constrained Optimization
Generally, a constrained optimization problem can be described by Formula (1). which is widely adopted in the literature and also used in our previous work [1].
where represents the objective function. is the i-th inequality constraint in optimization problem in Formula (1), and is the number of inequality constraints. is the j-th equation constraint, and is the number of equation constraints. and are the upper and lower bounds of , respectively. The set that meets all inequality and equality constraints in the search space is called the feasible region of the constrained optimization problem in Formula (1). If a group solution , x is called a feasible solution; otherwise, it is called an infeasible solution.
For (1), the distance from an individual x to the feasible region D is defined by (2).
Here, is called the violation function. represents the violation degree of x in the i-th inequality constraint. represents the violation degree of x in the j-th equation constraint, where is the tolerance parameter of the equation constraint and .
1.2. Related Work
When applying metaheuristic algorithms to constrained optimization problems (COPs), existing studies mainly involve the design of effective constraint-handling strategies, the development of high-performance optimization algorithms, and their applications in various engineering domains.
- (1)
- Constraint-handling methods
From the perspective of constraint handling, classical approaches mainly include the penalty function method [2] and Deb’s rules [3]. The penalty function method incorporates constraint violations into the objective function, while Deb’s rules rank solutions based on feasibility and objective values. These methods are widely used due to their simplicity and ease of implementation. However, they are often sensitive to parameter settings and may suffer from slow convergence or premature stagnation when dealing with complex constrained problems.
To overcome these limitations, several advanced strategies have been proposed, such as transforming constraints into bi-objective formulations [4], the ε-constraint method [5], and dual-population strategies [6]. These approaches improve the balance between constraint satisfaction and objective optimization, thereby enhancing adaptability to complex constrained problems. Nevertheless, they usually introduce additional computational overhead and increase algorithmic complexity.
- (2)
- Swarm intelligence algorithms and their improvements
From the perspective of algorithm design, a wide range of metaheuristic algorithms have been developed in recent years, particularly in the field of swarm intelligence optimization. In the past five years, more than 100 swarm-based optimization algorithms have been proposed, reflecting the rapidly growing research interest in this area [7,8]. Representative examples include Hawkfish Optimization Algorithm (HFOA) [9], Bezier Curve Optimization (BCO) [10], Dung Beetle Optimization (DBO) [11], Polar Lights Optimization (PLO) [12] and Sequoia-ecology-based Metaheuristic Optimization Algorithm (SMOA) [13]. Despite differences in inspiration and mathematical modeling, these algorithms share several common characteristics. Most of them adopt population-based search frameworks and utilize iterative update mechanisms to balance global exploration and local exploitation. In general, they exhibit strong exploration capability in the early search stages and can effectively avoid premature convergence to some extent.
However, these algorithms still face several inherent limitations when applied to constrained optimization problems. Complex constraints often lead to irregular, narrow, or even disconnected feasible regions, which significantly increase the difficulty of locating feasible and high-quality solutions. In such scenarios, many candidate solutions tend to fall into infeasible regions, making it difficult to maintain population diversity within the feasible space. In addition, the presence of multiple disjoint feasible regions may cause algorithms to converge prematurely to local feasible areas, thereby limiting global search capability. Furthermore, achieving an effective balance between exploration and exploitation under strict constraints remains challenging.
Therefore, developing metaheuristic algorithms with stronger adaptability, better diversity maintenance, and more effective search mechanisms for complex constrained spaces remains an important research direction.
To further enhance the performance of metaheuristic algorithms in constrained scenarios, many researchers have proposed improved or hybrid approaches by integrating multiple strategies. For example, Yu [14] proposed an enhanced Aquila Optimizer Algorithm (EAOA) incorporating restart strategies, opposition-based learning, and chaotic local search, and validated its effectiveness on several engineering optimization problems. Sun [15] developed a fuzzy logic-constrained particle swarm optimization algorithm (FILPSO-SCAε), which integrates a Spearman correlation-based adaptive ε constraint-handling method to dynamically balance constraint and objective information. In addition, fuzzy logic is employed to adaptively adjust key parameters, thereby improving search performance. Li [16] introduced an adaptive multi-objective transformation technique (AMaOTCO), which transforms constrained optimization problems into multi-objective ones by combining objective functions with weighted constraint violations, achieving improved convergence efficiency. Furio [17] proposed a hybrid grey wolf–JAYA algorithm (SHGWJA), which integrates elite strategies and adaptive perturbation mechanisms, and employs a penalty function to handle multi-constraint problems. The proposed method has been successfully applied to various engineering applications, such as structural optimization and path planning.
Although these approaches improve convergence behavior and solution quality to some extent, their performance gains often rely on complex hybrid strategies or multiple mechanisms. This may increase algorithmic complexity and reduce general applicability, especially in problems with highly complex constraint structures.
- (3)
- Engineering applications
In practical applications, some studies have integrated algorithm improvements with constraint-handling strategies to address complex engineering optimization problems. These applications span a wide range of domains, including energy system scheduling [18,19,20] and optimal power flow in power systems [21,22]. In addition, various studies have explored more complex constrained scenarios.
For instance, Boualem [23] proposed an adaptive coordinate system-constrained differential evolution algorithm (ACS-CDE), which utilizes multiple coordinate systems and adaptive selection mechanisms to balance exploration and exploitation. Yang [24] developed an improved sandworm optimization algorithm (ISSA) for structural optimization problems, incorporating enhanced initialization and update strategies combined with penalty-based constraint handling. Abdollahzadeh [25] introduced a hybrid algorithm integrating the puma optimizer with neighborhood search for marine route optimization under multiple constraints. Similarly, Wang [26] proposed a multi-population adaptive optimizer (MACSGWO) for UAV path planning in complex three-dimensional environments. Other studies [27,28] have also applied metaheuristic algorithms to solve constrained optimization problems in similar engineering domains. In addition, Chen et al. [29] and Huang et al. [30] demonstrated the effectiveness of improved metaheuristic algorithms in industrial scheduling and portfolio optimization problems, respectively. These studies show that metaheuristic algorithms have achieved promising performance in various engineering applications with complex constraints.
However, despite these successes, most existing approaches are highly problem-dependent and often rely on carefully designed hybrid strategies or constraint-handling mechanisms. As a result, their generalization ability and robustness in handling diverse and highly complex constrained optimization problems remain limited.
- (4)
- Summary of existing studies
Based on the above review, existing studies on constrained optimization problems can be broadly categorized into three main groups: constraint-handling strategies, swarm intelligence optimization algorithms, and their applications in engineering domains.
Constraint-handling strategies, including classical methods such as penalty functions and Deb’s rules, as well as advanced approaches like ε-constraint and multi-objective transformation techniques, provide effective mechanisms for handling feasibility conditions. However, their performance often depends heavily on parameter settings and may introduce additional computational complexity.
Swarm intelligence algorithms and their improved variants have demonstrated strong global exploration capabilities and have been widely applied in solving complex optimization problems. Nevertheless, these algorithms still face challenges in maintaining population diversity and achieving a proper balance between exploration and exploitation, especially in constrained search spaces.
In terms of engineering applications, metaheuristic algorithms have achieved promising results in various domains, such as energy systems, power systems, and structural optimization. However, many of these methods are highly problem-dependent and rely on carefully designed hybrid strategies, which may limit their generalization ability in diverse constrained optimization scenarios.
To further synthesize the above studies, a structured comparison of representative methods in terms of their advantages and limitations is provided in Table 1.
Table 1.
Summary of representative methods for constrained optimization problems.
- (5)
- Discussion and research gaps
Despite the significant progress achieved in constraint-handling strategies, swarm intelligence algorithms, and their engineering applications, several critical challenges remain in solving constrained optimization problems.
First, existing constraint-handling methods often struggle to effectively guide the search process in complex feasible spaces. In problems with irregular, narrow, or disconnected feasible regions, many algorithms tend to generate a large number of infeasible solutions, which reduces search efficiency and hinders convergence toward high-quality feasible solutions.
Second, most swarm intelligence algorithms still face difficulties in maintaining population diversity and achieving a proper balance between global exploration and local exploitation under strict constraint conditions. As a result, these algorithms are prone to premature convergence within local feasible regions, limiting their ability to explore multiple promising areas.
Third, although hybrid and improved algorithms can enhance performance by integrating multiple strategies, their effectiveness often relies on problem-specific designs and carefully tuned parameters. This reduces their robustness and generalization ability when applied to diverse and complex constrained optimization scenarios.
Therefore, there is a need to develop more effective optimization algorithms that can better handle complex constraint structures, maintain population diversity within feasible regions, and achieve a more balanced and robust search process. These challenges motivate the development of the proposed method in this study.
1.3. The Introduction of PKO
The pied kingfisher optimizer (PKO) is a novel swarm intelligence algorithm proposed by Bouaouda [31], inspired by the unique foraging behavior of the pied kingfisher, including hovering, diving, and its symbiotic relationship with Eurasian otters. The algorithm innovatively incorporates three phases: the hovering phase for global search, the diving phase for local exploitation, and the symbiotic phase for balancing exploration and exploitation. By mathematically modeling these behaviors into optimization strategies, PKO has been validated on 29 CEC-2017 benchmark functions and 10 CEC-2020 benchmark functions. Experimental results demonstrate that PKO outperforms many advanced algorithms in terms of solution quality, convergence speed, and avoiding local optima. Despite its superior performance in complex search spaces, PKO has certain limitations. For instance, the algorithm lacks a mutation mechanism, leaving room for improvement in its global search capabilities. Additionally, during the symbiotic phase, the algorithm occasionally chooses to keep the population stationary, which suggests potential enhancements to its search performance in this stage.
However, several limitations have been observed in the original PKO. First, it lacks any explicit mutation or perturbation mechanism throughout its iterative process, which limits the algorithm’s ability to escape local optima. As a result, the population tends to converge prematurely, especially when navigating complex, multimodal, or high-dimensional search spaces where diverse exploratory behavior is crucial. Second, the hovering and diving phases adopt a centralized update strategy that relies heavily on elite or globally best individuals. While this may accelerate convergence in simple landscapes, it significantly reduces the diversity of the population and restricts the algorithm’s capacity to explore less-exploited regions of the search space. In scenarios involving rugged fitness landscapes or disjoint feasible regions, this behavior can severely compromise the global search capability. Third, the symbiotic phase lacks directional learning mechanisms guided by fitness differences or relative advantage among individuals. The update rule often leads individuals to randomly drift toward other peers without considering solution quality, resulting in inefficient local exploitation and slow convergence in the later stages of the search. This inefficiency becomes more pronounced in fine-tuning phases where precision and gradient-like adjustment are essential.
1.4. The Main Contributions and Contents of This Paper
To address the limitations of existing methods in solving complex constrained optimization problems, this paper proposes a multi-strategy improved pied kingfisher optimizer (MSIPKO). The main contributions of this study are summarized as follows:
(1) A reverse differential crossover mechanism is proposed by integrating reverse learning with differential mutation, which effectively enhances global exploration capability and maintains population diversity, especially in complex feasible regions.
(2) An enhanced diving-fishing operator is designed to strengthen local exploitation performance, thereby improving convergence accuracy and accelerating the search process.
(3) An improved commensalism phase with a novel guidance mechanism is introduced to enrich search directions, leading to improved solution quality and robustness of the algorithm.
(4) Extensive experiments on IEEE Congress on Evolutionary Computation 2006 (CEC 2006) benchmark functions and classical engineering optimization problems demonstrate that the proposed MSIPKO achieves competitive or superior performance in terms of optimization accuracy, convergence speed, and stability compared with several state-of-the-art algorithms.
These contributions distinguish MSIPKO from existing hybrid metaheuristic approaches and provide an effective solution for complex constrained optimization problems.
The remainder of this paper is organized as follows. Section 2 introduces the basic pied kingfisher optimizer (PKO). Section 3 presents the proposed MSIPKO in detail. Section 4 reports the experimental results, including benchmark functions and engineering optimization problems. Finally, Section 5 concludes the paper and discusses future research directions.
2. The Process of PKO
The proposal of this algorithm is inspired by the living habits of pied kingfisher, considering their behaviors such as perching, hovering, diving, and symbiosis. The specific process is shown below. The mathematical formulations presented in this section follow the original PKO algorithm proposed in [31].
2.1. Initialization
Similar to many swarm intelligence optimization algorithms, the PKO algorithm initiates the search process by randomly generating a set of initial solutions in the search space as the first attempt. The initial population generation is shown in Formula (3).
where means the position of the i-th individual in the j-th dimension. rand is a random number within the interval [0, 1]. LB and UB respectively represent the lower and upper bounds of the search range.
2.2. Perching and Hovering Strategies (Exploration Phase)
The exploration phase of the PKO algorithm was inspired by the habitat and hovering behavior of pied kingfisher. Based on observations of pied kingfisher in their natural habitats, they alternate between habitat attacks and hovering attacks according to different factors. The location of the individual being searched is updated based on the foraging activities of the pied kingfisher, as shown in Formula (4).
where and respectively represent the solution vector of the i-th individual in iteration and . means the solution vector of the k-th individual in iteration . The population size is N.
The calculation method for parameter is shown in Formula (5).
where randn means random numbers between 0 and 1 that follow a normal distribution. dim is the length of the solution vector , which is the dimension of the objective function.
The parameter T represents the strategy selection of perching or hovering, and the calculation method is shown in Formulas (6)–(9).
2.2.1. Perching
In their habitat strategy, pied kingfishers typically inhabit objects such as trees, rocks, or electrical wires to search for prey. The calculation formula is shown in Formulas (6) and (7).
where is the number of maximum iterations. BF stands for beating factor, which is set to 8 in this algorithm. The crest angle of a pied kingfisher enhances its field of view for detecting prey from a distance and aids in focusing on prey during hunting.
2.2.2. Hovering
In the hovering strategy, the pied kingfisher maintains its position in the air by rapidly flapping its wings, and its mathematical model is shown in Formulas (8) and (9).
where the i-th and j-th individual’s fitness are respectively and .
2.3. Solid Samples Desorption and Sustainability
Pied kingfishers are known for their diving and hunting behavior, which was used for local searches during the development phase. The calculation formula is shown in Formulas (10)–(13).
where and are the parameters related to hunting ability.
2.4. Commensalism Phase (Local Escape Phase)
The symbiotic relationship between pied kingfisher and otters was used to simulate the escape phase, and the calculation formula is shown in Formulas (14) and (15).
where and respectively mean two random individuals of iteration t. PE represents predatory efficiency of the pied kingfisher. , .
2.5. The Flow of PKO
This section presents PKO’s framework in pseudocode form, as shown in Algorithm 1. The pseudocode outlines the three main phases of PKO—hovering exploration, diving exploitation, and commensalism cooperation—and details how these phases are executed within the iterative optimization process.
| Algorithm 1: Pseudocode of PKO | |
| Input: Population total number N; the number of optimization iterations MaxIt. Output: The optimal solution of PKO (Best_fitness), optimal solution vector Xbest. | |
| 1 | Initialize the PKO population positions according to Section 2.1. |
| 2 | Calculate the pied kingfisher fitness values |
| 3 | while (t < MaxIt + 1) do |
| 4 | for i = 1:N do |
| 5 | if (rand < 0.8) then |
| 6 | % Exploration phase |
| 7 | if (rand > 0.5) then |
| 8 | Compute T1 according to Formulas (6) and (7) |
| 9 | Update the position of pied kingfisher using Formula (4) |
| 10 | else |
| 11 | Compute T2 according to Formulas (8) and (9) |
| 12 | Update the position of pied kingfisher using Formula (4) |
| 13 | end |
| 14 | else |
| 15 | % Exploitation phase |
| 16 | Update the position of pied kingfisher using Formula (10) |
| 17 | end |
| 18 | If the newly generated solutions are superior to the previous ones, then replace them. Set best position as the location of best fitness. |
| 19 | if (rand > (1 − PE)) then |
| 20 | Update the position of pied kingfisher using Formulas (14) and (15) |
| 21 | else |
| 22 | Update the position of pied kingfisher using Formulas (14) and (15) |
| 23 | end |
| 24 | Calculate the fitness values of pied kingfisher |
| 25 | If the newly generated solutions are superior to the previous ones, then replace them. Set best position as the location of best fitness. |
| 26 | t = t + 1 |
| 27 | end for |
| 28 | end while |
| 29 | Return Best_fitness and Xbest. |
3. Materials and Methodology
3.1. Overview of the Proposed MSIPKO Algorithm
The original PKO algorithm has demonstrated promising performance in solving optimization problems. However, similar to many population-based metaheuristic methods, it still suffers from several limitations, such as insufficient exploration ability in early iterations, lack of effective mutation mechanisms, and potential premature convergence or slow search speed in later stages when dealing with complex functions.
To address these issues, a multi-strategy improved PKO algorithm (MSIPKO) is proposed in this study. The core idea of MSIPKO is to enhance the balance between global exploration and local exploitation through the integration of multiple complementary strategies.
Specifically, three improvement strategies are introduced. First, a reverse differential crossover mechanism is incorporated to compensate for the lack of mutation in the original PKO and enhance population diversity. Second, during the symbiotic stage, a detour-foraging mechanism inspired by zebrafish behavior is embedded into the second branch of Formula (14) to improve the search capability during the commensalism phase. Finally, a diving-foraging module inspired by pied kingfisher behavior is introduced to strengthen the search efficiency and maintain convergence performance in later iterations.
Through the integration of these strategies, MSIPKO is able to achieve a better balance between exploration and exploitation, thereby improving convergence stability and optimization accuracy. The detailed formulations of the proposed strategies are presented in the following subsections.
3.2. Improvement Strategies
3.2.1. Reverse Differential Crossover Mechanism
In this operator, first, reverse learning is used to simulate the process of reverse searching for food in pied kingfisher, and the calculation formula is shown in Formula (16).
where represents the inverse solution after the t-th iteration.
Subsequently, after merging the original population and the reverse population, differential mutation operations are performed on the resulting population . The specific calculation process is shown in Formulas (17) and (18). This step simulates the process in which pied kingfishers expand their search range and interact with each other within the group to exchange information.
where and are the i-th and k-th individuals after population merging, respectively. means a random vector with the range of [0, 1] of length dimensions.
3.2.2. Enhanced Diving-Fishing Operator
An enhanced operator, as defined in Formulas (19)–(21), is proposed to improve the search efficiency of the pied kingfisher’s diving behavior during the prey-capturing process in the PKO algorithm.
where are three random numbers within the interval [0, 1]. represents any individual in the population other than itself in t-th iteration. is a disturbance variable.
3.2.3. Improvement of the Commensalism Phase
To enhance the search performance of the PKO algorithm, the second branch of Formula (14) was improved to address the issue where individuals might not search toward a better direction. The modified formula is presented as Formulas (22)–(25).
where R is a zoom factor. is a disturbance variable. round means round to the nearest integer.
3.3. The Flow of MSIPKO
MSIPKO is designed as a unified hybrid optimization framework, as shown in Algorithm 2, in which three carefully selected strategies function in a complementary and coordinated manner. This integration is not a simple stacking of heuristics, but a structured synergy aimed at addressing key limitations in the original PKO algorithm. Specifically, the reverse differential crossover enhances global exploration in early stages, the enhanced diving-fishing operator improves local exploitation during convergence, and the improved commensalism phase ensures guided adaptation in later iterations. These strategies work together to improve search diversity, convergence speed, and solution accuracy under complex constraints. Based on this integrated framework, the complete pseudocode of MSIPKO is presented below to illustrate its iterative process.
| Algorithm 2: Pseudocode of MSIPKO | |
| Input: Population total number N; the number of optimization iterations MaxIt. Output: The optimal solution of PKO (Best_fitness), optimal solution vector Xbest. | |
| 1 | Initialize the PKO population positions according to Section 2.1. |
| 2 | Calculate the pied kingfisher fitness values |
| 3 | while (t < MaxIt + 1) do |
| 4 | for i = 1:N do |
| 5 | Implement reverse differential crossover mechanism according to Formulas (16)–(18). |
| 6 | If the newly generated solutions are superior to the previous ones, then replace them. Set best position as the location of best fitness. |
| 7 | if (rand < 0.8) then |
| 8 | % Exploration phase |
| 9 | if (rand > 0.5) then |
| 10 | Compute T1 according to Formulas (6) and (7) |
| 11 | Update the position of pied kingfisher using Formula (4) |
| 12 | else |
| 13 | Compute T2 according to Formulas (8) and (9) |
| 14 | Update the position of pied kingfisher using Formula (4) |
| 15 | end |
| 16 | else |
| 17 | % Exploitation phase |
| 18 | Update the position of pied kingfisher using Formula (10) |
| 19 | end |
| 20 | If the newly generated solutions are superior to the previous ones, then replace them. Set best position as the location of best fitness. |
| 21 | if (rand > (1 − PE)) then |
| 22 | Update the position of pied kingfisher using the first branch of Formulas (14) and (15) |
| 23 | else |
| 24 | Update the position of pied kingfisher using Formulas (19)–(21) |
| 25 | end |
| 26 | Calculate the fitness values of pied kingfisher |
| 27 | If the newly generated solutions are superior to the previous ones, then replace them. Set best position as the location of best fitness. |
| 28 | % Local escape phase |
| 29 | Implement commensalism phase according to Formulas (22)–(25) and (15). |
| 30 | If the newly generated solutions are superior to the previous ones, then replace them. Set best position as the location of best fitness. |
| 31 | t = t + 1 |
| 32 | end for |
| 33 | end while |
| 34 | Return Best_fitness and Xbest. |
3.4. Computational Complexity of MSIPKO Analysis
To assess the computational efficiency of the proposed MSIPKO algorithm, this section compares its theoretical time complexity with the original PKO algorithm. Both algorithms operate under the same population size N, problem dimension D, and maximum number of iterations T.
Table 2 summarizes the time complexity of key modules in both algorithms. Structurally, PKO performs three stages per generation—hovering/perching, diving, and commensalism—each involving scale updates and evaluations. Therefore, the complexity for all iterations is . Considering the initialization, the total complexity is .
Table 2.
Comparison of computational complexity of PKO and MSIPKO modules.
On top of retaining these three stages, MSIPKO introduces one additional module: the reverse differential crossover mechanism, which involves generating reverse individuals and applying differential mutation, contributing an extra computational load per generation. It is important to emphasize that the enhanced diving-fishing operator and the improved commensalism phase in MSIPKO are refined versions of the original PKO operators. These enhancements only adjust local update rules without introducing new loops or global operations, thus do not increase the asymptotic complexity. Consequently, MSIPKO’s per-generation complexity is , and total complexity is . While the constant factor increases slightly, the overall asymptotic order remains unchanged. It should be noted that the above analysis focuses on asymptotic time complexity, whereas the additional module mainly affects the constant computational cost per iteration rather than the overall complexity order.
In addition to the asymptotic time complexity analysis, the computational burden of MSIPKO is further evaluated from a practical perspective. Although the additional module increases the constant computational cost per iteration, the experimental results indicate that MSIPKO generally requires fewer function evaluations to achieve comparable or better solution quality than most competing algorithms. This suggests that the im proved search efficiency effectively compensates for the additional computational overhead.
Therefore, MSIPKO maintains a reasonable computational burden while achieving improved optimization performance, demonstrating a favorable trade-off between computational cost and solution quality. Table 2 presents a module-level comparison of computational cost, reflecting the relative overhead of each component rather than the asymptotic complexity order.
3.5. Experimental Settings and Constraint-Handling Strategy
To ensure a fair and reliable comparison, all experiments are conducted under a unified experimental setting.
To ensure a fair and reliable comparison, all algorithms are implemented in MATLAB R2024a and executed on a macOS-based system equipped with an Apple M3 Pro processor and 18 GB RAM. For each test problem, all algorithms are independently run 30 times to reduce the influence of randomness.
For constrained optimization problems, a static penalty function is adopted. The penalized objective function is defined as Equation (26).
where is the fitness function, is the original objective function, and is called the violation function, whose calculation process is shown in Equation (2). is the penalty coefficient. In this study, is set to 106 for all constrained problems. This formulation ensures that infeasible solutions are strongly penalized and guides the population toward the feasible region during the optimization process.
All compared algorithms use the parameter settings recommended in their original studies to ensure fairness of comparison.
4. Numerical Experiment
This section presents a comprehensive set of experiments to evaluate the performance of the proposed MSIPKO algorithm on constrained optimization problems (COPs). The evaluation is divided into two parts: benchmark problems from the CEC 2006 suite (G01–G12) and six classical engineering design problems.
For the benchmark tests, MSIPKO is compared against nine representative algorithms, including recent methods such as the enzyme action optimizer (EAO) and the starfish optimization algorithm (SFOA), forming a set of ten algorithms in total. All algorithms are tested under unified simulation conditions and use a static penalty function as the default constraint-handling mechanism. Performance is assessed through metrics such as average fitness, best solution, worst solution, and standard deviation. Statistical significance is verified using Wilcoxon signed-rank tests with Bonferroni correction.
Next, a component-wise ablation study is conducted to assess the contribution of each improvement in MSIPKO, by sequentially integrating the proposed strategies into the baseline PKO. Following that, a sensitivity analysis under varying evaluation budgets is performed, examining the algorithm’s ability to converge under six different function evaluations (FEs) limits, ranging from 1000 to 200,000.
Furthermore, a detailed comparison of different constraint-handling strategies (CHMs) is presented. MSIPKO is embedded within multiple CHMs, including static penalty, dynamic penalty, feasibility rules, ε-constrained method, and equality relaxation. This comparison highlights the algorithm’s robustness across diverse constraint environments.
In the second part, six widely studied engineering problems are used to further validate the real-world applicability of MSIPKO. The results confirm its strong and stable performance under practical design constraints.
4.1. Benchmark Functions
In this section, the performance of the proposed MSIPKO algorithm is thoroughly examined. Twelve benchmark functions are used to evaluate its optimization ability, and ten state-of-the-art algorithms are employed for comparison. This section includes five parts: (1) introduction of benchmark functions; (2) simulation setup and statistical analysis; (3) component-wise ablation study of MSIPKO; (4) sensitivity to evaluation budget; and (5) comparison of constraint-handling strategies.
4.1.1. Introduction of Benchmark Functions
The main characteristics of the 12 functions are shown in Table 3. Among them, n is the number of decision variables. ρ is the estimated ratio between the feasible region and the search space. LI is the number of linear inequality constraints. NI is the number of nonlinear inequality constraints. LE is the number of linear equality constraints, and NE is the number of nonlinear equality constraints. is the number of active constraints.
Table 3.
The characteristics of CEC 2006 benchmark functions (G01–G12).
4.1.2. Comparative Evaluation of 10 Algorithms: Simulation Setup and Statistical Analysis
- (1)
- Simulation settings
In order to verify MSIPKO’s performance, eight algorithms that have shown high quality in the last two years are compared, including PKO, flood algorithm (FLA) [32], black-winged kite algorithm (BKA) [33], triangulation topology aggregation optimizer (TTAO) [34], FOX-inspired optimization algorithm (FOX) [35], Crayfish optimization algorithm (COA) [36], Newton–Raphson-based optimizer (NRBO) [37], enzyme action optimizer (EAO) [38] and starfish optimization algorithm [7].
In order to ensure the fairness of numerical simulation, these 10 algorithms have consistent simulation conditions when calculating 12 benchmark functions by executing 30 times independently. The specific parameters and constraint processing strategies for numerical simulation are shown in Table 4, FEs represent function evaluations, which is population size multiplied by iterations. The relevant parameters of each algorithm are consistent with their proposed literature.
Table 4.
Numerical simulation conditions of 10 algorithms for solving the CEC 2006 benchmark functions.
- (2)
- Experimental results
According to the simulating condition in Table 4, the performance of G01–G12, including the mean value, standard deviation, and the best and worst value, is summarized in Table 5 and Table 6 and visualized through the box plots in Figure 1. Specifically, Table 4 presents the results of the first five algorithms, while Table 5 shows those of the remaining five algorithms.
Table 5.
Comparison results of MSIPKO and nine other algorithms for 12 benchmark functions (1).
Table 6.
Comparison results of MSIPKO and nine other algorithms for 12 benchmark functions (2).
Figure 1.
Boxplot of MSIPKO and 9 competitor algorithms for 12 benchmark functions of CEC 2006.
From the numerical results, MSIPKO demonstrates a strong ability to consistently reach near-optimal or best-known solutions in most test cases. Specifically, on G01, G02, G06, and G08, the algorithm shows both low standard deviation and excellent best-case performance, indicating reliable convergence behavior. In constrained equality-dominant problems such as G03 and G07, MSIPKO still maintains competitive quality with relatively tight result distributions.
Figure 1 complements this analysis by highlighting the solution distributions of all algorithms. MSIPKO exhibits compact box ranges on most problems, reflecting high stability. For functions like G04 and G09, although multiple algorithms show feasible outputs, the interquartile range of MSIPKO is narrower, with fewer outliers. This suggests the multi-strategy enhancement successfully mitigates population stagnation and maintains solution diversity in high-constraint scenarios.
Overall, the simulation results validate the effectiveness of MSIPKO across different categories of constrained optimization problems.
To further validate the statistical significance of the non-parametric statistical tests was conducted. The next subsection presents the ranking results, Wilcoxon signed-rank test outcomes, and Bonferroni-corrected significance analysis to confirm the robustness and reliability of MSIPKO’s superiority.
In the present study, a static penalty function with a penalty factor of 106 is adopted for both the CEC 2006 benchmark problems and the engineering design problems. Under this setting, infeasible solutions would result in substantially inflated objective values. From the reported results, most algorithms obtain objective values within the expected feasible range on the majority of problems, indicating that they generally reach the feasible region or remain very close to it. A notable exception is EAO on G06, where the unusually large objective values suggest possible difficulty in reaching feasible solutions in some runs.
- (3)
- Statistical analysis
To further validate the algorithm’s superiority and robustness, statistical analyses including rank-based comparison and non-parametric Wilcoxon signed-rank test with Bonferroni correction were conducted on the results across all benchmark functions.
As shown in Table 7, the proposed MSIPKO algorithm achieves rank 1 on most benchmark functions, and secures rank 2 on a few functions. While the EAO ranks first on some functions including G05, G07, G09, etc., its performance significantly deteriorates on others (e.g., G01–G03, G06), resulting in an overall mean rank of 3.33, which is inferior to MSIPKO (mean rank = 1.42). This indicates that EAO may exhibit strength in specific local patterns but lacks general applicability. In contrast, MSIPKO demonstrates stable and universal performance, suggesting its broader suitability for solving diverse constrained optimization problems.
Table 7.
Ranking results of the 10 algorithms by the mean value and standard deviation.
Furthermore, other algorithms such as PKO, BKA, TTAO, and FOX present relatively fluctuating ranks, showing inconsistent effectiveness depending on the problem structure. Notably, the original PKO ranks much lower (mean rank = 5.92), highlighting the significant improvements gained through the enhancements introduced in MSIPKO.
To further validate the statistical significance of the observed performance advantages, a Wilcoxon signed-rank test is performed between MSIPKO and each of the other nine algorithms. Additionally, the Bonferroni correction was applied to adjust the significance levels in the context of multiple comparisons. The detailed results of these non-parametric statistical tests are presented in Table 7.
As shown in Table 8, the Wilcoxon signed-rank test is employed to assess the statistical significance of performance differences between MSIPKO and the comparison algorithms. For each benchmark function, all algorithms are independently executed 30 times, and the mean objective value is used as the representative performance metric.
Table 8.
Results of the Wilcoxon test including Bonferroni correction between MSIPKO and other algorithms.
For each pair of algorithms, a paired sample is constructed by comparing their mean objective values on each benchmark function. That is, each function provides one paired data point, and the Wilcoxon signed-rank test is conducted across all benchmark functions. This pairing scheme enables a fair comparison by evaluating algorithm performance consistently on the same set of problem instances.
The significance level is set to α = 0.05, and the Bonferroni correction is applied with m = 9, representing the total number of pairwise comparisons between MSIPKO and each of the nine competing algorithms, to control the family-wise error rate.
The results indicate that MSIPKO generally achieves better performance compared to most of the considered algorithms. For PKO, FLA, BKA, TTAO, FOX, COA, NRBO, and SFOA, the obtained p-values (e.g., 0.0005) indicate statistically significant differences at the 0.05 significance level before correction, and these differences remain significant after applying the Bonferroni correction.
For EAO, the p-value is 0.0312, indicating relatively weaker statistical evidence. After Bonferroni correction, the adjusted p-value (0.2808) does not meet the significance thresholds. However, the rank-sum results (R+ > R−) still suggest that MSIPKO tends to outperform EAO in most cases.
Overall, these results suggest that MSIPKO demonstrates competitive and generally superior performance compared with the majority of the considered algorithms, while maintaining statistical robustness under multiple comparison conditions.
4.1.3. Component-Wise Ablation Study of MSIPKO
To further validate the effectiveness of each improvement component in the MSIPKO algorithm, this section conducts an ablation study involving five variants: the original PKO, PKO enhanced with Component 1 (PKO + C1), Component 2 (PKO + C2), Component 3 (PKO + C3), and the full version MSIPKO, where C1 denotes the reverse differential crossover mechanism, C2 represents the enhanced diving-fishing operator, and C3 introduces the improvement of the commensalism phase. The comparative results across 12 benchmark functions are summarized in Table 9 and visualized in Figure 2 using boxplots. Additionally, a ranking-based evaluation is conducted in Table 10 to assess the effectiveness of each component and their synergy.
Table 9.
Comparison results of MSIPKO’s component-wise ablation study for 12 benchmark functions.
Figure 2.
Boxplot of MSIPKO’s component-wise ablation study for 12 benchmark functions of CEC 2006.
Table 10.
Ranking results of the component-wise ablation by the mean value and standard deviation.
From the data in Table 10, MSIPKO achieves the best performance on 10 out of the 12 benchmark functions, and ranks second on the remaining two (G02 and G07), resulting in the lowest total ranking score with the number 14 and an average rank of 1.17. This indicates that the integration of all three components leads to consistently superior performance and robustness. By contrast, the original PKO ranks worst overall (average rank = 4.83), confirming the necessity of component enhancements.
Detailed analysis reveals the individual and synergistic contributions of each component. Component C1 plays a decisive role in improving the optimization accuracy for functions G01 and G02. Component C2 dominates the improvements in G04, G05, G07, G09, and G10, showcasing its ability to enhance convergence and robustness in complex constrained scenarios. Component C3, though not solely responsible for the best results on any single function, contributes a stabilizing effect, particularly in the combination setting.
Moreover, some benchmark functions benefit from the synergy of multiple components. Specifically, G03 and G12 are significantly improved only when all three components are integrated, with the most notable contribution in G03 coming from C3. Functions G06, G08, and G11 are enhanced primarily by the combined effect of C1 and C2, indicating their complementary strengths.
It is worth noting that in the cases of G02 and G07, MSIPKO performs slightly worse than the single-module-enhanced versions (PKO + C1 and PKO + C2, respectively). This is likely due to the slight trade-off effect introduced by full-component integration, where the balancing mechanism of C3 may suppress the localized strength of individual modules in specific scenarios.
Overall, the results from Table 9 and Table 10 and Figure 2 demonstrate that each component contributes uniquely to the algorithm. The combined use of C1, C2, and C3 in MSIPKO ensures both high accuracy and strong stability, making it a robust and well-rounded approach for constrained optimization problems.
4.1.4. Sensitivity to Evaluation Budget
To further evaluate the response sensitivity and efficiency of the 10 algorithms under varying computational budgets, this section analyzes the average objective values across six levels of function evaluations, including 1000; 5000; 10,000; 50,000; 100,000; 200,000, as visualized in Figure 3.
Figure 3.
Sensitivity analysis of 10 algorithms under varying FEs.
When the number of function evaluations (FEs) is less than 10,000, most algorithms—such as PKO, FLA, and FOX—exhibit relatively slow convergence, with noticeable gaps between initial and near-optimal values. In contrast, some algorithms, including EAO, BKA, and FLA, show relatively faster descent on certain functions (e.g., G02, G07, and G09). Among them, EAO often demonstrates rapid improvement at the early stage for several functions, although its subsequent progress becomes limited in some cases (e.g., G02 and G03). Similarly, BKA shows good initial performance but tends to plateau relatively early.
In comparison, MSIPKO exhibits efficient early-stage convergence behavior, achieving objective values close to the optimum on several functions (e.g., G01, G02, G06, and G12) within FEs = 10,000.
As the evaluation budget increases to FEs = 50,000 and beyond, the performance differences become more apparent. MSIPKO continues to improve its solutions and generally maintains lower objective values on most functions. For example, on G02, MSIPKO gradually surpasses other algorithms. In the later stages, FOX and COA demonstrate relatively better fine-tuning ability on some functions (e.g., G03, G05, and G10), suggesting stronger local exploitation capability, although their overall performance remains inferior to MSIPKO.
Overall, MSIPKO demonstrates competitive and generally superior convergence behavior across most test functions. The convergence curves exhibit relatively smooth trends in many cases, although some fluctuations may still be observed. No obvious premature convergence is observed in most functions. These results suggest that MSIPKO achieves a reasonable balance between global exploration and local exploitation under different computational budgets.
4.1.5. Comparison of Constraint-Handling Strategies
To evaluate the performance of MSIPKO in comparison with algorithms utilizing different constraint-handling strategies, this study conducts a comparative analysis against five representative algorithms. These algorithms adopt various constraint-handling approaches, including the HMICA [1] based on Deb’s criterion, the BSA-SAε algorithm [39] employing the ε-constrained method, and three algorithms—SMA-GM [40], AGWO [41], and IChoA [42]—using the dynamic penalty approach.
The simulation conditions and constraint-handling strategies for these algorithms are summarized in Table 11, and the corresponding results are presented in Table 12. It should be emphasized that the results in Table 12 are partially collected from the literature, where different algorithms were evaluated under different function evaluation (FE) budgets. Therefore, these results should be interpreted as indicative comparisons rather than strictly controlled evaluations.
Table 11.
Function evaluation budgets and constraint-handling strategies of the compared algorithms on the 12 CEC 2006 constrained benchmark functions (G01–G12).
Table 12.
Comparison results of MSIPKO and five other algorithms using different constraint-handling strategies on 12 benchmark functions.
As shown in Table 12, MSIPKO demonstrates competitive performance compared with the other algorithms. However, some algorithms exhibit slightly better reported average or optimal values for certain benchmark functions, such as G04, G05, G06, G08, and G11. These discrepancies are mainly attributed to differences in numerical precision and rounding conventions across studies rather than intrinsic performance differences.
For example, for the G04 benchmark function, the theoretical optimum is reported as in the CEC 2006 benchmark definition, while some studies present rounded values such as −30,665.539 or even −30,666.
According to the official CEC 2006 evaluation criteria, solution quality is assessed based on function error rather than decimal precision. Specifically, a solution is considered successful if while satisfying feasibility conditions.
Therefore, in this study, solutions that satisfy this error threshold are regarded as equivalent to the theoretical optimum. This criterion ensures consistency with the benchmark evaluation protocol and avoids misleading comparisons caused by differences in reported decimal precision.
Another important issue is the inconsistency in FE budgets. Specifically, the three algorithms employing dynamic penalty strategies were evaluated under a fixed FE budget of 30,000 in their original studies, which is lower than that used by MSIPKO for several benchmark functions (G01, G02, G03, G05, G07, G09, and G10). To ensure a fairer comparison, MSIPKO was additionally evaluated under the same FE budget (30,000) for these functions, and the results are presented in Table 13.
Table 13.
Comparison results of the MSIPKO and three dynamic penalty function-based algorithms under the same simulation settings.
Compared with Table 12, Table 13 provides a more reliable and directly comparable assessment under unified computational conditions. Based on these results, MSIPKO maintains competitive performance under equal evaluation budgets.
Given the aforementioned scenarios, a simple comparison using average rankings or the Wilcoxon test is not suitable when evaluating against studies that adopt different constraint-handling strategies. Instead, a detailed comparison of the results obtained by MSIPKO and other algorithms on each benchmark function is necessary. Additionally, when MSIPKO and another algorithm reach the theoretical optimal value for a benchmark function, the precision retained in the literature is disregarded. In this case, the results of the two algorithms are considered equivalent.
The comparison rules are as follows:
- (1)
- If the results of both algorithms are identical, their performance is further compared based on the number of function evaluations, with the algorithms requiring fewer evaluations being deemed superior.
- (2)
- If one algorithm achieves better results while requiring no more function evaluations than the other, it is considered to have superior performance. In this study, MSIPKO demonstrates that its number of function evaluations for all benchmark functions (G01–G12) is consistently less than or equal to that of the comparison algorithms.
- (3)
- If one algorithm outperforms the other in the comparison, it is marked with a “+”; if the other method is superior, it is marked with a “−”; and if both methods yield equivalent results, it is marked with an “=”.
Table 14 presents the comparison results of MSIPKO and five other algorithms across 12 benchmark functions. It should be noted that the results presented in Table 14 are derived based on a combination of the results from Table 12 and Table 13. For benchmark functions with consistent function evaluation settings, results from Table 13 are used, while results from Table 12 are adopted for the remaining functions. Combined with the data and analysis rules discussed earlier, MSIPKO shows competitive performance with consistent advantages across most benchmark functions.
Table 14.
Comparison results between MSIPKO and other algorithms using different constraint-handling strategies.
First, MSIPKO achieved 53 positive outcomes (“+” marks), 3 ties (“=” marks), and 4 negative outcomes (“−” marks) in the comparisons. Its overall performance across the 12 benchmark functions outperformed other algorithms, particularly in nonlinear complex constrained problems where it showcased exceptional optimization capabilities. For instance, in complex functions such as G02 and G10, MSIPKO not only achieved the theoretical optimal values but also significantly reduced the number of function evaluations (up to 200,000, compared to 350,000 for BSA-SAε), achieving an excellent balance between efficiency and accuracy.
In the comparison with HMICA, MSIPKO performed better on most benchmark functions, with tied results on G04, G08, and G12 (“=” marks), highlighting its superior efficiency and robustness. Against BSA-SAε, MSIPKO outperformed in all benchmark functions, demonstrating its strong adaptability to different types of constraints. While SMA-GM showed slightly better performance on G01 and G03, MSIPKO surpassed it on all other benchmark functions. Although MSIPKO showed a slight disadvantage in G03 when fewer function evaluations were used compared to algorithms employing dynamic penalty functions, results with 200,000 function evaluations showed that MSIPKO still achieved the theoretical optimal value, indicating its competitive search precision. Particularly in complex constrained problems such as G05, G07, and G09, MSIPKO obtained superior solutions with fewer function evaluations. Additionally, MSIPKO significantly outperformed AGWO and IChoA, especially in nonlinear problems, where its mean and optimal values were markedly better, further emphasizing its precision advantages.
In summary, MSIPKO demonstrated computational efficiency, robustness, and optimization capabilities in the benchmark tests, validating its exceptional performance as an effective constrained optimization algorithm.
4.2. Engineering Problems
The method proposed in this paper addresses six common engineering optimization problems, including the I-beam vertical deflection problem, the speed reducer design problem, the three-bar truss design problem, the welded beam design problem, the tension/compression spring design problem, and the pressure vessel design optimization problem. The performance of MSIPKO is validated by comparing its results with those of nine other algorithms across these problems.
This section is divided into two parts. The first part provides a brief introduction to the six engineering problems, while the second part presents the computational results of various algorithms and offers an analysis and discussion of their performance.
4.2.1. Introduction of Six Engineering Problems
- (1)
- I-beam vertical deflection problem
The I-beam vertical deflection problem is a classic engineering optimization problem. The objective is to minimize the vertical deflection of the I-beam by optimizing geometric parameters such as length (), height (), web thickness (), and flange thickness (), while satisfying constraints on cross-sectional area and material stress. This problem is characterized by its constrained and nonlinear nature, requiring a balance between structural strength, stiffness, and material efficiency, which adds to its computational complexity. The design variables, including length, height, web thickness, and flange thickness, each have a significant impact on the structural performance.
I-beams are widely used in construction, mechanical engineering, and transportation, such as in bridges, floors, equipment frames, and railway tracks. Optimizing the design of I-beams not only reduces material consumption and costs but also enhances load-bearing capacity and structural safety. However, the problem involves complex constraints that require comprehensive consideration of strength, stiffness, and stability. Additionally, the optimization process often exhibits nonlinear and multimodal characteristics, increasing the difficulty of finding solutions.
The mathematical formulation of this problem is given in Formulas (27)–(29).
s.t.
where , , , .
- (2)
- Speed reducer design problem
The speed reducer is a critical component in mechanical transmission systems and is widely used in industrial machinery, automotive power systems, and energy equipment such as wind turbines. It serves to regulate speed and transmit torque. Optimizing the design of speed reducers not only helps reduce their manufacturing cost and weight but also significantly enhances their efficiency and reliability.
This problem represents a classic constrained mixed-integer optimization challenge, where the primary difficulty lies in achieving the optimal balance between performance and weight while addressing the computational complexities introduced by nonlinear constraints and mixed variables. The objective is to minimize the weight of the speed reducer while satisfying mechanical performance constraints. These constraints primarily involve gear bending stress, surface contact stress, lateral deflection of the shaft, and internal stress within the shaft. The problem involves seven design variables: gear width (), module (), number of pinion teeth (), length of the first shaft (), length of the second shaft (), diameter of the first shaft (), and diameter of the second shaft (). These variables include both continuous variables (e.g., shaft diameters) and discrete variables (e.g., number of teeth), further increasing the complexity of the problem. For the speed reducer design problem, the variable , representing the number of pinion teeth, is treated as an integer variable. In this study, an integer constraint is imposed on during function evaluation and result reporting to ensure consistency with the original problem formulation.
The mathematical formulation of this problem is given in Formulas (30)–(41).
s.t.
where , , , , , .
- (3)
- Three-bar truss design problem
The three-bar truss design problem is a structural optimization problem with wide-ranging applications. In construction engineering, three-bar trusses are commonly used in bridges, roofs, and high-rise buildings, where optimized designs improve material utilization and reduce costs. In mechanical manufacturing, lightweight truss structures are applied to machine supports and frames, reducing weight while maintaining strength. In aerospace engineering, optimizing truss designs is crucial for reducing the structural weight of aircraft and spacecraft while enhancing their performance.
The three-bar truss design problem is a classic structural optimization problem. The objective is to minimize the total volume of the three-bar truss by optimizing its cross-sectional areas while satisfying the bearing capacity constraints of each truss member. In this problem, the objective function represents the total material volume of the truss, calculated as the sum of the products of the cross-sectional areas and the lengths of the truss members. The constraints ensure that the truss satisfies the required bearing capacity and structural stability while achieving volume minimization.
The main challenge of the three-bar truss design problem lies in handling the complex nonlinear constraints and interdependencies among variables, while achieving an optimal balance between strength, stability, and volume minimization. Its mathematical formulation is provided in Formulas (42)–(45).
s.t.
where , .
- (4)
- Welded beam design problem
The welded beam design problem is a classic engineering optimization problem widely applied in scenarios such as crane beams, bridge structures, steel frame buildings, and heavy equipment supports. Through optimized design, it is possible to reduce costs, decrease weight, and improve structural strength.
The objective of this problem is to minimize the manufacturing cost of the welded beam by optimizing geometric parameters such as weld thickness (), beam width (), beam thickness () and weld length (). At the same time, it must satisfy multiple mechanical performance constraints, including limitations on shear strength, bending load, and buckling stress. Additionally, the weld width and deflection must remain within allowable limits to ensure the stiffness and stability of the beam.
s.t.
where the parameters with fixed values are as follows. , , , , , , . There are some equation relationships among variables as follows.
, , , ,, , , , . The range of values for decision variables is , .
- (5)
- Tension/compression spring design problem
The tension/compression spring design problem is a classic engineering optimization problem with wide-ranging applications across various fields. For example, in mechanical equipment, springs are used for vibration control, energy storage, and impact absorption. In the automotive industry, they are an integral part of suspension systems, providing shock absorption and structural support. In the aerospace sector, springs are employed for high-precision damping and load-bearing. In consumer electronics, they are commonly used in buttons, connectors, and mechanical latches.
The objective of this problem is to minimize the weight of the spring by optimizing its geometric parameters while satisfying multiple performance constraints, including spring deflection, shear stress, natural frequency, and outer diameter limitations. The problem involves three design variables: wire diameter (), mean coil diameter (), and the number of active coils (), all of which directly affect the performance and service life of the spring. The mathematical expression is shown as Formulas (54)–(58).
s.t.
where .
- (6)
- Pressure vessel design optimization problem
The pressure vessel design problem is widely applied in fields such as chemical engineering, energy, food and pharmaceutical industries, and aerospace. Examples include reactors, gas storage tanks, and steam generators, which are responsible for storing and transporting liquids and gases under high-pressure conditions. The challenge of this problem lies in handling mixed variables and multiple constraints while minimizing the cost and maintaining the performance of the vessel.
The objective is to minimize the manufacturing cost of a cylindrical pressure vessel, including welding, material, and forming costs. The design variables include shell thickness (), head thickness (), inner radius (), and vessel length (). For the pressure vessel design problem, the shell thickness and head thickness are integer-multiple variables with a discretization step of 0.0625, which reflects standard manufacturing requirements in practical engineering design. In this study, these two variables are mapped to the nearest feasible discrete values during function evaluation and result reporting, while and are treated as continuous variables. This treatment ensures that the evaluated solutions strictly satisfy the original mixed-integer design requirements.
The problem is subject to various constraints, including geometric, material, and mechanical performance constraints, to ensure that the pressure vessel achieves sufficient strength and stability at the lowest possible cost.
s.t.
where , .
4.2.2. Results and Discussions of Solving Engineering Problems
This section conducts simulation experiments on six representative engineering optimization problems. The numerical simulation conditions and constraint-handling strategies are shown in Table 15. The computational results are summarized in Table 16 and Table 17, where Table 16 presents the results of the first five algorithms and Table 17 lists those of the remaining five algorithms. The distribution of solutions across different algorithms is visualized in Figure 4.
Table 15.
Numerical simulation conditions and constraints on strategies of 10 comparative algorithms for solving six engineering problems.
Table 16.
Comparison results of MSIPKO and 9 other algorithms for 6 engineering problems (1).
Table 17.
Comparison results of MSIPKO and 9 other algorithms for 6 engineering problems (2).
Figure 4.
Boxplot of MSIPKO and competitor algorithms for 6 engineering problems.
It should be noted that, due to the large dispersion of certain algorithms in some problems, the boxplots in Figure 4 may exhibit compressed regions for other methods. To improve the clarity of visualization and provide a more detailed comparison among the leading algorithms, Figure 5 further presents the boxplots of the top five algorithms selected based on mean fitness values for each problem, where the algorithms are arranged according to their ranking based on mean performance, consistent with the results reported in Table 18, with the leftmost box representing the best-performing algorithm.
Figure 5.
Boxplot of the top five algorithms selected based on mean fitness values for each engineering design problem.
Table 18.
Ten algorithms’ ranking results of 6 engineering problems by the mean value.
The best objective values and their corresponding solution vectors are listed in Table 19. In order to analyze the quality of various algorithms when solving engineering optimization problems, the ranking results based on mean values are shown in Table 18.
Table 19.
Six engineering problems’ solution vectors obtained by MSIPKO.
For all experiments, a unified experimental setting is adopted to ensure a fair comparison. All algorithms are executed with the same population size and maximum number of iterations, and each problem is independently run 30 times. For problems involving discrete variables, the corresponding constraints are handled within the objective evaluation to ensure feasibility of the obtained solutions.
For problems involving discrete variables, namely the speed reducer design problem (P2) and the pressure vessel design problem (P6), the corresponding integer or discrete constraints are explicitly handled within the objective function evaluation. This ensures that all candidate solutions satisfy the problem-specific feasibility requirements throughout the optimization process. For constrained optimization problems, the original constraint-handling mechanisms of each algorithm are retained, ensuring that the comparison reflects their intrinsic performance under standard configurations.
Based on the ranking results presented in Table 18, a clear overall performance pattern can be observed. MSIPKO achieves the best overall ranking with the lowest total rank score, indicating its strong competitiveness across different types of engineering optimization problems. Specifically, MSIPKO ranks first in four out of six problems, while maintaining competitive performance in the remaining two cases. Compared with other algorithms, such as PKO and EAO, which perform well on certain individual problems, MSIPKO demonstrates a more balanced and consistent performance across all test cases. In contrast, algorithms such as FLA and FOX obtain relatively poor rankings, reflecting their limited adaptability to complex constrained optimization scenarios.
A more detailed analysis of each problem is given as follows.
For the I-beam deflection problem (P1), MSIPKO ranks third in terms of mean performance. Although it does not achieve the best result, less than TTAO and EAO, its solution is still very close to the theoretical optimum. Meanwhile, the distribution shown in Figure 4 indicates that MSIPKO maintains relatively stable convergence with limited fluctuations. Compared with some algorithms that exhibit larger deviations, MSIPKO provides a more reliable performance.
For the speed reducer design problem (P2), MSIPKO achieves the best overall performance. The obtained mean value is highly competitive, and the variance is relatively small, indicating both high accuracy and stability. Compared with algorithms such as FLA and FOX, which show larger deviations and fluctuations, MSIPKO demonstrates stronger adaptability to nonlinear and mixed-variable constraints.
For the three-bar truss structure problem (P3), most algorithms obtain results very close to the theoretical optimum. MSIPKO achieves the best mean performance, although the performance gap among the top algorithms is relatively small. From Figure 4 and Figure 5, it can be observed that MSIPKO exhibits relatively stable distributions with fewer outliers, indicating consistent convergence behavior.
For the welded beam design problem (P4), MSIPKO ranks first and achieves the best mean performance among all algorithms. Compared with recent algorithms such as COA and TTAO, MSIPKO shows better convergence accuracy and lower variance, demonstrating its effectiveness in handling nonlinear engineering constraints.
For the spring design problem (P5), MSIPKO ranks third, slightly behind the top-performing algorithms (including EAO and SFOA). However, the difference in objective value is extremely small, indicating that MSIPKO still maintains a competitive performance. In addition, its solution distribution remains relatively concentrated, suggesting stable convergence across multiple runs.
Finally, in the pressure vessel design problem (P6), MSIPKO achieves the best performance with a mean value of 6059.976678 and a very low standard deviation of 0.419671. This indicates that the proposed algorithm maintains both high solution quality and strong stability under the mixed discrete–continuous design constraints. In contrast, algorithms such as FOX, FLA and BKA exhibit much larger fluctuations, suggesting relatively weaker robustness in this problem. For the pressure vessel problem, the reported values of and are the discrete feasible values obtained after applying the 0.0625-step mapping in Table 19.
4.3. Discussion
Based on the comprehensive experimental results presented in Section 4.1 and Section 4.2, the proposed MSIPKO demonstrates competitive and generally superior performance across both benchmark functions and engineering optimization problems.
In Section 4.1, MSIPKO is evaluated on 12 constrained functions from the CEC 2006 test suite. The results show that the proposed algorithm achieves the best or near-best performance on most functions in terms of mean value, best value, and robustness. The convergence analysis further indicates that MSIPKO exhibits efficient search behavior across different evaluation budgets, maintaining a good balance between global exploration and local exploitation. In addition, the ablation study confirms that each component (C1, C2, and C3) contributes positively to the overall performance, and their integration leads to further improvements.
Despite these promising results, several limitations should be acknowledged. First, the current evaluation is mainly conducted on medium-scale constrained optimization problems (CEC 2006), and the performance of MSIPKO on high-dimensional or large-scale problems has not yet been fully investigated. Second, the introduction of additional modules leads to a slight increase in per-iteration computational overhead, which may affect efficiency in scenarios with strict real-time requirements. Third, the constraint-handling strategy adopted in this study is relatively standard, and its effectiveness in more complex or dynamic constraint environments still requires further validation.
Beyond these limitations, it is also important to consider the applicability of MSIPKO to more complex and emerging constrained optimization scenarios. In recent studies, constrained optimization problems have been formulated in increasingly complex forms, such as energy system scheduling under operational constraints and security-oriented optimization problems with implicit or hidden constraints. These problems are often characterized by highly irregular feasible regions, strong coupling among variables, and complex constraint structures.
Although MSIPKO demonstrates strong performance in the tested problems, its applicability to such emerging scenarios has not yet been fully investigated. Nevertheless, due to its enhanced exploration capability and adaptability, MSIPKO has the potential to be extended to these complex optimization tasks, which represents a promising direction for future research.
5. Conclusions and Future Work
This paper proposes a multi-strategy improved pied kingfisher optimizer (MSIPKO) to enhance the performance of the original PKO for constrained optimization problems. By integrating a reverse differential crossover mechanism, an enhanced diving-fishing operator, and a refined commensalism phase, the proposed algorithm improves global exploration, local exploitation, and convergence stability without changing the asymptotic computational complexity.
Comprehensive experiments on 12 constrained benchmark functions from the CEC 2006 test suite and six classical engineering design problems demonstrate that MSIPKO achieves competitive and generally superior performance compared with several state-of-the-art algorithms. In particular, the results indicate improvements in solution quality, robustness, and convergence behavior across most test cases.
Additional analyses, including ablation studies and sensitivity evaluations under different function evaluation budgets, further verify the effectiveness of the proposed components and the stability of the algorithm. Moreover, comparisons with different constraint-handling strategies confirm the robustness of MSIPKO across diverse constraint environments.
Despite these promising results, several limitations remain, as discussed in Section 4.3, and addressing them will be an important direction for future work.
In future research, we will focus on extending MSIPKO to high-dimensional and large-scale constrained optimization problems, improving its computational efficiency through parallelization, and enhancing its adaptability by integrating more advanced constraint-handling mechanisms. Furthermore, extending the proposed method to multi-objective optimization problems and real-world applications, such as energy scheduling and UAV path planning, will also be investigated.
Author Contributions
Conceptualization, J.L.; methodology, J.L.; software, J.L.; validation, J.L.; formal analysis, J.L.; investigation, J.L.; resources, J.L.; data curation, J.L.; writing—original draft preparation, J.L.; writing—review and editing, J.L., H.B. and T.W.; visualization, J.L.; project administration and discussions, H.B., T.W., J.L. and N.T.; funding acquisition, H.B., T.W., J.L. and N.T. All authors have read and agreed to the published version of the manuscript.
Funding
This research was funded by the Ph.D. Foundation of Hulunbuir University—Multi-strategy improved swarm optimization algorithm and engineering applications, grant number 2024BSJJ16; the Ph.D. Foundation of Hulunbuir University—Research on the prediction model of ionospheric characteristic parameters based on artificial intelligence, grant number 2022BS01; Key project of Hulun Buir city’s “Technological Revitalization of the City” action—Research and development of key technologies and equipment for mechanization of green, efficient, and intelligent production of soybeans; Research and development of vegetation adaptability for the historical geological environment and grassland vegetation ecological restoration project in Tuwei Mountain, Manzhouli City; Foundation of Hulunbuir University—Research on intelligent segmentation technology for medical imaging, grant number 2024BSJJ05.
Institutional Review Board Statement
Not applicable.
Informed Consent Statement
Not applicable.
Data Availability Statement
The data supporting the findings of this study are available within the article.
Conflicts of Interest
The authors declare no conflicts of interest.
References
- Luo, J.; Zhou, J.; Jiang, X. A modification of the imperialist competitive algorithm with hybrid methods for constrained optimization problems. IEEE Access 2021, 9, 161745–161760. [Google Scholar] [CrossRef] [Scilit]
- Moayed, D.; Gen, Y. Constrained multiple-swarm particle swarm optimization within a cultural framework. IEEE Trans. Syst. Man Cybern.-Syst. 2012, 42, 475–490. [Google Scholar] [CrossRef] [Scilit]
- Deb, K. An efficient constraint handling method for genetic algorithms. Comput. Meth. Appl. Mech. Eng. 2000, 186, 311–338. [Google Scholar] [CrossRef] [Scilit]
- Dong, N.; Wang, Y. Novel bi-objective model-based evolutionary algorithm for constrained optimization problems. Control Theor. Appl. 2014, 31, 577–583. [Google Scholar] [CrossRef]
- Bi, X.; Zhang, L. Constrained multi-objective optimization algorithm m with adaptive ε truncation strategy. J. Electr. Inf. Technol. 2016, 36, 2047–2053. [Google Scholar] [CrossRef]
- Zuo, W.; Gao, Y. Solving numerical and engineering optimization problems using a dynamic dual-population differential evolution algorithm. Int. J. Mach. Learn. Cybern. 2024, 9, 1701–1760. [Google Scholar] [CrossRef] [Scilit]
- Zhong, C.; Li, G.; Meng, Z. Starfish optimization algorithm (SFOA): A bio-inspired metaheuristic algorithm for global optimization compared with 100 optimizers. Neural Comput. Appl. 2025, 37, 3641–3683. [Google Scholar] [CrossRef] [Scilit]
- Xiao, Y.; Cui, H.; Khurma, R.A.; Castillo, P.A. Artificial lemming algorithm: A novel bionic meta-heuristic technique for solving real-world engineering optimization problems. Artif. Intell. Rev. 2025, 58, 84. [Google Scholar] [CrossRef] [Scilit]
- Alkharsan, A.; Ata, O. Hawkfish optimization algorithm: A gender-bending approach for solving complex optimization problems. Electronics 2025, 14, 611. [Google Scholar] [CrossRef] [Scilit]
- Zhao, W.; Xie, Y.; Wang, L. An effective Bezier curve-based optimization (BCO) for large-scale numerical problems and 3D unmanned aerial vehicle path planning with efficient multiple threats evasion. Adv. Eng. Inform. 2026, 73, 104524. [Google Scholar] [CrossRef] [Scilit]
- Xue, J.; Shen, B. Dung beetle optimizer: A new meta-heuristic algorithm for global optimization. J. Supercomput. 2023, 79, 7305–7336. [Google Scholar] [CrossRef] [Scilit]
- Yuan, C.; Zhao, D.; Heidari, A.A. Polar lights optimizer: Algorithm and applications in image segmentation and feature selection. Neurocomputing 2024, 607, 128427. [Google Scholar] [CrossRef] [Scilit]
- Fan, S.; Wang, R.; Kang, S. A sequoia-ecology-based metaheuristic optimisation algorithm for multi-constraint engineering design and UAV path planning. Results Eng. 2025, 26, 105130. [Google Scholar] [CrossRef] [Scilit]
- Yu, H.; Jia, H.; Zhou, J. Enhanced aquila optimizer algorithm for global optimization and constrained engineering problems. Math. Biosci. Eng. 2022, 19, 14173–14211. [Google Scholar] [CrossRef] [Scilit]
- Sun, B.; Peng, P.; Tan, G. A fuzzy logic constrained particle swarm optimization algorithm for industrial design problems. Appl. Soft Comput. 2024, 167, 112456. [Google Scholar] [CrossRef] [Scilit]
- Li, G.; Wang, Z.; Gao, W. Adaptive multi/many-objective transformation for constrained optimization. IEEE Trans. Syst. Man Cybern.-Syst. 2025, 55, 721–734. [Google Scholar] [CrossRef] [Scilit]
- Furio, C.; Lamberti, L.; Pruncu, C.I. Mechanical and civil engineering optimization with a very simple hybrid grey wolf–Jaya metaheuristic optimizer. Mathematics 2024, 12, 3464. [Google Scholar] [CrossRef] [Scilit]
- Meng, K.; Zhang, J.; Xu, Z. Ship power system network reconfiguration based on swarm exchange particle swarm optimization algorithm. Appl. Sci. 2024, 14, 9960. [Google Scholar] [CrossRef] [Scilit]
- Zhao, M.; He, Y.; Tian, Y. Capacity optimization of wind–solar–storage multi-power microgrid based on two-layer model and an improved snake optimization algorithm. Electronics 2024, 13, 4315. [Google Scholar] [CrossRef] [Scilit]
- Boroumandfar, G.; Khajehzadeh, A.; Eslami, M. A single and multiobjective robust optimization of a microgrid in distribution network considering uncertainty risk. Sci. Rep. 2024, 14, 28195. [Google Scholar] [CrossRef] [Scilit]
- Farhat, M.; Kamel, S.; Abdelaziz, A.Y. Modified Tasmanian devil optimization for solving single and multiobjective optimal power flow in conventional and advanced power systems. Clust. Comput. 2025, 28, 105. [Google Scholar] [CrossRef] [Scilit]
- Dora, B.K.; Bhat, S.; Halder, S. A solution to multi-objective stochastic optimal power flow problem using mutualism and elite strategy based pelican optimization algorithm. Appl. Soft Comput. 2024, 158, 111548. [Google Scholar] [CrossRef] [Scilit]
- Boualem, S.A.E.M.; Meftah, B.; Debbat, F. An adaptive coordinate system for constrained differential evolution. Clust. Comput. 2025, 28, 37. [Google Scholar] [CrossRef] [Scilit]
- Yang, H.; Ren, Y.; Xu, G. Optimization of rotary drilling rig mast structure based on multi-dimensional improved salp swarm algorithm. Appl. Sci. 2024, 14, 10040. [Google Scholar] [CrossRef] [Scilit]
- Abdollahzadeh, B.; Javadi, H. The green marine waste collector routing optimization with puma selection-based neighborhood search algorithm. Clust. Comput. 2025, 28, 80. [Google Scholar] [CrossRef] [Scilit]
- Wang, C.; Hu, A.; Gao, Q. UAV swarm path planning approach based on integration of multi-population strategy and adaptive evolutionary optimizer. Meas. Sci. Technol. 2024, 35, 126204. [Google Scholar] [CrossRef] [Scilit]
- Wang, X.; Feng, Y.; Tang, J. A UAV path planning method based on the framework of multi-objective jellyfish search algorithm. Sci. Rep. 2024, 14, 28058. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- You, G.; Hu, Y.; Lian, C.; Yang, Z. Mixed-strategy Harris hawk optimization algorithm for UAV path planning and engineering applications. Appl. Sci. 2024, 14, 10581. [Google Scholar] [CrossRef] [Scilit]
- Chen, Y.; Li, J.; Zhou, L. An improved dung beetle optimizer for the twin stacker cranes’ scheduling problem. Biomimetics 2024, 9, 683. [Google Scholar] [CrossRef] [Scilit]
- Huang, Z.; Zhang, Z.; Hua, C. Leveraging enhanced egret swarm optimization algorithm and artificial intelligence-driven prompt strategies for portfolio selection. Sci. Rep. 2024, 14, 26881. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Bouaouda, A.; Hashim, F.A.; Sayouti, Y. Pied kingfisher optimizer: A new bio-inspired algorithm for solving numerical optimization and industrial engineering problems. Neural Comput. Appl. 2024, 36, 15455–15513. [Google Scholar] [CrossRef] [Scilit]
- Ghasemi, M.; Golalipour, K.; Zare, M. Flood algorithm (FLA): An efficient inspired meta-heuristic for engineering optimization. J. Supercomput. 2024, 80, 22913–23017. [Google Scholar] [CrossRef] [Scilit]
- Wang, J.; Wang, W.; Hu, X. Black-winged kite algorithm: A nature-inspired meta-heuristic for solving benchmark functions and engineering problems. Artif. Intell. Rev. 2024, 57, 98. [Google Scholar] [CrossRef] [Scilit]
- Zhao, S.; Zhang, T. Triangulation topology aggregation optimizer: A novel mathematics-based meta-heuristic algorithm for continuous optimization and engineering applications. Expert Syst. Appl. 2024, 283, 121744. [Google Scholar] [CrossRef] [Scilit]
- Mohammed, H.; Rashid, T. FOX: A FOX-inspired optimization algorithm. Appl. Intell. 2023, 53, 1030–1050. [Google Scholar] [CrossRef] [Scilit]
- Jia, H.; Rao, H.; Mirjalili, S. Crayfish optimization algorithm. Artif. Intell. Rev. 2023, 56, 1919–1979. [Google Scholar] [CrossRef] [Scilit]
- Sowmya, R.; Premkumar, M. Newton–Raphson-based optimizer: A new population-based metaheuristic algorithm for continuous optimization problems. Eng. Appl. Artif. Intell. 2024, 128, 107532. [Google Scholar] [CrossRef] [Scilit]
- Rodan, A.; Al-Tamimi, A.K.; Al-Alnemer, L.; Mirjalili, S.; Tiňo, P. Enzyme action optimizer: A novel bio-inspired optimization algorithm. J. Supercomput. 2025, 81, 686. [Google Scholar] [CrossRef] [Scilit]
- Zhang, C.; Lin, Q.; Gao, L. Backtracking search algorithm with three constraint handling methods for constrained optimization problems. Expert Syst. Appl. 2015, 42, 7831–7845. [Google Scholar] [CrossRef] [Scilit]
- Thakur, G.; Pal, A.; Mittal, N. Slime mould algorithm based on a Gaussian mutation for solving constrained optimization problems. Mathematics 2024, 12, 1470. [Google Scholar] [CrossRef] [Scilit]
- Ma, C.; Huang, H.; Fan, Q.; Wei, J.; Du, Y.; Gao, W. Grey wolf optimizer based on Aquila exploration method. Expert Syst. Appl. 2022, 205, 117629. [Google Scholar] [CrossRef] [Scilit]
- Preeti; Kaur, R.; Singh, D. Dimension learning-based chimp optimizer for energy efficient wireless sensor networks. Sci. Rep. 2022, 12, 14968. [Google Scholar] [CrossRef] [Scilit] [PubMed]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.




