Next Article in Journal
Assessing Complexity in Physiological Systems through Biomedical Signals Analysis
Previous Article in Journal
Composite Multiscale Partial Cross-Sample Entropy Analysis for Quantifying Intrinsic Similarity of Two Time Series Affected by Common External Factors
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A-DVM: A Self-Adaptive Variable Matrix Decision Variable Selection Scheme for Multimodal Problems

by
Marco Antonio Florenzano Mollinetti
1,*,
Bernardo Bentes Gatto
2,
Mário Tasso Ribeiro Serra Neto
3 and
Takahito Kuno
1
1
School of Systems and Information Engineering, University of Tsukuba, Tsukuba 305-8577, Japan
2
Center for Artificial Intelligence Research (C-AIR), University of Tsukuba, Tsukuba 305-8577, Japan
3
Department of Computer Science, University of Porto, 4050-290 Porto, Portugal
*
Author to whom correspondence should be addressed.
Entropy 2020, 22(9), 1004; https://doi.org/10.3390/e22091004
Submission received: 27 July 2020 / Revised: 1 September 2020 / Accepted: 4 September 2020 / Published: 9 September 2020

Abstract

:
Artificial Bee Colony (ABC) is a Swarm Intelligence optimization algorithm well known for its versatility. The selection of decision variables to update is purely stochastic, incurring several issues to the local search capability of the ABC. To address these issues, a self-adaptive decision variable selection mechanism is proposed with the goal of balancing the degree of exploration and exploitation throughout the execution of the algorithm. This selection, named Adaptive Decision Variable Matrix (A-DVM), represents both stochastic and deterministic parameter selection in a binary matrix and regulates the extent of how much each selection is employed based on the estimation of the sparsity of the solutions in the search space. The influence of the proposed approach to performance and robustness of the original algorithm is validated by experimenting on 15 highly multimodal benchmark optimization problems. Numerical comparison on those problems is made against the ABC and their variants and prominent population-based algorithms (e.g., Particle Swarm Optimization and Differential Evolution). Results show an improvement in the performance of the algorithms with the A-DVM in the most challenging instances.

1. Introduction

Artificial Bee Colony (ABC) is a swarm intelligence (SI) heuristic for optimization problems inspired by the foraging behavior of honeybees. It was initially designed to solve box-constrained continuous problems [1]. The algorithm consists of three main steps–employed bees, onlooker bees and scout bees–that perform local and global search. In the original implementation of the ABC, at the employed and onlooker bees steps, a single component from each solution is chosen to be updated by a position update rule.
Following its conception, improvements to the search capabilities of the original ABC were proposed by many researchers. The great majority of these propositions centered around changes to the initialization of solutions in the solution space, update procedure of the first two phases and selection method in the onlooker phase [2]. Despite differences between each variant, they all share a common trait: the solution update rule chooses one to n decision variables with equal probability under a random uniform distribution. This may allow for a better exploration of the search space and prevent solutions to collapse in the same subspace at later iterations. However, issues to the consistency and convergence of the algorithm may arise due to this design choice.
Besides the uniformity of choice of decision variables, it has been observed that most ABC variants handle problems whose objective functions are multimodal poorly. Adaptations of the ABC to solve problems from this family include changes to the main update equation; adoption of a self-adaptive solution set growth/shrink scheme; and adaptations to the re-sampling step of stagnated solutions [2]. Despite efforts, the ABC still lacks a way to understand how the solutions are fitted and how apart they are in the objective function landscape.
Taking into account the deficiencies observed in the ABC mentioned above, we propose the Adaptive Decision Variable Matrix (A-DVM), a self-adaptive decision variable selection procedure that is an extension of a deterministic solution variable scheme developed in Mollinetti et al. [3]. A-DVM builds an augmented binary matrix that automatically balances deterministic and random decision variable selection to maintain a healthy amount of exploration in the early iterations while emphasizing exploitation in later stages. Levels of exploration and exploitation are monitored by an indicator of how many solutions cover the search space. The chosen estimator is the Δ value, a measure proposed by Morrison [4], which provides a reliable assessment of the shape of the distribution of the solutions along the main and peripheral axes of search. To validate the proposed approach, A-DVM is incorporated into the original ABC and several state-of-the-art variants and evaluated in a test set that features 15 multimodal unconstrained problems. Results are compared to the original counterparts of the ABCs, as well as to some well-established optimization algorithms such as the Particle Swarm Optimization (PSO) and Differential Evolution (DE).
The contributions that the A-DVM brings is twofold. First, a selection scheme that attempts to establish a balance between the global and local search along with the iterations so that the search can be conducted more efficiently. Naturally, it can be incorporated into any version of the ABC without interfering with any other mechanism. Second, a mean to assess how solutions of the solution set are spread throughout the search space and how well they fit the objective function value landscape. Such information is very beneficial in guiding solutions out of deceptive local optima when considering multimodal problems.
This work is organized as follows: Section 2 describes the original ABC. Section 3 discusses the main issues behind the fully randomized selection. Section 4 explains the idea behind the A-DVM. Section 5 reports the experiments and discusses the results. Lastly, Section 6 outlines the conclusion of the paper and points some future directions.

2. Artificial Bee Colony

Artificial Bee Colony (ABC) is a Swarm Intelligence (SI) heuristic developed by Karaboga [1] based on the mathematical model of the foraging and information sharing behavior of honey bees. The popularity of the ABC is due to its simple design and easiness to adapt to other families of optimization problems [5]. The conception of the algorithm was to solve continuous optimization problems of the following form:
minimize f x subject to x ̲ j x j x j ¯ , j = 1 , , d ,
where f : R n R is assumed to be multimodal. The canonical ABC described in Algorithm 1 is composed of four main steps, initialization, employed bees, onlooker bees, and scout bees step. In the initialization step, the solution set X is initialized based on specific rules. Then, solutions are sampled and updated by local and global search procedures iteratively until a stopping criterion is met.
ABC has three tunable parameters, the solution set size S N ; the maximum number of iterations M C N ; and the solution stagnation threshold L i t . A brief description of each step is given below. Let X = { x 1 , x 2 , , x S N } be the solution set where each x i is a point in R d .
Algorithm 1: Canonical Artificial Bee Colony
Entropy 22 01004 i001

2.1. Initialization

If no information of the solution space is provided, x i is sampled from a uniform distribution in the feasible interval [ x ̲ j , x j ¯ ] of each decision variable x j i , i.e., for i = 1 , 2 , , S N ,
x i = x ̲ j + U ( 0 , 1 ) x j ¯ x ̲ j , j = 1 , d .
where U ( 0 , 1 ) denotes a uniform distribution between 0 and 1. A counter l i = 0 to indicate unsuccessful updates is initialized for each i.

2.2. Employed Bees Cycle

A randomly chosen component x j i of each solution x i X is moved by a random step size towards the jth component of some x k X , k i . Therefore x i is updated into:
x q i = x j i + ϕ ( x j i x j k ) if q = j , x q i , otherwise ,
where ϕ U ( 1 , 1 ) . To verify if the update step was successful, the value of f is evaluated and a greedy selection is done for each i = 1 , 2 , S N :
x i = x i + ( x j i x j i ) e j , l i = 0 if f ( x i + ( x j i x j i ) e j ) f ( x i ) , x i , l i = l i + 1 otherwise , .
where e j is the j-th fundamental vector. Needless to say, if (3) fails, then (4) will flag (3) as a failed update.

2.3. Onlooker Bees Phase

The solution x i X is chosen with probability p i according to a weighted roulette selection scheme and updated using (3). This step can be thought of enhancing local search for solutions with better objective function values. The probability p i is determined for each solution x i X as follows,
s e l e c t f o n t p i = F ( x i ) i = 1 S N F ( x i ) ,
where F ( · ) is the adjusted objective function value:
F ( x i ) = 1 1 + f ( x i ) if f ( x i ) 0 1 + f ( x i ) otherwise .

2.4. Scout Bees Phase

Let X ˜ = { x k X | l k L i t } denote the set of solutions flagged as stagnated. A new point in R d is resampled using (2) if X ˜ . This prevents the algorithm from premature convergence to bad local optima and increases the number of explorations. The parameter L i t is commonly defined equal to S N · d . If X ˜ , then x w argmax { f ( x ) | x X ˜ } is always chosen to be resampled.

2.5. ABC Variants

Due to the modular nature of the ABC it is easy to make changes to any of the three steps of the algorithm [6]. Many modifications were proposed by several researchers to improve on some difficulties of the algorithm such as inclusion of memory to assist local search; efficient mechanisms to displace solutions stuck in local optima; handle high-dimensional ( d > 100 ) problem instances; changes to the update rule; and initialization of solutions using local information. As observed by Aydin et al. [2], the ABC variants often differ in some core components such as the initialization of the first solution set; the update step in the employed and onlooker bees; the computation of selection probabilities in the onlooker bees, the way of displacing solutions in the scout step.
Some well-known and successful variants include the chaotic ABC version of Alatas and Bilal [7] which uses chaotic maps for solution initialization, the ABC of Akay and Karaboga [8] and Gao and Liu [9] which update multiple decision variables in a single update step. Additionally, the ABC with modified selection scheme based on neighborhood distances by Diwold et al. [10], integration of the Differential Evolution algorithm with the ABC by Xiang et al. [11] and Akay et al. [12] are well known. The reader is encouraged to read the survey of Karaboga et al. [6], Sharma and Bhambu [13] for further information.

3. Issues Of Randomization

Population-based optimization methods usually employ randomization. By choosing step sizes, decision variables or even target solutions at random during the update steps, population-based optimization methods can “cover more ground” in the search space effortlessly. This is a key element to the success of population-based heuristics, but not without some unintended side effects.
For the sake of clarity, we refer in accordance to [14] to a neighborhood N ( · ) as the classical definition of a Euclidean ball centered at a point x k ,
s e l e c t f o n t N ( x k ) = { x R d : x x k 2 ϵ } ,
where · 2 is the 2 norm and ϵ 0 . Assume that a stochastic heuristic, such as the Artificial Bee Colony (ABC), runs infinitely on a problem ( f , S ) P , where f is the objective function, S is the feasible set, and P is a problem family. Moreover, borrowing some concepts explained in [15], let X f , S ( ω ) = { f ( ω k ) | k = 1 , 2 , } denote the infinite sequence of iterates generated by the heuristic where ω = { ω k | k = 1 , 2 , } is a sequence of random numbers distributed independently from ( f , S ) . Let X f , S and X ¯ f , S denote the set of accumulation points and the closure of the sequence X f , S ( ω ) . Lastly, let X f , S * denote the set of global optima. Clearly no X * can be “seen” if X ¯ f , S X f , S * = or X ¯ f , S X f , S * = .
In the following section, we will see how randomization affects the performance of the ABC.

An Analysis of the ABC Decision Variable Selection

Often overlooked, a common aspect of the ABC variants is that decision variable x j i is chosen according to the same uniform distribution with for all j = 1 , 2 , d during the Onlooker and Employed bees steps.
Let P r ( x j i ) be the probability that x j i is chosen in (3). For each situation below, we assume that ( f , S ) P , X ¯ f , S X f , S * and X f , S ( ω ) is monotonically decreasing, i.e., f ( ω 1 ) f ( ω 2 ) . The original ABC chooses a single x j i each time it calls (3) during the Onlooker and Employed bees step. We need to notice the following issues brought by the process of selecting j randomly.
  • Failed update steps cause solutions to be trapped in basins of attraction: Choosing the same wrong decision variable many times fails to move solutions out of basins of attraction, contributing to wasteful iterations, premature convergence and needless flagging of solutions at the scout bees step. Let x w * X f , S , x k * X f , S , x s * X f , S . Suppose that x w N ( x w * ) and x k N ( x k * ) . Also suppose f ( x w ) = f ( x w * ) , f ( x w ) f ( x s * ) , f ( x w ) > f ( x k * ) , and N ( x k * ) and N ( x s * ) are adjacent to N ( x w * ) .
    Lastly, let x j w be a component of x w such that a successful update moves x w to N ( x k * ) while an update to x q w for any q j moves x w to N ( x s * ) . x w is moved in (3) one axis at a time, if x j w is chosen, then (4) accepts x w and l w = 0 . Otherwise, l w is incremented by 1 every time x w is rejected by (4). If each component is chosen in (3) with equal probability, then the probability of x j w to be chosen is P r ( x j w ) = 1 / d . Therefore, x w has a probability of 1 1 / d to move to a basin of attraction N ( x s * ) similar to N ( x w * ) , and probability 1 / d to move to a more promising region N ( x k * ) .
  • Decision variables may never be chosen: If the problem is of high-dimensional ( d > 100 ) or the evaluation function f ( x ) is so expensive that only a limited number of objective function calls are allowed, there will be at least a component x j i that may never be chosen in (3). Let P r ( x j i ) = 1 1 / d be the probability of x j i not to be chosen at (3). Then the probability of x j i not to be chosen be at the end of M C N iterations is P r M C N ( x j i ) = n = 1 2 M C N 1 1 / d . It is clear that P r M C N ( x j i ) converges to 0 as the number of iterations goes to infinity. If d > 100 and ABC runs t d iterations, then P r M C N ( x j i ) 1 , so x j i is not chosen in (3).
At first glance, there would be two ways to resolve these issues. Either assign a non-equal probability to choose the decision variable or choose more than one x j i at (3) to be updated simultaneously. We disprove the effectiveness of these “quick fixes” through following arguments.
  • Changing the choice probabilities of decision variables to be unequal would not solve issue # 2 in high-dimensional problems because P r M C N ( x j i ) still converges to 0. A sufficient measure, in this case, would keep previously chosen components in memory. This only increases the complexity of the Onlooker and Employed bees phase from O ( n ) to O ( n log n ) if non-visited components are kept in a separate list for each solution in X in an efficient way
  • Changing (3) to choose multiple components from x i would not improve issue # 1 . Let J { 1 , , d } and suppose that x j i is chosen for each j J to update. Update rule (3) is an affine transformation in the j-th axis along the line segment between x j i and x j k , i k . If | J | > 1 , then | J | simultaneous affine transformations in the | J | -dimensional subspace between x i and x k would be performed. In terms of complexity, there would be no burden j decision variables are updated at once by means of a matrix product operation. However, in terms of performance, there would be no improvement because of two reasons. First, moving along many axes at once does not reduce the possibility of x i to remain in N ( x * ) if x k N ( x * ) . Secondly, setting | J | > 1 in (3) has been shown to be not as good as | J | = 1 in later iterations due to the coarseness of the search when most of the solutions have converged to a single accumulation point [2].
In the following section, we present a method that provides a solution to the issues stated above, the Adaptive Decision Variable Matrix (A-DVM). A-DVM is a decision selection variable scheme proposed to the ABC.

4. A Novel Decision Variable Selection Mechanism

We propose a method for selecting decision variables efficiently without any additional memory nor simultaneous update of multiple components. The Adaptive Decision Variable Matrix (A-DVM) is an extension of the decision variable selection procedure of Mollinetti et al. [3]. It exploits the same modular nature as the Artificial Bee Colony (ABC), and thereby it can be integrated to the employed and/or onlooker bees phase without interfering with any additional steps of the original or any variant. To emphasize the difference between the A-DVM and Mollinetti et al. [3] deterministic selection, we briefly explain their proposition as follows.

4.1. Fully Deterministic Decision Variable Selection

The selection scheme proposed by Mollinetti et al. [3] is inspired by Cantor’s Diagonalization argument used to prove the non-existence of bijection from the set of natural numbers to the set of real numbers [16,17]. Cantor’s argument state that any binary square matrix T does not have the same column as the vector consisting of the complements of the diagonal elements of T. The authors extended this notion to generate new solutions x i in the solution set X. For any given problem, the deterministic decision variable selection arranges the solution set X into a R d × S N matrix:
A = [ x 1 x 2 x S N ] .
If A is a square matrix, the entries on the main diagonal are stored in an m-vector c = ( a 11 , a 22 , , a m n ) and undergo the update step. In general, the higher the number of solutions, the better the exploration of the search, and so S N > d holds. If A is wide, then vector c consists of entries on the main diagonal and the superdiagonals of A offset d units to the right. For instance, if A is a 2 × 6 matrix, then c will be:
A = a 11 a 12 a 13 a 14 a 15 a 16 a 21 a 22 a 23 a 24 a 25 a 26 c = ( a 11 , a 22 , a 13 , a 24 , a 15 , a 26 ) .
The vector c allows (3) to be performed simultaneously for all columns of A by means of a simple vector multiplication:
s e l e c t f o n t c = ψ ( c + Φ ( c z ) ) ,
where ⊙ is the Hadamard product, Φ is a S N column vector of values sampled from U ( 1 , 1 ) , z = ( z 1 , , z S N ) c , and ψ ( · ) is a function similar to (4) defined as:
ψ ( c i ) = c i , l i = 0 if f ( x i + ( c i x j i ) e j ) f ( x i ) c i , l i = l i + 1 otherwise .
Suppose in the matrix A of the above example that if f ( x 1 + ( c 1 x 1 1 ) e 1 ) f ( x 1 ) and f ( x 2 + ( c 2 x 2 2 ) e 2 ) f ( x 2 ) , then c = ( c 1 , c 2 , a 13 , a 24 , a 15 , a 26 ) . Thus, entries a 11 and a 22 are replaced with c 1 , c 2 in A, and the corresponding values of f are updated.
Lastly, a safeguard step is performed so that every decision variable of each candidate solution can be updated at least once before the algorithm termination. The last column x S N of A is moved to the first position and the remaining columns are shifted one position to the right. Referring to the example, the matrix A is now:
A = c 1 a 12 a 13 a 14 a 15 a 16 a 21 c 2 a 23 a 24 a 25 a 26 a 16 c 1 a 12 a 13 a 14 a 15 a 26 a 21 c 2 a 23 a 24 a 25
This step ensures that every decision variable is updated by (8) every d iterations.
The results in Mollinetti et al. [3] indicate that eliminating the randomness in the choice of the decision variable in (3) boosted the performance of the original ABC in multimodal problems of up to 30 decision variables. However, it is observed that the diversity of solutions was compromised because local search was more emphasized over global search. From this result, we suppose that the bias towards local search brought by the fully deterministic parameter selection has yet not solved issue # 1 . In fact, if anything, the fully deterministic selection made it worse. Therefore, reintroducing a small degree of randomness while guaranteeing that every solution is chosen at some iteration is a step in the right direction to refocus global search.

4.2. A Self-Adaptive Decision Variable Selection Procedure (A-DVM)

Let us change the focus to a partially deterministic selection, and reintroduce an adaptive degree of randomness to the selection process based on the “spread” of solutions throughout the search space. The variables x j i are chosen via a binary decision matrix. The goal of the A-DVM is not only to provide an acceptable solution to the issues discussed in Section 3, but to improve the overall performance of the state-of-the-art of ABC for the multimodal and high-dimensional problem of the form of (1).
The main piece of the A-DVM is the d × S N binary matrix P a m that represents which x j i has been chosen to be updated by (3) or (8). The matrix P a m is a composition of two matrices, P r , a binary matrix with a single 1 in each column, whose row is determined randomly according to a uniform distribution; and P d , a matrix with 0 or 2 in each entry generated by the fully deterministic scheme of Mollinetti et al. [3]. For example, P r and P d are matrices of the form:
P r = 0 0 0 1 0 0 0 0 1 0 0 0 1 0 0 0 1 0 1 0 1 0 0 0 0 ,                 P d = 2 0 0 0 2 0 0 2 0 0 0 0 0 0 2 0 0 0 0 0 0 2 0 2 .
The matrix P a m is the result of a composition of P r into P d . That means some solutions x i X have their j-th component randomly selected when updated by (3) or (8) while the rest have their j-th component chosen by the fully deterministic scheme. We write P a m = β P r α P d when β % of the columns of P a m are from P r and the remaining α ( = 1 β ) % are from P d . An example of P a m based on the above example is as follows:
P a m = β P r α P d = 0 0 0 0 0 0 0 2 0 0 0 0 1 0 2 0 1 0 0 0 0 0 0 2 0 2 .
The degree of how much P d is favored over P r is represented by the coefficient α that is iteratively adjusted as follows, to maintain a healthy diversity of solutions while balancing between local search and local search:
s e l e c t f o n t α = ( 1 Δ ) K 1 + Δ K 2 ,
where Δ [ 0 , 1 ] is the measure of the dispersion of the population at the current iteration and K 1 and K 2 are scaling parameters set to 0.3 and 0.7 in accordance to McGinley et al. [18]. Values of α close to 1 signify high population diversity and activate exploitation by the deterministic selection. On the other hand, values close to 0 boost exploration using random selection. Because solutions in population-based algorithms tend to concentrate around accumulation points x X f , S after a considerable amount of iterations [14], α is increased by a growth function ρ defined as follows, to intensify local search around x after t iterations:
ρ ( · ) = α = α e γ t if t > t , α otherwise ,
where γ is set to 0.01 . The value of t is given by:
s e l e c t f o n t t = min n · d λ t · t m a x , λ t t m a x ,
where an acceptable value for λ t was empirically verified to be 0.1 .
To ensure that every decision variable is chosen in at least every d iterations, we introduce a history H { 0 , 1 } d that stores which columns of P d were put into P a m , and give a chance to the remaining columns of P d to be contained in P a m at the next iteration. We enforce a bound on the number of iterations that solutions are chosen by the fully deterministic selection to be no more than 3 5 K 1 and no less than 1 2 K 2 (refer to (10)). When the entries in H are all ones, H is reinitialized and the whole process runs again. The overall steps of the A-DVM are outlined in Algorithm 2.
Algorithm 2: Steps of the A-DVM
Entropy 22 01004 i002

4.3. The Δ Dispersion Estimate

Estimating the dispersion of the solutions in the search space is specifically effective for population-based algorithms to deal with multimodal or high-dimensional problems. Measuring how far apart solutions in X are from each other is very helpful to guide them towards accumulation points or free them from local optima. Significant contributions related to this subject can be found in Ursem [19] and Back et al. [20] which introduced the Sparse Population Diversity (SPD) metric, a method for estimating the variation of the solution set by measuring the distance from each solution in relation to the centroid. McGinley et al. [18] proposed the Healthy Population Diversity (HPD), an extension of the SPD that introduces the concept of individual contribution to the computation of the centroid.
Metrics like SPD and HPD may accurately and inexpensively identify differences between the solutions in X by measuring the distances to each x i . However, this kind of measurement does not take into account how the solutions are distributed in the search space, which is problematic since the same measurement values from SPD and HPD may indicate different search-space coverage of solution of X. Because of that, we employ the Δ dispersion measure introduced in Morrisson [4], initially proposed for Evolutionary Algorithms with binary solution encoding, and adapt it to continuous problems in the form of (1). Computation of Δ is as follows:
s e l e c t f o n t Δ = Δ 1 + Δ 2 = 1.75 S 1.75 ,
where Δ 1 = 0.75 S 1 , Δ 2 = 1 S 2 and S = S 1 + S 2 . The values of S 1 and S 2 are obtained by measuring the moment of inertia of the solution centroid in relation to each solution. We denote as P = X as the number of solutions x i X . The centroid c r j of the jth components and the moment of inertia I j of centroid c r j are
s e l e c t f o n t c r j = i = 1 P x j i P , I j = i = 1 P ( x j i c r j ) 2 , j = 1 , , d .
The first measure S 1 involves a quantitative assessment of the solutions around the distribution centroid. Assuming the distribution around the centroid to be uniform, S 1 is
s e l e c t f o n t S 1 = max j I U o I j + P c r j 2 P ,
where I U o represents the inertia of a uniform distribution:
s e l e c t f o n t I U o = i = 1 P i P + 1 2 .
Measure Δ 2 indicates how much the calculation of Δ 1 is misleading when the distribution is not uniform in the search-space, since Δ 1 only verifies non-uniformity along the principal diagonal of the search space. The second measure S 2 is
S 2 = max P χ c + j ( 1 c r j ) j ϕ j P P , P χ c j ( c r j ) j ϕ j P P .
where c = { x j i X | x j i c r j } , c + = { x j i X | x j i c r j } , χ is the characteristic function that returns either 0 or 1 whether a solution belongs to c or c + , respectively, and ϕ j is the range between [ x ̲ j , x ¯ j ] , so that j = 1 d ϕ j = 1 for an N-dimensional unit volume.

4.4. Remarks On Complexity

As for the complexity, S N function evaluations are done in each employed and onlooker bees phase, so the addition of A-DVM preserves the same 2 n + 1 function evaluations per iteration as the classical ABC. The effort to compute the sum of moments of inertia and Δ dispersion is proportional to the solution set size S N [4]. Updates of solutions (3) during the employed or onlooker bees is done one by one in a loop require O ( n ) time for the size S N of solution set X. On the other hand, offline update (8) can be done in a linear time due to the vector multiplication. We recommend (8) for parallel versions of the ABC, when M C N is large or the evaluation of f ( x ) is expensive.
Regarding lookup table H, it is verified in O ( n ) time which columns of P d were not chosen to be a part of P a m . Lastly, about binary matrix P d , because the deterministic parameter selection extracts the diagonal of solution set X, it is recommended to set S N d to ensure that every decision variable of each solution is chosen in at most d iterations.

5. Experiment and Results

A numerical experiment was carried out to answer the following research questions: “Does incorporating the Adaptive Decision Variable Matrix (A-DVM) improve the Artificial Bee Colony (ABC) and its variants overall performance on multimodal problems?”. To provide an answer to that question, we chose 15 instances of (1), each of which is designed to validate the capability of metaheuristics to handle multimodal and non-smooth objective functions. The instances are ranked in the top 30 hardest continuous optimization functions in the Global Optimization Benchmarks suite [21]. The number of variables ranges from 2 to 30 to test the robustness of the solvers when dealing with many as well as few variables. Each algorithm is executed 30 times with the same seed interchangeably in a random fashion to avoid bias in the machine load. The number of variables, the box constraint range [ l j , u j ] and the global optimum of each instance are listed in Table 1.
Testing involves the incorporation of the A-DVM to the onlooker and employed bees phase of the following versions of the ABC: the original ABC from Karaboga [22] (ABC+A-DVM), two versions of the global best guided ABC (gbestABC) from Gao et al. [23] (GBESTABC+A-DVM, GBESTABC2+A-DVM) and two versions of the ABC-X from [2] for multimodal problems (ABC-XM1+A-DVM, ABC-XM2+A-DVM). The original counterparts were also used for the baseline (ABC, GBESTABC, GBESTABC2, ABC-XM1, ABC-XM5) together with the modified ABC for multidimensional functions (MABC) from Akay and Karaboga [8] and its version with the A-DVM (MABC+A-DVM). Comparison is not limited only to ABCs and variants, but popular population-based algorithms, such as the Particle Swarm Optimization from Kennedy and Eberhart [24], Evolutionary Particle Swarm Optimization by Miranda and Fonseca [25] and Differential Evolution (DE) [26], were also included in the experiment.
The stopping criteria for each algorithm was set to 10 5 function evaluations (FE’s) or if the difference between the best value found so far and the global optimum f ( x * ) is less than 10 8 . The population size was common to all algorithms and fixed at 30. For PSO, the inertia factor ( w 1 ) was set to 0.6 and both cognitive and social parameters ( w 2 , w 3 ) to 1.8 . For Differential Evolution (DE) [26] with best1bin strategy, F value was 0.5 and CR 0.9 . For each version of the ABC: L i t = S N · d . For MABC, M R , S F and m were 0.5 , 0.7 , and 2.5 % of maximum FE’s, respectively. ABC-X parameters were L i t = 1.06 · d , maximum population of 66 and minimum of 15 for ABC-Xm1 and L i t = 0.83 · d , while for ABC-Xm5, maximum population of 78 and minimum of 17. Lastly, parameters γ and λ t of the A-DVM were set to 0.1 .
The experiment was conducted in a machine with the following hardware configuration: Intel core i7-6700 “Skylake” 3.4 GHz CPU; 16 GB RAM DDR4 3200 clocked at 3000 MHz. The running operating system (OS) is UbuntuOS 18.04. All algorithms were written in the python 3 programming language. Floating point operations were handled by the numpy package, version 1.19.1.
Table 2, Table 3, Table 4, Table 5, Table 6 and Table 7 show the computational results obtained from this experiment. The statistics used for comparison are the mean, standard deviation, median, and best-worst results obtained from 30 runs with distinct random seeds shown in Table 6 and Table 7. Statistical significance between pairs is verified by the Mann-Whitney U-test for non-parametric data, with confidence interval α set to 0.95 as shown in Table 2, Table 3, Table 4 and Table 5. Entries where p > 0.05 denotes no statistical difference between the algorithms. For better legibility, the precision of decimals is set to 5 digits and values lower than 10 6 are rounded to 0. Plots of the behavior of each algorithm are shown in Figure 1, Figure 2 and Figure 3. Each line represents the mean of the best solution of all executions for each function evaluation call. All plots were log-scaled for better legibility. If the performance of any algorithm for a particular instance is statistically significant, it means that its p-value in the U-test is less than 0.05 in the pairwise comparison against all other algorithms. The bold numbers in the tables indicate the least value for that particular statistic and instance.
First, we discuss the Rosenbrock, Whitley and Zimmerman function instances where the A-DVM resulted in overall worse performance than all their original counterparts. The A-DVM was indeed able to guide the functions towards a valley, but a thorough local search mechanism was lacking due to the parabolic surface of the Rosenbrock function [27]. The same behavior is observed in the Whitley and Zimmerman functions, which share the same property as Rosenbrock instance. The poor results in these functions imply a failure of the A-DVM to properly address issues # 1 and # 2 discussed in Section 3. Additionally, we can relate this case to the no-free-lunch theorem of Wolpert [28], saying that no algorithm can be strictly better than the others in every problem instance. The inferior results of the A-DVM are also seen for the Rastrigin function in the ABC-X variants. The Cause of such behavior could be due to intensification of the local search mechanism that forced solutions to stay far from the local attractors of the surface of the functions.
Strong evidence of the robustness of the A-DVM against strongly multimodal surfaces was found in the Damavandi, DeVilliersGlasser02 and CrossLegTable instances, ranked as the three hardest functions in the benchmark suite [21]. Both functions feature large basins of attraction for bad local optima, the number of which is directly proportional to the problem dimensionality. There are two possible causes explaining why the A-DVM versions were not superior to all other versions in these particular instances. First, a small number of dimensions means that a square matrix can be built, providing a thorough exploration of the search space. Second, exploration in the early stages allowed solutions to escape from the basins of attraction.
Evidence that the A-DVM improved the search process in comparison to their counterparts without the search can be seen in the Bukin06, SineEnvelope, CrownedCross and Schwefel06. Although the ABCs with A-DVM were not the best solvers, their robustness was statistically significant in comparison to the versions without A-DVM. Lastly, in the Cola, Griewank, XinSheYang03 and Trefethen, no statistical significance that corroborated that the incorporation of the A-DVM improved or worsened the performance of the original algorithm was found.

6. Conclusions

In this paper, a decision variable selection scheme named Adaptive Decision Variable Matrix (A-DVM) was proposed to be incorporated in the Artificial Bee Colony (ABC) algorithm. A-DVM can be incorporated in both employed and or onlooker bees phases and can be used with any variant of the ABC. A-DVM attempts to balance exploration and exploitation throughout the execution of the algorithm by constructing an augmented binary matrix that represents the choice of components of solutions in the solution set. The binary matrix is composed of a deterministic selection binary matrix that chooses matrix diagonals according to the proposal in [3] and another binary matrix whose components were selected by a random uniform distribution. The number of columns to be used from the deterministic matrix is determined by a self-adaptive parameter that is based on the Δ value, a measure of the sparsity of the actual solution set in the search space. Introducing a lookup table of chosen solutions of P d guarantees that every solution is a part of P d in the update step at least once before termination.
Effects of the A-DVM to the performance of the ABC is verified by a numerical experiment including several versions of the ABC with the A-DVM included and their original counterparts. Representative heuristics such as the Particle Swarm Optimization (PSO), Evolutionary Particle Swarm Optimization (EPSO) and Differential Evolution (DE) are included in the experiment to provide a baseline for the results. For the sake of brevity and to narrow the scope of this work, other prominent Swarm Intelligence (SI) algorithms suited to the multimodal family of problem, such as the monarch butterfly optimization (MBO) [29]; earthworm optimization algorithm (EWA) [30]; elephant herding optimization (EHO) [31]; and moth search (MS) algorithm [32], were not part of the experiment.
The results indicate that the A-DVM enhances the ability of the ABC to adapt to highly multimodal functions. However, the elimination of the full global search of the stochastic selection resulted in solutions not converging towards accumulation points that are located in basins, as seen in some instances where the A-DVM performed poorly. Integration with ABC variants with smart restart procedures in the scout bees phase may be a possible direction to improve this issue.
Future works include in-depth sensitivity analysis and integration of the selection mechanism to the state-of-the-art ABC used for optimization competitions and testing on large scale problems, mechanical design and power systems to further investigate the performance of the selection. Moreover, a thorough comparative study of multimodal problems using only SI algorithms including the aforementioned examples is due. Another research direction includes applying the proposed method for weight tuning of shallow networks [33,34]. Such networks may benefit from the proposed optimization mechanism since it tackles small sample size problems featuring rough objective function landscapes.

Author Contributions

Conceptualization, Formal analysis, Writing—Original draft M.A.F.M.; Writing—Review & Editing, M.T.R.S.N. and B.B.G.; Supervision T.K. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

The following abbreviations are used in this manuscript:
SISwarm Intelligence
ABCArtificial Bee Colony
ABC-ESArtificial Bee Colony with Evolution Strategies
A-DVMAdaptive Decision Variable Matrix
PSOParticle Swarm Optimization
DEDifferential Evolution
SPDSpatial Population Diversity
HPDHealthy Population Diversity
MABCModified Artificial Bee Colony
GBESTABCGlobal Best Artificial Bee Colony

References

  1. Karaboga, D. An Idea Based on Honey Bee Swarm for Numerical Optimization; Technical Report; Erciyes University: Kayseri, Turkey, 2005. [Google Scholar]
  2. Aydın, D.; Yavuz, G.; Stützle, T. ABC-X: A generalized, automatically configurable artificial bee colony framework. Swarm Intell. 2017, 11, 1–38. [Google Scholar] [CrossRef]
  3. Mollinetti, M.A.F.; Neto, M.T.R.S.; Kuno, T. Deterministic Parameter Selection of Artificial Bee Colony Based on Diagonalization. In Proceedings of the International Conference on Hybrid Intelligent Systems, Porto, Portugal, 13–15 December 2018. [Google Scholar]
  4. Morrison, R.W. Designing Evolutionary Algorithms for Dynamic Environments; Springer Science & Business Media: Berlin/Heidelberg, Germany, 2013. [Google Scholar]
  5. Akay, B.; Karaboga, D. A survey on the applications of artificial bee colony in signal, image, and video processing. Signal Image Video Process. 2015, 9, 967–990. [Google Scholar] [CrossRef]
  6. Karaboga, D.; Gorkemli, B.; Ozturk, C.; Karaboga, N. A comprehensive survey: Artificial bee colony (ABC) algorithm and applications. Artif. Intell. Rev. 2014, 42, 21–57. [Google Scholar] [CrossRef]
  7. Alatas, B. Chaotic bee colony algorithms for global numerical optimization. Expert Syst. Appl. 2010, 37, 5682–5687. [Google Scholar] [CrossRef]
  8. Akay, B.; Karaboga, D. A modified artificial bee colony algorithm for real-parameter optimization. Inf. Sci. 2012, 192, 120–142. [Google Scholar] [CrossRef]
  9. Gao, W.; Liu, S. Improved artificial bee colony algorithm for global optimization. Inf. Process. Lett. 2011, 111, 871–882. [Google Scholar] [CrossRef]
  10. Diwold, K.; Aderhold, A.; Scheidler, A.; Middendorf, M. Performance evaluation of artificial bee colony optimization and new selection schemes. Memetic Comput. 2011, 3, 149. [Google Scholar] [CrossRef]
  11. Xiang, W.L.; An, M.Q. An efficient and robust artificial bee colony algorithm for numerical optimization. Comput. Oper. Res. 2013, 40, 1256–1265. [Google Scholar] [CrossRef]
  12. Akay, B.B.; Karaboga, D. Artificial bee colony algorithm variants on constrained optimization. Int. J. Optim. Control. Theor. Appl. 2017, 7, 98–111. [Google Scholar] [CrossRef] [Green Version]
  13. Sharma, S.; Bhambu, P. Artificial bee colony algorithm: A survey. Int. J. Comput. Appl. 2016, 975, 8887. [Google Scholar] [CrossRef]
  14. Locatelli, M.; Schoen, F. Global Optimization: Theory, Algorithms, and Applications; Society for Industrial and Applied Mathematics: Philadelphia, PA, USA, 2013; Volume 15. [Google Scholar]
  15. Stephens, C.; Baritompa, W. Global optimization requires global information. J. Optim. Theory Appl. 1998, 96, 575–588. [Google Scholar] [CrossRef] [Green Version]
  16. Weisstein, E.W. CRC Concise Encyclopedia of Mathematics; Chapman and Hall: London, UK; CRC: Boca Raton, FL, USA, 2002. [Google Scholar]
  17. Zakon, E. Mathematical Analysis; The Trillia Group: Molave St, Cebu, Philippines, 2004. [Google Scholar]
  18. Mc Ginley, B.; Maher, J.; O’Riordan, C.; Morgan, F. Maintaining healthy population diversity using adaptive crossover, mutation, and selection. IEEE Trans. Evol. Comput. 2011, 15, 692–714. [Google Scholar] [CrossRef]
  19. Ursem, R.K. Diversity-guided evolutionary algorithms. In International Conference on Parallel Problem Solving from Nature; Springer: Berlin/Heidelberg, Germany, 2002; pp. 462–471. [Google Scholar]
  20. Bäck, T.; Hoffmeister, F. Extended Selection Mechanisms in Genetic Algorithms; Morgan Kaufmann: Burlington, MA, USA, 1991; pp. 92–99. [Google Scholar]
  21. Gavana, A. Global Optimization Benchmarks and AMPGO. 2015. Available online: http://infinity77.net/global_optimization (accessed on 25 April 2019).
  22. Akay, B.; Karaboga, B. Artificial Bee Colony Algorithm for Large-Scale Problems and Engineering Design Optimization. J. Intell. Manuf. 2012, 23, 1001–1014. [Google Scholar] [CrossRef]
  23. Gao, W.; Liu, S.; Huang, L. A global best artificial bee colony algorithm for global optimization. J. Comput. Appl. Math. 2012, 236, 2741–2753. [Google Scholar] [CrossRef] [Green Version]
  24. Kennedy, J.; Eberhart, R. Particle Swarm Optimization. In Proceedings of the IEEE International Conference on Neural Networks, Perth, Australia, 27 November–1 December 1995; IEEE Press: Piscataway, NJ, USA, 1995; pp. 1942–1948. [Google Scholar]
  25. Miranda, V.; Fonseca, N. EPSO-evolutionary particle swarm optimization, a new algorithm with applications in power systems. In Proceedings of the Transmission and Distribution Conference and Exhibition 2002: Asia Pacific, Yokohama, Japan, 6–10 October 2002; IEEE Press: Piscataway, NJ, USA, 2002; Volume 2, pp. 745–750. [Google Scholar]
  26. Storn, R.; Price, K. Differential evolution—A simple and efficient heuristic for global optimization over continuous spaces. J. Glob. Optim. 1997, 11, 341–359. [Google Scholar] [CrossRef]
  27. Molga, M.; Smutnicki, C. Test functions for optimization needs. Test Funct. Optim. Needs 2005, 101, 48. [Google Scholar]
  28. Wolpert, D.H.; Macready, W.G. No free lunch theorems for optimization. IEEE Trans. Evol. Comput. 1997, 1, 67–82. [Google Scholar] [CrossRef] [Green Version]
  29. Wang, G.G.; Deb, S.; Cui, Z. Monarch butterfly optimization. Neural Comput. Appl. 2019, 31, 1995–2014. [Google Scholar] [CrossRef] [Green Version]
  30. Wang, G.G.; Deb, S.; Coelho, L.D.S. Earthworm optimisation algorithm: A bio-inspired metaheuristic algorithm for global optimisation problems. Int. J. Biol. Inspired Comput. 2018, 12, 1–22. [Google Scholar] [CrossRef]
  31. Wang, G.G.; Deb, S.; Coelho, L.D.S. Elephant herding optimization. In Proceedings of the 2015 3rd International Symposium on Computational and Business Intelligence (ISCBI), Bali, Indonesia, 7–9 December 2015; IEEE Press: Piscataway, NJ, USA, 2015; pp. 1–5. [Google Scholar]
  32. Wang, G.G. Moth search algorithm: A bio-inspired metaheuristic algorithm for global optimization problems. Memet. Comput. 2018, 10, 151–164. [Google Scholar] [CrossRef]
  33. Gatto, B.B.; dos Santos, E.M.; Fukui, K.; Júnior, W.S.; dos Santos, K. Fukunaga–Koontz Convolutional Network with Applications on Character Classification. Neural Process. Lett. 2020, 52, 443–465. [Google Scholar] [CrossRef]
  34. Gatto, B.B.; Souza, L.S.; dos Santos, E.M.; Fukui, K.; Júnior, W.S.; dos Santos, K.V. A semi-supervised convolutional neural network based on subspace representation for image classification. Eurasip J. Image Video Process. 2020, 2020, 1–21. [Google Scholar] [CrossRef]
Figure 1. Behavior of the Mean of all executions for Bukin06 to DeVilliersGlasser02 instances.
Figure 1. Behavior of the Mean of all executions for Bukin06 to DeVilliersGlasser02 instances.
Entropy 22 01004 g001
Figure 2. Behavior of the Mean of all executions for Griewank to Trefethen instances.
Figure 2. Behavior of the Mean of all executions for Griewank to Trefethen instances.
Entropy 22 01004 g002
Figure 3. Behavior of the Mean of all executions for Whitley to Zimmerman instances.
Figure 3. Behavior of the Mean of all executions for Whitley to Zimmerman instances.
Entropy 22 01004 g003
Table 1. Definition of Benchmark functions.
Table 1. Definition of Benchmark functions.
NameDimRangeOpt.NameDimRangeOpt.
Bukin0610[−10, 0]0.0Rosenbrock30[−30, 30]0.0
Cola17[−4, 4]11.7464Schwefel0630[−500, 500]0.0
CrossLegTable2[−10, 10]−1.0SineEnvelope20[−500, 500]0.0
CrownedCross2[−10, 10]0.0001Trefethen2[−10, 10]−3.0
Damavandi2[0, 14]0.0Whitley2[−10.24, 10.24]0.0
DeVilliersGlasser025[1, 60]0.0XinSheYang0320[−500, 500]0.0
Griewank30[−100, 100]0.0Zimmerman2[0, 100]0.0
Rastrigin30[−5.12, 5.12]0.0
Table 2. Pairwise U-test analysis from Bukin06 to Crowned Cross functions.
Table 2. Pairwise U-test analysis from Bukin06 to Crowned Cross functions.
Bukin06ABC-ESABCx+ADVM-m5MABCABC+A-DVMABCx-m5GBESTABC+A-DVMEPSOABCABCx-m1GBESTABCGBESTABC2+A-DVMGBESTABC2ABCx+ADVM-m1MABC+ADVM
PSO1.4323 × 10 11 0.2099221.48463 × 10 8 0.0002197960.1287481.82244 × 10 10 0.1686080.0004632910.1736325.37741 × 10 10 1.4323 × 10 11 1.4323 × 10 11 0.1383141.48463 × 10 8
ABC-ES-1.50993 × 10 11 5.13867 × 10 7 3.87146 × 10 10 1.50993 × 10 11 6.23853 × 10 5 1.47713 × 10 11 4.0485 × 10 10 1.50993 × 10 11 2.22121 × 10 7 0.04249980.0188911.50993 × 10 11 5.13867 × 10 7
ABCx+ADVM-m5--2.76643 × 10 8 0.0003406550.4499981.30493 × 10 10 0.4441244.89476 × 10 5 0.2144829.27889 × 10 10 1.50993 × 10 11 1.50993 × 10 11 0.1816112.76643 × 10 8
MABC---0.002516423.25914 × 10 9 0.03283564.17254 × 10 9 0.00254184.63014 × 10 9 0.2552962.5461 × 10 8 1.00761 × 10 8 2.28629 × 10 9 0.18406
ABC+A-DVM----5.42735 × 10 5 2.85674 × 10 6 3.23538 × 10 5 0.4440240.0001174324.43709 × 10 5 2.66077 × 10 10 8.46204 × 10 11 0.0001244340.00251642
ABCx-m5-----9.7839 × 10 11 0.467582.31892 × 10 5 0.2947263.05885 × 10 10 1.50993 × 10 11 1.50993 × 10 11 0.2552993.25914 × 10 9
GBESTABC+A-DVM------1.05577 × 10 10 3.14047 × 10 6 1.18573 × 10 10 0.1353493.1414 × 10 6 4.42055 × 10 7 8.88454 × 10 11 0.0328356
EPSO-------3.52994 × 10 5 0.4793563.2109 × 10 10 1.47713 × 10 11 1.47713 × 10 11 0.3921794.17254 × 10 9
ABC--------2.04147 × 10 5 7.01841 × 10 5 1.73612 × 10 10 9.77827 × 10 11 1.38593 × 10 5 0.0025418
ABCx-m1---------4.44312 × 10 10 1.50993 × 10 11 1.50993 × 10 11 0.3780994.63014 × 10 9
GBESTABC----------2.15438 × 10 8 2.09022 × 10 9 4.87515 × 10 10 0.255296
GBESTABC2+A-DVM-----------0.3530861.50993 × 10 11 2.5461 × 10 8
GBESTABC2------------1.50993 × 10 11 1.00761 × 10 8
ABCx+ADVM-m1-------------2.28629 × 10 9
ColaABC-ESABCx+ADVM-m5MABCABC+A-DVMABCx-m5GBESTABC+A-DVMEPSOABCABCx-m1GBESTABCGBESTABC2+A-DVMGBESTABC2ABCx+ADVM-m1MABC+ADVM
PSO1.50993 × 10 11 1.50993 × 10 11 1.50993 × 10 11 1.50993 × 10 11 1.50993 × 10 11 1.50993 × 10 11 1.50898 × 10 11 1.50993 × 10 11 1.50993 × 10 11 1.50993 × 10 11 1.50993 × 10 11 1.50993 × 10 11 1.50993 × 10 11 1.50993 × 10 11
ABC-ES-0.2648910.002784970.3421610.193550.04813140.003485830.2059550.0005571280.01756830.1855390.05116313.79957 × 10 7 0.00278497
ABCx+ADVM-m5--0.004734130.4675960.3809140.0667270.005156810.3102020.001026170.03622280.4324970.04813145.9684 × 10 7 0.00473413
MABC---0.01034040.02179180.2188210.0287280.01118010.0386360.2552990.03176630.1855396.23853 × 10 5 0.18406
ABC+A-DVM----0.386560.1486360.004733640.4324970.001516970.07898780.3585940.1031038.64516 × 10 7 0.0103404
ABCx-m5-----0.1816110.006365440.4324970.002016490.07898780.4911540.1555941.24566 × 10 6 0.0217918
GBESTABC+A-DVM------0.01207750.1031030.01034040.4617210.2017690.4209012.98528 × 10 5 0.218821
EPSO-------0.005380760.3809130.01888970.009555360.008141660.4093720.028728
ABC--------0.001026170.06483510.4970510.1112861.24566 × 10 6 0.0111801
ABCx-m1---------0.02420670.002914080.007206090.1816110.038636
GBESTABC----------0.09789540.4383177.03343 × 10 5 0.255299
GBESTABC2+A-DVM-----------0.1701445.09384 × 10 6 0.0317663
GBESTABC2------------1.13901 × 10 5 0.185539
ABCx+ADVM-m1-------------6.23853 × 10 5
CrossLegTableABC-ESABCx+ADVM-m5MABCABC+A-DVMABCx-m5GBESTABC+A-DVMEPSOABCABCx-m1GBESTABCGBESTABC2+A-DVMGBESTABC2ABCx+ADVM-m1MABC+ADVM
PSO1.88668 × 10 10 6.15459 × 10 5 0.009884188.29814 × 10 6 0.0004019450.07387620.1250634.85361 × 10 7 0.0001863380.1811790.05075160.0555470.0001863380.00988418
ABC-ES-7.0328 × 10 10 2.59815 × 10 12 9.38541 × 10 12 2.78175 × 10 10 1.19757 × 10 11 1.37041 × 10 11 1.10665 × 10 11 6.43181 × 10 10 1.17704 × 10 11 6.81594 × 10 12 8.24062 × 10 12 8.46924 × 10 10 2.59815 × 10 12
ABCx+ADVM-m5--6.66123 × 10 11 3.34893 × 10 11 0.4324832.41841 × 10 9 8.32168 × 10 9 2.57089 × 10 11 0.06116354.60855 × 10 9 5.24118 × 10 10 7.24385 × 10 10 0.07681936.66123 × 10 11
MABC---2.00663 × 10 5 8.45378 × 10 10 0.1758280.1531622.20242 × 10 7 2.60004 × 10 12 0.04677080.1467790.1541372.60004 × 10 12 0.18406
ABC+A-DVM----5.55389 × 10 10 0.002580240.005510080.06122469.39154 × 10 12 0.000141592.62516 × 10 5 5.04706 × 10 5 9.39154 × 10 12 2.00663 × 10 5
ABCx-m5-----5.96732 × 10 9 1.26859 × 10 8 4.07016 × 10 10 0.1199189.61915 × 10 9 2.85227 × 10 9 3.41938 × 10 9 0.1321568.45378 × 10 10
GBESTABC+A-DVM------0.3080420.0004119541.19833 × 10 11 0.2533750.3965630.4219041.19833 × 10 11 0.175828
EPSO-------0.00122395.50656 × 10 11 0.481830.2769690.2889254.10246 × 10 11 0.153162
ABC--------1.10736 × 10 11 1.06775 × 10 5 8.00576 × 10 7 1.62891 × 10 6 1.10736 × 10 11 2.20242 × 10 7
ABCx-m1---------1.1778 × 10 11 6.82052 × 10 12 8.24607 × 10 12 0.1591522.60004 × 10 12
GBESTABC----------0.1609710.1765641.1778 × 10 11 0.0467708
GBESTABC2+A-DVM-----------0.48316.82052 × 10 12 0.146779
GBESTABC2------------8.24607 × 10 12 0.154137
ABCx+ADVM-m1-------------2.60004 × 10 12
CrownedCrossABC-ESABCx+ADVM-m5MABCABC+A-DVMABCx-m5GBESTABC+A-DVMEPSOABCABCx-m1GBESTABCGBESTABC2+A-DVMGBESTABC2ABCx+ADVM-m1MABC+ADVM
PSO1.88774 × 10 10 6.15459 × 10 5 0.003138742.16704 × 10 5 0.0004019450.03082990.1250631.24881 × 10 5 0.0001863380.2254140.01311810.1561570.0001862670.00313874
ABC-ES-7.03648 × 10 10 3.88432 × 10 12 8.46104 × 10 12 2.78328 × 10 10 1.2895 × 10 11 1.37128 × 10 11 9.49637 × 10 12 1.74856 × 10 9 1.19987 × 10 11 1.01877 × 10 11 7.7844 × 10 12 3.68616 × 10 10 3.88432 × 10 12
ABCx+ADVM-m5--7.59201 × 10 11 3.5606 × 10 11 0.4324831.76096 × 10 9 8.32168 × 10 9 3.66889 × 10 11 0.1353365.53236 × 10 9 5.39866 × 10 10 1.61048 × 10 9 0.02256277.59201 × 10 11
MABC---0.002726371.01263 × 10 9 0.3910530.1080870.001100363.88432 × 10 12 0.01495460.4148880.006579233.87885 × 10 12 0.18406
ABC+A-DVM----5.93316 × 10 10 0.02578180.008659080.3385188.46104 × 10 12 8.60446 × 10 5 0.01070897.74196 × 10 6 8.44989 × 10 12 0.00272637
ABCx-m5-----7.12191 × 10 9 1.26859 × 10 8 6.34878 × 10 10 0.279611.49781 × 10 8 3.31439 × 10 9 6.25234 × 10 9 0.03740541.01263 × 10 9
GBESTABC+A-DVM------0.2730510.01705441.2895 × 10 11 0.1194540.4324150.1411061.28786 × 10 11 0.391053
EPSO-------0.00728146.07163 × 10 11 0.3751220.1737690.58.94474 × 10 11 0.108087
ABC--------9.49637 × 10 12 4.65081 × 10 5 0.005776673.90672 × 10 6 9.48398 × 10 12 0.00110036
ABCx-m1---------1.19987 × 10 11 1.01877 × 10 11 7.7844 × 10 12 0.006364823.88432 × 10 12
GBESTABC----------0.04727740.3510551.19833 × 10 11 0.0149546
GBESTABC2+A-DVM-----------0.04825691.01745 × 10 11 0.414888
GBESTABC2------------7.77407 × 10 12 0.00657923
ABCx+ADVM-m1-------------3.87885 × 10 12
Table 3. Pairwise U-test analysis from Damavandi to Rastrigin functions.
Table 3. Pairwise U-test analysis from Damavandi to Rastrigin functions.
DamavandiABC-ESABCx+ADVM-m5MABCABC+A-DVMABCx-m5GBESTABC+A-DVMEPSOABCABCx-m1GBESTABCGBESTABC2+A-DVMGBESTABC2ABCx+ADVM-m1MABC+ADVM
PSO5.82529 × 10 14 0.184060.005517540.005517540.184060.08040110.00544580.08040110.184060.1668550.04076150.04076150.1668550.00551754
ABC-ES-5.82529 × 10 14 7.92983 × 10 13 7.92983 × 10 13 5.82529 × 10 14 1.63123 × 10 13 1.23252 × 10 9 1.63123 × 10 13 5.82529 × 10 14 9.97923 × 10 14 2.55617 × 10 13 2.55617 × 10 13 4.01815 × 10 13 7.92983 × 10 13
ABCx+ADVM-m5--0.005517540.005517540.184060.08040110.00544580.08040110.184060.1668550.04076150.04076150.1668550.00551754
MABC---0.4536710.005517540.09033320.3554280.06826460.005517540.02897260.1193960.1991010.02897260.18406
ABC+A-DVM----0.005517540.09033320.3554280.06503020.005517540.02897260.1193960.1991010.02897260.453671
ABCx-m5-----0.08040110.00544580.08040110.184060.1668550.04076150.04076150.1668550.00551754
GBESTABC+A-DVM------0.05037130.479550.08040110.2985950.3614140.294690.2985950.0903332
EPSO-------0.05037130.00544580.01977350.1011880.1011880.02381620.355428
ABC--------0.08040110.2985950.3499240.294690.2985950.0682646
ABCx-m1---------0.1668550.04076150.04076150.1668550.00551754
GBESTABC----------0.1692090.1525230.50.0289726
GBESTABC2+A-DVM-----------0.4547810.1692090.119396
GBESTABC2------------0.1692090.199101
ABCx+ADVM-m1-------------0.0289726
DeVilliersGlasser02ABC-ESABCx+ADVM-m5MABCABC+A-DVMABCx-m5GBESTABC+A-DVMEPSOABCABCx-m1GBESTABCGBESTABC2+A-DVMGBESTABC2ABCx+ADVM-m1MABC+ADVM
PSO1.50993 × 10 11 1.50993 × 10 11 1.50993 × 10 11 6.0589 × 10 13 1.50993 × 10 11 8.60126 × 10 13 1.66919 × 10 11 6.0589 × 10 13 1.50993 × 10 11 6.0589 × 10 13 6.0589 × 10 13 6.0589 × 10 13 1.50993 × 10 11 1.50993 × 10 11
ABC-ES-4.87775 × 10 10 1.50993 × 10 11 6.0589 × 10 13 2.09984 × 10 10 8.60126 × 10 13 1.50993 × 10 11 6.0589 × 10 13 0.01515876.0589 × 10 13 6.0589 × 10 13 6.0589 × 10 13 0.1520881.50993 × 10 11
ABCx+ADVM-m5--1.50993 × 10 11 6.0589 × 10 13 0.2458918.60126 × 10 13 1.50993 × 10 11 6.0589 × 10 13 3.82939 × 10 5 6.0589 × 10 13 6.0589 × 10 13 6.0589 × 10 13 2.05888 × 10 6 1.50993 × 10 11
MABC---6.0589 × 10 13 1.50993 × 10 11 8.60126 × 10 13 5.46835 × 10 11 6.0589 × 10 13 1.50993 × 10 11 6.0589 × 10 13 6.0589 × 10 13 6.0589 × 10 13 2.48758 × 10 11 0.18406
ABC+A-DVM----6.0589 × 10 13 0.1668556.0589 × 10 13 0.184066.0589 × 10 13 0.184060.184060.184066.0589 × 10 13 6.0589 × 10 13
ABCx-m5-----8.60126 × 10 13 1.50993 × 10 11 6.0589 × 10 13 2.6325 × 10 5 6.0589 × 10 13 6.0589 × 10 13 6.0589 × 10 13 1.66208 × 10 6 1.50993 × 10 11
GBESTABC+A-DVM------8.60126 × 10 13 0.1668551.2055 × 10 12 0.1668550.1668550.1668551.07747 × 10 12 8.60126 × 10 13
EPSO-------6.0589 × 10 13 1.50993 × 10 11 6.0589 × 10 13 6.0589 × 10 13 6.0589 × 10 13 1.50993 × 10 11 5.46835 × 10 11
ABC--------6.0589 × 10 13 0.184060.184060.184066.0589 × 10 13 6.0589 × 10 13
ABCx-m1---------6.0589 × 10 13 6.0589 × 10 13 6.0589 × 10 13 0.1895181.50993 × 10 11
GBESTABC----------0.184060.184066.0589 × 10 13 6.0589 × 10 13
GBESTABC2+A-DVM-----------0.184066.0589 × 10 13 6.0589 × 10 13
GBESTABC2------------6.0589 × 10 13 6.0589 × 10 13
ABCx+ADVM-m1-------------2.48758 × 10 11
GriewankABC-ESABCx+ADVM-m5MABCABC+A-DVMABCx-m5GBESTABC+A-DVMEPSOABCABCx-m1GBESTABCGBESTABC2+A-DVMGBESTABC2ABCx+ADVM-m1MABC+ADVM
PSO1.19833 × 10 11 1.50993 × 10 11 1.50709 × 10 11 6.0589 × 10 13 1.50898 × 10 11 6.0589 × 10 13 1.18284 × 10 12 8.60126 × 10 13 1.50993 × 10 11 8.60126 × 10 13 6.0589 × 10 13 1.18192 × 10 12 1.50898 × 10 11 1.50709 × 10 11
ABC-ES-5.81883 × 10 10 0.007727191.10591 × 10 6 4.39882 × 10 10 1.10591 × 10 6 0.0001006031.25899 × 10 5 1.05827 × 10 10 3.93803 × 10 6 1.10591 × 10 6 7.56738 × 10 6 2.50191 × 10 10 0.00772719
ABCx+ADVM-m5--0.0006019196.0589 × 10 13 0.418016.0589 × 10 13 6.19215 × 10 10 2.28091 × 10 11 1.73883 × 10 5 8.60126 × 10 13 6.0589 × 10 13 1.18192 × 10 12 5.4519 × 10 6 0.000601919
MABC---8.27367 × 10 12 0.0005284378.27367 × 10 12 5.04433 × 10 9 2.27682 × 10 10 1.38985 × 10 7 3.32294 × 10 11 8.27367 × 10 12 2.55281 × 10 11 3.01539 × 10 7 0.18406
ABC+A-DVM----6.05396 × 10 13 0.184060.08040110.1668556.0589 × 10 13 0.1668550.184060.0803716.05396 × 10 13 8.27367 × 10 12
ABCx-m5-----6.05396 × 10 13 6.18852 × 10 10 2.27933 × 10 11 2.89174 × 10 5 8.59442 × 10 13 6.05396 × 10 13 1.181 × 10 12 7.14526 × 10 6 0.000528437
GBESTABC+A-DVM------0.08040110.1668556.0589 × 10 13 0.1668550.184060.0803716.05396 × 10 13 8.27367 × 10 12
EPSO-------0.2720133.44112 × 10 10 0.2720130.08040110.4795483.79508 × 10 10 5.04433 × 10 9
ABC--------3.27579 × 10 12 0.50.1668550.2985774.54799 × 10 12 2.27682 × 10 10
ABCx-m1---------8.60126 × 10 13 6.0589 × 10 13 1.18192 × 10 12 0.3530841.38985 × 10 7
GBESTABC----------0.1668550.2985778.59442 × 10 13 3.32294 × 10 11
GBESTABC2+A-DVM-----------0.0803716.05396 × 10 13 8.27367 × 10 12
GBESTABC2------------1.181 × 10 12 2.55281 × 10 11
ABCx+ADVM-m1-------------3.01539 × 10 7
RastriginABC-ESABCx+ADVM-m5MABCABC+A-DVMABCx-m5GBESTABC+A-DVMEPSOABCABCx-m1GBESTABCGBESTABC2+A-DVMGBESTABC2ABCx+ADVM-m1MABC+ADVM
PSO1.50993 × 10 11 1.50993 × 10 11 1.50993 × 10 11 6.0589 × 10 13 1.50993 × 10 11 8.60126 × 10 13 1.66919 × 10 11 6.0589 × 10 13 1.50993 × 10 11 6.0589 × 10 13 6.0589 × 10 13 6.0589 × 10 13 1.50993 × 10 11 1.50993 × 10 11
ABC-ES-4.87775 × 10 10 1.50993 × 10 11 6.0589 × 10 13 2.09984 × 10 10 8.60126 × 10 13 1.50993 × 10 11 6.0589 × 10 13 0.01515876.0589 × 10 13 6.0589 × 10 13 6.0589 × 10 13 0.1520881.50993 × 10 11
ABCx+ADVM-m5--1.50993 × 10 11 6.0589 × 10 13 0.2458918.60126 × 10 13 1.50993 × 10 11 6.0589 × 10 13 3.82939 × 10 5 6.0589 × 10 13 6.0589 × 10 13 6.0589 × 10 13 2.05888 × 10 6 1.50993 × 10 11
MABC---6.0589 × 10 13 1.50993 × 10 11 8.60126 × 10 13 5.46835 × 10 11 6.0589 × 10 13 1.50993 × 10 11 6.0589 × 10 13 6.0589 × 10 13 6.0589 × 10 13 2.48758 × 10 11 0.18406
ABC+A-DVM----6.0589 × 10 13 0.1668556.0589 × 10 13 0.184066.0589 × 10 13 0.184060.184060.184066.0589 × 10 13 6.0589 × 10 13
ABCx-m5-----8.60126 × 10 13 1.50993 × 10 11 6.0589 × 10 13 2.6325 × 10 5 6.0589 × 10 13 6.0589 × 10 13 6.0589 × 10 13 1.66208 × 10 6 1.50993 × 10 11
GBESTABC+A-DVM------8.60126 × 10 13 0.1668551.2055 × 10 12 0.1668550.1668550.1668551.07747 × 10 12 8.60126 × 10 13
EPSO-------6.0589 × 10 13 1.50993 × 10 11 6.0589 × 10 13 6.0589 × 10 13 6.0589 × 10 13 1.50993 × 10 11 5.46835 × 10 11
ABC--------6.0589 × 10 13 0.184060.184060.184066.0589 × 10 13 6.0589 × 10 13
ABCx-m1---------6.0589 × 10 13 6.0589 × 10 13 6.0589 × 10 13 0.1895181.50993 × 10 11
GBESTABC----------0.184060.184066.0589 × 10 13 6.0589 × 10 13
GBESTABC2+A-DVM-----------0.184066.0589 × 10 13 6.0589 × 10 13
GBESTABC2------------6.0589 × 10 13 6.0589 × 10 13
ABCx+ADVM-m1-------------2.48758 × 10 11
Table 4. Pairwise U-test analysis from Rosenbrock to Trefethen functions.
Table 4. Pairwise U-test analysis from Rosenbrock to Trefethen functions.
RosenbrockABC-ESABCx+ADVM-m5MABCABC+A-DVMABCx-m5GBESTABC+A-DVMEPSOABCABCx-m1GBESTABCGBESTABC2+A-DVMGBESTABC2ABCx+ADVM-m1MABC+ADVM
PSO1.50993 × 10 11 1.50993 × 10 11 1.50993 × 10 11 6.0589 × 10 13 1.50993 × 10 11 8.60126 × 10 13 1.66919 × 10 11 6.0589 × 10 13 1.50993 × 10 11 6.0589 × 10 13 6.0589 × 10 13 6.0589 × 10 13 1.50993 × 10 11 1.50993 × 10 11
ABC-ES-4.87775 × 10 10 1.50993 × 10 11 6.0589 × 10 13 2.09984 × 10 10 8.60126 × 10 13 1.50993 × 10 11 6.0589 × 10 13 0.01515876.0589 × 10 13 6.0589 × 10 13 6.0589 × 10 13 0.1520881.50993 × 10 11
ABCx+ADVM-m5--1.50993 × 10 11 6.0589 × 10 13 0.2458918.60126 × 10 13 1.50993 × 10 11 6.0589 × 10 13 3.82939 × 10 5 6.0589 × 10 13 6.0589 × 10 13 6.0589 × 10 13 2.05888 × 10 6 1.50993 × 10 11
MABC---6.0589 × 10 13 1.50993 × 10 11 8.60126 × 10 13 5.46835 × 10 11 6.0589 × 10 13 1.50993 × 10 11 6.0589 × 10 13 6.0589 × 10 13 6.0589 × 10 13 2.48758 × 10 11 0.18406
ABC+A-DVM----6.0589 × 10 13 0.1668556.0589 × 10 13 0.184066.0589 × 10 13 0.184060.184060.184066.0589 × 10 13 6.0589 × 10 13
ABCx-m5-----8.60126 × 10 13 1.50993 × 10 11 6.0589 × 10 13 2.6325 × 10 5 6.0589 × 10 13 6.0589 × 10 13 6.0589 × 10 13 1.66208 × 10 6 1.50993 × 10 11
GBESTABC+A-DVM------8.60126 × 10 13 0.1668551.2055 × 10 12 0.1668550.1668550.1668551.07747 × 10 12 8.60126 × 10 13
EPSO-------6.0589 × 10 13 1.50993 × 10 11 6.0589 × 10 13 6.0589 × 10 13 6.0589 × 10 13 1.50993 × 10 11 5.46835 × 10 11
ABC--------6.0589 × 10 13 0.184060.184060.184066.0589 × 10 13 6.0589 × 10 13
ABCx-m1---------6.0589 × 10 13 6.0589 × 10 13 6.0589 × 10 13 0.1895181.50993 × 10 11
GBESTABC----------0.184060.184066.0589 × 10 13 6.0589 × 10 13
GBESTABC2+A-DVM-----------0.184066.0589 × 10 13 6.0589 × 10 13
GBESTABC2------------6.0589 × 10 13 6.0589 × 10 13
ABCx+ADVM-m1-------------2.48758 × 10 11
Schwefel06ABC-ESABCx+ADVM-m5MABCABC+A-DVMABCx-m5GBESTABC+A-DVMEPSOABCABCx-m1GBESTABCGBESTABC2+A-DVMGBESTABC2ABCx+ADVM-m1MABC+ADVM
PSO0.00138756.90317 × 10 12 6.0589 × 10 13 6.0589 × 10 13 2.1558 × 10 11 8.27367 × 10 12 0.184066.0589 × 10 13 0.184069.6525 × 10 11 6.05396 × 10 13 6.0589 × 10 13 0.184066.0589 × 10 13
ABC-ES-1.46217 × 10 7 4.66114 × 10 12 4.66114 × 10 12 1.83084 × 10 6 1.75567 × 10 10 0.00138754.66114 × 10 12 0.00138757.12005 × 10 9 4.65791 × 10 12 4.66114 × 10 12 0.00138754.66114 × 10 12
ABCx+ADVM-m5--1.29772 × 10 11 1.29772 × 10 11 0.1204638.41872 × 10 8 6.90317 × 10 12 1.29772 × 10 11 6.90317 × 10 12 1.50954 × 10 5 1.2969 × 10 11 1.29772 × 10 11 6.90317 × 10 12 1.29772 × 10 11
MABC---0.1004741.17328 × 10 11 1.50709 × 10 11 6.0589 × 10 13 0.04962886.0589 × 10 13 1.49767 × 10 11 3.05885 × 10 10 1.59837 × 10 9 6.0589 × 10 13 0.18406
ABC+A-DVM----1.17328 × 10 11 1.50709 × 10 11 6.0589 × 10 13 0.2947266.0589 × 10 13 1.6557 × 10 11 1.53985 × 10 8 5.78327 × 10 8 6.0589 × 10 13 0.100474
ABCx-m5-----1.57018 × 10 8 2.1558 × 10 11 1.17328 × 10 11 2.1558 × 10 11 3.47585 × 10 6 1.17253 × 10 11 1.17328 × 10 11 2.1558 × 10 11 1.17328 × 10 11
GBESTABC+A-DVM------8.27367 × 10 12 1.84143 × 10 11 8.27367 × 10 12 0.1607862.41277 × 10 10 2.248 × 10 11 8.27367 × 10 12 1.50709 × 10 11
EPSO-------6.0589 × 10 13 0.184069.6525 × 10 11 6.05396 × 10 13 6.0589 × 10 13 0.184066.0589 × 10 13
ABC--------6.0589 × 10 13 2.7253 × 10 11 1.01375 × 10 7 7.45902 × 10 7 6.0589 × 10 13 0.0496288
ABCx-m1---------9.6525 × 10 11 6.05396 × 10 13 6.0589 × 10 13 0.184066.0589 × 10 13
GBESTABC----------5.82549 × 10 10 1.0692 × 10 10 9.6525 × 10 11 1.49767 × 10 11
GBESTABC2+A-DVM-----------0.179666.05396 × 10 13 3.05885 × 10 10
GBESTABC2------------6.0589 × 10 13 1.59837 × 10 9
ABCx+ADVM-m1-------------6.0589 × 10 13
SineEnvelopeABC-ESABCx+ADVM-m5MABCABC+A-DVMABCx-m5GBESTABC+A-DVMEPSOABCABCx-m1GBESTABCGBESTABC2+A-DVMGBESTABC2ABCx+ADVM-m1MABC+ADVM
PSO1.50993 × 10 11 1.50993 × 10 11 1.50993 × 10 11 1.50993 × 10 11 1.50993 × 10 11 1.50993 × 10 11 3.69454 × 10 11 1.50993 × 10 11 1.50993 × 10 11 1.50993 × 10 11 1.50993 × 10 11 1.50993 × 10 11 1.50993 × 10 11 1.50993 × 10 11
ABC-ES-3.06052 × 10 10 1.07702 × 10 6 1.66919 × 10 11 3.06052 × 10 10 1.50993 × 10 11 1.50993 × 10 11 1.50993 × 10 11 3.26307 × 10 7 1.50993 × 10 11 1.50993 × 10 11 1.50993 × 10 11 2.4713 × 10 5 1.07702 × 10 6
ABCx+ADVM-m5--2.03858 × 10 11 1.09737 × 10 8 0.3809145.46835 × 10 11 1.50993 × 10 11 1.11363 × 10 9 0.4617218.06613 × 10 11 4.07637 × 10 11 1.30493 × 10 10 0.125942.03858 × 10 11
MABC---1.50993 × 10 11 2.48758 × 10 11 1.50993 × 10 11 1.50993 × 10 11 1.50993 × 10 11 1.57944 × 10 10 1.50993 × 10 11 1.50993 × 10 11 1.50993 × 10 11 1.91245 × 10 9 0.18406
ABC+A-DVM----7.79038 × 10 9 0.003486221.50993 × 10 11 0.3696995.45343 × 10 6 0.001312140.2101930.1739141.09794 × 10 7 1.50993 × 10 11
ABCx-m5-----4.95931 × 10 11 1.50993 × 10 11 9.28367 × 10 10 0.4793665.46835 × 10 11 5.46835 × 10 11 1.57944 × 10 10 0.1321632.48758 × 10 11
GBESTABC+A-DVM------1.50993 × 10 11 0.004342192.34282 × 10 8 0.4675960.003486220.03622284.87775 × 10 10 1.50993 × 10 11
EPSO-------1.50993 × 10 11 1.50993 × 10 11 1.50993 × 10 11 1.50993 × 10 11 1.50993 × 10 11 1.50993 × 10 11 1.50993 × 10 11
ABC--------3.36811 × 10 6 0.002112960.3421610.2746632.5461 × 10 8 1.50993 × 10 11
ABCx-m1---------1.19487 × 10 8 5.13867 × 10 7 3.52149 × 10 7 0.1591521.57944 × 10 10
GBESTABC----------0.001591480.01460275.35089 × 10 10 1.50993 × 10 11
GBESTABC2+A-DVM-----------0.4209013.25914 × 10 9 1.50993 × 10 11
GBESTABC2------------6.55552 × 10 9 1.50993 × 10 11
ABCx+ADVM-m1-------------1.91245 × 10 9
TrefethenABC-ESABCx+ADVM-m5MABCABC+A-DVMABCx-m5GBESTABC+A-DVMEPSOABCABCx-m1GBESTABCGBESTABC2+A-DVMGBESTABC2ABCx+ADVM-m1MABC+ADVM
PSO1.68597 × 10 7 4.4196 × 10 6 1.68597 × 10 7 1.68597 × 10 7 0.0009112630.04734050.0003721731.68597 × 10 7 0.02072840.02808221.68597 × 10 7 1.68597 × 10 7 0.001631451.68597 × 10 7
ABC-ES-0.04070210.184060.184060.0006695943.19329 × 10 5 0.001363790.184062.23578 × 10 6 3.17451 × 10 5 0.184060.184060.0006785390.18406
ABCx+ADVM-m5--0.04070210.04070210.02460250.001042720.04711790.04070210.0001497530.001359160.04070210.04070210.02137920.0407021
MABC---0.184060.0006695943.19329 × 10 5 0.001363790.184062.23578 × 10 6 3.17451 × 10 5 0.184060.184060.0006785390.18406
ABC+A-DVM----0.0006695943.19329 × 10 5 0.001363790.184062.23578 × 10 6 3.17451 × 10 5 0.184060.184060.0006785390.18406
ABCx-m5-----0.07491140.3747240.0006695940.04382420.1096040.0006695940.0006695940.4452460.000669594
GBESTABC+A-DVM------0.04505363.19329 × 10 5 0.4741520.4118913.19329 × 10 5 3.19329 × 10 5 0.09823053.19329 × 10 5
EPSO-------0.001363790.01845590.06233020.001363790.001363790.3266430.00136379
ABC--------2.23578 × 10 6 3.17451 × 10 5 0.184060.184060.0006785390.18406
ABCx-m1---------0.3750152.23578 × 10 6 2.23578 × 10 6 0.07539942.23578 × 10 6
GBESTABC----------3.17451 × 10 5 3.17451 × 10 5 0.1444373.17451 × 10 5
GBESTABC2+A-DVM-----------0.184060.0006785390.18406
GBESTABC2------------0.0006785390.18406
ABCx+ADVM-m1-------------0.000678539
Table 5. Pairwise U-test analysis from Whitley to Zimmerman functions.
Table 5. Pairwise U-test analysis from Whitley to Zimmerman functions.
WhitleyABC-ESABCx+ADVM-m5MABCABC+A-DVMABCx-m5GBESTABC+A-DVMEPSOABCABCx-m1GBESTABCGBESTABC2+A-DVMGBESTABC2ABCx+ADVM-m1MABC+ADVM
PSO1.50993 × 10 11 1.50993 × 10 11 1.50993 × 10 11 1.50993 × 10 11 1.50993 × 10 11 1.50993 × 10 11 1.50993 × 10 11 1.50993 × 10 11 1.50993 × 10 11 1.50993 × 10 11 1.50993 × 10 11 1.50993 × 10 11 1.50993 × 10 11 1.50993 × 10 11
ABC-ES-7.14708 × 10 9 2.34282 × 10 8 4.24239 × 10 9 2.09125 × 10 9 2.04198 × 10 5 1.50993 × 10 11 2.53616 × 10 10 0.0004059991.59837 × 10 9 3.88627 × 10 9 4.42055 × 10 7 3.1414 × 10 6 2.34282 × 10 8
ABCx+ADVM-m5--2.98528 × 10 5 4.60563 × 10 5 0.3979230.0001994051.50993 × 10 11 2.17654 × 10 5 0.4675962.21025 × 10 6 1.90263 × 10 7 0.0001194240.007206092.98528 × 10 5
MABC---0.2998452.4713 × 10 5 0.2059551.50993 × 10 11 0.3313677.92305 × 10 5 0.1057810.2017690.1169940.005157340.18406
ABC+A-DVM----6.62476 × 10 5 0.3696991.50993 × 10 11 0.4852581.68407 × 10 5 0.2059550.4970510.2101930.0002490910.299845
ABCx-m5-----0.0001994051.50993 × 10 11 3.17802 × 10 5 0.4093732.73102 × 10 6 1.62777 × 10 7 0.0001265290.005381312.4713 × 10 5
GBESTABC+A-DVM------1.50993 × 10 11 0.392234.89586 × 10 5 0.3154380.2188210.2458910.0001683950.205955
EPSO-------1.50993 × 10 11 1.50993 × 10 11 1.50993 × 10 11 1.50993 × 10 11 1.50993 × 10 11 1.50993 × 10 11 1.50993 × 10 11
ABC--------1.68407 × 10 5 0.223210.4852580.2366730.0008832820.331367
ABCx-m1---------2.21025 × 10 6 2.59284 × 10 7 1.29868 × 10 5 0.03283567.92305 × 10 5
GBESTABC----------0.1452360.4793662.98528 × 10 5 0.105781
GBESTABC2+A-DVM-----------0.09536527.14918 × 10 6 0.201769
GBESTABC2------------3.59939 × 10 5 0.116994
ABCx+ADVM-m1-------------0.00515734
XinSheYang06ABC-ESABCx+ADVM-m5MABCABC+A-DVMABCx-m5GBESTABC+A-DVMEPSOABCABCx-m1GBESTABCGBESTABC2+A-DVMGBESTABC2ABCx+ADVM-m1MABC+ADVM
PSO0.04070210.184060.184060.184060.184060.184060.184060.184060.184060.184060.184060.184060.184060.18406
ABC-ES-0.04070210.04070210.04070210.04070210.04070210.04070210.04070210.04070210.04070210.04070210.04070210.04070210.0407021
ABCx+ADVM-m5--0.184060.184060.184060.184060.184060.184060.184060.184060.184060.184060.184060.18406
MABC---0.184060.184060.184060.184060.184060.184060.184060.184060.184060.184060.18406
ABC+A-DVM----0.184060.184060.184060.184060.184060.184060.184060.184060.184060.18406
ABCx-m5-----0.184060.184060.184060.184060.184060.184060.184060.184060.18406
GBESTABC+A-DVM------0.184060.184060.184060.184060.184060.184060.184060.18406
EPSO-------0.184060.184060.184060.184060.184060.184060.18406
ABC--------0.184060.184060.184060.184060.184060.18406
ABCx-m1---------0.184060.184060.184060.184060.18406
GBESTABC----------0.184060.184060.184060.18406
GBESTABC2+A-DVM-----------0.184060.184060.18406
GBESTABC2------------0.184060.18406
ABCx+ADVM-m1-------------0.18406
ZimmermanABC-ESABCx+ADVM-m5MABCABC+A-DVMABCx-m5GBESTABC+A-DVMEPSOABCABCx-m1GBESTABCGBESTABC2+A-DVMGBESTABC2ABCx+ADVM-m1MABC+ADVM
PSO4.56246 × 10 6 0.001918530.001457420.0009037680.0005135930.006464950.0005404840.0009036293.68175 × 10 5 0.003408670.007656460.008660690.0001381620.00145742
ABC-ES-0.0008040150.0002736930.0008986230.00532944.97132 × 10 6 0.03145190.0008984720.2189613.50841 × 10 5 1.51208 × 10 6 9.64117 × 10 7 0.08402640.000273693
ABCx+ADVM-m5--0.2675230.2047290.2527840.01782750.04271090.2111920.003203940.02601430.09558790.0630220.01205030.267523
MABC---0.341730.1049130.02737780.1924210.3890720.1066180.03488310.02172610.002584440.4909230.18406
ABC+A-DVM----0.1526410.02918950.1387430.4674640.1678980.03510920.08330040.007788780.3946880.34173
ABCx-m5-----0.001927540.3675060.1422650.05830640.004410180.001107160.0006496720.1798640.104913
GBESTABC+A-DVM------0.01837380.02969560.0004275480.4000060.403570.4266420.003369020.0273778
EPSO-------0.1387390.08636350.03690740.1860930.1319250.2682650.192421
ABC--------0.1678950.03510720.07564540.006339420.3946870.389072
ABCx-m1---------0.001628720.002587240.001529620.2205450.106618
GBESTABC----------0.4236620.4499130.008838170.0348831
GBESTABC2+A-DVM-----------0.1071190.04407780.0217261
GBESTABC2------------0.02771350.00258444
ABCx+ADVM-m1-------------0.490923
Table 6. Results of the experiment for all problem instances.
Table 6. Results of the experiment for all problem instances.
ProblemAlgorithmMeanMedianStd. DevBestWorstProblemAlgorithmMeanMedianStd. DevBestWorstProblemAlgorithmMeanMedianStd. DevBestWorst
Bukin06DE0.978930.919220.523930.332.60682DeVilliersGlasser02DE352.64264.37420767.1210.395343182.44SineEnvelopeDE0.474140.473540.092020.32890.69363
PSO0.037590.048830.016110.004310.05000 PSO7108.739377.494258.060.0000010647.4 PSO7.092577.266540.571196.096797.86571
EPSO0.009010.007150.006900.000570.02419 EPSO799.0596.520042538.220.0000010467.8 EPSO4.748724.89020.894283.046646.09835
ABC0.065350.050000.033450.019090.15020 ABC5.711683.208756.020960.3432921.70150 ABC0.259650.223720.070910.181750.39453
MABC0.058000.050000.0466000.016110.21930 MABC4.124672.741944.636190.2456515.8204 MABC3.015143.093040.303182.479553.57755
MABC+ADVM0.0990970.0714730.0599370.0138190.261345 MABC+ADVM3.547752.482243.457170.43235617.9148 MABC+ADVM1.991071.990380.3324861.227782.5769
GBESTABC0.187810.180140.079220.050440.34700 GBESTABC8.131074.7128511.616100.8498853.06630 GBESTABC0.259330.230340.067960.161920.38841
GBESTABC20.357830.335250.173330.124200.63954 GBESTABC25.563754.426504.645820.6574421.59900 GBESTABC20.306960.301390.070770.196380.43203
ABC+A-DVM0.059490.049900.040870.003400.15985 ABC+A-DVM2.535811.930482.002500.058037.09280 ABC+A-DVM0.306940.296370.094030.199310.56087
GBESTABC+A-DVM0.173300.137610.089930.048720.33291 GBESTABC+A-DVM6.892544.773185.302921.0662123.2227 GBESTABC+A-DVM0.264990.253780.053390.189600.37096
GBESTABC2+A-DVM0.323940.340000.172250.098920.69858 GBESTABC2+A-DVM8.364857.130588.015410.4072532.1687 GBESTABC2+A-DVM0.295610.290250.055810.193670.39693
ABCXm10.0275480.0234340.0176430.002410.050081 ABCXm13.84840.33825311.43975.2 × 10 5 59.3269 ABCXm11.066731.021630.3441640.4757961.80824
ABCXm1+A-DVM0.0265750.0263930.0183260.0004730.050066 ABCXm1+A-DVM2.123720.3382533.375614.4 × 10 5 12.0782 ABCXm1+A-DVM1.16841.066260.3660670.5149021.91655
ABCXm50.0296840.0288660.0144250.0023580.053062 ABCXm53.393122.460512.570710.47801810.445 ABCXm51.039551.028330.160000.6915041.48731
ABCXm5+A-DVM0.0290740.0281340.0165070.003260.052951 ABCXm5+A-DVM3.701453.397752.666260.59835910.0822 ABCXm5+A-DVM1.042251.068350.1564750.7607751.33566
ColaDE12.4439012.390200.50283611.7757013.82660GriewankDE0.000000.000000.000000.000000.00000TrefethenDE−3.29379−3.306870.04156−3.30687−3.14408
PSO16.1341015.302702.4401412.969722.06270 PSO1.342821.300040.171681.101781.80049 PSO−3.08315−3.176110.21692−3.30687−2.64262
EPSO13.4221013.601001.0616611.748115.48070 EPSO0.009100.000000.013790.000000.04426 EPSO−3.27985−3.306870.06253−3.30687−3.06263
ABC12.0544011.955000.2299311.7537012.54730 ABC0.000000.000000.000000.000000.00000 ABC−3.30687−3.306870.00000−3.30687−3.30687
MABC12.8397012.847900.44341612.1139013.61120 MABC0.000000.000000.000000.000000.00000 MABC−3.30687−3.306870.00000−3.30687−3.30687
MABC+ADVM12.293212.34460.32725411.803512.9642 MABC+ADVM0.0020130.0000200.004830.000000.022877 MABC+ADVM−3.30687−3.306870.00000−3.30687−3.30687
GBESTABC12.2279012.152600.3088911.7999013.08850 GBESTABC0.000000.000000.000000.000000.00000 GBESTABC−3.30687−3.306870.00000−3.30687−3.30687
GBESTABC212.2352012.252500.2823511.8043012.76960 GBESTABC20.000000.000000.000000.000000.00000 GBESTABC2−3.30687−3.306870.00000−3.30687−3.30687
ABC+A-DVM12.1525012.085000.23250911.8432012.65390 ABC+A-DVM0.000410.000000.001860.000000.00834 ABC+A-DVM−3.30687−3.306870.00000−3.30687−3.30687
GBESTABC+A-DVM12.2823012.183000.3259911.8183013.12510 GBESTABC+A-DVM0.000000.000000.000000.000000.00000 GBESTABC+A-DVM−3.30682−3.306870.00022−3.30687−3.30588
GBESTBBC2+A-DVM12.2363012.212500.2941311.8289012.96570 GBESTABC2+A-DVM0.000000.000000.000000.000001.43 × 10 5 GBESTABC2+A-DVM−3.30687−3.306870.00000−3.30687−3.30687
ABCXm112.707412.55680.75920711.771814.6546 ABCXm10.0139160.0138240.011684.2 × 10 5 0.047391 ABCXm1−3.24238−3.208140.070179−3.30687−3.06263
ABCXm1+A-DVM12.856813.06180.57043711.813914.1411 ABCXm1+A-DVM0.0125590.0123240.0100671.5 × 10 5 0.037476 ABCXm1+A-DVM−3.26056−3.306870.079556−3.30687−3.06263
ABCXm512.111911.99550.26220811.7712.7076 ABCXm50.0007750.0006840.0004030.0002130.002204 ABCXm5−3.26755−3.306870.068596−3.30687−3.06263
ABCXm5+A-DVM12.059512.03120.19537111.797112.5531 ABCXm5+A-DVM0.0007510.0006330.0004240.0002070.002318 ABCXm5+A-DVM−3.297−3.306870.029619−3.30687−3.20814
CrossLegTableDE−0.26326−0.084770.37832−1.00000−0.00611RastriginDE0.547220.497480.601750.000001.98992XinSheYang03DE0.000000.000000.000000.000000.00000
PSO−0.09723−0.082830.21626−1.00000−0.00255 PSO125.84700126.2050021.1652088.1972160.206 PSO0.000000.000000.000000.000000.00000
EPSO−0.17534−0.084770.28203−1.00000−0.07959 EPSO45.7695051.2551023.051106.9647199.49550 EPSO0.000000.000000.000000.000000.00000
ABC−0.13062−0.084930.20463−1.00000−0.08477 ABC0.000000.000000.000000.000000.00000 ABC0.000000.000000.000000.000000.00000
MABC−0.10630−0.084770.09595−0.51398−0.08477 MABC74.5529075.181708.7812950.3963087.9141 MABC0.000000.000000.000000.000000.00000
MABC+ADVM−0.084594−0.0847780.000587−0.084933−0.082837 MABC+ADVM6.298676.045951.809492.1597410.3941 MABC+ADVM0.000000.000000.000000.000000.00000
GBESTABC−0.12994−0.084770.20479−1.00000−0.07981 GBESTABC0.000000.000000.000000.000000.00000 GBESTABC0.000000.000000.000000.000000.00000
GBESTABC2−0.08448−0.084770.00071−0.08477−0.08283 GBESTABC20.000000.000000.000000.000000.00000 GBESTABC20.000000.000000.000000.000000.00000
ABC+A-DVM−0.13061−0.084930.20463−1.00000−0.08477 ABC+A-DVM0.000000.000000.000000.000000.00000 ABC+A-DVM0.000000.000000.000000.000000.00000
GBESTABC+A-DVM−0.12355−0.084770.20728−1.00000−0.00656 GBESTABC+A-DVM0.000000.000000.000000.000000.00000 GBESTABC2+A-DVM0.000000.000000.000000.000000.00000
GBESTABC2+A-DVM−0.13044−0.084770.20467−1.00000−0.08283 GBESTABC2+A-DVM0.000000.000000.000000.000000.00000 GBESTABC+A-DVM0.000000.000000.000000.000000.00000
ABCXm1−0.032665−0.0399320.022017−0.063706−0.004235 ABCXm10.5984050.1719570.7091020.0020892.10224 ABCXm10.000000.000000.000000.000000.00000
ABCXm1+A-DVM−0.028716−0.0411770.019874−0.055539−0.003221 ABCXm1+A-DVM0.8339170.8240830.8427610.0044113.21893 ABCXm1+A-DVM0.000000.000000.000000.000000.00000
ABCXm5−0.049196−0.0066410.178485−1.00000−0.001788 ABCXm50.0298050.0287140.0093020.0145850.05643 ABCXm50.000000.000000.000000.000000.00000
ABCXm5+A-DVM−0.020866−0.0070020.031149−0.084778−0.000575 ABCXm5+A-DVM0.0346290.0297120.0179510.011760.091563 ABCXm5+A-DVM0.000000.000000.000000.000000.00000
Table 7. Results of the experiment for all problem instances.
Table 7. Results of the experiment for all problem instances.
ProblemAlgorithmMeanMedianStd. DevBestWorstProblemAlgorithmMeanMedianStd. DevBestWorstProblemAlgorithmMeanMedianStd. DevBestWorst
CrownedCrossDE0.001730.001170.003470.000100.01635RosenbrockDE32.8688025.5825024.114407.4939286.07950WhitleyDE0.013881.20 × 10 5 0.019250.000000.03945
PSO0.016090.001200.018840.000100.03909 PSO16374112269410713731992.8449777 PSO0.032860.039450.041000.000000.15783
EPSO0.001080.001170.000330.000100.00125 EPSO8.203978.590762.845633.1679513.15980 EPSO0.005910.000000.014450.000000.03945
ABC0.001170.000100.000000.001170.00117 ABC0.912200.153231.449280.017124.69119 ABC0.000030.000000.000110.000000.00050
MABC0.001130.000100.00020.000270.00117 MABC44.6888027.2288029.9465023.93810112.734 MABC0.002030.000000.008810.000000.03945
MABC+ADVM0.0011860.001183.1 × 10 5 0.0011770.001349 MABC+ADVM13.56155.5740121.1790.05527978.1312 MABC+ADVM38.188920.048444.43051.03001182.301
GBESTABC0.001080.000100.000330.000100.00120 GBESTABC1.705781.098511.852630.085476.11791 GBESTABC0.007571.37 × 10 5 0.012760.000000.03945
GBESTABC20.001180.000101.13 × 10 5 0.001170.00120 GBESTABC23.182242.58522.932240.3593013.16040 GBESTABC20.002360.000150.008520.000000.03845
ABC+A-DVM0.001050.000100.000320.000100.00117 ABC+A-DVM2.559891.047914.375520.0286319.18300 ABC+A-DVM0.000640.000000.002260.000000.01009
GBESTABC+A-DVM0.001130.000100.000240.000100.00125 GBESTABC+A-DVM3.462041.486144.406230.0436013.87970 GBESTABC+A-DVM0.006180.000000.014350.000000.03945
GBESTABC2+A-DVM0.001180.000100.000000.001170.00120 GBESTABC2+A-DVM4.554523.86973.734670.1187914.8367 GBESTABC2+A-DVM0.000620.000220.000950.000000.00379
ABCXm10.0114390.0027540.0106810.0013890.028141 ABCXm172.057682.142428.38587.44934109.364 ABCXm185.040257.928867.518126.3005270.85
ABCXm1+A-DVM0.0080050.0021000.009420.0016220.030850 ABCXm1+A-DVM64.332277.929132.11622.19893106.097 ABCXm1+A-DVM62.60844.169751.605515.8966269.044
ABCXm50.0183390.0150570.014840.00010.055938 ABCXm522.2119.25569.545159.6988447.4673 ABCXm559.904558.632914.088938.66390102.5700
ABCXm5+A-DVM0.0258780.0142980.0328530.001180.173876 ABCXm5+A-DVM18.667214.042415.16275.3265382.7050 ABCXm5+A-DVM61.42959.203815.688137.0757100.947
DamavandiDE2.000002.000000.000002.000002.00000Schwefel06DE0.000000.000000.000000.000000.00000ZimmermanDE0.385220.698690.356330.000000.70133
PSO2.000002.000000.000002.000002.00000 PSO0.000000.000000.000000.000000.00000 PSO715.17501300663.345000.000001300.000
EPSO1.900002.000000.447210.000002.00000 EPSO0.000000.000000.000000.000000.00000 EPSO0.174640.000000.310350.000000.69858
ABC2.000002.000000.000002.000002.00000 ABC0.171590.103860.179890.000560.59950 ABC0.000370.000000.001260.000000.00569
MABC2.000002.000000.000002.000002.00000 MABC0.000000.000000.000000.000000.00000 MABC0.000000.000000.000000.000000.00000
MABC+ADVM1.611132.000000.7782190.0015552.00000 MABC+ADVM0.1233410.0760950.1806870.0029490.767581 MABC+ADVM0.0003151.7 × 10 5 0.0010230.0000000.005673
GBESTABC1.760592.000000.602200.006112.00000 GBESTABC0.131960.118920.087830.011930.28331 GBESTABC0.106260.000530.255540.000000.69923
GBESTABC21.827722.000000.536540.025022.00000 GBESTABC20.138860.121970.101820.012230.42978 GBESTABC20.070620.000500.214875.96 × 10 5 0.69904
ABC+A-DVM1.800562.000000.613870.002582.00000 ABC+A-DVM0.117280.048980.177930.002720.72679 ABC+A-DVM0.000413.27 × 10 5 0.000970.000000.00325
GBESTABC+A-DVM1.817872.000000.560990.113352.00000 GBESTABC+A-DVM0.097490.101970.044160.024920.16431 GBESTABC+A-DVM0.105430.000350.255820.000000.69921
GBESTABC2+A-DVM1.740732.000000.637820.000282.00000 GBESTABC2+A-DVM0.146950.097990.121290.026570.46299 GBESTABC2+A-DVM0.035310.000200.156121.40 × 10 5 0.69862
ABCXm52.000002.000000.000002.000002.00000 ABCXm50.000000.000000.000000.000000.00000 ABCXm50.2328620.000000.3293150.000000.698586
ABCXm5+A-DVM2.000002.000000.000002.000002.00000 ABCXm5+A-DVM0.000000.000000.000000.000000.00000 ABCXm5+A-DVM0.3492920.3492920.3492920.000000.698586
ABCXm12.000002.000000.000002.000002.00000 ABCXm10.000000.000000.000000.000000.00000 ABCXm10.2561460.000000.3366420.000000.698581
ABCXm1+A-DVM1.933332.000000.359010.000002.00000 ABCXm1+A-DVM0.000000.000000.000000.000000.00000 ABCXm1+A-DVM0.3260040.000000.3485130.000000.698581

Share and Cite

MDPI and ACS Style

Mollinetti, M.A.F.; Gatto, B.B.; Neto, M.T.R.S.; Kuno, T. A-DVM: A Self-Adaptive Variable Matrix Decision Variable Selection Scheme for Multimodal Problems. Entropy 2020, 22, 1004. https://doi.org/10.3390/e22091004

AMA Style

Mollinetti MAF, Gatto BB, Neto MTRS, Kuno T. A-DVM: A Self-Adaptive Variable Matrix Decision Variable Selection Scheme for Multimodal Problems. Entropy. 2020; 22(9):1004. https://doi.org/10.3390/e22091004

Chicago/Turabian Style

Mollinetti, Marco Antonio Florenzano, Bernardo Bentes Gatto, Mário Tasso Ribeiro Serra Neto, and Takahito Kuno. 2020. "A-DVM: A Self-Adaptive Variable Matrix Decision Variable Selection Scheme for Multimodal Problems" Entropy 22, no. 9: 1004. https://doi.org/10.3390/e22091004

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop