Open Access This article is
- freely available
Algorithms 2018, 11(3), 30; https://doi.org/10.3390/a11030030
Modified Cuckoo Search Algorithm with Variational Parameters and Logistic Map
School of Software, Central South University, Changsha 410075, China
Author to whom correspondence should be addressed.
Received: 17 January 2018 / Accepted: 14 March 2018 / Published: 15 March 2018
Cuckoo Search (CS) is a Meta-heuristic method, which exhibits several advantages such as easier to application and fewer tuning parameters. However, it has proven to very easily fall into local optimal solutions and has a slow rate of convergence. Therefore, we propose Modified cuckoo search algorithm with variational parameter and logistic map (VLCS) to ameliorate these defects. To balance the exploitation and exploration of the VLCS algorithm, we not only use the coefficient function to change step size and probability of detection at next generation, but also use logistic map of each dimension to initialize host nest location and update the location of host nest beyond the boundary. With fifteen benchmark functions, the simulations demonstrate that the VLCS algorithm can over come the disadvantages of the CS algorithm.In addition, the VLCS algorithm is good at dealing with high dimension problems and low dimension problems.
Keywords:cuckoo search; logistic map; variational parameter; coefficient function
Optimization problems are prevalent in society, such as profit maximization, minimum error, and so on [1,2]. To solve this kind of problems, many Meta-heuristic algorithms have been proposed, such as genetic algorithms (GA) [3,4,5], tabu search [6,7,8], simulated annealing [9,10,11], particle swarm optimization [12,13,14], ant colony optimization [15,16,17], etc. Cuckoo search (CS)  is inspired by nature, which is a concise method and easy to implement. Cuckoo search is widely used in the real world. For example, Shair et al.  developed a new approach which is CS algorithm in cutting stock problem. Medjahed et al.  proposed a new framework for band selection problem based on binary cuckoo search. However, CS method is not perfect, the main drawbacks being it easily falls into the local optimal solution and the slow rate of convergence . Li and Yin  used self adaptive parameter method to improve CS. Wang et al.  presented a novel cuckoo search based on chaos theory and elitism. Huang et al.  proposed a Chaos-enhanced cuckoo search that use logistic map to ameliorate CS. Liu and Fu  proposed a cuckoo search algorithm based on frog leaping local search and chaos theory. Zheng and Zhou  used Gaussian distribution to initiate the CS algorithm, which only considered the initial part was not comprehensive. Li and Cao  used a DE algorithm and a CS algorithm to propose a new hybrid optimization algorithm. These algorithms actually have some improvement; however, some of the them make the CS become difficult to implement, while others increase the complexity of the CS. Therefore, many future studies are necessary to develop new effective cuckoo search algorithms for optimization problems .
Chiroma et al.  found that the population reduction and usage of biased random walk are the most frequently used modifications. To improve the CS algorithm, this paper chooses a different method. This paper proposes modified cuckoo search algorithm with variational parameters and logistic sequences (VLCS). VLCS uses logistic map of each dimension to initialize host nest location and update the location of host nest beyond the boundary, which can guarantee that the location of the nest is only calculated once. VLCS also uses coefficient function to change and at next generation, which greatly accelerates the convergence rate.
The rest of this paper is organized as follows. Section 2 describes the CS algorithm and analyzes the defects of CS algorithm. Section 3 proposes the corresponding solution for the drawbacks of CS algorithm and the VLCS algorithm. Simulation experiments are presented in Section 4. Finally, conclusions are presented in Section 5.
2.1. Cuckoo Search Algorithm
Some cuckoos have an aggressive and complicated reproduction strategy. Yang and Deb imitated the strategy and proposed the CS algorithm. The CS  obeys three rules: (1) Each cuckoo lays one egg at a time, and dumps its egg in randomly chosen nest. (2) The best nests with high quality of eggs will carry over to the next generations. (3) The number of available host nests is fixed, and the egg laid by a cuckoo is discovered by the host bird with a probability ∈ [0, 1]. Based on these rules, the pseudo code of CS is shown in Algorithm 1.
|Algorithm 1: Cuckoo Search via Lévy Flights|
2.2. The Disadvantages of the Cuckoo Search Algorithm
Cuckoo search algorithm has three major drawbacks.
- InitializationCuckoo search algorithm uses the random number to initiate these location of nests. Sometimes, the location of these nests will be the same, and sometimes the location of these nests are not properly dispersed in a defined area. Therefore, it causes repeated calculations and the easy chance to fall into local optimal solution .
- Parameters andIn most cases, Yang and Deb used or , where L is the characteristic scale of the problem of interest . Yang and Deb also suggested = 0.25 . In other words, and are fixed number. The properties of the two parameters are the shortcomings of the algorithm, because and should be changed with the progress of iterator, when CS algorithm search a local optimal solution and the global optimal solution.
- Boundary issueCS algorithm uses Lévy flights and random walk to find nest location [18,30]. The locations of some nests may be out of the boundary; when this happens CS algorithm uses the boundary value to replace these location. The bound dealing method will result in a lot of nests at the same location on the boundary, which is inefficient.
3. Modified Cuckoo Search Algorithm: VLCS
This section puts forward the corresponding solution for the drawbacks of the CS algorithm.
3.1. Nest Location of Each Host Are Initialized by Logistic Map of Each Dimension
In this paper, the nest location of each host is initialized by logistic map of each dimension for four reasons. Firstly, the location is found by the logistic map and will not repeat. This means that the speed of convergence can be accelerated. Secondly, logistic map is simple and easy to implement. Thirdly, logistic map is easy to embed into every part of the CS algorithm. Fourthly, since each dimension requires a chaotic map, using other chaotic maps will increase the complexity of the CS algorithm. Logistic map  is defined as:where , the control parameter and n represents the n-th iteration. Chaos phenomenon occurs when . The pseudo code of initialization is shown in Algorithm 2.
|Algorithm 2: Nest location of each host is initialized by logistic map of each dimension|
3.2. Step Size and Are Changed by Coefficient Function
This article uses the coefficient function to overcome the second disadvantage in Section 2. The coefficient function  is defined as:
In Equation (3), the cur_iteration means the current number of iteration and the total_iteration means the total number of iteration. The coefficient function in Equation (2) is used to adjust and (Equation (4))., , and . To find the optimal parameters, this paper use a template to group parameters and set the change size to 0.5. The template shown in Figure 1d and groups shown in Table 1. In Table 1, each row changes and , and each column changes and . This paper selects and , which are mentioned by Yang and Deb  and recent literature . With functions of Table 2, we did 9600 experiments, and the results are shown in Figure 1c. Then, we selects the optimal parameters from those experiments, which are red group 20 in Table 1. These parameters are , , and . Then, these values are used to draw Figure 1a. In Figure 1a, at the beginning of the , the can guarantee that the VLCS algorithm can jump out of the local optimal solution. At middle of the , the change value of can improve the convergence rate. At the end of the , the can guarantee the accuracy of the VLCS algorithm convergence. In Figure 1b, the interval of decreases as increases. The replaces the fixed step size of and the replaces the fixed , which accelerate convergence of cuckoo search algorithm.
3.3. Boundary Is Constrained by Logistic Map of Each Dimension
For the boundary issue, the paper also uses the global random number r, which is changed by logistic map.The reason for using logistic map is the same as in Section 3.1. Algorithms 2 and 3 use the same r. This r can guarantee that the location of each nest is calculated only once.That means the r reduces repeated calculations and accelerates the convergence process. The pseudo code of boundary processing is shown in Algorithm 3.
|Algorithm 3: Boundary is constrained by logistic map of each dimension|
3.4. Proposed VLCS algorithm
This paper proposes VLCS algorithm to balance the exploitation and exploration. The VLCS algorithm uses logistic map of each dimension to handle global random , which is used in initiation and boundary issue. Logistic map can guarantee that the location of each nest will only be calculated once. The VLCS algorithm uses and to replace the fixed parameters of the CS algorithm and improve the performance of CS algorithm. The pseudo code of VLCS algorithm is shown in Algorithm 4.
|Algorithm 4: VLCS algorithm|
4. Simulation Experiments
This paper selects 15 benchmark functions [34,35,36] to prove that the VLCS algorithm is better than the CS algorithm.The simulation environment is Matlab R2014a. The and are shown in Equation (4). The benchmark functions and conditions are shown in Table 2. In Table 2, the dimensions of f02, f08 and f15 are two, and the others’ dimensions are not less than ten. To compare with other algorithms, the nest number of n is 15 [18,24]. If the number of nest is changed, the relative convergence rates of the VLCS algorithm and the CS algorithm do not change. Of course, if n is increased, the VLCS algorithm and the CS algorithm will converge faster than other meta-heuristic algorithms. The CS  was proposed by Xin She Yang, who has already attested that it is better than other meta-heuristic algorithms. Section 3.1 illustrates the benefits of logistic map. Most of modified CS algorithms are mainly focused on choosing chaotic maps (e.g., [23,24,25]). These studies do not mention how to reduce repeated calculation in each dimension. This means the VLCS algorithm converges faster than most of other modified CS algorithms, because the VLCS algorithm uses logistic map of each dimension to initialize host nest location and update the location of host nest beyond the boundary. Therefore, this paper compares the CS algorithm and the VLCS algorithm, and shows the results in Figure 2. There is little difference between the VLCS algorithm and the CS algorithm in the function f04, f13 and f14 because the three functions are simpler than other functions in Figure 2 and do not need to carry out complex calculations. From the results, f07, f08, f09, f10 and f14 show two things clearly. Firstly, the convergence speed of the VLCS algorithm is faster than the CS algorithm, because, at the middle of the iteration, the CS algorithm easily falls into the local optimal solution and needs time to jump out of the local optimal solution. Secondly, the convergence accuracy of the VLCS algorithm is better than the CS algorithm because the VLCS algorithm does not do redundant calculations in the same place, even in the same dimension. Actually, if the other pictures in Figure 2 are enlarged, it is easy to get the same conclusion. The VLCS algorithm solves the three disadvantages of the CS algorithm mentioned in Section 2.2. In addition, Table 2 contains high-dimensional and low-dimensional test functions. This means the VLCS algorithm applies not only to low-dimensional problems but also to high-dimensional problems.
In this paper, the VLCS algorithm consists of coefficient function, the standard CS algorithm and each dimension with one logistic map. The logistic map is used to handle the initial problem and boundary issue. Using the logistic map guarantees to reduce the complexity of the VLCS algorithm and improve the computational efficiency. The reasons are analyzed in Section 3.1. The coefficient function is used to calculate and . The coefficient function is used to change and when the iteration increases. That is why the VLCS algorithm not only can reduce repeated calculation, but also can accelerate the speed of convergence. Furthermore, the VLCS algorithm can prevent itself from falling into a local optimum. The coefficient function is analyzed in Section 3.2. After the analysis of Section 4 simulation experiments, the VLCS algorithm is good at dealing with high dimension problems and low dimension problems.
In the future, we will come up with a more precise way to deal with and and use the VLCS algorithm to solve other practical engineering problems and real-world problems such as image hiding, power distribution, AODV routing protocol and so on. We believe that the VLCS will promote the development of the algorithm and be very useful in real-world problems.
This work is supported by the National Natural Science Foundation of China (Grant No. 71633006 and Grant No. 61672540), and The Fund of Postgraduate Student Independent Innovation Project of Central South University (Grant No. 2017zzts733).
L.L. and X.L. conceived and designed the experiments; X.L. performed the experiments; N.W. analyzed the data; P.Z. contributed reagents/materials/analysis tools; X.L. wrote the paper.
Conflicts of Interest
The authors declare no conflicts of interest.
- Shubin, G.R. Optimization Problem Formulation for Multidisciplinary Design. Siam J. Optim. 1993, 4, 754–776. [Google Scholar]
- Ponsich, A.; Jaimes, A.L.; Coello, C.A.C. A Survey on Multiobjective Evolutionary Algorithms for the Solution of the Portfolio Optimization Problem and Other Finance and Economics Applications. IEEE Trans. Evolut. Comput. 2013, 17, 321–344. [Google Scholar] [CrossRef]
- Gaobo, Y.; Xingming, S.; Xiaojing, W. A Genetic Algorithm based Video Watermarking in the DWT Domain. In Proceedings of the International Conference on Computational Intelligence and Security, Guangzhou, China, 3–6 November 2006; pp. 1209–1212. [Google Scholar]
- Tao, C.; Zhang, Y.; Jiang, J.J. Estimating system parameters from chaotic time series with synchronization optimized by a genetic algorithm. Phys. Rev. E Stat. Nonlinear Soft Matter Phys. 2007, 76, 016209. [Google Scholar] [CrossRef] [PubMed]
- Szpiro, G.G. Forecasting chaotic time series with genetic algorithms. Phys. Rev. E Stat. Phys. Plasmas Fluids Relat. Interdiscip. Top. 1997, 55, 2557–2568. [Google Scholar] [CrossRef]
- Chou, Y.H.; Kuo, S.Y.; Chen, C.Y.; Chao, H.C. A Rule-Based Dynamic Decision-Making Stock Trading System Based on Quantum-Inspired Tabu Search Algorithm. IEEE Access 2014, 2, 883–896. [Google Scholar] [CrossRef]
- Wei, K.C.; Sun, X.; Chu, H.; Wu, C.C. Reconstructing permutation table to improve the Tabu Search for the PFSP on GPU. J. Supercomput. 2017, 73, 4711–4738. [Google Scholar] [CrossRef]
- Alidaee, B.; Ramalingam, V.P.; Wang, H.; Kethley, B. Computational experiment of critical event tabu search for the general integer multidimensional knapsack problem. Ann. Oper. Res. 2017, 1–17. [Google Scholar] [CrossRef]
- Bandyopadhyay, S.; Saha, S.; Maulik, U.; Deb, K. A Simulated Annealing-Based Multiobjective Optimization Algorithm: AMOSA. IEEE Trans. Evolut. Comput. 2008, 12, 269–283. [Google Scholar] [CrossRef]
- Mamano, N.; Hayes, W.B. SANA: Simulated annealing far outperforms many other search algorithms for biological network alignment. Bioinformatics 2017, 33, 2156–2164. [Google Scholar] [CrossRef] [PubMed]
- Angland, P.; Haberberger, D.; Ivancic, S.T.; Froula, D.H. Angular filter refractometry analysis using simulated annealing. Rev. Sci. Instrum. 2017, 88, 103510. [Google Scholar] [CrossRef] [PubMed]
- Fei, G. Parameter estimation for chaotic system based on particle swarm optimization. Acta Phys. Sin. 2006, 55, 577–582. [Google Scholar]
- Garcia-Nieto, J.; Olivera, A.C.; Alba, E. Optimal Cycle Program of Traffic Lights With Particle Swarm Optimization. IEEE Trans. Evolut. Comput. 2013, 17, 823–839. [Google Scholar] [CrossRef]
- Salahi, M.; Jamalian, A.; Taati, A. Global minimization of multi-funnel functions using particle swarm optimization. Neural Comput. Appl. 2013, 23, 2101–2106. [Google Scholar] [CrossRef]
- Martens, D.; Backer, M.D.; Haesen, R.; Vanthienen, J.; Snoeck, M.; Baesens, B. Classification with Ant Colony Optimization. IEEE Trans. Evolut. Comput. 2007, 11, 651–665. [Google Scholar] [CrossRef]
- Yang, Q.; Chen, W.N.; Yu, Z.; Gu, T.; Li, Y.; Zhang, H.; Zhang, J. Adaptive Multimodal Continuous Ant Colony Optimization. IEEE Trans. Evolut. Comput. 2017, 21, 191–205. [Google Scholar] [CrossRef]
- Ye, K.; Zhang, C.; Ning, J.; Liu, X. Ant-colony algorithm with a strengthened negative-feedback mechanism for constraint-satisfaction problems. Inf. Sci. 2017, 406–407, 29–41. [Google Scholar] [CrossRef]
- Yang, X.S.; Deb, S. Cuckoo Search via Lévy Flights. In Proceedings of the World Congress on Nature & Biologically Inspired Computing, 2009 (NaBIC 2009), Coimbatore, India, 9–11 December 2010; pp. 210–214. [Google Scholar]
- Shair, E.F.; Shen, Y.K.; Abdullah, A.R.; Jaafar, H.I.; Saharuddin, N.Z.; Abidin, A.F.Z. Cuckoo Search Approach for Cutting Stock Problem. Int. J. Inf. Electron. Eng. 2015, 5, 138–143. [Google Scholar] [CrossRef]
- Medjahed, S.A.; Saadi, T.A.; Benyettou, A.; Ouali, M. Binary cuckoo search algorithm for band selection in hyperspectral image classification. IAENG Int. J. Comput. Sci. 2015, 42, 1–9. [Google Scholar]
- Walton, S.; Hassan, O.; Morgan, K.; Brown, M.R. Modified cuckoo search: A new gradient free optimisation algorithm. Chaos Solitons Fractals 2011, 44, 710–718. [Google Scholar] [CrossRef]
- Li, X.; Yin, M. Modified cuckoo search algorithm with self adaptive parameter method. Inf. Sci. 2015, 298, 80–97. [Google Scholar] [CrossRef]
- Wang, G.G.; Deb, S.; Gandomi, A.H.; Zhang, Z.; Alavi, A.H. A Novel Cuckoo Search with Chaos Theory and Elitism Scheme. In Proceedings of the International Conference on Soft Computing and Machine Intelligence, New Delhi, India, 26–27 September 2015; pp. 64–69. [Google Scholar]
- Huang, L.; Ding, S.; Yu, S.; Wang, J.; Lu, K. Chaos-enhanced Cuckoo search optimization algorithms for global optimization. Appl. Math. Model. 2016, 40, 3860–3875. [Google Scholar] [CrossRef]
- Liu, X.; Fu, M. Cuckoo search algorithm based on frog leaping local search and chaos theory. Appl. Math. Comput. 2015, 266, 1083–1092. [Google Scholar] [CrossRef]
- Zheng, H.; Zhou, Y. A novel Cuckoo Search optimization algorithm base on gauss distribution. J. Comput. Inf. Syst. 2012, 8, 4193–4200. [Google Scholar]
- Li, M.; Cao, D. Hybrid optimization algorithm of Cuckoo Search and DE. Comput. Eng. Appl. 2013, 49, 57–60. [Google Scholar]
- Chiroma, H.; Herawan, T.; Fister, I., Jr.; Fister, I.; Abdulkareem, S.; Shuib, L.; Hamza, M.F.; Saadi, Y.; Abubakar, A. Bio-Inspired Computation: Recent Development on the Modifications of the Cuckoo Search Algorithm. Appl. Soft Comput. 2017, 61, 149–173. [Google Scholar] [CrossRef]
- Yang, X.S.; Deb, S. Cuckoo search: Recent advances and applications. Neural Comput. Appl. 2014, 24, 169–174. [Google Scholar] [CrossRef]
- Sharma, A.; Singh, R.; Liaw, P.K.; Balasubramanian, G. Cuckoo searching optimal composition of multicomponent alloys by molecular simulations. Scr. Mater. 2017, 130, 292–296. [Google Scholar] [CrossRef]
- Kocarev, L.; Jakimoski, G. Logistic map as a block encryption algorithm. Phys. Lett. A 2001, 289, 199–206. [Google Scholar] [CrossRef]
- Wu, G.C.; Baleanu, D. Discrete fractional logistic map and its chaos. Nonlinear Dyn. 2013, 75, 283–287. [Google Scholar] [CrossRef]
- Jia, B.; Yu, B.; Wu, Q.; Wei, C.; Law, R. Adaptive affinity propagation method based on improved cuckoo search. Knowl.-Based Syst. 2016, 111, 27–35. [Google Scholar] [CrossRef]
- Chattopadhyay, R. A study of test functions for optimization algorithms. J. Optim. Theory Appl. 1971, 8, 231–236. [Google Scholar] [CrossRef]
- Shang, Y.W.; Qiu, Y.H. A Note on the Extended Rosenbrock Function. Evolut. Comput. 2006, 14, 119–126. [Google Scholar] [CrossRef] [PubMed]
- Schoen, F. A wide class of test functions for global optimization. J. Glob. Optim. 1993, 3, 133–137. [Google Scholar] [CrossRef]
Figure 1. Parameter selection.
Figure 2. Convergence performance of the CS and the VLCS.
Table 1. Parameters groups.
Table 2. benchmark function.
© 2018 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).