Pareto Local Search Guided by Archive Entropy
Abstract
1. Introduction
2. Preliminaries
3. Proposed Algorithm
| Algorithm 1: AEG-PLS Framework |
![]() |
| Algorithm 2: Select Exploration Region by Archive Entropy |
![]() |
| Algorithm 3: Perturb Reference Direction |
![]() |
3.1. Region Exploration Selection by Archive Entropy
| Algorithm 4: Select Best Solution by Chebyshev Scalarization |
![]() |
| Algorithm 5: Update Region Archive |
![]() |
| Algorithm 6: Compute Distance Entropy |
![]() |
3.2. Reference Direction Perturbation Mechanism
3.3. Exploratory Solution Selection Based on Chebyshev Scalarization
3.4. Neighborhood Solutions Generation and External Archive Update
3.5. Region Archive Update and Entropy Estimation
4. Experiments and Results
4.1. Test Instances
4.2. Comparative Algorithms
4.3. Performance Metrics
4.4. Experimental Settings
4.5. Experimental Results
4.5.1. Convergence Performance
- Random InitializationFor the test instances derived from TSPLIB, Table 1 and Table 2 summarize the mean and standard deviation of the IGD and HV metrics, respectively, across 21 independent runs for each algorithm. The best results are highlighted with darker shading. The results in Table 1 show that the proposed AEG-PLS algorithm achieved the best IGD values in all 22 test instances. For HV metrics, Table 2 indicates that AEG-PLS performed optimally in 21 out of the 22 instances, while MPLS achieved the best HV mean on the kroBDE100 instance.
- Lin–Kernighan Heuristic InitializationBased on the comparative analysis of performance metrics under the Lin–Kernighan heuristic initialization, the IGD and HV metrics are evaluated on both TSPLIB and DIMACS instances. Table 5 and Table 6 provide the comparative results for the TSPLIB instances, while Table 7 and Table 8 present the corresponding results for the DIMACS instances. In the case of two objectives, Table 5 and Table 6 show that AEG-PLS achieves the best results in both IGD and HV metrics across all test instances from the TSPLIB and DIMACS series. For the three-objective TSPLIB instances, the performance of AEG-PLS is comparable to that of MPLS, yet it still outperforms all other compared algorithms.
4.5.2. Convergence Speed Analysis
4.5.3. Running Time Comparison
4.6. Parameter Sensitivity Analysis
4.6.1. Neighborhood Depth
4.6.2. Update Frequency and Number of Regions
5. Conclusions and Future Work
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- Agrawal, A.; Ghune, N.; Prakash, S.; Ramteke, M. Evolutionary algorithm hybridized with local search and intelligent seeding for solving multi-objective Euclidian TSP. Expert Syst. Appl. 2021, 181, 115192. [Google Scholar] [CrossRef] [Scilit]
- Shao, Y.; Lin, J.C.W.; Srivastava, G.; Guo, D.; Zhang, H.; Yi, H.; Jolfaei, A. Multi-Objective Neural Evolutionary Algorithm for Combinatorial Optimization Problems. IEEE Trans. Neural Netw. Learn. Syst. 2023, 34, 2133–2143. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Dong, Z.; Wang, X.; Tang, L. MOEA/D with a self-adaptive weight vector adjustment strategy based on chain segmentation. Inf. Sci. 2020, 521, 209–230. [Google Scholar]
- Diaz, J.E.; López-Ibáñez, M. Incorporating decision-maker’s preferences into the automatic configuration of bi-objective optimisation algorithms. Eur. J. Oper. Res. 2021, 289, 1209–1222. [Google Scholar] [CrossRef] [Scilit]
- Miettinen, K. Nonlinear Multiobjective Optimization; Kluwer Academic Publishers: Boston, MA, USA, 1999. [Google Scholar]
- Wang, X.; Dong, Z.; Tang, L.; Zhang, Q. Multiobjective Multitask Optimization-Neighborhood as a Bridge for Knowledge Transfer. IEEE Trans. Evol. Comput. 2023, 27, 155–169. [Google Scholar] [CrossRef] [Scilit]
- Wang, X.; Zhang, J.; Tang, L.; Liu, Y. Evolutionary Direction Learning with Multivariate Gaussian Probabilistic Model for Multiobjective Optimization. IEEE Trans. Evol. Comput. 2025, in press. [Google Scholar] [CrossRef] [Scilit]
- Wang, Z.; Gombolay, M. Learning Scheduling Policies for Multi-Robot Coordination with Graph Attention Networks. IEEE Robot. Autom. Lett. 2020, 5, 4509–4516. [Google Scholar] [CrossRef] [Scilit]
- Zhang, C.; Song, W.; Cao, Z.; Zhang, J.; Tan, P.S.; Xu, C. Learning to dispatch for job shop scheduling via deep reinforcement learning. In Proceedings of the 34th International Conference on Neural Information Processing Systems, NIPS ’20, Vancouver, BC, Canada, 6–12 December 2020; Curran Associates Inc.: Red Hook, NY, USA, 2020. [Google Scholar]
- Jozefowiez, N.; Semet, F.; Talbi, E.G. Multi-objective vehicle routing problems. Eur. J. Oper. Res. 2008, 189, 293–309. [Google Scholar] [CrossRef] [Scilit]
- Arnold, F.; Sörensen, K. Knowledge-guided local search for the vehicle routing problem. Comput. Oper. Res. 2019, 105, 32–46. [Google Scholar] [CrossRef] [Scilit]
- Paquete, L.; Chiarandini, M.; Stützle, T. Pareto Local Optimum Sets in the Biobjective Traveling Salesman Problem: An Experimental Study. In Metaheuristics for Multiobjective Optimisation; Gandibleux, X., Sevaux, M., Sörensen, K., T’kindt, V., Eds.; Springer: Berlin/Heidelberg, Germany, 2004; pp. 177–199. [Google Scholar]
- Shannon, C.E. A mathematical theory of communication. Bell Syst. Tech. J. 1948, 27, 379–423. [Google Scholar]
- Zhang, Q.; Li, H. MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition. IEEE Trans. Evol. Comput. 2007, 11, 712–731. [Google Scholar] [CrossRef] [Scilit]
- Wang, X.; Zhao, Y.; Tang, L.; Yao, X. MOEA/D with Spatial–Temporal Topological Tensor Prediction for Evolutionary Dynamic Multiobjective Optimization. IEEE Trans. Evol. Comput. 2025, 29, 764–778. [Google Scholar] [CrossRef] [Scilit]
- Shi, J.; Sun, J.; Zhang, Q.; Zhang, H.; Fan, Y. Improving Pareto Local Search Using Cooperative Parallelism Strategies for Multiobjective Combinatorial Optimization. IEEE Trans. Cybern. 2024, 54, 2369–2382. [Google Scholar] [CrossRef] [Scilit]
- Zhao, Q.; Zhang, L.; Pan, Q.; Cui, K.; Zhao, M.; Tian, F.; Hu, B. An On-Board Executable Pareto-Based Iterated Local Search Algorithm for Embedded Multi-Core Processor Task Scheduling. IEEE Trans. Comput. 2025, 74, 3696–3709. [Google Scholar]
- Dubois-Lacoste, J.; López-Ibáñez, M.; Stützle, T. Anytime Pareto local search. Eur. J. Oper. Res. 2015, 243, 369–385. [Google Scholar] [CrossRef] [Scilit]
- Jaszkiewicz, A. Many-Objective Pareto Local Search. Eur. J. Oper. Res. 2018, 271, 1001–1013. [Google Scholar] [CrossRef] [Scilit]
- Luo, Q.; Wu, G.; Ji, B.; Wang, L.; Suganthan, P.N. Hybrid Multi-Objective Optimization Approach with Pareto Local Search for Collaborative Truck-Drone Routing Problems Considering Flexible Time Windows. IEEE Trans. Intell. Transp. Syst. 2022, 23, 13011–13025. [Google Scholar] [CrossRef] [Scilit]
- Lust, T.; Teghem, J. Two-phase Pareto local search for the biobjective traveling salesman problem. J. Heuristics 2010, 16, 475–510. [Google Scholar]
- Dubois-Lacoste, J.; López-Ibáñez, M.; Stützle, T. A hybrid TP+PLS algorithm for bi-objective flow-shop scheduling problems. Comput. Oper. Res. 2011, 38, 1219–1236. [Google Scholar]
- Dong, Z.; Wang, X.; Tang, L. Color-Coating Scheduling with a Multiobjective Evolutionary Algorithm Based on Decomposition and Dynamic Local Search. IEEE Trans. Autom. Sci. Eng. 2021, 18, 1590–1601. [Google Scholar]
- Shi, J.; Zhang, Q.; Derbel, B.; Liefooghe, A.; Sun, J. Parallel Pareto Local Search Revisited: First Experimental Results on Bi-Objective UBQP. In Proceedings of the Genetic and Evolutionary Computation Conference, GECCO ’18, Kyoto, Japan, 15–19 July 2018; pp. 753–760. [Google Scholar]
- Shi, J.; Zhang, Q.; Sun, J. PPLS/D: Parallel Pareto Local Search Based on Decomposition. IEEE Trans. Cybern. 2020, 50, 1060–1071. [Google Scholar] [CrossRef] [Scilit]
- Cai, X.; Sun, H.; Zhang, Q.; Huang, Y. A Grid Weighted Sum Pareto Local Search for Combinatorial Multi and Many-Objective Optimization. IEEE Trans. Cybern. 2019, 49, 3586–3598. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Cai, X.; Xia, C.; Zhang, Q.; Mei, Z.; Hu, H.; Wang, L.; Hu, J. The Collaborative Local Search Based on Dynamic-Constrained Decomposition with Grids for Combinatorial Multiobjective Optimization. IEEE Trans. Cybern. 2021, 51, 2639–2650. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Cai, X.; Li, Y.; Fan, Z.; Zhang, Q. An External Archive Guided Multiobjective Evolutionary Algorithm Based on Decomposition for Combinatorial Optimization. IEEE Trans. Evol. Comput. 2015, 19, 508–523. [Google Scholar]
- Deb, K.; Pratap, A.; Agarwal, S.; Meyarivan, T. A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans. Evol. Comput. 2002, 6, 182–197. [Google Scholar] [CrossRef] [Scilit]
- Jaszkiewicz, A.; Zielniewicz, P. Improving the Efficiency of the Distance-Based Hypervolume Estimation Using ND-Tree. IEEE Trans. Evol. Comput. 2025, 29, 726–733. [Google Scholar] [CrossRef] [Scilit]
- Voudouris, C.; Tsang, E. Guided local search and its application to the traveling salesman problem. Eur. J. Oper. Res. 1999, 113, 469–499. [Google Scholar] [CrossRef] [Scilit]
- Voudouris, C.; Tsang, E.P.; Alsheddy, A. Guided Local Search. In Handbook of Metaheuristics; Gendreau, M., Potvin, J.Y., Eds.; Springer: Boston, MA, USA, 2010; pp. 321–361. [Google Scholar]
- Alsheddy, A.; Voudouris, C.; Tsang, E.P.K.; Alhindi, A. Guided Local Search. In Handbook of Heuristics; Martí, R., Pardalos, P.M., Resende, M.G.C., Eds.; Springer International Publishing: Cham, Switzerland, 2018; pp. 261–297. [Google Scholar]
- Alsheddy, A.; Tsang, E.E.P.K. Guided Pareto Local Search based frameworks for biobjective optimization. In Proceedings of the IEEE Congress on Evolutionary Computation, Barcelona, Spain, 18–23 July 2010; pp. 1–8. [Google Scholar]
- Panichella, A. An improved Pareto front modeling algorithm for large-scale many-objective optimization. In Proceedings of the Genetic and Evolutionary Computation Conference, GECCO ’22, Boston, MA, USA, 9–13 July 2022; pp. 565–573. [Google Scholar]
- Schuetze, O.; Equivel, X.; Lara, A.; Coello Coello, C.A. Some Comments on GD and IGD and Relations to the Hausdorff Distance. In Proceedings of the 12th Annual Conference Companion on Genetic and Evolutionary Computation, GECCO ’10, Portland, OR, USA, 7–11 July 2010; pp. 1971–1974. [Google Scholar]
- Bosman, P.A.N.; Thierens, D. The balance between proximity and diversity in multiobjective evolutionary algorithms. IEEE Trans. Evol. Comput. 2003, 7, 174–188. [Google Scholar] [CrossRef] [Scilit]
- Cai, X.; Hu, M.; Gong, D.; Guo, Y.-N.; Zhang, Y.; Fan, Z.; Huang, Y. A decomposition-based coevolutionary multiobjective local search for combinatorial multiobjective optimization. Swarm Evol. Comput. 2019, 49, 178–193. [Google Scholar] [CrossRef] [Scilit]
- Lin, S.; Kernighan, B.W. An Effective Heuristic Algorithm for the Traveling-Salesman Problem. Oper. Res. 1973, 21, 498–516. [Google Scholar] [CrossRef] [Scilit]
- Paquete, L.; Stützle, T. A Two-Phase Local Search for the Biobjective Traveling Salesman Problem. In Evolutionary Multi-Criterion Optimization; Fonseca, C.M., Fleming, P.J., Zitzler, E., Thiele, L., Deb, K., Eds.; Springer: Berlin/Heidelberg, Germany, 2003; pp. 479–493. [Google Scholar]
- Blank, J.; Deb, K.; Dhebar, Y.; Bandaru, S.; Seada, H. Generating Well-Spaced Points on a Unit Simplex for Evolutionary Many-Objective Optimization. IEEE Trans. Evol. Comput. 2021, 25, 48–60. [Google Scholar] [CrossRef] [Scilit]
- Demšar, J. Statistical Comparisons of Classifiers over Multiple Data Sets. J. Mach. Learn. Res. 2006, 7, 1–30. [Google Scholar]
- Durillo, J.J.; Nebro, A.J. jMetal: A Java framework for multi-objective optimization. Adv. Eng. Softw. 2011, 42, 760–771. [Google Scholar] [CrossRef] [Scilit]











| Test Instances | MOEA/D-DLS | AGE-MOEA-II | EAG-MOEA/D | MPLS | AEG-PLS |
|---|---|---|---|---|---|
| kroAB100 | |||||
| kroAC100 | |||||
| kroAD100 | |||||
| kroAE100 | |||||
| kroBC100 | |||||
| kroBD100 | |||||
| kroBE100 | |||||
| kroCD100 | |||||
| kroCE100 | |||||
| kroDE100 | |||||
| kroAB150 | |||||
| kroAB200 | |||||
| kroABC100 | |||||
| kroABD100 | |||||
| kroABE100 | |||||
| kroACD100 | |||||
| kroACE100 | |||||
| kroADE100 | |||||
| kroBCD100 | |||||
| kroBCE100 | |||||
| kroBDE100 | |||||
| kroCDE100 |
| Test Instances | MOEA/D-DLS | AGE-MOEA-II | EAG-MOEA/D | MPLS | AEG-PLS |
|---|---|---|---|---|---|
| kroAB100 | |||||
| kroAC100 | |||||
| kroAD100 | |||||
| kroAE100 | |||||
| kroBC100 | |||||
| kroBD100 | |||||
| kroBE100 | |||||
| kroCD100 | |||||
| kroCE100 | |||||
| kroDE100 | |||||
| kroAB150 | |||||
| kroAB200 | |||||
| kroABC100 | |||||
| kroABD100 | |||||
| kroABE100 | |||||
| kroACD100 | |||||
| kroACE100 | |||||
| kroADE100 | |||||
| kroBCD100 | |||||
| kroBCE100 | |||||
| kroBDE100 | |||||
| kroCDE100 |
| Test Instances | MOEA/D-DLS | AGE-MOEA-II | EAG-MOEA/D | MPLS | AEG-PLS |
|---|---|---|---|---|---|
| euclidAB100 | |||||
| euclidCD100 | |||||
| euclidEF100 |
| Test Instances | MOEA/D-DLS | AGE-MOEA-II | EAG-MOEA/D | MPLS | AEG-PLS |
|---|---|---|---|---|---|
| euclidAB100 | |||||
| euclidCD100 | |||||
| euclidEF100 |
| Test Instances | MOEA/D-DLS | AGE-MOEA-II | EAG-MOEA/D | MPLS | AEG-PLS |
|---|---|---|---|---|---|
| kroAB100 | |||||
| kroAC100 | |||||
| kroAD100 | |||||
| kroAE100 | |||||
| kroBC100 | |||||
| kroBD100 | |||||
| kroBE100 | |||||
| kroCD100 | |||||
| kroCE100 | |||||
| kroDE100 | |||||
| kroAB150 | |||||
| kroAB200 | |||||
| kroABC100 | |||||
| kroABD100 | |||||
| kroABE100 | |||||
| kroACD100 | |||||
| kroACE100 | |||||
| kroADE100 | |||||
| kroBCD100 | |||||
| kroBCE100 | |||||
| kroBDE100 | |||||
| kroCDE100 |
| Test Instances | MOEA/D-DLS | AGE-MOEA-II | EAG-MOEA/D | MPLS | AEG-PLS |
|---|---|---|---|---|---|
| kroAB100 | |||||
| kroAC100 | |||||
| kroAD100 | |||||
| kroAE100 | |||||
| kroBC100 | |||||
| kroBD100 | |||||
| kroBE100 | |||||
| kroCD100 | |||||
| kroCE100 | |||||
| kroDE100 | |||||
| kroAB150 | |||||
| kroAB200 | |||||
| kroABC100 | |||||
| kroABD100 | |||||
| kroABE100 | |||||
| kroACD100 | |||||
| kroACE100 | |||||
| kroADE100 | |||||
| kroBCD100 | |||||
| kroBCE100 | |||||
| kroBDE100 | |||||
| kroCDE100 |
| Test Instances | MOEA/D-DLS | AGE-MOEA-II | EAG-MOEA/D | MPLS | AEG-PLS |
|---|---|---|---|---|---|
| euclidAB100 | |||||
| euclidCD100 | |||||
| euclidEF100 |
| Test Instances | MOEA/D-DLS | AGE-MOEA-II | EAG-MOEA/D | MPLS | AEG-PLS |
|---|---|---|---|---|---|
| euclidAB100 | |||||
| euclidCD100 | |||||
| euclidEF100 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Yao, S.; Zhang, L.; Dong, Z.; Liu, Q.; Wang, X. Pareto Local Search Guided by Archive Entropy. Appl. Sci. 2026, 16, 964. https://doi.org/10.3390/app16020964
Yao S, Zhang L, Dong Z, Liu Q, Wang X. Pareto Local Search Guided by Archive Entropy. Applied Sciences. 2026; 16(2):964. https://doi.org/10.3390/app16020964
Chicago/Turabian StyleYao, Shuangshuang, Le Zhang, Zhiming Dong, Qingqing Liu, and Xianpeng Wang. 2026. "Pareto Local Search Guided by Archive Entropy" Applied Sciences 16, no. 2: 964. https://doi.org/10.3390/app16020964
APA StyleYao, S., Zhang, L., Dong, Z., Liu, Q., & Wang, X. (2026). Pareto Local Search Guided by Archive Entropy. Applied Sciences, 16(2), 964. https://doi.org/10.3390/app16020964







