Abstract
Feature selection (FS) is a pivotal preprocessing task in data mining aimed at identifying optimal feature subsets to improve model generalization and reduce computational overhead. However, its NP-hard nature poses significant challenges for traditional optimizers in terms of search efficiency and solution quality. The Harris Hawks Optimization (HHO) algorithm is a state-of-the-art population-based metaheuristic method that demonstrates powerful capabilities in various optimization challenges. Despite its advantages, HHO encounters problems such as early stagnation and reduced accuracy. To mitigate these problems, we introduce an advanced algorithm called the Hybrid Strategy Harris Hawks Optimization (HSHHO). The HSHHO combines three key enhancements to support global search diversity and local refinement: (1) an exploration mechanism that utilizes the Self-Parameterized Map (SPM) alongside a dynamic logarithmic spiral to expand search breadth; (2) a nonlinear adjustment to the escape energy parameter for improved phase equilibrium; and (3) an elite perturbation approach that uses Cauchy–Gaussian mutation to strengthen local optimization and solution quality. We assessed HSHHO against eight well-known algorithms on 30 benchmark functions, where it exhibited superior results in the majority of cases. Finally, HSHHO is applied to address 18 feature selection tasks. The results demonstrated that HSHHO achieved highly competitive outcomes in terms of objective values, feature subset size, and classification performance in most datasets, reaching an average accuracy of 94.47%.
1. Introduction
Nowadays, various industries generate a large amount of data, and finding valuable insights from multi-source data is a daunting challenge for data processing [1]. Model performance often requires clean, non-redundant input data. However, the collected raw data often has redundant, irrelevant, and noisy features [2]. High-dimensional data can lead to a curse of dimensionality, severely reducing the model’s generalization ability.
To address these issues, researchers widely use feature selection (FS) methods to identify key attributes in the data. The goal of feature selection is to find the optimal subset of features to eliminate irrelevant or redundant features, thereby improving model accuracy and reducing computational complexity [3]. Essentially, FS is a combinatorial optimization problem, where given a dataset with features, the objective is to select the optimal feature subset from candidate feature combinations [4]. Due to its NP hard nature and inherent multi-objective nature, this task has attracted in-depth research in recent years [5]. At present, the FS method has been applied in classification and regression tasks [6,7], engineering optimization [8,9], text classification [10,11], and many other fields. Especially in complex engineering applications, such as railway transportation emergency response scenarios, due to the involvement of multi-disciplinary collaboration, the emergency response process generates massive amounts of multi feature data. Researchers need to identify key influencing factors from these redundant and noisy raw features. FS, as a key preprocessing task, can effectively eliminate irrelevant variables in railway emergency data, thereby improving emergency decision-making capabilities in the event of sudden accidents.
FS approaches fall into three categories: filter, wrapper, and embedded methods [12,13,14,15,16]. Filter methods are computationally lightweight and classifier-independent, which explains their widespread popularity. However, they often produce suboptimal feature subsets and are prone to overfitting [17]. Wrapper methods, by contrast, evaluate subsets directly through a specific classifier; although they are more accurate and less susceptible to overfitting than filters, they can still select biased features when used in isolation and are computationally more demanding. Embedded methods integrate feature selection into the training process of the classifier itself and have therefore drawn considerable interest; numerous hybrid strategies have been proposed to further enhance their effectiveness [18,19]. Regardless of category, these techniques are typically paired with well-known classifiers such as decision trees [20,21], support vector machines [22], Bayesian networks [23,24], k-nearest neighbors [25], and artificial neural networks [26,27].
In recent years, metaheuristic optimization algorithms have become the main method for solving FS problems due to their powerful global search and local optimization capabilities [28,29,30,31,32,33]. The landscape optimized by metaheuristics can be divided into two main schools of thought. The first genre includes mature classic algorithms that have been rigorously tested for decades, such as genetic algorithms (GA), differential evolution (DE), and simulated annealing (SA). The second school represents recent biologically inspired swarm intelligence methods that utilize collective behavior in nature to solve complex engineering problems. For example, Particle Swarm Optimization (PSO), Gray Wolf Optimizer (GWO), Whale Optimization Algorithm (WOA), etc. These optimization algorithms can generate a set of candidate solutions. Their search process consists of two basic stages, the exploration stage and the exploitation stage [34]. However, the imbalance between the two stages is the main reason why these algorithms fall into local optima when processing high-dimensional data.
To overcome these limitations, researchers are increasingly turning to hybrid algorithms that combine complementary advantages. For example, chaotic cosine firefly (CSCF) algorithm [35], PSO-GWO hybrid algorithm [36], GSA-GA fusion algorithm [37], quantum enhanced bat algorithm (CCQBA) [38], and opponent based social spider optimizer (OBSSO) [39]. These hybrid algorithms demonstrate excellent solving capabilities in feature selection problems.
Among the popular swarm intelligence algorithms, the HHO algorithm has received widespread attention due to its simple mathematical structure and effectiveness in solving various engineering problems [40]. However, HHO performs poorly in dealing with high-dimensional and complex multimodal problems. This is because HHO has limitations of premature convergence and low solution accuracy. Therefore, it is urgent to propose improvement strategies to optimize HHO in order to enhance the algorithm’s fast gaming performance. At present, several enhancement methods have been proposed to alleviate these weaknesses: neighborhood perturbation [41], sine escape energy adjustment [42], logarithmic spiral exploration [43], and tent graph plus crossover mutation strategy [44]. Based on these insights, the present work introduces a novel algorithm called Hybrid Strategy Harris Hawks Optimization (HSHHO). As an improved feature selection wrapper method, HSHHO aims to obtain the optimal feature subset while improving classification accuracy.
The core contribution lies in three targeted improvement measures aimed at strengthening the exploration, transition, and mining stages of HHO:
- (1)
- SPM chaotic mapping and variable logarithmic spiral strategy were proposed to enhance burst diversity and global search.
- (2)
- A nonlinear escape energy function has been proposed, achieving a smoother and more adaptive balance between exploration and exploitation.
- (3)
- The Cauchy–Gaussian elite perturbation mechanism has been proposed, which can promote local refinement and help algorithms overcome local optima.
The rest of this article is organized as follows. Section 2 reviewed the standard HHO algorithm and proposed three improvement strategies for constructing HSHHO. Section 3 reports a comprehensive experiment on 30 benchmark functions and 18 real-world feature selection datasets, comparing HSHHO with eight well-known methods. Finally, Section 4 summarizes the research findings and outlines future research directions.
2. Methods
2.1. Harris Hawks Optimization
The Harris Hawks Optimization (HHO) is a population-based metaheuristic, inspired by the collaborative hunting tactics of Harris hawks in pursuing prey. This algorithm has shown robust performance in addressing various optimization challenges. To cope with the variability in prey behavior and environmental conditions, hawks adapt their strategies dynamically. Empirical evaluations indicate that HHO often surpasses other metaheuristics in terms of solution quality. The algorithm operates in two primary phases—exploration and exploitation—driven by the prey’s escape energy, as illustrated in Figure 1. Exploration employs two position-update mechanisms, while exploitation features four distinct strategies. The detail of the HHO is as follows.
Figure 1.
Different stages of HHO.
Figure 1 shows the framework of the HHO algorithm, demonstrating the dynamic behavior between different hunting stages. The optimization process is mainly determined by the escape energy of the prey. When , the algorithm is in the exploration stage. When , the algorithm will enter the exploitation stage. In these stages, the specific strategy is determined by two variables: determines the habitat mechanism during exploration, while represents the probability of prey successfully escaping during exploitation. The arrow indicates the behavioral change in the eagle’s position from global search to local capture.
2.1.1. Exploration Phase
In HHO, each hawk represents a candidate solution within the population. Through iterative updates, hawks adjust their positions relative to the current best location. During exploration, two strategies are applied based on a random threshold . If , hawks update positions using their own location and those of nearby individuals. If , they select a random perch within the search space for observation. The mathematical formulations are:
where is the expressed hawk position at iteration . is a randomly chosen hawk position at iteration . is the prey’s position (best solution) at iteration . , , , are random values in (0, 1). and denote the upper and lower bounds of the search space. The average population position is computed as:
2.1.2. Transition Phase
The transition from exploration to exploitation hinges on the prey’s escape energy , which dictates the hawks’ pursuit tactics. Initially, hawks scan broadly for prey; upon detection, they shift to targeted attacks. This phase ensures an equilibrium between global and local search, enhancing overall efficiency. The escape energy is modeled as:
where represents is the initial escape energy, which is a random value with [−1, 1]. is the current iteration, and is the maximum iterations. decreases linearly from 2 to 0 over iterations, as depicted in the light green area of Figure 1.
2.1.3. Exploitation Phase
Exploitation encompasses four strategies, selected based on and an escape probability . If , the prey escapes successfully; otherwise, it fails. Figure 1 outlines the sequential application of these strategies.
- Soft besiege strategy
When and , hawks gradually encircle the prey with sufficient energy remaining:
where is a random number with [0, 2] denoting the strength of the rabbit’s jumps during its escape. denotes the best solution in iteration .
- 2.
- Hard besiege strategy
When and , the prey is fatigued, prompting a direct assault:
- 3.
- Soft besiege with progressive rapid dives
When and , the prey evades energetically, leading to Lévy-flight-based dives:
where is a random vector in [0, 1]. Y and Z denote the two strategies, respectively. denotes the Lévy flight function [45]:
where and normally distributed in (0, 1). is 1.5 acquiescently.
- 4.
- Hard besiege with progressive rapid dives
When and , a similar dive strategy is applied but with reduced energy:
2.2. Hybrid Strategy Harris Hawks Optimization
While HHO excels in dynamic search, it shares common pitfalls with other swarm methods, such as limited accuracy and local optima entrapment when facing complex problems. These arise from random initialization and rigid exploration/exploitation mechanics. To remedy this, we propose HSHHO, incorporating: (1) SPM chaotic map and variable logarithmic spiral (SPM-VLS) for exploration; (2) nonlinear escape energy for transition; and (3) Cauchy–Gaussian elite perturbation for exploitation. The three proposed improvement strategies effectively address the inherent weaknesses of HHO. Although SPM-VLS expands the initial search range, the nonlinear energy method maintains a balance between the exploration stage and the mining stage during the mid-term iteration, and the dual mutation mechanism in the mining stage escapes the local optimal solution. This synergy ensures that each stage of the optimization process is particularly strengthened.
2.2.1. Population Initialization Based on a Chaotic Map
The population initialization of optimization algorithms is one of the key steps. The distribution of the population affects the search performance of the algorithm in the early stage. In the HHO algorithm, the initial population position is randomly generated, which may lead to an uneven distribution of individuals. The diversity of the initial population is the key to algorithm optimization, and it is necessary to enhance population diversity to improve overall search capability. Introducing chaotic mapping into the algorithm initialization phase can alleviate this problem. Chaotic mapping can provide traversal and non-repetitive sequences, which are superior to random initialization in improving population diversity [46]. This study chooses the SPM mapping method to replace the traditional random generation method. Figure 2 and Figure 3 show the distribution histograms and scatter plots of SPM, respectively. It is not difficult to see that the population generated using SPM mapping exhibits a uniform distribution. Therefore, SPM effectively enhances the diversity of the initial population, which is beneficial for the global search of the algorithm.
Figure 2.
Population distribution diagrams of SPM.
Figure 3.
Histograms of distributions of SPM.
Therefore, we introduce the SPM to improve the population initialization of HHO:
where if , the system is in a chaotic state. is a random number.
Therefore, we can obtain the position of :
2.2.2. Variable Logarithmic Spiral Strategy
HHO’s exploration relies heavily on random factors, which can lead to premature convergence. We integrate a variable logarithmic spiral, inspired by whale and moth algorithms [47], to refine position updates:
where represents the best solution. represents a random number in [−1, 1]. dynamically adjusts:
This enables larger spirals early on and finer adjustments later.
2.2.3. Improvement Strategies for the Transition Phase
The transition phase of HHO is based on the escape energy . The main purpose of the transition phase is to maintain a balance between exploration phase and exploitation phase. We propose a nonlinear method to address the limitation of linear function.
where represents the average position of the population. is the minimum value, is the maximum value. of random numbers.
Equation (19) shows that varies nonlinearly with the number of iterations. Based on Figure 1, when , decreases nonlinearly from the exploration to the exploitation. According to the variation curve of the cos(x) function, with in the middle of the algorithm iteration, the rate of change accelerates, which enables the HHO to quickly switch to the exploitation phase. When and depends on the distance between the position of the Harris hawks and the position of the optimal solution, the closer to the optimal solution, the larger is, and the algorithm will shift from the exploitation stage to the exploration phase, which can relieve local population accumulation and avoid getting into a local optimum in the later stage of the algorithm.
2.2.4. Improvement Strategies for the Exploitation Phase
To overcome limitations of HHO, we introduce an elite-guided perturbation strategy [48]. The disturbance probability is introduced to determine whether the current optimal individual performs the elite perturbation operation:
where is the disturbance probability of an elite individual and is the problem dimension.
To improve the capability of running away from local optima, an improved method is proposed by integrating the Cauchy–Gaussian mutation mechanism into the traditional elite perturbation strategy. The specific calculation formula of the Cauchy–Gaussian mutation is expressed as follows:
where represents a Cauchy random variable, and represents a Gaussian variable. , whose value gradually decreases with the iterations, , and the value gradually increases with the iterations.
Therefore, the best individual position is as shown:
In summary, the proposed HSHHO algorithm is shown in Figure 4.
Figure 4.
Flowchart of the HSHHO algorithm.
2.3. Complexity of the HSHHO Algorithm
The computational complexity of the HSHHO algorithm is mainly composed of the following three parts:
- Initialization of the population. The computational complexity of this part mainly depends on population size and the problem dimension , and the calculated complexity is .
- Evaluating the fitness of the initial population. The computational complexity of this part is mainly determined by the population size . The computational complexity is .
- The population position is cyclically updated. The computational complexity of this part mainly depends by the population size , the problem dimension and the number of iterations . It is composed of individual position updates and fitness calculations. The position of the individual is updated through different search strategies. The execution of two different stages is determined by whether the algorithm satisfies the judgment condition. The computational complexity of this part is calculated as .
Based on the above analysis, we can deduce that the time complexity of our proposed HSHHO algorithm follows a similar structure to that of the standard HHO algorithm. Specifically, the time complexity primarily includes population position initialization, population position update, and population fitness calculation. Consequently, the computational complexity of these components should remain unchanged. Similarly, the different strategy in this paper is to improve the method of updating the population position without increasing the number of populations and the iteration time, which does not change the time complexity of this component.
Therefore, = + + . where , , . Total complexity of the HSHHO is .
3. Results
To assess the efficacy and optimization potential of HSHHO, we conduct a series of simulation experiments. Initially, the algorithm is tested on 23 standard benchmark functions to evaluate the impact of its three enhancement strategies relative to the baseline HHO. Subsequently, HSHHO is benchmarked against eight established metaheuristic algorithms using IEEE CEC 2017 problems, with statistical analyses to highlight its advantages. Finally, HSHHO is deployed on 18 feature selection datasets to demonstrate its practical utility. All simulations are executed on a Windows 10 system equipped with an Intel Core i7-7700, CPU @ 3.60 GHz and 32 G of RAM, using MATLAB R2022b for implementation.
The common parameters for all algorithms are set such that the population size is 30 and the maximum iteration is 500. In this study, to ensure fairness in computational workload between algorithms, the total number of function evaluations is set to . In addition, we define one iteration of the algorithm as a complete loop. In this loop, the positions of all individuals in the group are updated, followed by a round of fitness assessment.
3.1. Comparison of the Effects of Different Improvement Strategies
To bolster HHO’s optimization capabilities, we introduce three targeted enhancements: a hybrid SPM chaotic map with variable logarithmic spiral (SPM-VLS), a nonlinear escape energy mechanism for smoother phase transitions, and a Cauchy–Gaussian elite perturbation approach. These are integrated to form the comprehensive HSHHO algorithm. This section aims to empirically verify the independent contribution of each strategy to HHO and demonstrate the excellent performance achieved through its fusion effect.
To conduct this analysis, we decomposed HSHHO into three variants, including HSHHO1, HSHHO2, and HSHHO3. Each variant contains only one improvement strategy. HSHHO1 only enhances HHO through SPM-VLS and ignores other functions. HSHHO2 only applies nonlinear escape energy updates. HSHHO3 is only available for the police Cauchy Gauss Elite. These variants, as well as the proposed HSHHO and HHO, are evaluated and compared on 23 standard benchmark functions, as shown in Table 1.
Table 1.
Descriptions of the 23 standard benchmark functions.
Table 2 shows the experimental results of HHO, HSHHO, and these function variants, with the optimal values displayed in bold. Figure 5 shows the convergence curves of these algorithms. Overall, the ARV in Table 2 indicates that in most tests, HSHHO and its variants perform better than HHO. This confirms the effectiveness of SPM-VLS, nonlinear escape energy, and Cauchy–Gaussian perturbation strategies in improving the quality of HHO solutions.
Table 2.
Experimental results.
Figure 5.
Convergence curves on 23 classical benchmark functions.
The Wilcoxon rank sum test in Table 3 shows significant differences between HSHHO1 and HHO in most functions. HSHHO2 performs well on eight functions, but performs poorly on F5–F8, F12–F14, and F23. This indicates that nonlinear escape energy faces difficulties in maintaining phase balance in unimodal and multimodal scenarios. However, the p-values in Table 3 indicate that all optimization strategies except F14 can improve the performance of HHO. Meanwhile, HSHHO3 ensures an optimal solution for all problems except F5, emphasizing the promoting effect of the perturbation strategy on local refinement. The p-value indicates that all functions except F6 and F12 show significance.
Table 3.
The p-values of the Wilcoxon rank-sum test with 5% significance of experimental results.
3.2. Comparison Between HSHHO and Other Optimization Algorithms
This section evaluates the performance comparison between HSHHO and eight popular optimization algorithms based on 30 benchmark functions of CEC 2017. Table 4 shows the description of the CEC 2017. Especially, the F2 of the CEC 2017 test function has been officially proven to have issues. However, in order to maintain the integrity and continuity of the testing, F2 is retained but not used in the experiment in this study.
Table 4.
Description of the CEC 2017 benchmark function.
Eight popular optimization algorithms include WOA, SSA, MFO, GOA, SCA, PSO, and GWO. Table 5 reports the AVG and STD metrics, with the best performers highlighted in bold. To emphasize performance differences, we applied the non-parametric Wilcoxon rank sum test, with p-values detailed in Table 6.
Table 5.
Experimental results on CEC 2017.
Table 6.
The p-values of the Wilcoxon rank-sum test.
The unimodal benchmark has a single global optimum, making it an ideal choice for convergence speed and accuracy. According to Table 4, F1–F3 belong to this category. As shown in Table 5, HSHHO ensures the lowest AVG and STD. The p-values in Table 6 show significant differences compared to competitors on all unimodal functions. These results highlight HSHHO’s enhanced handling of unimodal challenges, thanks to the robust global exploration of the SPM-VLS strategy during the search phase.
In contrast, multimodal benchmarks contain multiple local optima, which test the algorithm’s ability to avoid getting stuck and optimize locally. The CEC 2017 test ensured comprehensive validation, improving the reliability and breadth of the experiment. Table 5 shows that HSHHO dominates all multimodal functions except for F4 and F7. However, for most functions, HSHHO exhibits significant advantages. This highlights its powerful utilization ability, which is driven by Cauchy–Gaussian elite perturbations and helps escape local minima and broader global pursuits.
To increase rigor, we studied the mixed (F11–F20) and combined (F21–F30) functions of CEC 2017, which are more complex than single or multi peak types. Table 5 confirms the highest AVG and STD of HSHHO on all functions except F17 and F27. On F17 and F27, HSHHO ranks second in value. The p-values in Table 6 confirm that they are significantly better than other algorithms on each mixing and combining function. These results stem from the nonlinear escape energy mechanism, which promotes optimal phase balance in HSHHO and produces excellent performance on complex problems.
In summary, according to the results in Table 5, HSHHO exhibits excellent performance in 26 out of 30 benchmark functions. However, according to the “no free lunch” theorem, it can be observed that HSHHO is not the optimal executor in all cases. For example, it ranks second on functions F4, F7, F17, and F27 or is comparable to GWO and SSA. This indicates that although HSHHO has strong robustness to mixing and combining problems, specific landscape features in certain multimodal functions may still be more effectively navigated through other metaheuristic methods.
The convergence graph in Figure 6, Figure 7 and Figure 8 visually compares HSHHO with different optimization algorithms. Figure 6 depicts the rapid decline and sustained accuracy advantage of HSHHO. Figure 7 shows that HSHHO quickly reaches its optimal value, surpassing other algorithms. Figure 8 highlights the leading speed of HSHHO on all functions except F22, ultimately achieving unparalleled accuracy.
Figure 6.
Convergence curves on unimodal benchmark functions.
Figure 7.
Convergence curves on multimodal benchmark functions.
Figure 8.
Convergence curves on hybrid and composition benchmark functions.
In addition, we compare the average time. According to Table 7, PSO and WOA achieved good results on the benchmark test function. Compared with HHO, the average time of HSHHO increased due to the influence of three improvement strategies. However, achieving better computational results at a smaller time cost is often acceptable.
Table 7.
Average running time on CEC 2017.
3.3. HSHHO for Feature Selection
To demonstrate the practical value of HSHHO, we apply it to feature selection tasks spanning datasets with feature counts ranging from a few to several hundred. Its performance is benchmarked against several established metaheuristic algorithms.
3.3.1. Datasets and Parameter Settings
We selected 18 widely used UCI datasets, detailed in Table 8, that have been extensively validated in prior feature selection research, ensuring both reliability and relevance.
Table 8.
Detailed features of the 18 feature selection datasets.
Using the wrapper approach, the optimizer is combined with the classifier to identify the optimal feature subset. In order to evaluate the accuracy of the selected feature subset, a classifier must be used for classification after feature selection. The KNN classifier is a popular classification method in the field of feature selection. The selection of K value and distance measurement in KNN affect the effectiveness of KNN. In this study, the selection of K value refers to the existing literature, with a value of 5 [49]. For each dataset, the samples are divided into 80% training set and 20% testing set, and reliability is improved through 10-fold cross validation. All experiments were repeated 10 times to eliminate the influence of random fluctuations.
For comparative analysis, HSHHO is tested alongside HHO, PSO, GWO, WOA, SSA, and GOA. Common parameters are fixed as follows: population size = 10, maximum iterations = 100, and search dimension equal to the number of features in each dataset. The parameters of each algorithm are summarized in Table 9. All implementations are developed and executed in MATLAB R2022b.
Table 9.
Parameter setting.
3.3.2. Performance Indicators
To evaluate the performance of the HSHHO, three statistical indicators are introduced, including average fitness, average accuracy, and average feature selection size.
- Average fitness (AvgFit): Average value of the fitness obtained.where denotes the best fitness obtained in the -th iteration.
- Average accuracy (AvgAcc): Accuracy of the classifier in selecting the best feature subset.where is the accuracy achieved by the optimal subset in the -th iteration.
- Average number of feature selections (AvgSel): Average value of the ratio of the number of features selected.where the number of features selected in the -th iteration, and is the total number of original features.
- Average run-time (AvgRt): Average value of the algorithm’s run time.where denotes the run time in the -th iteration.
3.3.3. Comparison Results on the 18 Feature Datasets
For average fitness, the results are reported in Table 10. According to Table 10, it can be observed that HSHHO obtains the best value on the 16-feature datasets. Compared to HHO, PSO, GWO and WOA, HSHHO achieves the best results on all datasets. SSA achieves the optimal fitness value on the WaveformEW dataset, while GOA achieves better results on the Vote dataset.
Table 10.
Comparison of the results for average fitness.
For average accuracy, the results are reported in Table 11. It is evident that HSHHO demonstrates superior performance. Compared to SSA, HSHHO also achieves the best results on other datasets except the HeartEW, IonosphereEW, and WaveformEW datasets. For PSO, GWO, and GOA, HSHHO achieves the best results on all datasets. Additionally, SSA ranks second for accuracy.
Table 11.
Comparison results for accuracy.
In terms of the number of selected features, based on the average number of selected features by HSHHO and other optimization algorithms reported in Table 12, it can be observed that, compared to the standard HHO, HSHHO obtains the minimum number of selected features on all 18-feature datasets. Compared to GWO, HSHHO obtains the best feature subset on all datasets except the KrvskpEW dataset. SSA obtains the least number of features on the SonarEW and PenglungEW datasets. The GOA finds the optimal number of selected features on the WaveformEW dataset. In total, HSHHO finds the best feature subsets on 14 datasets (Exactly, Exactly2, Breastcancer, Lymphography, Vote, Zoo, BreastEW, CongressEW, HeartEW, IonosphereEW, WineEW, SpectEW, Tic-tac-toe and PenglungEW), and the number of features obtained on the remaining four datasets ranked second.
Table 12.
Comparison results for number of selected features.
For average accuracy, the results are reported in Table 13. It is evident that HSHHO demonstrates superior performance. Compared to SSA, HSHHO also achieves the best results on other datasets except the HeartEW, IonosphereEW, and WaveformEW datasets. For PSO, GWO, and GOA, HSHHO achieves the best results on all datasets. Additionally, SSA ranks second for accuracy.
Table 13.
Comparison results for average running time.
In addition, Table 13 provides detailed information on the average time. The analysis of experimental results shows that, compared with other algorithms, the proposed method requires the longest time. This is due to the introduction of three improvement strategies, which extend the time required to mine the optimal solution. When used for FS, the number of features is a dimension, and the higher the dimension, the longer the required time. Although PSO and WOA require the shortest time in the dataset, their classification accuracy is not the highest and they cannot minimize the number of features. Therefore, considering other metrics, HSHHO still outperforms other algorithms in terms of FS.
3.3.4. Comprehensive Correlation Analysis
To evaluate whether the improvement of fitness is essentially based on classification performance, a three indicators correlation analysis was conducted on Table 8, Table 9 and Table 10. Firstly, the comparison between fitness and accuracy indicates that the optimization of HSHHO is performance-oriented. In 16 out of 18 datasets, a decrease in fitness values was accompanied by a significant increase in accuracy. It is worth noting that on high-dimensional datasets such as KrvskpEW and PenglingEW, HSHHO achieved excellent accuracy while significantly reducing fitness scores. This confirms that the fitness function effectively captures the algorithm’s ability to enhance discriminative power. Secondly, the relationship between accuracy and feature subset size indicates the efficiency of HSHHO in noise filtering. According to Table 10, HSHHO achieved a smaller feature subset than HHO in all 18 datasets. In most cases, a decrease in the feature count leads to a reverse improvement in accuracy, indicating that the eliminated features are mainly redundant or noisy.
In addition to solving quality, the practical usability of the proposed HSHHO framework should also be evaluated based on computational costs. Since HSHHO incorporates three improvement strategies, its processing naturally requires more time than the original HHO. Therefore, the runtime results should be interpreted in conjunction with accuracy results rather than in isolation.
According to Table 7 and Table 13, we can observe that on the feature selection dataset, the average computation time increased from 597.67 s for HHO to 630.35 s for HSHHO; on the benchmark functions, it rose from 16.54 s for HHO to 22.24 s. Although this indicates an increase in computational cost, HSHHO demonstrates superior algorithmic performance.
These results indicate that the additional runtime of HSHO is associated with improved search quality and stronger convergence behavior, rather than an unnecessary computational burden. In other words, HSHO achieves higher optimization accuracy, enhanced robustness, and more reliable final solutions at the cost of a moderate additional runtime. This trade-off is advantageous in applications where solution quality and stability are more critical than minimal execution time. In summary, the improved HSHHO fitness is a collaborative result of achieving higher classification accuracy with a more concise feature set.
4. Conclusions
In this paper, we introduce an enhanced Harris Hawks Optimization algorithm, named HSHHO, which incorporates the SPM with variable logarithmic spiral, nonlinear escape energy mechanism, and Cauchy–Gaussian elite perturbation. By integrating these enhancements, HSHHO improves initial population diversity, global search efficiency, and local refinement accuracy. To evaluate its effectiveness, we first examined the impact of the three strategies on HHO that use 23 classical benchmark functions, revealing that each contributes meaningfully to overall improvement. Next, IEEE CEC 2017 is used to compare HSHHO with eight well-known algorithms. The results indicate that HSHHO dominates a significant competitive advantage at most benchmark functions. Finally, when applied to 18 feature selection tasks, HSHHO delivered outstanding results, notably reducing feature counts by 70.92% while elevating average classification accuracy to 94.47%.
Although HSHHO has demonstrated strong optimization capabilities, the inherent limitations in hybrid strategies need to be addressed. The integration of SPM chaotic mapping and Cauchy–Gaussian mutation significantly improves the search performance of the algorithm, but also enhances its sensitivity by increasing the initial parameter configuration. Meanwhile, experimental results indicate that HSHHO dominates in most benchmark tests, but its performance in specific functions still needs improvement. In addition, the transition between exploration and mining may still experience local stagnation, indicating that a single nonlinear energy model may not be universally applicable to all complex multimodal problems.
From these insights, several avenues for future exploration have emerged. Firstly, the development phase can be improved by integrating search operators from alternative optimizers. Secondly, its application may be extended to real engineering problems, such as railway emergency scenario prediction, medical big data analysis, intelligent risk assessment, etc. Thirdly, future research will compare HSHHO with the latest feature selection algorithms and continuously optimize algorithm performance. In addition, a notable prospect lies in developing a unified framework to interactively orchestrate multiple metaheuristics and machine learning models, leveraging their collective strengths to tackle daunting real-world challenges and generate higher-quality solutions. On the basis of this project, we will improve the HSHHO algorithm and apply it to key point recognition in typical emergency response scenarios of railways. By identifying the core feature subset in the collaborative emergency process of multiple disciplines, a scientific method is provided for railway emergency response operation standards, and an important role is played in risk warning and emergency plan optimization.
Author Contributions
Conceptualization, G.L. and X.L.; methodology, G.L. and X.L.; software, G.L. and R.Y.; validation, R.Y.; formal analysis, X.L.; writing—original draft preparation, G.L.; writing—review and editing, G.L. and R.Y.; supervision, X.L. All authors have read and agreed to the published version of the manuscript.
Funding
This work was funded by the China State Railway Group Co., Ltd. Science and Technology Research and Development Plan Project, grant number [2025F028]; China Academy of Railway Sciences Research Fund, grant number [2025YJ092].
Data Availability Statement
The original contributions presented in this study are included in the article. Further inquiries can be directed to the corresponding author.
Conflicts of Interest
Author Guanyi Liu was employed by the company China Academy of Railway Sciences Corporation Limited. The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest. The authors declare that this study received funding from China State Railway Group Co., Ltd. The funder was not involved in the study design, collection, analysis, interpretation of data, the writing of this article or the decision to submit it for publication.
References
- Mach-Król, M. On a certain research gap in big data mining for customer insights. Appl. Sci. 2021, 11, 6993. [Google Scholar] [CrossRef] [Scilit]
- Lohrmann, C.; Lohrmann, A.; Kumbure, M.M. On the benefit of feature selection and ensemble feature selection for fuzzy k-nearest neighbor classification. Appl. Soft. Comput. 2025, 171, 112784. [Google Scholar] [CrossRef] [Scilit]
- Keerthana, G.; Annabel, L.S.P. A survey on big data classification. Data Knowl. Eng. 2025, 156, 102408. [Google Scholar] [CrossRef] [Scilit]
- Gurcan, F.; Gudek, B.; Dalveren, G.G.M.; Derawi, M. Future-Ready skills across big data ecosystems: Insights from machine learning-driven human resource analytics. Appl. Sci. 2025, 15, 5841. [Google Scholar] [CrossRef] [Scilit]
- Nogueira, A.R.; Pugnana, A.; Ruggieri, S.; Pedreschi, D.; Gama, J. Methods and tools for causal discovery and causal inference. Wiley Interdiscip. Rev. Data Min. Knowl. Discov. 2022, 12, e1449. [Google Scholar] [CrossRef] [Scilit]
- Zhang, Y.; Liu, R.; Wang, X.; Chen, H.L. Boosted binary Harris hawks optimizer and feature selection. Eng. Comput. 2021, 37, 3741–3770. [Google Scholar] [CrossRef] [Scilit]
- Bharti, K.K.; Singh, P.K. Opposition chaotic fitness mutation based adaptive inertia weight BPSO for feature selection in text clustering. Appl. Soft Comput. 2016, 43, 20–34. [Google Scholar] [CrossRef] [Scilit]
- Yang, X.X.; Liu, J.; Liu, Y.; Xu, P.; Yu, L.; Zhu, L.; Chen, H.Y.; Deng, W. A novel adaptive sparrow search algorithm based on chaotic mapping and T-distribution mutation. Appl. Sci. 2021, 11, 11192. [Google Scholar] [CrossRef] [Scilit]
- Shan, W.F.; He, X.X.; Liu, H.J.; Heidari, A.A.; Wang, M.F.; Cai, Z.N.; Chen, H.L. Cauchy mutation boosted Harris hawk algorithm: Optimal performance design and engineering applications. J. Comput. Des. Eng. 2023, 10, 503–526. [Google Scholar] [CrossRef] [Scilit]
- Gundluru, N.; Rajput, D.S.; Lakshmanna, K.; Kaluri, R.; Shorfuzzaman, M.; Uddin, M.; Khan, M.A.R. Enhancement of Detection of Diabetic Retinopathy Using Harris Hawks Optimization with Deep Learning Model. Comput. Intell. Neurosci. 2022, 2022, 8512469. [Google Scholar] [CrossRef] [Scilit]
- Liu, K.Z.; Dai, Y.Q.; Liu, H. Improvement of Dung Beetle Optimization Algorithm Application to Robot Path Planning. Appl. Sci. 2025, 15, 396. [Google Scholar] [CrossRef] [Scilit]
- Mohamed, B.; Mohaisen, L.; Amin, M. Computing Connected Resolvability of Graphs Using Binary Enhanced Harris Hawks Optimization. Intell. Autom. Soft Comput. 2023, 36, 2349–2361. [Google Scholar] [CrossRef] [Scilit]
- Gupta, A.; Chhikara, R.; Sharma, P. An improved continuous and discrete Harris Hawks optimiser applied to feature selection for image steganalysis. Int. J. Comput. Sci. Eng. 2024, 27, 515–535. [Google Scholar] [CrossRef] [Scilit]
- Özbay, F.A. An enhanced zebra optimization algorithm with multiple strategies for global optimization and feature selection problems: A hepatocellular carcinoma case study. IEEE Access 2025, 13, 30036–30057. [Google Scholar] [CrossRef] [Scilit]
- Li, J.; Sun, K.X. Pressure vessel design problem using improved gray wolf optimizer based on cauchy distribution. Appl. Sci. 2023, 13, 12290. [Google Scholar] [CrossRef] [Scilit]
- Wen, L.; Wang, G.P.; Yue, L.W.; Liang, X.D.; Chen, H.N. Multistrategy Harris Hawks Optimization Algorithm Using Chaotic Method, Cauchy Mutation, and Elite Individual Guidance. Discret. Dyn. Nat. Soc. 2022, 2022, 5129098. [Google Scholar] [CrossRef] [Scilit]
- Sun, Y.S.; Huang, Q.; Liu, T.; Cheng, Y.T.; Li, Y.Q. Multi-strategy enhanced harris hawks optimization for global optimization and deep learning-based channel estimation problems. Mathematics 2023, 11, 390. [Google Scholar] [CrossRef] [Scilit]
- Chen, X.L.; Qin, H.; Liu, S.; Chen, J.W.; Li, Y.X.; Zhu, X. Intelligent Scheduling Method for Cascade Reservoirs Driven by Dual Optimization of Harris Hawks and Marine Predators. Water 2025, 17, 3291. [Google Scholar] [CrossRef] [Scilit]
- Long, W.; Jiao, J.J.; Xu, M.; Tang, M.Z.; Wu, T.B.; Cai, S.H. Lens-imaging learning Harris hawks optimizer for global optimization and its application to feature selection. Expert Syst. Appl. 2022, 204, 117555. [Google Scholar] [CrossRef] [Scilit]
- Saelee, J.; Wetchapram, P.; Wanichsombat, A.; Intarasit, A.; Muangprathub, J.; Boongasame, L.; Choopradit, B. Enhanced Feature Selection via Hierarchical Concept Modeling. Appl. Sci. 2024, 14, 10965. [Google Scholar] [CrossRef] [Scilit]
- Ding, J.Y.; Du, J.C.; Wang, H.J.; Xiao, S. A novel two-stage feature selection method based on random forest and improved genetic algorithm for enhancing classification in machine learning. Sci. Rep. 2025, 15, 16828. [Google Scholar] [CrossRef] [Scilit]
- Zhao, M.; Ye, N. FS-SVM: High-Dimensional Ensemble Learning Classification: An Ensemble Learning Classification Algorithm Based on High-Dimensional Feature Space Reconstruction. Appl. Sci. 2024, 14, 1956. [Google Scholar] [CrossRef] [Scilit]
- Yang, K.K.; Liu, L.; Wen, Y.L. The impact of Bayesian optimization on feature selection. Sci. Rep. 2024, 14, 3948. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Zhang, M.L.; Peña, J.M.; Robles, V. Feature selection for multi-label naive Bayes classification. Inf. Sci. 2009, 179, 3218–3229. [Google Scholar] [CrossRef] [Scilit]
- Gbashi, S.M.; Adedeji, P.A.; Olatunji, O.O.; Madushele, N. Optimal feature selection for a weighted k-nearest neighbors for compound fault classification in wind turbine gearbox. Results Eng. 2025, 25, 103791. [Google Scholar] [CrossRef] [Scilit]
- Nemati, K.; Sheikhani, A.H.R.; Kordrostami, S.; Roudposhti, K.K. New Hybrid Feature Selection Approaches Based on ANN and Novel Sparsity Norm. J. Electr. Comput. Eng. 2024, 2024, 7112770. [Google Scholar] [CrossRef] [Scilit]
- Passemiers, A.; Folco, P.; Raimondi, D.; Birolo, G.; Moreau, Y.; Fariselli, P. A quantitative benchmark of neural network feature selection methods for detecting nonlinear signals. Sci. Rep. 2024, 14, 31180. [Google Scholar] [CrossRef] [Scilit]
- Xiao, J.E.; Hong, M. A Feature Selection Method Based on a Convolutional Neural Network for Text Classification. Electronics 2025, 14, 4615. [Google Scholar] [CrossRef] [Scilit]
- Xu, Y.T.; Chen, H.L.; Heidari, A.A.; Luo, J.; Zhang, Q.; Zhao, X.H.; Li, C.Y. An efficient chaotic mutative moth- flame-inspired optimizer for global optimization tasks. Expert Syst. Appl. 2019, 129, 135–155. [Google Scholar] [CrossRef] [Scilit]
- Emary, E.; Zawbaa, H.M.; Sharawi, M. Impact of Levy flight on modern meta-heuristic optimizers. Appl. Soft. Comput. 2019, 75, 775–789. [Google Scholar] [CrossRef] [Scilit]
- Shen, C.N.; Zhang, K. Two-stage improved grey wolf optimization algorithm for feature selection on high-dimensional classification. Complex Intell. Syst. 2022, 8, 2769–2789. [Google Scholar] [CrossRef] [Scilit]
- Mirjalili, S.; Saremi, S.; Mirjalili, S.M.; Coelho, L.D. Multi-objective grey wolf optimizer: A novel algorithm for multi-criterion optimization. Expert Syst. Appl. 2016, 47, 106–119. [Google Scholar] [CrossRef] [Scilit]
- Adegboye, O.R.; Feda, A.K.; Ojekemi, O.S.; Agyekum, E.B.; Hussien, A.G.; Kamel, S. Chaotic opposition learning with mirror reflection and worst individual disturbance grey wolf optimizer for continuous global numerical optimization. Sci. Rep. 2024, 14, 4660. [Google Scholar] [CrossRef] [Scilit]
- Liu, X.L.; Tian, H.W. A novel hybrid feature selection method combining binary grey wolf optimization and cuckoo search. Sci. Rep. 2025, 15, 45190. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Al-Tashi, Q.; Abdulkadir, S.J.; Rais, H.M.; Mirjalili, S.; Alhussian, H. Binary optimization using hybrid grey wolf optimization for feature selection. IEEE Access 2019, 7, 39496–39508. [Google Scholar] [CrossRef] [Scilit]
- Hassan, B.A. CSCF: A chaotic sine cosine firefly algorithm for practical application problems. Neural Comput. Appl. 2021, 33, 7011–7038. [Google Scholar] [CrossRef] [Scilit]
- Garg, H. A hybrid GSA-GA algorithm for constrained optimization problems. Inf. Sci. 2019, 478, 499–523. [Google Scholar] [CrossRef] [Scilit]
- Li, M.W.; Wang, Y.T.; Geng, J.; Hong, W.C. Chaos cloud quantum bat hybrid optimization algorithm. Nonlinear Dyn. 2021, 103, 1167–1193. [Google Scholar] [CrossRef] [Scilit]
- Ibrahim, R.A.; Abd Elaziz, M.; Oliva, D.; Cuevas, E.; Lu, S.F. An opposition-based social spider optimization for feature selection. Soft. Comput. 2019, 23, 13547–13567. [Google Scholar] [CrossRef] [Scilit]
- Heidari, A.A.; Mirjalili, S.; Faris, H.; Aljarah, I.; Mafarja, M.; Chen, H. Harris hawks optimization: Algorithm and applications. Future Gener. Comput. Syst. 2019, 97, 849–872. [Google Scholar] [CrossRef] [Scilit]
- Jiao, S.B.; Wang, C.; Gao, R.; Li, Y.X.; Zhang, Q. Harris Hawks Optimization with multi-strategy search and application. Symmetry 2021, 13, 2364. [Google Scholar] [CrossRef] [Scilit]
- Long, W.; Jiao, J.J.; Liang, X.M.; Tang, M.Z. An exploration-enhanced grey wolf optimizer to solve high-dimensional numerical optimization. Eng. Appl. Artif. Intell. 2018, 68, 63–80. [Google Scholar] [CrossRef] [Scilit]
- Zhang, Z.R.; Huang, H.Q.; Huang, C.Q.; Han, B. An improved TLBO with logarithmic spiral and triangular mutation for global optimization. Neural Comput. Appl. 2019, 31, 4435–4450. [Google Scholar] [CrossRef] [Scilit]
- Mondal, B.; Singh, S.; Kumar, P. A secure image encryption scheme based on cellular automata and chaotic skew tent map. J. Inf. Secur. Appl. 2019, 45, 117–130. [Google Scholar] [CrossRef] [Scilit]
- Wu, Y.B.; Sun, D.F.; Zhang, M.J.; Zhao, J.Y.; Wu, H.F. Beetle swarm with constrained levy flight for image matching. IEEE Trans. Autom. Sci. Eng. 2025, 22, 3366–3376. [Google Scholar] [CrossRef] [Scilit]
- Almotairi, S.; Alqahtani, A.; Alkhaldi, A.; Alshathri, S.; Alhenawi, E. Three chaotic strategies for enhancing the self-adaptive Harris Hawk optimization algorithm for global optimization. Mathematics 2023, 11, 4181. [Google Scholar] [CrossRef] [Scilit]
- Mirjalili, S.; Gandomi, A.H.; Mirjalili, S.Z.; Saremi, S.; Faris, H.; Mirjalili, S.M. Salp swarm algorithm: A bio-inspired optimizer for engineering design problems. Adv. Eng. Softw. 2017, 114, 163–191. [Google Scholar] [CrossRef] [Scilit]
- Zhu, Y.B.; Li, T.; Lan, X.L. Feature selection optimized by the artificial immune algorithm based on genome shuffling and conditional lethal mutation. Appl. Intell. 2023, 53, 13972–13992. [Google Scholar] [CrossRef] [Scilit]
- Tamara, A.Q.; Mohd, M.N.; Mohammed, A.B.; Ahamad, T.K. Improved gray wolf harris hawk algorithm based feature selection for sentiment analysis. Results Control Optim. 2025, 20, 100604. [Google Scholar] [CrossRef] [Scilit]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.











