HFW-NPO: A Dual a Paradigm Hybrid Filter–Wrapper Nomadic People Optimizer Framework for High-Dimensional Alzheimer’s Gene Expression Classification
Abstract
1. Introduction
2. Materials and Methods
2.1. Dataset Acquisition and Description
2.2. Data Pre-Processing
2.3. Proposed HFW-NPO Algorithm
- Phase 1: Filter-Based Hybrid Multi-Criterion Feature Selection
- Phase 2: NPO-Based Wrapper Optimization
- Phase 3: Ensemble-Based Classification
- Weighted Fisher’s Discriminant Ratio—weights all differences in class distributions among genes according to their separation power.
- Mutual Information (MI)—discovers non-linear associations between gene expression profiles and disease labels.
- Welch’s t-test—detects statistically significant differential expression while accommodating unequal variance between groups.
2.3.1. Phase I: Tri-Criterion Hybrid Filter Feature Selection
Fisher’s Discriminant Ratio
Mutual Information (MI)
Welch’s t-Test Score
Composite Omega Score
2.3.2. Phase II: Adaptive Intra-Fold SMOTE Balancing
2.3.3. Phase III: NPO Wrapper Optimization
Continuous Search Space
Sigmoid Transfer Function (Binarization)
Objective Fitness Function
Fitness Function: Extended Form (Scenarios A/B)
- is the balanced accuracy estimated on the inner cross-validation held-out fold within the current training partition, is the number of genes in the selected subset, and k is the total filtered candidate pool [32].
Adaptive Lévy Scale: Anti-Stagnation Mechanism
2.3.4. Phase IV: Five-Member Soft-Voting Ensemble
2.3.5. Performance Metric: Balanced Accuracy
2.3.6. Future Extension: Focal Loss Weighting
2.4. HFW-NPO Algorithm Implementation
| Algorithm 1: HFW-NPO—Main pipeline (outer five-fold CV loop). |
| 1: Input: X ∈ , labels y, K = five folds, filter size k 2: Output: BalAcc, probe panel, convergence history 3: Preprocess: impute(X), MinMaxScale(X) → X_norm 4: for fold f = 1 to K do 5: (X_tr, y_tr), (X_te, y_te) ← StratifiedSplit(X_norm, y, f) /* Phase 1: filter on training fold only */ 6: I_k ← HybridFilter(X_tr, y_tr, k) // Algorithm 2 7: X_trf ← X_tr[:, I_k] X_tef ← X_te[:, I_k] /* Phase 2: SMOTE on training only */ 8: (X_bal, y_bal) ← AdaptiveSMOTE(X_trf, y_tr) /* Phase 3: NPO wrapper */ 9: (S_best, f_best) ← NPO(X_bal, y_bal, k) // Algorithm 3 10: X_seltr ← X_bal[:, S_best] X_selte ← X_tef[:, S_best] /* Phase 4: ensemble */ 11: M ← SoftVotingEnsemble(X_seltr, y_bal) // Algorithm 5 12: y_hat ← M.predict(X_selte) 13: Record BalAcc(y_te, y_hat), Acc, F1, MCC, Kappa, AUC 14: end for 15: return mean ± std of all metrics, union probe panel |
| Algorithm 2: HybridFilter—Tri-criterion omega-score. |
| 1: Input: X_tr ∈ , y_tr , k (filter size) 2: Output: I_k (indices of top-k genes by ω-score) /*Fisher’s Discriminant Ratio—Equation (1) */ 3: μ1 ← mean(X_tr[y == 1], axis = 0); μ0 ← mean(X_tr[y == 0], axis = 0) 4: σ21 ← var(X_tr[y == 1], axis = 0); σ20 ← var(X_tr[y == 0], axis = 0) 5: F_i ← (μ1i − μ0i)2/(σ21i + σ20i + ε), for i = 1…p /* Mutual Information—Equation (2) */ 6: MI_i ← MutualInfo(X_tr[:,i], y_tr), for i = 1…p /* Welch t-test Score—Equation (3) */ 7: p_i ← WelchTTest(X_tr[y == 1,:], X_tr[y == 0,:]) (two-tailed p-values) 8: W_i ← −log10(clip(p_i, , 1.0)), for i = 1…p /* Independent min–max normalization per criterion */ 9: F^norm ← MinMax(F); MI^norm ← MinMax(MI); W^norm ← MinMax(W) /* Composite omega-score—Equation (4) */ 10: ω_i ← 0.40·F^norm_i + 0.30·MI^norm_i + 0.30·W^norm_i, for i = 1…p /* Top-k selection */ 11: I_k ← argsort(ω, descending = True)[:k] 12: return I_k |
| Algorithm 3: NPO—Wrapper optimization with adaptive Lévy anti-stagnation. |
| 1: Input: X_bal, y_bal, k; N_clans = 5, N_fam = 15, T = 100, P = 8 2: Output: best binary mask S_best, fitness f_best /* Initialize population */ 3: for agent i = 1 to N_clans × N_fam do 4: x_i ← Uniform(−10, 10)^k 5: fitness(x_i) ← FitnessEval(x_i) // see Equation (8) 6: end for 7: (x_global, f_global) ← global elite; stag ← 0 /* Main optimization loop */ 8: for t = 1 to T do 9: α_t ← 0.50 · (1 − t/T); β_t ← 0.80 · (t/T) 10: λ_t ← λ_lb · (1 + (λ_lm/λ_lb − 1) · min(stag/P, 1)) // λ_lb = 0.01, λ_lm = 0.40 11: for each agent i do 12: d_intra ← x_clan-best − x_i; d_global ← x_global − x_i 13: l ← λ_t · LévyStep(k, β = 1.5) // Mantegna [REF] 14: x_new ← clip(x_i + α_t · d_intra + β_t · d_global + l, −10, 10) 15: b_new ← Bernoulli(sigmoid(x_new)) 16: if FitnessEval(b_new) < fitness(x_i) then 17: x_i ← x_new; update clan & global elites 18: end if 19: end for 20: if t mod 5 = 0 then InterClanMigration() end if 21: stag ← (f_global improved) ? 0 : stag + 1 22: if stag ≥ P then 23: Restart worst 20% (50% random; 50% perturbed global-best); stag ← 0 24: end if 25: end for /* Post-NPO Hill Climbing (50 iterations) */ 26: S_best ← deterministic-binarize(x_global) 27: for iter = 1 to 50 do 28: Flip random bit j; accept S’ if FitnessEval(S’) < f_best 29: end for 30: return S_best, f_best |
| Algorithm 4: FitnessEval-Inner-fold fitness evaluation for a candidate binary mask b. |
| 1: Input: b in {0,1}^k (binary selection mask); X_bal, y_bal (SMOTE-balanced training fold, already filtered) 2: Output: scalar fitness value f in [0, 1] /* Select feature columns */ 3: X_sub <- X_bal[:, b == 1] 4: if |{i: b_i = 1}| = 0 then return 1.0 // penalize empty subset /* Inner three-fold stratified cross-validation */ 5: Partition (X_sub, y_bal) into three stratified inner folds 6: BalAcc_inner <- [] 7: for fold j = 1 to 3 do 8: (X_in_tr, y_in_tr), (X_in_val, y_in_val) <- inner split j 9: M_inner <- SoftVotingEnsemble(X_in_tr, y_in_tr) // Algorithm 5 10: y_pred <- M_inner.predict(X_in_val) 11: BalAcc_inner.append(BalAcc(y_in_val, y_pred)) // Equation (12) 12: end for 13: BalAcc_cv <- mean(BalAcc_inner) /* compute fitness (Equation (9)) */ 14: f <- 0.90 × (1 BalAcc_cv) + 0.10 sqrt(|G_sel|/k) 15: return f |
| Algorithm 5: SoftVotingEnsemble—Five-member heterogeneous ensemble. |
| 1: Input: X_tr, y_tr (balanced, selected probes); X_te 2: Output: predicted labels y_hat 3: Train {C_j}_{j = 1…5} on (X_tr, y_tr): 4: C1 ← ExtraTrees(n = 300, class_weight = balanced) 5: C2 ← SVC-RBF(C = 10, kernel = ‘rbf’, class_weight = ‘balanced’, probability = True) 6: C3 ← LogisticRegression(penalty = ‘l2’, C = 1.0,class_weight = ‘balanced’, solver = ‘lbfgs’, max_iter = 500) 7: C4 ← RandomForest(n = 300, max_features = √p, balanced) 8: C5 ← GradientBoosting(n = 200, lr = 0.05, max_depth = 3) 9: P^(x) ← (1/5) · Σ_{j = 1…5} C_j.predict_proba(X_te) 10: y_hat ← argmax(P^, axis = 1) 11: return y_hat |
2.5. Cross-Validation Strategy
Computational Complexity and Runtime Analysis
3. Results and Discussion
3.1. Classification Performance Evaluation of the Proposed HFW-NPO Framework
Scenario B
3.2. Extended Evaluation Metrics Analysis
3.3. Optimization Behavior and Convergence Analysis of NPO
3.4. Ablation Study: Contribution Analysis of HFW-NPO Components
3.5. Statistical Validation Against Baseline Methods
3.6. Biomarker Stability Analysis and Biological Interpretation
3.7. Biological Pathway Enrichment Analysis of HFW-NPO-Selected Biomarkers
3.8. Comparison with Existing Alzheimer’s Disease Classification Methods
3.9. Methodological Originality and Research Contribution
4. Conclusions
Supplementary Materials
Author Contributions
Funding
Data Availability Statement
Acknowledgments
Conflicts of Interest
Abbreviations
| ACC | Accuracy |
| AD | Alzheimer’s Disease |
| APOE | Apolipoprotein E |
| APP | Amyloid Precursor Protein |
| AUC | Area Under the Curve |
| BAOA | Binary Arithmetic Optimization Algorithm |
| BalAcc | Balanced Accuracy |
| BBB | Blood–Brain Barrier |
| BP | Biological Process |
| CNN | Convolutional Neural Network |
| CV | Cross-Validation |
| DNA | Deoxyribonucleic Acid |
| DOR | Diagnostic Odds Ratio |
| EFS | Ensemble Feature Selection |
| ET | Extra Trees |
| F1 | F1 Score (Harmonic Mean of Precision and Recall) |
| FDR | False Discovery Rate |
| FN | False Negative |
| FP | False Positive |
| FWSE | Filter and Wrapper Stacking Ensemble |
| GA | Genetic Algorithm |
| GB | Gradient Boosting |
| GEO | Gene Expression Omnibus |
| GO | Gene Ontology |
| GSE | Gene Series Expression (GEO Dataset Series) |
| HDLSS | High-Dimensional Low-Sample-Size |
| HFW | Hybrid Filter–Wrapper |
| HFW-NPO | Hybrid Filter–Wrapper Nomadic People Optimizer |
| HNC | Head and Neck Cancer |
| KEGG | Kyoto Encyclopedia of Genes and Genomes |
| LASSO | Least Absolute Shrinkage and Selection Operator |
| LR | Logistic Regression |
| MAPK | Mitogen-Activated Protein Kinase |
| MCC | Matthews Correlation Coefficient |
| MCI | Mild Cognitive Impairment |
| MI | Mutual Information |
| MLPC | Multi-Layer Perceptron Classifier |
| MLPNN | Multi-Layer Perceptron Neural Network |
| mRMR | Minimum Redundancy Maximum Relevance |
| NCBI | National Center for Biotechnology Information |
| NIA | National Institute on Aging |
| NPO | Nomadic People Optimizer/Neuro-inspired Population Optimization |
| PI3K | Phosphatidylinositol 3-Kinase |
| PINK | PTEN-Induced Kinase 1 |
| PSO | Particle Swarm Optimization |
| RBF | Radial Basis Function |
| REAC | Reactome |
| RF | Random Forest |
| RNA | Ribonucleic Acid |
| ROC | Receiver Operating Characteristic |
| RSKF | Repeated Stratified K-Fold |
| SASMOTE | Self-Inspected Adaptive SMOTE |
| SMOTE | Synthetic Minority Oversampling Technique |
| SVC | Support Vector Classifier |
| SVM | Support Vector Machine |
| TFAM | Transcription Factor A, Mitochondrial |
| TN | True Negative |
| TP | True Positive |
References
- Karch, C.M.; Cruchaga, C.; Goate, A.M. Alzheimer’s disease genetics: From the bench to the clinic. Neuron 2014, 83, 11–26. [Google Scholar] [CrossRef] [PubMed]
- Mohammed, S.J. A proposed Alzheimer’s disease diagnosing system based on clustering and segmentation techniques. Eng. Technol. 2018, 36, 160–165. [Google Scholar] [CrossRef]
- Gauthier, S.; Cummings, J.; Ballard, C.; Brodaty, H.; Grossberg, G.; Robert, P.; Lyketsos, C. Management of behavioral problems in Alzheimer’s disease. Int. Psychogeriatr. 2010, 22, 346–372. [Google Scholar] [CrossRef] [PubMed]
- Salih, S.Q.; Alsewari, A.M.A. A new algorithm for normal and large-scale optimization problems: Nomadic People Optimizer. Neural Comput. Appl. 2020, 32, 10359–10386. [Google Scholar] [CrossRef]
- Sekaran, K.; Sudha, M. Diagnostic gene biomarker selection for Alzheimer’s classification using machine learning. Int. J. Innov. Technol. Explor. Eng. 2019, 8, 2348–2352. [Google Scholar] [CrossRef]
- Vanitha, C.D.A.; Devaraj, D.; Venkatesulu, M. Gene expression data classification using support vector machine and mutual information-based gene selection. Procedia Comput. Sci. 2015, 47, 13–21. [Google Scholar] [CrossRef]
- Al-Thani, H.F.; Ahmad, M.N.; Younes, S.; Zayed, H. Genetic variants associated with Alzheimer disease in the 22 Arab countries: A systematic review. Alzheimer Dis. Assoc. Disord. 2021, 35, 178–186. [Google Scholar] [PubMed]
- Chethana, H.P.; Hemachandra, G.; Sidhu, A. Biomarkers: Potential Perspectives in Detection, Diagnosis, and Prognosis of Neurodegenerative Disorders. In Functional Foods and Therapeutic Strategies for Neurodegenerative Disorders; Elumalai, P., Lakshmi, S., Eds.; Springer: Singapore, 2022; pp. 203–222. [Google Scholar]
- Koutsodendris, N.; Nelson, M.R.; Rao, A.; Huang, Y. Apolipoprotein E and Alzheimer’s disease: Findings, hypotheses, and potential mechanisms. Annu. Rev. Pathol. 2022, 17, 73–99. [Google Scholar] [PubMed]
- Bhattacharyya, R.; Teves, C.A.F.; Long, A.; Hofert, M.; Tanzi, R.E. The neuronal-specific isoform of BIN1 regulates β-secretase cleavage of APP and Aβ generation in a RIN3-dependent manner. Sci. Rep. 2022, 12, 3486. [Google Scholar] [PubMed]
- Mahto, R.; Ahmed, S.U.; Rahman, R.U.; Aziz, R.M.; Roy, P.; Mallik, S.; Li, A.; Shah, M.A. A novel and innovative cancer classification framework through a consecutive utilization of hybrid feature selection. BMC Bioinform. 2023, 24, 479. [Google Scholar] [CrossRef]
- Joshi, A.M.A.; Aziz, R.M. A two-phase cuckoo search based approach for gene selection and deep learning classification of cancer disease using gene expression data with a novel fitness function. Multimed. Tools Appl. 2024, 83, 71721–71752. [Google Scholar] [CrossRef]
- Petrella, J.R.; Jiang, J.; Sreeram, K.; Dalziel, S.; Doraiswamy, P.; Hao, W.; Alzheimer’s Disease Neuroimaging Initiative. Personalized computational causal modeling of the Alzheimer disease biomarker cascade. J. Prev. Alzheimers Dis. 2024, 11, 435–444. [Google Scholar] [PubMed]
- Yaqoob, A.; Verma, N.K.; Aziz, R.M. Optimizing gene selection and cancer classification with hybrid sine cosine and cuckoo search algorithm. J. Med. Syst. 2024, 48, 10. [Google Scholar] [CrossRef] [PubMed]
- Edgar, R.; Domrachev, M.; Lash, A. Gene Expression Omnibus: NCBI gene expression and hybridization array data repository. Nucleic Acids Res. 2002, 30, 207–210. [Google Scholar] [CrossRef] [PubMed]
- Barrett, T.; Wilhite, S.E.; Ledoux, P.; Evangelista, C.; Kim, I.F.; Tomashevsky, M.; Marshall, K.A.; Phillippy, K.H.; Sherman, P.M.; Holko, M.; et al. NCBI GEO: Archive for functional genomics data sets—Update. Nucleic Acids Res. 2013, 41, D991–D995. [Google Scholar] [CrossRef] [PubMed]
- Clough, E.; Barrett, T.; Wilhite, S.E.; Ledoux, P.; Evangelista, C.; Kim, I.F.; Tomashevsky, M.; Marshall, K.; Phillippy, K.H.; Sherman, P.M.; et al. NCBI GEO: Archive for gene expression and epigenomics data sets: 23-year update. Nucleic Acids Res. 2023, 52, D138–D144. [Google Scholar] [CrossRef] [PubMed]
- Clarke, R.; Ressom, H.; Wang, A.; Xuan, J.; Liu, M.C.; Gehan, E.; Wang, Y. The properties of high-dimensional data spaces: Implications for exploring gene and protein expression data. Nat. Rev. Cancer 2007, 8, 37–49. [Google Scholar] [CrossRef] [PubMed]
- Huang, Y.-N.; Jaiswal, P.; Rajes, A.; Yadav, A.; Yu, D.; Liu, F.; Scheg, G.; Shih, E.; Boldirev, G.; Nakashidze, I.; et al. The systematic assessment of completeness of public metadata accompanying omics studies in the Gene Expression Omnibus data repository. Genome Biol. 2025, 26, 274. [Google Scholar] [CrossRef] [PubMed]
- Hamraz, M.; Khan, Z.; Khan, D.M.; Gul, N.; Ali, A.; Aldahmani, S. Gene selection in binary classification problems within functional genomics experiments via robust Fisher Score. IEEE Access 2022, 10, 51682–51692. [Google Scholar] [CrossRef]
- Pirgazi, J.; Alimoradi, M.; Abharian, T.E.; Olyaee, M. An efficient hybrid filter-wrapper metaheuristic-based gene selection method for high dimensional datasets. Sci. Rep. 2019, 9, 18580. [Google Scholar] [CrossRef] [PubMed]
- Gul, S.; Khan, D.M.; Aldahmani, S.; Khan, Z. Margin weighted robust discriminant score for feature selection in imbalanced gene expression classification. PLoS ONE 2025, 20, e0325147. [Google Scholar] [CrossRef] [PubMed]
- Sarbazi-Azad, S.; Abadeh, M.S.; Abadi, M.I.N. Feature Selection in Microarray Gene Expression Data Using Fisher Discriminant Ratio. In Proceedings of the 2018 8th International Conference on Computer and Knowledge Engineering (ICCKE), Mashhad, Iran, 25–26 October 2018; pp. 225–230. [Google Scholar] [CrossRef]
- Anidha, M.; Premalatha, K. A Hybrid Gene Selection Technique Using Improved Mutual Information and Fisher Score for Cancer Classification Using Microarrays. Int. J. Comput. Electr. Autom. Control Inf. Eng. 2016, 10, 607–610. [Google Scholar]
- Xu, J.; Qu, K.; Qu, K.; Hou, Q.; Meng, X. Feature selection using neighborhood uncertainty measures and Fisher score for gene expression data classification. Int. J. Mach. Learn. Cybern. 2023, 14, 4011–4028. [Google Scholar] [CrossRef]
- Hammami, M.; Bechikh, S.; Hung, C.; Said, L.B. A multi-objective hybrid filter-wrapper evolutionary approach for feature selection. Memet. Comput. 2019, 11, 193–208. [Google Scholar] [CrossRef]
- Li, J.; Luo, T.; Zhang, B.; Chen, M.; Zhou, J. IMOABC: An efficient multi-objective filter-wrapper hybrid approach for high-dimensional feature selection. J. King Saud Univ. Comput. Inf. Sci. 2024, 36, 102205. [Google Scholar] [CrossRef]
- Yuen, K. The two-sample trimmed t for unequal population variances. Biometrika 1974, 61, 165–170. [Google Scholar] [CrossRef]
- Dudoit, S.; Fridlyand, J.; Speed, T.P. Comparison of discrimination methods for the classification of tumors using gene expression data. J. Am. Stat. Assoc. 2002, 97, 77–87. [Google Scholar] [CrossRef]
- Ahmed, S.T.; Kadhem, S. Optimizing Alzheimer’s disease prediction using the nomadic people algorithm. Int. J. Electr. Comput. Eng. 2023, 13, 2052–2067. [Google Scholar] [CrossRef]
- Ghosh, K.; Ahmed, S.; Singh, P.; Geem, Z.; Sarkar, R. Improved Binary Sailfish Optimizer based on adaptive β-Hill Climbing for feature selection. IEEE Access 2020, 8, 83548–83560. [Google Scholar] [CrossRef]
- Khodadadi, N.; Khodadadii, E.; Al-Tashi, Q.; El-Kenawy, E.-S.M.; Abualigah, L.; Abdulkadir, S.; Alqushaibi, A.; Mirjalili, S. BAOA: Binary Arithmetic Optimization Algorithm with K-Nearest Neighbor Classifier for feature selection. IEEE Access 2023, 11, 94094–94115. [Google Scholar] [CrossRef]
- Sun, P.; Zhang, Y.; Liu, J.; Bi, J. An improved Atom Search Optimization with Cellular Automata, a Lévy Flight and an Adaptive Weight Strategy. IEEE Access 2020, 8, 49137–49159. [Google Scholar] [CrossRef]
- Ba, A.F.; Huang, H.; Wang, M.; Ye, X.; Gu, Z.; Chen, H.; Cai, X. Levy-based antlion-inspired optimizers with orthogonal learning scheme. Eng. Comput. 2022, 38, 397–418. [Google Scholar] [CrossRef]
- Thölke, P.; Mantilla-Ramos, Y.-J.; Abdelhedi, H.; Maschke, C.; Dehgan, A.; Harel, Y.; Kemtur, A.; Berrada, L.M.; Sahraoui, M.; Young, T.; et al. Class imbalance should not throw you off balance: Choosing the right classifiers and performance metrics for brain decoding with imbalanced data. bioRxiv 2023. [Google Scholar] [CrossRef]
- Akinola, O.; Ezugwu, A.; Agushaka, J.; Zitar, R.A.; Abualigah, L. Multiclass feature selection with metaheuristic optimization algorithms: A review. Neural Comput. Appl. 2022, 34, 19751–19790. [Google Scholar] [CrossRef] [PubMed]
- Xue, B.; Zhang, M.; Browne, W.N. Particle Swarm Optimization for Feature Selection in Classification: A Multi-Objective Approach. IEEE Trans. Cybern. 2013, 43, 1656–1671. [Google Scholar] [CrossRef] [PubMed]
- Alyasiri, O.M.; Cheah, Y.; Abasi, A.; Al-Janabi, O.M. Wrapper and Hybrid Feature Selection Methods Using Metaheuristic Algorithms for English Text Classification: A Systematic Review. IEEE Access 2022, 10, 39833–39852. [Google Scholar] [CrossRef]
- Agrawal, P.; Abutarboush, H.F.; Ganesh, T.; Mohamed, A.W. Metaheuristic Algorithms on Feature Selection: A Survey of One Decade of Research (2009–2019). IEEE Access 2021, 9, 26766–26791. [Google Scholar] [CrossRef]
- Chawla, N.; Bowyer, K.; Hall, L.; Kegelmeyer, W. SMOTE: Synthetic Minority Over-sampling Technique. J. Artif. Intell. Res. 2002, 16, 321–357. [Google Scholar] [CrossRef]
- Saeys, Y.; Inza, I.; Larrañaga, P. A review of feature selection techniques in bioinformatics. Bioinformatics 2007, 23, 2507–2517. [Google Scholar] [CrossRef] [PubMed]
- Guelib, B.; Rayene, B.; Aliouane, S.E.; Hermessi, H.; Khlifa, N.; Zarour, K. Optimizing gene selection for Alzheimer’s disease classification: A Bayesian approach to filter and embedded techniques. Appl. Soft Comput. 2024, 167, 112307. [Google Scholar] [CrossRef]
- Lazar, C.; Taminau, J.; Meganck, S.; Steenhoff, D.; Coletta, A.; Molter, C.; de Schaetzen, V.; Duque, R.; Bersini, H.; Nowé, A. A Survey on Filter Techniques for Feature Selection in Gene Expression Microarray Analysis. IEEE/ACM Trans. Comput. Biol. Bioinform. 2012, 9, 1106–1119. [Google Scholar] [CrossRef] [PubMed]
- Song, Y.-W.; Wang, J.-S.; Qi, Y.-L.; Wang, Y.-C.; Song, H.; Shang-Guan, Y.-P. Serial filter-wrapper feature selection method with elite guided mutation strategy on cancer gene expression data. Artif. Intell. Rev. 2025, 58, 111. [Google Scholar] [CrossRef]
- Chicco, D.; Jurman, G. The advantages of the Matthews correlation coefficient (MCC) over F1 score and accuracy in binary classification evaluation. BMC Genom. 2020, 21, 6. [Google Scholar] [CrossRef] [PubMed]
- Saito, T.; Rehmsmeier, M. The Precision-Recall Plot Is More Informative than the ROC Plot When Evaluating Binary Classifiers on Imbalanced Datasets. PLoS ONE 2015, 10, e0118432. [Google Scholar] [CrossRef] [PubMed]
- Japkowicz, N.; Stephen, S. The class imbalance problem: A systematic study. Intell. Data Anal. 2002, 6, 429–449. [Google Scholar] [CrossRef]
- Fawcett, T. An introduction to ROC analysis. Pattern Recognit. Lett. 2006, 27, 861–874. [Google Scholar] [CrossRef]
- Chicco, D.; Starovoitov, V.; Jurman, G. The Benefits of the Matthews Correlation Coefficient (MCC) Over the Diagnostic Odds Ratio (DOR) in Binary Classification Assessment. IEEE Access 2021, 9, 47112–47124. [Google Scholar] [CrossRef]
- Chicco, D.; Jurman, G. The Matthews correlation coefficient (MCC) should replace the ROC AUC as the standard metric for assessing binary classification. BioData Min. 2023, 16, 4. [Google Scholar] [CrossRef] [PubMed]
- Kennedy, J.; Eberhart, R. Particle swarm optimization. In Proceedings of the ICNN’95—International Conference on Neural Networks, Perth, WA, Australia, 27 November–1 December 1995; Volume 4, pp. 1942–1948. [Google Scholar] [CrossRef]
- Holland, J. Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence; MIT Press: Cambridge, MA, USA, 1992. [Google Scholar] [CrossRef]
- Gaudreault, J.-G.; Branco, P. Empirical analysis of performance assessment for imbalanced classification. Mach. Learn. 2024, 113, 5533–5575. [Google Scholar] [CrossRef]
- Dökeroğlu, T.; Deniz, A.; Kiziloz, H.E. A comprehensive survey on recent metaheuristics for feature selection. Neurocomputing 2022, 494, 269–296. [Google Scholar] [CrossRef]
- Yang, X.-S. Nature-Inspired Optimization Algorithms: Challenges and Open Problems. J. Comput. Sci. 2020, 46, 101104. [Google Scholar] [CrossRef]
- Pham, T.H.; Raahemi, B. Bio-Inspired Feature Selection Algorithms With Their Applications: A Systematic Literature Review. IEEE Access 2023, 11, 43733–43758. [Google Scholar] [CrossRef]
- Wolpert, D. Stacked generalization. Neural Netw. 1992, 5, 241–259. [Google Scholar] [CrossRef]
- Arora, V.; Agarwal, P. An Empirical Study of Nature-Inspired Algorithms for Feature Selection in Medical Applications. Ann. Data Sci. 2024, 12, 1479–1524. [Google Scholar] [CrossRef]
- Bashir, S.; Khattak, I.; Khan, A.; Khan, F.; Gani, A.; Shiraz, M. A Novel Feature Selection Method for Classification of Medical Data Using Filters, Wrappers, and Embedded Approaches. Complexity 2022, 2022, 8190814. [Google Scholar] [CrossRef]
- Cheng, X. A Comprehensive Study of Feature Selection Techniques in Machine Learning Models. Insights Comput. Signals Syst. 2024, 1, 65–78. [Google Scholar] [CrossRef]
- Chen, C.-W.; Tsai, Y.-H.; Chang, F.; Lin, W. Ensemble feature selection in medical datasets: Combining filter, wrapper, and embedded feature selection results. Expert Syst. 2020, 37, e12553. [Google Scholar] [CrossRef]
- Simon, R. Roadmap for developing and validating therapeutically relevant genomic classifiers. J. Clin. Oncol. 2005, 23, 7332–7341. [Google Scholar] [CrossRef] [PubMed]
- Gong, H.; Li, Y.; Zhang, J.; Zhang, B.; Wang, X. A new filter feature selection algorithm for classification task by ensembling pearson correlation coefficient and mutual information. Eng. Appl. Artif. Intell. 2024, 131, 107865. [Google Scholar] [CrossRef]
- Kotlarz, K.; Słomian, D.; Zawadzka, W.; Szyda, J. Feature Selection Strategies for Deep Learning-Based Classification in Ultra-High-Dimensional Genomic Data. Int. J. Mol. Sci. 2025, 26, 7961. [Google Scholar] [CrossRef] [PubMed]
- Hampel, H.; Frank, R.; Broich, K.; Teipel, S.; Katz, R.; Hardy, J.; Herholz, K.; Bokde, A.L.W.; Jessen, F.; Hoessler, Y.C.; et al. Biomarkers for Alzheimer’s disease: Academic, industry and regulatory perspectives. Nat. Rev. Drug Discov. 2010, 9, 560–574. [Google Scholar] [CrossRef] [PubMed]
- Blalock, E.; Geddes, J.; Chen, K.; Porter, N.; Markesbery, W.; Landfield, P. Incipient Alzheimer’s disease: Microarray correlation analyses reveal major transcriptional and tumor suppressor responses. Proc. Natl. Acad. Sci. USA 2004, 101, 2173–2178. [Google Scholar] [CrossRef] [PubMed]
- Huynh-Thu, V.A.; Sanguinetti, G. Gene Regulatory Network Inference: An Introductory Survey. Methods Mol. Biol. 2019, 1883, 1–23. [Google Scholar] [CrossRef] [PubMed]
- Saeys, Y.; Abeel, T.; Peer, Y. Robust Feature Selection Using Ensemble Feature Selection Techniques. In Proceedings of the European Conference on Machine Learning and Knowledge Discovery in Databases (ECML PKDD 2008), Antwerp, Belgium, 15–19 September 2008; pp. 313–325. [Google Scholar] [CrossRef]
- Le, P.; Gong, X.; Ung, L.; Yang, H.; Keenan, B.P.; Zhang, L.; He, T. A robust ensemble feature selection approach to prioritize genes associated with survival outcome in high-dimensional gene expression data. Front. Syst. Biol. 2024, 4, 1355595. [Google Scholar] [CrossRef] [PubMed]
- Battistella, E.; Ghiassian, S.; Barabási, A. Improving the performance and interpretability on medical datasets using graphical ensemble feature selection. Bioinformatics 2024, 40, btae341. [Google Scholar] [CrossRef] [PubMed]
- Alshamlan, H.; Omar, S.; Aljurayyad, R.; Alabduljabbar, R. Identifying Effective Feature Selection Methods for Alzheimer’s Disease Biomarker Gene Detection Using Machine Learning. Diagnostics 2023, 13, 1771. [Google Scholar] [CrossRef] [PubMed]
- Mahendran, N.; Vincent, P.M.D.R.; Srinivasan, K.; Chang, C.-Y. Improving the Classification of Alzheimer’s Disease Using Hybrid Gene Selection Pipeline and Deep Learning. Front. Genet. 2021, 12, 784814. [Google Scholar] [CrossRef] [PubMed]
- Abdelwahab, M.M.; Al-Karawi, K.A.; Semary, H.E. Deep Learning-Based Prediction of Alzheimer’s Disease Using Microarray Gene Expression Data. Biomedicines 2023, 11, 3304. [Google Scholar] [CrossRef] [PubMed]
- Sun, D.; Peng, H.; Wu, Z. Establishment and Analysis of a Combined Diagnostic Model of Alzheimer’s Disease With Random Forest and Artificial Neural Network. Front. Aging Neurosci. 2022, 14, 921906. [Google Scholar] [CrossRef] [PubMed]
- Pashaei, E.; Pashaei, E.; Aydin, N. Biomarker Identification for Alzheimer’s Disease Using a Multi-Filter Gene Selection Approach. Int. J. Mol. Sci. 2025, 26, 1816. [Google Scholar] [CrossRef] [PubMed]
- Guyon, I.M.; Weston, J.; Barnhill, S.; Vapnik, V. Gene Selection for Cancer Classification using Support Vector Machines. Mach. Learn. 2002, 46, 389–422. [Google Scholar] [CrossRef]
- Zhang, Y.; Deng, Q.; Liang, W.; Zou, X. An Efficient Feature Selection Strategy Based on Multiple Support Vector Machine Technology with Gene Expression Data. BioMed Res. Int. 2018, 2018, 7538204. [Google Scholar] [CrossRef] [PubMed]
- Xue, Y.; Zhu, H.; Liang, J.; Słowik, A. Adaptive crossover operator based multi-objective binary genetic algorithm for feature selection in classification. Knowl. Based Syst. 2021, 227, 107218. [Google Scholar] [CrossRef]
- Ding, J.; Du, J.; Wang, H.; Xiao, S. A novel two-stage feature selection method based on random forest and improved genetic algorithm for enhancing classification in machine learning. Sci. Rep. 2025, 15, 16828. [Google Scholar] [CrossRef] [PubMed]
- Omuya, E.; Okeyo, G.; Kimwele, M.W. Feature Selection for Classification using Principal Component Analysis and Information Gain. Expert Syst. Appl. 2021, 174, 114765. [Google Scholar] [CrossRef]











| Dataset | GEO ID | Tissue Source | Task | N Samples | AD (Class 1) | Control/MCI | Imbalance | Raw Features | Platform |
|---|---|---|---|---|---|---|---|---|---|
| Data 1 | GSE33000 | Brain Cortex | AD vs. Control | 159 | 80 | 79 | 1.01:1 | 16,379 | Illumina HumanHT-12 |
| Data 2 | GSE132903 | Brain Gene Expr. | AD vs. Control | 125 | 65 | 60 | 1.08:1 | 16,379 | Illumina HumanHT-12 |
| Data 3 | GSE122063 | Neurons (iPSC) | AD vs. Control | 108 | 54 | 54 | 1.00:1 | 15,720 | Illumina HumanHT-12 |
| Data 4 | GSE63060 + GSE63061 | Peripheral Blood | AD vs. MCI | 478 | 285 | 193 | 1.48:1 | 16,379 | Illumina HumanHT-12 |
| Dataset | Initial Fitness | Final Fitness | Improvement (%) | vs. PSO (Better %) | vs. GA (Better%) | Avg Genes /Fold | Union Genes | Convergence Speed |
|---|---|---|---|---|---|---|---|---|
| GSE33000 | 0.2106 | 0.1894 | 10.1% | +6.5% | +8.3% | 29.4 | 83 | ~iter 15 |
| GSE132903 | 0.1699 | 0.1482 | 12.8% | +7.5% | +9.9% | 32.4 | 100 | ~iter 20 |
| GSE122063 | 0.1095 | 0.0931 | 14.9% | +11.8% | +13.8% | 29.6 | 98 | ~iter 25 |
| GSE33000—Per-Fold Results. | |||||
| Fold | Accuracy (%) | Bal. Accuracy (%) | Probes Selected | SMOTE | Conv. Fitness |
| Fold 1 | 78.40 | 78.42 | 25 | Yes | 0.1871 |
| Fold 2 | 84.00 | 83.99 | 27 | Yes | 0.1833 |
| Fold 3 | 88.00 | 87.99 | 33 | Yes | 0.1985 |
| Fold 4 | 88.00 | 88.08 | 29 | Yes | 0.1763 |
| Fold 5 | 87.90 | 87.90 | 33 | Yes | 0.2019 |
| Mean ± Std | 85.26 ± 3.76 | 85.28 ± 3.76 | 29.4 avg | — | 0.1894 |
| GSE132903—Per-Fold Results. | |||||
| Fold | Accuracy (%) | Bal. Accuracy (%) | Probes Selected | SMOTE | Conv. Fitness |
| Fold 1 | 89.74 | 89.87 | 27 | Yes | 0.1446 |
| Fold 2 | 89.74 | 89.74 | 31 | Yes | 0.1504 |
| Fold 3 | 89.74 | 89.74 | 34 | Yes | 0.1606 |
| Fold 4 | 82.05 | 82.11 | 38 | Yes | 0.1399 |
| Fold 5 | 84.62 | 84.34 | 32 | Yes | 0.1458 |
| Mean ± Std | 87.18 ± 3.24 | 87.16 ± 3.29 | 32.4 avg | — | 0.1482 |
| GSE122063—Per-Fold Results. | |||||
| Fold | Accuracy (%) | Bal. Accuracy (%) | Probes Selected | SMOTE | Conv. Fitness |
| Fold 1 | 100.00 | 100.00 | 31 | Yes | 0.1065 |
| Fold 2 | 100.00 | 100.00 | 25 | Yes | 0.0871 |
| Fold 3 | 96.30 | 97.22 | 37 | Yes | 0.0934 |
| Fold 4 | 96.30 | 97.22 | 31 | Yes | 0.0898 |
| Fold 5 | 88.89 | 88.89 | 24 | Yes | 0.0887 |
| Mean ± Std | 96.30 ± 4.06 | 96.67 ± 4.08 | 29.6 avg | — | 0.0931 |
| (GSE63060 + GSE63061—10 Repeats, RSKF 5 × 10). | |||||
| Repeat | BalAcc (%) | MCI Recall (%) | Mean Genes | Batch/CV | |
| 1 | 59.98 | 73.64 | 5.26 | Z-score; RSKF | |
| 2 | 58.30 | 57.65 | 5.26 | — | |
| 3 | 62.17 | 67.14 | 5.26 | — | |
| 4 | 59.52 | 61.15 | 5.26 | — | |
| 5 | 59.78 | 66.23 | 5.26 | — | |
| 6 | 59.00 | 63.27 | 5.26 | — | |
| 7 | 59.69 | 58.68 | 5.26 | — | |
| 8 | 59.62 | 58.19 | 5.26 | — | |
| 9 | 57.69 | 61.69 | 5.26 | — | |
| 10 | 59.63 | 67.33 | 5.26 | — | |
| Mean ± Std | 59.53 ± 4.21 | 63.50 ± 14.02 | 5.26 | n = 478; 285 AD; 193 MCI | |
| Dataset | Accuracy (%) | BalAcc (%) | Sensitivity (%) | Specificity (%) | Precision (%) | F1-Score (%) | MCC | Kappa | AUC-ROC |
|---|---|---|---|---|---|---|---|---|---|
| GSE33000 (mean ± std) | 84.4 ± 4.2 | 85.3 ± 3.8 | 86.2 ± 4.8 | 82.5 ± 5.1 | 83.2 ± 4.9 | 84.6 ± 4.5 | 0.690 | 0.688 | 0.863 |
| GSE132903 (mean ± std) | 86.4 ± 4.2 | 86.4 ± 4.2 | 87.1 ± 5.2 | 85.7 ± 4.8 | 86.1 ± 4.6 | 86.5 ± 4.7 | 0.730 | 0.729 | 0.893 |
| GSE122063 (mean ± std) | 96.3 ± 4.1 | 96.7 ± 4.1 | 97.5 ± 5.6 | 97.5 ± 5.6 | 97.5 ± 5.6 | 97.5 ± 5.6 | 0.950 | 0.950 | 0.978 |
| Dataset | Acc (%) | BalAcc (%) | F1-MCI | MCI-Rec | MCC | Kappa | AUC | Genes | CV |
| GSE63060 + 63061 | 58.76 | 59.53 ± 4.21 | 54.92 | 63.50 | 0.195 | 0.183 | 0.5 | 5.26 | RSKF5 × 10 |
| Configuration | Component Removed | GSE33000 BalAcc (%) | GSE132903 BalAcc (%) | GSE122063 BalAcc (%) | Avg ΔBalAcc |
|---|---|---|---|---|---|
| Full HFW-NPO | None (reference) | 85.28 | 87.16 | 96.67 | — |
| Filter-only | NPO Wrapper | 83.68 | 79.86 | 88.42 | −4.7% |
| No-Filter (raw) | Hybrid Filter | 77.58 | 76.36 | 88.89 | −8.8% |
| No-SMOTE | Data Augmentation | 84.08 | 83.96 | 95.68 | −1.6% |
| No-Local Search | Hill Climbing (post) | 84.18 | 85.46 | 95.90 | −1.2% |
| Fisher-only | MI + Welch Criteria | 81.98 | 81.86 | 90.29 | −4.7% |
| MI-only | Fisher + Welch Criteria | 81.68 | 81.55 | 93.50 | −4.3% |
| Welch-only | Fisher + MI Criteria | 80.28 | 83.72 | 93.31 | −4.0% |
| No-Ensemble (SVM) | Voting Ensemble | 81.68 | 82.06 | 92.40 | −4.3% |
| Baseline Method | GSE 33000 d | GSE 33000 p | GSE 132903 d | GSE 132903 p | GSE 122063 d | GSE 122063 p |
|---|---|---|---|---|---|---|
| Filter-only | 1.03 | 0.188 | 3.06 | 0.063 | 2.56 | 0.125 |
| PSO + Ensemble | 0.27 | 0.813 | 0.74 | 0.313 | 1.56 | 0.125 |
| GA + Ensemble | 1.75 | 0.125 | 2.05 | 0.063 | 2.54 | 0.125 |
| RF-baseline | 2.81 | 0.063 | 2.01 | 0.063 | 1.71 | 0.063 |
| LASSO + Ensemble | 0.47 | 0.625 | 1.23 | 0.188 | 0.90 | 0.125 |
| Dataset | Top Stable Gene (≥60%) | Freq. | Second Stable | Freq. | Third Stable | Freq. | Total Stable (≥60%) | Total Notable (≥40%) | Union Size |
|---|---|---|---|---|---|---|---|---|---|
| GSE33000 | ILMN_1689552 | 80% | ILMN_1688033 | 80% | ILMN_1911007 | 80% | 23 | 14 | 83 |
| GSE132903 | ILMN_1873464 | 100% | ILMN_1811921 | 100% | ILMN_2118472 | 80% | 15 | 25 | 100 |
| GSE122063 | 45922 | 100% | 41226 | 60% | 9494 | 60% | 14 | 20 | 98 |
| Reference | Dataset | Classifier | Feature Selection | Acc (%) | AUC | Genes | Year |
|---|---|---|---|---|---|---|---|
| Alshamlan et al. [71] | GSE33000 | SVM | mRMR/F-score | ~84 | N/R | 20–40 | 2023 |
| Mahendran et al. [72] | GSE5281 | SVM + IDBN | mRmR + WPSO + AE | 92.9 | N/R | N/R | 2021 |
| Abdelwahab et al. [73] | GSE122063 | CNN (PCA-CNN) | PCA/SVD | 96.60 | N/R | N/R | 2023 |
| Sun et al. [74] | GSE132903 | Random Forest + ANN | RF feature importance | 91.4 | 0.810 | 6 | 2022 |
| Aerqin et al. [75] | GSE132903 | Logistic Regression | Multi-filter (RF + DISR) | N/R | 0.868 | 50 | 2025 |
| HFW-NPO (propose) | GSE33000 | Soft-voting (ET + SVM + LR + RF) | Fisher + MI + Welch + NPO | 85.26 | 0.863 | 29.4 | 2025 |
| HFW-NPO (propose) | GSE132903 | Soft-voting (ET + SVM + LR + RF) | Fisher + MI + Welch + NPO | 87.18 | 0.924 | 32.4 | 2025 |
| HFW-NPO (propose) | GSE122063 | Soft-voting (ET + SVM + LR + RF) | Fisher + MI + Welch + NPO | 96.30 | 0.978 | 29.6 | 2025 |
| Feature/Criterion | HFW-NPO (This Work) | Filter + SVM (Single Step) | PSO + Ensemble (No Hybrid Filter) | CNN/Deep (No Interpretation.) | LASSO + Ensemble (Linear Only) |
|---|---|---|---|---|---|
| Feature Selection Stage | Hybrid Filter + Wrapper | Filter only | Wrapper only | End-to-end | L1 penalty |
| Filter Criteria | Fisher + MI + Welch (3) | Single criterion | None | None | None |
| Optimizer | NPO + Local Search | Greedy ranking | PSO | Backpropagation | Convex opt. |
| Anti-stagnation Mechanism | Adaptive Lévy + Restart | None | Varies | Dropout | None |
| Ensemble Architecture | Five-member soft-voting | Single SVM | Varies | FC layers | Ensemble |
| SMOTE Strategy | Intra-fold (no leakage) | Often global | Varies | Not needed | Often global |
| Data Leakage Prevention | Full (filter inside CV) | Partial | Partial | Full | Partial |
| Reproducibility | Five-fold × fixed seed 42 | Varies | Varies | Varies | Varies |
| Interpretability | Gene IDs + frequencies | Gene IDs | Gene IDs | None (black box) | Coef. signs |
| Multi-dataset Validation | Four datasets | 1–2 | 1–2 | 1–2 | 1–2 |
| Datasets (brain + blood) | GSE33000 + GSE132903 + GSE122063 + GSE63060 + GSE63061 | Subset | Subset | Subset | Subset |
| Target: AD vs. MCI | GSE63060 + GSE63061 (merged) | Rarely | Rarely | Rarely | Rarely |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Alwhelat, A.M.; Abiyev, R.H. HFW-NPO: A Dual a Paradigm Hybrid Filter–Wrapper Nomadic People Optimizer Framework for High-Dimensional Alzheimer’s Gene Expression Classification. Electronics 2026, 15, 2970. https://doi.org/10.3390/electronics15132970
Alwhelat AM, Abiyev RH. HFW-NPO: A Dual a Paradigm Hybrid Filter–Wrapper Nomadic People Optimizer Framework for High-Dimensional Alzheimer’s Gene Expression Classification. Electronics. 2026; 15(13):2970. https://doi.org/10.3390/electronics15132970
Chicago/Turabian StyleAlwhelat, Almuntadher Mahmood, and Rahib H. Abiyev. 2026. "HFW-NPO: A Dual a Paradigm Hybrid Filter–Wrapper Nomadic People Optimizer Framework for High-Dimensional Alzheimer’s Gene Expression Classification" Electronics 15, no. 13: 2970. https://doi.org/10.3390/electronics15132970
APA StyleAlwhelat, A. M., & Abiyev, R. H. (2026). HFW-NPO: A Dual a Paradigm Hybrid Filter–Wrapper Nomadic People Optimizer Framework for High-Dimensional Alzheimer’s Gene Expression Classification. Electronics, 15(13), 2970. https://doi.org/10.3390/electronics15132970
