FluEvoFormer: A Structure-Guided Generative Foundation Model for Prospective Influenza Antigenic Evolution and Vaccine Strain Selection
Abstract
1. Introduction
- A joint HA–NA sequence and structure representation integrates complementary evolutionary information from both influenza surface proteins.
- A unified forecasting framework combines future dominance predictions, vaccine–virus antigenicity estimation, and pair-specific uncertainty.
- A controlled future-like variant simulator and clade-balanced coverage score assess the candidate robustness under plausible antigenic drift scenarios without reporting generated viral sequences.
- A cutoff-restricted rolling evaluation examines the antigenicity, dominance, vaccine ranking, calibration, interpretability, clinical association, and computational efficiency across target seasons involving the influenza A(H1N1)pdm09 virus and influenza A(H3N2) virus.
2. Materials and Methods
2.1. Study Design and Data Sources
2.2. Data Processing and Biological Labels
2.3. Rolling Retrospective Evaluation
2.4. FluEvoFormer Framework
2.5. Vaccine Candidate Ranking and Evaluation
2.6. Model Training, Implementation, and Statistical Analysis
3. Results
3.1. Dataset Characterization
3.2. Antigenicity Prediction Performance
3.3. Future Dominance Prediction Performance
3.4. Vaccine Candidate Ranking and Coverage Score
3.5. Overall Comparison with Baseline Vaccine Selection Strategies
3.6. Correlation with Vaccine Effectiveness and Disease Burden
3.7. Ablation Study
3.8. Uncertainty and Calibration Analysis
3.9. Generated Future-like Variant Evaluation
3.10. Explainability and Residue-Level Interpretation
3.11. Statistical Significance Analysis
3.12. Computational Efficiency
4. Discussion
5. Limitations, Biosafety, and Ethical Considerations
6. Conclusions
Supplementary Materials
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Jackson, M.L.; Nelson, J.C. The test-negative design for estimating influenza vaccine effectiveness. Vaccine 2013, 31, 2165–2168. [Google Scholar] [CrossRef] [Scilit]
- Trombetta, C.M.; Kistner, O.; Montomoli, E.; Viviani, S.; Marchi, S. Influenza viruses and vaccines: The role of vaccine effectiveness studies for evaluation of the benefits of influenza vaccines. Vaccines 2022, 10, 714. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Han, A.X.; de Jong, S.P.; Russell, C.A. Co-evolution of immunity and seasonal influenza viruses. Nat. Rev. Microbiol. 2023, 21, 805–817. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Smith, D.J.; Lapedes, A.S.; de Jong, J.C.; Bestebroer, T.M.; Rimmelzwaan, G.F.; Osterhaus, A.D.M.E.; Fouchier, R.A.M. Mapping the antigenic and genetic evolution of influenza virus. Science 2004, 305, 371–376. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Gouma, S.; Weirick, M.; Hensley, S.E. Antigenic assessment of the H3N2 component of the 2019–2020 Northern Hemisphere influenza vaccine. Nat. Commun. 2020, 11, 2445. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Tenforde, M.W.; Kondor, R.J.G.; Chung, J.R.; Zimmerman, R.K.; Nowalk, M.P.; Jackson, M.L.; Jackson, L.A.; Monto, A.S.; Martin, E.T.; Belongia, E.A.; et al. Effect of antigenic drift on influenza vaccine effectiveness in the United States–2019–2020. Clin. Infect. Dis. 2021, 73, e4244–e4250. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Gerdil, C. The annual production cycle for influenza vaccine. Vaccine 2003, 21, 1776–1779. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Krammer, F. The human antibody response to influenza A virus infection and vaccination. Nat. Rev. Immunol. 2019, 19, 383–397. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Gamblin, S.J.; Skehel, J.J. Influenza hemagglutinin and neuraminidase membrane glycoproteins. J. Biol. Chem. 2010, 285, 28403–28409. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Matrosovich, M.N.; Matrosovich, T.Y.; Gray, T.; Roberts, N.A.; Klenk, H.D. Neuraminidase is important for the initiation of influenza virus infection in human airway epithelium. J. Virol. 2004, 78, 12665–12667. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Monto, A.S.; Petrie, J.G.; Cross, R.T.; Johnson, E.; Liu, M.; Zhong, W.; Levine, M.; Katz, J.M.; Ohmit, S.E. Antibody to influenza virus neuraminidase: An independent correlate of protection. J. Infect. Dis. 2015, 212, 1191–1199. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Bush, R.M.; Bender, C.A.; Subbarao, K.; Cox, N.J.; Fitch, W.M. Predicting the evolution of human influenza A. Science 1999, 286, 1921–1925. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Luksza, M.; Lassig, M. A predictive fitness model for influenza. Nature 2014, 507, 57–61. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Neher, R.A.; Bedford, T.; Daniels, R.S.; Russell, C.A.; Shraiman, B.I. Prediction, dynamics, and visualization of antigenic phenotypes of seasonal influenza viruses. Proc. Natl. Acad. Sci. USA 2016, 113, E1701–E1709. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Huddleston, J.; Barnes, J.R.; Rowe, T.; Xu, X.; Kondor, R.; Wentworth, D.E.; Whittaker, L.; Ermetal, B.; Daniels, R.S.; McCauley, J.W.; et al. Integrating genotypes and phenotypes improves long-term forecasts of seasonal influenza A/H3N2 evolution. eLife 2020, 9, e60067. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Hie, B.; Zhong, E.D.; Berger, B.; Bryson, B. Learning the language of viral evolution and escape. Science 2021, 371, 284–288. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Rao, R.M.; Liu, J.; Verkuil, R.; Meier, J.; Canny, J.F.; Abbeel, P.; Sercu, T.; Rives, A. MSA Transformer. In Proceedings of the 38th International Conference on Machine Learning, Virtual, 18–24 July 2021; Volume 139, pp. 8844–8856. [Google Scholar]
- Shi, W.; Wohlwend, J.; Wu, M.; Barzilay, R. Influenza vaccine strain selection with an AI-based evolutionary and antigenicity model. Nat. Med. 2025, 31, 3862–3870. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Frazer, J.; Notin, P.; Dias, M.; Gomez, A.; Min, J.K.; Brock, K.; Gal, Y.; Marks, D.S. Disease variant prediction with deep generative models of evolutionary data. Nature 2021, 599, 91–95. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Thadani, N.N.; Gurev, S.; Notin, P.; Youssef, N.; Rollins, N.; Ritter, D.; Sander, C.; Gal, Y.; Marks, D.S. Learning from prepandemic data to forecast viral escape. Nature 2023, 622, 818–825. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Bedford, T.; Suchard, M.A.; Lemey, P.; Dudas, G.; Gregory, V.; Hay, A.J.; McCauley, J.W.; Russell, C.A.; Smith, D.J.; Rambaut, A. Integrating Influenza Antigenic Dynamics with Molecular Evolution. eLife 2014, 3, e01914. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Chen, R.; Holmes, E.C. The Evolutionary Dynamics of Human Influenza B Virus. J. Mol. Evol. 2008, 66, 655–663. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Shu, Y.; McCauley, J. GISAID: Global initiative on sharing all influenza data—From vision to reality. Eurosurveillance 2017, 22, 30494. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Bao, Y.; Bolotov, P.; Dernovoy, D.; Kiryutin, B.; Zaslavsky, L.; Tatusova, T.; Ostell, J.; Lipman, D. The Influenza Virus Resource at the National Center for Biotechnology Information. J. Virol. 2008, 82, 596–601. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- World Health Organization. Manual for the Laboratory Diagnosis and Virological Surveillance of Influenza; World Health Organization: Geneva, Switzerland, 2011. [Google Scholar]
- Worldwide Influenza Centre, The Francis Crick Institute. Worldwide Influenza Centre Annual and Interim Reports, 2026. Available online: https://www.crick.ac.uk/research/worldwide-influenza-centre/ (accessed on 15 June 2026).
- GISAID. Human Influenza Vaccine Composition, 2026. Available online: https://gisaid.org/resources/human-influenza-vaccine-composition/ (accessed on 15 June 2026).
- Centers for Disease Control and Prevention. Seasonal Flu Vaccine Effectiveness Studies, 2026. Available online: https://www.cdc.gov/flu-vaccines-work/php/effectiveness-studies/index.html (accessed on 15 June 2026).
- Centers for Disease Control and Prevention. Flu Burden Prevented by Vaccination, 2026. Available online: https://www.cdc.gov/flu-burden/php/data-vis-vac/index.html (accessed on 15 June 2026).
- Berman, H.M.; Westbrook, J.; Feng, Z.; Gilliland, G.; Bhat, T.N.; Weissig, H.; Shindyalov, I.N.; Bourne, P.E. The Protein Data Bank. Nucleic Acids Res. 2000, 28, 235–242. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Varadi, M.; Anyango, S.; Deshpande, M.; Nair, S.; Natassia, C.; Yordanova, G.; Yuan, D.; Stroe, O.; Wood, G.; Laydon, A.; et al. AlphaFold Protein Structure Database: Massively expanding the structural coverage of protein-sequence space with high-accuracy models. Nucleic Acids Res. 2022, 50, D439–D444. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Hirst, G.K. Studies of antigenic differences among strains of influenza A by means of red cell agglutination. J. Exp. Med. 1943, 78, 407–423. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Paszke, A.; Gross, S.; Massa, F.; Lerer, A.; Bradbury, J.; Chanan, G.; Killeen, T.; Lin, Z.; Gimelshein, N.; Antiga, L.; et al. PyTorch: An Imperative Style, High-Performance Deep Learning Library. In Proceedings of the Advances in Neural Information Processing Systems, Vancouver, BC, Canada, 8–14 December 2019; Volume 32. [Google Scholar]
- Pedregosa, F.; Varoquaux, G.; Gramfort, A.; Michel, V.; Thirion, B.; Grisel, O.; Blondel, M.; Prettenhofer, P.; Weiss, R.; Dubourg, V.; et al. Scikit-learn: Machine Learning in Python. J. Mach. Learn. Res. 2011, 12, 2825–2830. [Google Scholar]
- Chen, T.; Guestrin, C. XGBoost: A Scalable Tree Boosting System. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA, 13–17 August 2016; pp. 785–794. [Google Scholar] [CrossRef] [Scilit]
- Loshchilov, I.; Hutter, F. Decoupled Weight Decay Regularization. In Proceedings of the International Conference on Learning Representations, New Orleans, LA, USA, 6–9 May 2019. [Google Scholar]
- Wilcoxon, F. Individual comparisons by ranking methods. Biom. Bull. 1945, 1, 80–83. [Google Scholar] [CrossRef] [Scilit]
- Benjamini, Y.; Hochberg, Y. Controlling the false discovery rate: A practical and powerful approach to multiple testing. J. R. Stat. Soc. Ser. B 1995, 57, 289–300. [Google Scholar] [CrossRef] [Scilit]
- Schober, P.; Boer, C.; Schwarte, L.A. Correlation coefficients: Appropriate use and interpretation. Anesth. Analg. 2018, 126, 1763–1768. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Olsen, S.J.; Azziz-Baumgartner, E.; Budd, A.P.; Brammer, L.; Sullivan, S.; Pineda, R.F.; Cohen, C.; Fry, A.M. Changes in Influenza and Other Respiratory Virus Activity During the COVID-19 Pandemic—United States, 2020–2021. Morb. Mortal. Wkly. Rep. 2021, 70, 1013–1019. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Li, M.; Liu, M.; Song, S.; Zhao, R.; Xie, Y.; Liu, J.; Xu, L.; Ma, X.; Song, M.; Zhou, J.; et al. Influenza A Neuraminidase-Based Bivalent mRNA Vaccine Induces Th1-Type Immune Response and Provides Protective Effects in Mice. Vaccines 2024, 12, 300. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- World Health Organization. Global Guidance Framework for the Responsible Use of the Life Sciences: Mitigating Biorisks and Governing Dual-Use Research; World Health Organization: Geneva, Switzerland, 2022. [Google Scholar]
- National Science Advisory Board for Biosecurity. Proposed Biosecurity Oversight Framework for the Future of Science; Technical Report; National Institutes of Health, Office of Science Policy: Bethesda, MD, USA, 2023.












| Dataset Group | Source | Main Variables | Use in This Study |
|---|---|---|---|
| Sequence data | GISAID/NCBI Influenza Virus Database [23,24] | HA sequence, NA sequence, strain name, collection date, subtype, region, host, passage history | Dominance prediction, sequence pretraining, clade analysis, HA–NA fusion |
| Antigenicity data | WHO Collaborating Centre HI reports, including Francis Crick WIC reports [18,25,26] | Vaccine strain, virus strain, HI value, assay date | Vaccine–virus antigenicity prediction and empirical coverage estimation |
| Vaccine composition | WHO/GISAID human influenza vaccine-composition records [18,27] | Recommended vaccine strain, season, subtype | Historical comparator and candidate validation |
| Clinical effectiveness | CDC, I-MOVE, SPSN, and published vaccine-effectiveness estimates [18,28,29] | Vaccine effectiveness, subtype, season, disease burden averted | External clinical correlation analysis |
| Protein structure | Protein Data Bank/AlphaFold predicted structure resources [30,31] | 3D coordinates, residue contacts, structural annotations | Structure-guided residue graph learning |
| Data Component | Subtype | Total Processed Records | Training/ Validation Split | Test/Evaluation Design | Seasons Covered | Missing or Excluded Rate | Main Use |
|---|---|---|---|---|---|---|---|
| HA sequences | A/H1N1 | 23,736 non-repeated HA sequences | Cutoff-specific 9:1 split | Rolling winter seasons | 2012–2021 | Seasons with <100 HA samples excluded | Dominance, pretraining |
| NA sequences | A/H1N1 | 18,920 matched NA sequences | Cutoff-specific 9:1 split | Matched rolling subset | 2012–2021 | Missing HA–NA pair excluded | HA–NA fusion |
| HA sequences | A/H3N2 | 28,546 non-repeated HA sequences | Cutoff-specific 9:1 split | Rolling winter seasons | 2012–2021 | Seasons with <100 HA samples excluded | Dominance, pretraining |
| NA sequences | A/H3N2 | 21,860 matched NA sequences | Cutoff-specific 9:1 split | Matched rolling subset | 2012–2021 | Missing HA–NA pair excluded | HA–NA fusion |
| HI pairs | A/H1N1 | 70,631 HA-pair records | 8:1:1 before each cutoff | Held-out HI-pair test set | 2012–2021 | 58,420 HA–NA matched pairs | Antigenicity |
| HI pairs | A/H3N2 | 63,299 HA-pair records | 8:1:1 before each cutoff | Held-out HI-pair test set | 2012–2021 | 51,870 HA–NA matched pairs | Antigenicity |
| Structure graphs | Both | 93,062 sequence-mapped graphs | Template-guided mapping | Residue-level analysis | 2012–2021 | Template coverage not uniform across all residues | Graph learning |
| Model | Subtype | MAE | RMSE | Pearson r | Spearman | Calibration Error | Rank |
|---|---|---|---|---|---|---|---|
| BLOSUM-nearest HI baseline | A/H1N1 | 0.566 | 0.761 | 0.61 | 0.58 | 0.151 | 6 |
| Linear regression + substitutions | A/H1N1 | 0.532 | 0.719 | 0.65 | 0.62 | 0.137 | 5 |
| CNN | A/H1N1 | 0.496 | 0.671 | 0.69 | 0.66 | 0.121 | 4 |
| Transformer | A/H1N1 | 0.444 | 0.608 | 0.74 | 0.71 | 0.101 | 3 |
| HA-only MSA-transformer baseline | A/H1N1 | 0.417 | 0.574 | 0.78 | 0.75 | 0.084 | 2 |
| FluEvoFormer | A/H1N1 | 0.389 | 0.548 | 0.80 | 0.77 | 0.067 | 1 |
| BLOSUM-nearest HI baseline | A/H3N2 | 0.648 | 0.861 | 0.57 | 0.54 | 0.168 | 6 |
| Linear regression + substitutions | A/H3N2 | 0.612 | 0.824 | 0.60 | 0.57 | 0.153 | 5 |
| CNN | A/H3N2 | 0.579 | 0.776 | 0.64 | 0.61 | 0.136 | 4 |
| Transformer | A/H3N2 | 0.517 | 0.704 | 0.69 | 0.66 | 0.116 | 3 |
| HA-only MSA-transformer baseline | A/H3N2 | 0.489 | 0.668 | 0.72 | 0.69 | 0.098 | 2 |
| FluEvoFormer | A/H3N2 | 0.456 | 0.631 | 0.75 | 0.72 | 0.081 | 1 |
| Model | Subtype | KL Divergence | RMSE | Recall@10 | Recall@20 | Spearman | Rank |
|---|---|---|---|---|---|---|---|
| Last-season dominance | A/H1N1 | 0.492 | 0.058 | 0.44 | 0.58 | 0.65 | 5 |
| CSCS-style static score | A/H1N1 | 0.428 | 0.052 | 0.50 | 0.64 | 0.60 | 4 |
| EVEscape-style static score | A/H1N1 | 0.401 | 0.049 | 0.53 | 0.67 | 0.52 | 3 |
| Static protein LM | A/H1N1 | 0.354 | 0.046 | 0.57 | 0.70 | 0.70 | 2 |
| FluEvoFormer | A/H1N1 | 0.255 | 0.036 | 0.69 | 0.81 | 0.79 | 1 |
| Last-season dominance | A/H3N2 | 0.611 | 0.071 | 0.37 | 0.51 | 0.69 | 5 |
| CSCS-style static score | A/H3N2 | 0.542 | 0.065 | 0.43 | 0.57 | 0.67 | 4 |
| EVEscape-style static score | A/H3N2 | 0.501 | 0.061 | 0.47 | 0.61 | 0.61 | 3 |
| Static protein LM | A/H3N2 | 0.462 | 0.057 | 0.50 | 0.64 | 0.71 | 2 |
| FluEvoFormer | A/H3N2 | 0.289 | 0.043 | 0.65 | 0.80 | 0.83 | 1 |
| Season | Subtype | Historical Recommended Strain | FluEvoFormer Top-Ranked Strain | Historical Empirical NCS | Proposed Empirical NCS | Difference | Winner |
|---|---|---|---|---|---|---|---|
| 2012–2013 | A/H1N1 | Rec-H1N1-2012 | FEF-H1N1-2012-A | 0.744 | 0.771 | +0.027 | Proposed |
| 2012–2013 | A/H3N2 | Rec-H3N2-2012 | FEF-H3N2-2012-A | 0.638 | 0.681 | +0.043 | Proposed |
| 2013–2014 | A/H1N1 | Rec-H1N1-2013 | FEF-H1N1-2013-A | 0.701 | 0.729 | +0.028 | Proposed |
| 2013–2014 | A/H3N2 | Rec-H3N2-2013 | FEF-H3N2-2013-A | 0.604 | 0.648 | +0.044 | Proposed |
| 2014–2015 | A/H1N1 | Rec-H1N1-2014 | FEF-H1N1-2014-A | 0.786 | 0.807 | +0.021 | Proposed |
| 2014–2015 | A/H3N2 | Rec-H3N2-2014 | FEF-H3N2-2014-A | 0.582 | 0.638 | +0.056 | Proposed |
| 2015–2016 | A/H1N1 | Rec-H1N1-2015 | FEF-H1N1-2015-A | 0.732 | 0.724 | −0.008 | Historical |
| 2015–2016 | A/H3N2 | Rec-H3N2-2015 | FEF-H3N2-2015-A | 0.647 | 0.693 | +0.046 | Proposed |
| 2016–2017 | A/H1N1 | Rec-H1N1-2016 | FEF-H1N1-2016-A | 0.769 | 0.801 | +0.032 | Proposed |
| 2016–2017 | A/H3N2 | Rec-H3N2-2016 | FEF-H3N2-2016-A | 0.612 | 0.668 | +0.056 | Proposed |
| 2017–2018 | A/H1N1 | Rec-H1N1-2017 | FEF-H1N1-2017-A | 0.821 | 0.816 | −0.005 | Historical |
| 2017–2018 | A/H3N2 | Rec-H3N2-2017 | FEF-H3N2-2017-A | 0.694 | 0.687 | −0.007 | Historical |
| 2018–2019 | A/H1N1 | Rec-H1N1-2018 | FEF-H1N1-2018-A | 0.754 | 0.783 | +0.029 | Proposed |
| 2018–2019 | A/H3N2 | Rec-H3N2-2018 | FEF-H3N2-2018-A | 0.628 | 0.674 | +0.046 | Proposed |
| 2019–2020 | A/H1N1 | Rec-H1N1-2019 | FEF-H1N1-2019-A | 0.793 | 0.787 | −0.006 | Historical |
| 2019–2020 | A/H3N2 | Rec-H3N2-2019 | FEF-H3N2-2019-A | 0.661 | 0.701 | +0.040 | Proposed |
| 2020–2021 | A/H1N1 | Rec-H1N1-2020 | FEF-H1N1-2020-A | 0.682 | 0.739 | +0.057 | Proposed |
| 2020–2021 | A/H3N2 | Rec-H3N2-2020 | FEF-H3N2-2020-A | 0.556 | 0.620 | +0.064 | Proposed |
| 2021–2022 | A/H1N1 | Rec-H1N1-2021 | FEF-H1N1-2021-A | 0.748 | 0.774 | +0.026 | Proposed |
| 2021–2022 | A/H3N2 | Rec-H3N2-2021 | FEF-H3N2-2021-A | 0.617 | 0.659 | +0.042 | Proposed |
| Method | Subtype | Mean Empirical NCS | Median Empirical NCS | Win Rate | Best Tested- Strain Rate | Mean Rank of Selected Strain |
|---|---|---|---|---|---|---|
| Last-season dominance | A/H1N1 | 0.733 | 0.735 | 0.50 | 0.20 | 3.1 |
| Antigenicity-only score | A/H1N1 | 0.754 | 0.759 | 0.60 | 0.40 | 2.6 |
| Dominance + antigenicity score | A/H1N1 | 0.766 | 0.771 | 0.70 | 0.60 | 2.1 |
| FluEvoFormer | A/H1N1 | 0.773 | 0.778 | 0.70 | 0.70 | 1.6 |
| Last-season dominance | A/H3N2 | 0.600 | 0.602 | 0.40 | 0.10 | 3.8 |
| Antigenicity-only score | A/H3N2 | 0.633 | 0.636 | 0.55 | 0.30 | 3.0 |
| Dominance + antigenicity score | A/H3N2 | 0.654 | 0.655 | 0.70 | 0.50 | 2.3 |
| FluEvoFormer | A/H3N2 | 0.667 | 0.671 | 0.90 | 0.60 | 1.7 |
| Outcome | Data Source | Subtype | Pearson r | Spearman | p-Value |
|---|---|---|---|---|---|
| Vaccine effectiveness | CDC | Combined A/H1N1+A/H3N2 | 0.872 | 0.903 | 0.0011 |
| Vaccine effectiveness | I-MOVE | Combined A/H1N1+A/H3N2 | 0.801 | 0.842 | 0.0090 |
| Vaccine effectiveness | SPSN | Combined A/H1N1+A/H3N2 | 0.742 | 0.812 | 0.0180 |
| Averted illnesses | CDC | Combined weighted score | 0.692 | 0.683 | 0.0410 |
| Averted medical visits | CDC | Combined weighted score | 0.704 | 0.697 | 0.0340 |
| Model Variant | HI MAE | Dominance KL | Recall@20 | Mean Empirical NCS | Win Rate | Performance Drop |
|---|---|---|---|---|---|---|
| Full FluEvoFormer | 0.423 | 0.272 | 0.805 | 0.720 | 0.80 | Reference |
| Without NA encoder | 0.438 | 0.288 | 0.786 | 0.710 | 0.75 | −1.4% NCS |
| Without structure graph | 0.447 | 0.291 | 0.779 | 0.708 | 0.75 | −1.7% NCS |
| Without diffusion simulator | 0.429 | 0.305 | 0.753 | 0.703 | 0.70 | −2.4% NCS |
| Without uncertainty penalty | 0.425 | 0.276 | 0.801 | 0.709 | 0.70 | −1.5% NCS |
| Without clade-balanced score | 0.426 | 0.280 | 0.793 | 0.711 | 0.75 | −1.3% NCS |
| HA-only MSA-transformer backbone | 0.453 | 0.319 | 0.741 | 0.695 | 0.70 | −3.5% NCS |
| Sequence-only transformer | 0.462 | 0.336 | 0.722 | 0.687 | 0.65 | −4.6% NCS |
| Model | Subtype | ECE | 95% Coverage | NLL | Risk-Adjusted Win Rate |
|---|---|---|---|---|---|
| Transformer baseline | A/H1N1 | 0.096 | 0.881 | 1.214 | 0.60 |
| FluEvoFormer without uncertainty | A/H1N1 | 0.074 | 0.907 | 1.061 | 0.65 |
| FluEvoFormer | A/H1N1 | 0.061 | 0.939 | 0.902 | 0.70 |
| Transformer baseline | A/H3N2 | 0.111 | 0.856 | 1.382 | 0.55 |
| FluEvoFormer without uncertainty | A/H3N2 | 0.083 | 0.892 | 1.187 | 0.75 |
| FluEvoFormer | A/H3N2 | 0.071 | 0.934 | 1.012 | 0.90 |
| Season | Subtype | Generated Pool Size | Novelty Rate | Clade Consistency | Future-Neighbor Recall | Plausibility Filter Pass Rate | Effect on Predicted NCS |
|---|---|---|---|---|---|---|---|
| 2018–2019 | A/H1N1 | 1500 | 0.31 | 0.88 | 0.63 | 0.95 | +0.010 |
| 2018–2019 | A/H3N2 | 2000 | 0.42 | 0.82 | 0.58 | 0.91 | +0.019 |
| 2019–2020 | A/H1N1 | 1500 | 0.29 | 0.89 | 0.65 | 0.95 | +0.009 |
| 2019–2020 | A/H3N2 | 2000 | 0.44 | 0.80 | 0.57 | 0.90 | +0.022 |
| 2020–2021 | A/H1N1 | 1200 | 0.27 | 0.86 | 0.60 | 0.94 | +0.012 |
| 2020–2021 | A/H3N2 | 1500 | 0.40 | 0.79 | 0.55 | 0.89 | +0.025 |
| 2021–2022 | A/H1N1 | 1400 | 0.30 | 0.88 | 0.62 | 0.94 | +0.011 |
| 2021–2022 | A/H3N2 | 1800 | 0.41 | 0.81 | 0.56 | 0.90 | +0.021 |
| Subtype | Protein | Residue/ Site | Mutation Pattern | Biological/ Structural Context | Attribution Score | Structural Neighborhood | Interpretation |
|---|---|---|---|---|---|---|---|
| A/H1N1 | HA | HA-156/158 | Substitution cluster | HA antigenic head region | 0.82 | Receptor-binding proximal residues | Main contribution to antigenic-distance prediction |
| A/H1N1 | HA | HA-190/193 | Substitution cluster | Receptor-binding and antigenic interface | 0.77 | Head-domain contact pocket | Linked with vaccine–virus match variation |
| A/H1N1 | NA | NA-151/153 | Local substitution signal | NA surface loop | 0.58 | NA head-domain surface contacts | Putative secondary model signal associated with dominance; experimental role not established |
| A/H3N2 | HA | HA-145/159 | Substitution and glycosylation-associated signal | HA antigenic head region | 0.88 | High-contact head-domain neighborhood | Strong model attribution near the HA antigenic head; experimental causality not established |
| A/H3N2 | HA | HA-186/189 | Substitution cluster | Receptor-binding proximal region | 0.83 | Antigenic-site contact shell | Strong influence on pairwise HI prediction |
| A/H3N2 | NA | NA-245/248 | Surface substitution signal | NA functional surface region | 0.61 | NA head-domain neighborhood | Secondary signal for dominance and dual-protein fitness |
| Comparison | Metric | Subtype | Mean Paired Difference | Positive Seasons | Test | Raw p-Value | BH-Adjusted q-Value | Significant |
|---|---|---|---|---|---|---|---|---|
| FluEvoFormer vs. historical recommendation | Empirical NCS | A(H1N1)pdm09 | +0.020 | 7/10 | Exact one-sided Wilcoxon signed-rank test | 0.0137 | 0.0137 | Yes |
| FluEvoFormer vs. historical recommendation | Empirical NCS | A/H3N2 | +0.043 | 9/10 | Exact one-sided Wilcoxon signed-rank test | 0.0020 | 0.0039 | Yes |
| Model | Training Time | Inference Time/Season | GPU Memory | Pairs Screened/Min |
|---|---|---|---|---|
| CNN baseline | 5.8 h | 1.6 min | 9.2 GB | 18,400 |
| Transformer baseline | 16.4 h | 4.1 min | 19.8 GB | 10,600 |
| HA-only MSA-transformer baseline | 24.7 h | 6.9 min | 26.4 GB | 7400 |
| FluEvoFormer | 54.8 h | 8.7 min | 38.6 GB | 5800 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Agarwal, P.; Yogarayan, S.; Sayeed, M.S. FluEvoFormer: A Structure-Guided Generative Foundation Model for Prospective Influenza Antigenic Evolution and Vaccine Strain Selection. Viruses 2026, 18, 843. https://doi.org/10.3390/v18080843
Agarwal P, Yogarayan S, Sayeed MS. FluEvoFormer: A Structure-Guided Generative Foundation Model for Prospective Influenza Antigenic Evolution and Vaccine Strain Selection. Viruses. 2026; 18(8):843. https://doi.org/10.3390/v18080843
Chicago/Turabian StyleAgarwal, Pankaj, Sumendra Yogarayan, and Md. Shohel Sayeed. 2026. "FluEvoFormer: A Structure-Guided Generative Foundation Model for Prospective Influenza Antigenic Evolution and Vaccine Strain Selection" Viruses 18, no. 8: 843. https://doi.org/10.3390/v18080843
APA StyleAgarwal, P., Yogarayan, S., & Sayeed, M. S. (2026). FluEvoFormer: A Structure-Guided Generative Foundation Model for Prospective Influenza Antigenic Evolution and Vaccine Strain Selection. Viruses, 18(8), 843. https://doi.org/10.3390/v18080843

