A Multi-Atlas Dynamic Connectivity Transformer Fused with 4D Spatiotemporal Modeling for Autism Spectrum Disorder Recognition
Highlights
- A dual-branch framework (MADCT-4D) is proposed to jointly model voxel-wise 4D spatiotemporal dynamics and temporally aligned multi-atlas dynamic functional connectivity for ASD recognition.
- The proposed framework demonstrates consistently superior performance on the ABIDE dataset compared with representative dynamic-connectivity and multi-view baselines.
- Temporally aligned fusion of 4D rs-fMRI representations and multi-atlas dFC provides a robust end-to-end solution for capturing transient brain coupling patterns.
- The framework provides interpretable cross-atlas biomarkers consistent with altered functional coupling in ASD, supporting explainable neuroimaging-based diagnosis.
Abstract
1. Introduction
2. Related Work
3. Materials and Methods
3.1. Overview
3.2. Dataset and Experimental Settings
3.3. rs-fMRI and dFC Representation
3.4. 4D Spatiotemporal Backbone for rs-fMRI
3.5. Multi-Atlas Dynamic Functional Connectivity Modeling
3.6. DFC Transformer Encoder
3.7. Fusion Strategy Between rs-fMRI and dFC Branches
3.8. Confounding Factors and Stratified Subject-Wise Splitting
4. Results
4.1. Comparative Experiments
4.2. Diagnosis Prediction from Site Identity Alone
4.3. Ablation Experiments
4.4. Biomarker
5. Discussion
6. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- Harris, E. Autism prevalence has been on the rise in the US for decades—And that’s progress. JAMA 2023, 329, 1724–1726. [Google Scholar] [CrossRef]
- Shehzad, A.; Yu, S.; Zhang, D.; Abid, S.; Cheng, X.; Zhou, J.; Xia, F. BrainGT: Multifunctional brain graph transformer for brain disorder diagnosis. medRxiv 2024. [Google Scholar] [CrossRef]
- Kachura, A.; Chernyshev, V.; Kachan, O.; Levchenko, E. Blurred magnitude homology of functional connectome for ASD diagnosis. Front. Psychiatry 2025, 16, 1677282. [Google Scholar] [CrossRef]
- Alharthi, A.G.; Alzahrani, S.M. Do it the transformer way: A comprehensive review of brain and vision transformers for autism spectrum disorder diagnosis and classification. Comput. Biol. Med. 2023, 167, 107667. [Google Scholar] [CrossRef] [PubMed]
- Chen, L.; Qiao, C.; Ren, K.; Qu, G.; Calhoun, V.D.; Stephen, J.M.; Wilson, T.W.; Wang, Y.P. Explainable spatio-temporal graph evolution learning with applications to dynamic brain network analysis during development. Neuroimage 2024, 298, 120771. [Google Scholar] [CrossRef]
- Gao, J.; Ge, B.; Qiang, N.; Zhao, S. 3D masked autoencoder with spatiotemporal transformer for modeling of 4D fMRI data. Med. Image Anal. 2025, 107, 103861. [Google Scholar] [CrossRef]
- Luo, Y.; Chen, Q.; Li, F.; Yi, L.; Xu, P.; Zhang, Y. Hierarchical feature extraction on functional brain networks for autism spectrum disorder identification with resting-state fMRI data. Neural Netw. 2025, 188, 107450. [Google Scholar] [CrossRef]
- Leng, Y.; Anwar, S.M.; Rekik, I.; He, S.; Lee, E.J. Self-supervised graph transformer with contrastive learning for brain connectivity analysis towards improving autism detection. In Proceedings of the 2025 IEEE 22nd International Symposium on Biomedical Imaging (ISBI), Houston, TX, USA, 14–17 April 2025; pp. 1–5. [Google Scholar]
- Czekóová, K.; Mareček, R.; Staněk, R.; Hartley, C.; Kessler, K.; Hlavatá, P.; Ošlejšková, H.; Brázdil, M.; Shaw, D.J. Altered patterns of dynamic functional connectivity underpin reduced expressions of social–emotional reciprocity in autistic adults. Autism Res. 2025, 18, 725–740. [Google Scholar] [CrossRef]
- Zhou, Y.; Duan, P.; Du, Y.; Dvornek, N.C. Self-supervised pre-training tasks for an fMRI time-series transformer in autism detection. In Proceedings of the International Workshop on Machine Learning in Clinical Neuroimaging, Marrakesh, Morocco, 10 October 2024; pp. 145–154. [Google Scholar]
- Deepika; Sharma, M.; Arora, S. Multimodality model investigating the impact of brain atlases, connectivity measures, and dimensionality reduction techniques on attention deficit hyperactivity disorder diagnosis using resting state functional connectivity. J. Med. Imaging 2024, 11, 064502. [Google Scholar] [CrossRef]
- Pergantis, P.; Bamicha, V.; Doulou, A.; Christou, A.I.; Bardis, N.; Skianis, C.; Drigas, A. Assistive and Emerging Technologies to Detect and Reduce Neurophysiological Stress and Anxiety in Children and Adolescents with Autism and Sensory Processing Disorders: A Systematic Review. Technologies 2025, 13, 144. [Google Scholar] [CrossRef]
- Zheng, X.; Ravid, O.; Barry, R.A.; Kim, Y.; Wang, Q.; Kim, Y.g.; Zhu, X.; He, X. Denoising VAE as an explainable feature reduction and diagnostic pipeline for autism based on resting state fMRI. arXiv 2024, arXiv:2410.00068. [Google Scholar]
- Liu, M.; Song, Z.; Chen, D.; Wang, X.; Zhuang, Z.; Fei, M.; Zhang, L.; Wang, Q. Affinity learning based brain function representation for disease diagnosis. In Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Marrakesh, Morocco, 6–10 October 2024; pp. 14–23. [Google Scholar]
- Dong, W.; Li, Y.; Zeng, W.; Chen, L.; Yan, H.; Siok, W.T.; Wang, N. STARFormer: A novel spatio-temporal aggregation reorganization transformer of fMRI for brain disorder diagnosis. arXiv 2024, arXiv:2501.00378. [Google Scholar] [CrossRef] [PubMed]
- Li, Z.; Liu, J.; Sun, M.; Zhang, F.; Hu, B.; Dong, Q. Similarity-guided multi-view functional brain network fusion. Med. Image Anal. 2025, 105, 103632. [Google Scholar] [CrossRef] [PubMed]
- Guan, Z.; Yu, J.; Shi, Z.; Liu, X.; Yu, R.; Lai, T.; Yang, C.; Dong, H.; Chen, R.; Wei, L. Dynamic graph transformer network via dual-view connectivity for autism spectrum disorder identification. Comput. Biol. Med. 2024, 174, 108415. [Google Scholar] [CrossRef]
- Park, K.W.; Cho, S.B. A residual graph convolutional network with spatio-temporal features for autism classification from fMRI brain images. Appl. Soft Comput. 2023, 142, 110363. [Google Scholar] [CrossRef]
- Stephens, A.; Santos, F.; Tan, P.N.; Esfahanian, A.H. Population graph cross-network node classification for autism detection across sample groups. In Proceedings of the 2023 IEEE International Conference on Data Mining Workshops (ICDMW), Shanghai, China, 1–4 December 2023; pp. 348–355. [Google Scholar]
- Mahler, L.; Wang, Q.; Steiglechner, J.; Birk, F.; Heczko, S.; Scheffler, K.; Lohmann, G. Pretraining is all you need: A multi-atlas enhanced transformer framework for autism spectrum disorder classification. In Proceedings of the International Workshop on Machine Learning in Clinical Neuroimaging, Vancouver, BC, Canada, 8 October 2023; pp. 123–132. [Google Scholar]
- Qiang, N.; Gao, J.; Dong, Q.; Li, J.; Zhang, S.; Liang, H.; Sun, Y.; Ge, B.; Liu, Z.; Wu, Z.; et al. A deep learning method for autism spectrum disorder identification based on interactions of hierarchical brain networks. Behav. Brain Res. 2023, 452, 114603. [Google Scholar] [CrossRef]
- Alves, C.L.; Toutain, T.G.L.d.O.; Aguiar, P.d.C.; Pineda, A.M.; Roster, K.; Thielemann, C.; Porto, J.A.M.; Rodrigues, F.A. Diagnosis of autism spectrum disorder based on functional brain networks and machine learning. Sci. Rep. 2023, 13, 8072. [Google Scholar] [CrossRef]
- Zhang, J.; Wang, Q.; Wang, X.; Qiao, L. Preserving specificity in federated graph learning for fMRI-based neurological disorder identification. Neural Netw. 2024, 169, 584–596. [Google Scholar] [CrossRef]
- Liu, X.; Hasan, M.R.; Gedeon, T.; Hossain, M.Z. MADE-for-ASD: A multi-atlas deep ensemble network for diagnosing autism spectrum disorder. Comput. Biol. Med. 2024, 182, 109083. [Google Scholar] [CrossRef]
- Wang, P.; Wen, X.; Lei, Y.; Guo, Y.; Li, J.; Hao, Y.; Cao, R.; Gao, C.; Cao, R. MCDGLN: Masked connection-based dynamic graph learning network for autism spectrum disorder. Brain Res. Bull. 2025, 224, 111290. [Google Scholar] [CrossRef]
- Gao, L.; Wang, Z.; Long, Y.; Zhang, X.; Su, H.; Yu, Y.; Hong, J. Autism spectrum disorders detection based on multi-task transformer neural network. BMC Neurosci. 2024, 25, 27. [Google Scholar] [CrossRef]
- Tzourio-Mazoyer, N.; Landeau, B.; Papathanassiou, D.; Crivello, F.; Etard, O.; Delcroix, N.; Mazoyer, B.; Joliot, M. Automated anatomical labeling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI single-subject brain. Neuroimage 2002, 15, 273–289. [Google Scholar] [CrossRef]
- Schaefer, A.; Kong, R.; Gordon, E.M.; Laumann, T.O.; Zuo, X.N.; Holmes, A.J.; Eickhoff, S.B.; Yeo, B.T. Local-global parcellation of the human cerebral cortex from intrinsic functional connectivity MRI. Cereb. Cortex 2018, 28, 3095–3114. [Google Scholar] [CrossRef] [PubMed]
- Yeo, B.T.; Krienen, F.M.; Sepulcre, J.; Sabuncu, M.R.; Lashkari, D.; Hollinshead, M.; Roffman, J.L.; Smoller, J.W.; Zöllei, L.; Polimeni, J.R.; et al. The organization of the human cerebral cortex estimated by intrinsic functional connectivity. J. Neurophysiol. 2011, 106, 1125–1165. [Google Scholar] [CrossRef]
- Dosenbach, N.U.; Nardos, B.; Cohen, A.L.; Fair, D.A.; Power, J.D.; Church, J.A.; Nelson, S.M.; Wig, G.S.; Vogel, A.C.; Lessov-Schlaggar, C.N.; et al. Prediction of individual brain maturity using fMRI. Science 2010, 329, 1358–1361. [Google Scholar] [CrossRef]
- Xia, M.; Wang, J.; He, Y. BrainNet Viewer: A network visualization tool for human brain connectomics. PLoS ONE 2013, 8, e68910. [Google Scholar] [CrossRef]
- Glasser, M.F.; Sotiropoulos, S.N.; Wilson, J.A.; Coalson, T.S.; Fischl, B.; Andersson, J.L.; Xu, J.; Jbabdi, S.; Webster, M.; Polimeni, J.R.; et al. The minimal preprocessing pipelines for the Human Connectome Project. Neuroimage 2013, 80, 105–124. [Google Scholar] [CrossRef]
- Buckner, R.L.; Andrews-Hanna, J.R.; Schacter, D.L. The brain’s default network: Anatomy, function, and relevance to disease. Ann. N. Y. Acad. Sci. 2008, 1124, 1–38. [Google Scholar] [CrossRef]
- Lynch, C.J.; Uddin, L.Q.; Supekar, K.; Khouzam, A.; Phillips, J.; Menon, V. Default mode network in childhood autism: Posteromedial cortex heterogeneity and relationship with social deficits. Biol. Psychiatry 2013, 74, 212–219. [Google Scholar] [CrossRef]
- Zhang, S.; Chen, X.; Shen, X.; Ren, B.; Yu, Z.; Yang, H.; Jiang, X.; Shen, D.; Zhou, Y.; Zhang, X.Y. A-GCL: Adversarial graph contrastive learning for fMRI analysis to diagnose neurodevelopmental disorders. Med. Image Anal. 2023, 90, 102932. [Google Scholar] [CrossRef]
- Wang, W.; Xiao, L.; Qu, G.; Calhoun, V.D.; Wang, Y.P.; Sun, X. Multiview hyperedge-aware hypergraph embedding learning for multisite, multiatlas fMRI based functional connectivity network analysis. Med. Image Anal. 2024, 94, 103144. [Google Scholar] [CrossRef]
- Uddin, L.Q.; Menon, V. The anterior insula in autism: Under-connected and under-examined. Neurosci. Biobehav. Rev. 2009, 33, 1198–1203. [Google Scholar] [CrossRef]
- Odriozola, P.; Uddin, L.Q.; Lynch, C.J.; Kochalka, J.; Chen, T.; Menon, V. Insula response and connectivity during social and non-social attention in children with autism. Soc. Cogn. Affect. Neurosci. 2016, 11, 433–444. [Google Scholar] [CrossRef] [PubMed]
- Zhou, Y.; Shi, L.; Cui, X.; Wang, S.; Luo, X. Functional connectivity of the caudal anterior cingulate cortex is decreased in autism. PLoS ONE 2016, 11, e0151879. [Google Scholar] [CrossRef]
- Weston, C.S. Four social brain regions, their dysfunctions, and sequelae, extensively explain autism spectrum disorder symptomatology. Brain Sci. 2019, 9, 130. [Google Scholar] [CrossRef]
- Floris, D.L.; Llera, A.; Zabihi, M.; Moessnang, C.; Jones, E.J.; Mason, L.; Haartsen, R.; Holz, N.E.; Mei, T.; Elleaume, C.; et al. A multimodal neural signature of face processing in autism within the fusiform gyrus. Nat. Ment. Health 2025, 3, 31–45. [Google Scholar] [CrossRef] [PubMed]
- Cai, J.; Hu, X.; Guo, K.; Yang, P.; Situ, M.; Huang, Y. Increased left inferior temporal gyrus was found in both low function autism and high function autism. Front. Psychiatry 2018, 9, 542. [Google Scholar] [CrossRef]
- Liu, J.; Chen, H.; Wang, H.; Wang, Z. Neural correlates of facial recognition deficits in autism spectrum disorder: A comprehensive review. Front. Psychiatry 2025, 15, 1464142. [Google Scholar] [CrossRef]
- Dalton, K.M.; Nacewicz, B.M.; Johnstone, T.; Schaefer, H.S.; Gernsbacher, M.A.; Goldsmith, H.H.; Alexander, A.L.; Davidson, R.J. Gaze fixation and the neural circuitry of face processing in autism. Nat. Neurosci. 2005, 8, 519–526. [Google Scholar] [CrossRef]
- Tottenham, N.; Hertzig, M.E.; Gillespie-Lynch, K.; Gilhooly, T.; Millner, A.J.; Casey, B. Elevated amygdala response to faces and gaze aversion in autism spectrum disorder. Soc. Cogn. Affect. Neurosci. 2014, 9, 106–117. [Google Scholar] [CrossRef]





| Fold | N | ASD/TC | #Sites | Sex (M/F) | Age (Years) | FIQ n | FIQ | Eye (Open/Closed/NA) |
|---|---|---|---|---|---|---|---|---|
| 1 | 223 | 107/116 | 20 | 194/29 | 17.6 ± 8.5 | 207 | 108 ± 15 | 147/76/0 |
| 2 | 223 | 107/116 | 20 | 190/33 | 16.8 ± 8.5 | 211 | 109 ± 15 | 160/63/0 |
| 3 | 222 | 107/115 | 20 | 183/39 | 17.4 ± 8.4 | 208 | 107 ± 16 | 155/67/0 |
| 4 | 222 | 109/113 | 20 | 187/35 | 16.8 ± 7.2 | 206 | 109 ± 15 | 154/68/0 |
| 5 | 222 | 109/113 | 20 | 194/28 | 16.7 ± 7.6 | 208 | 108 ± 15 | 149/73/0 |
| Method | Acc (%) | Prec (%) | F1 (%) | AUC (%) |
|---|---|---|---|---|
| Dynamic graph transformer [17] | NR | |||
| PC + SR + tHOFC [16] | ||||
| MCDGLN [25] | NR | |||
| MADE-for-ASD [24] | NR | NR | NR | |
| MADCT-4D (ours) |
| Method | ACC (%) | Precision (%) | F1 (%) | AUC (%) |
|---|---|---|---|---|
| MADCT-4D (full) | ||||
| MADCT-4D-A | ||||
| MADCT-4D-B | ||||
| MADCT-4D-C |
| Region | Abbr. |
|---|---|
| Precuneus | PCUN.R |
| Amygdala | AMYG.R |
| Anterior Cingulate Gyrus | ACG.R |
| Fusiform Gyrus | FFG.R |
| Superior Frontal Gyrus, medial | SFGmed.L |
| Insula | INS.R |
| Inferior Temporal Gyrus | ITG.L |
| Superior Temporal Gyrus | STG.L |
| Hippocampus | HIP.R |
| Inferior Frontal Gyrus, triangular part | IFGtriang.L |
| Region | Abbr. |
|---|---|
| Precuneus | precuneus |
| Anterior Cingulate Cortex | ACC |
| Occipital Cortex | occipital |
| Inferior Temporal Cortex | inftemporal |
| Ventromedial Prefrontal Cortex | vmPFC |
| Fusiform Gyrus | fusiform |
| Inferior Cerebellum | infcerebellum |
| Temporal Cortex | temporal |
| Ventral Frontal Cortex | vFC |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Wang, M.; Guo, J.; Guo, X. A Multi-Atlas Dynamic Connectivity Transformer Fused with 4D Spatiotemporal Modeling for Autism Spectrum Disorder Recognition. Brain Sci. 2026, 16, 378. https://doi.org/10.3390/brainsci16040378
Wang M, Guo J, Guo X. A Multi-Atlas Dynamic Connectivity Transformer Fused with 4D Spatiotemporal Modeling for Autism Spectrum Disorder Recognition. Brain Sciences. 2026; 16(4):378. https://doi.org/10.3390/brainsci16040378
Chicago/Turabian StyleWang, Monan, Jiujiang Guo, and Xiaojing Guo. 2026. "A Multi-Atlas Dynamic Connectivity Transformer Fused with 4D Spatiotemporal Modeling for Autism Spectrum Disorder Recognition" Brain Sciences 16, no. 4: 378. https://doi.org/10.3390/brainsci16040378
APA StyleWang, M., Guo, J., & Guo, X. (2026). A Multi-Atlas Dynamic Connectivity Transformer Fused with 4D Spatiotemporal Modeling for Autism Spectrum Disorder Recognition. Brain Sciences, 16(4), 378. https://doi.org/10.3390/brainsci16040378

