Physics-Guided Dynamic Sparse Attention Network for Gravitational Wave Detection Across Ground and Space-Based Observatories
Abstract
1. Introduction
1.1. Research Background and Significance
1.2. Review of Existing Methods
1.2.1. Template-Based and Bayesian Methods
1.2.2. Machine Learning Approaches
1.2.3. Hybrid Methods
1.3. Limitations and Challenges
1.4. Research Objectives and Main Contributions
2. Methods
2.1. Overall Architecture Design
2.2. Physics-Inspired Time–Frequency Branch
2.2.1. Differentiable Wavelet Transform Layer
2.2.2. Gravitational Wave Feature Enhancement Module
2.2.3. Physical Feature Projection Layer
2.3. Neural Network Branch
2.3.1. Improved WaveNet Encoder
2.3.2. Dynamic Sparse Transformer
2.4. Gated Cross-Modal Fusion
2.5. Multi-Task Output Modules
2.5.1. Detection Head
2.5.2. Waveform Reconstruction (Extraction) Head
2.6. Multi-Task Loss Function
2.7. Model Training and Optimization
2.8. Key Dimensional Transformations and Temporal Processing Flow
3. Experimental Design
3.1. Datasets and Evaluation Protocol
3.1.1. Dataset Details
- EMRI (Extreme-Mass-Ratio Inspiral): Produced by a low-mass compact object inspiraling into a massive black hole. Waveforms are generated using the AAK (Augmented Analytic Kludge) model [33], with parameter ranges including central black hole mass , spin , eccentricity , and inclination .
- MBHB (Massive Black Hole Binary): Produced by the coalescence of two massive black holes during galaxy mergers. Waveforms are generated using the SEOBNRv4 model [34], with parameter ranges including total mass (log-uniform), mass ratio , and spins .
- BWD (Binary White Dwarfs): The most common compact binaries in the Milky Way, producing quasi-monochromatic signals. Waveforms are generated following the procedure described in [13].
- SGWB (Stochastic Gravitational Wave Background): A random signal formed by the superposition of numerous unresolved sources. We adopt a power-law spectrum modelwhere corresponds to a background generated by compact binary coalescences, Hz is the reference frequency, and the amplitude parameter is set to , , and for testing [13].
3.1.2. Evaluation Metrics
3.1.3. Experimental Environment
3.2. Experimental Settings and Implementation Details
3.2.1. Model Configuration
3.2.2. Training Strategy
3.3. Baseline Methods for Comparison
4. Model Complexity and Performance Analysis
4.1. Computational Complexity Analysis
4.1.1. Time Complexity
4.1.2. Space Complexity
4.1.3. Model Size
4.2. Effectiveness Analysis of the Model Design
4.2.1. Role of the Physics-Inspired Time–Frequency Branch
4.2.2. Representational Capacity of Sparse Attention
4.2.3. Adaptivity and Synergistic Gains from the Gated Fusion Mechanism
5. Results and Discussion
5.1. Main Performance Comparisons
5.1.1. Ground-Based Gravitational Wave Detection Performance (G2Net)
5.1.2. Validation on Real Events from GWOSC O3
5.1.3. Space-Based Gravitational Wave Detection Performance (LISA)
5.1.4. Space-Based Waveform Reconstruction Performance
5.2. Ablation Results
5.2.1. Contributions of Major Components
5.2.2. Fine-Grained Ablation Analysis
5.3. Noise Robustness Analysis
5.4. Visualization Analysis and Interpretation
5.4.1. An Interpretability Example for MBHB Signals
5.4.2. Analysis of the Gating Coefficient
5.4.3. Analysis of Learnable Wavelet Parameters
5.5. Discussion
6. Conclusions
Author Contributions
Funding
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Abbott, B.P.; Abbott, R.; Abbott, T.D.; Abernathy, M.R.; Acernese, F.; Ackley, K.; Adams, C.; Adams, T.; Addesso, P.; LIGO Scientific Collaboration and Virgo Collaboration; et al. Observation of Gravitational Waves from a Binary Black Hole Merger. Phys. Rev. Lett. 2016, 116, 061102. [Google Scholar] [CrossRef] [PubMed]
- Abbott, R.; Abbott, T.; Acernese, F.; Ackley, K.; Adams, C.; Adhikari, N.; Adhikari, R.; Adya, V.; Affeldt, C.; LIGO Scientific Collaboration and Virgo Collaboration; et al. GWTC-3: Compact Binary Coalescences Observed by LIGO and Virgo During the Second Part of the Third Observing Run. Phys. Rev. X 2023, 13, 041039. [Google Scholar] [CrossRef]
- Abbott, R.; Abe, H.; Acernese, F.; Ackley, K.; Adhicary, S.; Adhikari, N.; Adhikari, R.X.; Adkins, V.K.; Adya, V.B.; Affeldt, C.; et al. Open Data from the Third Observing Run of LIGO, Virgo, KAGRA, and GEO. Astrophys. J. Suppl. Ser. 2023, 267, 29. [Google Scholar] [CrossRef]
- Abbott, B.P.; Abbott, R.; Abbott, T.D.; Abraham, S.; Acernese, F.; Ackley, K.; Adams, C.; Adya, V.B.; Affeldt, C.; Agathos, M.; et al. Prospects for Observing and Localizing Gravitational-Wave Transients with Advanced LIGO, Advanced Virgo and KAGRA. Living Rev. Relativ. 2020, 23, 3. [Google Scholar] [CrossRef] [PubMed]
- Luo, Z.; Wang, Y.; Wu, Y.; Hu, W.; Jin, G. The Taiji Program: A Concise Overview. Prog. Theor. Exp. Phys. 2021, 2021, 05A108. [Google Scholar] [CrossRef]
- Amaro-Seoane, P.; Audley, H.; Babak, S.; Baker, J.; Barausse, E.; Bender, P.; Berti, E.; Binetruy, P.; Born, M.; Bortoluzzi, D.; et al. Laser Interferometer Space Antenna. arXiv 2017, arXiv:1702.00786. [Google Scholar] [CrossRef]
- Robson, T.; Cornish, N.J.; Liu, C. The Construction and Use of LISA Sensitivity Curves. Class. Quantum Gravity 2019, 36, 105011. [Google Scholar] [CrossRef]
- Schutz, B.F. Gravitational Wave Sources and Their Detectability. Class. Quantum Gravity 1989, 6, 1761–1780. [Google Scholar] [CrossRef]
- Benedetto, V.; Berberi, L.; Capozziello, S.; Feoli, A. AI in Gravitational Wave Analysis: An Overview. Appl. Sci. 2023, 13, 9886. [Google Scholar] [CrossRef]
- Usman, S.A.; Nitz, A.H.; Harry, I.W.; Biwer, C.M.; Brown, D.A.; Cabero, M.; Capano, C.D.; Canton, T.D.; Dent, T.; Fairhurst, S.; et al. The PyCBC Search for Gravitational Waves from Compact Binary Coalescence. Class. Quantum Gravity 2016, 33, 215004. [Google Scholar] [CrossRef]
- Sachdev, S.; Caudill, S.; Fong, H.; Lo, R.K.L.; Messick, C.; Mukherjee, D.; Magee, R.; Tsukada, L.; Blackburn, K.; Brady, P.; et al. The GstLAL Search Analysis Methods for Compact Binary Mergers in Advanced LIGO’s Second and Advanced Virgo’s First Observing Runs. arXiv 2019, arXiv:1901.08580. [Google Scholar] [CrossRef]
- Klimenko, S.; Yakushin, I.; Mercer, A.; Mitselmakher, G. A Coherent Method for Detection of Gravitational Wave Bursts. Class. Quantum Gravity 2008, 25, 114029. [Google Scholar] [CrossRef]
- Zhao, T.; Lyu, R.; Wang, H.; Cao, Z.; Ren, Z. Space-Based Gravitational Wave Signal Detection and Extraction with Deep Neural Network. Commun. Phys. 2023, 6, 212. [Google Scholar] [CrossRef]
- Sathyaprakash, B.S.; Schutz, B.F. Physics, Astrophysics and Cosmology with Gravitational Waves. Living Rev. Relativ. 2009, 12, 2. [Google Scholar] [CrossRef]
- Cornish, N.J.; Littenberg, T.B. BayesWave: Bayesian Inference for Gravitational Wave Bursts and Instrument Glitches. Class. Quantum Gravity 2015, 32, 135012. [Google Scholar] [CrossRef]
- George, D.; Huerta, E.A. Deep Learning for Real-Time Gravitational Wave Detection and Parameter Estimation: Results with Advanced LIGO Data. Phys. Lett. B 2018, 778, 64–70. [Google Scholar] [CrossRef]
- Gebhard, T.D.; Kilbertus, N.; Harry, I.; Schölkopf, B. Convolutional Neural Networks: A Magic Bullet for Gravitational-Wave Detection? Phys. Rev. D 2019, 100, 063015. [Google Scholar] [CrossRef]
- Lin, Y.-C.; Wu, J.-H.P. Detection of Gravitational Waves Using Bayesian Neural Networks. Phys. Rev. D 2021, 103, 063034. [Google Scholar] [CrossRef]
- Poghosyan, R.; Luo, Y. Random Convolutional Kernels for Space-Detector Based Gravitational Wave Signals. Electronics 2023, 12, 4360. [Google Scholar] [CrossRef]
- Wang, H.; Zhou, Y.; Cao, Z.; Guo, Z.-K.; Ren, Z. WaveFormer: Transformer-Based Denoising Method for Gravitational-Wave Data. Mach. Learn. Sci. Technol. 2024, 5, 015046. [Google Scholar] [CrossRef]
- Shi, R.; Zhou, Y.; Zhao, T.; Cao, Z.; Ren, Z. Compact Binary Systems Waveform Generation with Generative Pre-trained Transformer. arXiv 2023, arXiv:2310.20172. [Google Scholar] [CrossRef]
- Legin, R.; Isi, M.; Wong, K.W.K.; Hezaveh, Y.; Perreault-Levasseur, L. Gravitational-Wave Parameter Estimation in Non-Gaussian Noise Using Score-Based Likelihood Characterization. arXiv 2024, arXiv:2410.19956. [Google Scholar] [CrossRef]
- Rhif, M.; Ben Abbes, A.; Farah, I.R.; Martínez, B.; Sang, Y. Wavelet Transform Application for/in Non-Stationary Time-Series Analysis: A Review. Appl. Sci. 2019, 9, 1345. [Google Scholar] [CrossRef]
- Kang, S.-K.; Yie, S.-Y.; Lee, J.-S. Noise2Noise Improved by Trainable Wavelet Coefficients for PET Denoising. Electronics 2021, 10, 1529. [Google Scholar] [CrossRef]
- Cuoco, E.; Powell, J.; Cavaglià, M.; Ackley, K.; Bejger, M.; Chatterjee, C.; Coughlin, M.; Coughlin, S.; Easter, P.; Essick, R.; et al. Enhancing Gravitational-Wave Science with Machine Learning. Mach. Learn. Sci. Technol. 2021, 2, 011002. [Google Scholar] [CrossRef]
- Scorzato, L. Reliability and Interpretability in Science and Deep Learning. Minds Mach. 2024, 34, 27. [Google Scholar] [CrossRef]
- Tay, Y.; Dehghani, M.; Bahri, D.; Metzler, D. Efficient Transformers: A Survey. ACM Comput. Surv. 2022, 55, 109. [Google Scholar] [CrossRef]
- Vaswani, A.; Shazeer, N.; Parmar, N.; Uszkoreit, J.; Jones, L.; Gomez, A.N.; Kaiser, Ł.; Polosukhin, I. Attention Is All You Need. In Proceedings of the Advances in Neural Information Processing Systems 30 (NeurIPS 2017), Long Beach, CA, USA, 4–9 December 2017; pp. 5998–6008. [Google Scholar] [CrossRef]
- Van Den Oord, A.; Dieleman, S.; Zen, H.; Simonyan, K.; Vinyals, O.; Graves, A.; Kalchbrenner, N.; Senior, A.; Kavukcuoglu, K. WaveNet: A Generative Model for Raw Audio. arXiv 2016, arXiv:1609.03499. [Google Scholar] [CrossRef]
- Zhang, Y.; Liu, B.; Yang, Y.; Yang, Q. Gated Cross-Attention for Universal Speaker Extraction: Toward Real-World Applications. Electronics 2024, 13, 2046. [Google Scholar] [CrossRef]
- G2Net Gravitational Wave Detection Challenge. Kaggle Competition. Available online: https://www.kaggle.com/competitions/g2net-gravitational-wave-detection (accessed on 1 February 2026).
- Macleod, D.M.; Areeda, J.S.; Coughlin, S.B.; Massinger, T.J.; Urban, A.L. GWpy: A Python Package for Gravitational-Wave Astrophysics. SoftwareX 2021, 13, 100657. [Google Scholar] [CrossRef]
- Katz, M.L.; Chua, A.J.; Speri, L.; Warburton, N.; Hughes, S.A. Fast Extreme-Mass-Ratio-Inspiral Waveforms: New Tools for Millihertz Gravitational-Wave Data Analysis. Phys. Rev. D 2021, 104, 064047. [Google Scholar] [CrossRef]
- Bohé, A.; Shao, L.; Taracchini, A.; Buonanno, A.; Babak, S.; Harry, I.W.; Hinder, I.; Ossokine, S.; Pürrer, M.; Raymond, V.; et al. Improved Effective-One-Body Model of Spinning, Nonprecessing Binary Black Holes for the Era of Gravitational-Wave Astrophysics with Advanced Detectors. Phys. Rev. D 2017, 95, 044028. [Google Scholar] [CrossRef]
- He, K.; Zhang, X.; Ren, S.; Sun, J. Deep Residual Learning for Image Recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA, 27–30 June 2016; IEEE: New York, NY, USA, 2016; pp. 770–778. [Google Scholar] [CrossRef]









| Method | Algorithms | Tasks | Advantages | Limitations |
|---|---|---|---|---|
| Template matching | PyCBC/GstLAL | Detection + param. est. | Theoretically optimal, high sensitivity | High cost, template dependence |
| Bayesian | BayesWave/cWB | Detection + reconstruction | Template-free, flexible | Expensive, short signals |
| CNN-based | ResNet/Inception | Detection | Mature, low cost | Limited interpretability |
| Transformer | Zhao et al. [13] | Detection + reconstruction | Long-range modeling | complexity |
| Generative | WaveNet/cVAE | Extraction | High-quality reconstruction | Not jointly optimized |
| Physics hybrid | Wavelet + CNN | Detection | Time–freq priors | Simple fusion |
| This work | PGDSA | Detection + reconstr. | Physics-guided, multi-task, unified | – |
| Sequence Length | Normalized Time (Standard = 1) |
|---|---|
| 1024 | 0.34 |
| 2048 | 0.23 |
| 4096 | 0.15 |
| 8192 | 0.11 |
| Model | AUC |
|---|---|
| ResNet-50 [35] | 0.880 |
| Transformer [28] | 0.880 |
| CNN + wavelet [25] | 0.870 |
| PGDSA (ours) | 0.886 |
| Event | Network SNR | Detection Score | Event Characteristics |
|---|---|---|---|
| GW190412 | 19.1 | 0.987 | Asymmetric mass ratio |
| GW190521 | 14.7 | 0.952 | Intermediate-mass BH component |
| GW190828_063405 | 16.3 | 0.971 | Typical BBH |
| GW191109_010717 | 15.6 | 0.963 | Typical BBH |
| Signal Type | Method | SNR = 30 | SNR = 40 | SNR = 50 |
|---|---|---|---|---|
| EMRI | Baseline | 98.20% | 99.70% | 99.71% |
| PGDSA (Ours) | 98.56% | 99.78% | 99.82% | |
| MBHB | Baseline | 99.99% | 99.999% | 99.999% |
| PGDSA (Ours) | 99.996% | 99.999% | 99.999% | |
| BWD | Baseline | 99.37% | 99.97% | 99.98% |
| PGDSA (Ours) | 99.52% | 99.98% | 99.99% | |
| SGWB * | Baseline | 95.05% | 99.97% | 100.00% |
| PGDSA (Ours) | 95.89% | 99.98% | 100.00% |
| Signal Type | Method | Samples with Overlap > 0.95 | Typical Overlap |
|---|---|---|---|
| EMRI | Baseline | 92% | ∼0.96 |
| PGDSA (Ours) | 93% | ∼0.96 | |
| MBHB | Baseline | 100% | >0.99 |
| PGDSA (Ours) | 100% | >0.99 | |
| BWD | Baseline | 95% | ∼0.98 |
| PGDSA (Ours) | 95% | ∼0.98 |
| Model ID | Physics Module | Sparse Attention | Gated Fusion | AUC |
|---|---|---|---|---|
| M1 | ✓ | × | × | 0.862 |
| M2 | × | ✓ | × | 0.871 |
| M3 | ✓ | ✓ | × | 0.874 |
| M4 | ✓ | ✓ | ✓ | 0.886 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Zhang, T.; Bian, W. Physics-Guided Dynamic Sparse Attention Network for Gravitational Wave Detection Across Ground and Space-Based Observatories. Electronics 2026, 15, 838. https://doi.org/10.3390/electronics15040838
Zhang T, Bian W. Physics-Guided Dynamic Sparse Attention Network for Gravitational Wave Detection Across Ground and Space-Based Observatories. Electronics. 2026; 15(4):838. https://doi.org/10.3390/electronics15040838
Chicago/Turabian StyleZhang, Tiancong, and Wei Bian. 2026. "Physics-Guided Dynamic Sparse Attention Network for Gravitational Wave Detection Across Ground and Space-Based Observatories" Electronics 15, no. 4: 838. https://doi.org/10.3390/electronics15040838
APA StyleZhang, T., & Bian, W. (2026). Physics-Guided Dynamic Sparse Attention Network for Gravitational Wave Detection Across Ground and Space-Based Observatories. Electronics, 15(4), 838. https://doi.org/10.3390/electronics15040838

